Home / server / Questions

Questions[netdata](server)

Martin Hope
Joseph
Asked: 2021-09-23 22:37:55 +0800 CST
  • 2

I have a server with the following characteristics: https://www.soyoustart.com/it/offerte/1801sysgame05.xml

Processor Intel i7-4790K

RAM 32GB DDR3 1333MHz

Traffic Unlimited Anti-DDoS Included

Disks 1x240GB SSD

Bandwidth 250 Mbps

I've installed the Proxmox Linux distribution that runs a container based on Ubuntu server to handle a real-time TCP game server written in C++ that, at the moment, reached around 1000 online users, and we are going to double the current population soon.

The problem is that we are encountering a weird performance "bottleneck" as soon as the number of online users reaches ~850. As soon as it returns to ~800 or less, the bottleneck disappears. What practically happens is that players have to wait for about 30s to be connected to the server, while the players already connected are not experiencing any issue (no latency, no freezes etc.). It seems like network congestion, or cap-limit, or something similar that denies further connections to the same process and creates pressure on our CPU (as you can see from the screenshots below)

Here I have collected some graphs from our NetData where I have noticed the same "pattern". The softirqs RCU is particularly meaningful I guess but I do not know what does it mean exactly.

softirqs RCU: image

cpu usage/pressure: image

cpu frequency image

cpu temperature

image

I do not believe that the fault is our CPU itself, but as said above, seems like something related to a process limitation or something similar.

Do you have any idea of what's going on?

UPDATE:

another related graph

image

tcp proxmox cpu-usage irq netdata
Martin Hope
suther
Asked: 2021-06-04 05:30:07 +0800 CST
  • 3

Currently I do setup monitoring-service for our Server. I've found some articles, which recommend to use: Netdata, prometheus and grafana

So I wonder what are the benefits to use all three of them. Can anybody explain it to me, why prometheus and grafana is recommended, if it's seems that netdata do the same stuff as those both?

Even at the netdata-documentations, there are an article about the setup for this: https://learn.netdata.cloud/docs/agent/backends/prometheus/#filtering-metrics-sent-to-prometheus

What are the benefits of this constellation?

monitoring prometheus grafana netdata
Martin Hope
Arwed Mett
Asked: 2020-09-20 06:15:58 +0800 CST
  • 0

I run netdata on my server to monitor it. Therefore I use an NGINX Reverse Proxy together with Letsencrypt and the Authorization feature of NGINX to make it accessible via the internet.

upstream netdata {
    server localhost:19999;
    keepalive 64;
}

server {
    server_name netdata.<mydomain>;
    access_log /var/log/nginx/netdata-access.log combined;
    error_log /var/log/nginx/netdata-error.log error;

    location / {
        proxy_pass http://netdata;

        auth_basic "Administrator’s Area";
        auth_basic_user_file /etc/nginx/.htpasswd;
    }

    #... Here is the Letsencrypt generated stuf    
}

Most of the time when I call the website netdata loads either very slow or not at all. Sometimes it loads.

When I look in the error logs, I see the following but do not know how to resolve that issue.

*66 upstream timed out (110: Unknown error) while connecting to upstream
nginx netdata
Martin Hope
zeflex
Asked: 2020-02-26 10:27:00 +0800 CST
  • 0

Since I enabled mariadb logs for all queries on my server, using Netdata shows me each second these queries:

SHOW GLOBAL VARIABLES LIKE 'max_connections'
11 Query     SHOW GLOBAL STATUS
11 Query     commit

I have to say it's not helping me to invest what's going on on the server because it's polluting my logs.

Is there a way to avoid logging this kind of query each sec?

mysql centos7 mariadb netdata
Martin Hope
hymie
Asked: 2019-02-12 10:06:10 +0800 CST
  • 1

I've just installed netdata for testing as a replacement (or augment) for nagios. I have it installed on one machine and it's great.

However, I'm trying to install netdata on a second machine ("cougar"), with the intent of using the first machine ("rolls-royce") as my sole dashboard/viewing host.

I believe I have followed the directions correctly from https://docs.netdata.cloud/streaming/ for setting up a "headless collector", where "cougar" is my "slave" instance and "rolls-royce" is my "master" instance.

Update: I also figured out that I need to have my own "registry"

cougar netdata.conf

 [global]
     memory mode = none

 [web]
     mode = none

[registry]
    # enabled = no
    registry to announce = http://rolls-royce:19999

cougar stream.conf

[stream]
    enabled = yes
    destination = rolls-royce:19999
    api key = 9447dae1-0830-4edd-9e70-1cd125844b65
    timeout seconds = 60
    default port = 19999

rolls-royce netdata.conf

[registry]
    enabled = yes
    registry to announce = http://rolls-royce:19999

rolls-royce stream.conf

[stream]
    enabled = no


[9447dae1-0830-4edd-9e70-1cd125844b65]
    enabled = yes
    allow from = *
    default history = 3600
    default memory mode = save
    health enabled by default = auto
    multiple connections = allow

And I think I see data being collected in the logs, and cache files being created.

However, I cannot figure out how to view my "cougar" data from my "rolls-royce" dashboard.

The documentation refers to a "my-netdata" menu. I don't have a "my-netdata" menu. I have a menu entitled "rolls-royce", with only a single entry for "rolls-royce http://rolls-royce:19999/" but no entry for "cougar".

Can anybody help me figure out what I am missing?

netdata