Home / user-232846

Kostiuk Aleksandr's questions

Martin Hope
Kostiuk Aleksandr
Asked: 2016-12-01 03:07:28 +0800 CST
  • -1

The main task of the analyzer - referring sites, referrers URLs. Logs are collected in one place from 3 nginx server. I install awstats with a specific parameter LogFormat - all working fine, but the customer was not enough, we need statistics referring site and referrers URLs per day, awstats provides only for a month.

I found project goaccess, but again, in the demo, I did not see the possibility of statistics for a day (or a certain period).

logstash + elasticsearch + kibana - never work with this soft, i need solution as fast as can)

Please, advise me the solution, thank you)

log-files analysis nginx awstats goaccess
Martin Hope
Kostiuk Aleksandr
Asked: 2016-09-01 11:10:34 +0800 CST
  • 0

After some server configuration, i decided to do a stress test using siege.

2 front servers in lxc containers, load balancing nginx - on the host machine. (if need, I add nginx and sysctl configs later)

Host machine - dedicated server on OVH:

Intel  Xeon E5
2x E5-2630v3 2.4 GHz (32 cores at all)
128 GB of RAM DDR3
2x 480GB SSD (RAID 1)

Some parameters of containers:

8 cores, 8192 cpu units per core
8 GB RAM

In lxc conteiners - php + static (images, css, js). Future load will be on static content output. The test was conducted on a static page with js, css and images.

In general, the test results are different, and strange behavior:

siege http://example.com/some_url -r50 -c250

test #1:

Transactions: 12451 hits
Availability: 99.61 %
Elapsed time: 36.84 secs
Data transferred: 80.52 MB
Response time: 0.06 secs
Transaction rate: 337.98 trans/sec
Throughput: 2.19 MB/sec
Concurrency: 21.43
Successful transactions: 12451
Failed transactions: 49
Longest transaction: 1.18
Shortest transaction: 0.04

test #2, same parameters

Transactions: 12152 hits
Availability: 97.22 %
Elapsed time: 200.90 secs
Data transferred: 29.16 MB
Response time: 1.15 secs
Transaction rate: 60.49 trans/sec
Throughput: 0.15 MB/sec
Concurrency: 69.67
Successful transactions: 12152
Failed transactions: 348
Longest transaction: 63.40
Shortest transaction: 0.16

In the first case, a good performance, sometime during the second results worse and strange behavior, namely:
It begins test - CPU of each container is loaded on ~50%, but load decreases over time, and the response time - increases, appears connection timeouts. Then the speed is increased, and those "waves" before end of the test. During tests no anomaly in top/htop, disks I/O or servers logs. Thanks in advance for your advice;)

load-balancing nginx benchmark lxc
Martin Hope
Kostiuk Aleksandr
Asked: 2016-02-26 02:57:54 +0800 CST
  • 0

I'm interesting in how i can monitor which request on which URL creates high load on database(mysql) and php scripts. Now i use zabbix(2.4), but i cannot find something what can me help with this. Maybe anybody can advise me some tools, ideas for scripts or maybe another monitoring system for this goal? I've seen that NewRelic have such this functionality, but it's too expensive for me.

P.S. It's not enough for me

monitoring
Martin Hope
Kostiuk Aleksandr
Asked: 2014-10-29 02:16:23 +0800 CST
  • 0

After last reload nginx i have error nginx: [emerg] chown("/gypost/uploads/00", 1001) failed (1: Operation not permitted)

192.168.0.91:/gypost/mail/u
                      247G   17G  218G   7% /gypost/uploads

it's a mounted directory

exports for this client: 

/gypost/mail/u  192.168.0.93(rw,insecure,nohide,sync,no_subtree_check,anonuid=1003,anongid=33,no_all_squash)

fstab in client:

192.168.0.91:/gypost/mail/u     /gypost/uploads         nfs     rw,auto         1       3

In location nginx block: 

upload_store /gypost/uploads/00;

A few days ago, it was working correctly. Where problem?

I found the problem, why nginx could not chown. In mount point was several files with permissions 500 (do not know where they came from). But why mounting occur under wrong user, i did not understand (but it does not matter for me).

nginx