Questions[plesk](server)

I have a VPN configured with Plesk.

(I have installed a SSL/TLS certificate, through Plesk, using Lets Encrypt. Everything seems good as far as I can tell, but I mention it as it also protects emails.)

I have setup a mail forward, without a mailbox.

To test it, I use my GMail account to send an email to the [email protected], which should be forwarded back to the same GMail I sent it from.

This the tail of /var/log/maillog:

Dec 30 23:05:55 vps-1234 journal: plesk sendmail[21517]: handlers_stderr: SKIP
Dec 30 23:05:55 vps-1234 journal: plesk sendmail[21517]: SKIP during call 'check-quota' handler
Dec 30 23:05:55 vps-1234 postfix/pipe[21511]: 7A3BC4B7E3: to=<[email protected]>, relay=plesk_virtual, delay=1.5, delays=0.72/0.02/0/0.76, dsn=2.0.0, status=sent (delivered via plesk_virtual service)
Dec 30 23:05:55 vps-1234 postfix/qmgr[21455]: 7A3BC4B7E3: removed
Dec 30 23:05:55 vps-1234 postfix/pickup[21454]: EAFA74B7E5: uid=30 from=<[email protected]>
Dec 30 23:05:55 vps-1234 postfix/cleanup[21501]: EAFA74B7E5: message-id=<CAAg_DarPpmMvHyar=2xYDHNE6w-UeKQfPSuUMfgyG44xzFY8Dg@mail.gmail.com>
Dec 30 23:05:55 vps-1234 postfix/qmgr[21455]: EAFA74B7E5: from=<[email protected]>, size=4544, nrcpt=1 (queue active)
Dec 30 23:05:57 vps-1234 postfix/smtp[21532]: EAFA74B7E5: to=<[email protected]>, relay=gmail-smtp-in.l.google.com[74.125.192.26]:25, delay=2, delays=0.02/0.02/0.54/1.4, dsn=2.0.0, status=sent (250 2.0.0 OK  1609369557 h6si28285381qth.374 - gsmtp)
Dec 30 23:05:57 vps-1234 postfix/qmgr[21455]: EAFA74B7E5: removed

I noticed the [email protected] that is a weird made up email that I think should either be [email protected] or [email protected], but it seem the email is sent properly...

Yet it is not in my Inbox or my Spam folder on GMail. Any ideas ?

Edit1:

Following the comment confirming Google did received my email, I have added the domain on https://postmaster.google.com. The domain is validated, but there is no data being displayed.

I have also ran the domain through https://mxtoolbox.com/emailhealth/ and I do have the following warnings:

dmarc   mydomain.ca DMARC Quarantine/Reject policy not enabled
mx      mydomain.ca DMARC Quarantine/Reject policy not enabled
smtp    mail.mydomain.ca    Reverse DNS does not match SMTP Banner

I am currently trying to resolve the last one, but as I understand none of those warnings should justify the email not being delivered.

Currently the SMTP banner is:

$ telnet localhost 25
Trying ::1...
Connected to localhost.
Escape character is '^]'.
220 mydomain.ca ESMTP Postfix

My current thesis is that the domain and IP is new and might not have a good reputation enough yet, but I currently have no way to confirm that yet (as postmaster is not displaying anything)

today i've checked our server status with htop and i saw somethig that i could not believe.

Could someone please answer me the following questions?

1. Why are there so much mysqld processes?
2. Why they are running for so long?

On this server we have a plesk system with 3 PHP Symfony Projects running. Only 1 project has load.

The server has 12 cores and 126GB of RAM (it's dedicated)

htop

I have a file uploaded to our website under a /Downloads folder, which I created. The download link, similar to:

A Sample Download Link

had no issues downloading up until a few weeks ago. I am not sure what changed.

I now receive(d) 403 Forbidden nginx as the message. I put past tense, because I saw this SO article. I implemented the solution and the error changed. I now get:

Forbidden

You do not have permission to access this document.

Permissions are file, same as every other file on the web server. Linux is on the back-end and presumably uses Apache.

I talked with the web hosting company and they were not helpful. Making the file name lower case for cosmetic reasons made me hiss and deleting the .exe extension and saying problem solved made me doubly hiss. Neither explains the problem or the solution.

NGINX is obviously part of the picture. That is simply part of the web host package, much like a radio when you lease a car. You get it whether you want it or not, not that NGINX is necessarily the problem.

Permissions on Download and down:

rwx r-x r-x

Someone else added the executable permission, which I want to delete, as the file should be downloadable only, not executable on the server. The web host support technician a few weeks should not have done that. I just left it for now.

Plesk Control Panel

Technician added the following into the Apache and nginx settings area.

Into both Additional Directives for HTTP/HTTPS:

<Location /shared/>
     Options +Indexes
</Location>

I easily found this morning In the Plesk panel, under the Apache & nginx settings for the domain. Checking the box: 'Serve static files directly by nginx' and placed a check in the box, but now I do not see this option there.

Everything else is standard issue (I reserve using the word default, as the index file box has a laundry list and not default checked.).

Thoughts?

Currently exploring the relation between Plesk and AWS

As of now my AWS account showing the Memory Disk SSD Usage of 30GB of my account

Where it says 40%+ of memory are being used out of 30GB

and Relational Database System of AWS showing no current data

and my AWS Account doesn't run a single instance of ec2

My question is, how does the Plesk uses AWS when it comes to storage?

Because as of now My plesk contains the files of my wordpress site and database of site using phpmyadmin (mysql)

My website playsongs.pk got 499, 502 and php-fpm.sock failed (11: Resource temporarily unavailable) errors when I received 300-400 active users on site.

Sample/example error logs:

2017-02-27 14:56:23 Error   162.158.78.50   499 GET / HTTP/1.1          0   nginx access
2017-02-27 14:56:23 Error   162.158.78.20   502 GET / HTTP/1.1          166     nginx access
2017-02-27 14:56:23 Error   162.158.78.170  502 GET / HTTP/1.1          166     nginx access
2017-02-27 14:56:23 Error   162.158.79.63   502 GET / HTTP/1.1          166     nginx access
2017-02-27 14:56:23 Error   162.158.78.50   499 GET / HTTP/1.1          0   nginx access
2017-02-27 14:56:23 Error   162.158.78.20   499 GET / HTTP/1.1          0   nginx access
2017-02-27 14:56:23 Error   162.158.78.20   499 GET / HTTP/1.1          0   nginx access
2017-02-27 14:56:23 Error   162.158.78.20   499 GET / HTTP/1.1          0   nginx access
2017-02-27 14:56:23 Error   162.158.78.20   499 GET / HTTP/1.1          0   nginx access

and After few time I got

2017-02-27 14:56:23 Error   172.68.65.4     24026#0: *2784527 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24023#0: *2784529 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.100       24028#0: *2784539 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24021#0: *2784541 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24021#0: *2784545 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24021#0: *2784547 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24028#0: *2784549 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   162.158.78.50       24028#0: *2784551 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error
2017-02-27 14:56:23 Error   172.68.65.112       24028#0: *2784552 connect() to unix:///var/www/vhosts/system/playsongs.pk/php-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream               nginx error

My Nginx configuration /etc/nginx/nginx.conf:

user  nginx;
worker_processes auto; #some last versions calculate it automatically

worker_rlimit_nofile 99999;

error_log /var/log/nginx/error.log crit;

include /etc/nginx/modules.conf.d/*.conf;

events {

    worker_connections 66536;
    use epoll;
    multi_accept on;
}

http {
    include   mime.types;
    default_type  application/octet-stream;

    open_file_cache max=2048 inactive=20s;
    open_file_cache_valid 30s;
    open_file_cache_min_uses 5;
    open_file_cache_errors off;


    access_log off;

    sendfile on;
    tcp_nopush on;
    tcp_nodelay on;

    keepalive_timeout  2;
    keepalive_requests 100000;
    reset_timedout_connection on;
    client_body_timeout 30;
    send_timeout 15;

client_header_timeout 12;
proxy_connect_timeout  60;
proxy_send_timeout  60;
proxy_read_timeout  60;


fastcgi_buffers 8 128k;
fastcgi_buffer_size 256k;

# reduce the data that needs to be sent over network
    gzip on;
    gzip_min_length 1000;
    gzip_proxied expired no-cache no-store private auth;
    gzip_types application/x-javascript text/css application/javascript text/javascript text/plain text/xml application/json application/v$
    gzip_disable "MSIE [1-6]\.(?!.*SV1)";


    server_tokens off;

    include /etc/nginx/conf.d/*.conf;
}

# override global parameters e.g. worker_rlimit_nofile
include /etc/nginx/*global_params;

My php-fpm pool setting are following:

;[php-fpm-pool-settings]
pm = dynamic
pm.max_children = 5000
pm.start_servers = 50
pm.min_spare_servers = 20
pm.max_spare_servers = 70
pm.max_requests = 2000

Please note

Server have 64GB of RAM with 1 GBit dedicate INTERNET PORT and average load on CPU also does not exceed from 1.somthing % or 2.somthing %

Server OS: Centos 7.2

Control Panel: Plesk Onyx

nginx Version: nginx/1.11.4

Output of #cat /proc/$(cat /run/nginx.pid)/limits is following. May it will be helpful to solve the issue.

Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        0                    unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             515124               515124               processes
Max open files            1024                 4096                 files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       515124               515124               signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                   
Max realtime priority     0                    0                   
Max realtime timeout      unlimited            unlimited            us

Output of tail /var/log/nginx/error.log

2017/03/01 15:16:15 [notice] 31867#0: getrlimit(RLIMIT_NOFILE): 1024:4096
2017/03/01 15:16:15 [notice] 31868#0: start worker processes
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31869
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31870
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31871
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31872
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31873
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31874
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31875
2017/03/01 15:16:15 [notice] 31868#0: start worker process 31876