Guntis's questions

Searched for a while and cannot find answer or even directions to look forward.

So. XCP-NG cluster of three servers HP DL360p G8, MSA 2060 iSCSI NAS with 12 SAS 10K drives, QNAP TS-1273U-RP, Mikrotik CRS317 switch. Storage network is in dedicated bridge in mikrotik. All devices connected with 3meter copper cables. All devices shows that link is 10G. I even configured MTU to 9000 to all devices. Each server has Ethernet card with two interfaces. One is used for storage network only (eth1 on all three servers). Different subnet for storage network and management network. Xen network backend is openvswitch.

Jumbo frames is working:

ping -M do -s 8972 -c 2 10.100.200.10 -- QNAP
PING 10.100.200.10 (10.100.200.10) 8972(9000) bytes of data.
8980 bytes from 10.100.200.10: icmp_seq=1 ttl=64 time=1.01 ms
8980 bytes from 10.100.200.10: icmp_seq=2 ttl=64 time=0.349 ms

--- 10.100.200.10 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.349/0.682/1.015/0.333 ms

ping -M do -s 8972 -c 2 10.100.200.8 -- MSA 2060
PING 10.100.200.8 (10.100.200.8) 8972(9000) bytes of data.
8980 bytes from 10.100.200.8: icmp_seq=1 ttl=64 time=9.83 ms
8980 bytes from 10.100.200.8: icmp_seq=2 ttl=64 time=0.215 ms

--- 10.100.200.8 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.215/5.023/9.832/4.809 ms

Problem: when i copy virtual machine from one storage (QNAP) to another (MSA) write speed is about 45MB/s. When i copy some large file from QNAP (ex: iso install) to servers local storage, speed is about 100MB/s and in that server htop shows one core with 100% load

It is clearly visible that network is working like 1G network.

Some info about hardware.

ethtool -i eth1
driver: ixgbe
version: 5.5.2
firmware-version: 0x18b30001
expansion-rom-version:
bus-info: 0000:07:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

ethtool eth1
Settings for eth1:
        Supported ports: [ FIBRE ]
        Supported link modes:   10000baseT/Full
        Supported pause frame use: Symmetric
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  10000baseT/Full
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Port: Direct Attach Copper
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: off
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes

lspci | grep net
07:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
07:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

Then i ran iper3 server on this host: iperf3 -s -4 Results on server host:

[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec                  sender
[  5]   0.00-10.04  sec  5.48 GBytes  4.69 Gbits/sec                  receiver
[  7]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec                  sender
[  7]   0.00-10.04  sec  5.44 GBytes  4.66 Gbits/sec                  receiver
[SUM]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec                  sender
[SUM]   0.00-10.04  sec  10.9 GBytes  9.35 Gbits/sec                  receiver

And client on another host: iperf3 -c 10.100.200.20 -P 2 -t 10 -4 Results on client host:

[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  5.49 GBytes  4.72 Gbits/sec  112             sender
[  4]   0.00-10.00  sec  5.48 GBytes  4.71 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  5.45 GBytes  4.68 Gbits/sec  178             sender
[  6]   0.00-10.00  sec  5.44 GBytes  4.67 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  10.9 GBytes  9.40 Gbits/sec  290             sender
[SUM]   0.00-10.00  sec  10.9 GBytes  9.38 Gbits/sec                  receiver

What to test next or how to find bottleneck?

iperf3 shows that link is working with 10Gbit speed or i interpret results incorrectly?

Software versions:

xe host-list params=software-version
software-version (MRO)    : product_version: 8.2.0; product_version_text: 8.2; product_version_text_short: 8.2; platform_name: XCP; platform_version: 3.2.0; product_brand: XCP-ng; build_number: release/stockholm/master/7; hostname: localhost; date: 2021-05-20; dbv: 0.0.1; xapi: 1.20; xen: 4.13.1-9.11.1; linux: 4.19.0+1; xencenter_min: 2.16; xencenter_max: 2.16; network_backend: openvswitch; db_schema: 5.602


software-version (MRO)    : product_version: 8.2.0; product_version_text: 8.2; product_version_text_short: 8.2; platform_name: XCP; platform_version: 3.2.0; product_brand: XCP-ng; build_number: release/stockholm/master/7; hostname: localhost; date: 2021-05-20; dbv: 0.0.1; xapi: 1.20; xen: 4.13.1-9.11.1; linux: 4.19.0+1; xencenter_min: 2.16; xencenter_max: 2.16; network_backend: openvswitch; db_schema: 5.602


software-version (MRO)    : product_version: 8.2.0; product_version_text: 8.2; product_version_text_short: 8.2; platform_name: XCP; platform_version: 3.2.0; product_brand: XCP-ng; build_number: release/stockholm/master/7; hostname: localhost; date: 2021-05-20; dbv: 0.0.1; xapi: 1.20; xen: 4.13.1-9.11.1; linux: 4.19.0+1; xencenter_min: 2.16; xencenter_max: 2.16; network_backend: openvswitch; db_schema: 5.602

Other two servers have HP 530FLR-SFP+ cards:

    lspci | grep net
    03:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
    03:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)

ethtool -i eth1
driver: bnx2x
version: 1.714.24 storm 7.13.11.0
firmware-version: bc 7.10.10
expansion-rom-version:
bus-info: 0000:03:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

ethtool eth1
Settings for eth1:
        Supported ports: [ FIBRE ]
        Supported link modes:   1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  10000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Port: Direct Attach Copper
        PHYAD: 1
        Transceiver: internal
        Auto-negotiation: off
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x00000000 (0)

        Link detected: yes

Edit 1: Local storage test:

dmesg | grep sda
[   13.093002] sd 0:1:0:0: [sda] 860051248 512-byte logical blocks: (440 GB/410 GiB)
[   13.093077] sd 0:1:0:0: [sda] Write Protect is off
[   13.093080] sd 0:1:0:0: [sda] Mode Sense: 73 00 00 08
[   13.093232] sd 0:1:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   13.112781]  sda: sda1 sda2 sda3 sda4 sda5 sda6
[   13.114348] sd 0:1:0:0: [sda] Attached SCSI disk
[   15.267456] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem
[   15.268750] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[   17.597243] EXT4-fs (sda1): re-mounted. Opts: (null)
[   18.991998] Adding 1048572k swap on /dev/sda6.  Priority:-2 extents:1 across:1048572k
[   19.279706] EXT4-fs (sda5): mounting ext3 file system using the ext4 subsystem
[   19.281346] EXT4-fs (sda5): mounted filesystem with ordered data mode. Opts: (null)

dd if=/dev/sda of=/dev/null bs=1024 count=1000000
1000000+0 records in
1000000+0 records out
1024000000 bytes (1.0 GB) copied, 11.1072 s, 92.2 MB/s

This is strange, because server has Smart Array P420i Controller with 2GB cache, hardware raid10 of 6 146GB 15k SAS drives. iLo shows that with storage all is ok. On another server results is similar 1024000000 bytes (1.0 GB) copied, 11.8031 s, 86.8 MB/s

Edit 2 (Shared storage test):
Qnap (SSD Raid10):

dd if=/run/sr-mount/23d45731-c005-8ad6-a596-bab2d12ec6b5/01ce9f2e-c5b1-4ba8-b783-d3a5c1ac54f0.vhd of=/dev/null bs=1024 count=1000000
1000000+0 records in
1000000+0 records out
1024000000 bytes (1.0 GB) copied, 11.2902 s, 90.7 MB/s

MSA (HP MSA-DP+ raid):

dd if=/dev/mapper/3600c0ff000647bc2259a2f6101000000 of=/dev/null bs=1024 count=1000000
1000000+0 records in
1000000+0 records out
1024000000 bytes (1.0 GB) copied, 11.3974 s, 89.8 MB/s

No more than 1 Gigabit network ... So, if i transfer VM images between shared storage, then local storage isn't involved. Can openvswitch be bottleneck?

Edit 3 (More disk tests):
sda = Raid10 of 6 x 146GB 15k sas, sdb = one 146GB 15k SAS in raid0

dd if=/dev/sdb of=/dev/null bs=1024 count=1000000
1000000+0 records in
1000000+0 records out
1024000000 bytes (1.0 GB) copied, 16.5326 s, 61.9 MB/s
[14:35 xcp-ng-em ssh]# dd if=/dev/sdb of=/dev/null bs=512k count=1000
1000+0 records in
1000+0 records out
524288000 bytes (524 MB) copied, 8.48061 s, 61.8 MB/s
[14:36 xcp-ng-em ssh]# dd if=/dev/sdb of=/dev/null bs=512k count=10000
10000+0 records in
10000+0 records out
5242880000 bytes (5.2 GB) copied, 84.9631 s, 61.7 MB/s
[14:37 xcp-ng-em ssh]# dd if=/dev/sda of=/dev/null bs=512k count=10000
10000+0 records in
10000+0 records out
5242880000 bytes (5.2 GB) copied, 7.03023 s, 746 MB/s

I have encrypted luks partition. Key file is located on USB flash drive. I also created copy of that flash drive to another flash. How I can add two mount points in /etc/fstab that points to same target directory. Booth flash drives to server not connected at same time. I just want to setup system that I can replace USB flash if it fails and system boots up correctly.

/etc/crypttab contains

cryptolvm       /dev/disk/by-uuid/a172345c-c0bd-1234-abcd-3febeeef9730  /media/sdb1/keyfile     luks

/etc/fstab (USB part of)

#kingston 16GB 
UUID=622548b9-2223-4444-1234-5f61228bfa1c /media/sdb1   ext3    ro,nosuid,nodev,nofail,x-gvfs-show 0 0

# Adata 16GB 
UUID=7342c8a5-4321-1111-1234-34742b566af1 /media/sdb1   ext3    ro,nosuid,nodev,nofail,x-gvfs-show 0 0

At this moment when server boots it show errors:

1) systemd-fstab-generator: failed to create mount unit file /run/systemd/generator/media-sdb1.mount, as it already exists. Duplicate entry in /etc/fstab?
2) dependency failed for /media/sdb1

It's time to replace old server with new one. In old server all was setup on bare metal. With new server I try to set up virtual server for specific task.

Host OS is Debian 9. Guests I will run in HVM mode (also Debian). Planned servers are: MySql, email (postfix,curys,spam filters and all related to email), web server (nginx+php), web proxy (SSL terminator)

But question is about networking. I do not want that guests are visible from outside and they do not have public IP. But each guest must see other guests.

I created two bridges. hostbr0 and xenbr0. In hostbr0 I added physical interface eno1 witch has one static IP (public). In xenbr0 I added vdum1 interface.

vdum1 is virtual interface with dummy module, IP = 192.168.1.1. For all guests IP address is from 192.168.1.0 subnet. So all guests are in one network.

How I can configure iptables, so that guests have internet access? I am not asking for exact commands but for directions. Do I need to setup masquerading? Then witch interface must masquerade? Is it possible to set forwarding between bridges?

I already tried masquerading booth bridges and also interfaces but I cannot access internet from guest OS.

I also want to control guest access to internet. For example, mysql guest do not need internet at all (in general).

On host OS I will use shorewall.

I am trying to stop spam from one sender. They each time uses another mail server. here is headers from original email (i replaced my email and host with: [email protected], sender email and host i replaced with: [email protected], all other is unchanged):

From - Mon Jan 27 14:17:08 2014
X-Account-Key: account7
X-UIDL: 1201266183.11294
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00000000
X-Mozilla-Keys:                                                                                 
Return-Path: <[email protected]>
Received: from my-domain.com ([unix socket])
     by localhost (Cyrus v2.2.13-Debian-2.2.13-10) with LMTPA;
     Mon, 27 Jan 2014 14:15:18 +0200
X-Sieve: CMU Sieve 2.2
X-Greylist: delayed 460 seconds by postgrey-1.27 at mnl-bck; Mon, 27 Jan 2014 14:15:05 EET
Received: from gw13.delivery-gate.com (gw13.delivery-gate.com [72.29.83.9])
    by my-domain.com (ESMTP daemon) with ESMTP id 999EA15F505
    for <[email protected]>; Mon, 27 Jan 2014 14:15:05 +0200 (EET)
MIME-Version: 1.0
From: Blah blah blah <[email protected]>
To: [email protected]
X-Original-To: [email protected]
Reply-To: Blah blah blah <[email protected]>
Subject: {(***Disarmed***)} =?UTF-8?B?VmFsZW50xKtuYSBkaWVuYSBuxIFrIQ==?=
Date: Mon, 27 Jan 2014 12:07:07 +0000
DKIM-Signature: v=1; a=rsa-sha1; q=dns/txt; l=6092; s=default;
    t=1390824427; c=relaxed/simple;
    h=From:To:Subject;
    d=delivery-gate.com;
    z=From:=20Blah blah blah=20<[email protected]>
    |To:[email protected]
    |Subject:=20=3D?UTF-8?B?VmFsZW50xKtuYSBkaWVuYSBuxIFrIQ=3D=3D?=3D;
    bh=fOfN6GO2cjh0ZljdK73x8C71zUg=;
    b=BGlxwArEBjFsawRUIO7e9DyOBaUvFs0xgUCPKVkOXVoF0ND5BKxQzCuDqpV3ek1kOGo/gn0UaCH0j405y/XXEfhTE83NN6C/V7zY2pcxf6iBeMAxxqy93CNL1UsAjRLhZOBhg2m1c47WPpHzZdn9dOxXM190YD6x+xqHo8Ydu+c=
Content-Type: multipart/alternative;
    boundary="=_6ec15ca19a7f51e90ef52ebaa3d3dfc1"
Message-Id: <[email protected]>
X-my-domain.com-MailScanner: Found to be clean
X-my-domain.com-MailScanner-SpamScore:  2.77
X-my-domain.com-MailScanner-From: [email protected]
X-MailScanner-Envelope-To: [email protected]


--=_6ec15ca19a7f51e90ef52ebaa3d3dfc1
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain; charset="UTF-8"

I edited /etc/postfix/sender_access to reject email from sender-website.com. But that does not work, because postfix is seeing that email comes from different sender/server. From postfix log file:

Jan 27 14:15:05 myMailServer postfix/smtpd[12822]: connect from gw13.delivery-gate.com[72.29.83.9]
Jan 27 14:15:05 myMailServer postgrey[4304]: delayed 460 seconds: client=gw13.delivery-gate.com, from=4a590193769-#-#@delivery-gate.com, [email protected]
Jan 27 14:15:05 myMailServer postfix/policy-spf[12827]: : testing: stripped [email protected], stripped [email protected]
Jan 27 14:15:05 myMailServer postfix/policy-spf[12827]: : SPF pass: smtp_comment=Please see http://www.openspf.org/why.html?sender=4a590193769-1-589%40delivery-gate.com&ip=72.29.83.9&receiver=myMailServer: 72.29.83.0/24 contains 72.29.83.9, header_comment=myMailServer: domain of [email protected] 72.29.83.9 as permitted sender
Jan 27 14:15:05 myMailServer postfix/policy-spf[12827]: decided action=DUNNO
Jan 27 14:15:05 myMailServer postfix/smtpd[12822]: 999EA15F505: client=gw13.delivery-gate.com[72.29.83.9]
Jan 27 14:15:05 myMailServer postfix/cleanup[12829]: 999EA15F505: hold: header Received: from gw13.delivery-gate.com (gw13.delivery-gate.com [72.29.83.9])??by my-domain.com (ESMTP daemon) with ESMTP id 999EA15F505??for <[email protected]>; Mon, 27 Jan 2014 14:15:05 +0200 (EET) from gw13.delivery-gate.com[72.29.83.9]; from=<[email protected]> to=<[email protected]> proto=ESMTP helo=<gw13.delivery-gate.com>
Jan 27 14:15:05 myMailServer postfix/cleanup[12829]: 999EA15F505: message-id=<[email protected]>
Jan 27 14:15:05 myMailServer postfix/smtpd[12822]: disconnect from gw13.delivery-gate.com[72.29.83.9]

So, when i am looking message source in thunderbird, i see header: From: Blah blah blah <[email protected]>. How i can block email from that sender (sender-website.com)? There is no point to block IP, because next time it will different. I have also set up MailScanner, but that too does not see proper from header. I already blacklisted that domain in MailScanner too.

Can anyone explain how i can use theses directives? I found official documentation here. But not much explained.

Here is problem. Server A is running cpanel, php 5.3.10

php.ini contains this:

suhosin.executor.disable_eval=On
[PATH=/home/username/public_html]
suhosin.executor.disable_eval=Off

I have file under: /home/username/public_html/afd/evaltest.php and eval is working. If i comment path section, php shows error, that eval is disabled. So, all is working as expected.

Server B is the same, but php version is 5.3.19 and application is codeigniter and that does not working. If i add to php.ini

[HOST=www.example.com]
suhosin.executor.disable_eval=Off

[HOST=example.com]
suhosin.executor.disable_eval=Off

then all works like expected. So, why path does not work on server B ?

Can i add multiple path to directive? like this

[PATH=/home/username/public_html, /home/username2/public_html, /home/usernameN/public_html]
suhosin.executor.disable_eval=Off

or

[PATH=/home/username/public_html]
[PATH=/home/username2/public_html
[PATH=/home/usernameN/public_html
suhosin.executor.disable_eval=Off

on both serves php is running as suPHP.

I have windows server 2003. What permissions is required, to user bob can print on printer who is attached to computer where sits alice. Of course, booth users are connected to server.
At this moment i have user bob in Power operators group. But i want to allow only print to another users printers.
If i put user in printer operators group, then that user does'n see other printers.

Server is HP DL360 G7 with P410i disk controller. 2xE5620 CPU's. 16GB RAM. Linux mysql 2.6.32-5-amd64 #1 SMP Mon Feb 25 00:26:11 UTC 2013 x86_64 GNU/Linux (Debian 6.0.7)
hpacucli "ctrl all show status"

Smart Array P410i in Slot 0 (Embedded)
   Controller Status: OK
   Cache Status: OK
   Battery/Capacitor Status: OK

hpacucli "ctrl all show config"

Smart Array P410i in Slot 0 (Embedded)    (sn: 5001438014555B80)

   array A (SAS, Unused Space: 0 MB)


      logicaldrive 1 (136.7 GB, RAID 1+0, OK)

      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 72 GB, OK)
      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 72 GB, OK)
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS, 72 GB, OK)
      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS, 72 GB, OK)

   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 250 (WWID: 5001438014555B8F)

hpacucli "ctrl slot=0 ld all show"

Smart Array P410i in Slot 0 (Embedded)

   array A

      logicaldrive 1 (136.7 GB, RAID 1+0, OK)

I run fallowing script via night:

#!/bin/bash
mkdir -p /isotest
for i in {1..200}; do
    for j in {1..55}; do cp -v /root/ubuntu.iso /isotest/ubuntu.iso${j}; done
    rm /isotest/ubuntu.iso*;
done

/root/ubuntu.iso size is abou 2 GB.

in syslog has some errors. I think that it is related to disk controller:

Mar 28 06:59:17 mysql kernel: [850337.524306] INFO: task mandb:25565 blocked for more than 120 seconds.
Mar 28 06:59:17 mysql kernel: [850337.524337] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 28 06:59:17 mysql kernel: [850337.524381] mandb         D ffff88022740fa20     0 25565  25197 0x00000000
Mar 28 06:59:17 mysql kernel: [850337.524385]  ffff88041ec4b880 0000000000000082 0000000000000000 000000009d778d11
Mar 28 06:59:17 mysql kernel: [850337.524388]  ffffea000defe260 ffffea000defe260 000000000000f9e0 ffff88014d913fd8
Mar 28 06:59:17 mysql kernel: [850337.524390]  00000000000157c0 00000000000157c0 ffff88013228a350 ffff88013228a648
Mar 28 06:59:17 mysql kernel: [850337.524393] Call Trace:
Mar 28 06:59:17 mysql kernel: [850337.524404]  [<ffffffff810168ec>] ? read_tsc+0xa/0x20
Mar 28 06:59:17 mysql kernel: [850337.524408]  [<ffffffff8106bdca>] ? timekeeping_get_ns+0xe/0x2e
Mar 28 06:59:17 mysql kernel: [850337.524412]  [<ffffffff810b4761>] ? sync_page+0x0/0x46
Mar 28 06:59:17 mysql kernel: [850337.524416]  [<ffffffff812fc8f2>] ? io_schedule+0x73/0xb7
Mar 28 06:59:17 mysql kernel: [850337.524418]  [<ffffffff810b47a2>] ? sync_page+0x41/0x46
Mar 28 06:59:17 mysql kernel: [850337.524421]  [<ffffffff812fcd02>] ? __wait_on_bit_lock+0x3f/0x84
Mar 28 06:59:17 mysql kernel: [850337.524423]  [<ffffffff810b472e>] ? __lock_page+0x5d/0x63
Mar 28 06:59:17 mysql kernel: [850337.524426]  [<ffffffff810652e0>] ? wake_bit_function+0x0/0x23
Mar 28 06:59:17 mysql kernel: [850337.524428]  [<ffffffff810b473d>] ? lock_page+0x9/0x1f
Mar 28 06:59:17 mysql kernel: [850337.524431]  [<ffffffff810b4853>] ? find_lock_page+0x25/0x45
Mar 28 06:59:17 mysql kernel: [850337.524433]  [<ffffffff810b4e63>] ? filemap_fault+0x1a5/0x2f6
Mar 28 06:59:17 mysql kernel: [850337.524438]  [<ffffffff810cadf2>] ? __do_fault+0x54/0x3c3
Mar 28 06:59:17 mysql kernel: [850337.524455]  [<ffffffffa01702d2>] ? __ext3_journal_stop+0x1f/0x3d [ext3]
Mar 28 06:59:17 mysql kernel: [850337.524458]  [<ffffffff810cd146>] ? handle_mm_fault+0x3b8/0x80f
Mar 28 06:59:17 mysql kernel: [850337.524461]  [<ffffffff81101d8e>] ? notify_change+0x2b3/0x2c5
Mar 28 06:59:17 mysql kernel: [850337.524464]  [<ffffffff81103eb5>] ? mntput_no_expire+0x23/0xee
Mar 28 06:59:17 mysql kernel: [850337.524467]  [<ffffffff81300096>] ? do_page_fault+0x2e0/0x2fc
Mar 28 06:59:17 mysql kernel: [850337.524469]  [<ffffffff812fdf35>] ? page_fault+0x25/0x30

There are no other error messages.

Or this error can be related to memory? I already run memtest86+ on that server for several days and there was no errors.

When server was in data center, i cant boot server up. It show all the time error:

Fatal PCI Express Device Error PCI ? B00/D00/F00

After transporting it to my work, it boot up normally. In ILO event log has fallowing errors:

Uncorrectable PCI Express Error (Embedded device, Bus 0, Device 0, Function 0, Error status 0x00000000)
Uncorrectable Memory Error ((Processor 1, Memory Module 2))
Uncorrectable Memory Error ((Processor 1, Memory Module 3))
An Unrecoverable System Error (NMI) has occurred (System error code 0x00000000, 0x00000000)

I already updated bios, disk controller and drive firmwares to latest versions.

I have problem with my server. Server is running centos 6 (CloudLinux Server release 6.2). uname -a = 2.6.32-320.4.1.lve1.1.4.el6.x86_64 That is a kvm guest. On host is debian 6.

If i run command ps aux, it stuck on random process (shows some processes only), top command is working fine. htop doesn't work too (black screen).

top - 12:11:51 up 34 min,  1 user,  load average: 4.26, 6.71, 16.15
Tasks: 201 total,   7 running, 192 sleeping,   0 stopped,   2 zombie
Cpu(s):  7.9%us,  2.8%sy,  0.0%ni, 87.5%id,  1.6%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:   9862044k total,  2359484k used,  7502560k free,   171720k buffers
Swap: 10485720k total,        0k used, 10485720k free,  1336872k cached

server has one Intel(R) Xeon(R) CPU E5606 @ 2.13GHz,

free -m

             total       used       free     shared    buffers     cached
Mem:          9630       2336       7293          0        170       1324
-/+ buffers/cache:        841       8789
Swap:        10239          0      10239

php -v

PHP 5.3.19 (cli) (built: Nov 28 2012 10:03:07)
Copyright (c) 1997-2012 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2012 Zend Technologies
    with the ionCube PHP Loader v4.2.2, Copyright (c) 2002-2012, by ionCube Ltd., and
    with Zend Guard Loader v3.3, Copyright (c) 1998-2010, by Zend Technologies
    with Suhosin v0.9.33, Copyright (c) 2007-2012, by SektionEins GmbH

mysql Server version: 5.1.63-cll

php -i

disable_functions => apache_child_terminate, apache_setenv, define_syslog_variables, escapeshellarg, escapeshellcmd, eval, exec, fp, fput, ftp_connect, ftp_e
xec, ftp_get, ftp_login, ftp_nb_fput, ftp_put, ftp_raw, ftp_rawlist, highlight_file, ini_alter, ini_get_all, ini_restore, inject_code, openlog, passthru, php
_uname, phpAds_remoteInfo, phpAds_XmlRpc, phpAds_xmlrpcDecode, phpAds_xmlrpcEncode, popen, posix_getpwuid, posix_kill, posix_mkfifo, posix_setpgid, posix_set
sid, posix_setuid, posix_setuid, posix_uname, proc_close, proc_get_status, proc_nice, proc_open, proc_terminate, shell_exec, syslog, system, xmlrpc_entity_de
code, xmlrpc_server_create, putenv, show_source,mail => apache_child_terminate, apache_setenv, define_syslog_variables, escapeshellarg, escapeshellcmd, eval,
 exec, fp, fput, ftp_connect, ftp_exec, ftp_get, ftp_login, ftp_nb_fput, ftp_put, ftp_raw, ftp_rawlist, highlight_file, ini_alter, ini_get_all, ini_restore,
inject_code, openlog, passthru, php_uname, phpAds_remoteInfo, phpAds_XmlRpc, phpAds_xmlrpcDecode, phpAds_xmlrpcEncode, popen, posix_getpwuid, posix_kill, pos
ix_mkfifo, posix_setpgid, posix_setsid, posix_setuid, posix_setuid, posix_uname, proc_close, proc_get_status, proc_nice, proc_open, proc_terminate, shell_exe
c, syslog, system, xmlrpc_entity_decode, xmlrpc_server_create, putenv, show_source,mail
...
suhosin.executor.disable_eval => Off => Off
suhosin.executor.eval.blacklist => include,include_once,require,require_once,curl_init,fpassthru,base64_encode,base64_decode,mail,exec,system,proc_open,leak,
syslog,pfsockopen,shell_exec,ini_restore,symlink,stream_socket_server,proc_nice,popen,proc_get_status,dl, pcntl_exec, pcntl_fork, pcntl_signal,pcntl_waitpid,
 pcntl_wexitstatus, pcntl_wifexited, pcntl_wifsignaled,pcntl_wifstopped, pcntl_wstopsig, pcntl_wtermsig, socket_accept,socket_bind, socket_connect, socket_cr
eate, socket_create_listen,socket_create_pair,link,register_shutdown_function,register_tick_function,gzinflate => include,include_once,require,require_once,c
url_init,fpassthru,base64_encode,base64_decode,mail,exec,system,proc_open,leak,syslog,pfsockopen,shell_exec,ini_restore,symlink,stream_socket_server,proc_nic
e,popen,proc_get_status,dl, pcntl_exec, pcntl_fork, pcntl_signal,pcntl_waitpid, pcntl_wexitstatus, pcntl_wifexited, pcntl_wifsignaled,pcntl_wifstopped, pcntl
_wstopsig, pcntl_wtermsig, socket_accept,socket_bind, socket_connect, socket_create, socket_create_listen,socket_create_pair,link,register_shutdown_function,
register_tick_function,gzinflate

Sometimes i cannot kill httpd process. I run kill -9 PID even several times, and nothing happens. php runs via suphp. I learned somewhere that it can be trojan. I ran strace ps aux and it stops on

open("/proc/216456/cmdline", O_RDONLY)  = 5
read(5,

If i reboot server, problem is gone but after some time it is back again .. :(

Thanks.

We are using nginx with php-fpm. We plan to make first page static (generate html file). if we have 100 concurrent connections, how we can handle file regeneration? basically we need generate new file index_new.html, then delete index.html, and then move index_new.html to index.html. What happens when index.html file was deleted? User gets 404 error? Or nginx handles file from OS cache? One idea is to tell nginx, that 404 error is index_new.html and then not to move index_new to index, but copy. But i don't like idea about 404 error.

Thanks.

We have HP DL360 G7 server with one cpu and 16G 12G ram. We plan to add another cpu. So, we need also ram for second cpu. Is there any negative performance impact if we add different size of ram to second cpu? for example 20G ?

Current ram configuration:

How can i disable postfix smtpd error notifications? Here is message headers:

From - Wed Oct 24 20:16:05 2012                                                                                
Return-Path: <[email protected]>
Received: from mnl-latvia.lv ([unix socket])
     by localhost (Cyrus v2.x.xxx-Debian-2.x.xx-xxxx) with LMTPA;
     Wed, 24 Oct 2012 18:45:44 +0300
X-Sieve: CMU Sieve 2.xxx
Received: by example.com (ESMTP daemon)
    id D9F5315F5A8; Wed, 24 Oct 2012 18:45:44 +0300 (EEST)
Date: Wed, 24 Oct 2012 18:45:44 +0300 (EEST)
From: [email protected] (Mail Delivery System)
To: [email protected] (Postmaster)
Subject: ESMTP daemon SMTP server: errors from 130-12.104-92.cust.bluewin.ch[92.104.12.130]
Message-Id: <[email protected]>

Transcript of session follows.

 Out: 220 mnl-latvia.lv ESMTP daemon ready
 In:  EHLO
 Out: 501 Syntax: EHLO hostname
 In:  HELO
 Out: 501 Syntax: HELO hostname
 In:  QUIT
 Out: 221 2.0.0 Bye

We are planning to move mysql to dedicated box. At this moment we have web servers and mysql is running on each. Question is: cheaper is to buy 10G switch and put 10G network card into mysql server. Or buy normal gigabit switch and connect mysql box to switch with multiple network cables. In 1G scenario then we give each web server different mysql IP address. I don't think, that mysql box with one 1G link is enough to to satisfy multiple web box mysql traffic.

At this moment we have 3 servers witch are running mysql/web. Plan is to add fourth server for mysql only. Thanks.

Edit:

if we buy 1G switch with mini-GBIC ports. Can we put in mini-GBIC 10G connectors and then connect mysql box to that port?

I have dl360 G7 servers. some times kernel got panic. I understood, that server have hardware watchdog timer.

dmesg | grep wdt [ 6.344992] hpwdt 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 [ 6.345563] hpwdt: New timer passed in is 30 seconds.

Server already is in production. Question is: how i can enable it? Did i need some software to install on system too? On server is running debian. I understood that i need on system some software that tells watchdog, that system is alive. Or i am wrong? Thanks!

We have 5 physical servers. All are identical. 16 gb ram, 4x146 10k sas in raid 10.

So, we need high availability. Current plan is following:

2 boxes with Heartbeat for load balancing. At this moment nginx is configured as balancer.

then problem is web & mysql. I plan to set up 2 boxes running mysql and nginx. Between theses boxes set up mysql replication in master <-> master. Then add latest box which has replicated mysql. For this model each webserver connects to its local mysql server. (to minimize network latency).

Other model is to put two boxes (nginx) in HA and another two boxes in mysql master/slave. but in this model load balancer is alone ....

Or i need another setup. Basically i don't need how to do it, but which model to choose. We need to handle lot of traffic (about 20k req/s).

We have news portal. We have 5 identical dedicated boxes. 2xE5620, 16GB ram, 4x146gb 15k sas raid10. at this time bottleneck is mysql.

One box is load balancer (nginx), two boxes (C,D) is nginx & phpfpm, one is mysql backup and one box is mysql.

At this moment caching is on box C and D. we use memcached, where are stored result from mysql. Sometimes in page is white boxes (no content loaded). I already made atomic inserts into memcached and made full debugging of memcached operations.

So, i think that maybe must made static files. When new article is published, then create static html file for it and use server side includes for comment count displaying and same comment content displaying. Then nginx can cache mostly used files and serve them from memory. With static pages we could also speed up page loading time.

I am thinking about cookie less domain, but i am not sure if that helps, because network pipe not bottleneck.

Question is: what caching system/model to use?

I have 2 boxes. One is dell (4x146GB 15k 3.5'' SAS in raid 10). this is primary sql server (runs only mssql). dell has 8gb ram and mssql is running fine. Dell has windows 2008 R2 x64 second is hp dl360 g5 (2x36gb[raid1] 10k sas for system and 2x700gb[raid1] for storage) 700 gb drives are seagate ST9750420AS. Hp has windows 2003 R2 x64. Booth servers have mssql 2005 x64

Second server is for sql replication (in transaction mode),wsus, kaspersky adminkit and terminal server for 3 users. Hp server has 6gb ram and SmartArray E200i - this is the pain, because they do not support 6 drives. i was planned to use 4x700 gb in raid 10 (for performance)

So, in case, that E200i doesn't suport 6 drives, my plan is that put sql replication to 700 gb array. And question no 1 = how good that will be? Option to by new controller and cable not acceptable. I have already 4x700 gb drives. But theses drives are standard drives and not enterprise. HP server is second server and that not critical. And question no 2: did theses drives affects performance for primary mssql server? because latency and access times is much higher for non enterprise disks. In plan also is to change one drive after half year (in case to booth drives doesn't fail at same time)

Or better way is to sell theses 4 700gb drives and get 2 SAS drives?

Database size:

DatabaseName Logical_Name   Physical_Name                   SizeMB
-------------------------------------------------------------------
FTGWIN       FTGWIN_data    D:\MSSQL_FTGWIN\FTGWIN.mdf      6216
FTGWIN       FTGWIN_log     D:\MSSQL_FTGWIN\FTGWIN_log.ldf  11535

Thanks. And happy christmas :)

I have a little problem. Some spammer is sending email to me from my address.

here is mail headers:

From - Fri Aug 20 08:06:15 2010
X-Account-Key: account7
X-UIDL: 1201266183.2446
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00000000
X-Mozilla-Keys:                                                                                 
Return-Path: <[email protected]>
Received: from mnl-latvia.lv ([unix socket])
     by localhost (Cyrus v2.2.13-Debian-2.2.13-10) with LMTPA;
     Fri, 20 Aug 2010 07:17:26 +0300
X-Sieve: CMU Sieve 2.2
X-Greylist: delayed 328 seconds by postgrey-1.27 at mnl-bck; Fri, 20 Aug 2010 07:17:20 EEST
Received: from 59.93.217.133 (unknown [59.93.217.133])
    by mnl-latvia.lv (ESMTP daemon) with ESMTP id 0F8572E6970
    for <[email protected]>; Fri, 20 Aug 2010 07:17:19 +0300 (EEST)
Received: (qmail 2323 by uid 603); Fri, 20 Aug 2010 08:11:00 +0400
Message-Id: <[email protected]>
From: [email protected]
To: [email protected]
Subject: [email protected] VIAGRA X Official Seller -77%
MIME-Version: 1.0
Content-Type: text/html; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
Date: Fri, 20 Aug 2010 07:17:19 +0300 (EEST)
X-mnl-latvia.lv-MailScanner: Found to be clean
X-mnl-latvia.lv-MailScanner-From: [email protected]
X-mnl-latvia.lv-MailScanner-To: [email protected]

Mail server is running on postfix, spamassasin. In spamassasin is defined that all messages who is going from latvian adreeses are whitelisted.

spamassasin spam.whitelist.rules

From:           *@*.lv          yes

main.cf

smtpd_recipient_restrictions = hash:/etc/postfix/access,
        permit_sasl_authenticated,
        permit_tls_clientcerts,
        permit_mynetworks,
        check_policy_service inet:127.0.0.1:60000
        reject_invalid_hostname,
        reject_non_fqdn_sender,
        reject_unknown_sender_domain,
        reject_non_fqdn_recipient,
        reject_unknown_recipient_domain,
        reject_unauth_destination,
        permit

question is: can i drop mail at smtp level if From is same as To and if sender is not authenticated?

at mail headers sender is :
Received: from 59.93.217.133 (unknown [59.93.217.133])
so its not authenticated. I am right ?