Derek Downey's questions

Fairly new to Vagrant, so bear with me if I don't understand the process.

I downloaded a CentOS box off http://www.vagrantbox.es/

Started it up running VirtualBox 4.2.4 and got this message:

[default] The guest additions on this VM do not match the install version of VirtualBox! This may cause things such as forwarded ports, shared folders, and more to not work properly. If any of those things fail on this machine, please update the guest additions and repackage the box.

Guest Additions Version: 4.0.8

VirtualBox Version: 4.2.4

So I used the vbguest plugin to update the guest additions, then repackaged the box as suggested. Having replaced the old box and loading it up I get the same message about guest additions being outdated, but vbguest reports that they are up to date (the automatic vbguest update is disabled in my Vagrantfile):

Vagrant::Config.run do |config|    
    config.vm.box = "centos56_64"

    config.vbguest.auto_update = false
    config.vbguest.no_remote = true
end

And the commands:

dtest$ vagrant up
[default] Importing base box 'centos56_64'...
[default] The guest additions on this VM do not match the install version of
VirtualBox! This may cause things such as forwarded ports, shared
folders, and more to not work properly. If any of those things fail on
this machine, please update the guest additions and repackage the
box.

Guest Additions Version: 4.0.8
VirtualBox Version: 4.2.4
[default] Matching MAC address for NAT networking...
[default] Clearing any previously set forwarded ports...
[default] Forwarding ports...
[default] -- 22 => 2222 (adapter 1)
[default] Creating shared folders metadata...
[default] Clearing any previously set network interfaces...
[default] Booting VM...
[default] Waiting for VM to boot. This can take a few minutes.
[default] VM booted and ready for use!
[default] Mounting shared folders...
[default] -- v-root: /vagrant

dtest$ vagrant vbguest --no-install
[default] Detected Virtualbox Guest Additions 4.2.4 --- OK.
[default] Virtualbox Guest Additions on host: 4.2.4 - guest's version is 4.2.4

Since they appear to be updated after an install, I could ignore the message. But is it possible to get rid of it?

I am having an issue with a php script running rsync on one of my servers, but only when run through apache/mod_php.

Here is a trimmed down version of the script:

<?php
 exec("rsync -a /var/www/html/from/ /var/www/html/to");
?>

Pretty simple. The purpose of this command is to copy a folder structure (complete with appropriate permissions) to a new folder. But the issue is, this rsync command hangs and won't complete.

Doing a bit of investigating, I noticed that the script would spawn two rsync processes:

> ps aux | grep rsync
apache   20752 56.9  0.0  10400   656 ?     R   11:29  1:37 rsync -a /var/www/html/from/ /var/www/html/to
apache   20753  0.0  0.0  10400   276 ?     S   11:29  0:00 rsync -a /var/www/html/from/ /var/www/html/to
root     22305  0.0  0.0  61212   764 pts/1 S+  11:32  0:00 grep rsync

I noticed that the first process was in the 'running' status. So I did an strace on it, but all I got for output was the following:

> strace -p 20752
<snip>
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
select(1037, [1026 1027 1028 1029], [], NULL, {60, 0}) = 4 (in [1026 1027 1028 1029], left {60, 0})
<snip>

Here is what I know so far:

1. The php script works fine when run from the cli. I enabled the ability to su apache and run the script > php myscript.php and it works fine. But running http://mydomain.com/myscript.php creates the 2 processes, with one of the first one in continual running state. This leads me to believe it's not a permission issue. As further proof, here is the ls -l output:

   > ls -l /var/www | grep html
   drwxr-xr-x 79 apache    apacheftp 4096 Aug 17 12:07 html
   
   > ls -l /var/www/html | grep from
   drwxrwxr-x 2 apache apache 4096 Aug 22 11:27 from
   

   So, apache has permission to write to the directory, and read from the from directory.

2. Running the same script on a different server of same specs works fine. The specs of both servers are:

   Apache version: Apache/2.2.3
   PHP version: 5.3.3
   rsync version: 2.6.8  protocol version 29
   OS: Red Hat Enterprise Linux Server release 5.6 (Tikanga)
   

What I don't know is why apache spawns two rsync processes (or why the first rsync spawns a second), and why the first rsync process seems to be stuck on select(1037...)

Can someone shed light on this?

I'm using HAProxy to set a cookie when you visit mydomain.com/dev and redirects to mydomain.com .

The purpose of this is to offer a way to visit a development version of the site instead of the production site, while keeping everything else the same.

The pertinent config line looks something like this:

frontend webfarm 1.2.3.4:80
    acl acl_dev path_end /dev

    redirect location / code 302 set-cookie SERVERID=live03 if acl_dev

    default_backend default_farm

Now, instead of redirecting to the root domain, I'd just like to strip off the /dev path. So if I went to mydomain.com/foo/dev it would set the cookie and redirect to mydomain.com/foo

Is this possible with HAProxy, or would I need to use mod_rewrite in the apache backend server?

Note: I don't need a mod_rewrite rule, just looking for whether this is possible in HAproxy.

I am running sysbench on a RHEL 5.6 server running MySQL 5.5.16 using the following setup:

sysbench --test=oltp --db-driver=mysql --mysql-user=sbench \
 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-db=sbench \
 --mysql-table-engine=innodb --oltp-table-size=1000000 prepare

This creates the default sbench table like so:

mysql> SHOW CREATE TABLE sbench.sbtest\G
*************************** 1. row ***************************
       Table: sbtest
Create Table: CREATE TABLE `sbtest` (
  `id` int(10) unsigned NOT NULL AUTO_INCREMENT,
  `k` int(10) unsigned NOT NULL DEFAULT '0',
  `c` char(120) NOT NULL DEFAULT '',
  `pad` char(60) NOT NULL DEFAULT '',
  PRIMARY KEY (`id`),
  KEY `k` (`k`)
) ENGINE=InnoDB AUTO_INCREMENT=1000001 DEFAULT CHARSET=latin1
1 row in set (0.04 sec)

Running a 16 thread innodb read/write test on 1,000,000 rows:

sysbench --num-threads=16 --test=oltp --db-driver=mysql --mysql-user=sbench \
  --mysql-socket=/var/lib/mysql/mysql.sock --mysql-db=sbench \
  --mysql-table-engine=innodb --oltp-table-size=100000 \
  --oltp-reconnect-mode=query --batch --batch-delay=5 run

results in the following error

[1319136662] sysbench 0.4.12:  multi-threaded system evaluation benchmark

[1319136663] Running the test with following options:
[1319136663] Number of threads: 16
[1319136663] 
[1319136663] Doing OLTP test.
[1319136663] Running mixed OLTP test
[1319136663] Using Special distribution (12 iterations,  1 pct of values are returned in 75 pct cases)
[1319136663] Using "BEGIN" for starting transactions
[1319136663] Using auto_inc on the id column
[1319136663] Maximum number of requests for OLTP test is limited to 10000
[1319136663] Threads started!
[1319136668] min: 0.2181  avg: 0.2484  max: 0.3025  percentile: 0.2715
[1319136673] min: 0.2181  avg: 0.2454  max: 0.3025  percentile: 0.2646
[1319136678] min: 0.2173  avg: 0.2441  max: 0.3115  percentile: 0.2646
[1319136683] min: 0.2173  avg: 0.2435  max: 0.3115  percentile: 0.2648
[1319136688] min: 0.2173  avg: 0.2440  max: 0.3115  percentile: 0.2663
ALERT: [1319136690] failed to execute mysql_stmt_execute(): Err1062 Duplicate entry '49616' for key 'PRIMARY'
FATAL: [1319136690] database error, exiting...
[1319136691] Done.

I'm fairly new to using sysbench, but is this a bug, or did I misconfigure something to make it insert duplicate primary keys?

Scenario

I've got a haproxy farm of 3 (apache) webservers. 2 are actively balanced, and the third is a backup normally.

Every so often, I want to take the third server out of the backup role and make it a 'patch' server. But I want to do this without changing the url (eg, I don't want to use patch.mysite.com)

What I want to happen is, I visit http://mysite.com/patch and have haproxy give the server a cookie for later use in an ACL, but remove the /patch and send a GET / to the backend server.

Where I'm at now is the ACL is working fine, but the reqrep is not removing the /patch request before sending it to the backend.

Config:

global
    log 127.0.0.1   local0 info

    maxconn 25000
    daemon
    spread-checks 2 

defaults
    log     global
    mode    http
    balance roundrobin

    option  httplog
    option redispatch
    option abortonclose
    option forwardfor
    option http-server-close

frontend webfarm :80 
  # FILTERING
  acl acl_patch path_end /patches

  use_backend patch if acl_patch
  default_backend default_farm

backend default_farm
  cookie SERVERID insert indirect
  server prod1 192.168.100.18:80 cookie live01 check
  server prod2 192.168.100.22:80 cookie live02 check weight 2
  server prod3 192.168.100.20:80 cookie live03 check backup

  # do not let this cookie tell our internal IP address 
  rspidel ^Set-cookie:\ IP=

backend patch  
  cookie SERVERID insert indirect
  server prod3 192.168.100.20:80 cookie live03
  reqrep ^([^\ ]*)\ /patch     \1\ /

  # do not let this cookie tell our internal IP address
  rspidel ^Set-cookie:\ IP=

The haproxy log still specifies a GET /patch being sent to the backend. What am I missing about reqrep (I don't care about anything after the /patch directory)?

I've recently setup a loadbalanced solution for our websites. We host about 200 sites, most run of our custom application, but some are running wordpress blogs (in which files can be uploaded/deleted). The setup is basic:

          |-------------------> Apache1
          |
 HAProxy -|
          |
          |-------------------> Apache2

I've set up Apache1 as a 'master', so that most of the changes made on it are rsync'd over to Apache2 every minute using the following command:

rsync -av --delete apache1:/var/www/html/ /var/www/html/

The problem is, as mentioned earlier, in some cases files are added/removed on Apache2. The only solution I've come up with so far is to have Apache1 rsync all files in certain directories (wp-content, for instance) to itself (not delete), then push everything back to Apache2.

This has it's flaws, the main ones being:

• The two servers will eventually get extra files that have been deleted on Apache2
• As I add more servers, the rsync script will take longer to complete.

Are there any ways to keep 2+ web servers synched, taking into account that both servers can have files added, updated and deleted?

I've got a web farm set up something like this:

          |-------------------> Apache1
          |
 HAProxy -|
          |
          |-------------------> Apache2

HAproxy has external IP x.x.x.x

Apache1 has 2 interfaces: internal y.y.y.y (for requests from HAProxy), and external IP z.z.z.z

Apache2 has 2 interfaces: internal yy.yy.yy.yy (for requests from HAProxy), and external IP zz.zz.zz.zz

Anytime I make requests outside the farm from one of the apache servers (such as a curl request in php to say, google.com), the REMOTE_ADDR header is the external IP of the apache server making the call (yy.yy.yy.yy or zz.zz.zz.zz).

The problem is, some of the servers I make such requests to limit the IPs requests from. Ideally I'd like to provide them the IP of the HAProxy server (x.x.x.x), instead of having to give them the IPs of the 2 backend servers.

Is there any way to accomplish this in configuring either apache or haproxy?

I am using RHEL 5.6 and trying to install stunnel with the 'xforwardfor' patch from haproxy to get a setup similar to this (older) post: http://www.buro9.com/blog/2009/12/07/installing-haproxy-load-balance-http-and-https/

When I run ./configure I get the following error:

*snip*
configure: **************************************** SSL
checking for SSL directory... Not found

Couldn't find your SSL library installation dir
Use --with-ssl option to fix this problem

From the stunnel documentation I need to pass a directory that has the ssl libraries (assuming libssl.so ? ) as well as a 'certs' directory.

I've tried creating a /etc/openssl directory with a 'certs' directory and a symlink to /lib64/libssl.so.6 but that didn't work.

What other libraries would I need ?

Update

From the config.log:

It was created by stunnel configure 4.32, which was generated by GNU Autoconf 2.61. Invocation command line was

$ ./configure --with-ssl=/lib64

## --------- ##
## Platform. ##
## --------- ##

uname -m = x86_64
uname -r = 2.6.18-238.12.1.el5
uname -s = Linux
* snip *
configure:23977: **************************************** SSL
configure:23996: checking for SSL directory
configure:24019: result: Not found

And running ls /lib64 | grep ssl:

$ ls -l /lib64 | grep ssl
-rwxr-xr-x 1 root root  315032 Dec  7  2010 libssl.so.0.9.8e
lrwxrwxrwx 1 root root      16 Jul 13 18:48 libssl.so.6 -> libssl.so.0.9.8e

So I'm testing out a small CentOS build (rackspace cloud). I set up my user and went to do some sudo'ing. Well, I forgot the step to add my user to the sudoers file with visudo. So of course, I get this error:

is not in the sudoers file. This incident will be reported.

Never saw it before, so now I'm wondering. Where does this get reported? Does it just get sent to mail, or is it logged somewhere?

Thanks for any help

I'm running php with curl support on a mac. cURL in php works fine(ish) but I noticed an oddity reported by phpinfo(). It states that curl support is 7.19.7

But using the otool command, I get this:

# otool -L `which php`
   /usr/local/bin/php:
        ...
        /usr/lib/libcurl.4.dylib (compatibility version 6.0.0, current version 6.1.0)
        ...

I was wondering what is the relationship between libcurl's 'current version 6.1.0' and php curl's 'curl support 7.19.7'?

Basically just making sure I don't have a version mismatch, because I'm experiencing some PHP DNS issues that I'm trying to debug.

I'm installing a mac osx munin node, and the default value of

User root
Group root

Produces an error that there is no 'root' group. What should the group be for a munin node?

Title has it all, is it recommended practice on production servers to change the default port?

Ours is a fairly small company (3-4 programmers and 3-4 site designers) that develops a single-purpose PHP web app which provides the functionality to about 100+ websites. We've operated for a couple years in a separate development and production environment which has worked fairly well. There's always been enough separate features to be developed that the programmers never really clash and it was more convenient to work without the source control; even though it had risk of data loss and we've had our fair share of files going missing in an inadvertant move.

The other consideration is that our designers are not tech savvy (I introduced them to html markup, instead of using WYSIWYGs). This has been one of the reasons to hesitate on making the move to versioning.

However, now that we've reached 100+ sites and the development team is growing, I'm trying to standardize our procedures and source-control seems a logical step as far as programmers go. I'm hoping this will also speed up our patch deployments.

Unfortunately, I've very limited experience with setting a source-control system up. What I'm curious to hear about from people with a similar setup, or experience making the switch:

1) Do you version everything (sites, css, html templates, and app code) and thus force the designers to learn versioning? Or is it just the developers that work on the application code?

2) What are some pitfalls to watch out for when initially setting up the source control?

3) Deployment of dev => production tips for source control.

Thanks for all insight.

Edit 1: Dang. Everyone so far is recommending controlling everything. That's going to make me lose my hair early. It's probably going to spark a new question in the near future. Thanks for the advice so far, keep it coming!

Edit 2: A lot of good answers, and we'll be looking into the various version control systems. Thanks for the replies everyone!

I need some help constructing a directory listing using 'find'?

An example directory structure looks something like this:

/ (root)
 - /foo
   - /folderA
   - /folderB
 - /bar
   - /folderA
     -/search
   - /folderB

What I want to find is a list of 'folderA' or 'folderB' directories that do NOT have a 'search' folder. Requested output would be:

/foo/folderA
/foo/folderB
/bar/folderB

I am assuming this can be accomplished with 'find' on a *nix system, but am pretty green with the command. All help is appreciated.

SOLVED: Thank you Khaled for your response leading me in the right direction. Needed a slight modification to include the -E option, but the final solution looked like this:

find -E . -regex '.*(folderA|folderB)' -type d '!' -exec test -d '{}/search' ';' -print

I'm noticing a bunch of 'domain.com/redirect.error404' entries in my domain's error log. Is this the filename that apache puts on if an ErrorDocument 404 entry exists in the configuration?

I manage a few Mac OSX XServes for production websites and have recently run into an issue dealing with the server resolving the DNS of some of the sites. Further investigation revealed that httpd.conf was configured to listen on all IPs (port 80), but the virtual host configurations only applied to the actual IP for the domain (not localhost).

eg (freehand configuration, probably syntactically incorrect and missing irrelevant options): in httpd.conf: Listen 80

in domainA:80.conf: ServerName domainA.com

Now, in the /etc/hosts file, it had this entry: 127.0.0.1 localhost 127.0.0.1 domainA.com

what would happen when domainB.com called out to domainA.com on the same machine, it would use the localhost IP address. Therefore, instead of using the correct virtualHost configuration, it used the default configuration (this took me so damn long to figure out, but it makes perfect sense)

I don't really have a need to access the domains from localhost, so my question is: What's the best way to disable apache from trying to access the configuration using 127.0.0.1?

1) Comment out the '127.0.0.1 domainA.com' entry in /etc/hosts (this is what I did to fix it temporarily, but is this really a good solution)?

2) Update the httpd.conf file to listen only to the appropriate 1.2.3.4 IP address (Listen 1.2.3.4:80) ?

Sidenote: I went with option 1 temporarily because I use a Tenon configuration and was unsure of the ramifications of changing their default value on the 'Listen'

I'm running a MacOS Xserve using a Tenon apache/php build. I've noticed that once maxclients is reached, I start getting errors like 'Directory index forbidden by Options directive: /Library/Tenon/WebServer/Documents/'

Our server hosts 100+ websites and each are configured using their own vhost file, but Tenon has a default 'DocumentRoot /Library/Tenon/WebServer/Documents'.

Would reaching maxclients interfere with being able to properly parse vhosts?

I'm running a Mac XServe as a dedicated apache mpm-prefork server with 8GB RAM. As part of the tuning process (I'm new to this), I'm trying to come up with the best value for MaxClients. To do so, I'm using 'top' to come up with a average process size, but I'm not sure which value represents actual memory size of the http process: 'RSIZE' or 'RPRVT'

What are the differences of these values? Thanks for any help.