Daniel t.'s questions

In the place I work, there are multiple users who log in to any server through ssh and perform various tasks. In general, they are supposed only to run commands on the servers, not copy files out of the servers. And yes, they have root access.

What I need to find out is, the amount of data transferred out of each server by a user. In other words, from the moment a user logins to the moment they disconnect, I need to find out the total data transferred i.e. sent as well as received, between their server and the ssh server. This might help in tracking users who might have transferred lots of sensitive data out of the servers. There are some huge files on the server.

I have a site with low traffic, less than 500 hits a day. It has a 6G of memory and it is way underutilized, on average 5% is in use. But as soon as googlebot establishes a connection to my webserver/apache, the memory and cpu usage spikes in seconds and the server becomes inaccessible - website, ssh and all other services.

When I do lsof for port 80, here is what i see before the site crashes in seconds.

lsof -i:80 mywebsite:http->crawl-66-249-71-200.googlebot.com:43567 (ESTABLISHED)

Google Bot is set to a slow crawl rate.

Apache config is:

ServerLimit 256 
MaxClients 150 
MaxRequestsPerChild 100 
KeepAlive Off 
KeepAliveTimeout 5 
MaxKeepAliveRequests 100

The error log shows:

Cannot allocate memory: couldn't create child process: /opt/suphp/sbin/suphp

how do I rewrite web requests of type http://mydomain.com/mypage.php?id=somenumber where somenumber is an integer TO http://mydomain.com/directory

like http://mydomain.com/mypage.php?id=15 to http://mydomain.com/directory