I've created my own deb package for Redis 2.6.11 instead of the very old default version for Ubuntu. All works well except when I do an apt-get upgrade it tries to install what it thinks is the latest version of redis-server How can tell the package manager to stick on my custom one and don't refer to default repository for this particular package?
Ubuntu 12.04
I've a Ubuntu webserver with Sendmail as my MTA
Currently when i email outside my webserver's domain e.g. example.com to something like gmail or any other email outside the example.com domain it works perfectly. I don't want my sendmail daemon to recognize example.com as a local address I want it to send to example.com the same way any other email is sent.
There will never be a case were i will use the local users on the webserver to collect these emails for example.com.
So how can I disable local delivery?
I'm scratching my head on this one.
Django is installed on my production and dev servers but the live server under not ver heavy load is running extremely slow. Every page is taking more than 30 seconds at times.
here is my Apache sites-available/example.com file:
<VirtualHost *:80>
ServerName www.example.com
ServerAdmin [email protected]
<Directory /var/www/sites/example.com>
Order Deny,Allow
Allow from all
</Directory>
WSGIDaemonProcess example.com user=example group=example threads=25
WSGIProcessGroup example.com
WSGIScriptAlias / /var/www/sites/example.com.wsgi
Alias /media /var/www/sites/example.com/media
<Directory /var/www/sites/example.com/media>
Order Deny,Allow
Allow from all
</Directory>
</VirtualHost>
and this is what i have in my wsgi file
#!/usr/bin/env python
project = "fishpond"
sitename = "www.fishpond.ie"
envpath = "/var/www/env/dev.fishpond.ie/lib/python2.6/site-packages"
import os, sys, site
sys.path.append(os.path.join(os.path.dirname(__file__), sitename))
sys.path.append("/var/www/sites/new.fishpond.ie/")
os.environ['DJANGO_SETTINGS_MODULE'] = ("%s.settings" % project)
site.addsitedir(envpath)
import django.core.handlers.wsgi
application = django.core.handlers.wsgi.WSGIHandler()
If you need any other info let me know.
Biggest problem being I can't find any error message in log when I run 'top' for example I don't see any unusual load on the server or high mem usuage.
Any help is greatly appreciated.
Derek
Ok, because of a bunch of projects I'm working on I've access to dedicated Servers on a 3 hosting providers.
As an experiment and for educational purposes I decided to see if I could benchmark how good the IO is with each.
Bit of research lead me to Bonnie++
So I installed it on the server and ran this simple command
/usr/sbin/bonnie -d /tmp/foo
The 3 machines in different hosting providers are all dedicated machines, one is a VPS, other two are on some cloud platform e.g. VMWare / Xen using some kind of clustered SAN for storage
This might be a naive thing to do but here are the results I found.
HOST A
Version 1.03c ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
xxxxxxxxxxxxxxxx 1G 45081 88 56244 14 19167 4 20965 40 67110 6 67.2 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 15264 28 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
xxxxxxxx,1G,45081,88,56244,14,19167,4,20965,40,67110,6,67.2,0,16,15264,28,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
HOST B
Version 1.03d ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
xxxxxxxxxxxx 4G 43070 91 64510 15 19092 0 29276 47 39169 0 448.2 0
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 24799 52 +++++ +++ +++++ +++ 25443 54 +++++ +++ +++++ +++
xxxxxxx,4G,43070,91,64510,15,19092,0,29276,47,39169,0,448.2,0,16,24799,52,+++++,+++,+++++,+++,25443,54,+++++,+++,+++++,+++
HOST C
Version 1.03c ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
xxxxxxxxxxxxx 1536M 15598 22 85698 13 258969 20 16194 22 723655 21 +++++ +++
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 14142 22 +++++ +++ 18621 22 13544 22 +++++ +++ 17363 21
xxxxxxxx,1536M,15598,22,85698,13,258969,20,16194,22,723655,21,+++++,+++,16,14142,22,+++++,+++,18621,22,13544,22,+++++,+++,17363,21
Ok, so first off what is the best way to read the figures and are there any issues with really comparing these numbers?
Is this in any way a true representation of IO Speed?
If not is there any way for me to test that?
Note: these 3 machines are using either Ubuntu or Debian (I presume that doesn't really matter)
Ok I have a bunch of files in this file structure format.
/backup/daily/database1/database1-2011-01-01.sql
/backup/daily/database1/database1-2011-01-02.sql
/backup/daily/database1/database1-2011-01-03.sql
/backup/daily/database1/database1-2011-01-04.sql
/backup/daily/database1/database1-2011-01-05.sql
/backup/daily/database1/database1-2011-01-06.sql
/backup/daily/database1/database1-2011-01-07.sql
/backup/daily/anotherdb/anotherdb-2011-01-01.sql
/backup/daily/anotherdb/anotherdb-2011-01-02.sql
/backup/daily/anotherdb/anotherdb-2011-01-03.sql
/backup/daily/anotherdb/anotherdb-2011-01-04.sql
/backup/daily/anotherdb/anotherdb-2011-01-05.sql
/backup/daily/anotherdb/anotherdb-2011-01-06.sql
/backup/daily/anotherdb/anotherdb-2011-01-07.sql
/backup/daily/stuff/stuff-2011-01-01.sql
/backup/daily/stuff/stuff-2011-01-02.sql
/backup/daily/stuff/stuff-2011-01-03.sql
/backup/daily/stuff/stuff-2011-01-04.sql
/backup/daily/stuff/stuff-2011-01-05.sql
/backup/daily/stuff/stuff-2011-01-06.sql
/backup/daily/stuff/stuff-2011-01-07.sql
And there are lots lots more.
ultimately I want to import all the 2011-01-07.sql files into my mysql database.
This works for one
mysql -u root -ppassword < /backup/daily/database1/database1-2011-01-07.sql
That will nicely restore that database from this backupfile.
I want to run a process where it does this for all databases.
So my plan is to first cp all 2011-01-07 sql files into a tmp dir e.g.
cp /backup/daily/*/*2011-01-07*.sql /tmp/all
The command above unfortunately isn't working I get an error:
cp: cannot stat ..... No such file or directory
So can you guys help me out with this. For bonus points if you can tell me how to do the next step which is import all databases in one command doing one at a time that would be great too.
I really want to do these in two separate steps because I need to delete a few sql files manually from the tmp dir before I run the restore command.
So I need:
1) command to copy all 2011-01-07 sql files to a tmp dir
2) command to import all those files in that dir into mysql
I know its possible to do in one but for lots of reasons I really would prefer to do it in two steps.
I've a debian webserver with subversion running on it.
I'm trying to use post-commit script to update my staging version of my site.
#!/bin/sh
/usr/bin/svn update /home/sites/example.com/www >> /var/log/svn/example.log 2>&1
if I run that command from the command line logged in as user 'derek' then it all works fine
but when it runs as post-commit I get the following error in my log file:
svn: Can't open file '/home/sites/example.com/www/.svn/lock': Permission denied
Ok, so I realize what is happening here is the user calling the post-commit script isn't 'derek' so it hasn't permission.
So my question is what user is calling the post-commit script.
the svnserve daemon is run as derek ... I thought that would mean the post-commit command would be called as derek too but it seems not.
Any ideas how I can find out what user is calling it
and secondly what would be the best practice method to allow access for that user? I don't think adding it to the group would help because the group doesn't have the write access to the .svn directories by default.
UPDATE: I've just found that www-data is the user that seems to be calling the script. Now naturally www-data can't run the svn command.
I've an webserver that is still debian etch.
My problem is I need to upgrade some packages but I can't find a source for debian etch anywhere.
I have the following:
###### Debian Main Repos
deb http://ftp.ie.debian.org/debian/ etch main
deb-src http://ftp.ie.debian.org/debian/ etch main
deb http://security.debian.org/ etch/updates main contrib
deb-src http://security.debian.org/ etch/updates main contrib
but my main repos don't seem to exist anymore.
I know I need to upgrade to lenny but the docs recommend you update to latest etch first before doing a dist-upgrade. Where can I find the latest etch source?
I'm trying to pin point what applications are using up my network connection. Is there an app/widget out there that can show me this?
I'm aware of net monitor but that doesn't seem to tell me what apps are using what traffic.
Ideally what i'd like to see is a bar chart of app usage of net traffic over time.
I'm fairly familiar with the workings of apache on Linux.
Enviroment: Hosted VPS (full access)
Windows Server 2003 Datacentre x64 edition, Apache 2.2
I have 2 straight forward websites I want to host.
example1.com and example2.org
This server was originally set up by someone else and example1.com works as expected.
So my task is to add example2.org to the server.
I create a basic index.html test page in C:\www\example2
add a virtual host record to httpd-vhosts.conf
and for test purposes add a 127.0.0.1 example2.org to my hosts file so I can test locally.
This all worked as expected and I can view example2.org which shows my test html file.
The problem is... when the DNS propagated it shows the example1.com site when I go to example2.org from anywhere but the local windows server.
I'm completely baffled as to why this is happening? Any ideas?
At what point does apache read in outside connections differently to local ones?
NameVirtualHost *:80
<VirtualHost *:80>
ServerName www.example2.org
ServerAlias example2.org
ServerAdmin [email protected]
DocumentRoot "C:/www/example2"
<Directory "C:/www/example2">
Order Deny,Allow
Allow from all
</Directory>
ErrorLog "logs/example2-error.log"
CustomLog "logs/example2-access.log" common
</VirtualHost>
<VirtualHost *:80>
ServerName www.example1.com
ServerAlias www.example1.com
ServerAdmin [email protected]
DocumentRoot "C:/www/example1"
<Directory "C:/www/example1">
Order Deny,Allow
Allow from all
</Directory>
ErrorLog "logs/example1-error.log"
CustomLog "logs/example1-access.log" common
</VirtualHost>
Above is what I have in my httpd-vhosts.conf file.. bare in mind example1.com works fine.
I'm working on lamp application. We have 2 servers (Debian) Live and Dev.
I constantly work on dev main to add new features and fix bugs.
When happy all works well I scp the relevant code to the Live system. Database (mysql) is local to each machine.
Now this is pretty basic setup really and I want to improve the workflow a bit. I use git and github for version control. Admittedly I've only really used one branch. Their can be 3 different developers who work on the code at different times. We all use the same linux username to connect to the dev server and edit the code directly when needed. I usually then commit and push the code at the end of the day to github.
One thing to bare in mind is it isn't easy to run this code on a local machine as there are many apache and subdomain configurations that wouldn't work on a local machine so it is important to work on the dev server not locally.
I need to create a new process because we need to have a main trunk now and a branch with a big code re-write.
What is the best way to do this. Should I create different unix logins for each developer and set up different working areas on the dev server for there changes? e.g.
/var/www/mysite_derek /var/www/mysite_paul /var/www/mysite_mike
my thinking is they can do a pull from the main branch and then create there own branch and merge it back in. I'm not sure how this will work though with git locally and with github.
will i need to create different github user accounts as well.
I'd like to do this the 'right' way and future proof for having lots of potential developers but I also don't want to over complicate it. I simple and elegant solution is preferred.
any recommendations or suggestions?
right need a script/command that will list all .php files that have a pattern/string in it.
It should look at the current directory and all sub directories.
Be even better if it showed the line number something like:
my new command
./www/index.php Line 12
./www/lib/config.php Line 123
Also would it be possible to do a search and replace for the line in each file that has this pattern?
I have 5000 databases on one server.
Switching databases is taking a long time sometimes 2 seconds. (use databaseA)
IT is showing up in a my slow queries log. Is there any way to make this go faster.. some form indexing or some other configuration?
On my dev server. Evey so often apache2 just falls over. Its no longer running as a process.
Server details: Linux Debian etch Apache2
# ps aux | grep apache
www-data 6782 99.9 0.2 4792 2912 ? R Oct12 8592:53 /usr/sbin/apache/log
root 22418 0.0 0.0 2852 704 pts/2 S+ 13:31 0:00 grep apache
# apache2ctl restart
httpd not running, trying to start
(98)Address already in use: make_sock: could not bind to address [::]:80
(98)Address already in use: make_sock: could not bind to address 0.0.0.0:80
no listening sockets available, shutting down
Unable to open logs
When I check the /var/log/apach2/error.log There is nothing in there.
I guess I want to do two things.
Figure out why apache is falling over. Fix it
Congifure where nessacary so it doesn't happen again and maybe set up log files better?
If i restart the machine I can get apache up and running again. can anyone explain what is going on here?
Thanks, Derek
Taking over a Debian Etch web server with MySQL running.
I usually start, stop and restart msyql using:
/etc/init.d/mysql restart
For some reason on this set up I get the following:
:~# /etc/init.d/mysql stop
Stopping MySQL database server: mysqld failed!
The mysql process is running fine:
:~# ps aux | grep mysql
root 2045 0.0 0.1 2676 1332 ? S Jun25 0:00 /bin/sh /usr/bin/mysqld_safe
mysql 2082 0.6 10.7 752544 111188 ? Sl Jun25 18:49 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-external-locking --port=3306 --socket=/var/run/mysqld/mysqld.sock
root 2083 0.0 0.0 1568 504 ? S Jun25 0:00 logger -p daemon.err -t mysqld_safe -i -t mysqld
root 11063 0.0 0.0 2856 716 pts/0 S+ 17:29 0:00 grep mysql
I'm sure there are some really easy way to do it but I want to understand what is going on as well. Why is the typical way not working for me?
EDIT UPDATE as an update:
JBRLSVR001:/var/log/mysql# mysqladmin shutdown
JBRLSVR001:/var/log/mysql# dpkg --list mysql\*
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Installed/Config-files/Unpacked/Failed-config/Half-installed
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name Version Description
+++-============================================-============================================-========================================================================================================
un mysql-client <none> (no description available)
un mysql-client-4.1 <none> (no description available)
ii mysql-client-5.0 5.0.32-7etch8 mysql database client binaries
ii mysql-common 5.0.32-7etch8 mysql database common files (e.g. /etc/mysql /my.cnf)
un mysql-common-4.1 <none> (no description available)
ii mysql-server 5.0.32-7etch8 mysql database server (meta package depending on the latest version)
un mysql-server-4.1 <none> (no description available)
ii mysql-server-5.0 5.0.32-7etch8 mysql database server binaries
mysqladmin shutdown does work but i'm still curious why the /etc/init.d/mysql commands aren't working.
I'm looking to create a black box solution that an IT administrator for a organization could easily install. They could pop it into the server rack and direct all incoming and outgoing email through it.
It would do some analysis of these emails (similar to anti-virus software) and then send the emails on their merry way. To be more specific, I want to create a digital finger print of the email and its attachments which would be stored on the machine and also send to an off-site server.
First off, in a general sense; Is this a reasonable way to make this work? Do you see any pit falls either technically or politically for a IT department to install this if requested by management?
To follow on that; What kind of open source or off-the-shelf solutions could be used as a base for this system? The analysis and finger print software we have already.
We are in the early stages of designing this solution so I open to ideas.