Shoaibi's questions

I have a m1.large Debian based server on EU-West. Recently due to some changes in organization's policies we are to move to Rackspace. How would i move an AWS EC2 EU-West Debian Instance to Rackspace? Unfortunately it wasn't setup by me so i don't know exactly what and how it was configured, by a rough estimate i think i would need about a week to setup a fresh one with everything installed and configured same as this one.

I have also seen some scripts/posts that suggest to use same distro, same kernel on both source and target and then just rsync whole system(excluding few directories) to target.

I am trying to implement a dry run kind of mechanism for my script and facing the issue of quotes getting stripped off when a command is passed as an argument to a function and resulting in unexpected behavior.

dry_run () {
    echo "$@"
    #printf '%q ' "$@"

    if [ "$DRY_RUN" ]; then
        return 0
    fi

    "$@"
}


email_admin() {
    echo " Emailing admin"
    dry_run su - $target_username  -c "cd $GIT_WORK_TREE && git log -1 -p|mail -s '$mail_subject' $admin_email"
    echo " Emailed"
    }

Output is:

su - webuser1 -c cd /home/webuser1/public_html && git log -1 -p|mail -s 'Git deployment on webuser1' [email protected]

Expected:

su - webuser1 -c "cd /home/webuser1/public_html && git log -1 -p|mail -s 'Git deployment on webuser1' [email protected]"

With printf enabled instead of echo:

su - webuser1 -c cd\ /home/webuser1/public_html\ \&\&\ git\ log\ -1\ -p\|mail\ -s\ \'Git\ deployment\ on\ webuser1\'\ [email protected]

Result:

su: invalid option -- 1

That shouldn't be the case if quotes remained where they were inserted. I have also tried using "eval", not much difference. If i remove the dry_run call in email_admin and then run script, it work great.

I have configured Gitorious under Nginx and Passenger on Ubuntu. When i try to add ssh key, i get a 500 server error, where gitorious tells me that the responsible personals has been notified. On the server logs we are seeing:

TypeError (can't convert nil into Integer):
  vendor/plugins/paperclip/lib/paperclip/processor.rb:45:in `sprintf'
  vendor/plugins/paperclip/lib/paperclip/processor.rb:45:in `make_tmpname'
  /usr/local/rvm/rubies/ruby-1.9.2-p136/lib/ruby/1.9.1/tmpdir.rb:132:in `create'
  /usr/local/rvm/rubies/ruby-1.9.2-p136/lib/ruby/1.9.1/tempfile.rb:134:in `initialize'
  app/models/ssh_key.rb:121:in `new'
  app/models/ssh_key.rb:121:in `valid_key_using_ssh_keygen?'
  app/models/ssh_key.rb:47:in `validate'
  vendor/rails/activerecord/lib/active_record/validations.rb:1099:in `valid?'
  vendor/rails/activerecord/lib/active_record/callbacks.rb:315:in `valid_with_callbacks?'
  vendor/rails/activerecord/lib/active_record/validations.rb:1077:in `save_with_validation'
  vendor/rails/activerecord/lib/active_record/dirty.rb:79:in `save_with_dirty'
  vendor/rails/activerecord/lib/active_record/transactions.rb:229:in `block in with_transaction_returning_status'
  vendor/rails/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:136:in `transaction'
  vendor/rails/activerecord/lib/active_record/transactions.rb:182:in `transaction'
  vendor/rails/activerecord/lib/active_record/transactions.rb:228:in `with_transaction_returning_status'
  vendor/rails/activerecord/lib/active_record/transactions.rb:196:in `block in save_with_transactions'
  vendor/rails/activerecord/lib/active_record/transactions.rb:208:in `rollback_active_record_state!'
  vendor/rails/activerecord/lib/active_record/transactions.rb:196:in `save_with_transactions'
  app/controllers/keys_controller.rb:48:in `block in create'
  vendor/rails/actionpack/lib/action_controller/mime_responds.rb:106:in `call'
  vendor/rails/actionpack/lib/action_controller/mime_responds.rb:106:in `respond_to'
  app/controllers/keys_controller.rb:47:in `create'
  vendor/rails/actionpack/lib/action_controller/base.rb:1331:in `perform_action'
  vendor/rails/actionpack/lib/action_controller/filters.rb:617:in `call_filters'
  vendor/rails/actionpack/lib/action_controller/filters.rb:610:in `perform_action_with_filters'
  vendor/rails/actionpack/lib/action_controller/benchmarking.rb:68:in `block in perform_action_with_benchmark'
  vendor/rails/activesupport/lib/active_support/core_ext/benchmark.rb:17:in `block in ms'
  /usr/local/rvm/rubies/ruby-1.9.2-p136/lib/ruby/1.9.1/benchmark.rb:309:in `realtime'
  vendor/rails/activesupport/lib/active_support/core_ext/benchmark.rb:17:in `ms'
  vendor/rails/actionpack/lib/action_controller/benchmarking.rb:68:in `perform_action_with_benchmark'
      vendor/rails/actionpack/lib/action_controller/rescue.rb:160:in `perform_action_with_rescue'
  vendor/rails/actionpack/lib/action_controller/flash.rb:146:in `perform_action_with_flash'
  vendor/rails/actionpack/lib/action_controller/base.rb:532:in `process'
  vendor/rails/actionpack/lib/action_controller/filters.rb:606:in `process_with_filters'
  vendor/rails/actionpack/lib/action_controller/base.rb:391:in `process'
  vendor/rails/actionpack/lib/action_controller/base.rb:386:in `call'
  vendor/rails/actionpack/lib/action_controller/routing/route_set.rb:437:in `call'
  vendor/rails/actionpack/lib/action_controller/dispatcher.rb:87:in `dispatch'
  vendor/rails/actionpack/lib/action_controller/dispatcher.rb:121:in `_call'
  vendor/rails/actionpack/lib/action_controller/dispatcher.rb:130:in `block in build_middleware_stack'
  vendor/rails/activerecord/lib/active_record/query_cache.rb:29:in `call'
  vendor/rails/activerecord/lib/active_record/query_cache.rb:29:in `block in call'
  vendor/rails/activerecord/lib/active_record/connection_adapters/abstract/query_cache.rb:34:in `cache'
  vendor/rails/activerecord/lib/active_record/query_cache.rb:9:in `cache'
  vendor/rails/activerecord/lib/active_record/query_cache.rb:28:in `call'
  vendor/rails/activerecord/lib/active_record/connection_adapters/abstract/connection_pool.rb:361:in `call'
  vendor/rails/actionpack/lib/action_controller/string_coercion.rb:25:in `call'
  rack (1.0.1) lib/rack/head.rb:9:in `call'
  rack (1.0.1) lib/rack/methodoverride.rb:24:in `call'
  vendor/rails/actionpack/lib/action_controller/params_parser.rb:15:in `call'
  vendor/rails/railties/lib/rails/rack/metal.rb:47:in `call'
  vendor/rails/actionpack/lib/action_controller/session/cookie_store.rb:93:in `call'
  vendor/rails/activesupport/lib/active_support/cache/strategy/local_cache.rb:24:in `call'
  vendor/rails/actionpack/lib/action_controller/failsafe.rb:26:in `call'
  rack (1.0.1) lib/rack/lock.rb:11:in `block in call'
  <internal:prelude>:10:in `synchronize'
  rack (1.0.1) lib/rack/lock.rb:11:in `call'
  vendor/rails/actionpack/lib/action_controller/dispatcher.rb:106:in `call'
  passenger (3.0.2) lib/phusion_passenger/rack/request_handler.rb:96:in `process_request'
  passenger (3.0.2) lib/phusion_passenger/abstract_request_handler.rb:513:in `accept_and_process_next_request'
  passenger (3.0.2) lib/phusion_passenger/abstract_request_handler.rb:274:in `main_loop'
  passenger (3.0.2) lib/phusion_passenger/classic_rails/application_spawner.rb:321:in `start_request_handler'
  passenger (3.0.2) lib/phusion_passenger/classic_rails/application_spawner.rb:275:in `block in handle_spawn_application'
  passenger (3.0.2) lib/phusion_passenger/utils.rb:479:in `safe_fork'
  passenger (3.0.2) lib/phusion_passenger/classic_rails/application_spawner.rb:270:in `handle_spawn_application'
  passenger (3.0.2) lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'
  passenger (3.0.2) lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'
  passenger (3.0.2) lib/phusion_passenger/abstract_server.rb:180:in `start'
  passenger (3.0.2) lib/phusion_passenger/classic_rails/application_spawner.rb:149:in `start'
  passenger (3.0.2) lib/phusion_passenger/spawn_manager.rb:219:in `block (2 levels) in spawn_rails_application'
  passenger (3.0.2) lib/phusion_passenger/abstract_server_collection.rb:132:in `lookup_or_add'
  passenger (3.0.2) lib/phusion_passenger/spawn_manager.rb:214:in `block in spawn_rails_application'
  passenger (3.0.2) lib/phusion_passenger/abstract_server_collection.rb:82:in `block in synchronize'
  <internal:prelude>:10:in `synchronize'
  passenger (3.0.2) lib/phusion_passenger/abstract_server_collection.rb:79:in `synchronize'
  passenger (3.0.2) lib/phusion_passenger/spawn_manager.rb:213:in `spawn_rails_application'
  passenger (3.0.2) lib/phusion_passenger/spawn_manager.rb:132:in `spawn_application'
  passenger (3.0.2) lib/phusion_passenger/spawn_manager.rb:275:in `handle_spawn_application'
  passenger (3.0.2) lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'
  passenger (3.0.2) lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'
  passenger (3.0.2) helper-scripts/passenger-spawn-server:99:in `<main>'

I have seen this notified here: http://groups.google.com/group/gitorious/browse_thread/thread/db20b2c7eef2d5a9 but no solution was posted. I am not an RoR guy myself, so have no clue on what could be the possible fix.

I am following http://cjohansen.no/en/ruby/setting_up_gitorious_on_your_own_server to install gitorious with ruby1.9 installed via rvm. When i try to create admin user i get:

$ env RAILS_ENV=production ruby script/create_admin 
<internal:lib/rubygems/custom_require>:29:in `require': no such file to load -- script/../config/environment (LoadError)
        from <internal:lib/rubygems/custom_require>:29:in `require'
    from script/create_admin:2:in `<main>'

would appreciate all the help i can get.

I have a simple script to help me do some power saving:

#!/bin/bash
echo 1 > /sys/module/snd_hda_intel/parameters/power_save
echo min_power > /sys/class/scsi_host/host0/link_power_management_policy
echo 1500 > /proc/sys/vm/dirty_writeback_centisecs

I want this to run on every boot as root, tried running it by adding:

/bin/bash /root/power-save.sh

in

/etc/rc.local

and also tried by adding following to root's crontab:

@reboot /bin/bash /root/power-save.sh

no use..

I have got an application which has three components

• Application code : Amazon EC2 US-EAST-1 instance
• Application images, and other static data : Amazon S3 with CloudFront
• Application Database : Amazon RDS

In short i need something like Cloud Front for EC2.

In long, people using this application from a different region say middle east will have faster static content downloading due to Cloud Front but there would be a lot of latency in communicating to EC2 instance. I want to use a budget friendly way of enhancing this. Launching Amazon Instances in every region that offer is sure a choice, but isn't really cheap, so would try to avoid it unless its last resort.

Also say if my clients also need to communicate to the RDS database directly, is there some kind of solution which gives that kind of functionality mentioned above, but for RDS?

I have chrooted sftp setup as below.

# Package generated configuration file
# See the sshd_config(5) manpage for details

# What ports, IPs and protocols we listen for
Port 22
# Use these options to restrict which interfaces/protocols sshd will bind to
#ListenAddress ::
#ListenAddress 0.0.0.0
Protocol 2
# HostKeys for protocol version 2
HostKey /etc/ssh/ssh_host_rsa_key
HostKey /etc/ssh/ssh_host_dsa_key
#Privilege Separation is turned on for security
UsePrivilegeSeparation yes

# Lifetime and size of ephemeral version 1 server key
KeyRegenerationInterval 3600
ServerKeyBits 768

# Logging
SyslogFacility AUTH
LogLevel INFO

# Authentication:
LoginGraceTime 120
PermitRootLogin without-password
StrictModes yes
AllowGroups admins clients

RSAAuthentication yes
PubkeyAuthentication yes
#AuthorizedKeysFile %h/.ssh/authorized_keys

# Don't read the user's ~/.rhosts and ~/.shosts files
IgnoreRhosts yes
# For this to work you will also need host keys in /etc/ssh_known_hosts
RhostsRSAAuthentication no
# similar for protocol version 2
HostbasedAuthentication no
# Uncomment if you don't trust ~/.ssh/known_hosts for RhostsRSAAuthentication
#IgnoreUserKnownHosts yes

# To enable empty passwords, change to yes (NOT RECOMMENDED)
PermitEmptyPasswords no

# Change to yes to enable challenge-response passwords (beware issues with
# some PAM modules and threads)
ChallengeResponseAuthentication no

# Change to no to disable tunnelled clear text passwords
#PasswordAuthentication yes

# Kerberos options
#KerberosAuthentication no
#KerberosGetAFSToken no
#KerberosOrLocalPasswd yes
#KerberosTicketCleanup yes

# GSSAPI options
#GSSAPIAuthentication no
#GSSAPICleanupCredentials yes

X11Forwarding yes
X11DisplayOffset 10
PrintMotd no
PrintLastLog yes
TCPKeepAlive yes
#UseLogin no

#MaxStartups 10:30:60
#Banner /etc/issue.net

# Allow client to pass locale environment variables
AcceptEnv LANG LC_*

#Subsystem sftp /usr/lib/openssh/sftp-server

# Set this to 'yes' to enable PAM authentication, account processing,
# and session processing. If this is enabled, PAM authentication will
# be allowed through the ChallengeResponseAuthentication and
# PasswordAuthentication.  Depending on your PAM configuration,
# PAM authentication via ChallengeResponseAuthentication may bypass
# the setting of "PermitRootLogin without-password".
# If you just want the PAM account and session checks to run without
# PAM authentication, then enable this but set PasswordAuthentication
# and ChallengeResponseAuthentication to 'no'.
UsePAM yes



Subsystem sftp internal-sftp

Match group clients
    ChrootDirectory /var/chroot-home
    X11Forwarding no
    AllowTcpForwarding no
    ForceCommand internal-sftp

a dummy user

root:~# tail -n1 /etc/passwd
david:x:1000:1001::/david:/bin/sh

Now in this case david can sftp using say filezilla client and he is chrooted to /var/chroot-home/david/. But what if i was to setup a passwordless auth? I have tried pasting his key in /var/chroot-home/david/.ssh/authorized_keys but no use, tried ssh'ing as david to the box and it just stops at "debug1: Sending env LC_CTYPE = C" after i supply it password and there is nothing shown in auth.log, may be because it can't find the homedir. If i do "su - david" as root i see "No directory, logging in with HOME=/" which makes sense. Symlink doesn't help either.

I have also tried with:

Match group clients
        ChrootDirectory /var/chroot-home/%u
        X11Forwarding no
        AllowTcpForwarding no
        ForceCommand internal-sftp

a dummy user

root:~# tail -n1 /etc/passwd
david:x:1000:1001::/var/chroot-home/david:/bin/sh

This way if i don't change /var/chroot-home/david to root:root sshd complains about bad ownership or permission modes, and if i do, david can no longer upload/delete anything directly in his home while using sftp from filezilla.

I have a WebServer say WS-1 and a NFS server say NFS-1 setup on AWS. WS-1 is being managed by an elastic load balancer and also autoscaled. It also has an EBS mounted on /var/www which contains all application code.

• During autoscaling if another WS-X is launched will the /var/www mounted EBS also cloned and attached to that as well? If not, what are my options besides hosting code on root EBS volume?

• Access inside NFS is defined on IP basis like 10.0.0.1/32(rw,...). During autoscaling more instances will be launched, how can i allow them to connect to NFS server and mounted the shared directory? I don't want to give access to private IP subnet using NFS, while on the Security Group level i have given access to NFS server to 0.0.0.0/0. NFS server uses fixed ports like 111, 2049, 4000-4002.

I am trying to setup a repository server based on git combine with its git-http-backend and apache. My problem? I can clone perfectly, but when i try ti push, i hit a wall

$ git push origin master
* Couldn't find host git.local in the .netrc file; using defaults
* About to connect() to git.local port 80 (#0)
*   Trying 127.0.0.1... * connected
* Connected to git.local (127.0.0.1) port 80 (#0)
> GET /new/info/refs?service=git-receive-pack HTTP/1.1
User-Agent: git/1.7.1
Host: git.local
Accept: */*
Pragma: no-cache

< HTTP/1.1 401 Authorization Required
< Date: Tue, 23 Nov 2010 16:21:51 GMT
< Server: Apache/2.2.16 (Ubuntu)
< WWW-Authenticate: Basic realm="Private Git Access"
< Vary: Accept-Encoding
< Content-Length: 476
< Content-Type: text/html; charset=iso-8859-1
< 
* Ignoring the response-body
* Connection #0 to host git.local left intact
* Issue another request to this URL: 'http://shoaibi:[email protected]/new/info/refs?service=git-receive-pack'
* Couldn't find host git.local in the .netrc file; using defaults
* Re-using existing connection! (#0) with host git.local
* Connected to git.local (127.0.0.1) port 80 (#0)
* Server auth using Basic with user 'shoaibi'
> GET /new/info/refs?service=git-receive-pack HTTP/1.1
Authorization: Basic c2hvYWliaTpzaG9haWJp
User-Agent: git/1.7.1
Host: git.local
Accept: */*
Pragma: no-cache

< HTTP/1.1 200 OK
< Date: Tue, 23 Nov 2010 16:21:51 GMT
< Server: Apache/2.2.16 (Ubuntu)
< Last-Modified: Tue, 23 Nov 2010 15:30:17 GMT
< ETag: "8853-0-495ba0cca2f10"
< Accept-Ranges: bytes
< Content-Length: 0
< Content-Type: text/plain
< 
* Connection #0 to host git.local left intact
* Couldn't find host git.local in the .netrc file; using defaults
* Re-using existing connection! (#0) with host git.local
* Connected to git.local (127.0.0.1) port 80 (#0)
* Server auth using Basic with user 'shoaibi'
> GET /new/HEAD HTTP/1.1
Authorization: Basic c2hvYWliaTpzaG9haWJp
User-Agent: git/1.7.1
Host: git.local
Accept: */*
Pragma: no-cache

< HTTP/1.1 200 OK
< Date: Tue, 23 Nov 2010 16:21:51 GMT
< Server: Apache/2.2.16 (Ubuntu)
< Last-Modified: Tue, 23 Nov 2010 12:05:07 GMT
< ETag: "88b7-17-495b72f0814f0"
< Accept-Ranges: bytes
< Content-Length: 23
< Content-Type: text/plain
< 
* Expire cleared
* Connection #0 to host git.local left intact
* Couldn't find host git.local in the .netrc file; using defaults
* About to connect() to git.local port 80 (#0)
*   Trying 127.0.0.1... * connected
* Connected to git.local (127.0.0.1) port 80 (#0)
> PROPFIND /new/ HTTP/1.1
User-Agent: git/1.7.1
Host: git.local
Accept: */*
Depth: 0
Content-Type: text/xml
Content-Length: 167
Expect: 100-continue

< HTTP/1.1 401 Authorization Required
< Date: Tue, 23 Nov 2010 16:21:51 GMT
< Server: Apache/2.2.16 (Ubuntu)
< WWW-Authenticate: Basic realm="Private Git Access"
< Vary: Accept-Encoding
< Content-Length: 476
< Content-Type: text/html; charset=iso-8859-1
< 
* Expire cleared
* Closing connection #0
* Issue another request to this URL: 'http://shoaibi:[email protected]/new/'
* Couldn't find host git.local in the .netrc file; using defaults
* About to connect() to git.local port 80 (#0)
*   Trying 127.0.0.1... * connected
* Connected to git.local (127.0.0.1) port 80 (#0)
* Server auth using Basic with user 'shoaibi'
> PROPFIND /new/ HTTP/1.1
Authorization: Basic c2hvYWliaTpzaG9haWJp
User-Agent: git/1.7.1
Host: git.local
Accept: */*
Depth: 0
Content-Type: text/xml
Content-Length: 167
Expect: 100-continue

< HTTP/1.1 100 Continue
* The requested URL returned error: 405
* Expire cleared
* Closing connection #0
error: Cannot access URL http://shoaibi:[email protected]/new/, return code 22
fatal: git-http-push failed

Apache's Logs say:

127.0.0.1 - - [23/Nov/2010:21:21:51 +0500] "GET /new/info/refs?service=git-receive-pack HTTP/1.1" 401 725
127.0.0.1 - shoaibi [23/Nov/2010:21:21:51 +0500] "GET /new/info/refs?service=git-receive-pack HTTP/1.1" 200 231
127.0.0.1 - shoaibi [23/Nov/2010:21:21:51 +0500] "GET /new/HEAD HTTP/1.1" 200 256
127.0.0.1 - - [23/Nov/2010:21:21:51 +0500] "PROPFIND /new/ HTTP/1.1" 401 725
127.0.0.1 - shoaibi [23/Nov/2010:21:21:51 +0500] "PROPFIND /new/ HTTP/1.1" 405 553

git-http-backend requires cgi, alias and env mods enabled, these are already enabled, i even tried enabled and disabling dav related modules after reading some results on google. Apache's enabled modules:

 $apache2ctl -M
Loaded Modules:
 core_module (static)
 log_config_module (static)
 logio_module (static)
 mpm_prefork_module (static)
 http_module (static)
 so_module (static)
 alias_module (shared)
 auth_basic_module (shared)
 authn_file_module (shared)
 authz_default_module (shared)
 authz_groupfile_module (shared)
 authz_host_module (shared)
 authz_user_module (shared)
 autoindex_module (shared)
 cache_module (shared)
 cgi_module (shared)
 dav_module (shared)
 deflate_module (shared)
 dir_module (shared)
 env_module (shared)
 mem_cache_module (shared)
 mime_module (shared)
 security2_module (shared)
 negotiation_module (shared)
 php5_module (shared)
 proxy_module (shared)
 proxy_ajp_module (shared)
 proxy_balancer_module (shared)
 reqtimeout_module (shared)
 rewrite_module (shared)
 setenvif_module (shared)
 ssl_module (shared)
 status_module (shared)
 unique_id_module (shared)
 userdir_module (shared)
Syntax OK

Apache's Vhost:

<VirtualHost *:80>
        ServerName www.git.local
        ServerAlias git.local
        ServerAdmin [email protected]
        DocumentRoot /var/www/git/

        SetEnv GIT_PROJECT_ROOT /var/www/git
        SetEnv GIT_HTTP_EXPORT_ALL
        ScriptAlias /git/ /usr/lib/git-core/git-http-backend
        <Directory />
            Options +ExecCGI
            Allow From All
        </Directory>


        <Location />
                AuthType Basic
                AuthName "Private Git Access"
                Require group committers
                AuthUserFile /var/www/git/.htpasswd
                AuthGroupFile /var/www/git/.htgroup
        </Location>

        ErrorLog /var/log/apache2/git-error_log
        CustomLog /var/log/apache2/git-access_log common


</VirtualHost>

htpasswd:

$ cat .htpasswd
shoaibi:HSt/9CzkstIUM

htgroup:

$ cat .htgroup
committers: shoaibi

Directory Structure:

$ ls -al
total 28
drwxrwxr-x  4 www-data shoaibi 4096 2010-11-23 17:05 .
drwxrwxr-x 17 www-data shoaibi 4096 2010-11-23 11:46 ..
-rwxrwxr-x  1 www-data shoaibi   20 2010-11-23 16:51 .htgroup
-rwxrwxr-x  1 www-data shoaibi   22 2010-11-23 16:50 .htpasswd
-rwxrwxr-x  1 www-data shoaibi    9 2010-11-23 15:46 index.html
drwxrwxr-x  7 www-data shoaibi 4096 2010-11-23 11:53 myrepo.git
drwxrwxr-x  7 www-data shoaibi 4096 2010-11-23 17:05 new


$ ls -al new
total 40
drwxrwxr-x 7 www-data shoaibi 4096 2010-11-23 17:05 .
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 17:05 ..
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 17:05 branches
-rwxrwxr-x 1 www-data shoaibi   66 2010-11-23 17:05 config
-rwxrwxr-x 1 www-data shoaibi   73 2010-11-23 17:05 description
-rwxrwxr-x 1 www-data shoaibi   23 2010-11-23 17:05 HEAD
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 17:05 hooks
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 20:30 info
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 17:05 objects
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 17:05 refs


 $ ls -al myrepo.git
total 40
drwxrwxr-x 7 www-data shoaibi 4096 2010-11-23 11:53 .
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 17:05 ..
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 11:53 branches
-rwxrwxr-x 1 www-data shoaibi   66 2010-11-23 11:53 config
-rwxrwxr-x 1 www-data shoaibi   73 2010-11-23 11:53 description
-rwxrwxr-x 1 www-data shoaibi   23 2010-11-23 11:53 HEAD
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 11:53 hooks
drwxrwxr-x 2 www-data shoaibi 4096 2010-11-23 16:20 info
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 11:53 objects
drwxrwxr-x 4 www-data shoaibi 4096 2010-11-23 11:53 refs

I was upgrading my servers today and it all went fine except the last machine which has the following issues:

[Resolved using http://www.ndchost.com/wiki/server-administration/upgrade-ubuntu-pre-10.04#post-1004-upgradefinal-steps]

• No login prompt on console

  Done.
  Begin: Mounting root file system... ...
  Begin: Running /scripts/local-top ...
  Done.
  [    0.545705] blkfront: xvda: barriers enabled
  [    0.546949]  xvda: xvda1
  [    0.549961] blkfront: xvde: barriers enabled
  [    0.550619]  xvde: xvde1 xvde2
  Begin: Running /scripts/local-premount ...
  Done.
  [    0.870385] kjournald starting.  Commit interval 5 seconds
  [    0.870449] EXT3-fs: mounted filesystem with ordered data mode.
  Begin: Running /scripts/local-bottom ...
  Done.
  Done.
  Begin: Running /scripts/init-bottom ...
  Done.
  

Also tried by pressing ENTER and CTRL+C many times, no use.

Resolved: [/tmp was mounted as noexec, changing that fix it]:

• I get errors when i try to re-install udev in single user mode:

  Unpacking replacement udev ...
  Processing triggers for ureadahead ...
  ureadahead will be reprofiled on next reboot
  Processing triggers for man-db ...
  Setting up udev (151-12.1) ...
  udev start/running, process 1003
  Removing `local diversion of /sbin/udevadm to /sbin/udevadm.upgrade'
  update-initramfs: deferring update (trigger activated)
  
  Processing triggers for initramfs-tools ...
  update-initramfs: Generating /boot/initrd.img-2.6.32-25-server
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/local-premount/fixrtc: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/local-premount/ntfs_3g: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/local-premount/resume: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/nfs-top/udev: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/panic/console_setup: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/init-top/all_generic_ide: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/init-top/blacklist: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/init-top/udev: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/init-bottom/udev: Permission denied
  /usr/sbin/mkinitramfs: 329: /tmp/mkinitramfs_yuuTSc/scripts/local-bottom/ntfs_3g: Permission denied
  

• Can i configure apache reverse proxy server so that it load some of files from local document root? Like may be static files?
• Can i used Nginx as a alternate for Apache (mod_proxy, mod_proxy_html, mod_rewrite)? If yes, any links? suggestions?

I have a scenario where i have to establish peer-to-peer preshared key based VPN to a vendor. This vendor uses Cisco EasyVPN with Cisco VPN 3000 as access concentrator. I check the compatibility of the type of VPN from http://www.cisco.com/en/US/prod/collateral/iosswrel/ps6537/ps6586/ps6635/ps7180/prod_brochure0900aecd80582078.pdf and it appears that it would only work on cisco hardware.

I am looking for a less inexpensive and possibly and open replacement to this to save my cost and also recommend to them. I have tried OpenVPN and thinking about vyatta.

We have a server on which we host private services. These services can also be access from rest of the world but there is slight difference on application level based on from which IP request came.

Applications run on subdomains like app1.domain.com, so i want to add *.domain.com to exception somewhere and point it to our VPN IP instead of public. /etc/hosts is an overkill as there are 25 client systems at this office and further more i would have to update everyone's /etc/hosts everytime we launch a new app. I am looking for more generic and one time solution.

Could DNS be my solution? but even in that case won't i have to add a new entry everytime a new app is launched? (which is much better than adding it to 25 machines though but still...)

What do you suggest?

I have linux installed on this laptop. It has 320G HD. I want to experiment something and for that i will have to format my hard disk. I have got a spare 500G USB External Drive. Can someone suggest me a backup method with which i could take a complete backup of current state of the system and later restore it without any issues?

I myself have two options in mind:

• dd
• clonezilla

Here is my fstab

Filesystem    Type    Size  Used Avail Use% Mounted on
/dev/sda7     ext3     19G   12G  6.0G  67% /
/dev/sda6     ext2    2.3G  261M  2.0G  12% /tmp
/dev/sda2     ext2     89M   45M   40M  54% /boot
/dev/sda5 reiserfs    4.9G  614M  4.3G  13% /var
/dev/sda8     ext4    264G  133G  132G  51% /home

I have somehow managed to purchase a VPS after collecting money for sometime, now problem is i cant find a way to backup the server. My previous approach was:

Got a webdav account from mydisk.se, mounted it on the vps, used duplicity and created encrypted backups.

Problem is it was only 2G, and its running out of space, at my own place i dont have a stable internet connection else i have a 500G drive that i could surely use for backups. The vps has a 12G HD, and i would like to backup /home, /root, /etc, /var/ (specially log and www).

Any ideas are welcomed.

[EDIT] I am more of looking for resource of setting up a backup-point or such(i know how to setup a backup server, but i cant as i dont have stable connection or the money to buy another VPS/disk for backup) , i have already got the tools needed.

(yes, the title is strange, but read on...)

I copied some data from here and there on my linux box and now i find some many eml and HTML:Nimda viruses on my system when i scan it using clamtk. Problem is that these are 1700+ files that i have to manually select and do action. Plus clamtk doesnt clean it? is there any other way possible to remove these viruses?

I have a finding to share, all infected html files contain:

<html><script language="JavaScript">window.open("readme.eml", null,"resizable=no,top=6000,left=6000")</script></html>

multiple times around the end of file (the previous end e.g. it is appended at the end of every html file)

so all i gotta do is:

1. Search for all eml files, delete them, some eml files' paths have spaces and other characters between them, so will have to be careful here to no remove the directory or miss the file.

2. Search for all html files, grep them for these lines, if the lines exists, i would have to delete any lines that match the pattern of :

<script language="JavaScript">window.open("readme.eml", null,

because rest of pattern varies a bit.

I think i need a shell script, my own scripting isnt really great but i will try, in a mean while i am waiting here for answers.

I am a student and for my hobby projects i managed to buy a vps. Problem is how can i backup that? I have got a webdav account somewhere (and they allow to store any file types for any purposes as long as copyrights are not being voilated) and i have mounted webdav as /media/webdav.

My usual tbz2 backups site is around 300-400M and incremental backups vary from 20M to 120M. This is when i do them manually and download them on my laptop.

I am using Debian Lenny on the server and i am looking for a backup solution that makes full and incremental backups with encryption as i would store the backups on the webdav mount.

I tried duplicity, but its a bit complexed, but i have disabled root's ssh, and only root has access to most of the folders that i want to backup. So if possible please suggest a solution.

I have looked over rdiff-backup, rsnapshot, ftplicity, box backup and some others.

Finally decided Duplicity as the tool to go with.

I work as a sysadmin in a company and i am required to Deploy openLDAP. I have read a lot of materials but i really can't figure out where to start.

First about the company:

Services:

1. Email: every user gets an email account such as [email protected] and an email alias/forwarder of the format [email protected] or sometimes [First-letter-of-first-name][email protected]
2. Jabber: every user gets a jabber account of format [email protected]. In some cases this becomes firstname.lastname if names collide.
3. Trac and Redmine: Every use gets accounts for trac and redmine which are usually his first name.
4. A timetrex login as firstname or first.lastname.
5. A machine login, firstname.
6. Membership to mailing lists such as [email protected], [email protected], [email protected] and etc.
7. A MediaWiki account, again of the same format as email alias/forwarder.
8. A ssh account on one of deployment server of the same format as email alias/forwarder.

What i think i should do: I should use inetOrgPerson and create custom scheme for our organization. What i am unsure is how can i manage so many different logins and how will respect software know which login to use. I have written a custom scheme that can store following information:

• Full name
• Phone
• Cell
• Address
• City
• Country
• Department
• Joined on

Will anyone point me to the right direction? i have wasted a lot of time searching over it but couldnt come up with anything... Really appreciate you taking time and reading the question.

I recently configured accelerator and fastcgi with apache using: http://secure-ubuntu-server.blogspot.com/2009/07/howto-performance-tuning-of-lamp-and.html

Now my Apache never starts.

Logs shows:

Mon Jul 20 16:12:24 2009] [notice] ModSecurity for Apache/2.5.6 (http://www.modsecurity.org/) configured.
[Mon Jul 20 16:12:25 2009] [notice] FastCGI: process manager initialized (pid 10919)
[Mon Jul 20 16:12:25 2009] [alert] FastCGI: read() from pipe failed (0)
[Mon Jul 20 16:12:25 2009] [alert] FastCGI: the PM is shutting down, Apache seems to have disappeared - bye

I am running FreeBSD 7 and I get this in /var/log/security :

+++ /tmp/security.AIKARuA1  2009-06-30 03:05:17.000000000 +0500
+TCP: [69.147.83.36]:80 to [115.186.130.56]:50488 tcpflags 0x10<ACK>; tcp_do_segment: FIN_WAIT_1: Received 1440 bytes of data after socket was closed, sending RST and removing tcpcb
+TCP: [69.147.83.36]:80 to [115.186.130.56]:55740 tcpflags 0x10<ACK>; tcp_do_segment: FIN_WAIT_1: Received 1440 bytes of data after socket was closed, sending RST and removing tcpcb
+TCP: [69.147.83.33]:80 to [115.186.130.56]:52461 tcpflags 0x10<ACK>; tcp_do_segment: FIN_WAIT_1: Received 1440 bytes of data after socket was closed, sending RST and removing tcpcb
+TCP: [69.147.83.36]:80 to [115.186.130.56]:57401 tcpflags 0x10<ACK>; tcp_do_segment: FIN_WAIT_1: Received 1440 bytes of data after socket was closed, sending RST and removing tcpcb

What I can infer from here, which is quite obvious, is that client sent some data while the connection was supposed to be closed.
Could this be a case where I initiated an ssh session, got had a Man-in-the-Middle soemwhere without me knowing, and after I closed the SSH session he tried to connect again?