Home / user-95551

waxical's questions

Martin Hope
waxical
Asked: 2012-08-07 02:03:10 +0800 CST
  • 4

I've tried a number of obvious commands as detailed in Duplicity Man page to do this but it doesn't seem to work.

Scenario

I'm SSH'ing to a machine, then running Duplicity; below is the command, of sorts:-

ssh -i /keys/key.pem -o StrictHostKeyChecking=no user@ipAddress "sudo duplicity --s3-european-buckets --s3-use-new-style /local/dir/stuff s3+http://bucket/dir/"

Problem is, it's always asking for a passphrase, and I want to run this as an automated process without CLi user replies. The man page's only precise reference is to the environment variable PASSPHRASE, but makes little mention (with encrypt-key or sign-key which seem different) how this can be set.

NOTE: It's asking for GnuPG passphrase

ssh
Martin Hope
waxical
Asked: 2011-11-19 08:00:13 +0800 CST
  • 1

I've got a single domain. I moved my nameservers to AWS R53 yesterday. These are A record, alias'd to my ELB > EC2s.

However, occasionally, and mostly on subdomains I get drop out. It just could not be found.

Also, what appears to only happen on subdomains... I get really slow responses. This is not EC2 related, the www. responds super quick. And my carbon copy site works fine elsewhere, also pre-R53 loaded in normal speed.

I've done live HTTP headers and monitored logs, nothing hits the box until it visibly begins loading. So, it's obviously in the DNS realm. I'm not a great packet sniffer, so looking over Wireshark/Ethereal logs, I can only see whois and then standard queries to domain. Bit messy to work out what's going on.

Any advice or pointers in which to try and follow this problem up would be greatly appreciated.

performance domain-name-system apache-2.2 amazon-route53
Martin Hope
waxical
Asked: 2011-11-08 10:10:16 +0800 CST
  • 1

I'm working with Apache on an ec2 box. I'm trying to generate keys for a user, apache on the system.

However, I don't have permission, because it's ec2. So, I sudo - and get asked for a password for sudo apache. I have no password. I can not set a password.

I use keys to access the systems via these users.

How on earth am I meant to generate a key for apache to use?

linux apache-2.2 password users
Martin Hope
waxical
Asked: 2011-11-08 08:22:57 +0800 CST
  • 0

I'm working on an EC2 box and trying to SSH command another box.

The command works in command-line, even php -a interactive. However it does not work when running as apache. Example cmd:-

   system('ssh -i /home/me/keys/key.pem [email protected] "ls"');

I've tried adding apache to wheel group, and gshadow on both boxes. I've also just tried chowning the pem file to apache. Nothing.

Yet the command response fine in the two other use cases outlines.

What's going on here? Anyone know?

linux apache-2.2 command-line-interface ssh
Martin Hope
waxical
Asked: 2011-10-27 03:53:53 +0800 CST
  • 9

Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances.

My initial idea was to run all the instances a dumb slaves, and use S3 as local storage. For this, I've begun using S3FS but it's not really ready, from what I've seen, for production use in a web serving environment. Writing of logs seems to appear very late, if not never. Numerous issues with odd caching, even with no cache flags etc. Just generally nightmare to develop on.

But, the alternatives look few. One is obviously EBS volumes, which can be attached to a single instance. Some solutions to sharing this:-

  • SMB sharing to other instances. Having one master and the rest slaves - obv needs redundancy built in here with multiple EBS volumes perhaps?
  • Rsync sharing to other boxes. This seems painful, considering its not persistent and will updated periodically. Potentially ok, if there are forcing scripts to update when major changes have happened.

Question is... what DO people DO? It seems an entirely common use case, but the variety of answers found in forums and even here on SF, seems to suggest there's not a concise answer... help wanted!

amazon-ec2 amazon-s3 amazon-web-services s3fs amazon-ebs
Martin Hope
waxical
Asked: 2011-10-27 00:54:36 +0800 CST
  • 4

I'm having an a-hole of a problem redirecting traffic. Basically, I'm building a new web server and it's on another version of my domain, so I want to redirect traffic not from this IP.

Problem is Amazon's ELB Load Balancer is in the way, so it replaces REMOTE ip address. The normal method of obtaining. Research found I need to use %{X-Forward-For}i - but it's not working and I don't know if I've got it in the right placement and syntax. I'm running vhosts, so I put in the VirtualHost tags...

<VirtualHost *:80>
    ServerAdmin [email protected]
    DocumentRoot /var/www/vhosts/foo/www.bar.com/htdocs/
    ServerName www.bar.com
    ErrorLog /var/www/vhosts/foo/www.bar.com/logs/error.log
    CustomLog /var/www/vhosts/foo/www.bar.com/logs/access.log common
    RewriteEngine On
    RewriteCond %{X-Forwarded-For}i !^xxx\.xxx\.xxx\.xxx
    RewriteRule ^.*$ http://www.bar.com/ [R,L]
</VirtualHost>

Obv xxx.xxx.xxx.xxx being my IP.

Is this wrong?

apache-2.2 redirect httpd mod-rewrite 301-redirect
Martin Hope
waxical
Asked: 2011-10-26 02:29:03 +0800 CST
  • 0

I'm in the midst of setting up a standard web server on EC2. However, I'm just getting a 403 error on remote access, despite following tutorials (which describe a very simple process).

So far, I have

  1. Installed httpd and associating
  2. Mounted /var/www/vhosts/foo to an s3 bucket dir.
  3. Installed php

  4. Edited httpd conf adding a NameVirtualHost *:80, a

    <Directory "/var/www/vhosts/foo/*bar*">
Satisfy Any
Order Allow,Deny
Allow from all
</Directory>

and a

SuexecUserGroup root root

and a 

<VirtualHost *:80>
  ServerName foo.mydomain.com
  ServerAlias mydomain.com
  ServerAdmin [email protected]
  DocumentRoot /var/www/vhosts/foo/bar/htdocs
  CustomLog /var/www/vhosts/fooh/bar/logs/access.log common
  ErrorLog /var/www/vhosts/foo/bar/logs/error.log
  SuexecUserGroup root root
  ScriptAlias /cgi-bin/ "/var/www/vhosts/foo/cgi-bin.bar/"
</VirtualHost>

Now, I'm aware root isn't great at this stage. But, until the problem is sorted I haven't gone about changing that.

I've restarted httpd - I just get 403 errors. I can see the hits on access.log on the subdomain etc. so it is getting through (via my foo.mydomain.com) - but it's not going past a 403 and I can't figure out a reason why. All the tutorials say this is mega easy.

linux apache-2.2 amazon-ec2
Martin Hope
waxical
Asked: 2011-10-19 06:43:40 +0800 CST
  • 1

I'm going to to try and be as detailed as possible, as I'm aware these questions are often too loose.

I'm running some smaller services on EC2/RDS and have begun organising myself to migrate my entire service to EC2.

Current service runs:-

  • Around 200 Apache requests a minute / 12,000 per hour
  • Service is PHP driven with both front and back end functionality (I'd suggest roughly half all traffic is PHP requests)
  • Around 250mb mb uploaded via PHP per day
  • FFMPEG encoding (note; this will be portable, so could run on other instances of it got too heavy
  • Numerous daily processes parsing large quantities of logs and compressing database dump backups
  • Database - Will now migrate to RDS. Easy one.

I'm looking for some orientation on:-

  1. Indicators of what instance-type would be best to run permanently. Do you need more idea of usage to get this idea?
  2. An idea of whether it is worth using AWS load balancing facilities? I sense from the docs that these are targetted at larger scale implmentations. I'd certainly like the flexibility to start duplicate AMIs and distribute traffic, but whether to do this at DNS/Scripting level or use their services - not sure.
  3. An idea of a hitlist of things to do/be aware in an ec2 environment would be awesome.

I hope this isn't too vague.

migration amazon-ec2 amazon-web-services