I have a few questions, since the recent Amazon Cloudburst.
Since I am charged I/O on an external EBS, am I correct in guessing that the EBS volumes are in a different location than the instances?
I have a few key-pairs, that are used as authentication, to ssh into my servers on the Amazon cloud. I rotate those certificates weekly, manually. My question is, I need to share the certificates with some colleagues, a few on the LAN, and a few in another part of the country. What is the best practice to share the certificate? My initial thoughts were Dropbox and email. We dont host dedicated email servers with encryption and all, and dont have a VPN.
Thanks.
I am facing a load average of > 3 since past 2 days. The CPU utilization is never above 40 % in all cases. Here are some screenshots of Server Density monitoring tool that I use.
The process snapshot at the highest peak, @ 0:00 is as follows:
And the process snapshot at the peak created at 12:00 is:
My question is, even though CPU utilization is not 100 %, why am I facing a high average?
PS: All snapshots are sorted by descending CPU utilization.
Is the 1.7 GB memory bottlenecked by the 32 bit processor in case of Small instance? Or does choosing 64 bit Micro instance give better performance because its 64bit? I am confused performance wise, and cant think straight. Even if there is no fixed answer, can anyone list out the points I should think about before selecting either? If it helps, this is my configuration:
1 Micro/Small Instance, running via Elastic Beanstalk. Hosts the webapp, created in GWT, and is a mongoDB slave.
1 Large DB-server, running as mongoDB master. The webapp queries the DB-Server for data, the slave is a read-only.
The webapp runs mongod, memcached, apache and tomcat.
PS: We need an amazon-beanstalk tag.
Do all ProxyPass Directives need a ProxyPassReverse Directive?
ProxyPass / http://foo.example.com:8080/
ProxyPassReverse / http://www.example.com/
I saw this snippet, and understand that all traffic coming to foo.example.com is proxied to foo.example.com:8080. What does the second line do?
I have a few instances running on the Amazon cloud. Some are DB-servers, some are blogs and one has my webapp. The DB-servers don't have apache or any other web-servers installed. So will it be safe to allot an IP to the DB-Servers?
I want to host my images on Amazon S3. So I created a bucket by the name images.foo.com and added a CNAME entry with the record host as images.foo.com and a record answer as s3.amazonaws.com.
There is a file in the bucket named image.jpg, under a folder named images. which I can access at images.foo.com.s3.amazonaws.com/images/image.jpg I cant access the same from images.foo.com/images/image.jpg
I also changed the record answer to s3.amazonaws.com/images.foo.com/, but that also doesnt work. What am I missing?
Thanks.
EDIT, AFTER THE ANSWER: Just read these pages:
http://carltonbale.com/how-to-alias-a-domain-name-or-sub-domain-to-amazon-s3
http://www.wrichards.com/blog/2009/02/customize-your-amazon-s3-url/comment-page-1/#comment-135
This is my httpd.conf configured with Virtual hosts:
NameVirtualHost *:80
<VirtualHost *:80>
ServerName http://foo.baz.in
DocumentRoot /var/www/foo/
</VirtualHost>
<VirtualHost *:80>
ServerName http://bar.baz.in
DocumentRoot /var/www/
</VirtualHost>
The second virtual host is a Wordpress blog, configured with .htaccess, and index.php in the root i.e. /var/www, and rest of the files in wordpress's own folder.
However, the first virtual host is a "war" file, and when I goto foo.baz.in, I see the directory listing, containing the war. I also tried changing the DocumentRoot to /var/www/foo/foo.war` but I get an error
Restarting web server: apache2Warning: DocumentRoot [/var/www/foo/foo.war] does not exist
I also changed the owner and permission of the war to www-data:www-data and changed the permissions to 755, but to no avail.
How do I make apache deploy my "war"?
Thanks.
This is how I have setup my environment, atm. An apache2 instance on port 80. Jetty instance on the same server, on port 8090.
Use-Case:
When I visit foo.com, I should see the webapp, which is hosted on jetty, port 8090.
If I put foo.com/blog, I should see the wordpress blog, which is hosted on apache. (I read howtos on the web, and installed it using AMP.)
Below are my various configuration files:
/etc/apache2/mods-enabled/proxy.conf:
ProxyPass / http://foo.com:8090/ << this is the jetty server
ProxyPass /blog http://foo.com/blog
ProxyRequests On
ProxyVia On
<Proxy *>
Order deny,allow
Allow from all
</Proxy>
ProxyPreserveHost On
ProxyStatus On
/etc/apache2/httpd.conf:
LoadModule proxy_module /usr/lib/apache2/modules/mod_proxy.so
LoadModule proxy_balancer_module /usr/lib/apache2/modules/mod_proxy_balancer.so
LoadModule proxy_http_module /usr/lib/apache2/modules/mod_proxy_http.so
LoadModule proxy_ajp_module /usr/lib/apache2/modules/mod_proxy_ajp.so
I have not created any other files, in sites-available or sites-enabled.
Current situation:
HTTP ERROR 404
Problem accessing /errors/404.html. Reason:
NOT_FOUND powered by jetty://
The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request GET /blog.
Reason: Error reading from remote server
I am running Debian squeeze on an Amazon EC2 Instance.
Question: Where am I going wrong? What changes should I make in the proxy.conf (or another conf files) to be able to visit the blog?
I am a noob in Server related stuff, so bear me.
I use amazon webservices (EC2) on which I have a webapp running on jetty, which runs on port 8090. I deploy the webapp through the usual method of
java -jar start.jar
So then to access the app, I have to add a port in the URL, like this:
someIP:8090/app
But just typing someIP in the browser takes me to a page that shows
It works!
This is the default web page for this server.
The web server software is running but no content has been added, yet.
which I assume is apache. I have apache, tomcat and jetty installed. What can I do so that I dont have to specify the port? Do I have to perform port-forwarding?
Thanks a lot.
I'm using Ubuntu server 10.04.
ssh-add /foo/cert.pem gave the following output:
Could not open a connection to your authentication agent.
These are my running processes:
ps -aux | grep ssh
Warning: bad ps syntax, perhaps a bogus '-'? See http://procps.sf.net/faq.html
root 1523 0.0 0.0 49260 632 ? Ss Dec25 0:00 /usr/sbin/sshd
root 10023 0.0 0.3 141304 6012 ? Ss 12:58 0:00 sshd: padmin [priv]
padmin 10117 0.0 0.1 141304 2400 ? S 12:58 0:00 sshd: padmin@pts/1
padmin 11867 0.0 0.0 7628 964 pts/1 S+ 13:06 0:00 grep --color=auto ssh
root 31041 0.0 0.3 141264 5884 ? Ss 11:24 0:00 sshd: padmin [priv]
padmin 31138 0.0 0.1 141264 2312 ? S 11:25 0:00 sshd: padmin@pts/0
root 31382 0.0 0.3 139240 5844 ? Ss 11:26 0:00 sshd: padmin [priv]
padmin 31475 0.0 0.1 139372 2488 ? S 11:27 0:00 sshd: padmin@notty
padmin 31476 0.0 0.0 12468 964 ? Ss 11:27 0:00 /usr/lib/openssh/sftp-server
These are my environment variables:
$ env | grep SSH
SSH_CLIENT=192.168.1.13 42626 22
SSH_TTY=/dev/pts/1
SSH_CONNECTION=192.168.1.13 42626 192.168.1.2 22
What is wrong? Why can't I add any identities?
I am trying to ssh into my EC2 instance, and get the following ssh verbose output. THe identity file is in a pem format, which is X.509, i think. I dont know the login name, or I could have tried with the -l flag. Prior to this, I only recieved a file permission error, because the file had improper permissions, which i changed to 600, and the directory containing the key to 700. The keys aren't in the ~/.ssh folder, but in ~aws-kes/aws-keys.pem
I run this command:
$ ssh -v -i aws-keys/aws-keys.pem ec2...ompute.amazonaws.com
and I get the following output:
OpenSSH_5.3p1 Debian-3ubuntu4, OpenSSL 0.9.8k 25 Mar 2009
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
debug1: Connecting to ec2...ompute.amazonaws.com [0.0.0.0] port 22.
debug1: Connection established.
debug1: identity file aws-keys/aws-keys.pem type -1
debug1: Remote protocol version 2.0, remote software version OpenSSH_5.3
debug1: match: OpenSSH_5.3 pat OpenSSH*
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_5.3p1 Debian-3ubuntu4
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: server->client aes128-ctr hmac-md5 none
debug1: kex: client->server aes128-ctr hmac-md5 none
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST(1024<1024<8192) sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_GROUP
debug1: SSH2_MSG_KEX_DH_GEX_INIT sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_REPLY
debug1: Host 'ec2...ompute.amazonaws.com' is known and matches the RSA host key.
debug1: Found key in /home/wissen16/.ssh/known_hosts:10
debug1: ssh_rsa_verify: signature correct
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: SSH2_MSG_SERVICE_REQUEST sent
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey
debug1: Next authentication method: publickey
debug1: Offering public key: wissen16@wissen16
debug1: Authentications that can continue: publickey
debug1: Trying private key: aws-keys/aws-keys.pem
debug1: read PEM private key done: type RSA
debug1: Authentications that can continue: publickey
debug1: No more authentication methods to try.
Permission denied (publickey).
EDIT: I read a few of the possible similar questions, and they didn't help me :(
I just created a Amazon Linux micro-instance and setup a S3 bucket & an EC2+EBS. I want to know, if at all it is possible, to map a S3 to an EC2 instance, preferably via ssh, and not from the console.
I have a static IP assigned to me by my ISP. I want to access a server running tomcat in our network from outside the LAN. Can any one give a few pointers, to what I need to do, and where to start from? I should be able to ssh, deploy builds from outside, and most importantly, show the product running on the server to clients.
Right now, typing the static IP in the browser from a PC on the LAN brings me to the Modem's login page(from where you change the various settings related to the modem, like setting the IP rules, or port forwarding, or related to wi-fi). I havent tried it from outside the network, but I am guessing it will be the same.
Thanks.
I thought that it was because of two machines on the network having the same hostname, and hence asked this question. But it did not resolve the problem. The machine responds to my pings. But when I go to Places > Network, I can't view that machine. I also can't view the other machines on the network from his machine. What seems to be the problem?
EDIT: I can view the folders using the samba protocol, by typing this in nautilus:
smb://192.168.1.5
But I cannot access the tomcat running on his machine, by typing this in the browser:
http://192.168.1.5:8000
There is a mac-mini in my office, and that can view this machine, and vice-versa.
There are two machines on my network that have the same hostname. I verified it by typing
# hostname
on the terminal. The effect is that I can only view one of the two machines on the Network, from Nautilus. One machine is Ubuntu 10.04 and the other is 9.10.
I tried
# sudo hostname newName
and restarted the machine, but the name remains the same. What should I do to change the hostname?
Thanks :)
I ssh into a server in my office, its running Lucid Lynx 10.04. I dont know why its running so many instances of java.
Thanks
This is the the console barf of $ top
Tasks: 134 total, 2 running, 132 sleeping, 0 stopped, 0 zombie
Cpu(s): 98.2%us, 1.8%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 1926032k total, 1895432k used, 30600k free, 19500k buffers
Swap: 5644280k total, 192576k used, 5451704k free, 268796k cached
PID USER NI VIRT RES SHR S %CPU %MEM TIME+ PPID GROUP COMMAND
27132 padmin 0 1149m 405m 10m S 58 21.6 429:33.50 1 padmin java
7169 padmin 0 1134m 380m 10m S 57 20.2 37:02.32 1 padmin java
1893 padmin 0 1142m 381m 10m S 51 20.3 170:03.34 1 padmin java
3515 padmin 0 1105m 241m 916 S 20 12.8 4932:54 1 padmin java
16946 root 0 41784 7768 1084 S 1 0.4 0:00.13 6935 root munin-node
17301 nobody 0 17368 2744 1696 R 1 0.1 0:00.03 16946 munin memory
16930 root 0 41784 7768 1084 S 1 0.4 0:00.13 6935 root munin-node
54 root 0 0 0 0 S 0 0.0 22:38.89 2 root kondemand/0
926 mysql 0 237m 2484 664 S 0 0.1 14:30.06 1 mysql mysqld
1692 root 0 1017m 51m 27m S 0 2.7 60:31.46 1 root mongod
3284 padmin 0 76400 1032 232 S 0 0.1 0:30.69 1 padmin memcached
16012 padmin 0 19224 1424 1064 R 0 0.1 0:00.82 12115 padmin top
1 root 0 23904 1316 644 S 0 0.1 0:00.74 0 root init
2 root 0 0 0 0 S 0 0.0 0:00.01 0 root kthreadd
3 root 0 0 0 0 S 0 0.0 0:00.03 2 root migration/0
4 root 0 0 0 0 S 0 0.0 0:00.27 2 root ksoftirqd/0
5 root 0 0 0 0 S 0 0.0 0:00.21 2 root watchdog/0
6 root 0 0 0 0 S 0 0.0 0:00.03 2 root migration/1
7 root 0 0 0 0 S 0 0.0 0:00.95 2 root ksoftirqd/1
8 root 0 0 0 0 S 0 0.0 0:00.15 2 root watchdog/1
9 root 0 0 0 0 S 0 0.0 1:09.30 2 root events/0
As you can see, all the java instances of java have the same ppid. This is a mild case. At many rabid instances, there can be upto 7-10 instances of java. Let me know if there are any-other outputs you need.
As an aside, every time i log into the server, i get a
*** System restart required ***
Are so many instances of java the reason?
EDIT: $ pstree
init─┬─apache2───5*[apache2]
├─atd
├─avahi-daemon───avahi-daemon
├─console-kit-dae───63*[{console-kit-da}]
├─cron
├─cupsd
├─dbus-daemon
├─dnsmasq
├─dovecot─┬─2*[dovecot-auth]
│ ├─3*[imap-login]
│ └─3*[pop3-login]
├─6*[getty]
├─java───56*[{java}]
├─java───67*[{java}]
├─libvirtd───6*[{libvirtd}]
├─master─┬─pickup
│ └─qmgr
├─2*[memcached───5*[{memcached}]]
├─mongod───76*[{mongod}]
├─munin-node
├─mysqld───9*[{mysqld}]
├─named───4*[{named}]
├─nmbd
├─postgres───4*[postgres]
├─rsyslogd───3*[{rsyslogd}]
├─smbd───smbd
├─sshd───sshd───sshd───bash───pstree
├─udevd───2*[udevd]
├─upstart-udev-br
├─vsftpd
└─winbindd───3*[winbindd]