Jeevan Dongre's questions

I am a newbie to the chef and knife, I am running couple of ec2 instances and have install chef-client and I can see all the instances in the node list of the chef, but couple of them are missing FQDN which is causing hell lot of problem, here is the output when I run knife node show node_name

Environment: _default
FQDN:        
IP:          
Run List:    
Roles:       
Recipes:     
Platform:     
Tags: 

You can see expect Env rest all other are blank. How do I fix this problem. Kindly help me out

I am bootstrapping a ec2 ubuntu based chef node using chef, it creates an instance but it says Failed to authenticate ubuntu - trying password authand asks for the password. But a newly created ubuntu ec2 instance will not have any kind of password set. Throws an error

ERROR: Net::SSH::AuthenticationFailed: [email protected]

How do I bypass this event and also whats the problem, do I have to make any changes in the configurations.

Kindly help me I am new to the chef.

I am running my ruby on rails app ubuntu 10.04 ec2 instance and I am using nginx 1.2.4. I am trying to configure munin to get stats fron nginx, I have recompiled nginx and its working fine but I am unable to run the munin. If I hit mydomain.com/munin/ I am getting error 404 page not found. Also I have installed all the necessary plugins for the munin like nginx-stats,nginx-memory and many more. Googling did not sole my issue, because people are suggesting to add configuration setting to sites-available/defaults, but my Nginx doesnt have any such kind of folder. Kindly help me

commerce web site running, on multiple ec2 instances. The web content is served using nginx and its a ruby on rails application. I am using a load balancer which routes the traffic to the multiple ec2 instances. Is there any way to figure out using nginx how many users it serving and how many concurrent users are present in a particular ec2 instance. SO that I can match the number os concurrent users served by nginx and the amount of CPU and memory and processes running, to generate report and do a profiling.Kindly help me out!

Thanks

I am running a AWS RDS large instance for the production. I am taking mysqldumps everyday at mid-night. But it take too long to take the mysql dump and the website does not respond during the mysql dump process. Instead of taking the mysql dump, now I am taking DB snapshot every day.

My Question

Is there any other way to copy the DB snapshot of the dump to a local box so that I have a back up of it locally every day?

I am develops guy working for an e-commerce company I am running my e-commerce application built using ruby on rails spree commerce. I am presently running 2 medium instances in the production. One is a high memory instance which has 3.8 RAM and single Core CPU and another one is high CPU instance which has Dual Core CPU. Basically AWS calls it has m1.medium and c1.medium instance respectively. My question is it possible to separate the processes according the cpu intense and memory intense? So that all the cpu intense process can be made run in high cpu instance and all the memory intense process can be made to run in the high memory instances. Is any tool available to identify those process. Kindly give me some heads up. Thank you

Hi I am running a large ec2 ubuntu instance which is configured for auto scaling. Whenever the load increases on the large instance it will boot a new instance. But the booted new instance will not have updated code. I have my code repo in github. How to I configure the newly booted instance to pull the code from the github and keep itself updated.

Please give some heads up

I am trying to autoscale my present instance, I am running a medium instance right now and auto scale with small instance. I used command line tool to config the settings, this is the configurations I have used to scale and I am running minimum of one instance apart from my regular instance, that means one more instance and I have attached to the load balancer.

s-create-auto-scaling-group groupname --launch-configuration launchconfig --availability-zones ap-southeast-1a --min-size 1 --max-size 5 --load-balancers prod

But when I have checked the load balancer it says "Out of Service" reason "Instance has failed at least the Unhealthy Threshold number of health checks consecutively". How can I solve this, using its public DNS, I am not able to get any response from the instance and also not able to ssh to it since the key value pair is not attached to the newly created instance.

what is the problem.How do I solve this.

Please help me out its little urgent, since I am struck up at this point from almost 2 days.

as-describe-launch-configs --show-long --headers



testLC,ami-e8c4bdba,t1.micro,(nil),(nil),(nil),(nil),default,2012-02-03T07:14:54.461Z,true,arn:aws:autoscaling:ap-southeast-1:346266270015:launchConfiguration:175a16db-1f6a-4514-9233-ac7cb34bca90:launchConfigurationName/testLC

as-describe-auto-scaling-groups --show-long --headers

testASG,testLC,ap-southeast-1a,2012-02-03T07:19:10.706Z,prod,EC2,1,5,1,300,0,(nil),(nil),arn:aws:autoscaling:ap-southeast-1:346266270015:autoScalingGroup:c4b584d0-bac4-4507-b972-4fc2b1bc53ac:autoScalingGroupName/testASG,(nil)

as-describe-auto-scaling-instances
i-43796716  testASG  ap-southeast-1a  InService  HEALTHY  testLC

elb-describe-lbs --headers --show-long

prod,prod-11719395.ap-southeast-1.elb.amazonaws.com,prod-11719395.ap-southeast-1.elb.amazonaws.com,Z1WI8VXHPB1R38,"{interval=120,target=HTTP:80/user/sign_in/,timeout=30,healthy-threshold=5,unhealthy-threshold=3}",ap-southeast-1a,(nil),(nil),"i-495dda1c, i-43796716","{protocol=HTTP,lb-port=80,instance-protocol=HTTP,instance-port=80,policies=AWSConsolePolicy-1}",(nil),"{policy-name=AWSConsolePolicy-1,expiration-period=180}","{owner-alias=amazon-elb,group-name=amazon-elb-sg}",(nil),2012-02-01T10:36:08.810Z

elb-describe-instance-health loadbalancername --headers --show-long

INSTANCE_ID,i-495dda1c,InService,N/A,N/A
INSTANCE_ID,i-43796716,OutOfService,Instance has failed at least the UnhealthyThreshold number of health checks consecutively.,Instance

I have installed the AWS Command line tools and have also set the Env Variables, but why I type mon-cmd I am getting this error, I am not able to figure it out,kindly help me.

/usr/local/aws/bin/mon-cmd: line 12: /home/ubuntu/usr/local/aws/bin/service: No such file or directory
/usr/local/aws/bin/mon-cmd: line 12: exec: /home/ubuntu/usr/local/aws/bin/service: cannot execute: No such file or directory

I am setting up auto scaling based on memory consumed by the particular instance. I went through the link posted at awsforums. I was able to set my metrics and using the bash script given and with the same variables.

In figuring out how to set auto scaling based on those metrics, I came to know about the bunch of bash scripts at google project hosting site. I am not able to set the metrics.

How could I move further?

I am trying to run this bash script as a cron job, but I am getting an error which says sudo: sorry, you must have a tty to run sudo. I am running this bash script in amazon EC2 linux instance.

#!/bin/bash -
#get instance id - used for putting metric
INSTANCE_ID=`GET http://169.254.169.254/latest/meta-data/instance-id`

#could be done using "free" or "vmstat" - use of less and grep is believed to provide widest compatibility - CJ 2011-11-24
memfree=`less /proc/meminfo | grep -i MemFree | grep -o [0-9]*`
swaptotal=`less /proc/meminfo | grep -i SwapTotal | grep -o [0-9]*`
swapfree=`less /proc/meminfo | grep -i SwapFree | grep -o [0-9]*`
swapused=$(($swaptotal-$swapfree))

#mon-put-data to put metrics
mon-put-data --metric-name MemoryFree --namespace EC2/Memory --value $memfree --unit Kilobytes --dimensions "InstanceId=$INSTANCE_ID"
mon-put-data --metric-name SwapUsed --namespace EC2/Memory --value $swapused --unit Kilobytes --dimensions "InstanceId=$INSTANCE_ID"

Kindly help me out to figure this out.

I was able to set the auto scaling policy and also tested works fine, I am using EC2 small instance to run Ruby on Rails app, since Rails is more of Memory Intense platform I wanna scale the EC2 instances based upon the memory not on CPU Utilization. I googled yesterday but did not fetched any results which would actually helped me.

Any suggestions would be help ful.

I went through enough number of blog post which actually guides how to set up the auto scaling platform. I am using the Ubuntu ec2 32 bit AMI. From which I am trying to scale the instances, I am trying to set up the auto scaling initially in a micro instance and after every thing goes fine I wanna implement the same thing in the production server. I am mentioning the problems which I am facing since morning

1)setting my the env_variables has become a major challenge 2)I am facing this problem "MalformedSOAPSignature: Invalid SOAP Signature. Failed to check signature with X.509 cert" 3) Can I use the aws EC2 instance itself to scale the infra

I had set up a Ubuntu instance with a Rails package, deployed my app, and it is working fine.

But when I try to do SSH, it's not allowing me for the remote login and throws errors like: Host key verification failed.

The problem seem to be persistent. I have attached the Elastic IP to that instance and I am not able to see the public DNS.

My instance is running in Singapore region.

ssh debug output:

OpenSSH_5.8p1 Debian-7ubuntu1, OpenSSL 1.0.0e 6 Sep 2011
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
debug1: Connecting to 46.137.253.231 [46.137.253.231] port 22.
debug1: Connection established.
debug1: identity file st.pem type -1
debug1: identity file st.pem-cert type -1
debug1: Remote protocol version 2.0, remote software version OpenSSH_5.5p1 Debian-4ubuntu6
debug1: match: OpenSSH_5.5p1 Debian-4ubuntu6 pat OpenSSH*
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_5.8p1 Debian-7ubuntu1
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: server->client aes128-ctr hmac-md5 none
debug1: kex: client->server aes128-ctr hmac-md5 none
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST(1024<1024<8192) sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_GROUP
debug1: SSH2_MSG_KEX_DH_GEX_INIT sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_REPLY

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that a host key has just been changed.
The fingerprint for the RSA key sent by the remote host is.
Please contact your system administrator.
Add correct host key in /home/ubuntu/.ssh/known_hosts to get rid of this message.
Offending RSA key in /home/ubuntu/.ssh/known_hosts:1
  remove with: ssh-keygen -f "/home/ubuntu/.ssh/known_hosts" -R 46.137.253.231
RSA host key for 46.137.253.231 has changed and you have requested strict checking.
Host key verification failed.

I have written a script which takes MySQL dumps and uploads it to Amazon S3. I have added the script to the cronjob and it runs at 2 o'clock in the midnight and uploads the MySQL dump to S3. I am using the date and time stamp as the file name before uploading it to S3.

My problem is I need to manage backups of 7 days on S3 and automatically I have to delete the 8th day backup file from S3 since I am using the date and time stamp as file name to make each file unique, I am not able to figure out how to do it.

And also I have to restore the latest backup in another EC2 instance.

I have a AWS EC2 instance with ubuntu 10.10 server. I am trying to add a cron job to the list. But the cron job is not being executed.

I am actually uploading a particular file to aws s3 using s3cmd visit s3tools.org

What will be in the problem and also the solution.

Kindly help me out

Here is the bash script which has to be run

s3cmd put file-name s3://bucket_name/foder_name/file-name 

Here is the job

* * * * * bash /path/to/file.sh 

I am trying to enable the zgip compression in apache2 web server, a quick googling helped me to fetch some instructions and I got to know that I need to edit httpd.conf which is inside /etc/apache2/ but my ubuntu 10.04 server doesnt have any content inside httpd.conf file and I also had a look into apache.conf file but could not find "LoadModule deflate_module modules/mod_deflate.so"

So where can I find this lines so that I can edit it.

I have to set up a LAN connection between 5 laptops, 2 using windows 7 and other 2 using windows xp and 1 using Ubuntu. I have installed VisualSVN. Now How do other people update their code to my laptop which is the central svn repository. They are using eclipse and dreamweaver IDE for development.

I have java war file which is stored in s3 now I need to copy that file to the tomcat6 var/lib/webapps folder using ssh through my command line is it possible to do that. Or how do I send the war file my to remote instance tomcat6 folder. I failed to do that using scp. scp -r localfile.txt [email protected]:/home/username/

I need to set up an ubuntu 10.04 instance on ec2, but there are some instance ready available I tried with few but I am not really happy with that since those are meant for test puporse.

I have to deploy a java/j2ee based web app with mysql. 1)need to install tomcat 2)java runtime 6 3) apache web server

What would be the best image to use for my requirement and I initially planning to launch with the micro instance if my web app demands I may further move to small and larger instances. So it should be eligible for free usuage tier.