Luccas's questions

Im confusing about where should I have a script polling an Aws Sqs inside a Rails application.

If I use a thread inside the web app probably it will use cpu cycles to listen this queue forever and then affecting performance.

And if I reserve a single heroku worker dyno it costs $34.50 per month. It makes sense to pay this price for it for a single queue poll? Or it's not the case to use a worker for it?

The script code:

  queue = AWS::SQS::Queue.new(SQSADDR['my_queue'])    
  queue.poll(:idle_timeout => 20) do |msg|
     # code here
  end

I need help!! Thanks

I'm using amazon s3 as storage for users profile pic. I see that many websites generates large random filenames and put them into the same root directory like:

http://xxx.us-east-1.amazonaws.com/aHR0cHM6Ly9mYmNkbi1wcm9maWxlLWEuYWthbWFpaGQubmV0L2hwcm9maWxlLWFrLWFzaDIvMjczMzkxXzEwMDAwMDMxMjAxMzg5OV81NTk3MjM4Mzdfbi5qcGc.jpg

And my question is: What are the pros and cons of that approach?

If I palce them into different directories, what problems I will have in future?

http://xxx.us-east-1.amazonaws.com/users/id/username.jpg

or

http://xxx.us-east-1.amazonaws.com/users/id/random_number.jpg

Thanks!

My problem is to process images through ec2 instances.

Based this similar question: Separate server for Resque workers

And in this article: http://highscalability.com/blog/2009/11/6/product-resque-githubs-distrubuted-job-queue.html

I'm planning to have distributed workers around ec2 instances, lets say 3. But I havent figured out the right way to do this.

My doubts are:

1. I have to install resque on each amazon ec2 instance?
2. If yes, they have to share a single redis server or each one can have their own?
3. Is that right to use SQS and each intance will listen this global queue and process my incoming files?

Thanks a lot if you guys can help!