Questions[iops](server)

The company I work for is currently going through an AWS migration, and for 99% of services, their commodity hardware does the job just fine.

Except for the production Database, we currently sit at 60,000 IOPS just to keep up with requests, and it's due to see much more action this year.

We've looked at using enterprise SSD's on EC2, but the IOPS hard limit is 20,000, which is pretty terrible, considering I can get a 240GB SSD that performs at 80,000 IOPS for about €200. http://www.techradar.com/reviews/pc-mac/pc-components/storage/disk-drives-hdd-ssd/intel-ssd-520-series-240gb-1060850/review

Any idea's how I can get past this limit? Is a cluster/RAID of ebs volumes possible?

Thanks, Ben

Is there a way in which ZFS can be prompted to redistribute a given filesystem over the all of the disks in its zpool?

I'm thinking of a scenario where I have a fixed size ZFS volume that's exported as a LUN over FC. The current zpool is small, just two 1TB mirrored disks, and the zvol is 750GB in total. If I were to suddenly expand the size of the zpool to, say, 12 1TB disks, I believe the zvol would still effectively be 'housed' on the first two spindles only.

Given that more spindles = more IOPS, what method could I use to 'redistribute' the zvol over all 12 spindles to take advantage of them?

I want to build let's name it a lowcost Ra*san which would host for our social site the images (many millions) we have 5 sizes of every photo with 3 KB, 7 KB, 15 KB, 25 KB and 80 KB per Image.

My idea is to build a Server with 24x consumer 240 GB SSD's in Raid 6 which will give me some 5 TB Disk space for the photo storage. To have HA I can add a 2nd one and use drdb.

I'm looking to get above 150'000 IOPS (4K Random reads).

As we mostly have read access only and rarely delete photos i think to go with consumer MLC SSD. I read many endurance reviews and don't see there a problem as long we don't rewrite the cells.

What you think about my idea? - I'm not sure between Raid 6 or Raid 10 (more IOPS, cost SSD). - Is ext4 OK for the filesystem - Would you use 1 or 2 Raid controller, with Extender Backplane

If anyone has realized something similar i would be happy to get Real World numbers.

UPDATE

I have buy 12 (plus some spare) OCZ Talos 480GB SAS SSD Drive's they will be placed in a 12-bay DAS and attached to a PERC H800 (1GB NV Cache, manufactured by LSI with fastpath) Controller, I plan to setup Raid 50 with ext4. If someone is wondering about some benchmarks let me know what you would like to see.

I'm evaluating moving our aging infrastructure to Amazon's AWS and am trying to estimate costs. I know our current disk space requirements, bandwidth, and most of the other variables that will affect cost. The one that's got me stumped is IOPS on EBS volumes. My thought is to capture performance monitor data from our existing servers (using PolyMon), but I'm not sure which PhysicalDisk metrics match up with Amazon's IOPS count. My two guesses are Disk Reads/Writes or Average Disk Reads/Writes.

Any thoughts? Thanks!

How would I find out how many IOPS my Linux system can handle?