Home / server / Questions / 168199
Accepted
Nenad
Asked: 2010-08-09 00:58:18 +0800 CST

high load web server setup

  • 772

I'm preparing a server setup for a dating website who need to be able to process around 5'000 - 10'000 req/sec to the main site.

My idea was to do it this way:

Server for static content (css, js, img) :: Varnish cache => nginx webserver

Server for member photos :: [1] Varnish cache => [n] nginx webserver

Server for member videos and streaming :: nginx webserver with Erlyvideo or Wowza (only paid member)

Server for web app :: [1] nginx (as cache if needed) => [n] HipHop webserver or Apache mod_php nolog

is this OK or is there a better way?

We developed the web app with a custom framewrok and optimized as much possible, the result is that the execution time per site don't take more then 0.05 sec (no cache) 0.0009 sec (with apc or memcached) on a 3 yr old development webserver with apache and mysql.

I'm not sure how much Server we will need for the web app and for the DB to can handle this amount of requests.

apache-2.2 nginx memcached varnish high-availability

2 Answers

  1. Best Answer

    put a load balancer in front of it all so you can pull servers in and out, spread the load [preferably for all types of content - both static and dynamic]. [you can use nginx or varnish as reverse proxy for that and if that's not enough - put cluster of LVS or haproxy servers to spread the load across multiple reverse proxies].

    make sure your generators of dynamic content are stateless or at least would allow partitioning with sticky sessions so you can easily increase capacity with liner investment.

    maybe it makes sense to offload static hosting to some cdn?

    • 0

  2. It sounds like a reasonable setup, although you can probably do without the varnish for the static content.

    The biggest gains are probably in what you glossed over: how many video streaming users, how good/bad is the framework and how loaded is the database.

    Also typically a gamechanger-metric is how many logged in users you expect from those 10K pages.

    The only way to tell what hardware you need is to run proper benchmarks against your production-ready software stack. If you can, make the uptake gradual and keep optimizing the bottlenecks.

    Btw, if you need help scaling or performance-optimizing: I'm available for projects.

    • 0