I need to setup 2 (physical) Postfix server and on one I want to install dovecot.
Both Postfix will have same MX priority. I would prefer to have the dovecot Mailstorage folder on a NFS share. Both postfix are responsible for same 2 domains.
What's the best way to get all incoming Mails Postfix on Server B to dovecot which stay on Server A? Or should I setup that both Postfix store Mail in the same NFS share?
I need to build a Centos ISO with a 3.2 Kernel to setup a new server, how I can do this?
The server has a Raid Controller that's not supported in previous Kernel Versions, which means I can not install Centos 6.3 and change later the Kernel as the HDD are not showed.
I have do some benchmarks with postfix, where we send out 6 KB HTML Mails. We followed all tuning instructions published by Postfix and used Ramdisk for the queue.
We were not able to send above 50 Mails / sec out.
Does anyone have some input on how we can improve that number?
The Server is only used for outgoing Mails.
Only to mention: I'm not a spammer :-) We will use it for a dating site where we send a big amount of Mails out for Notifications, weekly reports, daily stats.
I'm doing some comet benchmarks and would like to see how many open connections I have.
Actually I use netstat:
netstat -ant | grep 8080 | grep EST | wc -l
But it needs around 4-6 minutes to list the number, is there any tool that can do show it in real time? The number of open connections is between 100'000 - 250'000.
Actually we have following setup for our website that gets traffic around the world:
All JS, Images, Photos are stored on a CDN: Cloud Files ("Akamai light" powered).
The WebApp server who send the dynamic content out are located in Switzerland, the average page size is around 14KB (3-5KB after GZip).
70% of the traffic is from North America. Our network latency time is between 105 - 185 ms to the USA (just-ping.com) mostly measured from data centers I think, means a home user will have higher latency.
Would it be a good solution to place a proxy server on east and west coast of the USA in a data center with a good latency (100ms) to us and to serve the dynamic content from WebAPP server to our visitors from the USA from there? Means the proxy server will forward the request to us and send the answer back.
How to implement node.js to be able to handle 250k connections as comet server (client side we use socket.io)?
Would the use of nginx as proxy/loadbalancer be the right solution? Or will HA-Proxy be the better way? Has anyone real world experience with 100k+ connections and can share his setup? Would a setup like this be the right one (Quad core CPU per server -> start 4 Instances of node.js per Server?):
nginx (as proxy / load balancing server)
/ | \
/ | \
/ | \
/ | \
node server #1 node server #2 node server #3
4 instances 4 instances 4 instances
I want to build let's name it a lowcost Ra*san which would host for our social site the images (many millions) we have 5 sizes of every photo with 3 KB, 7 KB, 15 KB, 25 KB and 80 KB per Image.
My idea is to build a Server with 24x consumer 240 GB SSD's in Raid 6 which will give me some 5 TB Disk space for the photo storage. To have HA I can add a 2nd one and use drdb.
I'm looking to get above 150'000 IOPS (4K Random reads).
As we mostly have read access only and rarely delete photos i think to go with consumer MLC SSD. I read many endurance reviews and don't see there a problem as long we don't rewrite the cells.
What you think about my idea? - I'm not sure between Raid 6 or Raid 10 (more IOPS, cost SSD). - Is ext4 OK for the filesystem - Would you use 1 or 2 Raid controller, with Extender Backplane
If anyone has realized something similar i would be happy to get Real World numbers.
UPDATE
I have buy 12 (plus some spare) OCZ Talos 480GB SAS SSD Drive's they will be placed in a 12-bay DAS and attached to a PERC H800 (1GB NV Cache, manufactured by LSI with fastpath) Controller, I plan to setup Raid 50 with ext4. If someone is wondering about some benchmarks let me know what you would like to see.
I have around 50 identical domains names with different tld like: domain.net, domain.org, domain.de, domain.biz, domain.ca... now I would like to forward all incoming requests to this domain with and without www on nginx to: http://domain.com how I can do this without need to list every domain?
Something like: forward all request to .domain. or domain.* to: http://domain.com permanent
We have build a special interest social network and need to setup now the proper server setup for the webapp servers.
We have for the webapp 5 physical server available (2xE5645 CPU, 24 GB Ram, RAID, 4x Gbit NIC), one of the five server need to provide the API for our mobile visitors (iOS, Android). Our webapp need PHP, APC, Memcached and MySQL.
Also we have 4 more physical server inside (2xE5620, 12 GB Ram, RAID, 4x Gbit NIC):
Comet push server (custom server for the chat)
Queue/Mail server (beanstalkd)
static webserver (G-WAN webserver) with 2xDAS with 12x2TB (total 40 TB in Raid 6)
Apache webserver dedicated for HTTPS (this server can also be used for the LB cluster if the SSL secured page will be put on the LB cluster, is this better?).
For the beginning we only want to have the webapp server in LB/HA, because we don't have more servers available at the moment.
And a last is a low cost server (X3430, 4 GB Ram, RAID, 2x Gbit NIC) that is used for monitoring all Hardware.
We have 2x HP Procurve 2900 managed 48 port Gbit Switch.
All the above equipment stay in our Rack in a network center.
We use RHEL 6 on all servers.
I have much ideas, but I'm not really sure which will be the best way.
My direction is go the way to install HA Proxy and Apache webserver on two boxes, have on two boxes MySQL DB Server and on one both Apache and MySQL for the API/Webservice. To use one of the switch for private network where all server will be connected and used for internal communication (MySQL, File transfer after upload).
Is it helpful to connect multiple NIC ports per server to the Switch?
Is HA Proxy the best way for our case? Or would it be better to use nginx on 2 or 3 boxes and to use it for load balancing and serving PHP and have LVS or some similar for the HA part?
I'm open for all solutions, and the 5+1 server can be used flexible.
Thanks for any help.
UPDATE: After more research, I think it would be hard to find a solution to have HA for all Server. My actual idea for the setup is:
nginx as Proxy for load balancing (I will use one of the mid spec boxes)
3 Apache webserver on private net
2 MySQL Server Master/Slave on private net
In the above solution, the Apache Webserver will also host the SSL site for payout, I'm not sure if nginx can handle the SSL certificate for this different backend servers.
UPDATE 2: I have do more research, Redhat offers a Add-On for Load balancing based on LVS. http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtual_Server_Administration/ch-lvs-overview-VSA.html This Addon looks well, BUT I still don't know which way is the right one? Is it better to go with a nginx in front or with LVS or something other? Someone told me I can use the existing HP Procurve 2900 Switch for simple load balncing too....
We build for a customer a social network site, where we will have on beginning 1 Master and 2 Slave MySQL Server.
I'm not sure if we need to go with the Enterprise or use the GA Version. The only advantage for me would be the MySQL Enterprise Monitor, who we only get with the USD 5000/Server Enterprise version. Would you suggest to buy it, or to use a 3rd party monitor tool? Does anyone know any similar tool as the MySQL Enterprise Monitor?
I need to store 25M Photos in 4 sizes = total 100M Files, the filesize will vary between 3Kb and 200 kb per file and the used storage at beginning is about 14-15 TB.
Our goal is to have the data on 2-4 Server available and to serve them with a local fast Webserver (nginx or lighthttpd), we need to server as much possible req/sec.
My plan is to use 2U Servercase from Intel with 12x2TB (WD RE4) with Raid 6 (or FS with redunancy??) for the data and 2x60GB SSD for the OS, is that a good way? Now: I found the Adaptec 5805ZQ who can use SSD SLC Drives for cache of most used files, any suggestions for it?
What Read cache size I need to choose?
What will be the best way for redunancy and load balancing, if I plan to have 2-4 of such Server?
Whats pro/con between Cluster and distributed FS regarding our goal?
Do anybody know what kind of system architecture is behind Websites like tinychat, omegle, cam4, chatroulette? And how much bandwith is needed per connection?
If I'm not wrong they use some video streaming Server like Flash Media Server, Wowza Media Server, Red5, Erlyvideo but this would eat for 20'000 users around 1 Gb/s bandwith? Or do they use some software who is wroking peer2peer? I found some kind of such Software but they all requires some UDP ports to be opened.
Do anybody know how much users 1 server instance with some of the above server software can handle?
Im happy for any background information.
I'm preparing a server setup for a dating website who need to be able to process around 5'000 - 10'000 req/sec to the main site.
My idea was to do it this way:
Server for static content (css, js, img) :: Varnish cache => nginx webserver
Server for member photos :: [1] Varnish cache => [n] nginx webserver
Server for member videos and streaming :: nginx webserver with Erlyvideo or Wowza (only paid member)
Server for web app :: [1] nginx (as cache if needed) => [n] HipHop webserver or Apache mod_php nolog
is this OK or is there a better way?
We developed the web app with a custom framewrok and optimized as much possible, the result is that the execution time per site don't take more then 0.05 sec (no cache) 0.0009 sec (with apc or memcached) on a 3 yr old development webserver with apache and mysql.
I'm not sure how much Server we will need for the web app and for the DB to can handle this amount of requests.