I am about to implement an iSCSI solution on our network. The thing that is bothering me though is that we are only using 1 switch from the SAN to node connections. Since each node has 2 NICs, is anyone able to give me some tips on how to set up a second switch and use the second NIC in such a way that if the first switch were to die, then the second switch would take over?
Maybe in any case, even if there was a failover solution, would data loss still occur due to the "switch over" time required?
O/S is Centos 5.5
Simply. You do not.
You keep both lines separate. One dies, who ares.
The trick is to use MPIO (Multi Path IO) which is part of the ISCSI implementation / Standard. Your server and the SAN agree to use two paths for every LUN. Then the server can, when one path dies, just not use that one.
Also does load balancing while both paths work without funny playing around with bonding etc.
Also, it's typically preferable to keep iSCSI traffic separate from the rest of your network traffic; ideally you use separate NICs and switches from your regular network. If you have two single port NICs in the machines, you may want to think about adding another NIC, so that you can have >=2 separate paths for iSCSI, plus a port or two for regular network traffic.
Before you go down the rabbit's hole of redundant iSCSI connections, you should stop to think about the rest of your architecture. Yea it's great to have multi-path iSCSI, but if you have only one power circuit, and it goes down, well that extra iSCSI connection isn't doing much for you. Or if you have only one SAN, same problem.
TomTom's answer is spot on --I'd vote if I could, but I'm not registered.
Yes you should have a second network switch, with the switches cross connected to either other. Each NIC on your client machine should have it's own IP address.