We are investigating speeding up some machine learning code written using Theano and Keras, in particular by getting a GPU card. Does anyone have direct experience with this or a very similar combination? Specifically, we are interested in people's experiences about:
- Is it physically possible to install a card such as a GTX 1060 in a Dell R710 or R730xd?
- Is anything special required to get CentOS Linux to recognize the card, other than installing the necessary Nvidia drivers?
- Are there any issues with respect to power, cooling, etc., we should worry about?
A similar question has been asked, but for a different card and operating system. Discussions elsewhere such as here suggest it's possible for similar hardware, but a bit tricky. Before having our organization buy the hardware, it would be helpful to know whether there are serious issues.
The card will need to be configured with X as the Nvidia drivers are X drivers, though it can still be configured to be "headless" and you can have multiple graphics cards.
Some details on running GPUs in headless servers from: https://sites.google.com/site/akohlmey/random-hacks/nvidia-gpu-coolness
https://elrepo.org/tiki/tiki-index.php
They can also be downloaded from Nvidia's site, but that means no auto updating.
I can't say how the server will respond to having an additional GPU in it, but you may need to mess with the bios. According to the site mentioned above about configuring it as headless, you may need to boot the server with it configured as the primary graphics adapter or at least plugin a monitor temporarily to set it up with the nvidia utilities (to generate
dfp-edid.bin
).