As I mentioned yesterday, I’m currently doing some project work. Said project includes InfiniBand technology.
Apparently we bought a “cheap” InfiniBand switch, which comes without a subnet manager. So, in order to communicate between the nodes, you need to install the subnet manager (opensm in my case) on each node.
echo 'deb http://pkg-ofed.alioth.debian.org/apt/ofed ./' >
aptitude install opensm
In order to utilize the InfiniBand interface you need to do a few things first though:
- Obviously install the opensm package
- Add ib_umad and ib_ipoib to /etc/modules
After installing opensm on the host as well as the NFS root, opensm comes up just fine and the network starts automatically. Only trouble right now is, that ISC’s DHCP doesn’t support InfiniBand, otherwise I could even utilize DHCP to distribute the IP addresses.