InfiniBand install for vSphere 5.5

先把原本的 driver 移除

# esxcli software vib remove -n=net-mlx4-en -n=net-mlx4-core

然後重新開機 ESXi 主機

下載 VMware ESXi 5.0 Driver for Mellanox ConnectX Ethernet Adapters
與下載 Mellanox OFED Driver for VMware® ESXi Server
下載 Raphael Schitz 提供的 OpenFabrics.org Enterprise Distribution’s OpenSM 3.3.16-64 for VMware vSphere 5.5 (x86_64) packaged

然後複製 mlx4_en-mlnx-1.6.1.2-471530.zip , MLNX-OFED-ESX-1.8.2.0.zip, ib-opensm-3.3.16-64.x86_64.vib 到 ESXi 主機

# unzip mlx4_en-mlnx-1.6.1.2-471530.zip
# esxcli software acceptance set – -level=CommunitySupported
# esxcli software vib install -d /tmp/mlx4_en-mlnx-1.6.1.2-offline_bundle-471530.zip – -no-sig-check
# esxcli software vib install -d /tmp/MLNX-OFED-ESX-1.8.2.0.zip – -no-sig-check
# esxcli software vib install -v /tmp/ib-opensm-3.3.16-64.x86_64.vib – -no-sig-check

再重新開機 ESXi 主機

理論上就可以使用

用下列指令移除安裝

# esxcli software vib remove -f -n ib-opensm
# esxcli software vib remove -f -n net-ib-cm
# esxcli software vib remove -f -n net-ib-core
# esxcli software vib remove -f -n net-ib-ipoib
# esxcli software vib remove -f -n net-ib-mad
# esxcli software vib remove -f -n net-ib-sa
# esxcli software vib remove -f -n net-ib-umad
# esxcli software vib remove -f -n net-mlx4-core
# esxcli software vib remove -f -n net-mlx4-en
# esxcli software vib remove -f -n net-mlx4-ib
# esxcli software vib remove -f -n scsi-ib-srp

notes:

esxcli system module list | grep mlx4
esxcli software vib list |grep mlx
esxcli system module set -e true -m mlx4_en
esxcfg-nics -l|grep Mellanox

http://www.mellanox.com/page/vmware_matrix_hcl?mtag=vmware_driver
https://vibsdepot.v-front.de/wiki/index.php/Ib-opensm
https://www.neko6.info/archives/2100