Chelsio Communications Terminator Series Installation And User Manual page 89

Chapter IV. iWARP (RDMA)
vi. Set IntelMPI with mpi-selector (do this on all nodes).
[root@host~]# mpi-selector --register intelmpi --source-dir
/opt/intel/impi/3.1/bin/
[root@host~]# mpi-selector --set intelmpi
.bashrc
vii. Edit and add these lines:
export RSH=ssh
export DAPL_MAX_INLINE=64
export I_MPI_DEVICE=rdssm:chelsio
export MPIEXEC_TIMEOUT=180
export MPI_BIT_MODE=64
viii. Logout & log back in.
mpd.hosts
ix. Populate
•
The hosts in this file should be Chelsio interface IP addresses.
Note
•
I_MPI_DEVICE=rdssm:chelsio
/etc/dat.conf
•
MPIEXEC_TIMEOUT
going across the systems.
x. Contact Intel for obtaining their MPI with DAPL support.
xi. To run Intel MPI over RDMA interface, DAPL 2.0 should be set up as follows:
Enable the Chelsio device by adding an entry at the beginning of the /
the Chelsio interface. For instance, if your Chelsio interface name is eth2, then the following
line adds a DAT version 2.0 device named "chelsio2" for that interface:
chelsio2 u2.0 nonthreadsafe default libdaplofa.so.2 dapl.2.0 "eth2 0" ""
Open MPI (Installation and Setup)
Open MPI iWARP support is only available in Open MPI version 1.3 or greater.
Open MPI will work without any specific configuration via the openib btl. Users wishing to
performance tune the configurable options may wish to inspect the receive queue values. Those
can be found in the "Chelsio T4" section of
steps mentioned below to install and configure Open MPI.
i. If not alreay done, install mpi-selector tool.
ii. Download the latest stable/feature version of openMPI from
Chelsio Unified Wire for Linux
with node names.
chelsio
named
value might be required to increase if heavy traffic is
mca-btl-openib-device-params.ini
assumes you have
.
OpenMPI
an entry in
etc/dat.conf file for
. Follow the
website.
89