Table of Contents
Advertisement
64
Check the InfiniBand Cable
Check the InfiniBand Network Interfaces
ifconfig ib# addr netmask mask
Table 9-1: Interpreting the LEDs
LED
Top LED
On indicates a logical link is detected. A logical link is established
when the subnet manager makes a sweep. A logical link must be
established if you are to use the port.
Bottom LED
Off indicates that no physical link is detected. A physical link requires
that the drivers on the attached InfiniBand host have been installed and
are running.
Bottom LED
On indicates that a physical link is detected.
•
Make sure an InfiniBand cable is connected to a port on the HCA and a port on the InfiniBand
switch card. HP recommends that you tug slightly on the cable to verify that is tightly connected as
poorly connected InfiniBand cables can cause errors that are difficult to detect.
•
If you are running the Element Manager, click the Refresh button and note if the corresponding
InfiniBand port on the Element Manager turns green. If it's green, you have a physical connection
and a logical link.
•
Check the port LEDs on the HCA. The bottom LED should be green.
•
Check the port LEDs on the InfiniBand switch. One should turn green, indicating a physical
connection is established.
•
Note the port designations next to the HCA ports.
If you have one HCA installed in the host:
•
Port 1 is assigned the ib0 network interface. Port 2 is assigned the ib1 network interface. If they
are not correctly connected, reconnect them.
If you have two HCAs installed in the host:
•
ib0 is linked to port 1 of whichever HCA is discovered first in the system. You can run
/usr/local/topspin/bin/vstat and physically check which port reacts to the connection to
determine which HCA is first (ib0 and ib1). Refer to
on page
18.
Check for InfiniBand network interfaces using the ifconfig -a command.
You should see interfaces that begin with ib (i.e., ib0, ib1).
Use the ifconfig -a command to display InfiniBand interfaces. If there are no ib0 and ib1 interfaces,
you may create them automatically or manually. To create them automatically each time the server
reboots, change the directory. The directory may be:
/etc/sysconfig/network-scripts.
Create one script per HCA port you wish to use (i.e., ifcfg-ib0, ifcfg-ib1). (You may copy another ifcfg
file, modify the DEVICE and IPADDR lines, then save it as either ifcfg-ib0 or ifcfg-ib1.)
To create it manually each time after booting the server, enter:
Syntax:
•
ib# is the HCA network interface getting the IP address. This may be either ib0 or ib1.
Indication
"Verify the HCA and Driver Installation"
Advertisement
Table of Contents
