Fibre Channel devices to PCI or Micro Channel based servers. They support the SCSI-FCP protocol. When used with the Cambex DPF (Dynamic Path Failover) software, two adapters in a system provide greater throughput and total protection from failure of a fibre channel component.
SAN Management SAN Management is the top layer. It is responsible for assigning the required access for each server to each storage device. The unit of storage is the LUN (Logical Unit Number) which acts the same as a single disk directly attached to the server.
The Cambex Dynamic Path Failover driver is a Path Management component that allows multiple paths to a storage device and provides automatic failover between available paths. Cambex Dynamic Path Failover software provides both a command line interface and access through smit, the standard integrated management tool for AIX.
How Preferred Paths work The basic idea of multipathing is fairly simple. Access a disk on one of two paths. If the path fails, move I/O activity to the other path. We build on that basis by adding more factors into the configuration and seeing what effect they have.
and set up preferences so that the remaining paths to the same controller are preferred over paths to the alternate controller. Example 1) Suppose we have two HBAs, a switch, and two RAID controllers. A total of four cables, and four paths to each LUN (2 HBAs x 2 RAID controllers).
Page 10
are accessed by different hosts, we could have the problem of "thrashing". One host tries to move the LUN group to preferred controller A while the other host tries to move the group to preferred controller B. Anti-thrashing code prevents this problem in the multipathing software.
PC2000.driver.obj # PC1000 Fibre Channel Adapter Driver (AIX 5L) cbxdpf.driver.obj # Cambex Dynamic Path Failover Driver Before installing a new version of the driver, delete the previous version of the driver. Note that any file systems must be unmounted, volume groups exported and SCSI devices must be removed before removing the driver.
Page 13
The new driver may be installed on the system with the command: installp -acd <device> all where <device> is as described above. example: installp -acd /mnt/AIX6.1 all After installing the driver, see the README file for additional information and release notes. /usr/lpp/cbxfc/READ_ME /usr/lpp/PC4000/READ_ME /usr/lpp/cbxdpf/READ_ME...
On the smit screen, you can press the “F4” key to search for the full name of the conflicting driver(s). After they are selected, change “remove dependent software” from “no” to “yes”. After the drivers are removed, you should now be able to install the Cambex drivers.
Hardware Installation Power down the system and install the adapter in a free slot. The PCI cards may be installed in either 32 or 64-bit PCI card slots, however the 32-bit slots may limit performance at high data rates. Make sure that any cables do not block airflow to the card.
AutoRecover cbxdpfar, the AutoRecover daemon, is automatically installed and enabled when the DPF driver is installed. Control of the daemon is done using SRC. stopsrc -s cbxdpfar Stops AutoRecover startsrc -s cbxdpfar Starts AutoRecover AutoRecover works by periodically polling the standby paths to each LUN.
AIX Configuration During power-up initialization, AIX will find and configure the new adapter(s) and any supported devices using the driver's configuration method. Devices are assigned a SCSI ID as they are discovered starting with 0. SCSI ID is not related to loop ID, port ID or to SCSI ID assignment on other hosts.
ID or port ID of a device may change and the device will still be properly addressed. In the Cambex AIX driver, persistent binding is automatic. At configuration time, all devices that are found are automatically assigned to a SCSI ID and a persistent binding is created.
Cambex Fibre Channel Adapter: List all Cambex FC adapters This provides the name and location of each adapter. Change / Show Characteristics of a Cambex FC Adapter Allows the user to display and modify attributes. Attributes (and default values) include: exec_throttle (256) number of simultaneous I/O operations.
DPF driver. Use this when installing to verify that all paths have been found and configured. Change / Show Characteristics of a Cambex Dynamic Path Displays the current path status and allows the user to place paths online/offline or to change path preferences.
Consult the array user manuals for more information. Change / Show Characteristics of Cambex Managed HBA’s Used to display and change HBA preference for one or more adapters.
The generic version of DPF purchased from Cambex is licensed for use only on Cambex cards and on only one LPAR. A license token is provided with the purchase. Contact Cambex support by email to obtain a license. You will need to provide The license tokens for each card Host machine ID from 'uname –a -L'...
Page 23
-q"attribute=hba_pref" CuAt in smit: Devices -> Cambex Dynamic Path Management -> Change / Show Characteristics of Cambex Managed HBAs • Controller preference - this is for multi-controller RAID arrays where one or more of the controllers reports that it owns the LUN. Controllers which do not report preference, are treated equally.
0x23000080e511b744 FC World Wide Name Which indicates that the adapter is in card location 00-02, and the drive is at SCSI ID 0, LUN 0. Cambex SCSI... Device CLEARS it’s Queue on error Location Label Logical Unit Num ID...
Page 25
Path: /usr/lib/objrepos Level 01.05.00.00 (or greater) State Committed Description Cambex Fibre Channel Adapter Driver lsdev -Cc adapter fscsi<x> <x> is a unique number for each SCSI card Available <SS-SS> <S> is the location in the machine where the card is installed Check that the number of SCSI cards and their slots are correct then card and driver are installed.
Page 26
cfgmgr -v >/tmp/cfg.log 2>&1 Should identify the card and configure it. If cfg.log contains the ID 7710002x and no driver is found, then the adapter driver is not installed. During boot, the number displayed when configuring the adapter is hex 0x911 (FC adapter). /usr/lpp/cbxfc/mbtest fscsi1 This test code may be used to get fibre channel status from the adapter or from attached devices.
Page 27
/usr/lpp/cbxfc/runtrace This should be run to start a trace if Cambex support requests a trace of the card failure. To stop the trace and generate a trace report, type: trcstop;...
Error Messages Various errors and notifications will be placed in the AIX error log. These can be read using the errpt command, or automatic notification may be set up. DPF_FAILOVER This indicates that the active path to a device has failed, and that DPF successfully transferred I/O to an alternate path.
Upgrading the Driver When upgrading to a newer version of the driver there are two methods: 1) Use rmdev to remove all dependent devices, remove the existing driver(s), then install the new driver(s) and run cfgmgr to recreate the devices. This method allows a new driver to be installed without rebooting the server.
PC2000 LED Meanings Top LED – Transceiver hardware is detecting a signal. Middle LED – Firmware is being synchronized. Bottom LED – Flashing amber when not synchronized. NORM GREEN MIDDLE GREEN BOTTOM BAD CABLE NO CONN GREEN FLASHING FLASHING...
PC4000 LED Meanings Y G A Flash On/Flash ∗ Y G A Flash Flash On/Flash On/Flash Flashing in unison indicates initialized, while alternate flashing indicates a firmware error. No Power Power Applied Initializing * 1G (Flash indicates active) 2G (Flash indicates active) 4G (Flash indicates active)
Declaration of conformity We Cambex Corporation of Westborough, Massachusetts, USA, declare under our sole responsibility, that the products PC2000LC-HPSP, PC2000LC-A, and PC4000 are in conformity with the following standards: EN 55022:1994/A1:1995/A2:1997 Class A ITE emissions requirements EN 50082-1:1992 EMC residential, commercial and light industrial generic...
Human Services (DHHS) does not consider Class 1 lasers to be hazardous. Customer supplied laser GBICs must meet the same requirements. If in doubt, contact Cambex customer support before operating the product. The International Electrotechnical Commission (IEC) 825 Laser Safety Standard requires labeling in English, German, Finnish, and French stating that the product uses Class 1 lasers.
The Software is intended to provide improved availability of data but makes no claim for greater reliability or protection of data, and Cambex may not be held liable for data loss or consequential damages.