Page 3
ICP RAID Navigator Chapter E Appendix For information on the installation of the ICP Disk Array Controller and the configuration of Disk Arrays, please refer to the "User's Manual" or "Quick Installation Guide" for your ICP Controller. These documents may also be found on the ICP System CDROM.
Page 4
ICP vortex product, even if ICP vortex has been advised of the possibility of such damages. ICP vortex is not liable for, and does not cover under warranty, any costs associated with servicing and/or installation of ICP vortex products.
Page 5
For Europe: +49-(0)7132-9620-900 For the USA: 602-414-0414 or send us a FAX: For Europe: +49-(0)7132-9620-400 For the USA: 602-414-0444 or send us an E-Mail: For Europe: support@vortex.de For the USA: support@icp-vortex.com or check our Website: http://www.icp-vortex.com...
Important Note Using modern RAID Systems significantly increases data security and availability. Under no circumstances does it relieve you from a careful and daily backup on tape or a similar backup media. This is the only method to protect your valuable data against total loss (e.g., through fire or theft), accidental deletion, or any other destroying impacts.
If necessary, consult the dealer or an experienced radio/T.V. technician for additional suggestions. The use of a non-shielded interface cable with the referenced device is prohibited. Changes or modifications not expressly approved by ICP vortex Computersysteme GmbH could void the authority to operate the equipment.
A.5.3 Sample Configurations ........................27 B. INSTALLATION NOTES ..........................30 B.1 Hardware Installation .......................... 30 B.2 Using Wide/Ultra2 and Ultra 160 SCSI ICP Controllers ................30 B.4 Releasing the Cluster Channels......................31 B.5 The Microsoft® Cluster Server Concept....................32 B.6 Notes on Novell Netware Orion Clustering ....................34 B.6.1 Hardware Requirements and Settings ....................
Page 9
C.4.7 Menu Advanced Setup: Configure Host Drives ................... 71 D. ICP RAID NAVIGATOR ..........................74 D.1 Introduction............................74 D.2 The ICP RAID Navigator "Controls"......................75 D.2.1 The Toolbar ..........................75 D.2.2 The Status Bar ..........................75 D.2.3 "Window" Menu Commands ......................75 D.2.4 "Help"...
Page 10
D.6 The Statistics Window ........................101 D.7 The Controller Events Window......................102 D.8 ICP RAID Navigator Help ........................103 D.9 ICP Service and ICP Mail ........................104 E. APPENDIX ..............................110 E.1 Subsystem Enclosures Manufacturers ....................110 E.2 Index..............................111...
Page 11
Chapter A General General General General Information Information Information Information...
Information on the Operating System, the functioning of the Cluster and other system de- tails may be found in the corresponding system manuals. For information on the installation of the ICP Disk Array Controller and the configuration of Disk Arrays, please refer to the "User's Manual" or "Quick Installation Guide" of your ICP Controller.
Fibre Channel controllers are suitable for Clustering. Using such controllers allows for suf- ficient distances between the two servers and the RAID enclosure. All ICP Controllers with Clustering functionality have a 6 after the first number of the prod- uct name. ICP Controllers currently available with Clustering functionality are:...
3. The permanent conferring (by sale or donation) of the software is permitted. The new proprietor must be registered with ICP vortex and must assume all rights and obliga- tions resulting from this Software license agreement. Each and any other kind of transfer, in particular leasing, is not permitted.
ICP vortex offers various SCSI accessories for the setup and installation of Cluster Systems based on SCSI technology. These accessories are not only usable for SCSI ICP RAID Con- trollers, but also for Controllers with SCSI interfaces from other vendors.
Page 17
Isolation of two SCSI bus segments: This brings a lot of security for Cluster Systems; SCSI bus segments can be separated or reconnected without any detrimental effects for the SCSI bus (i.e., the other vital Server node). SCSI Wonder as an Isolator fulfills two primary tasks. First, it maintains a proper termi- nation of the shared SCSI bus, even if one Node is removed.
Automatic Mode (Factory Setting) All DIP-Switches down. ICP vortex Power Supply. 5V/4A DC. Manual Mode (use Connection Button) Use only the original ICP vortex part ! Port A: Termination ON Port B - SE/LVD Port B: Termination OFF Port A: Termination OFF...
A.4.3 Cables, Terminators, Brackets For the configuration of stable, high performance SCSI-Systems, we highly recommend you to use genuine ICP vortex accessories. Order # Part Name Description Application 8839 Wide/Ultra2 & 150 cm Wide/Ultra2 & Ultra 160 SCSI Connection of up to 5 internal...
4.4.4 SCSI Wonder to set up Cluster-Systems For the configuration of stable, high performance Cluster-Systems, we highly recommend you to use genuine ICP vortex accessories. Equipment list per shared SCSI channel (from the controllers to the shared disk en- closure).
Full Duplex operation per port with 1.0625 Gbit/sec. Repeater function per Port. The ICP Fibre Hub 1016 can be symmetrically divided into 2, 3 or 4 separate loops with 4 ports in each loop by using configuration switches.
Page 24
ICP Fibre Hub 1016 – Front View FC-AL Active LEDs FC-AL DB9 connectors FC-AL Active LEDs FC-AL DB9 connectors Configuration Switch Loops C and D "Power Good" LED for Hub Module Configuration Switch LEDs Loops C and D FC-AL Active LEDs...
Page 26
SC duplex female connector for the optical fiber. The adapter uses a laser diode to transform electrical signals into light signals and an opti- cal sensor to perform the reverse function. 12 of the 16 ports of the ICP Fibre Hub 1016 support MIAs.
A.5.3 Sample Configurations Clustering with one FC-AL; ICP Fibre Hub 1016 configured as one Hub with 16 ports...
Page 28
Clustering with Dual Loop FC-AL; ICP Fibre Hub 1016 configured as two independent Hubs with 8 ports, each. Note: In this configuration Fibre Hub 1016 is split into two fully inde- pendent Hub Modules, each with a separate power supply.
Page 29
Chapter B I I I I n n n n stallation Notes stallation Notes stallation Notes stallation Notes...
Wide/Ultra2 SCSI or Ultra 160 SCSI channels which are used as a shared I/O bus require per shared channel 2 SCSI Wonders to make sure that the shared channel continues to work even if a server is switched off, or if the bus is separated from the ICP Controller in one of the servers.
Both ICP Controllers for the two nodes should be identical (same model, same firmware level). We recommend to use for the shared Fibre Channel loops the ICP Fibre Hub 1016. This Hub can be split into two independent Hubs with own power supplies and 8 ports per hub.
B.5 The Microsoft® Cluster Server Concept A Cluster Server is always made up of 2 individual NT/2000 Servers, so-called Nodes. Both of these Nodes should at least be linked to a commonly used Shared Storage Bus. Ultra2 SCSI, Ultra 160 SCSI and Fibre Channel Controllers are suitable for these kinds of links as these technologies enable the configuration of sufficiently long I/O bus systems.
Page 33
RAID configuration still remains intact. The current ICP Controllers support and are certified (GDT7xy8RN) for operation with Win- dows NT and Windows 2000 Cluster Server.
GDT76xxRN GDT86xxRZ It is very important that the ICP Controllers are equipped with a RAIDYNE firmware which supports Clustering. From version 2.30.00 on and upwards support for NCS is included in the Cluster-RAIDYNE firmware.(Cluster-RAIDYNE versions with lower numbers will only support Microsoft Cluster Server).
5. Cluster Array Drives of ICP Controllers (from Firmware 2.30.00 on and upwards) are protected against any kind Controller failure with a “Transaction Tracking” system. This system is activated by default. If this feature is not desired (e.g., because of performance reasons), it can be switched off.
B.6.6 The ICP Netware Driver and the Tool ICPCON.NLM Basically, every released version of the ICP HAM driver (GDTRxxxx.HAM) is suitable for Clustering as there are no specific cluster functions in the driver. Though we recommend to use for any new installation the latest released version.
B.7 Notes on the ICP RAID Navigator (ICPRNAV) A detailed description of the ICP RAID Navigator is given in Chapter D of this manual. Display of shared I/O channels within ICP RAID Navigator: This example shows a shared Wide/Ultra2 SCSI channel with five Wide/Ultra2 SCSI hard disks.
Page 38
The two disk drives within the RAID 1 Disk Array are moved to the currently displayed ICP Controller: At logical level, the reversed procedure (moving this back to the other ICP Controller) is displayed as follows:...
Page 39
The shared Host Drive still belongs to this ICP Controller. Now it is moved within the Clus- ter Administrator to the other Node (with the other ICP Controller): The Host Drive Icon changes showing that this Host Drive belongs to the other Node.
B.8 Notes on ICP RAID Console (ICPCON) A complete description of ICP RAID Console can be found in the following chapter C. Within the ICP RAID Console all Host Drives, which are shared in a Cluster are marked with the extension „Clus.“.
C.1 Loading ICPCON As mentioned before, the ICPCON program is available for various operating systems. It can be used either locally or remotely. This means that all ICP Controllers in a network can be monitored and serviced from one (or several) workstation(s).
Solaris 7, enter: ICPCON ENTER C.1.3 Loading the ICPCON Program Under Windows NT / 2000 The ICPCON program for Windows NT / 2000 is part of the ICP System CDROM. To load the program under Windows NT / 2000, enter: ICPCON ENTER For using ICPCON to monitor the server(s) remote, the MON4SOCK.DLL has to be loaded...
In previous chapters we have already described the hierarchical struc- ture of the ICP firmware. We have defined 4 different levels of hierarchy: Level 1 where the physical devices named Physical Devices are found, level 2 containing the Logical Drives (made up of one or several Physical Drives), level 3 where we have the Array Drives, and fi- nally, level 4 where the Host Drives are.
In this example „Win. 9x/NT/2k“ means that this ICPCON is the Windows version and is loaded on a Windows system. If you press ENTER, ICPCON scans this local system for ICP Controllers. Instead of „Win. 9x/NT/2k“ you could also find here „Linux“, „NetWare“, etc.
SPX/IPX protocol). After that you may enter your user name and password. C.2.2 Select Controller After this login procedure ICPCON delivers a list of ICP RAID Controllers which are installed in this server (in this example one GDT7563RN). This list contains information on the con- troller name, the PCI Bus system (0=primary, 1=secondary, etc.) and separated with a slash...
(for this example the Physical Drives, i.e., level 1). In addition to the performance report on the Drives, you are given additional information on each device. The ICP I/O channel the hard disk is connected to, which ID the hard disk has, the name of the hard disk, the gross...
Off). The figures for „Cache Hits“ show the how often requests can be serviced out of the cache, i.e., without triggering an immediate Disk IO. By setting the „Sample Rate”, you can choose the interval at which the ICP Controller deliv- ers new measurements. According to the operating system used, the sampling rate can be set to a maximum of 60 seconds.
(3) The Grown Defects counter shows the number of media defects which have occurred since the first time the device was operated with an ICP Controller. A specific hard disk is in a good condition when it has 0 grown defects. When this counter increases, there is defi- nitely something wrong with the device.
At the end of this protocol is a chronological listing of boot messages and other events stored in the Flash-RAM of the ICP Controller. If the buffer is full, the oldest events are de- leted first. In the menu „Configure Controller“ the logging buffer can be cleared with „Clear Log Buffer“.
Page 51
After selecting Configure Host Drives, ICPCON displays a list of already existing Host Drives. With a new system this list will show no entries. In this example there is already one Host Drive available. It’s name is ”RAID 5“ and it is an RAID 5 Array Drive (with approx. 17GB capacity).
Page 52
SCSI channel as the defective one. The Array Drive's state is error and normally all data would be lost. The ICP Controllers include some functions, which allow the patch of this Array Drive from the error state into the fail sate.
Page 53
All SCSI parameters are adjusted to optimum values. After leaving ICPCON or after pressing F10 (for refresh) the ICP Controller starts the build process on this Host Drive. In our example it calculates the parity information and writes it to the hard disks.
ICPCON from a floppy disk or use the ICPCON from the Flash-RAM of the ICP Controller. To change the position of a Host Drive in the Host Drive list, highlight the Host Drive and confirm with ENTER. Then, type on the new position and press ENTER.
Page 55
In this example there is one Array Drive in the FAIL state. I.e., the Array Drive is still operating but longer redundant. After pressing any key, ICPCON displays a list of Array Drives which are candidates for this online automatic repair. Note: Array Drives which have the „ERROR“...
The „ERROR“ state of an Array Drive is very critical. There are several procedures in the ICP Controller’s firmware to handle such cases an bring back the Array Drive in operation with- out loosing data. The most suitable procedure for the specific case, should be elaborated with your system administrator or our technical support.
Page 57
ICP Controller. The major objective of SAF-TE or SES is to provide the Auto Hot Plug. In contrast to the Hot Plug, a defective drive is simply pulled out the subsystem and the replacement unit is plugged in again.
Page 58
In this example one subsystem is already defined. Naturally, the hard disks with their disk shuttles could be also directly mounted in the server enclosure. The term “Enclosure” in these cases is more a definition set, which includes all hard disks which should be auto hot pluggable.
The ICP Controller records certain events in a logging buffer which is part of the Flash-RAM. If it is planned to use the ICP Controller in a completely new system, it is sensible to clear all events in this buffer. The Clear Log Buffer function detects possible entries and deletes them.
Page 60
This helps to physically identify a specific drive in an array of many drives. If you press F8 you can repair the configuration data of a physical drive. If your ICP Con- troller should ever display during his boot sequence a message like “Detected Primary Configuration Data error, using Secondary“...
Page 61
"Enabled" or "On". If the hard disk you have selected is an Ultra 160 device and the ICP Controller has Ultra 160 SCSI channels, F4 “Advanced Configuration“, allows you to configure the so-called “Domain Validation“ (a cyclical check of the correct data transfer at a given rate).
Page 62
C.4.4.3 Menu Advanced Setup: Configure Phys. Devs., Check Surface This option destroys all data on the hard disk. This option allows the checking of the surfaces of the hard disk media. The ICP Controller writes and reads certain data patterns and checks them for correctness.
Page 63
C.4.4.6 Menu Advanced Setup: Configure Phys. Devs., Lock/Unlock Disk This option is only high-lighted when you have selected a removable hard disk (e.g., Sy- quest, Iomega). Before you can initialize a cartridge you have to lock it. Before removing it you have to unlock it.
Page 64
Disk Array Controller SCSI Channel Temperature Hot Plug Control Door Power Lock Supply Power Supply Status LEDs...
C.4.5 Menu Advanced Setup: Configure Logical Drives Logical Drives (hierarchy level 2) are installed in this main menu option. Selecting Configure Logical Drives leads you to the screen shown next. The F4 key gives you a list of all the hard disks this Logical Drive consists of. If it is a Logi- cal Drive of the type Disk, it only consists of one single hard disk.
RAID 10 RAID 0 combined with RAID 1 The ICP Controller can manage up to 35 Array Drives (with different RAID levels) simultane- ously. Obviously, the physically existing number of hard disks will limit the number of par- allel used Arrays.
Page 67
This command allows you to change the name of an Array Drive. The name serves to iden- tify an Array Drive in ICPCON or ICP RAID Navigator. This can be very helpful for configura- tions where several Host Drives of various types are operated by a single controller.
Page 68
C.4.6.6 Menu Advanced Setup: Configure Array Drives, Remove Array Drive This command allows you to remove an existing Array Drive. All the data of the Array Drive will be lost ! Before you confirm the security request with <Y>, you should be sure about this choice.
Page 69
Hot Fix drive, because up to that moment, the system is operating without redundancy. Notes: In some literature, Hot Fix drives are also called Hot-Spare drives. You can add or remove Hot Fix drives also with the ICP RAID Navigator. C.4.6.8 Menu Advanced Setup: Configure Array Drives, Remove Hot Fix Drive This option allows you to remove a Hot Fix Drive from an existing Array Drive.
Page 70
C.4.6.13 Menu Advanced Setup: Configure Array Drives, Create new Array Drive After pressing ENTER, ICPCON lists all free Logical Drives, which are free (not yet part of Array / Host Drives). The selection bar can be moved with the cursor up/down keys and the Logical Drives can be selected/deselected with the SPACE bar.
(because you have to get a replacement hard disk, or because you did not realize the failure immediately since you didn't hear the ICP Controller's alarm signal, or because nobody checked the file server) increases the risk of data loss which will occur if a second hard disk should fail.
Page 72
Host Drives containing valid data. They will be lost. C.4.7.8 Menu Advanced Setup: Configure Host Drives, Drive Type (Cluster) This option allows you to enable a Host Drive for clustering. Before that the shared IO channel(s) of the ICP Controllers have to be also enabled for clustering.
D. ICP RAID Navigator D.1 Introduction The ICP RAID Navigator (ICPRNAV) is a powerful tool for setting up, monitoring and main- taining mass storage subsystems based on ICP Controllers. Different to ICP RAID Console the ICP RAID Navigator is a pure GUI-style application, designed for the operation under Windows 95, 98, NT and Windows 2000.
The status bar can be displayed or hidden by selecting Status Bar from the View menu. D.2.3 "Window" Menu Commands These commands allow you to arrange the windows in the ICP RAID Navigator application window or to activate an open window.
D.2.4 "Help" Menu Commands The Help menu offers the following commands to provide you with online help: D.2.5 "File" Menu Commands Here you can end your ICP RAID Navigator session. Shortcuts: Press Alt+F4 or click to close the window. D.2.6 "View" Menu Commands Use the items in this menu to open or close the windows of the main components of the ICP RAID Navigator or change the appearance of the main window.
Configuration window. Here you can set the refresh rate for the Physical or the Logical Configuration windows. This is the rate, which is used by the ICP RAID Navigator to update the contents of the physical and logical configura- tion windows.
D.4 Physical Configuration Window This window shows the physical configuration of the SCSI or Fibre Channel busses of the selected ICP Controller and the devices connected with these busses. The complete configuration is shown as a tree starting from the left with the ICP Controller.
For optimum performance the write cache should be always On. BIOS The BIOS of the ICP Controller is needed to boot the computer and the operating system from a Host Drive. BIOS Warn- Enables or disables the display of non-critical boot messages of ing Level the ICP Controller during the system boot phase.
Page 80
Observe the following order when carrying out the updating procedure: Get the latest GDT_RPFW file for the ICP Controller. The file does NOT need to be ex- panded ! Format a 3.5" HD disk (1.44MB) and copy the GDT_RPFW file on this disk.
If the state of an Array Drive changes into error (more than one drive has failed) please con- tact our hotline for further assistance. If no drive failed, you may also check the Controller Events to find out if the CPU of the ICP Controller is overheated.
Channel Settings Termination The termination for this channel of the ICP Controller can be set to three different states: ON: The termination of the lower (low byte) and upper data lines (high byte) is enabled or disabled depending on the occupied SCSI connectors of this channel.
Page 83
Warning: By changing these parameters on a new hard disk or a hard disk, which has been connected with a non ICP Controller, this hard disk will be initialized and all data on this hard disk will be lost.
Page 84
(LVD SCSI (low voltage differential) only) Note: The maximum synchronous data transfer rate between a SCSI device and the ICP Controller can be limited. This limitation may become necessary if a particular SCSI cabling does not allow the maximum rate the controller and the drive could achieve. The adjust- ment of the synchronous transfer rate can be done in the SCSI parameters / Initialize menu.
Page 85
This function sends a format unit command to the Physical Drive. Everything else is done by the drive itself. The ICP Con- troller stands by to receive a good status back from the drive when it has successfully fin- ished the low level format, thus no progress information can be shown.
D.4.4 Non direct access devices (raw devices) Non direct access devices cannot become components of Logical Drives, Array Drives or Host Drives. These devices are either controlled by a software driver (e.g. an ASPI module), the operating system or an application. Non direct access devices cannot be initialized or changed in their SCSI parameters with this program.
Only one server can own a Host Drive at the same time, so a Host Drive configured for clus- tering may either be controlled by the selected ICP Controller (i.e., local mounted) or by a different ICP Controller (i.e., remote mounted).
Page 88
Only one server can own a Host Drive at the same time, so a Host Drive configured for clus- tering may either be controlled by the selected ICP Controller (i.e., local mounted) or by a different ICP Controller (i.e., remote mounted).
Page 89
RAID 1 Build Ready Fail RAID 0 Logical Drives Logical Drives consist of one or more Physical Drives. Icon Description double click right click opens... opens... Single Disk Logical Drive Information Hot Fix Drive Failed / missing Hot Fix or Single Disk Chaining Drive Physical Drives...
The Host Drive number of the Host Drive. The Host Drives are re- ported to the system one after the other, beginning with the lowest Drive Number. If the corresponding ICP Controller is the first con- troller in the system, the system will boot from the Host Drive with the lowest number.
Page 91
Type This is the RAID level of the Array Drive. It can be RAID 0 (data striping, no redundancy), RAID1 (mirroring), RAID 4 (striping with parity drive), RAID 5 (striping with striped parity) or RAID 10 (com- bination of RAID 1 and RAID 0). Status The status of an array can be ready (operational), fail (one drive missing, still operational but not redundant), error (more than one...
D.5.3 The Logical Drive Information Window Double click on the Logical Drive icon. This window shows information on a Logical Drive. A Logical Drive can be either a single disk, or a chaining group of disks (concatenation), or a stripe set of several disks. Drive No The number of the Logical Drive.
D.5.4 Change the name of a Drive Click the right mouse button on the drive icon. This menu option opens a dialog where you can enter a new name for the selected drive (up to 7 characters). D.5.5 Remove a Host Drive Click the right mouse button on the Host Drive icon.
(gray). While you are selecting Physical Drives for the new Host Drive, more and more pos- sibilities become selectable. You can select a single Physical Drive by clicking on it. If you want to select more than one Physical Drive, simply draw a frame around the Physical Drives, or press the <ctrl> key and then click on all the Physical Drives you want to combine to a new array.
an Array Drive. The user data on the drives is read, parity information is calculated from this user data and the parity information is written anew. While the parity recalculate is in progress the array is in the build state. During this time the Array Drive is not redundant.
If you want to add additional drives to the Array Drive, select them from the box on the left side of the window. It is possible to add more than one drive at the same time. If no Physical Drives are offered, you have to use the Hot Plug: Add Disk function first, to add new drives.
(because you have to get a replacement drive, or because you did not realize the failure immediately since you didn't hear the ICP Controller's alarm signal, or because nobody checked the file server) increases the risk of data loss which will occur if a second drive should fail.
The replacement is carried out with ICPCON or the ICP RAID Navigator. Before the Logical Drive can be removed, you have to select a new Logical Drive from the box with available Physical Drives which is shown after this option is selected.
Page 99
Therefore, under these circumstances the fail state is only temporary and will be eliminated by the controller itself. Whenever an Array Drive enters a fail state, the ICP Controller’s audible alarm is turned on. You can silence the audible alarm in the physical configuration window.
Page 100
I/O channel as the defective one. The Array Drive's state is error and normally all data would be lost. The ICP Controllers include some functions, which allow the patch of this Array Drive from the error state into the fail sate. Before the actual patch, the defective drive has to be physically removed from the Array Drive.
D.6 The Statistics Window The statistics window can display the throughput of Physical, Logical and Host Drives. The vertical axis show the throughput, the horizontal axis the time. You can add drives by drag and drop them from the physical and logical configuration windows into the statistics win- dow.
D.8 ICP RAID Navigator Help The ICP RAID Navigator includes an online help function. You can either choose the Help menu or the pointer with the question mark to obtain online help on a specific icon or function. There is also an index which allows you to search for certain keywords and/or...
Converts ICP messages into standard mails (for Windows 9x/NT, MAPI format) It is recommended to install the ICP Service / ICP CTRLSRV and the ICP Mail tool on each server which is equipped with an ICP Controller. Thus, remote access to ICP Controllers in a network can be easily managed from one or several authorized users.
Page 105
In the IOCTLSrv property sheet you can add / remove users which have remote access to the ICP Controller with the ICP RAID Navigator. Passwords are encrypted.
Page 106
The ICP Mail tool gathers messages from the ICP Service, generates standard mail mes- sages and sends them to pre-defined workstations. After loading ICPMAIL.EXE and selecting "Settings", you can configure the mailing tool. If you select "Local System" all messages are displayed on the server itself.
Page 107
Following is a typical message generated by ICP Mail. The "Mail" option allows the interfacing to a standard mailing system (like Microsoft Out- look or Exchange).
Page 109
Chapter E Appendix Appendix Appendix Appendix...