Completing the failover environment installation ... . . 67 Chapter 4. Introduction to IBM ServeRAID Cluster Solution ..69 Chapter 5. Preparing to install or change a cluster solution ..73...
Page 6
Updating ServeRAID software in an MSCS cluster environment ..90 Step 1: Upgrading the IBM ServeRAID Manager program ..90 Step 2: Upgrading the IBM ServeRAID Microsoft Windows NT Cluster Solution.
Page 7
Edition Notice ......164 Non-IBM Web sites ..... . 165 Year 2000 readiness and instructions .
Page 8
Federal Communications Commission (FCC) Statement ..167 Industry Canada Class A emission compliance statement ..167 Australia and New Zealand Class A statement ... . 167 United Kingdom telecommunications safety requirement .
Page 10
Pred inštaláciou tohto produktu si pre ítajte Informa nú brožúrku o bezpe nosti. Preden namestite ta izdelek, preberite knjižico Varnostne informacije. Antes de instalar este producto, lea la Información de Seguridad. Läs säkerhetsinformationen innan du installerar den här produkten. Installálás el tt olvassa el a Biztonsági el írások kézikönyvét ! Statement 1: DANGER Electrical current from power, telephone, and communication cables is...
Page 11
Statement 2: CAUTION: When replacing the lithium battery, use only IBM Part Number 38L3386 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer.
ServeRAID utility programs. Note: The IBM ServeRAID product can be either a controller on an adapter, such as the one in this option package, or a controller on the system board of your server.
CD has the Acrobat Readers for Microsoft Windows, IBM OS/2, and Linux in the /BOOKS directory. If you are installing the IBM ServeRAID Cluster Solution, you might need to refer to the IBM Shared Disk Clustering Hardware Reference.This book provides general information about planning and configuring a shared-disk cluster using IBM Netfinity and PC Server products.
(See “Controller features” on page 15 for more information.) You also can use the configuration and reference information in this book to configure the IBM ServeRAID controllers provided on some IBM Netfinity and PC Server system boards. Option package contents...
Stripe-unit size With RAID technology, data is striped across an array of physical drives. This data-distribution scheme complements the way the operating system requests data. The granularity at which data is stored on one drive of the array before subsequent data is stored on the next drive of the array is called the stripe-unit size.
Page 17
Create an array using the two physical drives. Then, create a logical drive within that array. The data is striped across the drives, creating blocks. Notice that the data is striped across all the drives in the array, but no redundant data is stored. A physical drive failure within the array results in loss of data in the logical drive assigned RAID level-0, but only in that logical drive.
Page 18
Because the data is mirrored, the capacity of the logical drive when assigned RAID level-1 is 50% of the array capacity. The following illustration shows an example of a RAID level-1 logical drive. Start with two physical drives. Create an array using the two physical drives. Then, create a logical drive within that array.
Page 19
RAID level-1E requires a minimum of 3 drives and, depending upon the level of firmware and the stripe-unit size, supports a maximum of 8 or 16 drives. The following illustration is an example of a RAID level-1E logical drive. Start with three physical drives. Create an array using the physical drives.
Page 20
RAID level-5 offers both data protection and increased throughput. RAID level-5 gives you higher capacity than RAID level-1, but RAID level-1 offers better performance. RAID level-5 requires a minimum of 3 drives and, depending upon the level of firmware and the stripe-unit size, supports a maximum of 8 or 16 drives. The following illustration is an example of a RAID level-5 logical drive.
Page 21
If a physical drive fails in the array, the ServeRAID controller switches read and write requests to the remaining functional drive in the RAID level-5 array, which is a hot-spare drive. Understanding RAID level-5 Enhanced RAID level-5 Enhanced (RAID level-5E) requires a minimum of four physical drives. RAID level-5E is also firmware-specific.
Page 22
The operating system uses the spanned array logical drive the same as a regular array logical drive. Note: RAID level-x0 is only available on the IBM ServeRAID-4H Ultra160 SCSI controller. RAID level-x0 requires a minimum of 2 drives and supports a maximum of 60 drives.
Page 23
The following illustration is an example of a RAID level-10 logical drive. Start with six physical drives. Create three arrays (labeled A, B, and C), each array using two physical drives. Then, create a spanned array 1 1 1 (labeled as 1) that spans the three arrays.
RAID level means the sub-logical drive is and the spanned array logical drive is RAID level-0 RAID level-0 RAID level-1 RAID level-0 RAID level-1E RAID level-0 RAID level-5 RAID level-0 With RAID level-10, 1E0, and 50, if one of the physical drives fails in a sub-logical drive, the ServeRAID controller switches read and write requests to the remaining functional drives in the sub-logical drive.
Page 25
Drive State Meaning Ready The ServeRAID controller recognizes a ready drive as being available for definition. Standby Hot A standby hot spare is a hot-spare drive that the ServeRAID controller Spare has spun down. If an online drive becomes defunct and no suitable hot-spare drive is available, a standby hot-spare drive of the appropriate size automatically spins up, and enters the rebuild state.
Obtaining ServeRAID updates IBM periodically makes updated versions of the ServeRAID firmware, device drivers, and utility programs available from the IBM Support page on the World Wide Web. In addition to the updated device drivers and utility programs, there is a command-line program available from the World Wide Web.
To access ServeRAID and Clustering support, follow these steps: 1. Click Servers on the IBM Support page. The IBM Netfinity and PC Server Support page appears. 2. Select ServeRAID or Clustering from the Family list box. The ServeRAID or Clustering Support page appears.
If you are using a ServeRAID controller on an IBM Netfinity or PC Server system board, you will not need the information in this section. Continue with “Step 2: Updating BIOS and firmware code”...
Page 30
Statement 2: CAUTION: When replacing the lithium battery, use only IBM Part Number 38L3386 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer.
To use Hot-plug PCI with Windows NT 4.0 and a ServeRAID-4H controller, you must install the IBM Netfinity Hot Plug for Windows NT 4.0 Package, version 4.1 or later. This package is available from the IBM Support Web site; select downloadable files for the IBM Netfinity server you are using.
Page 32
Note: Some IBM Netfinity servers support Hot-plug PCI features, which allow you to install or remove PCI controllers without turning off the server. If your Netfinity model provides Hot-plug PCI support and you are using Windows NT, Windows 2000, or NetWare 5.x, you do not need to turn off your server to install this controller.
Page 33
Figure 2. Inserting a ServeRAID-4H controller into the PCI expansion slot 8. Secure the controller by either tightening the expansion-slot screw on the top of the controller or closing the latch, depending on your server. 9. Connect the SCSI cables to the controller. If you intend to attach external devices only, go to step 13 on page 20.
Page 34
Figure 3. Connecting a ServeRAID-4H controller internal channel connector 11. Connect the other end of the SCSI cable to the Active PCI backplane or to a SCSI device in the server. (See your server documentation or the system label inside the server cover for the location of the SCSI connector on the backplane.) Note: When the ServeRAID controller and a SCSI CD-ROM drive are connected to the same SCSI bus (cable), you must enable the...
Before configuring the ServeRAID controller, you must have the latest BIOS and firmware code installed on your server. 1. Insert the IBM ServeRAID Support CD into the server CD-ROM drive. 2. Turn on the server. The FlashMan program automatically starts.
4. When all updates are complete, scroll through the Features window. This window reports the changes that FlashMan applied to your ServeRAID controllers. 5. Leaving the IBM ServeRAID Support CD in the CD-ROM drive, shut down and restart the server. Note: If you update the ServeRAID BIOS/firmware code after the initial configuration, you must clear the ServeRAID logs.
Page 37
To start the ServeRAID Manager program, do the following: 1. Insert the IBM ServeRAID Support CD (or the CD that contains the ServeRAID Manager program that came with your system) into the CD-ROM drive; then, turn on the server.
Page 38
Figure 5. Configuration mode window Follow the instructions in the right panel to create logical drives on your ServeRAID controller. If you do not want to configure your ServeRAID controller, click Cancel. This will switch the program from Configuration mode to Information mode.
Page 39
Figure 6. Information mode window Click on the tool bar to switch from Information mode to Configuration mode. 2. Continue with one of the following: v “Using Configuration mode”. v “Using Information mode” on page 33. Using Configuration mode You can use Configuration mode to create up to eight independent disk arrays for each ServeRAID controller.
Page 40
Attention: The new controller stripe-unit size is set at the factory to 8 KB. If you need to change this setting, you must change the stripe-unit size before you store data in the logical drives. After you store data in the logical drives, you cannot change the stripe-unit size without destroying data in the logical drives.
Page 41
Notes: a. Some operating systems have size limitations for logical drives. Before you save the configuration, verify that the size of the logical drive is appropriate for your operating system. See your operating-system documentation for more detailed information. b. To change the configuration, click Modify arrays or Modify logical drives. 5.
Page 42
Figure 8. Create arrays window 4. Using the right mouse button, click the drive or SCSI channel icons in the Main Tree to select the drives that you want to add to your arrays, delete from your arrays, or define as hot-spare drives; then, select a choice from the pop-up list. If you want to create a spanned array, click the Span Arrays box.
Page 43
Figure 9. Create spanned arrays window 6. Using the right mouse button, click the array icons in the Main Tree to select the arrays that you want to add or delete to your spanned arrays; then, select a choice from the pop-up list. 7.
Page 44
Figure 10. Create logical drives window 8. When creating your logical drives, you might change your mind about the arrays you created. If so, you can: v Remove a specific drive from a newly defined array or delete an entire newly defined array.
Page 45
b. Some operating systems have size limitations for logical drives. Before you save the configuration, verify that the size of the logical drive is appropriate for your operating system. See your operating-system documentation for more detailed information. c. Typically, the first logical drive defined on the first ServeRAID controller found by system BIOS during startup will be your startup (boot) drive.
Page 46
Figure 12. Configuration summary window Note: To change the configuration, click Modify arrays or Modify logical drives. 16. Click Apply to accept and save the configuration. The configuration is saved in the ServeRAID controller and on the physical drives. 17. If you have multiple controllers, for each controller repeat steps 1 on page 27 through step 16.
IBM ServeRAID Device Drivers for SCO Operating Systems - UnixWare HBA and OpenServer BTLD diskette If you are installing files for an IBM ServeRAID controller that comes as a standard feature on your IBM Netfinity or PC Server system board, use the installation instructions and CDs provided with your server to install these files.
The startable Windows NT CD into the CD-ROM drive; then, restart the server. Note: If you are installing on an IBM Netfinity server that supports Hot-plug PCI under Windows NT 4.0, select the IBM ServeRAID Hot Replace Wizard to enable the hot-replace operation.
Page 49
2000: To create the Red Hat Linux device driver diskette on Windows 95, Windows 98, Windows NT 4.0, or Windows 2000, do the following: 1. Insert the IBM ServeRAID Support CD into the CD-ROM drive. 2. At a DOS prompt, type the following: d:\tools\dsk4w32 images\redhatdd.img a:...
Page 50
CD-ROM drive and a is the drive letter of the diskette drive. 3. Press Enter. 4. Remove the IBM ServeRAID Support CD from the CD-ROM drive. ® Creating the diskette on OS/2 Warp...
Page 51
1. Make a copy of the OS/2 Warp Diskette 1 and label it Copy of OS/2 Diskette 2. Copy the IPSRAID.ADD file from the OS2 directory on the IBM ServeRAID Device Drivers diskette to the Copy of OS/2 Diskette 1.
Page 52
You can ignore the first message; if the second message appears, however, you must press Enter when prompted to continue the installation. 5. Keep the IBM ServeRAID Device Drivers for SCO Operating Systems - UnixWare HBA and OpenServer BTLD diskette available. You will need it to configure the device driver into the link kit.
Page 53
For additional information about adding a boot-time loadable driver at boot time, refer to “Using Boot-Time Loadable Drivers” in the SCO OpenServer Handbook. Installing device drivers for UnixWare The instructions that you use for installing the ServeRAID files when using UnixWare depend on the number of IDE and SCSI disk-storage adapters and controllers installed in the system.
Page 54
v If the CD-ROM drive that you are using to install your operating system is attached to the integrated ServeRAID controller, disconnect or remove all disk drives attached to the integrated controller. v If only disk drives are attached to the integrated controller, disconnect the SCSI cable from the ServeRAID connector on the system board.
Page 55
1. Use the instructions provided with UnixWare to begin the installation. 2. When a message appears asking if you want to install any HBA diskettes, insert the IBM ServeRAID Device Drivers for SCO Operating Systems - UnixWare HBA and OpenServer BTLD diskette; then, select Install HBA diskette.
Installing device drivers after installing Windows 2000 To install the ServeRAID device driver after installing Windows 2000: 1. Insert the IBM ServeRAID Support CD into the CD-ROM drive. 2. From the Start Menu, click Programs → Administrative Tools → Computer Management.
Page 57
Installing device drivers after installing Windows NT 4.0 To install the ServeRAID device driver after installing Windows NT 4.0: 1. Insert the IBM ServeRAID Device Drivers diskette into the diskette drive or insert the IBM ServeRAID Support CD into the CD-ROM drive.
Page 58
where d is the CD-ROM drive letter. v For NetWare 5.x: If you are installing from diskette, type: a:\netware5 where a is the diskette drive letter. v For NetWare 5.x: If you are installing from CD-ROM, type: d:\programs\netware\driver\netware5 where d is the CD-ROM drive letter. 10.
Page 59
Updating device drivers from the World Wide Web: To update device drivers downloaded from the World Wide Web after installing Linux, do the following: 1. Download the file ips-400.tgz that is available from the IBM Developer Web site at the following address: http://www.developer.ibm.com/welcome/netfinity/serveraid.html...
Page 60
You can use the following instructions to install the ServeRAID device driver files after installing OS/2 Warp Server. To install the ServeRAID files after installing OS/2: 1. After you complete the OS/2 installation, insert the IBM ServeRAID Device Drivers diskette. 2. From an OS/2 window, type: where a is the letter for the diskette drive that contains the ServeRAID diskette.
Page 61
3. Press Enter; then, select the diskette drive in which you will insert your installation diskette. 4. When prompted, insert the IBM ServeRAID Device Drivers for SCO Operating Systems - UnixWare HBA and OpenServer BTLD diskette. 5. When prompted for the name of the package, type: ipsraid 6.
3. Press Enter. 4. When the message Insert diskette into Floppy Drive 1 appears, press Enter. 5. When the message Installation of IBM ServeRAID SCSI IHV HBA (ips) was successful appears, type: 6. Press Enter. 7. After the device driver is installed, shut down and restart the server.
Figure 13. ServeRAID Manager installed on a server Installing the ServeRAID Manager program This section provides instructions for installing the ServeRAID Manager program. When using: Go to: Windows 2000 “Installing on Windows 2000, Windows NT 4.0, Windows 98, or Windows 95”...
Page 64
2. The installation program starts. Follow the instructions on the screen to install the program. Note: If you are installing on an IBM Netfinity server that supports Hot-plug PCI under Windows NT 4.0, select the IBM ServeRAID Hot Replace Wizard to enable the hot-replace operation.
Page 65
5. Follow the instructions on the screen to install the program. Installing on Red Hat Linux 6.1 (or later) Notes: 1. The ServeRAID Manager program comes with the IBM Java Runtime Environment (JRE). 2. This version of the ServeRAID Manager program supports up to 8 ServeRAID controllers when using Linux.
Page 66
Note: The ServeRAID Manager requires that you install the SCO OpenServer JDK (or JRE). You can download the JDK and JRE from the SCO Web site: http://www.sco.com/java/ 1. Insert the IBM ServeRAID Support CD into the CD-ROM drive. 2. Mount the CD-ROM by typing: cd / Then, press Enter.
ServeRAID controllers. These utility programs are provided on the IBM ServeRAID Command-Line Programs diskette and the IBM ServeRAID Support Note: IPSSEND for OS/2 is on the IBM ServeRAID Support CD only. You can use the IPSSEND program to view the configuration of a ServeRAID controller, initialize logical drives, synchronize logical drives.
Page 68
For OS/2, type: copy z:\programs\os2\cmdline\ipssend.exe c:\ipsadm Notes: a. Where z is the drive letter for the CD-ROM drive that contains the IBM ServeRAID Support CD and c is the drive letter where Windows NT, Windows 2000, NetWare, or OS/2 is installed.
Page 69
Installing IPSSEND for OpenServer To install these programs for OpenServer 5.0.5: 1. Start the server. 2. After the operating system starts, insert the IBM ServeRAID Support CD into the CD-ROM drive. 3. Mount the CD by typing the following at the console:...
To install the IPSMON program for NetWare: 1. Start the server. 2. After the operating system starts, insert the IBM ServeRAID Support CD into the CD-ROM drive. 3. Copy the IPSMON.EXE file to your hard disk drive by typing on the DOS command prompt: copy z:\programs\netware\cmdline\ipsmon.nlm c:\nwserver...
Figure 14. Information mode window Starting the ServeRAID Manager program in NetWare To start the ServeRAID Manager program in NetWare: 1. From the NetWare console, type: LOAD RAIDMAN 2. Press Enter. The program starts in Information mode and a window similar to the previous window opens.
3. Type the following: RaidMan 4. Press Enter. The program starts in Information mode and a window similar to the previous window opens. Starting the ServeRAID Manager program in OpenServer, UnixWare, and Linux Use these procedures to start the ServeRAID Manager program in OpenServer, UnixWare, and Linux.
Page 73
cd /opt/RaidMan 2. Press Enter. 3. Type the following: sh RaidAgnt.sh 4. Press Enter. Chapter 2. Installing and configuring ServeRAID controllers...
IBM PC Server Enterprise Expansion Enclosure (3518), using IBM SCSI-2 Fast/Wide Enhanced Repeater Adapter v IBM Netfinity Rack Drawer Enclosure (3519), using IBM SCSI-2 Fast/ Wide Enhanced Repeater Adapter v IBM Netfinity EXP10 Rack Storage Enclosure, using Netfinity EXP10 3m External...
Note: The cables to the drives must not be attached when you start the server. 1. Insert the IBM ServeRAID Support CD (or the configuration CD that was included with your server) into the CD-ROM drive; then, turn on the server.
Page 77
This point is especially important if the Windows NT or Windows 2000 system startup drive is attached to the IBM ServeRAID controller. If the initialization occurs after the startup drive array has been created, the array information will be removed and the system will no longer start in Windows NT or Windows 2000.
Page 78
5. Repeat step 2 on page 63 through step 4 on page 63 for the second ServeRAID controller. 6. In the Main Tree, click the first ServeRAID controller that you want to configure. 7. Click on the tool bar. The Configure controller for clustering window opens.
Channel 1 on the second ServeRAID controller to the first expansion enclosure. 2. Restart the server with the IBM ServeRAID Support CD (or the configuration CD that came with your server) in the CD-ROM drive.
Configuring ServeRAID arrays and logical drives To configure arrays and a logical drive, do the following. Note: You can create only one logical drive for each array in a failover environment. Click on the tool bar. The Configuration mode window opens (see Figure 15 on page 63).
12. Click Yes to continue working with your ServeRAID configuration. After creating the arrays and logical drives, you must assign merge group numbers to the shared logical drives. 13. In the Main Tree, click the ServeRAID controller that contains the logical drives.
Page 82
When you start the ServeRAID Manager installed on the server, the ServeRAID Manager Main Tree displays a successful failover controller pairing, similar to the following window. Figure 19. Information mode window showing a failover controller pairing Before testing your failover environment, allow the auto-synchronization process to complete.
Microsoft Cluster Service using Windows 2000, which is part of Windows 2000 Advanced Server Edition or Windows 2000 Datacenter Server Edition v Vinca High Availability for Novell IntranetWare, which is part of the IBM Netfinity Cluster Pack by Vinca v Novell High Availability Server 1.0...
Page 84
Clients Public Network Crossover Cable (Heartbeat) SCSI Bus Server A Server B Expansion Enclosure Figure 20. A high-level view of a cluster Public Network Server A Server B CD-ROM CD-ROM Drive Drive RAID - 1 RAID - 1 SCSI IDs SCSI IDs Array A Array A...
Page 85
The solution you use for your installation depends on your own specific requirements. For more information about requirements and types of installations, refer to the IBM Shared Disk Clustering Hardware Reference. You can obtain this publication from the IBM Support Web site. See “Downloadable files from the World Wide Web”...
Hardware considerations v The SCSI-2 Fast/Wide Enhanced Repeater Card is required for configurations using the IBM Enterprise Expansion Enclosure (Model 3518) or the IBM Model 3519 Rack Expansion Enclosure. The previous version of the SCSI-2 Fast/Wide Repeater is not supported in these configurations. For information on the latest version of the SCSI Fast/Wide Enhanced Repeater Card, contact your IBM reseller or marketing representative.
Page 89
failed. For this reason, do not use RAID level-5 for the quorum drive. You must configure the quorum drive as a RAID level-1 logical drive. Note: Define hot-spare drives in your array to minimize the time that logical drives remain in critical state. v Every logical drive that is shared by the two servers must have its cache policy set to write-through mode to ensure that data integrity is maintained.
IBM ServeRAID Support CD v IBM ServeRAID Device Drivers diskette Note: If you are using the latest version of the IBM ServeRAID Support CD, the BIOS/firmware code is automatically verified when you start the server with the CD in the CD-ROM drive. If the BIOS/firmware code needs updating, you will be prompted to do so.
Chapter 7. Configuring ServeRAID controllers for clustering To install the IBM ServeRAID Cluster Solution, you must first install the BIOS and firmware. Refer to “Chapter 6. Updating the ServeRAID BIOS, firmware, and software code” on page 77. Then, you must configure the ServeRAID controller, define logical drives, and set up merge group numbers for your servers.
Note: For complete information on using the ServeRAID Manager program, refer to the ServeRAID Manager online help. 1. Insert the IBM ServeRAID Support CD (or the configuration CD that was included with your server) into the CD-ROM drive; then, turn on the server. The ServeRAID Manager program starts.
Page 95
This point is especially important if the Windows NT or Windows 2000 system startup drive is attached to the IBM ServeRAID controller. If the initialization occurs after the startup drive array has been created, the array information will be removed and the system will no longer start in Windows NT or Windows 2000.
6. Click on the tool bar. The Configure for clustering window opens. Figure 23. Configure for clustering window 7. Fill in the following information. Notes: a. The controller name and partner name are case sensitive. b. If your configuration will contain multiple ServeRAID controllers pairs, each controller name must be unique.
Page 97
2. In the Main Tree, click the ServeRAID controller that you want to configure. 3. Click the Custom configuration radio button. 4. Click Next. The Create arrays window opens. 5. Using the right mouse button, click the ready drive or SCSI channel icons in the Main Tree to select the drives that you want to add to your arrays or delete from your arrays;...
Page 98
In the Main Tree, click the server. b. Click Actions → Save printable configuration. 16. Click OK. 17. To exit the ServeRAID Manager program, click File → Exit. 18. Remove the IBM ServeRAID Support CD from the CD-ROM drive. 19. Shut down the server. ® ®...
Windows 2000” on page 79 for configuring Server A and Server B for the high-availability cluster solution. v Ensure that you are using the IBM ServeRAID Device Driver diskette (version 4.0, or later) during the installation of the Microsoft Windows NT Server Enterprise Edition.
Page 100
Notes: a. It is helpful if part of the volume label that you assign contains the drive letter that you assigned to the drive, such as DRIVE E. b. If you want to use the disk in a cluster, create only one partition on the disk.
Page 101
Close the connection to the cluster and open it again to ensure that the connection is through Server A. 11. Install the IBM ServeRAID Windows NT Cluster Solution program by doing the following: a. On Server A, run the utility SETUP.EXE program from the IBM ServeRAID Windows NT Cluster Solution diskette or IBM ServeRAID Support CD and follow the instructions that appear on the screen.
Creating a ServeRAID disk resource on a Windows NT 4.0 ServeRAID cluster You can use a ServeRAID logical disk that has not already been designated as a cluster resource, or you can create a new array and logical disk on Server A, using the ServeRAID Manager program.
5. Bring the ServeRAID disk group online. Deleting and re-creating a ServeRAID logical drive resource This section describes how to delete and re-create a ServeRAID logical drive resource without deleting a ServeRAID logical drive. To delete a resource or resource group: 1.
1. Start the Microsoft Cluster Administrator program on the server you want to upgrade and move all resources and groups to the other server (its cluster partner). 2. Insert the IBM ServeRAID Support CD into the CD-ROM drive; then, type the following command and press Enter. d:\programs\winnt\cluster\setup.exe where d is the CD-ROM drive.
To upgrade the IBM ServeRAID BIOS and firmware on a server in the cluster, do the following: 1. Start the server from the IBM ServeRAID Support CD, version 4.0 or later, if the server was not previously started in step 10 on page 91 of the procedure “Step 3: Upgrading the IBM ServeRAID Windows NT device driver”.
Windows 2000” on page 79 for configuring Server A and Server B for the high-availability cluster solution. v Ensure that you are using the IBM ServeRAID Device Drivers diskette (version 4.0; or later) during the installation of Windows 2000 Advanced Server Edition or Windows 2000 Datacenter Server Edition.
Page 108
a:\support\ipshahto where a is the diskette drive letter. v If you are using the CD, type the following command from a Windows 2000 command line: d:\programs\winnt\cluster\support\ipshahto where d is the CD-ROM drive letter. Running the program makes all the shared logical drives available for access by Server A.
Page 109
Figure 25. Changing a shared logical drive to Basic Disk 9. On Server B, run the same utility, IPSHAHTO.EXE, to make all shared logical drives available for access by Server B. Note: Use the volume label as a guide to make sure you assign the same letters on Server B as you assigned on Server A.
15. Insert the IBM ServeRAID Windows NT Cluster Solution diskette or IBM ServeRAID Support CD into the Server A diskette or CD-ROM drive; then, type the following command and press Enter: v If you are installing from diskette, type the following command from a...
Page 111
1. On Server A, do the following: a. Using the right-mouse button on the desktop, click My Computer; then, click Manage. The Computer Management window opens. b. Double-click Storage. c. Click Disk Management. The Write Signature and Upgrade Disk Wizard opens.
2. Move all cluster resources and groups to the other cluster node (that is, the server that is not running the Cluster Administrator program). 3. Insert the IBM ServeRAID Support CD (version 4.0 or later) into the CD-ROM drive; then, type the following command and press Enter: d:\programs\winnt\cluster\setup.exe...
10. After the server restarts, click Start → Settings → Control Panel.The Control Panel window opens. 11. Double-click Add/Remove Programs. The Add/Remove Programs window opens. 12. Select IBM ServeRAID NT Cluster Solution from the list of installed components. 13. To uninstall the IBM ServeRAID Windows NT Cluster Solution, click Change/Remove.
Chapter 10. Monitoring and updating an IBM ServeRAID Cluster Solution You can use the ServeRAID Manager program to check the ownership of a physical drive on another server or to add or remove a logical drive in the cluster. The...
2. Click Actions → Clustering actions. 3. Click View shared drives. The View shared drives window opens. 4. Click Enable view shared drives. 5. Select the SCSI channel and SCSI ID of a physical drive on a shared channel. 6. Click OK. Physical drives that are available for use are labeled Ready in the Main Tree.
To validate a cluster, do the following: 1. In the Main Tree, click a server in the cluster. 2. Click Actions → Validate cluster. A window similar to the following opens. Chapter 10. Monitoring and updating an IBM ServeRAID Cluster Solution...
Page 118
Figure 28. ServeRAID cluster validation window The server you selected in step 1 on page 103 is listed in the Node A box. Note: You cannot change the Node A system in the Cluster validation window. To select a different system, click Cancel to return to the Main Tree. 3.
A window similar to the following opens. Figure 29. Configure controller for clustering window Note: In this case, you can view this information only. You cannot change the information. Chapter 10. Monitoring and updating an IBM ServeRAID Cluster Solution...
The ServeRAID Mini-Configuration program provides a quick way to display the current settings for the ServeRAID controller. You also can use this program to perform a limited set of the configuration functions without using the IBM ServeRAID Support CD. To access the Mini-Configuration program: 1.
v BootCD shows the current state of the Bootable CD-ROM function. (Refer to “Setting the Bootable CD-ROM feature” on page 109.) v CompMode shows the current BIOS compatibility mode. On indicates 8 gigabyte (GB) Extended; Off indicated 2 gigabyte (GB) Limited. v Clustered shows the current state for clustering.
Page 123
This choice does not change any of the ServeRAID controller settings (such as the stripe-unit size, rebuild rate, and so on) from their current values. v Copy the Configuration from Drives to Controller reads the most common configuration from the drives in the server and copies it to the ServeRAID controller.
Using the IPSSEND command-line program The IPSSEND command-line program provides a quick way to do the following for the ServeRAID controller: v Backup copies of data (see “FlashCopy function (for Windows NT and Windows 2000 only)”) v Copy ServeRAID controller configurations from one server to another (see “Server roll-out functions”...
Page 125
target partitions, and then creates a snapshot-like backup of the source data on the target partition. The target partition is available instantly for read access. Note: To create the backup copy, the following must be true: v The size of the target partition must be equal to or larger than that of the source partition.
Page 126
Command: ipssend flashcopy controller map where: v controller is the ServeRAID controller number (1–12) For example, if you type ipssend flashcopy 2 map, the following results appear on the screen: Found 2 IBM ServeRAID Controller(s). Partition Partition Partition Size Logical Array...
Page 127
Note 3 One or more of the following is true for this partition: v The partition is in the blocked state. v The partition is not in the okay or critical state. v The partition is currently synchronizing, rebuilding, or migrating.
Page 128
Note: Use the flashcopy map function to correlate the ServeRAID logical drive number to the operating system drive partition number. v target is the target partition number Note: Use the flashcopy map function to correlate the ServeRAID logical drive number to the operating system drive partition number.
Page 129
where: v controller is the ServeRAID controller number (1–12) v source is the source partition number Note: Use the flashcopy map function to correlate the ServeRAID logical drive number to the operating system drive partition number. v target is the target partition number Note: Use the flashcopy map function to correlate the ServeRAID logical drive number to the operating system drive partition number.
Command: ipssend flashcopy controller delete arrayID [noprompt] where: v controller is the ServeRAID controller number (1–12) v arrayID is the Array ID (A–H) Note: If the array is a spanned array, arrayID is the array ID (1–8). v noprompt is an optional parameter to override the user-prompt. flashcopy import Use the flashcopy import function to merge logical drive information from new physical drives when they are added to the...
Page 131
where: v controller is the ServeRAID controller number (1–12) v logicaldrive is the logical drive number (1–8) v noprompt is an optional parameter that overrides the user prompt backup Use the backup function to save a ServeRAID controller configuration and BIOS settings to a diskette or to a physical drive. The ServeRAID controller configuration must be valid.
v filename is the path and file name where the configuration is to be written v noprompt is an optional parameter that overrides the user prompt. synch Use the synch function to synchronize the parity information on redundant logical drives. If the parity information is inconsistent, the IPSSEND program will repair it automatically.
Attention: You must be very careful when you use this function. For example, you might lose data if you reset a defunct device to online without first performing a rebuild operation. Supported operating systems: Windows NT, Windows 2000, OS/2, NetWare, Linux, OpenServer, UnixWare, and DOS Command: ipssend setstate controller channel sid nstate where: v controller is the ServeRAID controller number (1–12)
Page 134
SCSI ID for the device (0–15) getevent Use the getevent function to display information about various unexpected events. IBM uses the soft and hard event logs for development and debugging purposes only. The device event log contains event counters for each attached physical device. These...
Page 135
v Hard: The SCSI controller detected an unexpected event. The controller is the most likely cause. v Misc: The ServeRAID controller detected an event that was most likely caused by the device. The device event log also provides Predictive Failure Analysis (PFA) alerts, which indicate that the device has signaled the ServeRAID controller that it might fail in the near future.
RAID Configuration functions The IPSSEND RAID configuration functions include the following: devinfo Use the devinfo function to retrieve information (such as size and state) about a specific device. Supported operating systems: Windows NT, Windows 2000, OS/2, NetWare, Linux, OpenServer, UnixWare, and DOS Command: ipssend devinfo controller channel sid where: v controller is the ServeRAID controller number (1–12)
readahead Use the readahead function to enable, disable, or set the adaptive mode for the read-ahead feature of the ServeRAID controller. Supported operating systems: Windows NT and DOS Command: ipssend readahead controller options where: v controller is the ServeRAID controller number (1–12) v options is one of the following: –...
Page 138
Note: IPSMON continuously polls the ServeRAID controllers until you type unload ipsmon at the system console. Supported operating systems: NetWare Command: ipsmon options where: v options is one of the following optional parameters: – -F:filename to specify the name of the file in which to record messages. The default file name is IPSMON.LOG.
ServeRAID Manager fails to start (Windows NT and Windows 2000 only) If you start a server with the IBM ServeRAID Support CD in the CD-ROM drive and the ServeRAID Manager does not start, you must reduce the number of FAT partitions with assigned drive letters on the server.
Page 140
Message Explanation Action Battery-backup The ServeRAID controller detects Press F8 if you replaced the battery-backup cache, or press cache that the battery-backup cache is F10 if you have not replaced the battery-backup cache. replacement defective. Configured drives When the ServeRAID controller Press one of the following keys: are missing.
Page 141
Message Explanation Action Configured drives When the ServeRAID controller Press one of the following keys: are not in the detects that a previously configured Detailed description. Press this key for a detailed configured drive is present, but the drive is in description of the problem, such as the example location.
Page 142
Message Explanation Action Installation The server cannot access the This is a follow-on message to a preceding message. Follow stopped. ServeRAID controller. the Action instructions for the preceding message to resolve the problem. ® ® ™ Netfinity User’s Reference: ServeRAID -4H Ultra160 SCSI Controller...
Page 143
Message Explanation Action New controller When the ServeRAID controller Press one of the following keys: installed in a detects that the identifiers of the Detailed description. Press this key for a detailed configured server drives do not match the controller description of the problem, such as the example or drives are configuration information, the...
1. When the ServeRAID controller requires your input, a list of function keys will appear below the message. 2. Where the Action information tells you to start the IBM ServeRAID configuration program, insert the IBM ServeRAID Support CD into the CD-ROM drive; then, restart the server.
The POST detected an error with the Have the system serviced. ServeRAID controller hardware. 2620 The POST detected that a ServeRAID Start the IBM ServeRAID Support CD configuration or hard disk error and view the existing device and occurred. configuration information for your ServeRAID subsystem.
Page 146
Action:Have the system serviced. table table Explanation:Invalid flash configuration. Action:Start the IBM ServeRAID Support CD and follow the instructions that appear on the screen. If no instructions appear or if the problem persists, have the system serviced. Explanation:Invalid NVRAM configuration.
Page 147
ID of the drive that is not responding. Action: Press F4 or F10. When you warm-start the server, if a ″Configuration change error″ displays, select F4. Do not select F10. If you do select F10, contact the IBM Personal Computer HelpCenter.
Page 148
Explanation and possible recovery action Explanation:Online/Rebuild and Hot-Spare/Standby Hot-Spare drives are not responding. Action:Press F4, F5, or F10. Explanation:Online/Rebuild and Hot Spare/Standby Hot-Spare drives are not responding, and a drive was found at the incorrect SCSI ID. Action:Press F4, F5, F6, or F10. Explanation:Online/Rebuild and Ready/Standby drives are not responding.
Page 149
Explanation and possible recovery action Explanation:No error occurred. Action:No action is required. Explanation:Hot-Spare/Standby Hot-Spare drives are not responding. Action:Press F4, F5, or F10. Explanation:Ready/Standby drives are not responding. Action:Press F4, F5, or F10. Explanation:Hot-Spare/Standby Hot-Spare and Ready/Standby drives are not responding. Action:Press F4, F5, or F10.
If the defunct drives are part of an array, do the following: v If more than one physical drive in an array is defunct, contact your IBM service representative. v If a rebuild operation is in progress, wait until the rebuild is complete.
On IBM servers, when a hot-spare drive is available, the Rebuild operation begins automatically without the need to replace the failed drive. If more than one drive fails, the Rebuild operation begins rebuilding the first failed drive to the hot-spare drive.
2. Replace the failed controller. Note: Do not attach the SCSI cables to the new controller. 3. Insert the IBM ServeRAID Support CD (or the configuration CD that was included with your server) into the CD-ROM drive; then, turn on the server.
IBM service representative for further information. Also, you can find hints and tips to help you solve problems on the IBM Support Web site. See “Downloadable files from the World Wide Web” on page 14 for additional information.
Recovering from a failed ServeRAID server When replacing a failed server in a high-availability configuration, you might not need to replace the ServeRAID controller. However, if you replace your ServeRAID controller, you must reconfigure the controller after you have installed your new server.
Page 155
To obtain the SCSI initiator IDs, controller name, partner name, and stripe-unit size from the corresponding cluster partner controller, do the following: 1. Start the cluster partner system with the IBM ServeRAID Support CD in the CD-ROM drive. The ServeRAID Manager program starts.
Page 156
You must ensure that you have the same level of ServeRAID BIOS and firmware on both controllers in the cluster. The software is available on the IBM Support Web site. See “Downloadable files from the World Wide Web” on page 14 for additional information.
Other non-shared disk arrays v Shared arrays which have not failed-over to the other server, start the system with the IBM ServeRAID Support CD (version 4.0, or later) in the CD-ROM drive. The ServeRAID Manager program starts. If the ServeRAID controller being replaced does not attach to any of these items, go to step 21 18.
1. Ensure that the resource type of each ServeRAID controller failover properly. shared disk resource is IBM ServeRAID logical disk. If the resource type is shown as physical drive, the localquorum option was not specified properly when MSCS was installed.
Page 159
Problem Action RAID level-5 logical drives cannot be Use the ServeRAID Manager program to check the state of the accessed by the operating system after a logical drive to ensure that it is not blocked. Using this program, failover. select the logical drive and look for Blocked state Yes. If the logical drive is blocked, make sure all physical drives that are part of the logical drive are in the online state.
Page 160
MSCS will bring this resource online on the surviving server within over the cluster resources, occasionally one about four minutes. or more of the IBM ServeRAID logical drive resources will stay in the online-pending state for several minutes, after moving over to the surviving server (when viewed with the Cluster Administrator).
Chapter 13. Getting help, service, and information If you need help, service, technical assistance, or just want more information about IBM products, you will find a wide variety of sources available from IBM to assist you. For example, IBM maintains pages on the World Wide Web where you can get information about IBM products and services, find the latest technical information, and download device drivers and updates.
IBM hardware repair - If the problem is determined to be caused by IBM hardware under warranty, trained service personnel are available to provide the applicable level of service.
Getting customer support and service Purchasing an IBM PC hardware product entitles you to standard help and support during the warranty period. If you need additional support and services, a wide variety of extended services are available for purchase that address almost any need.
Canada you can receive by fax marketing and technical information on many topics, including hardware, operating systems, and local area networks (LANs). You can call the IBM Automated Fax System 24 hours a day, 7 days a week. Follow the recorded instructions, and the requested information will be sent to your fax machine.
U.S.A. and Puerto Rico U.S.A. and Puerto Rico 1-800-772-2227 In all other countries, contact your IBM reseller or IBM marketing representative. Getting help around the world If you travel with your computer or need to move it to another country, you can register for International Warranty Service.
Enhanced PC support line Enhanced PC Support is available for desktop and mobile IBM computers that are not connected to a network. Technical support is provided for IBM computers and IBM or non-IBM options, operating systems, and application programs on the Supported Products list.
In Canada, contact IBM Direct at 1-800-465-7999, or: 1. Call 1-800-465-3299. 2. Select the HelpWare catalog. v In all other countries, contact your IBM reseller or IBM marketing representative. For more information or to purchase these services: v In the U.S., call 1-800-772-2227.
Ordering publications Additional publications are available for purchase from IBM. For a list of publications available in your country: v In the U.S., Canada, and Puerto Rico, call 1-800-879-2755. v In other countries, contact your IBM reseller or IBM marketing representative.
Country-unique Terms. The terms of Part 2 may replace or modify those of Part 1.The warranties provided by IBM in this Statement of Limited Warranty apply only to Machines you purchase for your use, and not for resale, from IBM or your reseller. The term ″Machine″ means an IBM machine, its features, conversions, upgrades, elements, or accessories, or any combination of them.
Page 170
If a Machine does not function as warranted during the warranty period, and IBM or your reseller are unable to either 1) make it do so or 2) replace it with one that is at least functionally equivalent, you may return it to your place of purchase and your money will be refunded.
Page 171
IBM or your reseller of changes in a Machine’s location. IBM is responsible for loss of, or damage to, your Machine while it is 1) in IBM’s possession or 2) in transit in those cases where IBM is responsible for the transportation charges.
1. The warranties provided by IBM in this Statement of Warranty apply only to Machines you purchase for your use, and not for resale, from IBM or your reseller. The term ″Machine″ means an IBM machine, its features, conversions, upgrades, elements, or accessories, or any combination of them.
Page 173
Machine and 2) at an engineering-change level compatible with the feature, conversion, or upgrade. Many features, conversions, or upgrades involve the removal of parts and their return to IBM. A part that replaces a removed part will assume the warranty service status of the removed part.
IBM is responsible for loss of, or damage to, your Machine while it is 1) in IBM’s possession or 2) in transit in those cases where IBM is responsible for the transportation charges. Neither IBM nor your reseller is responsible for any of your confidential, proprietary or personal information contained in a Machine which you return to IBM or your reseller for any reason.
Page 175
2. as to any other actual damage arising in any situation involving nonperformance by IBM pursuant to, or in any way related to the subject of this Statement of Warranty, IBM’s liability will be limited to the charge paid by you for the individual Machine that is the subject of the claim.
Page 176
FRANCE: Limitation of Liability: The following replaces the second sentence of the first paragraph of this Section: In such instances, regardless of the basis on which you are entitled to claim damages from IBM, IBM is liable for no more than: (items 1 and 2 unchanged).
Page 177
In each such instance unless otherwise provided by mandatory law, IBM is liable for no more than: (item 1 unchanged) 2)as to any other actual damage arising in all situations involving non-performance by IBM pursuant to, or in any way related to the subject matter of this Statement of Warranty, IBM’s liability, will be...
References in this publication to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which IBM operates. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used.
You should contact the software developers directly if you wish to verify readiness, understand limitations, or look for any software updates. To learn more about IBM PC products and the Year 2000, visit our Web site at http://www.ibm.com/pc/year2000. The information and tools there can help you with your Year 2000 transition plan, especially if you have multiple IBM PCs.
IBM. Unless otherwise stated, IBM makes no representations or warranties with respect to non-IBM products. Support (if any) for the non-IBM products is provided by the third party, not IBM. Some software may differ from its retail version (if available), and may not include user manuals or all program functionality.
Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
European community directive conformance statement This product is in conformity with the protection requirements of EC Council Directive 89/336/EEC on the approximation of the laws of the Member States relating to electro-magnetic compatibility. Attention: This is a Class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.
Page 184
33 IBM ServeRAID Command-Line Programs 13 cluster 74 IBM ServeRAID Device Drivers 14 onboard 62 IBM ServeRAID Device Drivers for SCO Operating problems 121 Systems - UnixWare HBA and OpenServer replacing 142 BTLD 14 self-test 121 IBM ServeRAID Windows NT Cluster Solutions 85,...
Page 189
83, 84, 88, 96 upgrading disk signatures 94 IBM ServeRAID Cluster Solution 98 software IBM Netfinity Hot Plug for Windows NT 4.0 17 spanned array 8, 111 creating 28 validate cluster 75, 79, 103 logical drive 10...
Page 190
ServeRAID Manager 50 Windows NT 4.0 Active PCI 17 device drivers 34, 43 failover 61 FlashCopy 110 Hot-plug PCI 17 IBM Netfinity Hot Plug for Windows NT 4.0 package 17 installing IPSSEND 54 Microsoft Cluster Service 85 ServeRAID Manager 50 problems...
Page 192
Part Number: 00N9132 Printed in the United States of America on recycled paper containing 10% recovered post-consumer fiber. SC00-N913-20...