Managing pcie adapters for ibm power system l922 9008-22l; ibm power system s922 9009-22a; ibm power system h922 9223-22h; ibm power system s914 9009-41a; ibm power system s924 9009-42a; ibm power system h924 9223-42h; ibm emx0 pcie gen3 i/o expansion dra (226 pages)
Page 1
SSA RAID Adapter Installation and User's Guide. COVER Book Cover -------------------------------------------------------------------------- IBM SSA RAID Adapter for PC Servers Installation and User's Guide Document Number S32H-3816-00 Part Number 32H3816 -------------------------------------------------------------------------- Book Cover _ Copyright IBM Corp. 1996 COVER - 1...
Page 2
+--- Note! ----------------------------------------------------------+ ¦ ¦ Before using this information and the product it supports, be sure ¦ ¦ to read the general information under "Notices" in topic D.2. ¦ +--------------------------------------------------------------------+ Notices _ Copyright IBM Corp. 1996 NOTICES - 1 ¦ ¦ ¦...
Page 3
Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corp. _ Copyright IBM Corp. 1996 EDITION - 1...
Avis de conformité aux normes de l'Industrie Canada D.4.5 Industry Canada Compliance Statement D.4.6 United Kingdom Telecommunications Requirements D.4.7 EC Council Directive D.4.8 Radio Protection for Germany INDEX Index Table of Contents _ Copyright IBM Corp. 1996 CONTENTS - 1...
SSA RAID Adapter Installation and User's Guide. Safety Information FRONT_1 Safety Information _ Copyright IBM Corp. 1996 FRONT_1 - 1...
Page 6
SSA RAID Adapter Installation and User's Guide. Safety Information _ Copyright IBM Corp. 1996 FRONT_1 - 2...
Page 7
The battery connector is polarized; do not try to reverse the polarity. Dispose of the battery according to local regulations. A module on the SSA RAID Adapter card contains a lithium battery. _ Copyright IBM Corp. 1996 FRONT_1 - 3...
PC server. It includes information about installing and using the SSA RAID Adapter, discusses disk-array technology, and describes tasks associated with disk arrays. Subtopics PREFACE.1 How This Book Is Organized. PREFACE.2 Related Publications _ Copyright IBM Corp. 1996 PREFACE - 1...
Page 9
Appendix B, "SSA RAID Adapter Service Request Numbers" in topic B.0 provides more detail about the messages that the subsystem might give you. Appendix C, "Introducing SSA and RAID" in topic C.0 gives background information on SSA and RAID in general. _ Copyright IBM Corp. 1996 PREFACE.1 - 1...
Introducing the SSA RAID Adapter The IBM SSA RAID Adapter for PC Servers is a PCI bus-master adapter that serves as the interface between systems using the Peripheral Component Interconnect (PCI) architecture and devices using the Serial Storage Architecture (SSA). The SSA RAID Adapter provides RAID functions.
Page 12
In SSA subsystems, transmissions to several destinations are multiplexed; the effective bandwidth is further increased by spatial reuse of the individual links. Commands are forwarded automatically from device to device along a loop until the target device is reached. Multiple commands can be travelling around the loop simultaneously. _ Copyright IBM Corp. 1996 1.1 - 1...
Page 13
The light is off if both ports are not operational On the front panel of the adapter and on one of its modules are labels on which is printed the 15-character SSA unique ID of the adapter. The Adapter Card _ Copyright IBM Corp. 1996 1.2 - 1...
The members of an array can be disk drives only; that is, an array cannot be a member of another array. If you need some basic information about RAID technology, refer to Appendix C, "Introducing SSA and RAID" in topic C.0. _ Copyright IBM Corp. 1996 1.3 - 1...
The SSA RAID Adapter, its firmware, and the software supplied with it provide attachments of SSA devices to the following operating systems: OS/2 2.11 SMP, OS/2 WarpServer Version Novell NetWare 4.1, 4.1 SM Windows NT 3.51 Serve Operating Systems _ Copyright IBM Corp. 1996 1.4 - 1...
- Novell NetWare Device Driver and Utilities diskette - Windows NT Device Driver and Utilities diskette - PC-DOS Configurator and Utilities diskette. Contact the place of purchase if any parts are missing or damaged. Before Installing the Adapter _ Copyright IBM Corp. 1996 1.5 - 1...
SSA RAID Adapter Installation and User's Guide. 1.6 Installation Requirements To install this option, you will need the following: The documentation that came with your serve A small flat-blade screwdriver Installation Requirements _ Copyright IBM Corp. 1996 1.6 - 1...
2.1 Installing the Adapter Card 2.2 Connecting the Disk Drives 2.3 Configuring the Disk Drives 2.4 Installing an Operating System 2.5 Installing the Device Drivers and Utility Programs 2.6 Selecting Your Boot Device _ Copyright IBM Corp. 1996 2.0 - 1...
Page 19
SCSI adapter. In some servers, slots with lower numbers have higher priority, in other servers, higher numbers mean higher priority; the User's Handbook for your server describes which rule applies. Installing the Adapter Card _ Copyright IBM Corp. 1996 2.1 - 1...
Page 20
1. Connect the cables from the devices to the appropriate pair of connectors on the adapter card. 2. Turn the retaining screws on the SSA cable connectors fully clockwise to ensure that a good ground connection is made. _ Copyright IBM Corp. 1996 2.2 - 1...
Page 21
2.3 Configuring the Disk Drives Turn power on to the server unit and to the devices. Your system automatically performs the PCI configuration tasks, which recognize the new adapter and devices during the boot process. _ Copyright IBM Corp. 1996 2.3 - 1...
Page 22
4. Install the device drivers and utility programs; how to do this is described in "Installing the Device Drivers and Utility Programs" in topic 2.5. 5. The SSA subsystem is now ready for use with your system. Installing an Operating System _ Copyright IBM Corp. 1996 2.4 - 1...
Page 23
The format in which the Event/Error Logger reports errors is controlled by the file EVNCTRLF.TXT in the install directory (which, by default, is c:\issa). Details of the settings and how to change them are contained in the header of the control file. _ Copyright IBM Corp. 1996 2.5 - 1...
Page 24
To return to booting from the previous default device: if the message CBIOS enabled appears, press the tab key. If you have problems booting from an SSA disk drive, refer to "Basic Problems" in topic 4.1. _ Copyright IBM Corp. 1996 2.6 - 1...
3. Attach the disk arrays or individual disk drives to your system. The following sections describe the details of these actions. Subtopics 3.1 Running the Configuration Utility 3.2 Accepting New Disk Drives 3.3 Creating an Array 3.4 Attaching Resources _ Copyright IBM Corp. 1996 3.0 - 1...
Page 27
Accepting New Disk Drives Vyymmdd ¦ ¦ List of New Disks Status xxxxxxx yyyyyyy ¦ ¦ ¦ ¦ <DELETE> Delete <F1> Help _ Copyright IBM Corp. 1996 3.2 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
(Q) ¦ Device N Slot T Adapter (S) ¦ ¦ ¦ <F1> Help Vyymmdd Device Y Slot Z Adapter <F1> Help _ Copyright IBM Corp. 1996 3.3 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 29
<F10> FlashOff <F8> Modify Attributes Vyymmdd Device Y Slot Z Adapter Filter Attributes for RAID-X Arrays : xxxxxxxx : xx : yy <F1> Help _ Copyright IBM Corp. 1996 3.3 - 2 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦...
Page 30
¦ Ru¦4. canUID444 status canUID555 status ¦ Di¦ +---+-----------------------------------+--+ <F1> Help <F9> FlashOn _ Copyright IBM Corp. 1996 3.3 - 3 ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦-----¦ ¦ ¦ ¦ ¦+¦ ¦...
Page 31
Creating an Array You can return to the Main Menu by repeatedly pressing Esc. The array created is in the free state. The next section describes how to attach the array to your system. _ Copyright IBM Corp. 1996 3.3 - 4...
Describes the actions you must perform with the adapter utility programs while changing a disk drive Subtopics 4.1 Basic Problems 4.2 Array Problems 4.3 Changing Failed Disk Drives Chapter 4. Dealing with Disk-Array Problems _ Copyright IBM Corp. 1996 4.0 - 1...
Page 35
That the address (drive letter) of the partition from which you are trying to boot has not changed. (Adding extra drives can cause the addresses of existing drives to be changed.) Basic Problems _ Copyright IBM Corp. 1996 4.1 - 1...
Page 36
The following section describes what you need to do with the array configuration utility while changing a disk drive. Array Problems Vyymmdd ¦ Error Log Report dd-mm-yy serialnum SRNNN¦ dd-mm-yy serialnu2 SRNN2¦ ¦ ¦ <F1> Help _ Copyright IBM Corp. 1996 4.2 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Good ¦ uidxxzzz Good ¦ ¦ ¦ ¦ No Disks ¦ ¦ <F1> Help <F2> Format <F5> Diagnostics <F9> FlashOn _ Copyright IBM Corp. 1996 4.3 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 38
Define the new disk drive as a new hot spare, using the procedure described in "Defining a Hot Spare" in topic 5.1, or Exchange the new disk drive with the previous hot spare, using the procedure described in "Exchanging a Member of an Array" in topic 5.5. _ Copyright IBM Corp. 1996 4.3 - 2...
Subtopics 5.1 Defining a Hot Spare 5.2 Viewing the Physical Configuration 5.3 Viewing Resources and Their Attributes 5.4 Changing Array Attributes 5.5 Exchanging a Member of an Array 5.6 Deleting an Array _ Copyright IBM Corp. 1996 5.0 - 1...
(Q) ¦ Device N Slot T Adapter (S) ¦ ¦ ¦ <F1> Help Vyymmdd Device Y Slot Z Adapter <F1> Help _ Copyright IBM Corp. 1996 5.1 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 41
Candidates for Hot-spare Disks canUID111 status canUID222 status canUID333 status canUID444 status canUID555 status <F1> Help <F9> FlashOn _ Copyright IBM Corp. 1996 5.1 - 2 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ (Q) ¦ ¦ ¦ ¦...
(Q) ¦ Device N Slot T Adapter (S) ¦ ¦ ¦ <F1> Help Vyymmdd Device Y Slot Z Adapter <F1> Help _ Copyright IBM Corp. 1996 5.4 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 46
<F10> FlashOff <F8> Modify Attributes Vyymmdd Device Y Slot Z Adapter Filter Attributes for RAID-X Arrays : xxxxxxxx : xx : yy <F1> Help _ Copyright IBM Corp. 1996 5.4 - 2 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦...
SSA Adapter List Device Y Slot Z Adapter (Q) ¦ Device N Slot T Adapter (S) ¦ ¦ ¦ <F1> Help _ Copyright IBM Corp. 1996 5.6 - 1 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 50
Slot Z Adapter List of RAID-X Arrays Status xxxxxxxx yyyyyyy FF00xxxx qqqqqqq <INSERT> Insert <DELETE> Delete ¦ <F10> FlashOff <F8> Modify Attributes _ Copyright IBM Corp. 1996 5.6 - 2 ¦ ¦ ¦ XX Version¦ ¦ ¦ ¦ ¦ (Q) ¦...
For detailed information on the operation of the adapter, refer to the SSA RAID Adapter: Technical Reference manual, SA33-3268. For more information on IBM products or services, browse the IBM home page on the World Wide Web, its URL is: http://www.ibm.com...
If two SSA RAID Adapters are installed, they must both be on the primary PCI bus (slots 6 and 7), if possible, or both on the secondary bus (slots 1 through 5). Appendix A. Multiple-Adapter Installations _ Copyright IBM Corp. 1996 A.0 - 1...
¦ Call for service or exchange ¦ ¦ the DRAM for a new one. ¦ ¦ Call for service or exchange ¦ ¦ the DRAM for a new one. _ Copyright IBM Corp. 1996 B.0 - 1 ¦ ¦ ¦...
Page 54
¦ Call for service ¦ ¦ Call for service ¦ ¦ ¦ ¦ ¦ ¦ Call for service ¦ ¦ ¦ _ Copyright IBM Corp. 1996 B.0 - 2 ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 55
¦ Exchange the adapter card ¦ for a new one or call for ¦ service ¦ Call for service ¦ ¦ for a new one or call for _ Copyright IBM Corp. 1996 B.0 - 3 ¦ ¦ ¦ ¦...
¦ for a new one or call for ¦ service ¦ for a new one or call for ¦ service ¦ Call for service ¦ ¦ ¦ ¦ ¦ _ Copyright IBM Corp. 1996 B.0 - 4 ¦ ¦ ¦ ¦ ¦ ¦ ¦ ¦...
Page 57
2. Review the configuration that you are trying to make, and determine why that configuration is not valid. 3. Correct your configuration by reconfiguring the SSA cables or by removing the excess devices or adapters from the loop. SSA Loop Configurations that Are Not Valid _ Copyright IBM Corp. 1996 B.1 - 1...
This chapter describes: Serial storage architecture (SSA The RAID functions that are provided by the SSA RAID Adapter Subtopics C.1 Serial Storage Architecture (SSA) C.2 RAID Functions Appendix C. Introducing SSA and RAID _ Copyright IBM Corp. 1996 C.0 - 1...
Page 59
Multiple commands can be travelling around the loop simultaneously. SSA retains the SCSI-2 commands, queuing model, and status and sense bytes. Subtopics C.1.1 SSA Loops and Links C.1.2 Rules for SSA Loops _ Copyright IBM Corp. 1996 C.1 - 1...
Page 60
The maximum permitted length for an external cable that connects two SSA nodes (for example, disk drives) is 25 meters (82 feet). Details of the rules for configuring SSA loops are given for each SSA adapter in "Rules for SSA Loops" in topic C.1.2. Subtopics C.1.1.1 Loops and Data Paths _ Copyright IBM Corp. 1996 C.1.1 - 1...
Page 61
In the diagram, disk drive number 3 has failed. Disk drives 1 and 2 can communicate with the system only through connector A1 of the SSA adapter. Disk drives 4 through 8 can communicate only through connector A2 of the SSA adapter. _ Copyright IBM Corp. 1996 C.1.1.1 - 1...
Page 62
A1 of the SSA adapter. Disk drive number 8 can communicate with the system only through connector A2 of the SSA adapter. Disk drives 4, 5, and 6 are isolated from the SSA adapter. _ Copyright IBM Corp. 1996 C.1.1.1 - 2...
Page 63
SSA RAID Adapter Installation and User's Guide. Loops and Data Paths _ Copyright IBM Corp. 1996 C.1.1.1 - 3...
Page 64
B1 and B2). A maximum of 48 devices can be connected in a particular SSA loop Only one pair of adapter connectors can be connected in a particular SSA loop Rules for SSA Loops _ Copyright IBM Corp. 1996 C.1.2 - 1...
Page 65
The SSA RAID Adapter provides RAID-0, RAID-1, and RAID-5 facilities and access to individual SSA disk drives that are not configured as members of an array. Subtopics C.2.1 RAID-0 C.2.2 RAID-1 C.2.3 RAID-5 C.2.4 Hot Spares C.2.5 Disk Array States RAID Functions _ Copyright IBM Corp. 1996 C.2 - 1...
Page 66
Short operations usually involve only one member, longer transfers use several simultaneously and can, therefore, give higher data rates. _ Copyright IBM Corp. 1996 C.2.1 - 1...
Page 67
So a mixed workload may not show any change in overall performance. When a member returns or it is replaced (either manually or automatically by the hot-spare mechanism), a rebuild occurs. This rebuild is performed in parallel with any activity to the array. _ Copyright IBM Corp. 1996 C.2.2 - 1...
Page 68
RAID-5 arrays write strips of data across all but one member of the array. Parity for the other strips is written on the last member. The members of the array are used in rotation for the parity data. RAID-5 arrays offer data protection , good throughput, and require fewer disks than RAID-1. _ Copyright IBM Corp. 1996 C.2.3 - 1...
If a disk drive within an array fails, at the next write operation to the array, the adapter automatically uses a hot spare instead of the failed disk drive, and rebuilds the data that was on the failed disk on to the hot spare. _ Copyright IBM Corp. 1996 C.2.4 - 1...
C.2.5 Disk Array States A disk array can be in one of several states. Those states are described here. Subtopics C.2.5.1 Good State C.2.5.2 Exposed State C.2.5.3 Degraded State C.2.5.4 Rebuilding State C.2.5.5 Offline State _ Copyright IBM Corp. 1996 C.2.5 - 1...
Page 71
SSA RAID Adapter Installation and User's Guide. Good State C.2.5.1 Good State A disk array is in the Good state when all the member disk drives of that disk array are present and functioning correctly. _ Copyright IBM Corp. 1996 C.2.5.1 - 1...
Page 72
Write Operations while in the Exposed State: When a write command is sent to a disk array that is in the Exposed state, the state of the array is changed to Degraded. _ Copyright IBM Corp. 1996 C.2.5.2 - 1...
Page 73
Attention: In this mode of operation, one data check can cause the loss of a large amount of data (more than 64 KB). The array management software must do a complete rebuild of the disk array to recover the data. _ Copyright IBM Corp. 1996 C.2.5.3 - 1...
Page 74
Rebuilding state. If the power fails before the rebuilding is complete, the array management software continues the rebuilding operation when the power returns for those strips not yet rebuilt. _ Copyright IBM Corp. 1996 C.2.5.4 - 1...
Page 75
SSA RAID Adapter Installation and User's Guide. Offline State C.2.5.5 Offline State A disk array enters Offline state when two or more disk drives become missing. Read and write operations are not allowed. _ Copyright IBM Corp. 1996 C.2.5.5 - 1...
Appendix D. Product Warranty and Notices D.0 Appendix D. Product Warranty and Notices International Business Machines Corporation Armonk, New York, 10504 Subtopics D.1 Statement of Limited Warranty D.2 Notices D.3 Trademarks D.4 Communications Statements _ Copyright IBM Corp. 1996 D.0 - 1...
Page 77
Machines are subject to these terms only if purchased in the United States or Puerto Rico, or Canada, and located in the country of purchase. If you have any questions, contact IBM or your reseller.
Page 78
Each Machine is manufactured from new parts, or new and serviceable used parts (which perform like new parts). In some cases, the Machine may not be new and may have been previously installed. Regardless of the Machine's production status, IBM's warranty terms apply.
If a Machine does not function as warranted during the warranty period, IBM or your reseller will repair or replace it (with a Machine that is at least functionally equivalent) without charge. If IBM or your reseller is unable to do so, you may return it to your place of purchase and your money will be refunded.
1-800-772-2227. In Canada, call IBM at 1-800-565-3344. You may be required to present proof of purchase. Depending on the Machine, the service may be 1) a "Repair" service at your location (called "On-site") or at one of IBM's or a reseller's service locations (called "Carry-in") or 2) an "Exchange"...
Extent of Warranty D.1.4 Extent of Warranty IBM does not warrant uninterrupted or error-free operation of a Machine. Misuse, accident, modification, unsuitable physical or operating environment, improper maintenance by you, or failure caused by a product for which IBM is not responsible may void the warranties.
Circumstances may arise where, because of a default on IBM's part (including fundamental breach) or other liability (including negligence and misrepresentation), you are entitled to recover damages from IBM. In each such instance, regardless of the basis on which you are entitled to claim damages, IBM is liable only for: 1.
References in this book to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which IBM operates. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used.
SSA RAID Adapter Installation and User's Guide. Trademarks D.3 Trademarks The following terms are trademarks of IBM Corporation in the United States or other countries or both: OS/2 NetWare is a trademark of Novell, Incorporated. Microsoft and Windows are trademarks or registered trademarks of Microsoft Corporation.
D.4.3 International Electrotechnical Commission (IEC) Statement D.4.4 Avis de conformité aux normes de l'Industrie Canada D.4.5 Industry Canada Compliance Statement D.4.6 United Kingdom Telecommunications Requirements D.4.7 EC Council Directive D.4.8 Radio Protection for Germany _ Copyright IBM Corp. 1996 D.4 - 1...
Page 86
This device complies with Part 15 of FCC Rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. _ Copyright IBM Corp. 1996 D.4.1 - 1...
Page 87
¦ use in commercial and industrial areas. ¦ area, or areas of proximity, radio and TV reception may be subject to ¦ radio interference. VCCI-1. +------------------------------------------------------------------------+ VCCI Statement When used in a residential _ Copyright IBM Corp. 1996 D.4.2 - 1 ¦ ¦ ¦...
Page 88
SSA RAID Adapter Installation and User's Guide. International Electrotechnical Commission (IEC) Statement D.4.3 International Electrotechnical Commission (IEC) Statement This product has been designed and built to comply with (IEC) Standard 950. _ Copyright IBM Corp. 1996 D.4.3 - 1...
Avis de conformité aux normes de l'Industrie Canada D.4.4 Avis de conformité aux normes de l'Industrie Canada Cet appareil numérique de la classe A respecte toutes les exigences du Règlement sur le matériel brouilleur du Canada. _ Copyright IBM Corp. 1996 D.4.4 - 1...
SSA RAID Adapter Installation and User's Guide. Industry Canada Compliance Statement D.4.5 Industry Canada Compliance Statement This Class A digital apparatus meets the requirements of the Canadian Interference-Causing Equipment Regulations. _ Copyright IBM Corp. 1996 D.4.5 - 1...
This apparatus is manufactured to the International Safety Standard EN60950 and as such is approved in the U.K. under approval number NS/G/1234/J/100003 for indirect connection to public telecommunications systems in the United Kingdom. _ Copyright IBM Corp. 1996 D.4.6 - 1...
Such cables and connectors are available from the provider or manufacturer. Neither the provider or manufacturer can accept responsibility for any interference caused by using other than recommended cables and connectors. EC Council Directive _ Copyright IBM Corp. 1996 D.4.7 - 1...
Dieses Gerät ist berechtigt in Übereinstimmung mit dem deutschen EMVG vom 9.Nov. das EG-Konformitätszeichen zu führen. Der Aussteller der Konformitätserklärung ist die IBM Germany. Dieses Gerät erfüllt die Bedingungen der EN 55022 Klasse A. Für diese Klasse von Geräten gilt folgende Bestimmung nach dem EMVG: Geräte dürfen an Orten, für die sie nicht ausreichend entstört sind, nur mit besonderer Genehmigung des Bundesministers für...
Page 94
C.2.2 event/error log checking 4.2 control file 2.5 exchanging array member 5.5 exposed state C.2.5.2 read operations C.2.5.2 write operations C.2.5.2 good state C.2.5.1 hot spares defining 5.1 function C.2.4 Index _ Copyright IBM Corp. 1996 INDEX - 1...
Page 95
C.2.5.3 exposed C.2.5.2 read operations C.2.5.2 write operations C.2.5.2 good C.2.5.1 offline C.2.5.5 rebuilding C.2.5.4 striping C.2.1 unique ID labels 1.2 utility programs installing 2.5 write while exposed C.2.5.2 Index _ Copyright IBM Corp. 1996 INDEX - 2...