1. Manuals
  2. Brands
  3. Bull Manuals
  4. Server
  5. Escala Power7 Series
  6. Manual

Bull ESCALA Power7 Series Manual

Enclosures and expansion units
Hide thumbs Also See for ESCALA Power7 Series:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Manual
Enclosures and expansion units
REFERENCE
86 A1 23FF 07

Advertisement

Table of Contents
loading

Related Manuals for Bull ESCALA Power7 Series

Summary of Contents for Bull ESCALA Power7 Series

  • Page 1 Enclosures and expansion units REFERENCE 86 A1 23FF 07...
  • Page 3 - Bull Escala E1-700 (Power 710 / 8231-E2B) - Bull Escala E1-705 (Power 710 / 8231-E1C) - Bull Escala E2-700 / E2-700T (Power 720 / 8202-E4B) - Bull Escala E2-705 / E2-705T (Power 720 / 8202-E4C) - Bull Escala E3-700 (Power 730 / 8231-E2B)
  • Page 4 Quoting of brand and product names is for information purposes only and does not represent trademark misuse. The information in this document is subject to change without notice. Bull will not be liable for errors contained herein, or for incidental or consequential damages in connection with the use of this material.

  • Page 5: Table Of Contents

    Contents Safety notices ....... . . v I/O expansion units ....... 1 Overview for I/O expansion units .
  • Page 6 Verifying the PCIe hardware topology without an HMC . . 91 Verifying that the PCIe storage enclosure is functioning . 93 Checking for new serviceable events . . 94 Using identify indicators to locate hardware components . . 95 Configuring your PCIe storage enclosures . .

  • Page 7: Safety Notices

    Safety notices Safety notices may be printed throughout this guide. v DANGER notices call attention to a situation that is potentially lethal or extremely hazardous to people. v CAUTION notices call attention to a situation that is potentially hazardous to people because of some existing condition.
  • Page 8 DANGER When working on or around the system, observe the following precautions: Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: v Connect power to this unit only with the provided power cord. Do not use the provided power cord for any other product.
  • Page 9 Observe the following precautions when working on or around your IT rack system: v Heavy equipment–personal injury or equipment damage might result if mishandled. v Always lower the leveling pads on the rack cabinet. v Always install stabilizer brackets on the rack cabinet. v To avoid hazardous conditions due to uneven mechanical loading, always install the heaviest devices in the bottom of the rack cabinet.
  • Page 10 CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building: v Reduce the weight of the rack cabinet by removing equipment starting at the top of the rack cabinet.
  • Page 11 (L003) All lasers are certified in the U.S. to conform to the requirements of DHHS 21 CFR Subchapter J for class 1 laser products. Outside the U.S., they are certified to be in compliance with IEC 60825 as a class 1 laser product.
  • Page 12 CAUTION: Data processing environments can contain equipment transmitting on system links with laser modules that operate at greater than Class 1 power levels. For this reason, never look into the end of an optical fiber cable or open receptacle. (C027) CAUTION: This product contains a Class 1M laser.

  • Page 13: I/O Expansion Units

    I/O expansion units Use this information to learn about connecting and configuring input/output (I/O) expansion units to system units. Overview for I/O expansion units Input/output expansion units provide additional I/O slots. Some I/O expansion units also provide additional disk and removable media slots. Input/output (I/O) expansion units are connected to system units with 12X cables and system power control network (SPCN) cables.

  • Page 14: Preparing To Connect Your Expansion Units

    adapters must be done separately from installing expansion units. Depending on your configuration, it might be necessary to power off the system to install the GX adapters. v Expansion units cannot be moved or relocated concurrently. If existing expansion units must be relocated in the configuration to add the new expansion units, complete the following tasks: 1.

  • Page 15: Where To Install A New Expansion Unit

    Where to install a new expansion unit Before you begin the installation process, plan where to install the new expansion units. When deciding where to install a new expansion unit, consider several elements that include size, security, and environmental factors. For more information, see Site preparation and physical planning (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7ebe/ p7ebegenconsiderations.htm).

  • Page 16: Expansion Unit Configuration Rules

    Table 2. 12X DDR cables Cable feature Length Part number Additional information 1828 1.5 m (4.9 ft.) 45D2235 12X to 4X channel conversion adapter used for clustering 1841 3.0 m (9.8 ft.) 45D2236 12X to 4X channel conversion cable used for clustering 1842 10.0 m (32.8 ft.)
  • Page 17 The following table specifies configuration limitations related to 12X loops. Table 4. 12X loop configuration limitations Machine type and Supported expansion Maximum number of Maximum number of Maximum number of model units loops expansion units per supported expansion loop units 02E/4B Maximum number of 14G/30...
  • Page 18 Table 4. 12X loop configuration limitations (continued) Machine type and Supported expansion Maximum number of Maximum number of Maximum number of model units loops expansion units per supported expansion loop units 17M/MB The maximum 14G/30 14G/30 = 4 14G/30 = 32 number of loops is 58/02 58/02 = 2...
  • Page 19 Table 4. 12X loop configuration limitations (continued) Machine type and Supported expansion Maximum number of Maximum number of Maximum number of model units loops expansion units per supported expansion loop units 19F/HB The maximum 57/98 57/98 = 1 57/98 = 32 number of loops is 58/03 58/03 = 1...

  • Page 20: Connecting Your Expansion Units

    Table 4. 12X loop configuration limitations (continued) Machine type and Supported expansion Maximum number of Maximum number of Maximum number of model units loops expansion units per supported expansion loop units 79M/HD The maximum 14G/30 14G/30 = 4 14G/30 = 32 number of loops is 58/02 58/02 = 2...
  • Page 21 v If your system is managed by a Hardware Management Console (HMC) or Systems Director Management Console (SDMC), see Verifying the 12X loops with an HMC or SDMC (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7ham/ ipham_verifyriohslloopwhmc.htm). One of the steps in that task is to verify the status of the links in the 12X loops.
  • Page 22 6. To connect the expansion units with 12X cables, see Connecting expansion units with 12X cables (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7ham/direct.htm). Note: If you are installing expansion units in an existing 12X loop with the system powered on, serviceable events and informational logs might be generated when you disconnect and reconnect cables.
  • Page 23 12. Verify that the Power Control Network Identifier value is set correctly for the expansion units you are adding by completing the following steps: a. Access the ASMI by using an authority level of administrator or authorized service provider. For details about using the ASMI, see Managing the Advanced System Management Interface (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7hby/asmi.htm).
  • Page 24 2) Click Service and Support Manager > Serviceable Problems. 3) Continue with step 14b. v If your system is not managed by an HMC or SDMC and has a partition running the Virtual I/O Server (VIOS) operating system, perform the following steps: 1) Log in as the padmin user.

  • Page 25: Connecting Expansion Units With 12X Cables

    17. Verify the new configuration. For details, see Verifying that the new configuration is functioning (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7ham/verify.htm). 18. If the system has logical partitions, you can now assign I/O slots in the expansion units that were added to logical partitions. You have completed the addition of your expansion unit. Connecting expansion units with 12X cables These instructions explain how to connect expansion units to a system unit with 12X cables in either a new or existing loop.

  • Page 26: Adding Expansion Units To An Existing 12X Loop

    9. Return to the procedure that sent you here. Adding expansion units to an existing 12X loop Use this procedure to place the system in standby mode and to add expansion units to an existing 12X loop. Before you begin Unused 12X connectors might be covered with metal clips.
  • Page 27 If your system is managed by an Systems Director Management Console (SDMC) complete the following steps to power on the system to firmware standby state: 1. On the Welcome page, under the Resources tab, select the server. 2. Complete the following steps to enable the server to power on to the firmware standby state: a.

  • Page 28: Examples: 12X Connections

    v To add the expansion units to the beginning of the loop, go to step 5. v To add the expansion units to the middle of the loop, go to step 6. v To add the expansion units to the end of the loop, go to step 7. 5.

  • Page 29: Connecting Expansion Units With Spcn Cables

    Figure 1. Example of a server that has one GX adapter connected to two expansion units 2. Connect a server to four expansion units using two GX adapters, wheret each adapter connects to two expansion units, as shown in the following figure. Figure 2.
  • Page 30 Important: As noted in “Overview for I/O expansion units” on page 1, there is only one SPCN loop per system to which all expansion units are connected. Procedure 1. Choose from the following options: v To add expansion units when there is not already an SPCN loop, go to step 2. v To add expansion units to the beginning of an existing SPCN loop, go to step 3.

  • Page 31: Examples: Spcn Connections

    To add expansion units to the end of an existing SPCN loop, do the following: a. Move the SPCN cable from connector SPCN 1 on the system unit to connector SPCN 0 on one of the expansion units to be added. b.

  • Page 32: Verifying That The New Configuration Is Functioning

    Figure 4. Example of SPCN connections Verifying that the new configuration is functioning Use this procedure to verify that your system lists the expansion units in your configuration and that the expansion units are functioning correctly. About this task 1. Choose from the following options: v If your system is managed by an HMC or SDMC, continue with step 2.

  • Page 33: Verifying The 12X Loops With An Hmc Or Sdmc

    c) Click Actions > Properties. d) Click the Inventory tab. b. Verify that the new expansion units are displayed in the list. It might take several minutes for the new expansion units to be displayed in the list. Tip: To refresh the list of expansion units, choose a system console option: v For the HMC option, repeat steps 3a1b on page 20 and 3a1c on page 20.

  • Page 34: Verifying The System Power Control Network

    b. Scan for any serviceable events that include B70069xx reference codes, and perform one of the following actions: v If there are no serviceable events that include B70069xx reference codes, close the Reference Code History window. v If there are serviceable events that include B70069xx reference codes, there might be problems with the 12X loops.
  • Page 35 v If your system is running the Virtual I/O Server (VIOS) operating system, continue with step 5. v If your system is running the AIX operating system, continue with step 6 on page 24. v If your system is running the Linux operating system, continue with step 7 on page 24. 3.
  • Page 36 v If there are no problems with 10009xxx reference codes, press Enter to return to the command line. v If there are problems with 10009xxx reference codes, there might be problems with the SPCN loop. Perform problem analysis on the problems to correct them before continuing. If you need assistance, contact your service provider.
  • Page 37 Important: If you are here because the procedure to concurrently add expansion units instructed you to perform this task following steps to connect the power cables and power on the expansion units, do not perform the following steps to clear the inactive enclosures. Contact your service provider for assistance.

  • Page 38: Setting I/O Enclosure Configuration Id And Mtms Value

    – If the system is managed by an SDMC, click Service and Support > Hardware > Power On/Off Unit to perform this task. – If the system is not managed by an HMC or SDMC, you must choose one of the other options in this list.
  • Page 39 4. If you were directed here from a part replacement procedure, you must restore information that was contained in the nonvolatile storage of the original part. The expansion unit MTMS must be restored, and you might also be required to set or change the configuration ID (power control network identifier).
  • Page 40 Notes: v Do not disconnect the power cables after powering off the expansion unit. v If the expansion unit does not display immediately on the service utility that is used to power off the expansion unit, refresh the utility periodically for up to 10 minutes. If the expansion unit does not display during this timeframe, go to step 1 on page 26 and repeat this procedure.

  • Page 41: Updating The Spcn Firmware

    Updating the SPCN firmware If a system power control network (SPCN) firmware update is required but is not started automatically due to the current SPCN firmware update policy, the SPCN firmware update must be started manually. About this task Notes: v Do not perform maintenance on an expansion unit or change the SPCN network while the SPCN firmware update is being performed.

  • Page 42: Cabling The 58/02 Disk Subsystem

    v The hard-disk-drive partitions switch is located at the rear of the 58/02 expansion unit, just below the SAS connectors. v If the hard-disk-drive partitions switch position is changed, you must power the 58/02 expansion unit off and on in order for the 58/02 to sense the new position of the hard-disk-drive partitions switch.
  • Page 43 About this task Use this procedure to cable the disk subsystem in the 58/02 expansion unit: 1. To select a cabling configuration that suits your requirements, see the following table. 2. Cable the disk subsystem in the 58/02 expansion unit. Note: For SAS cable information, see Serial-attached SCSI cable planning (http:// publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7had/p7hadsascabling.htm).
  • Page 44 Table 6. Configuration requirements of the 5802 disk subsystem (continued) Configuration features Configuration requirements For related physical cabling, see Figure 9 on page 34. Two hard-disk-drive partitions with nine disks per hard-disk-drive partition and four SAS adapters (two Operating system: AIX, , Linux pairs of SAS adapters, each running a set of nine disk SAS adapter: Either four (FC 5901) - PCIe Dual - x4 drives).
  • Page 45 Figure 5. Physical cabling example: Two hard-disk-drive partitions with nine disks per hard-disk-drive partition, dual SAS adapters, and hard-disk-drive partitions switch position 2 Figure 6. Physical cabling example: One hard-disk-drive partition with 18 disks, a single SAS adapter, and hard-disk-drive partitions switch position 1 Figure 7.
  • Page 46 Figure 8. Physical cabling example: Two hard-disk-drive partitions with nine disks per hard-disk-drive partition, two SAS adapters, and hard-disk-drive partitions switch position 2 Figure 9. Physical cabling example: Two hard-disk-drive partitions with nine disks per hard-disk-drive partition, four SAS adapters, and hard-disk-drive partitions switch position 2 Figure 10.

  • Page 47: Removing Your Expansion Units

    Figure 11. Physical cabling example: Four hard-disk-drive partitions with four or five disks per hard-disk-drive partition and hard-disk-drive partitions switch position 4 3. Set the hard-disk-drive partitions switch to the correct position for your cabling configuration by using the table in this section. The hard-disk-drive partitions switch is located at the rear of the 58/02 expansion unit, just below the SAS connectors.
  • Page 48 About this task Important: Be aware of the following items when you are removing an expansion unit: v Concurrent I/O expansion unit removal is supported only for 12X-attached I/O expansion units. v Concurrent I/O expansion unit removal is supported only on systems that are managed by a Hardware Management Console (HMC).
  • Page 49 10. Perform the following steps: a. Remove the SPCN cable between the SPCN 0 connector on the expansion unit that is to be removed and the corresponding connector on the preceding unit on the SPCN loop. Note: The preceding unit on the SPCN loop might be another expansion unit or a system unit. b.

  • Page 50: Removing An Expansion Unit Nonconcurrently

    3) Select Actions > Operations > Launch Advanced Systems Management (ASM). b. Log in to ASMI with administrator or authorized service provider authority. c. Expand System Configuration. d. Click Configure I/O Enclosures > Clear inactive enclosures. 16. Repeat step 1 on page 36 to verify the 12X configuration. Note: While concurrently removing an expansion unit, it is normal for error logs and event logs to be created with the following reference codes.
  • Page 51 v Before performing any procedure that involves changes to the 12X cabling or configuration for a system that is managed by an HMC, obtain a record that identifies for each expansion unit which I/O buses exist in that expansion unit. To acquire this information, use one of the following methods: –...
  • Page 52 b. Disconnect the 12X cable from connector 1 on the expansion unit to be removed. Attach that end to the connector on the preceding unit on the 12X loop that was opened in step 8a on page 39. c. Continue with step 9. 9.

  • Page 53: Disk Drive Enclosures

    Disk drive enclosures Use this information to learn about the cabling, SCSI addressing, and postconnection requirements for the disk drive enclosure. Overview for disk drive enclosures The disk drive subsystem is the portion of the enclosure that houses and controls the disk drives. The following connector information pertains to the systems and disk drive enclosures that are configured in this topic: 1.
  • Page 54 About this task To connect the 31D/24, or 31T/24 to a system that has an AIX operating system, perform the following steps: Procedure 1. Install the initiator repeater cards into the disk drive enclosure. For instructions, see “SCSI repeater card” on page 53. 2.

  • Page 55: Connecting And Configuring The 31D/24, Or 31T/24 Scsi Disk Drive Enclosure In An Aix Clustered

    Figure 13. SCSI cable to a dual repeater card that is connected with two SCSI cards v Four SCSI adapters connected to dual repeater cards: If, in this case, you are sharing resources (disk drives) between systems or logical partitions, ensure that you understand the SCSI addressing and cabling order.

  • Page 56: Connecting And Configuring The 31D/24, Or 31T/24 Scsi Disk Drive Enclosure In An Aix Clustered

    understand the SCSI addressing and cabling order. For more information, see “Connecting and configuring the 31D/24, or 31T/24 SCSI disk drive enclosure in an AIX clustered environment” on page 45. Figure 15. SCSI cable to a dual repeater card that is connected to a single repeater card 3.

  • Page 57: Connecting And Configuring The 31D/24, Or 31T/24 Scsi Disk Drive Enclosure In An Aix Clustered Environment

    If the system to which the enclosure is attached has a Hardware Management Console (HMC), or a ™ Systems Director Management Console (SDMC), or is running the Electronic Service Agent application, create a file named run_ses_healthcheck in the /usr/lpp/diagnostics/bin directory, with the following contents: ------------------------------------------------------------------ #!/bin/ksh...
  • Page 58 Before you begin Gather and have available any planning and cabling documentation that you have for the system to which you are connecting in a clustered environment so that you can refer to it during this procedure. About this task To assure that the SCSI disk drive enclosure is ready to be connected to the cluster, complete the following steps: Procedure...

  • Page 59: Connecting And Configuring The Disk Drive Enclosure In A System Running Linux

    Figure 16. SCSI cable to a dual repeater card that is connected with two SCSI cards 4. Cable the first SCSI bus or set of shared disks by performing the following steps: a. Connect the bottom port of the adapter on Host A (SCSI address 7) to the exterior port on the repeater card in slot C2 on the enclosure.
  • Page 60 About this task To connect and configure the disk drive enclosure in a system that has a Linux operating system, perform the following steps: Procedure 1. Install the initiator repeater cards into the disk drive enclosure. For instructions, see SCSI repeater cardSCSI repeater card.
  • Page 61 Figure 18. SCSI cable to a dual repeater card that is connected with two SCSI cards Figure 19. SCSI cable to a dual repeater card that is connected with four SCSI cards v If you are using a combination of single and dual repeater cards, connect a SCSI cable to the dual-initiator repeater card (A).
  • Page 62 Figure 20. SCSI cable to a dual repeater card that is connected to a single repeater card 3. Complete the SCSI cable connection process in this step. Important: The SCSI adapter or the system or partition must be powered off before making the connection in this step.

  • Page 63: Connecting And Configuring The Enclosure In A System Running

    Important: If you plan on using the disk enclosure in a Linux environment, it is critical that you set up a Linux CRON job so that if errors exist, they are reported to the attached system. The Linux CRON job must be set up during the initial installation. 5.
  • Page 64 Procedure 1. Install the initiator repeater cards into the disk drive enclosure. For instructions, see “SCSI repeater card” on page 53. 2. Connect the SCSI cable to your repeater card. Choose one of the following options based on your situation: Tip: Ensure that the cable length for connections across the enclosure are long enough to allow concurrent maintenance of disk drives.

  • Page 65: Scsi Repeater Card

    Figure 23. SCSI cable to a dual repeater card that is connected to a single repeater card 3. Complete the SCSI cable connection process in this step. Important: The SCSI adapter or the system or partition must be powered off before making the connection in this step.
  • Page 66 Use the following figures and instructions to place your repeater cards. Figure 25. Repeater card location of the and 31D/24 SCSI disk drive enclosure (drawer models) Enclosures and expansion units...
  • Page 67 Figure 26. Repeater card location of the and 31T/24 SCSI disk drive enclosure (deskside models) If you only have dual repeater cards, place them as follows: Important: On deskside models, the locations C3 and C5 are located on top, and C2 and C4 are located on the bottom.
  • Page 68 Table 7. Repeater card placement for single and dual style repeater cards (continued) Type and number of repeater cards Single repeater card placement Dual repeater card placement 2 single repeater cards and 1 dual Place in C5, C2, and then place dual repeater cards repeater card 2 single repeater cards and 2 dual...

  • Page 69: 58/86 Sas Disk Drive Enclosure

    Figure 28. Back view of 31D/24, or 31T/24 SCSI disk drive enclosure The following list describes how the repeater card locations affect the disk drive slots. v The top-left repeater card (C2) drives the front right six slots (D07 to D12). See Figure 27 on page 56. v The top-right repeater card (C3) drives the front left six slots (D01 to D06).

  • Page 70: Connecting The Sas Adapter To The 58/86 Disk Drive Enclosure

    RAID 10 Minimum of two drives per array Connecting the SAS adapter to the 58/86 disk drive enclosure Learn how to connect the 58/86 disk drive enclosure About this task To connect the 58/86 disk drive enclosure to one or more Serial-attached SCSI (SAS) adapters or to a system with support for a SAS drawer, complete the following steps.
  • Page 71 v To perform a connection of two 58/86 disk drive enclosures to a single SAS adapter by using YO cables, where each enclosure can be attached to an additional 58/86 disk drive enclosure by using an EE cable, go to step 6. v To perform a connection of two 58/86 disk drive enclosures to a SAS adapter pair by using X cables, where each enclosure can be attached to an additional 58/86 disk drive enclosure by using an EE cable, go to step 7 on page 60.
  • Page 72 Figure 30. Connection of two 58/86 disk drive enclosures to a single SAS adapter by using YO cables, where each enclosure can be attached to an additional 58/86 disk drive enclosure by using two EE cables Go to step 9 on page 62. 7.
  • Page 73 Figure 31. Connection of two 58/86 disk drive enclosures to a SAS adapter pair by using X cables, where each enclosure can be attached to an additional 58/86 disk drive enclosure by using two EE cables Go to step 9 on page 62. 8.

  • Page 74: 58/87 Sas Disk Drive Enclosure

    Figure 32. Connection of one 58/86 disk drive enclosure by using a YI cable to a system with support for a single SAS drawer Go to step 9. 9. For additional information to plan or complete your SAS cable installation, see Serial-attached SCSI cable planning (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7had/ p7hadsascabling.htm).

  • Page 75: Connecting The Sas Adapter To The 58/87 Disk Drive Enclosure

    Tip: If you are planning to configure RAID arrays, ensure that you have the minimum number of available disks for each RAID level: RAID 0 Minimum of one drive per array RAID 5 Minimum of three drives per array RAID 6 Minimum of four drives per array RAID 10 Minimum of two drives per array...
  • Page 76 a. Unconfigure the two internal RAID controllers in the PCIe storage enclosure. b. Connect the SAS cables from the the 5887 disk drive enclosure to the PCIe storage enclosure. c. Reconfigure the internal RAID controllers in the PCIe storage enclosure. –...
  • Page 77 v For installing the external SAS port on the 7/10 (31E/2B and 31E/1C) or 7/30 (31E/2B and 31E/2C), see Installing the external SAS port on an 8231-E2B, 8231-E1C, or 8231-E2C (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7hal/ installsasport_72x_74x.htm). v For installing the external SAS port on the 7/20 (02E/4B and 02E/4C) or 7/40 (05F/6B and 05E/6C), see Installing the external SAS port on an 8202-E4B, 8202-E4C, 8205-E6B, or 8205-E6C system (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7hal/ installsasport_72x_74x.htm).
  • Page 78 v To perform a mode 4 connection of one 58/87 disk drive enclosure by using X cables to four independent SAS adapters, go to step 17 on page 73. If your SAS configuration requirements are not supported by any of these options, go to step 18 on page 75.
  • Page 79 Figure 35. Mode 1 connection of one 58/87 disk drive enclosure by using a YO cable to a single SAS adapter Go to step 18 on page 75. 10. Perform the mode 1 connection of two 58/87 disk drive enclosures (A and B) by using YO cables (C and D) to a single SAS adapter (E) as shown in Figure 36 on page 68.
  • Page 80 Figure 36. Mode 1 connection of two 58/87 disk drive enclosures by using YO cables to a single SAS adapter Go to step 18 on page 75. 11. Perform the mode 1 connection of one 58/87 disk drive enclosure (A) by using YO cables (B) to a SAS adapter pair (C) as shown in Figure 37 on page 69.
  • Page 81 Figure 37. Mode 1 connection of one 58/87 disk drive enclosure by using YO cables to a SAS adapter pair Go to step 18 on page 75. 12. Perform the mode 1 connection of two 58/87 disk drive enclosures (A and B) by using YO cables (C and D) to a SAS adapter pair (E) as shown in Figure 38 on page 70.
  • Page 82 Figure 38. Mode 1 connection of two 58/87 disk drive enclosures by using YO cables to a SAS adapter pair Go to step 18 on page 75. 13. Perform the mode 1 connection of one 58/87 disk drive enclosure (B) by using EX cables (C) to a PCIe storage enclosure with support for SAS disk drawers (A) as shown in Figure 39.
  • Page 83 Go to step 18 on page 75. 14. Perform the mode 1 connection of two 58/87 disk drive enclosures (B) by using EX cables (C) to a PCIe storage enclosure with support for SAS disk drawers (A) as shown in Figure 40. Notes: v Each internal adapter in the PCIe storage enclosure (A) has access to the other adapter and to all disk drive bays.
  • Page 84 Figure 41. Mode 2 connection of one 58/87 disk drive enclosure by using YO cables to two independent SAS adapters Go to step 18 on page 75. 16. Perform the mode 2 connection of one 58/87 disk drive enclosure (A) by using X cables (B) to two SAS adapter pairs as shown in Figure 42 on page 73.
  • Page 85 Figure 42. Mode 2 connection of one 58/87 disk drive enclosure by using X cables to two SAS adapter pairs Go to step 18 on page 75. 17. Perform the mode 4 connection of one 58/87 disk drive enclosure (A) by using X cables (B) to four independent SAS adapters as shown in Figure 43 on page 74.
  • Page 86 Figure 43. Mode 4 connection of one 58/87 disk drive enclosure by using X cables to four independent SAS adapters Figure 44. Labels for SAS adapter cables showing P1 and P2 identifiers Go to step 18 on page 75. Enclosures and expansion units...

  • Page 87: Removing Your Disk Drive Enclosures

    18. For additional information to plan or complete your SAS cable installation, see Serial-attached SCSI cable planning (http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/p7had/ p7hadsascabling.htm). Remember: v Connect power cables and apply power to the 58/87 disk drive enclosure. v Power on the system, partition, or reconfigure the adapters depending what option you chose in the beginning of this procedure.
  • Page 88 Enclosures and expansion units...

  • Page 89: Pcie Storage Enclosures

    PCIe storage enclosures Use this information to learn about connecting and configuring PCI Express (PCIe) storage enclosures to system units. Overview for PCIe storage enclosures PCI Express (PCIe) storage enclosures provide additional storage capacity to the system in the form of hard disk drives (HDDs) or solid-state drives (SSDs).

  • Page 90: Preparing To Connect Your Pcie Storage Enclosures

    Related reference: “Connecting PCIe storage enclosures with PCIe cables” on page 87 Learn how PCIe cables are used to connect PCIe storage enclosures to servers. Preparing to connect your PCIe storage enclosures Use this information to plan the installation and configuration of your PCI Express (PCIe) storage enclosures.

  • Page 91: Pcie Storage Enclosure Configuration Rules

    Table 8. PCIe cables PCIe storage Cable feature Part number Length Systems supported enclosures supported EN05 46K3769 1.5 m (4.9 ft.) 8231-E1C 5888 8231-E2C EDR1 8202-E4C 8205-E6C EN07 46K3770 3.0 m (9.8 ft.) 8231-E1C 5888 8231-E2C EDR1 8202-E4C 8205-E6C EN08 41U8581 8.0 m (26.2 ft.) 9117-MMD...

  • Page 92: Connecting A Pcie Storage Enclosure

    Table 9. PCIe storage enclosures limits (continued) Machine type and model Supported PCIe storage Maximum number of PCIe Maximum number of PCIe enclosures GX++ adapters storage enclosures 9117-MMC EDR1 The maximum number of The maximum number of PCIe GX++ adapters is PCIe storage enclosures is 9179-MHC equal to two PCIe GX++...
  • Page 93 v Steps in this topic require you to have connector information for the hardware in your configuration. For details about PCIe storage enclosure or system connector locations, see “Connector locations” on page 115. About this task To add a PCIe storage enclosure to the system with the system powered on, complete the following steps: 1.
  • Page 94 Managing the Advanced System Management Interface (http://publib.boulder.ibm.com/ infocenter/systems/scope/hw/topic/p7hby/asmi.htm). 2) In the ASMI navigation area, expand System Configuration. 3) Click PCIe Hardware Topology. c. Scan the PCIe Hardware Topology data for entries with Host Port column values that match the location codes of the PCIe GX++ adapter connectors that you connected PCIe cables to in step 5 on page 81.
  • Page 95 Important: The PCIe storage enclosure usually requires no more than 5 minutes to power on and initialize. If any of the LED states previously described cannot be verified after 5 minutes have elapsed, there could be problems with the PCIe storage enclosure. Verify that the power cords are securely connected to the power supplies and the power source.
  • Page 96 k. If you have another I/O slot to power on, return to step 10 on page 83. Otherwise, continue with step 15 on page 85. 12. Complete the following steps: a. Log in to the operating system with admin or service level authority. If you need assistance, contact the system administrator.
  • Page 97 3) Select the server you are working with. 4) In the Tasks area, expand Hardware Information. 5) Click PCIe Hardware Topology. v If your system is not managed by an HMC, complete the following steps: 1) Access the ASMI by using an authority level of administrator or authorized service provider.

  • Page 98: Adding A Pcie Storage Enclosure With The System Powered Off

    partitions, you can now assign them. For information about adding I/O slots to partitions dynamically, see Adding physical I/O devices and slots dynamically (http:// publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphat/iphbldlpariopaddp6.htm). Adding a PCIe storage enclosure with the system powered off Learn how to add a PCIe storage enclosure to the system with the system powered off. Before you begin Prerequisites: If you have not reviewed the information in “Overview for PCIe storage enclosures”...

  • Page 99: Connecting Pcie Storage Enclosures With Pcie Cables

    5. If the system has a rear cover, close it. Important: If the PCIe storage enclosure is connected to two systems, complete this step for each system. 6. If the power cords for the PCIe storage enclosure are not connected to the power source, connect them now.
  • Page 100 Figure 45. Example of a server that has one PCIe GX++ adapter connected to a single storage enclosure 2. Connect a server that has two PCIe GX++ adapters to two storage enclosures, as shown in the following figure. Figure 46. Example of a server that has two PCIe GX++ adapters connected to two storage enclosures 3.
  • Page 101 4. Connect a server that has two PCIe GX++ adapters to two storage enclosures for high availability, as shown in the following figure. Figure 48. Example of a server that has two PCIe GX++ adapters connected to two storage enclosures for high availability 5.

  • Page 102: Verifying The Pcie Hardware Topology

    Figure 50. Example of two processor drawers, each with a PCIe GX++ adapter, connected to a single storage enclosure for high availability Verifying the PCIe hardware topology Learn how to verify that the PCIe links in the system are functioning properly. About this task The functioning of PCIe links can be verified in systems that are managed by a Hardware Management Console (HMC) and in systems that are not managed by an HMC.

  • Page 103: Verifying The Pcie Hardware Topology Without An Hmc

    v If any serviceable events include B7006Axx reference codes, there might be problems with the PCIe hardware topology. Perform problem analysis on the serviceable events to correct the problems before continuing. If you need assistance, contact your service provider. 2. Verify the status of the PCIe links by completing the following steps: a.
  • Page 104 v If there are problems that have B7006Axx reference codes, there might be problems with the PCIe hardware topology. Perform problem analysis to correct the problems before continuing. If you need assistance, contact your service provider. f. Go to step 5. 3.

  • Page 105: Verifying That The Pcie Storage Enclosure Is Functioning

    Verifying that the PCIe storage enclosure is functioning Use this procedure to verify that a PCIe storage enclosure is functioning and is recognized by the system. About this task Prerequisite: To use this procedure, the PCIe storage enclosure must have power, must be connected to the system, and the system must be powered on.

  • Page 106: Checking For New Serviceable Events

    2) When the system does not recognize the PCIe storage enclosure, the value in the Description column is Empty slot, Unknown, or PCI-to-PCI bridge. To ensure that the PCIe storage enclosure has been connected correctly, complete the following steps: Verify that the PCIe cables are connected to the system and to the PCIe storage enclosure. If you find an incorrect connection at either end, connect the cables correctly.

  • Page 107: Using Identify Indicators To Locate Hardware Components

    b. Type diag -d sysplanar0 -E xx, where xx is a number 1 - 60 that specifies the number of days, and press Enter. This command returns results for the most recent number of days specified. Specify a value that includes the time period during which the procedure was performed. c.

  • Page 108: Configuring Your Pcie Storage Enclosures

    Configuring your PCIe storage enclosures Read information that has been provided for configuring PCIe storage enclosure models. About this task Configuring the 58/88 PCIe storage enclosure Learn how to configure the 58/88 PCIe storage enclosure. 1. Review the following information: The 58/88 PCIe storage enclosure can hold up to 30 solid state drives (SSDs).
  • Page 109 Figure 51. Connection of two 58/87 disk drive enclosures by using EX cables to a PCIe storage enclosure For detailed information about cabling a 58/87 disk drive enclosure to the ED/R1 PCIe storage enclosure, see Serial-attached SCSI cable planning (http://publib.boulder.ibm.com/infocenter/ systems/scope/hw/topic/p7had/p7hadsascabling.htm).

  • Page 110: Removing A Pcie Storage Enclosure

    Best performance is achieved when the access characteristics on each disk array have a balanced workload. This happens when the two controllers have an equal number of disk arrays with active paths to the disk units. For additional SAS RAID controller information for the AIX operating system, see SAS RAID controller for AIX.
  • Page 111 3. Verify the existing PCIe hardware topology by completing the steps in “Verifying the PCIe hardware topology” on page 90. All PCIe hardware topology problems that are discovered in this step must be corrected before continuing with this procedure. Important: If the PCIe storage enclosure is connected to two systems, complete this step for each system.
  • Page 112 a. If the I/O slot is assigned to a logical partition that is powered on, complete the following steps to dynamically remove the I/O slot from the running logical partition: 1) From the navigation bar, expand Systems Management. 2) Click Servers. 3) Select the server you are working with.
  • Page 113 g. On the PCI Hot Plug Manager display, use the arrow keys to select List PCI Hot Plug Slots, and press Enter. h. On the COMMAND STATUS display, locate the entry with the identifier string of the I/O slot in the Slot column, and record the logical device name in the Devices column.
  • Page 114 Note: Specifying option 3 starts the Hardware Resource Concurrent Maintenance menu for the selected packaging hardware resource. k. On the Hardware Resource Concurrent Maintenance display, start the Power off domain function by pressing F9. l. Follow the online instructions to complete the power-off operation. m.

  • Page 115: Removing A Pcie Storage Enclosure With The System Powered Off

    d. Deactivate the identify indicators by repeating step 11a on page 102, except to click Deactivate LED in step 11a3 on page 102 rather than Activate LED. 12. Remove power from the PCIe storage enclosure by disconnecting the power cables from the power supplies on the PCIe storage enclosure.
  • Page 116 Before you begin Note: Depending on the feature of the PCIe storage enclosure that you are working with, you might be able to remove it from the system with the system powered on and the logical partitions active. To learn which options you have for removing your PCIe storage enclosure from the system, review the following information: v If you are removing a 58/88 PCIe storage enclosure, you must use this procedure to remove the...
  • Page 117 3) Click PCIe Hardware Topology. b. Review the PCIe Hardware Topology data to identify all PCIe links that are associated with the PCIe storage enclosure that you are removing. To make this identification, scan the I/O Enclosure Port column for values that contain the feature code and serial number that you recorded in step 1 on page 104.
  • Page 118 Important: If the PCIe storage enclosure is connected to two systems, complete this step for each system. 13. Check for and handle new serviceable events that were generated during the procedure by completing the steps in “Checking for new serviceable events” on page 94. Use the date and time information that you recorded in step 10 on page 105 as the start time for searching for new serviceable events.

  • Page 119: Reference Information

    Reference information Use information in this section as needed to complete enclosure installation and configuration tasks. Common procedures These procedures are used throughout the topic. Starting the system or logical partition Learn how to start a system or logical partition after performing a service action or system upgrade. Starting a system that is not managed by a HMC or an SDMC You can use the power button or the Advanced System Management Interface (ASMI) to start a system that is not managed by a Hardware Management Console (HMC) or an Systems Director Management...
  • Page 120 Figure 52. Control panel v A: Power-on button v B: Power LED – A constant light indicates full system power to the unit. – A flashing light indicates standby power to the unit. Note: There is approximately a 30-second transition period from the time the power-on button is pressed to when the power LED goes from flashing to solid.

  • Page 121: Starting A System Or Logical Partition By Using The Hmc

    v The system cooling fans are activated after approximately 30 seconds and begin to accelerate to operating speed. v Progress indicators, also referred to as checkpoints, appear on the control panel display while the system is being started. The power-on light on the control panel stops flashing and remains on, indicating that the system power is on.
  • Page 122 About this task The following procedure describes how to stop a system that is not managed by the HMC or the SDMC. Procedure 1. Log in to the system as a user with the authority to run the shutdown or pwrdwnsys (Power Down System) command.

  • Page 123: Stopping A System By Using The Hmc

    Stopping a system by using the HMC You can use the Hardware Management Console (HMC) to stop the system or a logical partition. About this task By default, the managed system is set to power off automatically when you shut down the last running logical partition on the managed system.

  • Page 124: Removing An Enclosure From The Rack

    Related information: Shutting down and restarting logical partitions Removing an enclosure from the rack This procedure provides you with general steps to help you physically remove an enclosure that is mounted in a rack. Because methods for the attachment of enclosures to a rack vary by model, this procedure provides only conceptual removal steps.
  • Page 125 4. Disconnect the enclosure from all devices and power as follows: a. At the rear of the enclosure, disconnect power cords, any I/O bus cables connecting the enclosure to adapters, and other cables that might be present. b. At the front of the enclosure, disconnect any UPIC cables and other cables that might be present. 5.
  • Page 126 b. If you do not have the original rail-mounting guides and screws that were used during the installation of the enclosure, complete the following steps: 1) Position three people at the front and sides of the enclosure to bear its weight and hold it steady during the removal of weight-bearing screws.

  • Page 127: Connector Locations

    14. Store all enclosure mounting hardware, brackets, bezels, and the shell for future use. Connector locations Learn about 12X, system power control network (SPCN), and PCIe connector locations. Server connectors Learn about connector locations for servers. Model 02E/4B connector locations Learn about connector locations on rack-mounted and stand-alone models.

  • Page 128: Model 02E/4C Connector Locations

    Figure 54. Model 02E/4B connector locations on a stand-alone model Model 02E/4C connector locations Learn about connector locations on rack-mounted models. The 02E/4C server provides cable connector locations for the following enclosures: v Support for expansion units, as shown in the following figure, is as follows: –...

  • Page 129: Model 05F/6B Connector Locations

    v Support for disk drive enclosures, as shown in the preceding figure, is as follows: – The server contains a SAS port. v Support for PCIe storage enclosures, as shown in the preceding figure, is as follows: – The card installed in the C1 slot can contain two PCIe cable ports. However, the C1 slot cannot provide both PCIe and 12X DDR cable ports.

  • Page 130: Model 05E/6C Connector Locations

    Model 05E/6C connector locations Learn about connector locations on rack-mounted models. The 05E/6C server provides cable connector locations for the following enclosures: v Support for expansion units, as shown in the following figure, is as follows: – The card installed in the C1 slot can contain two 12X double data rate (DDR) cable ports. However, the C1 slot cannot provide both 12X DDR and PCIe cable ports.

  • Page 131: Model 31E/2C Connector Locations

    Figure 59. Model 31E/1C connections for disk drive enclosures and PCIe storage enclosures v Support for PCIe storage enclosures, as shown in the preceding figure, is as follows: – The card installed in the C1 slot can contain one PCIe cable port. –...

  • Page 132: Model 31E/2B Connector Locations

    Figure 61. Model 31E/2C connections for PCIe storage enclosures Model 31E/2B connector locations Learn about connector locations on rack-mounted models. Figure 62. Model 31E/2B connector locations on a rack-mounted model Model 33E/8B connector locations Learn about connector locations on rack-mounted models. Figure 63.

  • Page 133: Model 17M/Mb Or 79M/Hb Connector Locations

    Model 17M/MB or 79M/HB connector locations Learn about connector locations. Figure 64. Model 17M/MB or 79M/HB connector locations Model 17M/MC, 17M/MD, 79M/HC, or 79M/HD connector locations Learn about connector locations. Figure 65. Model 17M/MC, 17M/MD, 79M/HC, or 79M/HD connector locations Enclosure connectors Learn about connector locations for I/O enclosures.

  • Page 134: Model 57/96 Or 14G/30 Connector Locations

    Model 57/96 or 14G/30 connector locations Learn about connector locations. Figure 66. Model 57/96 or 14G/30 connector locations Model 58/02 and 58/77 connector locations Learn about connector locations. Figure 67. Model 58/02 and 58/77 connector locations Enclosures and expansion units...

  • Page 135: Model 58/86 Connector Locations

    Model 58/86 connector locations Learn about connector locations. Figure 68. Model 58/86 connector locations Model 58/87 connector locations Learn about connector locations. Figure 69. Model 58/87 connector locations Model 58/88 connector locations Learn about connector locations. Figure 70. Model 58/88 connector locations Reference information...

  • Page 136: Model Ed/R1 Connector Locations

    Model ED/R1 connector locations Learn about connector locations. Figure 71. Model ED/R1 connector locations Enclosures and expansion units...

  • Page 137: Notices

    Notices This information was developed for products and services offered in the U.S.A. The manufacturer may not offer the products, services, or features discussed in this document in other countries. Consult the manufacturer's representative for information on the products and services currently available in your area.

  • Page 138: Trademarks

    This information is for planning purposes only. The information herein is subject to change before the products described become available. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products.
  • Page 139 equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense. Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits.
  • Page 140 Japanese Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guideline (products less than or equal to 20 A per phase) Japanese Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guideline with Modifications (products greater than 20 A per phase) Electromagnetic Interference (EMI) Statement - People's Republic of China Declaration: This is a Class A product.
  • Page 141 Electromagnetic Interference (EMI) Statement - Korea Germany Compliance Statement Deutschsprachiger EU Hinweis: Hinweis für Geräte der Klasse A EU-Richtlinie zur Elektromagnetischen Verträglichkeit Dieses Produkt entspricht den Schutzanforderungen der EU-Richtlinie 2004/108/EG zur Angleichung der Rechtsvorschriften über die elektromagnetische Verträglichkeit in den EU-Mitgliedsstaaten und hält die Grenzwerte der EN 55022 Klasse A ein.

  • Page 142: Class B Notices

    Generelle Informationen: Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 Klasse A. Electromagnetic Interference (EMI) Statement - Russia Class B Notices The following Class B statements apply to features designated as electromagnetic compatibility (EMC) Class B in the feature installation information. Federal Communications Commission (FCC) statement This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to Part 15 of the FCC Rules.
  • Page 143 European Community Compliance Statement This product is in conformity with the protection requirements of EU Council Directive 2004/108/EC on the approximation of the laws of the Member States relating to electromagnetic compatibility. IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a non-recommended modification of the product, including the fitting of non-IBM option cards.

  • Page 144: Terms And Conditions

    Germany Compliance Statement Deutschsprachiger EU Hinweis: Hinweis für Geräte der Klasse B EU-Richtlinie zur Elektromagnetischen Verträglichkeit Dieses Produkt entspricht den Schutzanforderungen der EU-Richtlinie 2004/108/EG zur Angleichung der Rechtsvorschriften über die elektromagnetische Verträglichkeit in den EU-Mitgliedsstaaten und hält die Grenzwerte der EN 55022 Klasse B ein. Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben.
  • Page 145 these publications, or reproduce, distribute or display these publications or any portion thereof outside your enterprise, without the express consent of the manufacturer. Rights: Except as expressly granted in this permission, no other permissions, licenses or rights are granted, either express or implied, to the Publications or any information, data, software or other intellectual property contained therein.
  • Page 146 Enclosures and expansion units...
  • Page 148 Printed in USA...

This manual is also suitable for:

Escala e1-700Escala e1-705Escala e2-700Escala e2-700tEscala e2-705Escala e2-705t ... Show all

Table of Contents