IBM Elastic Storage System 3200 Service Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Storage
  5. Elastic Storage System 3200
  6. Service manual

IBM Elastic Storage System 3200 Service Manual

Hide thumbs Also See for Elastic Storage System 3200:
Table of Contents

Advertisement

Quick Links

Download this manual
IBM Elastic Storage System 3200
6.1.3
Service Guide
IBM
SC27-9862-00

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Elastic Storage System 3200 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for IBM Elastic Storage System 3200

Summary of Contents for IBM Elastic Storage System 3200

  • Page 1 IBM Elastic Storage System 3200 6.1.3 Service Guide SC27-9862-00...
  • Page 2 IBM welcomes your comments; see the topic “How to submit your comments” on page xi. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.

  • Page 3: Table Of Contents

    Figures........................v Tables......................... vii About this information..................ix Who should read this information.......................ix IBM Elastic Storage System information units................... ix Related information.............................ix Conventions used in this information......................x How to submit your comments........................xi Chapter 1. Servicing (customer tasks)..............1 Removing and replacing an NVMe drive - GUI (Commandless)..............

  • Page 5: Figures

    Figures 1. Displaying enclosure front view........................2 2. Displaying drive carrier assembly......................... 2 3. Displaying NVMe drive replacement part..................... 2 4. Displaying physical disks state........................3 5. Unlocking the drive and release latch......................4 6. Removing NVMe drive........................... 4 7. Releasing catch..............................4 8.
  • Page 6 28. Displaying left ear cap front view......................18 29. Replacing left ear cap..........................18 30. Displaying right ear cap front view......................19 31. Replacing right ear cap..........................19 32. Pressing release tab..........................20 33. Securing the enclosure..........................20 34. Displaying IBM brand label location......................20...
  • Page 7 Tables 1. Conventions..............................x 2. IBM Elastic Storage System 3200 power module status LEDs..............14 3. CRU Part Numbers............................31 4. FRU Part Numbers............................31...
  • Page 8 viii...

  • Page 9: About This Information

    This information is intended for administrators of IBM Elastic Storage System (ESS) that includes IBM Spectrum Scale RAID. IBM Elastic Storage System information units IBM Elastic Storage System (ESS) 3200 documentation consists of the following information units. Information unit Type of information Intended users...

  • Page 10: Conventions Used In This Information

    • IBM POWER9 servers, see https://www.ibm.com/docs/en/ess/6.1.0_ent?topic=guide-5105-22e- reference-information. For the latest support information about IBM Spectrum Scale RAID, see the IBM Spectrum Scale RAID FAQ in IBM Documentation. Conventions used in this information Table 1 on page x describes the typographic conventions used in this information. UNIX file name conventions are used throughout this information.

  • Page 11: How To Submit Your Comments

    In the left margin of the document, vertical lines indicate technical changes to the information. How to submit your comments To contact the IBM Spectrum Scale development organization, send your comments to the following email address: scale@us.ibm.com About this information xi...
  • Page 12 IBM Elastic Storage System 3200: Service Guide...

  • Page 13: Chapter 1. Servicing (Customer Tasks)

    When you replace this part, you must follow recommended procedures for handling electrostatic discharge (ESD) sensitive devices. IBM Elastic Storage System 3200 enclosure supports up to 24 U.2 dual ported NVMe SSDs and the drive slots are numbered from 1 through 24 as shown in the following figure.

  • Page 14: Displaying Enclosure Front View

    1. Confirm the failed drive location from the fault drive LED. You can identify the failed drive by the amber fault LED on the drive carrier. If the fault LED is lit on a drive, it is safe to replace the drive. 2 IBM Elastic Storage System 3200: Service Guide...

  • Page 15: Displaying Physical Disks State

    Alternatively, locate unhealthy drives in the management GUI, either from the Storage> Physical Disks page as shown in Figure 4 on page 3, or from the list of events that are available under the Monitoring > Events page. Figure 4. Displaying physical disks state You can also select the Display unhealthy devices option in the Display unhealthy devices >...

  • Page 16: Unlocking The Drive And Release Latch

    Grab the frame beneath the touch point and gently push the drive carrier assembly into the drive bay until the carrier handle engages. c) Press the release handle downward until the release latch connects with the release catch and the drive carrier assembly locks into place. 4 IBM Elastic Storage System 3200: Service Guide...

  • Page 17: Removing And Replacing An Nvme Drive - Cli

    When you replace this part, you must follow recommended procedures for handling electrostatic discharge (ESD) sensitive devices. IBM Elastic Storage System 3200 enclosure supports up to 24 U.2 dual ported NVMe SSDs and the drive slots are numbered from 1 through 24 as shown in the following figure.

  • Page 18: Displaying Drive Carrier Assembly

    Alternatively, locate unhealthy drives in the management GUI, either from the Storage> Physical Disks page as shown in Figure 11 on page 7, or from the list of events that are available under the Monitoring > Events page. 6 IBM Elastic Storage System 3200: Service Guide...

  • Page 19: Displaying Physical Disks State

    2. Prepare the failed drive for replacement. In an IBM Elastic Storage System 3200 enclosure, a faulty drive has amber fault LED ON (non-flashing) on the driver carrier. At the end of this step, confirm that the amber LED in the ON state for the drive to be removed.

  • Page 20: Removing Nvme Drive

    Press the release catch on the drive carrier in the direction of the arrow to open the handle as identified in Figure 14 on page 9. The cam releases from the locked position. 8 IBM Elastic Storage System 3200: Service Guide...

  • Page 21: Removing And Replacing A Drive Filler

    Use the mmvdisk command to check and confirm that no failed disk is reported. Removing and replacing a drive filler Refer to the service procedure to remove a drive slot filler in an IBM Elastic Storage System 3200 enclosure and replace it with a new one from stock.

  • Page 22: Displaying Drive Slots

    • Part number - 01LL731 (Drive Filler) Figure 17. Displaying drive filler replacement kit Refer to the following steps to remove and replace a drive filler: 1. Remove the drive filler. 10 IBM Elastic Storage System 3200: Service Guide...

  • Page 23: Unlocking The Drive Slot And Release Latch

    a) Press the blue touchpoint to unlock the latching handle, as shown in Figure 18 on page 11. Unlock the drive slot and release latch. Figure 18. Unlocking the drive slot and release latch b) Raise the handle and slide the drive filler out of the enclosure, as shown in Figure 19 on page 11. Figure 19.

  • Page 24: Removing And Replacing A Power Module

    Figure 22. Inserting the drive filler Removing and replacing a power module Refer to the service procedure to remove and replace a power module of an IBM Elastic Storage System 3200 enclosure. The following steps are the high-level flow of the procedure: 1.

  • Page 25: Displaying Power Modules

    No tools are needed to complete this task. Do not remove or loosen any screws. An IBM Elastic Storage System 3200 (MTM: 5141-FN1) is powered by two high-efficiency, hot-swappable power modules that are installed in the right and left sides at the rear of the enclosure as shown in Figure 23 on page 13.
  • Page 26 2. Confirm the faulty power module location with the help of the power module LED. Each power module of an IBM Elastic Storage System 3200 enclosure has a bi-color LED as shown in Figure 24 on page 14. The LED indicates the status of the power module, as described in Table 2 on page 14.
  • Page 27 Table 2. IBM Elastic Storage System 3200 power module status LEDs (continued) Green Color Amber Color Behavior Flashing 1.0 Hz Power module is in standby state. AC present, 12 V standby ON. Power module is in cold standby state or always standby state.
  • Page 28 8. Run common system health check by using the SSR utility. For more information, see Completing the ESS 3200 installation at the customer site (SSR task) of the Installing chapter in ESS 3200 Hardware Planning and Installation Guide. 16 IBM Elastic Storage System 3200: Service Guide...

  • Page 29: Removing And Replacing A Bezel Kit

    Removing and replacing a bezel kit Refer to the service procedure to remove and replace both left and right ear caps in an IBM Elastic Storage System 3200 enclosure. The following steps are the high-level flow of the procedure: 1. Unlock the enclosure from the rack.
  • Page 30 4. Remove and replace the right ear cap. a) Remove the right ear cap by removing the two screws from the back side of the right flange by using a Phillips driver. 18 IBM Elastic Storage System 3200: Service Guide...
  • Page 31 Figure 30. Displaying right ear cap front view b) Next, install the right ear cap part (01LL678) as shown in Figure 31 on page 19. Figure 31. Replacing right ear cap 5. Return enclosure back to the rack position. With the enclosure in the serviceable position, press the release tab on each inner chassis member rail (see Figure 32 on page 20) to release the rail from the serviceable position.
  • Page 32 Figure 33. Securing the enclosure 7. Place the IBM brand label on the right ear cap. Place the IBM brand label onto the right ear cap within the square area, as highlighted in Figure 34 on page 20. Figure 34. Displaying IBM brand label location If an MTM/SN label is needed to be placed on the left ear cap, contact IBM Quality Hotline for more information.

  • Page 33: Miscellaneous Equipment Specification (Mes) Instructions

    • The system must be working correctly before the IBM Elastic Storage System 3200 storage MES upgrade. • The existing IBM Elastic Storage System 3200 must be a properly installed 12 NVMe system with 12 NVMe drives correctly located in slots 1 - 6 and 13 - 18.
  • Page 34 7. To check whether all 24 NVMe drives have the current firmware version, issue the following command from one of the canisters. For more information about the current firmware version, see the Drives section in IBM Elastic Storage System documentation. Note: For FCM drives, the minimum drive firmware level is 2.1.7 (2_1_7).
  • Page 35 drive a8241014065c 78E400K SN58SN58 *SN5ASN5A ess3200rw3a-hs Rack Bodhi-Rack-1520 U25-26, Enclosure 5141-FN1-78E400K Drive 13 drive a8241014065c 78E400K SN58SN58 *SN5ASN5A ess3200rw3a-hs Rack Bodhi-Rack-1520 U25-26, Enclosure 5141-FN1-78E400K Drive 14 drive a8241014065c 78E400K SN58SN58 *SN5ASN5A ess3200rw3a-hs Rack Bodhi-Rack-1520 U25-26, Enclosure 5141-FN1-78E400K Drive 15 drive a8241014065c 78E400K SN58SN58...
  • Page 36 12. Update the node class server configuration for 24 drives by issuing the following command: # mmvdisk server configure --update --node-class <node class name> --recycle 1 Example mmvdisk server configure --update --node-class ess3200_x86_64_mmvdisk_78E400K --recycle 1 mmvdisk: Recording pre-conversion cluster configuration in /var/mmfs/tmp/ mmvdisk.configure.before.20210816 24 IBM Elastic Storage System 3200: Service Guide...
  • Page 37 mmvdisk: Checking resources for specified nodes. mmvdisk: Node class 'ess3200_x86_64_mmvdisk_78E400K' has a shared recovery group disk topology. mmvdisk: Using 'ess3200.shared' RG configuration for topology 'ESS 3200 FN1 24 NVMe'. mmvdisk: Updating configuration for node class 'ess3200_x86_64_mmvdisk_78E400K' (recovery group 'ess3200_78E400K'). mmvdisk: Recording post-conversion cluster configuration in /var/mmfs/tmp/ mmvdisk.configure.after.20210816 mmvdisk: Restarting GPFS daemon on node 'ess3200rw3a-hs.gpfs.ess'.
  • Page 38 Because the decluster array size is doubled after new 12 drives, the set-size is set to 40% to keep the new vdisk size same as the original vdisk size. For information about non-default configurations, see IBM Spectrum Scale RAID: Administration in IBM Elastic Storage Server documentation.

  • Page 39: Formatting Drives Example

    (if needed), the restripe operation can be run. For more information, see IBM Spectrum Scale: Administration Guide. When you are adding a vdisk set to a file system, the default TRIM setting is "no" irrespective of the TRIM settings of the existing vdisk sets.
  • Page 40 4 KiB + SN1OSN1O /dev/nvme8n1 S43RNX0M903165 3.84TB NVMe G3 Tier-1 Flash 3.84 TB / 3.84 4 KiB + SN1OSN1O /dev/nvme9n1 S43RNX0M902921 3.84TB NVMe G3 Tier-1 Flash 3.84 TB / 3.84 4 KiB + SN1OSN1O 28 IBM Elastic Storage System 3200: Service Guide...

  • Page 41: Manually Restarting Gpfs On The Enterprise Storage Server 3200 Canisters Example

    Manually restarting GPFS on the Enterprise Storage Server 3200 canisters example You can manually stop and start GPFS to solidify the nodes configuration changes on both canisters. For configuration changes to take effect, restart GPFS on one canister at a time, and ensure that at least one of the canisters is always in the active state.
  • Page 42 30 IBM Elastic Storage System 3200: Service Guide...

  • Page 43: Chapter 2. Part Listings

    64GB memory DIMM 78P6815 960GB M.2 boot drive FRU kit 01LL663 PCIe adapter CX6 VPI 01LL648 PCIe adapter CX6 DX 01LL634 PCIe adapter riser card FRU kit 01LL744 Enclosure chassis 01LL662 CR2032 coin cell battery 00RY543 © Copyright IBM Corp. 2022...
  • Page 44 Canister Screw Set/Kit 01LL788 Note: This part is required when servicing the PCIe riser, PCIe adapter, DIMM, coin battery, TPM, and boot drives. The part is already included in all canister part FRU kits. 32 IBM Elastic Storage System 3200: Service Guide...

  • Page 45: Accessibility Features For The System

    IBM Documentation, and its related publications, are accessibility-enabled. Keyboard navigation This product uses standard Microsoft Windows navigation keys. IBM and accessibility See the IBM Human Ability and Accessibility Center (www.ibm.com/able) for more information about the commitment that IBM has to accessibility. © Copyright IBM Corp. 2022...
  • Page 46 34 IBM Elastic Storage System 3200: Service Guide...

  • Page 47: Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 48: Trademarks

    IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.
  • Page 49 IBM reserves the right to withdraw the permissions that are granted herein whenever, in its discretion, the use of the publications is detrimental to its interest or as determined by IBM, the above instructions are not being properly followed.
  • Page 50 38 IBM Elastic Storage System 3200: Service Guide...

  • Page 51: Glossary

    • See refers you from a non-preferred term to the preferred term or from an abbreviation to the spelled- out form. • See also refers you to a related or contrasting term. For other terms and definitions, see the IBM Terminology website (opens in new window): http://www.ibm.com/software/globalization/terminology building block A pair of servers with shared disk enclosures attached.
  • Page 52 A data structure containing key information about a file system. This information includes the disks assigned to the file system (stripe group), the current state of the file system, and pointers to key files such as quota files and log files. 40 IBM Elastic Storage System 3200: Service Guide...
  • Page 53 Hardware Management Console (HMC) Standard interface for configuring and operating partitioned (LPAR) and SMP systems. See Hardware Management Console (HMC). IBM Security Key Lifecycle Manager (ISKLM) For GPFS encryption, the ISKLM is used as an RKM server to store MEKs. independent fileset A fileset that has its own inode space.
  • Page 54 From a system management perspective, it is the central coordinator of the cluster. It also serves as a client node in an ESS building block. master encryption key (MEK) A key that is used to encrypt other keys. See also encryption key. 42 IBM Elastic Storage System 3200: Service Guide...
  • Page 55 maximum transmission unit (MTU) The largest packet or frame, specified in octets (eight-bit bytes), that can be sent in a packet- or frame-based network, such as the Internet. The TCP uses the MTU to determine the maximum size of each packet in any transmission. See master encryption key (MEK).
  • Page 56 A network protocol that ensures a loop-free topology for any bridged Ethernet local-area network. The basic function of STP is to prevent bridge loops and the broadcast radiation that results from them. 44 IBM Elastic Storage System 3200: Service Guide...
  • Page 57 See secure shell (SSH). See Spanning Tree Protocol (STP). symmetric multiprocessing (SMP) A computer architecture that provides fast performance by making multiple processors available to complete individual processes simultaneously. See Transmission Control Protocol (TCP). Transmission Control Protocol (TCP) A core protocol of the Internet Protocol Suite that provides reliable, ordered, and error-checked delivery of a stream of octets between applications running on hosts communicating over an IP network.
  • Page 58 46 IBM Elastic Storage System 3200: Service Guide...

  • Page 59: Index

    Index accessibility features 33 audience ix comments xi documentation on web ix information overview ix license inquiries 35 notices 35 overview of information ix patent information 35 preface ix resources on web ix submitting xi trademarks 36 documentation ix resources ix Index 47...
  • Page 60 48 IBM Elastic Storage System 3200: Service Guide...
  • Page 61 Index accessibility features 33 audience ix comments xi documentation on web ix information overview ix license inquiries 35 notices 35 overview of information ix patent information 35 preface ix resources on web ix submitting xi trademarks 36 documentation ix resources ix Index 49...
  • Page 62 50 IBM Elastic Storage System 3200: Service Guide...
  • Page 64 IBM® Product Number: 5765-DME 5765-DAE SC27-9862-00...

Table of Contents