IBM ESS 5000 SC Series Hardware Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Storage
  5. ESS 5000 SC Series
  6. Hardware manual
IBM ESS 5000 SC Series Hardware Manual

IBM ESS 5000 SC Series Hardware Manual

Elastic storage system 5000 version 6.0.1
Hide thumbs
Table of Contents

Advertisement

Quick Links

IBM Elastic Storage System 5000
Version 6.0.1
Hardware Guide
IBM
SC28-3155-00

Advertisement

Table of Contents
loading

Related Manuals for IBM ESS 5000 SC Series

Summary of Contents for IBM ESS 5000 SC Series

  • Page 1 IBM Elastic Storage System 5000 Version 6.0.1 Hardware Guide SC28-3155-00...
  • Page 2 IBM welcomes your comments; see the topic “How to submit your comments” on page xi. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.

  • Page 3: Table Of Contents

    Contents Figures........................v Tables......................... vii About this information..................ix Who should read this information.......................ix IBM Elastic Storage System information units................... ix Related information............................x Conventions used in this information......................x How to submit your comments........................xi Chapter 1. Notices....................1 Trademarks..............................2 Homologation statement..........................
  • Page 4 Assigning the management IP address....................43 Appendix A. Planning worksheets (customer task)..........45 Installation worksheet..........................45 Appendix B. 5105 22E: Reference information............49 Accessibility features for the system..............51 Accessibility features..........................51 Keyboard navigation..........................51 IBM and accessibility..........................51 Glossary......................53 Index........................61 Index........................61...

  • Page 5: Figures

    Figures 1. ESS 5000 high-level software architecture....................15 2. System management topology........................16 3. Components of a management container....................16 4. EMS in ESS 5000 environment........................17 5. ESS 5000 system with Model 106 expansion enclosures................. 19 6. Raw capacity of ESS 5000 SC variants....................... 20 7.

  • Page 7: Tables

    Tables 1. Conventions..............................x...
  • Page 8 viii...

  • Page 9: About This Information

    This information is intended for administrators of IBM Elastic Storage System (ESS) that includes IBM Spectrum Scale RAID. IBM Elastic Storage System information units IBM Elastic Storage System (ESS) 5000 documentation consists of the following information units. Information unit Type of information Intended users...

  • Page 10: Related Information

    Enter. In command examples, a backslash indicates that the command or coding example continues on the next line. For example: mkcondition -r IBM.FileSystem -e "PercentTotUsed > 90" \ -E "PercentTotUsed < 85" -m p "FileSystem space used" {item} Braces enclose a list from which you must choose an item in format and syntax descriptions.

  • Page 11: How To Submit Your Comments

    In the left margin of the document, vertical lines indicate technical changes to the information. How to submit your comments To contact the IBM Spectrum Scale development organization, send your comments to the following email address: scale@us.ibm.com About this information xi...
  • Page 12 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 13: Chapter 1. Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 14: Trademarks

    International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.

  • Page 15: Homologation Statement

    DANGER: A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury. (D002) 2. Locate the IBM Systems Safety Notices with the user publications that were provided with your system hardware.
  • Page 16 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: • If IBM supplied a power cord(s), connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.
  • Page 17 Use the reference numbers in parentheses at the end of each notice (for example, D005) to find the matching translated notice in IBM Systems Safety Notices. CAUTION: The battery contains lithium. To avoid possible explosion, do not burn or charge the battery.
  • Page 18 CAUTION: To avoid personal injury, before lifting this unit, remove all appropriate subassemblies per instructions to reduce the system weight. (C012) CAUTION: CAUTION regarding IBM provided VENDOR LIFT TOOL: • Operation of LIFT TOOL by authorized personnel only • LIFT TOOL intended for use to assist, lift, install, remove units (load) up into rack elevations. It is not to be used loaded transporting over major ramps nor as a replacement for such designated tools like pallet jacks, walkies, fork trucks and such related relocation practices.
  • Page 19 • Do not operate while under the influence of drugs or alcohol. • Do not support ladder against LIFT TOOL. • Tipping hazard. Do not push or lean against load with raised platform. • Do not use as a personnel lifting platform or step. No riders. •...

  • Page 20: Special Caution And Safety Notices

    General safety When you service the IBM Elastic Storage System 5000, follow general safety guidelines. Use the following general rules to ensure safety to yourself and others. • Observe good housekeeping in the area where the devices are kept during and after maintenance.
  • Page 21 Important: Good judgment must also be used to identify potential safety hazards due to the attachment of non-IBM features or options that are not covered by this inspection guide. If any unsafe conditions are present, you must determine how serious the apparent hazard might be and whether you can continue without first correcting the problem.

  • Page 22: Environmental Notices

    Attention: Depending on local conditions, the sound pressure can exceed 85 dB(A) during service operations. In such cases, wear appropriate hearing protection. Environmental notices This information contains all the required environmental notices for IBM Systems products in English and other languages. The IBM Systems Environmental Notices includes statements on limitations, product information, product recycling and disposal, battery information, flat panel display, refrigeration and water-cooling systems, external power supplies, and safety data sheets.

  • Page 23: Electromagnetic Compatibility Notices

    Electromagnetic compatibility notices The following Class A statements apply to IBM products and their features unless designated as electromagnetic compatibility (EMC) Class B in the feature information. When attaching a monitor to the equipment, you must use the designated monitor cable and any interference suppression devices that are supplied with the monitor.

  • Page 24: Japan Electronics And Information Technology Industries Association (Jeita) Notice

    This statement applies to products less than or equal to 20 A per phase. This statement applies to products greater than 20 A, single phase. This statement applies to products greater than 20 A per phase, three-phase. Japan Voluntary Control Council for Interference (VCCI) Notice 12 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 25: Korea Notice

    People's Republic of China Notice Russia Notice Taiwan Notice IBM Taiwan Contact Information: United States Federal Communications Commission (FCC) Notice This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
  • Page 26 Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors, or by unauthorized changes or modifications to this equipment.

  • Page 27: Chapter 2. System Overview

    Chapter 2. System overview IBM Elastic Storage System 5000 (ESS 5000) is a high-capacity storage system that uses the GPFS file system. It combines the IBM Elastic Storage System (5105) on the IBM POWER9 architecture with the IBM Spectrum Scale software, which provides the clustered file system.

  • Page 28: Servers

    • ESS management server • Protocol node • I/O server All these servers are based on the IBM POWER9 architecture. All these server types are having the same MTM (5105-22E). ESS management server The ESS management server (EMS) manages and deploys the I/O servers and hosts the graphical user interface (GUI).
  • Page 29 – See I/O matrix for full list Protocol node The ESS access methods are like the ones for accessing an IBM Spectrum Scale cluster. Depending on the required configuration, the ESS can be accessed as an IBM Spectrum Scale client, with a specific connector, or through dedicated protocol node servers.

  • Page 30: Ess 5000 Product Line-Up

    • ESS 5000 SC series • ESS 5000 SL series ESS 5000 SC series The main features of the ESS 5000 SC series are as follows: • Uses the 5147-106 enclosures • Uses up to six network adapters per ESS system –...
  • Page 31 Figure 5. ESS 5000 system with Model 106 expansion enclosures The following figure shows different configurations that are available under the raw capacity of ESS 5000 SC variants SC series: Chapter 2. System overview 19...

  • Page 32: Raw Capacity Of Ess 5000 Sc Variants

    – 25G Ethernet, 100G Ethernet, 100G InfiniBand • Four HDD options: 6 TB, 10 TB, 14 TB, and 16 TB The following figure shows the basic building block of the ESS 5000 system with Model 092 expansion enclosures: 20 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 33: Raw Capacity Of Ess 5000 Sl Variants

    Figure 7. ESS 5000 with Model 092 expansion enclosures The following figure shows the different configurations that are available under the ESS 5000 SL series and their raw capacities: Figure 8. Raw capacity of ESS 5000 SL variants Chapter 2. System overview 21...

  • Page 34: Enclosures

    Enclosures are the storage expansion units that are mounted on the rack. ESS 5000 system can have the following enclosures: • IBM Elastic Storage System 5000 Expansion – Model 106 (5147-106): The ESS 5000 system with this type of expansion enclosure is known as the IBM ESS 5000 SC series.

  • Page 35: Network Topology

    IBM Elastic Storage System 5000 Expansion – Model 092 (5147-092) The Model 092 enclosure is a high capacity and density expansion enclosure, which is designed for use in Cloud and Enterprise environments. It holds up to 92 3.5-inch SAS disk drives in a 5U, 19-inch rack mount enclosure.

  • Page 36: Ess 5000 Network Topology

    Ansible. • Clustering Network: This is a high-speed network based on InfiniBand (IB), or 10-Gigabit Ethernet, or 40-Gigabit Ethernet that is used by the IBM Spectrum Scale clients to access data on the Elastic Storage Server solution. • External or campus management network: This network is used to remotely access and manage the EMS and HMC.

  • Page 37: Sas Hba Port Schema

    Figure 15. Protocol node P2P cabling ESS management server Figure 16 on page 25 shows the EMS server P2P cabling. Figure 16. EMS server P2P cabling SAS HBA port schema Figure 17 on page 25 shows the SAS HBA port schema. Figure 17.

  • Page 38: Operating System And Software Levels

    - 1+1 1400W PS, 200 - 240 VAC – JBOD drives and select components – Enclosure only with enclosure protection Warranty information See the Warranty Information PDF for details of the warranty. 26 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 39: Chapter 3. Installing

    Chapter 3. Installing An IBM Service Support Representative (SSR) must install and configure the ESS 5000 system by following the plan that you provide to them. Network The following figure illustrates ESS 5000 network connections and shows an optional ESS 3000 server: Figure 18.

  • Page 40: Installation Prerequisites (Ssr Task)

    • ESS version • Installation notes Installation steps (SSR task) This section is a high-level overview of the tasks that an IBM service support representative (SSR) performs to complete code 20. SSR objectives 1. Log in by using the SSR ID (esserv1) and run the specified essutils command options on each server in the following order: a.

  • Page 41: Node Combination Rules

    8. When you run the Check and validate various install parameters option, write down the installed version in the “Installation worksheet” on page 45 so that the customer knows whether they need to upgrade or not. To check whether a higher version of ESS 5000 is available, see IBM Fix Central. Installation flow Connect USB to Ethernet dongle to your laptop, if no direct Ethernet connection is available.

  • Page 42: Checking I/O Servers

    For example, ssh essserv1@10.111.222.101. An example of how to set an IP in PuTTY for SSH is shown in the following figure. For more information, see How do I connect using SSH (Putty)? 30 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 43 Figure 19. PuTTY configuration example 4. When you log in, press Enter to start the essutils tool. A sample output is as follows: Note: Enlarge the PuTTY window to minimum 80 x 24, otherwise essutils might not work correctly. Chapter 3. Installing 31...
  • Page 44 Type the command exit and press Enter. The essutils Advanced SSR tasks screen appears again. f) Highlight Back and then press Enter. g) Highlight SSR Tools and then press Enter. The following menu is displayed: 32 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 45 6. Highlight the Check and validate various install parameters option and then click Enter. 7. Check the installation status. It is displayed as PASS (in green) or ERROR (in red) at the bottom of the screen. Write ERROR messages in the “Installation worksheet” on page 45, if any. You also need to write the installed version for the customer so they know whether they need to download a new update or not.
  • Page 46 If the output summary that appears at the end of the screen displays ERROR, see either the IBM Elastic Storage System 5000: Problem Determination Guide or the WCII or both to debug the issue. Note: Incorrect adapters or disk placement is usually the issue. Unsupported hardware or missing paths to some disks could also cause an error.
  • Page 47 Type Yes and press Enter to begin the test. Note: This command deletes the data from the disks. If you see a message regarding existing disk descriptors found, exit the command and essutils immediately and call IBM Service. Do not type 'Yes' to continue.
  • Page 48 18. If applicable, highlight the Erase serviceable event option if you need to clear any resolved serviceable events and then press c to edit the field. Important: Do not press Enter. Always press c to customize and do the following steps: 36 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 49 a) Type the ID for which you want more information. b) Press Ctrl+G keys to save. c) Press Enter to clear the event. 19. Highlight the Set FSP ipmi IP address option to set the HMC1 IP address on the server and then press c to edit the field.
  • Page 50 To perform a ping test, see “Checking ESS management server and protocol nodes” on page 39. 24. Disconnect the laptop from C11-T4. Note: You need to run all these steps for each additional I/O server and/or building-blocks. 38 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 51: Checking Ess Management Server And Protocol Nodes

    Checking ESS management server and protocol nodes By using the following steps, you can check the ESS protocol nodes and the ESS management server (EMS). Ensure that the EMS is the final node that you check in an order (if applicable). If an EMS is not in the order, skip any ping tests that are specified.
  • Page 52 If the ping is not successful, check the cabling and switch. You might need to log in as root to confirm whether the IP address was set correctly. For more information, see IBM Elastic Storage System 5000: Problem Determination Guide.

  • Page 53: Chapter 4. Troubleshooting (Ssr Tasks)

    Figure 20. Connecting a laptop to the serial port in the EMS node 2. Open a terminal emulator program such as PuTTY or minicom. Set the following settings for communications using the serial connection: 19200 baud rate Data bits of 8 © Copyright IBM Corp. 2020...
  • Page 54 Note: You should only login as root when you cannot log in as essserv1 and it is an emergency. The root password is set to expire so you will be prompted to change immediately. • Run essutils manually by typing essutils and press Enter. 42 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 55: Network Switch Issues

    Try to set that IP address and attempt ping. If the ping test still does not work (Ensure that the system is also booted up – apply power and press the front white button. Wait minimum 5 minutes though it could be up to 20 minutes to boot a data server.) call IBM service. Assigning the management IP address This section covers the issues that you might encounter while assigning the management IP address by using the essutils tool.
  • Page 56 You can now do a ping test on the command line or run the essutils tool to perform the task. You can turn off the Wi-Fi that is connected to the laptop, if the ping test is not successful. 44 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 57: Appendix A. Planning Worksheets (Customer Task)

    Customers are responsible for completing the system planning worksheets. Planning worksheets can help you identify important information that is needed when the system is installed and configured. The customer then provides the worksheets to the IBM SSR when they install and configure the system. Installation worksheet Note: The worksheet has default IPs filled out in case they were not provided by the customer during the TDA process.
  • Page 58 ESS 3000 node 1 (lowest position in the frame) Management interfaces IP address Netmask ESS 3000 canister 1 192.168.45.30 255.255.255.0 management interface (top) ESS 3000 canister 2 192.168.45.31 255.255.255.0 management interface (bottom) 46 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 59 ESS 3000 node 2 (upper position in the frame) Management interfaces IP address Netmask ESS 3000 canister 1 management interface (top) ESS 3000 canister 2 management interface (bottom) POWER9 EMS (should be only one) IP address Netmask EMS management interface 192.168.45.20 255.255.255.0 EMS FSP (HMC1 port) interface...
  • Page 60 48 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 61: Appendix B. 5105 22E: Reference Information

    Appendix B. 5105 22E: Reference information For detailed information about 5105 22E, see PDF files for 5105 22E. © Copyright IBM Corp. 2020...
  • Page 62 50 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 63: Accessibility Features For The System

    IBM Knowledge Center (www.ibm.com/support/knowledgecenter). Keyboard navigation This product uses standard Microsoft Windows navigation keys. IBM and accessibility See the IBM Human Ability and Accessibility Center (www.ibm.com/able) for more information about the commitment that IBM has to accessibility. © Copyright IBM Corp. 2020...
  • Page 64 52 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 65: Glossary

    • See refers you from a non-preferred term to the preferred term or from an abbreviation to the spelled- out form. • See also refers you to a related or contrasting term. For other terms and definitions, see the IBM Terminology website (opens in new window): http://www.ibm.com/software/globalization/terminology building block A pair of servers with shared disk enclosures attached.
  • Page 66 See also cluster. (3) The routing of all transactions to a second controller when the first controller fails. See also cluster. failure group A collection of disks that share common access paths or adapter connection, and could all become unavailable through a single hardware failure. 54 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 67 See file encryption key (FEK). file encryption key (FEK) A key used to encrypt sectors of an individual file. See also encryption key. file system The methods and data structures used to control how data is stored and retrieved. file system descriptor A data structure containing key information about a file system.
  • Page 68 Provides a way to control the bundling of several physical ports together to form a single logical channel. logical partition (LPAR) A subset of a server's hardware resources virtualized as a separate computer, each with its own operating system. See also node. LPAR See logical partition (LPAR). 56 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 69 management network A network that is primarily responsible for booting and installing the designated server and compute nodes from the management server. management server (MS) An ESS node that hosts the ESS GUI and xCAT and is not connected to storage. It must be part of a GPFS cluster.
  • Page 70 Data that is associated with a recovery group. RKM server See remote key management server (RKM server). See Serial Attached SCSI (SAS). secure shell (SSH) A cryptographic (encrypted) network protocol for initiating text-based shell sessions securely on remote computers. 58 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 71 Serial Attached SCSI (SAS) A point-to-point serial protocol that moves data to and from such computer storage devices as hard drives and tape drives. service network ® A private network that is dedicated to managing POWER8 servers. Provides Ethernet-based connectivity among the FSP, CPC, HMC, and management server. See symmetric multiprocessing (SMP).
  • Page 72 60 IBM Elastic Storage System 5000: Hardware Guide...

  • Page 73: Index

    Index sound pressure safety notices 10 accessibility features 51 SSR port 43 audience ix static-sensitive devices 10 submitting xi comments xi trademarks 2 documentation on web x documentation x resources x EMS 41 environmental notices 10 external device safety check 9 homologation statement 3 information overview ix inspections, safety...
  • Page 74 62 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 75 Index sound pressure safety notices 10 accessibility features 51 SSR port 43 audience ix static-sensitive devices 10 submitting xi comments xi trademarks 2 documentation on web x documentation x resources x EMS 41 environmental notices 10 external device safety check 9 homologation statement 3 information overview ix inspections, safety...
  • Page 76 64 IBM Elastic Storage System 5000: Hardware Guide...
  • Page 78 IBM® Product Number: 5765-DME 5765-DAE SC28-3155-00...

This manual is also suitable for:

Ess 5000 sl seriesEss 5000 sc1Ess 5000 sc2Ess 5000 sc3Ess 5000 sc4Ess 5000 sc5 ... Show all

Table of Contents