Download
Share
Print this page
IBM Elastic Storage System 3000 Hardware Planning And Installation Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Storage
  5. Elastic Storage System 3000
  6. Hardware planning and installation manual
IBM Elastic Storage System 3000 Hardware Planning And Installation Manual

IBM Elastic Storage System 3000 Hardware Planning And Installation Manual

Hide thumbs Also See for Elastic Storage System 3000:

Advertisement

Quick Links

Download this manual
IBM Elastic Storage System 3000
Version 6.0.1
Hardware Planning and Installation
Guide
IBM
GC28-3156-01

Advertisement

loading
Need help?

Need help?

Do you have a question about the Elastic Storage System 3000 and is the answer not in the manual?

Questions and answers

Related Manuals for IBM Elastic Storage System 3000

Summary of Contents for IBM Elastic Storage System 3000

  • Page 1 IBM Elastic Storage System 3000 Version 6.0.1 Hardware Planning and Installation Guide GC28-3156-01...
  • Page 2 IBM welcomes your comments; see the topic “How to submit your comments” on page xii. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.

  • Page 3: Table Of Contents

    Planning for site preparation........................23 Site preparation and physical planning....................23 Planning for hardware installation......................23 Planning for racks..........................23 Reviewing Elastic Storage System 3000 location guidelines..............24 ESS 3000 model........................... 24 Planning for power for server canister....................27 Physical installation planning........................29...
  • Page 4 Installing the EMS server in a rack.......................43 Unpacking Elastic Storage System 3000 (IBM SSR task)..............43 Installing support rails for the ESS 3000 system (IBM SSR task)............44 Installing enclosures (IBM SSR task)....................47 Connecting the components (IBM SSR task)..................49 Connecting an Ethernet cable to SSR access port (IBM SSR task).............
  • Page 5 Appendix C. Converting an older Elastic storage System Management Server for ESS 3000 compatibility..................89 Accessibility features for the system..............91 Accessibility features..........................91 Keyboard navigation..........................91 IBM and accessibility..........................91 Glossary......................93 Index........................ 101 Index........................ 101...

  • Page 7: Figures

    10. DIMM slots..............................27 11. DIMM slot labels printed in white on the circuit board of the server canister........27 12. Rear view of an Elastic Storage System 3000..................28 13. Sample illustration to show space around the rack................. 34 14. Acoustical Declaration with Noise Hazard Notice..................36 15.
  • Page 8 33. Canister SSR Tools menu options......................60 34. Connecting a laptop to the serial port in the EMS node................63 35. Front and rear view of IBM Elastic Storage System 3000............... 71 36. Rear view of ESS 3000..........................72 37. Management ports for each canister......................72 38.
  • Page 9 8. Power specifications per power supply...................... 32 9. Power consumption examples per enclosure.................... 32 10. Temperature requirements........................32 11. Physical characteristics of the enclosures....................33 12. Rack space requirements for the Elastic Storage System 3000............. 33 13. Service clearance requirements....................... 34 14. Clearances..............................34 15. Drive specifications........................... 35 16.

  • Page 11: About This Information

    This information is intended for administrators of IBM Elastic Storage System (ESS) that includes IBM Spectrum Scale RAID. IBM Elastic Storage System information units IBM Elastic Storage System (ESS) 3000 documentation consists of the following information units. Information unit Type of information Intended users...

  • Page 12: Conventions Used In This Information

    In the left margin of the document, vertical lines indicate technical changes to the information. How to submit your comments To contact the IBM Spectrum Scale development organization, send your comments to the following email address: scale@us.ibm.com xii IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 13: Chapter 1. Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 14: Trademarks

    International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.

  • Page 15: Homologation Statement

    DANGER: A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury. (D002) 2. Locate the IBM Systems Safety Notices with the user publications that were provided with your system hardware.
  • Page 16 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: • If IBM supplied a power cord(s), connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.
  • Page 17 Ensure that you understand the caution notices for the system. Use the reference numbers in parentheses at the end of each notice (for example, D005) to find the matching translated notice in IBM Systems Safety Notices. Chapter 1. Notices 5...
  • Page 18 • Do not stand under overhanging load. • Do not use on uneven surface, incline or decline (major ramps). • Do not stack loads. (C048, part 1 of 2) 6 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 19 • Do not operate while under the influence of drugs or alcohol. • Do not support ladder against LIFT TOOL. • Tipping hazard. Do not push or lean against load with raised platform. • Do not use as a personnel lifting platform or step. No riders. •...

  • Page 20: Special Caution And Safety Notices

    General safety When you service the Elastic Storage System 3000, follow general safety guidelines. Use the following general rules to ensure safety to yourself and others. • Observe good housekeeping in the area where the devices are kept during and after maintenance.
  • Page 21 Important: Good judgment must also be used to identify potential safety hazards due to the attachment of non-IBM features or options that are not covered by this inspection guide. If any unsafe conditions are present, you must determine how serious the apparent hazard might be and whether you can continue without first correcting the problem.

  • Page 22: Sound Pressure

    Attention: Depending on local conditions, the sound pressure can exceed 85 dB(A) during service operations. In such cases, wear appropriate hearing protection. Environmental notices This information contains all the required environmental notices for IBM Systems products in English and other languages. The IBM Systems Environmental Notices includes statements on limitations, product information, product recycling and disposal, battery information, flat panel display, refrigeration and water-cooling systems, external power supplies, and safety data sheets.

  • Page 23: Electromagnetic Compatibility Notices

    Electromagnetic compatibility notices The following Class A statements apply to IBM products and their features unless designated as electromagnetic compatibility (EMC) Class B in the feature information. When attaching a monitor to the equipment, you must use the designated monitor cable and any interference suppression devices that are supplied with the monitor.

  • Page 24: Japan Electronics And Information Technology Industries Association (Jeita) Notice

    This statement applies to products less than or equal to 20 A per phase. This statement applies to products greater than 20 A, single phase. This statement applies to products greater than 20 A per phase, three-phase. 12 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 25: Japan Voluntary Control Council For Interference (Vcci) Notice

    Japan Voluntary Control Council for Interference (VCCI) Notice Korea Notice People's Republic of China Notice Russia Notice Taiwan Notice Chapter 1. Notices 13...

  • Page 26: United States Federal Communications Commission (Fcc) Notice

    Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors, or by unauthorized changes or modifications to this equipment.

  • Page 27: Chapter 2. Technical Overview

    Figure 1. Front view of ESS 3000 Each Elastic Storage System 3000 contains two identical I/O server canisters. As Figure 2 on page 15 shows, the top I/O server canister is inverted above the bottom one; each server canister is connected to power supply units mounted on either side of the canister.
  • Page 28 – EC67: PCIe4 x16 2-Port 100GbE RoCE adapter – AJP1: PCIe4 LP 2-Port VPI 100Gb IB-EDR/Ethernet adapter Networking details The networking details of ESS 3000 are shown in the following figure: 16 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 29 Figure 4. ESS 3000 Sharing Existing Networks Figure 5 on page 18 shows the ESS 5000 network topology of a mixed ESS 5000 cluster, which contains ™ ESS 3000 and IBM POWER9 servers. ® Note: ESS 3000 is supported on an POWER8 EMS also.

  • Page 30: System Hardware

    Enterprise level software and support ESS 3000 consists of two I/O server canisters that run the IBM Spectrum Scale software, which is a part of the IBM Spectrum Storage family. For more information on the IBM Spectrum Scale capabilities, see IBM Spectrum Scale.

  • Page 31: System Management

    EMS node. A single EMS node can support multiple building blocks in the same IBM ESS 3000 cluster. You need a minimum of one EMS node (5148-21L) as a part of your ESS cluster. The EMS node can be ordered as a part of ESS 3000.

  • Page 32: Drives

    The SSR access port is a designated Ethernet port on the back panel of the canister that a service personnel can use to initialize a system. You can use the SSR access port to do the following tasks: 20 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 33: Hardware Specification Sheets

    • Set the IP address of the management interface Each of the canisters in the Elastic Storage System 3000 has a 1 Gb Ethernet SSR access port, as shown in Figure 8 on page 21. Because canister 2 is inverted, the plug of the Ethernet cable also needs to be inverted to connect to the SSR access port.
  • Page 34 22 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 35: Chapter 3. Planning For Hardware

    For detailed rack specification information on the 7965-S42 rack, see: Planning for the 7965-S42 rack. If you do not have a 7965-S42 rack and want to install the system into a non-IBM rack, see the ESS 3000 requirements topic. Ensure that the physical environment meet the specified requirements, such as rack space, power, and environmental conditions.

  • Page 36: Reviewing Elastic Storage System 3000 Location Guidelines

    Reviewing Elastic Storage System 3000 location guidelines Consult these guidelines when you plan the location of Elastic Storage System 3000 and any existing Elastic Storage System in your environment, including any IBM Spectrum Scale client or protocol node. ESS 3000 contains two I/O server canister. Each ESS 3000 cluster consists of the following components: •...
  • Page 37 Table 4. Available memory configurations for a server canister Total Memory per ESS 3000 768 GB 1,536 GB ACG1 Features ACG1 +ACGB Slots for CPU1 Content of each DIMM slot 32 GB 32 GB dummy 32 GB 32 GB 32 GB dummy 32 GB 32 GB...
  • Page 38 The following Figure 9 on page 26 shows the CPU and the location of the DIMM slots. It shows one of the two server canisters for an IBM Elastic Storage System 3000 (5141-AF8), which is open and oriented for DIMM removal and replacement.

  • Page 39: Planning For Power For Server Canister

    Attention: The power cord is the main power disconnect. Ensure that the socket outlets are located near the equipment and are easily accessible. Figure 12 on page 28 shows the back of a Elastic Storage System 3000. Each PSU is located on the sides of ESS 3000.
  • Page 40 Determining your power requirements https://www.ibm.com/support/knowledgecenter/ POWER8/p8had/p8had_power.htm?view=kc Server Information Form 3A https://www.ibm.com/support/knowledgecenter/ POWER8/p8had/p8had_form3a.htm?view=kc Workstation Information Form 3B https://www.ibm.com/support/knowledgecenter/ POWER8/p8had/p8had_form3b.htm?view=kc Plugs and receptacles https://www.ibm.com/support/knowledgecenter/ POWER8/p8had/p8had_plugs.htm?view=kc Supported PDU power cords https://www.ibm.com/support/knowledgecenter/ POWER8/p8had/p8had_pdupowercords.htm? view=kc 28 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 41: Physical Installation Planning

    Supported hosts IBM Spectrum Scale needs to be installed on the host server before it is connected to ESS 3000. IBM Spectrum Scale provides the high-performance scale-out clustering capabilities. For a list of supported host type and OS, see the IBM Spectrum Scale Frequently Asked Questions.

  • Page 42: User Interfaces

    It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (R001 part 1 of 2) 30 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 43 If there is less airflow, additional mechanisms are required to cool the enclosure. An appropriate IBM rack configuration would be the 7014-T42 IBM Rack Model T42, with standard rear door and feature code 6069 Front Door For 2.0 Meter Rack (High Perforation).
  • Page 44 Conduct your own testing to determine specific measurements for your environment. Each Elastic Storage System 3000 enclosure contains two PSUs for redundancy. The total power consumption values represent the total power that is drawn by both PSUs.
  • Page 45 (33.5 in.) (98.87 lb) (109.46 lb) The following table shows the rack space requirements for ESS 3000 in tabular form: Table 12. Rack space requirements for the Elastic Storage System 3000 Minimum rail length Maximum rail depth 670 mm (26.38 in.) 870 mm (34.25 in.)

  • Page 46: Additional Space Requirements

    Figure 13. Sample illustration to show space around the rack For Elastic Storage System 3000, use the recommended measurements that are given in the Table 13 on page 34. Table 13. Service clearance requirements Front Back 1200 mm (47 in.) 1000 mm (39 in.)

  • Page 47: Supported Drives

    Supported drives Table 15 on page 35 provides drive specifications for your Elastic Storage System 3000 system. Table 15. Drive specifications Model and type 2.5-inch drives Elastic Storage System 3000 with 24 2.5-inch drive 24 dual port NVMe drives (1.92 TB, 3.84 TB, 7.68 TB, slots 15.36 TB)
  • Page 48 Shock and vibration specifications for Elastic Storage System 3000 enclosures Table 16 on page 37 and Table 17 on page 37 provide the shock and vibration testing results for your Elastic Storage System 3000 system. 36 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 49: Ip Address Allocation And Usage

    To locate a device, the device must have a fixed IP address. Planning for high availability IBM Spectrum Scale can provide rack level redundancy and stretched cluster using file system data replication. AFM-DR can be used for site-level disaster recovery. For more details, see IBM Spectrum Scale Knowledge Center.

  • Page 50: Planning For 100 Gbps Adapter

    Planning for cables Connections for Elastic Storage System 3000 Care must be taken to note the orientation of each server canister in Elastic Storage System 3000 so that the interconnect cables are properly connected. Elastic Storage System 3000 contains two server canisters. A label on ESS 3000 identifies each server canister and power supply unit (PSU).
  • Page 51 Make the following connections for Elastic Storage System 3000: • Each ESS 3000 system requires two Ethernet cables to connect it to an Ethernet switch. One cable connects to port 1 of the top server canister, and the other cable connects to port 1 of the bottom server...

  • Page 52: Planning For Adapters

    AJP1 cannot be ordered with EC64 and EC67. AJP1 and EC64, EC67 are mutually exclusive in initial orders. Planning for adapters Elastic Storage System 3000 contains two server canisters. Each server canister has three PCIe interface slots to support extra adapters. InfiniBand and Ethernet adapters are supported in any of the interface slots.

  • Page 53: Chapter 4. Installing

    This section covers topics on how to rack, stack, unpack, and install an ESS 3000 system. It also guides the customer on how to fill out the installation worksheet. The SSR can refer to the “Elastic Storage System 3000 installation (SSR task)” on page 54 topic to perform a hardware checkout and set the management interface IP.

  • Page 54: Detailed Installation Steps (Ssr Task)

    EMS to all other Power nodes. 3. Use the instructions in the “Elastic Storage System 3000 installation (SSR task)” on page 54 to check the nodes using the essutils tool, starting with the node located at the bottom of the rack.

  • Page 55: Rack Details

    Unpacking Elastic Storage System 3000 (IBM SSR task) Before you unpack Elastic Storage System 3000, ensure that you have reviewed and followed all the related instructions. The ESS 3000 system and related parts are shipped pre-installed in the enclosure: •...

  • Page 56: Installing Support Rails For The Ess 3000 System (Ibm Ssr Task)

    2. Working at the front of the rack cabinet, identify the two standard rack units (2U) of space in the rack into which you want to install the support rails. Figure 19 on page 45 shows two rack units with the front mounting holes identified. 44 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 57 Figure 19. Hole locations in the front of the rack • Upper rail-mounting bracket pin • Lower rail-mounting bracket pin • Rack mounting screw hole 3. Ensure that the appropriate bracket pins are installed in the front and rear bracket of each rail. Each rail comes with four medium pins pre-installed (two in the front bracket and two in the rear bracket).
  • Page 58 10. Secure the rear of the rail to the rear rack flange with two black M5 screws. 11. Repeat the steps to secure the opposite rail to the rack cabinet. 12. Repeat the procedure to install rails for each additional ESS 3000 system. 46 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 59: Installing Enclosures (Ibm Ssr Task)

    Installing enclosures (IBM SSR task) Following your enclosure location plan, install the ESS 3000 system. CAUTION: • To lift an ESS 3000 system requires at least three people. • Install an ESS 3000 system only onto the ESS 3000 system rails supplied with the enclosure.
  • Page 60 Fit the slot on the top of the end cap over the tab on the flange. c) Rotate the end cap down until it snaps into place. d) Ensure that the inside surface of the end cap is flush with the flange. 48 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 61: Connecting The Components (Ibm Ssr Task)

    6. At this point, the rails and ESS 3000 enclosure are installed, the enclosure is mounted on the rail with all the components that were removed, reinserted into the slots. Connecting the components (IBM SSR task) After installing rails and the ESS 3000 enclosure in the rack, the next step is to connect to the power and network.

  • Page 62: Powering On The System

    For information on how to set an IP on a Windows 10 computer, see the instructions on the Change TCP/IP settings page at the Microsoft website. 3. Complete the steps outlined in the “Elastic Storage System 3000 installation (SSR task)” on page 54. 50 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 63: Install And Connect Management Server 5148-21L

    For information, see ESS network cabling on the IBM Worldwide Customized Installation Instructions (WCII) website. Connect AC (wall) power to the rack PDUs For information, see Connect AC (wall) power to the rack PDUs on the IBM Worldwide Customized Installation Instructions (WCII) website. Power On switches, storage enclosures, and servers For information, see Power On Switches, Storage Enclosures and Servers on the IBM Worldwide Customized Installation Instructions (WCII) website.

  • Page 64: Installation Prerequisites (Ssr Task)

    – There must be a dedicated switch/subnet for ESS or shared switch with isolated VLANs for ESS. – It is recommended to procure this switch from IBM, but customer-provided switch can also be used. 52 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 65 Note: An IBM intranet connection is required. If the switch was not purchased from IBM, there must be two isolated VLANS for ESS management. Do note that the customer provided switch might not be supported by IBM. – The switch must be placed in the rack, cabled, powered on, and properly VLAN'd for the SSR to start.

  • Page 66: Elastic Storage System 3000 Installation (Ssr Task)

    Elastic Storage System 3000 installation (SSR task) This document is intended to be used by the SSR at the customer site to complete installation. The document is for new customers of Elastic Storage System 3000 only (EMS + one or more ESS 3000 units). Note: •...
  • Page 67 2) Connect the laptop using Ethernet to the C10-T4 (Port 4 - Bottom, see Figure 39 on page 73) of 1 Gb NIC on the EMS (if it is racked, a cable might be already inserted into this port. Temporarily remove it to plug your laptop). 3) Define the IP on the laptop to 10.0.0.100 with subnet 10.0.0.0/24, netmask 255.255.255.0, and gateway 10.0.0.1.
  • Page 68 C11-T4 port of IP 110.111.222.101 after the node is booted. If the ping does not work attempt to manually set a static IP on your laptop of 10.111.222.102 and netmask 255.255.255.252. If the problems still persist, see “Power9 EMS Boot issues” on page 64. 56 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 69: Ems Ssr Menu

    Figure 30. EMS SSR menu You can use the same commands that you use to check an I/O server except for the two command options, Check enclosure cabling and paths to disks and Check disks for IO operations. You will not run these options because the EMS nor protocol nodes contain any SAS adapter or external storage like the I/O servers.
  • Page 70 Before you log in, increase the size of the putty window and the putty text. g. SSH login by using the following credentials: uid: essserv1 pw:<{Enclosure serial number}B> 58 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 71: Essutils Tool

    • Add a ‘B’ at the end of the enclosure serial number for the top canister for password. For example, if the enclosure serial number is 01YM312, the password for the top canister will be 01YM312B. The essutils tool opens. h.
  • Page 72 Connect the laptop using an Ethernet cable to service port. See Figure 31 on page 58 for the service port location (also called as technician port). b. Define the IP on the laptop to 10.0.0.100 with subnet 10.0.0.0/24, netmask 255.255.255.0. 60 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 73 c. Open a terminal window (not putty). d. Ping 10.0.0.101. If successful, go to the next step. It may take up to five minutes for the server to respond at initial start up process. If there are any issues, check Ethernet cable and switch, and verify the laptop IP address.
  • Page 74 Before moving on, ensure that there are no faulty LED lights on this canister. If you face any issues, see the Chapter 5, “Troubleshooting (SSR tasks),” on page 63 topic. 62 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 75: Chapter 5. Troubleshooting (Ssr Tasks)

    This section will help you troubleshoot issues faced while configuring EMS and Elastic Storage System 3000. Note: Ensure that you have gone through the “Installation prerequisites (SSR task)” on page 52 topic and also followed the steps given in the “Elastic Storage System 3000 installation (SSR task)” on page 54 topic. EMS issues Power8 EMS Boot issues When booting up the node, if you face any issue while pinging the FSP interface (C10-T4 IP 10.0.0.1) five...
  • Page 76 SSR task is complete. If you face issues logging in with username: essserv1 and password: <serial number of server>, perform the following steps: • Log in as a root user: 64 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 77: Ess 3000 Issues

    If you have any issues that are related to the management or high-speed switches, see ESS – Switch Update and Configuration Guide. Note: An IBM intranet connection is required to open this document. Some important chapters in this document are as follows: •...

  • Page 78: Ssr Port Login Issues

    Try to set that IP address and attempt ping. If the ping test still does not work (Ensure that the system is also booted up – apply power and press the front white button. Wait minimum 5 minutes though it could be up to 20 minutes to boot a data server.) call IBM service. Assigning the management IP address This section covers the issues that are faced while you set the management IP address by using the essutils tool.
  • Page 79 3. Open the ifcfg- file and press Enter. # vi ifcfg-interface name A sample output is as follows: 4. Edit the ifcfg- file. Press 'i' on the keyboard to enter the insert mode. You can see Insert at bottom of the screen. 5.
  • Page 80 # ifconfig interface name Example: ifconfig enP1p8s0f0 68 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 81: Chapter 6. Converting An Older Elastic Storage System Management Server For Ess 3000 Compatibility

    Red Hat Enterprise Linux 7.7 Server mediaid=1359576196.686790 metadata_expire=-1 gpgcheck=1 cost=500 enabled=1 baseurl=file:///mnt/disc/ gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release # yum clean all # yum repolist enabled d) Upgrade the operating system. # yum -y update e) Restart the node. # systemctl reboot © Copyright IBM Corp. 2019, 2020...
  • Page 82 Install Python 3. # mount -o loop iso file /mnt # yum -y install python3 g) Set Python 3 alternatives. update-alternatives --install /usr/bin/python python /usr/bin/python3 1 update-alternatives --config python python --version 70 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 83: Appendix A. Planning Worksheets (Customer Task)

    Prerequisite (for SSR): You must be connected to the SSR access port of the target canister (top or bottom). See the “Elastic Storage System 3000 installation (SSR task)” on page 54 for steps required to check the hardware and set the desired IP addresses outlined in this worksheet by the customer.

  • Page 84: Rear View Of Ess 3000

    Figure 38. Port mapping on the back of the EMS The SSR connects to C10-T4 (bottom port) on the 1Gb card to access the server and run the essutils tool. 72 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 85: Sas Hba Port Schema

    Figure 39. Rear view of the POWER8 EMS node Figure 40 on page 73 shows the EMS server P2P cabling. Figure 40. EMS server P2P cabling SAS HBA Port Schema Figure 41 on page 73 shows the SAS HBA port schema. Figure 41.
  • Page 86 Customers must fill in the following values so that the SSR is able perform the required networking tasks. If there are more than one ESS 5000 node being installed, you will need to add the corresponding rows. 74 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 87 Recommendations: • Keep all management interfaces on 192.168.x.x/24 (netmask 255.255.255.0). • Keep all FSP (HMC1) interfaces on 10.0.0.x/24 (netmask 255.255.255.0). Note: The EMS has an additional FSP connection at C11-T2, which is visible to the operating system. Important: All IP addresses must on the same subnet. For example, •...
  • Page 88 (bottom) POWER9 EMS (should be only one) IP address Netmask EMS management interface 192.168.45.20 255.255.255.0 EMS FSP (HMC1 port) interface 10.0.0.100 255.255.255.0 EMS FSP (C11-T2) interface 10.0.0.1 255.255.255.0 76 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 89: Call Home Worksheet

    Note: It is recommended to open 129.42.0.0/18. 3. (Optional) If client internet does not allow direct access to the internet, set up a proxy. If the proxy requires authentication, set a user ID and a password, and share it with the IBM service personnel.
  • Page 90 EIA 17 EIA 16 EIA 15 EIA 14 EIA 13 EIA 12 EIA 11 EIA 10 EIA 9 EIA 8 EIA 7 EIA 6 EIA 5 EIA 4 EIA 3 78 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 91 Table 21. Hardware locations of enclosures and other devices (continued) Rack unit Component EIA 2 EIA 1 Table 22 on page 79 lists the rack requirements for the different Elastic Storage System 3000 enclosure types. Table 22. Enclosure models and rack requirements Device Machine type and model...
  • Page 92 80 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 93: Appendix B. Cabling Guide (Ssr Tasks)

    Appendix B. Cabling Guide (SSR tasks) This chapter illustrates various cabling scenarios of IBM Elastic Storage System 3000. For information on cables, see “Connections for Elastic Storage System 3000” on page 38. © Copyright IBM Corp. 2019, 2020...

  • Page 94: Cabling Scenario 1

    Cabling Scenario 1 IBM Elastic Storage System 3000 as a part of the entire ESS setup including ESS GL / GS / GH units with Protocol nodes and the EMS node. 82 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 95: Cabling Scenario 2

    Cabling Scenario 2 IBM Elastic Storage System 3000 as a part of the entire ESS setup with Protocol nodes and the EMS node. Appendix B. Cabling Guide (SSR tasks) 83...

  • Page 96: Cabling Scenario 3

    Cabling Scenario 3 High speed networking with IBM Elastic Storage System 3000, Protocol nodes, and the EMS node. 84 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 97: Cabling Scenario 4

    Cabling Scenario 4 High speed networking with IBM Elastic Storage System 3000 and the EMS node. Appendix B. Cabling Guide (SSR tasks) 85...

  • Page 98: Cabling Scenario 5

    Cabling Scenario 5 Management networking with IBM Elastic Storage System 3000, Protocol nodes, and the EMS node. 86 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 99: Cabling Scenario 6

    Cabling Scenario 6 Management networking with IBM Elastic Storage System 3000 and the EMS node. Appendix B. Cabling Guide (SSR tasks) 87...
  • Page 100 88 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 101: Appendix C. Converting An Older Elastic Storage System Management Server For Ess 3000 Compatibility

    Red Hat Enterprise Linux 7.7 Server mediaid=1359576196.686790 metadata_expire=-1 gpgcheck=1 cost=500 enabled=1 baseurl=file:///mnt/disc/ gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release # yum clean all # yum repolist enabled d) Upgrade the operating system. # yum -y update e) Restart the node. © Copyright IBM Corp. 2019, 2020...
  • Page 102 Install Python 3. # mount -o loop iso file /mnt # yum -y install python3 g) Set Python 3 alternatives. update-alternatives --install /usr/bin/python python /usr/bin/python3 1 update-alternatives --config python python --version 90 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 103: Accessibility Features For The System

    IBM Knowledge Center (www.ibm.com/support/knowledgecenter). Keyboard navigation This product uses standard Microsoft Windows navigation keys. IBM and accessibility See the IBM Human Ability and Accessibility Center (www.ibm.com/able) for more information about the commitment that IBM has to accessibility. © Copyright IBM Corp. 2019, 2020...
  • Page 104 92 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 105: Glossary

    • See refers you from a non-preferred term to the preferred term or from an abbreviation to the spelled- out form. • See also refers you to a related or contrasting term. For other terms and definitions, see the IBM Terminology website (opens in new window): http://www.ibm.com/software/globalization/terminology building block A pair of servers with shared disk enclosures attached.
  • Page 106 ESS to a single cluster in the ESS when the other clusters in the ESS fails. See also cluster. (3) The routing of all transactions to a second controller when the first controller fails. See also cluster. 94 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 107 failure group A collection of disks that share common access paths or adapter connection, and could all become unavailable through a single hardware failure. See file encryption key (FEK). file encryption key (FEK) A key used to encrypt sectors of an individual file. See also encryption key. file system The methods and data structures used to control how data is stored and retrieved.
  • Page 108 Provides a way to control the bundling of several physical ports together to form a single logical channel. logical partition (LPAR) A subset of a server's hardware resources virtualized as a separate computer, each with its own operating system. See also node. 96 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 109 LPAR See logical partition (LPAR). management network A network that is primarily responsible for booting and installing the designated server and compute nodes from the management server. management server (MS) An ESS node that hosts the ESS GUI and xCAT and is not connected to storage. It must be part of a GPFS cluster.
  • Page 110 See recovery group (RG). recovery group data (RGD) Data that is associated with a recovery group. RKM server See remote key management server (RKM server). See Serial Attached SCSI (SAS). 98 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 111 secure shell (SSH) A cryptographic (encrypted) network protocol for initiating text-based shell sessions securely on remote computers. Serial Attached SCSI (SAS) A point-to-point serial protocol that moves data to and from such computer storage devices as hard drives and tape drives. service network A private network that is dedicated to managing POWER8 servers.
  • Page 112 100 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...

  • Page 113: Index

    23 sound pressure information overview xi safety notices 10 inspections, safety space requirements external device check 9 Elastic Storage System 3000 34 installation worksheet 71 specifications interfaces 30 shock 36 vibration 36 SSR access port 50 Index 101...
  • Page 114 SSR install 54 SSR port 66 static-sensitive devices 10 submitting xii trademarks 2 vibration specifications 36 documentation xi resources xi 102 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 115 23 sound pressure information overview xi safety notices 10 inspections, safety space requirements external device check 9 Elastic Storage System 3000 34 installation worksheet 71 specifications interfaces 30 shock 36 vibration 36 SSR access port 50 Index 103...
  • Page 116 SSR install 54 SSR port 66 static-sensitive devices 10 submitting xii trademarks 2 vibration specifications 36 documentation xi resources xi 104 IBM Elastic Storage System 3000: Hardware Planning and Installation Guide...
  • Page 118 IBM® Product Number: 5765-DME 5765-DAE GC28-3156-01...