You use the ISI in conjunction with this procedure to install and cable the disk shelves. ISIs are also available on the Lenovo Support Web site. Lenovo Data Center Support Considerations for installing and cabling disk shelves with IOM12...
Installing disk shelves with IOM12 modules for a new system installation You install the disk shelves in a rack using the rack mount kits that came with the disk shelves. About this task For DM120S and DM240S, the video for this task is available at: • Youtube: https://www.youtube.com/playlist?list=PLYV5R7hVcs-Bl5q5uqIV0US3rLklB5GOP •...
Page 7
The following illustration shows how the drives are numbered from 0 to 11 in each drive drawer within the shelf. In a shelf containing 30 drives, slots 0, 1, 3, 6, 9, and 10 must contain drives. Reinstall any power supplies and IOMs you removed prior to installing your disk shelf into the rack.
Otherwise, go to the next step. For a detailed explanation and examples of shelf-to-shelf “standard” cabling and shelf-to-shelf “double-wide” cabling, see the “shelf-to-shelf connection rules” section. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 9
If... Then... You are cabling a multipath HA, multipath, single-path HA, or single-path configuration Cable the shelf-to-shelf connections as “standard” connectivity (using IOM ports 3 and a. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.
Page 10
Set the shelf IDs and complete system setup: You must set shelf IDs so they are unique within the HA pair configuration, including the internal disk shelf in a DM3000x, DM5000x, or DM7000x. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 11
If... Then... You are manually setting shelf IDs a. Access the shelf ID button behind the left end cap. b. Change the shelf ID to a unique ID (00 through 99). c. Power-cycle the disk shelf to make the shelf ID take effect.Wait at least 10 seconds before turning the power back on to complete the power cycle.
Page 12
You can use the wildcard character to assign more than one disk at once. Step 7. Verify that in-band ACP was automatically enabled. storage shelf acp show In the output, “in-band” is listed as “active” for each node. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
For each disk shelf you are hot-adding, you install the disk shelf into a rack, connect the power cords, power on the disk shelf, and set the disk shelf ID before cabling the SAS connections. About this task For DM120S and DM240S, the video for this task is available at: • Youtube: https://www.youtube.com/playlist?list=PLYV5R7hVcs-Bl5q5uqIV0US3rLklB5GOP •...
Page 15
When installing DM600S disk shelves, remove the power supplies and I/O modules (IOMs) to make the disk shelf lighter and easier to maneuver. Step 3. If you are installing a DM600S disk shelf, install the components into the racked disk shelf; otherwise, go to the next step.
You must have met the requirements in the “Requirements for a hot-adding disk shelves with IOM12 modules” section and installed, powered on, and set shelf IDs for each disk shelf as instructed in the “Installing disk shelves with IOM12 modules for a hot-add” section. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 17
About this task • For an explanation and examples of shelf-to-shelf “standard” cabling and shelf-to-shelf “double-wide” cabling, see the “Shelf-to-shelf SAS connection rules” section. • Instructions about how to read a worksheet to cable controller-to-stack connections can be found towards the back of this guide. •...
Page 18
If you are hot-adding one or more disk shelves to an end—the logical first or last disk shelf—of an existing stack, complete the applicable substeps for your configuration; otherwise, go to the next step. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 19
Shelf Name: 2.5 Stack ID: 2 Shelf ID: 5 Shelf UID: 40:0a:09:70:02:2a:2b Serial Number: 101033373 Module Type: IOM12 Model: DM240S Shelf Vendor: Lenovo Disk Count: 24 Connection Type: SAS Shelf State: Online Status: Normal Chapter 2 Hot-adding disk shelves with IOM12 modules...
Page 20
If your configuration is running in-band ACP, verify that in-band ACP was automatically enabled on hot-added disk shelves: storage shelf acp show In the output, “in-band” is listed as “active” for each node. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 22
Run the storage shelf show -fields shelf-id command to see a list of shelf IDs already in use including any duplicate IDs. If your system has any duplicate shelf IDs, change the duplicate shelf IDs by repeating this procedure. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 24
Multipath HA with one quad-port SAS HBA and one single-shelf stack The following worksheet and cabling example uses port pair 1a/1d: Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 25
Multipath HA with one quad-port SAS HBA and two single-shelf stacks The following worksheet and cabling example uses port pairs 1a/1d and 1c/1b: Multipath HA with two quad-port SAS HBAs and two multi-shelf stacks Four port pairs are available for this configuration: 1a/2b, 2a/1d, 1c/2d, and 2c/1b. You can cable port pairs in the order in which they are identified (listed in the worksheet) or you can cable every other port pair (skip port pairs).
Page 26
The following worksheet and cabling example shows port pairs being used in the order in which they are listed in the worksheet: 1a/2b, 2a/1d, 1c/2d, and 2c/1b. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
The following worksheet and cabling example shows port pairs being skipped to use every other one in the list: 1a/2b and 1c/2d. Note: If a third stack is added later, you use the port pair that was skipped. Controller-to-stack cabling worksheets and cabling examples for multipath HA configurations with four onboard SAS ports You can use the completed controller-to-stack cabling worksheets and cabling examples to cable common multipath HA configurations that have four onboard SAS ports.
Page 28
Multipath HA with four onboard SAS ports and one single-shelf stack The following worksheet and cabling example uses port pair 0a/0d: Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 29
Multipath HA with four onboard SAS ports and two single-shelf stacks The following worksheet and cabling example uses port pairs 0a/0d and 0c/0b: Multipath HA with four onboard SAS ports, a quad-port SAS HBA, and two multi-shelf stacks Four port pairs are available for this configuration: 0a/1b, 1a/0d, 0c/1d, and 1c/0b. You can cable port pairs in the order in which they are identified (listed in the worksheet) or you can cable every other port pair (skip port pairs).
Page 30
The following worksheet and cabling example shows port pairs being used in the order in which they are listed in the worksheet: 0a/1b, 1a/0d, 0c/1d, and 1c/0b. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 31
The following worksheet and cabling example shows port pairs being skipped to use every other one in the list: 0a/1b and 0c/1d. Note: If a third stack is added later, you use the port pair that was skipped. Chapter 4 Controller-to-stack cabling worksheets and cabling examples for common multipath HA configurations...
Page 32
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 34
DM3000x, DM5000x, or DM7000x multipath HA configuration with one multi-shelf stack The following worksheet and cabling example uses port pair 0a/0b: Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 36
Each port pair designated for quad-pathed cabling is encircled by a rectangle that is the color associated with the stack it is cabled to. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 37
Quad-path HA with two quad-port SAS HBAs and two multi-shelf stacks The following worksheet and cabling example uses port pairs 1a/2b (multipathed) and 2a/1d (quad-pathed) for stack 1, and port pairs 1c/2d (multipathed) and 2c/1b (quad-pathed) for stack2. Chapter 6 Controller-to-stack cabling worksheet and cabling example for a quad-path HA configuration with two quad-port SAS HBAs...
Page 38
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
• Best practice is to use IOM ports 3 and 1 for standard shelf-to-shelf connectivity. From the logical first shelf to the logical last shelf in a stack, you connect IOM port 3 to the next shelf's IOM port 1 in domain A and then domain B. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Double-wide shelf-to-shelf connectivity • Double-wide shelf-to-shelf connectivity is used in quad-pathed (quad-path HA and quad-path) configurations. • Double-wide shelf-to-shelf connectivity requires two cable connections between disk shelves in each domain—domain A (IOM A) and domain B (IOM B). The first cable connection is cabled as standard shelf- to-shelf connectivity (using IOM ports 3 and 1);...
Page 42
• B and D ports are connected to the stacks by offsetting the order of the PCI slots by one so that the first port on the first slot is cabled last. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 43
The following illustration highlights how controller ports B and D connect in a multipath HA configuration with one quad-port HBA and two stacks of disk shelves. Connections to stack 1 are shown in blue. Connections to stack 2 are shown in orange. Port pair connection rules (for non DM3000x, DM5000x, or DM7000x configurations) Controller SAS ports A, B, C, and D are organized into port pairs using a method that leverages all of the SAS ports for system resiliency and consistency when cabling controller-to-stack connections in HA pair...
Page 44
– Port 0a is always the secondary path. – Port 0a always connects to the logical first disk shelf in a stack. – Port 0a always connect to disk shelf IOM port 1. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 45
The following illustration highlights internal storage port (0b) domain connectivity for a DM3000x, DM5000x, or DM7000x multipath HA configuration: Chapter 7 SAS cabling rules...
Page 46
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 48
Note: When you have more port pairs than you need to cable the stacks in your system, the best practice is to skip port pairs to optimize the SAS ports on your system. By optimizing SAS ports, you optimize your system's performance. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 49
You can use your completed worksheet to cable your system. Chapter 8 Controller-to-stack cabling worksheet template for multipathed connectivity...
Page 50
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 52
Cable controller 2 port 1c to stack 2, first shelf IOM B port 1. Cable controller 1 port 2d to stack 2, last shelf IOM B port 3. Cable controller 2 port 2d to stack 2, last shelf IOM A port 3. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 54
1 in your HA pair configuration.The following example uses port pair 1c/2d for the multipathed cabling and port pair 2c/1b for the quad-pathed cabling to stack 2. Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 56
Cable controller 1 port 2d to stack 2, last shelf IOM B port 3. Cable controller 2 port 2d to stack 2, last shelf IOM A port 3. Step 4. Cable port pair 2c/1b on each controller to stack 2: Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Page 57
This is the quad-pathed cabling for stack 2. Once completed, stack 2 has quad-pathed connectivity to each controller. Cable controller 1 port 2c to stack 2, first shelf IOM A port 2. Cable controller 2 port 2c to stack 2, first shelf IOM B port 2. Cable controller 1 port 1b to stack 2, last shelf IOM B port 4.
Page 58
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Appendix A. Contacting Support You can contact Support to obtain help for your issue. You can receive hardware service through a Lenovo Authorized Service Provider. To locate a service provider authorized by Lenovo to provide warranty service, go to https://datacentersupport.lenovo.com/ serviceprovider and use filter searching for different countries.
Page 62
Installation and Cabling Guide for DM120S, DM240S, and DM600S...
Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any Lenovo intellectual property right may be used instead.
Page 66
IOM12 modules for a hot-add controller-to-stack cabling worksheet template for multipath disk shelves with IOM12 modules for a new system HA and multipath configurations installation Installation and Cabling Guide for DM120S, DM240S, and DM600S...