Lenovo ThinkSystem DM3000 series Hardware Installation And Maintenance Manual
  1. Manuals
  2. Brands
  3. Lenovo Manuals
  4. Storage
  5. ThinkSystem DM3000 series
  6. Hardware installation and maintenance manual

Lenovo ThinkSystem DM3000 series Hardware Installation And Maintenance Manual

Hide thumbs Also See for ThinkSystem DM3000 series:
Table of Contents

Advertisement

Quick Links

ThinkSystem DM3000x and DM5000x
Hardware Installation and Maintenance Guide
Machine Types: 7Y41, 7Y42, and 7Y57

Advertisement

Table of Contents
loading

Related Manuals for Lenovo ThinkSystem DM3000 series

Summary of Contents for Lenovo ThinkSystem DM3000 series

  • Page 1 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide Machine Types: 7Y41, 7Y42, and 7Y57...
  • Page 2 Before using this information and the product it supports, be sure to read and understand the safety information and the safety instructions, which are available at: http://thinksystem.lenovofiles.com/help/topic/safety_documentation/pdf_files.html In addition, be sure that you are familiar with the terms and conditions of the Lenovo warranty for your server, which can be found at: http://datacentersupport.lenovo.com/warrantylookup First Edition (September 2018) ©...

  • Page 3: Table Of Contents

    Replacing the chassis ... . Reinstalling the controller module ..Workflow diagram ... . © Copyright Lenovo 2018...
  • Page 4 Chapter 6. Upgrading controller hardware ....87 Appendix B. Lenovo Privacy Considerations for upgrading controller Policy ....129 hardware .

  • Page 5: Safety

    Vor der Installation dieses Produkts die Sicherheitshinweise lesen. Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza. Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet. Antes de instalar este produto, leia as Informações sobre Segurança. © Copyright Lenovo 2018...
  • Page 6 Antes de instalar este producto, lea la información de seguridad. Läs säkerhetsinformationen innan du installerar den här produkten. ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 7: Chapter 1. Introduction

    • For models with 24 drive bays in the front: 19.4 kg (42.77 lb) Processor Two 64 bit 12-core 1.5 GHz processors DIMM • Total capacity: 64 GB • Four 16 GB DIMMs • NVRAM/NVMEM used capacity: 8 GB © Copyright Lenovo 2018...
  • Page 8 Table 1. Specifications (continued) Specification Description Power supplies Two hot-swap power supplies for redundancy support Storage maximums and limits • Max. raw capacity (HA): – For models with 12 drive bays in the front: 2160.8 TB – For models with 24 drive bays in the front: 2203.2 TB •...
  • Page 9 Chapter 1 Introduction...

  • Page 10: Management Software

    Tech Tips Lenovo continually updates the support website with the latest tips and techniques that you can use to solve issues that you might have with your system. These Tech Tips (also called retain tips or service bulletins) provide procedures to work around issues related to the operation of your system.

  • Page 11: Chapter 2. System Components

    The chassis location LED is manually activated to help locating the Chassis location LED Solid blue or (front) blinking blue chassis. The chassis location LED is not activated. Number displayed Display the shelf ID. Shelf ID digital display © Copyright Lenovo 2018...

  • Page 12: Rear View

    Front view without bezel Figure 2. Front view of models with 12 drive bays Figure 3. Front view of models with 24 drive bays Table 3. Components on the front of the system (without bezel) Chassis power LED Chassis attention LED (front) Chassis location LED (front) Shelf ID digital display Shelf ID change button...

  • Page 13: Rear View Leds

    Rear view – type 1 Figure 4. Rear view – type 1 Table 4. Components on the rear of the system MiniSAS HD ports (4) SFP+ Ethernet ports (4) UTA2 SFP+ ports (8) Micro-B USB console ports (2) RJ45 console ports (2) Host USB Type-A connectors (2) RJ45 management ports (2) Power supply buttons (2)
  • Page 14 Figure 6. Rear view LEDs – type 1 Table 6. LEDs on the rear of the system MiniSAS HD port link LED (4) MiniSAS HD port attention LED (4) SFP+ Ethernet port link LED (4) SFP+ Ethernet port attention LED (4) UTA2 SFP+ port link LED (8) UTA2 SFP+ port attention LED (8) Controller activity LED (2)
  • Page 15 Table 7. LEDs on the rear of the system (continued) RJ45 management port link LED (2) RJ45 management port activity LED (2) Power supply attention LED (2) AC power good LED (2) MiniSAS HD port LEDs Each MiniSAS HD port has two status LEDs. Status LED Color Status...
  • Page 16 Controller activity LED Description Status Color Green The controller is active. None The controller is off. Controller attention LED Status Color Description Yellow The controller requires attention. None The controller operates normally. Controller location LED Status Color Description On or blinking Blue The controller location LED is manually activated to help locating the controller.

  • Page 17: Chapter 3. Rail Kit Installation Instructions

    Any equipment that requires Install cage nuts above mounting above the rail top hole the rail as needed. will require customer- provided screws and cage nuts. 10x32 Do not overtighten screws threads Front 10-32x0.75” screw Repeat for both sides © Copyright Lenovo 2018...

  • Page 18: Dm/De Series 2U12 Rail Kit Installation Instructions

    Installing Rail to round-hole four-post rack (M4x15) x 12 Rails x 2 Left, right, front, rear Front Rear Partially tighten Tighten all rear M4x15 screws Tighten screw front screws Do not install this screw on the front brackets for all 2U drive shelves and systems.
  • Page 19 • Round-head M5 screws pre-installed in rails, qty 2 • Alignment screws Verify that you have the correct rail type by examining the PN label located on the outer box for the following: • Four-Post: SM17A38396 The kit includes the following types of screws: Type of hardware Description Quantity...
  • Page 20 Repeat these steps for the other rail. Step 3. Place the back of the enclosure (the end with the connectors) on the rails. Attention: A fully loaded enclosure weighs approximately 65 lb (29 kg). Two persons are required to safely move the enclosure. Step 4.
  • Page 21 Step 6. Secure the enclosure to the back of the rails by inserting two M5 screws through the brackets at the enclosure and the rail kit bracket. Step 7. If applicable, replace the shelf end caps or the system bezel. Step 8.
  • Page 22 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 23: Chapter 4. System Installation And Setup

    Before you begin You need to have access to Lenovo Press for information on your site requirements as well as additional information on your configured system. © Copyright Lenovo 2018...

  • Page 24: Installing The Hardware

    Make a note of the number and types of cables you received. The following table identifies the types of cables you might receive. If you receive a cable not listed in the table, refer to the Lenovo Press to locate the cable and identify its use.

  • Page 25: Cabling A Two-Controller Switchless Cluster, Unified Network Configuration

    Step 3. Attach cable management devices (as shown). Step 4. Place the bezel on the front of the system. Cabling a two-controller switchless cluster, unified network configuration Management network, UTA2 data network, and management ports on the controllers are connected to switches.

  • Page 26: Cabling A Two-Controller Switchless Cluster, Ethernet Network Configuration

    Step 2. To cable your storage, see “Cabling controllers to drive shelves” on page 22. Cabling a two-controller switchless cluster, Ethernet network configuration Management network, Ethernet data network, and management ports on the controllers are connected to switches. The cluster interconnect ports are cabled on both controllers. Before you begin See your network administrator for help connecting to the switches.

  • Page 27: Cabling A Switched Cluster, Ethernet Network Configuration

    To cluster switches To data network To management switches network switches Step Perform on each controller Ports used Cable the cluster interconnect ports to the cluster interconnect • e0a switches. • e0b • e0c and e0d Cable the UTA2 data ports to the data network switches. •...

  • Page 28: Cabling Controllers To Drive Shelves

    Step Perform on each controller Ports used Cable the management ports to the management network • e0M switches. DO NOT the plug power cords in at this point. Not applicable. Step 2. To cable your storage, see “Cabling controllers to drive shelves” on page 22. Cabling controllers to drive shelves You must cable the controllers to your drive shelves or to the onboard SAS ports if you only have onboard drives and no external drive shelves.

  • Page 29: Completing System Setup And Configuration

    Step 1. Cable the HA pair with external drive shelves using the following steps: IOMA IOMB IOM12 IOM12 First shelf 1 1 1 IOM12 IOM12 IOM12 IOM12 Last shelf Step Perform on each controller Ports used • Port 3 on IOM A to port 1 on the IOM A on the shelf directly below.
  • Page 30 Connect the console cable to the client and the console port on the controller module using the console cable that came with your system. 1 1 1 Connect the client to the switch on the management subnet. 1 1 1 Client Management subnet Assign a TCP/IP address to the client, using one that is on the management subnet.
  • Page 31 Note: See your client's online help for how to configure the console port. Step 6. Assign an initial controller management IP address to one of the controllers. If the management network has DHCP... Then... Record the IP address assigned to the new Configured controller modules.
  • Page 32 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 33: Chapter 5. Hardware Replacement Procedures

    Pull the cam handle to its fully open position to unseat the disk drive from the midplane and gently slide the disk drive out of the disk shelf. For example, the following illustration shows a disk drive with the cam handle in its fully open position. © Copyright Lenovo 2018...

  • Page 34: Replacing The Caching Module

    If you are replacing another disk drive, repeat Steps 1 through 7. Step 9. Reinstall the bezel. Step 10. Return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional help with the Lenovo Support replacement procedure.

  • Page 35: Shutting Down The Degraded Controller

    Shutting down the degraded controller You can shut down or take over the degraded controller using different procedures, depending on the storage system hardware configuration. Shutting down the controller To shut down the degraded controller, you must determine the status of the controller and, if necessary, take over the controller so that the healthy controller continues to serve data from the degraded controller storage.

  • Page 36: Opening The System

    Step 2. If the degraded controller is part of an HA pair, disable automatic giveback from the console of the healthy controller using the following command: storage failover modify -node local -auto- giveback false Take the degraded controller to the Autoboot Loader prompt by typing storage failover takeover Step 3.

  • Page 37: Replacing A Caching Module

    Step 5. Turn the controller module over and place it on a flat, stable surface. Step 6. Open the cover by sliding in the blue tabs to release the cover, and then swing the cover up and open. Replacing a caching module To replace a caching module referred to as the M.2 PCIe card on the label on your controller, locate the slot inside the controller and follow the specific sequence of steps.

  • Page 38: Reinstalling The Controller Module

    Press the release tab. Remove the heatsink. Step 3. Gently pull the caching module straight out of the housing. Step 4. Insert the new caching module in the controller, and then align the edges of the caching module with the socket housing and gently push it into the socket. Step 5.

  • Page 39: Running System-Level Diagnostics

    Attention: Do not use excessive force when sliding the controller module into the chassis; you might damage the connectors. The controller begins to boot as soon as it is seated in the chassis. 2. If you have not already done so, reinstall the cable management device. 3.
  • Page 40 If the system-level diagnostics tests... Then... Were completed without any failures 1. Clear the status logs: sldiag device clearstatus 2. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present.

  • Page 41: Completing The Replacement Process

    Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 42: Opening The System

    Shutting down the controller To shut down the degraded controller, you must determine the status of the controller and, if necessary, take over that controller so that the healthy controller continues to serve data for the degraded controller’s storage. Step 1. If the degraded controller is part of an HA pair, disable automatic giveback from the console of the healthy controller using the following command: storage failover modify -node local -auto- giveback false...

  • Page 43: Replacing The Nvmem Battery

    Step 5. Turn the controller module over and place it on a flat, stable surface. Step 6. Open the cover by sliding in the blue tabs to release the cover, and then swing the cover up and open. Replacing the NVMEM battery To replace the NVMEM battery in your system, you must remove the failed NVMEM battery from the system and replace it with a new NVMEM battery.

  • Page 44: Reinstalling The Controller Module

    – If power is lost without a clean shutdown, the NVMEM LED flashes until the destage is complete, and then the LED turns off. – If the LED is on and power is on, unwritten data is stored on NVMEM. This typically occurs during an uncontrolled shutdown after ONTAP has successfully booted.

  • Page 45: Running System-Level Diagnostics

    1. With the cam handle in the open position, firmly push the controller module in until it meets the midplane and is fully seated, and then close the cam handle to the locked position. Attention: Do not use excessive force when sliding the controller module into the chassis; you might damage the connectors.

  • Page 46: Completing The Replacement Process

    9. Rerun the system-level diagnostic test. Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 47: Swapping Out A Power Supply

    Swapping out a power supply Swapping out a power supply involves turning off, disconnecting, and removing the old power supply and installing, connecting, and turning on the replacement power supply. Before you begin All other components in the system must be functioning properly; if not, you must contact technical support. About this task •...

  • Page 48: Workflow Diagram

    This diagram shows the workflow of the power supply replacement procedure for a system. Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at...

  • Page 49: Workflow Diagram

    • This procedure includes steps for automatically or manually reassigning disks to the replacement controller, depending on your system's configuration.You should perform the disk reassignment as directed in the procedure. • You must replace the failed component with a replacement FRU component you received from your provider.

  • Page 50: Shutting Down The Degraded Controller

    Shutting down the degraded controller You can shut down or take over the degraded controller using different procedures, depending on the storage system hardware configuration. Shutting down the controller To shut down the degraded controller, you must determine the status of the controller and, if necessary, take over that controller so that the healthy controller continues to serve data for the degraded controller’s storage.
  • Page 51 Opening the system To replace the controller module, you must first remove the old controller module from the chassis. Step 1. If you are not already grounded, properly ground yourself. Step 2. Loosen the hook and loop strap binding the cables to the cable management device, and then unplug the system cables and SFPs (if needed) from the controller module, keeping track of where the cables were connected.
  • Page 52 Step 5. Squeeze the latch on the cam handle until it releases, open the cam handle fully to release the controller module from the midplane, and then, using two hands, pull the controller module out of the chassis. Step 6. Turn the controller module over and place it on a flat, stable surface.
  • Page 53 Attention: The NVRAM LED blinks while destaging contents to the flash memory when you halt the system. After the destage is complete, the LED turns off. – If power is lost without a clean shutdown, the NVMEM LED flashes until the destage is complete, and then the LED turns off.
  • Page 54 Step 2. Press the blue button on the boot media housing to release the boot media from its housing, and then gently pull it straight out of the boot media socket. Note: Do not twist or pull the boot media straight up, because this could damage the socket or the boot media.
  • Page 55 Step 4. Repeat these steps to remove additional DIMMs as needed. Step 5. Verify that the NVMEM battery is not plugged into the new controller module. Step 6. Locate the slot where you are installing the DIMM. Step 7. Make sure that the DIMM ejector tabs on the connector are in the open position, and then insert the DIMM squarely into the slot.The DIMM fits tightly in the slot, but should go in easily.
  • Page 56 Step 2. Gently pull the caching module straight out of the housing. Step 3. Insert the new caching module in the controller, and then align the edges of the caching module with the socket housing and gently push it into the socket. Step 4.

  • Page 57: Restoring And Verifying The System Configuration

    If your system is in... Then perform these steps... An HA pair The controller module begins to boot as soon as it is fully seated in the chassis. Be prepared to interrupt the boot process. 1. With the cam handle in the open position, firmly push the controller module in until it meets the midplane and is fully seated, and then close the cam handle to the...
  • Page 58 Verifying and setting the HA state of the controller module You must verify the state of the controller module and, if necessary, update the state to match your system configuration. Step 1. In Maintenance mode from the new controller module, verify that all components display the same state: ha-config show If your system is in...
  • Page 59 All commands in the diagnostic procedures are issued from the controller where the component is being replaced. If the controller to be serviced is not at the LOADER prompt, reboot the controller by typing: halt Step 1. After you issue the command, you should wait until the system stops at the LOADER prompt. Step 2.
  • Page 60 If you want to run diagnostic tests on... Then... Individual components 1. Clear the status logs: sldiag device clearstatus 2. Display the available tests for the selected devices: sldiag device show -dev dev_ name dev_name can be any one of the ports and devices identified in the preceding step.

  • Page 61: Completing System Restoration

    Completing system restoration To complete the replacement procedure and restore your system to full operation, you must recable the storage, confirm disk reassignment, restore the Lenovo Storage Encryption configuration (if necessary), and install licenses for the new controller. Chapter 5...
  • Page 62 Recabling the system After running diagnostics, you must recable the controller module's storage and network connections. Step 1. Recable the system. Step 2. Verify that the cabling is correct. Reassigning disks If the storage system is in an HA pair, the system ID of the new controller module is automatically assigned to the disks when the giveback occurs at the end of the procedure.
  • Page 63 Verifying the system ID change on an HA system You must confirm the system ID change when you boot the replacement controller and then verify that the change was implemented. This procedure applies only to systems running ONTAP in an HA pair. Step 1.
  • Page 64 Step 1. Obtain replacement license keys by contacting Lenovo technical support. Note: The new license keys that you require are NOT auto-generated. You should contact Lenovo technical support. Install each license key: system license add -license-code license-key, license-key...

  • Page 65: Completing The Replacement Process

    Exit admin privilege. Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 66: Shutting Down The Degraded Controller

    Shutting down the degraded controller You can shut down or take over the degraded controller using different procedures, depending on the storage system hardware configuration. Shutting down the controller To shut down the degraded controller, you must determine the status of the controller and, if necessary, take over that controller so that the healthy controller continues to serve data for the degraded controller’s storage.

  • Page 67: Opening The System

    If the degraded controller is displaying... Then... The LOADER prompt Go to the next step. Waiting for giveback... Press Ctrl-C, and then respond y when prompted. Take over or halt the degraded controller: System prompt or password prompt • For an HA pair, take over the degraded controller from the healthy controller: storage failover takeover -ofnode impaired_ node_name...

  • Page 68: Replacing The Dimms

    Step 5. Turn the controller module over and place it on a flat, stable surface. Step 6. Open the cover by sliding in the blue tabs to release the cover, and then swing the cover up and open. Replacing the DIMMs To replace the DIMMs, locate them inside the controller and follow the specific sequence of steps.
  • Page 69 Step 3. If the NVMEM LED is not flashing, there is no content in the NVMEM; you can skip the following steps and proceed to the next task in this procedure. Step 4. If the NVMEM LED is flashing, there is data in the NVMEM and you must disconnect the battery to clear the memory: Locate the battery, press the clip on the face of the battery plug to release the lock clip from the plug socket, and then unplug the battery cable from the socket.

  • Page 70: Reinstalling The Controller Module

    Step 9. Remove the replacement DIMM from the antistatic shipping bag, hold the DIMM by the corners, and align it to the slot. The notch among the pins on the DIMM should line up with the tab in the socket. Step 10.

  • Page 71: Running System-Level Diagnostics

    2. If you have not already done so, reinstall the cable management device. 3. Bind the cables to the cable management device with the hook and loop strap. 4. When you see Press Ctrl-C for Boot Menu, press Ctrl-C to interrupt the boot process. 5.
  • Page 72 If the system-level diagnostics tests... Then... Were completed without any failures 1. Clear the status logs: sldiag device clearstatus 2. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present.

  • Page 73: Completing The Replacement Process

    Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 74: Opening The System

    Opening the system To access components inside the controller, you must first remove the controller module from the system and then remove the cover on the controller module. Step 1. If you are not already grounded, properly ground yourself. Step 2. Loosen the hook and loop strap binding the cables to the cable management device, and then unplug the system cables and SFPs (if needed) from the controller module, keeping track of where the cables were connected.

  • Page 75: Replacing The Boot Media

    Step 5. Turn the controller module over and place it on a flat, stable surface. Step 6. Open the cover by sliding in the blue tabs to release the cover, and then swing the cover up and open. Replacing the boot media You must locate the boot media in the controller and follow the directions to replace it.

  • Page 76: Transferring The Boot Image To The Boot Media

    • A copy of the same image version of ONTAP as what the degraded controller was running. You can download the appropriate image from the Lenovo Support Site. • If your system is an HA pair, you must have a network connection.
  • Page 77 Step 4. Push the controller module all the way into the system, making sure that the cam handle clears the USB flash drive, firmly push the cam handle to finish seating the controller module, push the cam handle to the closed position, and then tighten the thumbscrew. The controller begins to boot as soon as it is completely installed into the chassis.

  • Page 78: Completing The Replacement Process

    Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at...

  • Page 79: Workflow Diagram

    Workflow diagram This diagram shows the workflow of the RTC battery replacement procedure for a system. Shutting down the degraded controller You can shut down or take over the degraded controller using different procedures, depending on the storage system hardware configuration. Shutting down the controller To shut down the degraded controller, you must determine the status of the controller and, if necessary, take over that controller so that the healthy controller continues to serve data for the degraded controller’s...

  • Page 80: Opening The System

    If the degraded controller is displaying... Then... The LOADER prompt Go to the next step. Waiting for giveback... Press Ctrl-C, and then respond y when prompted. Take over or halt the degraded controller: System prompt or password prompt • For an HA pair, take over the degraded controller from the healthy controller: storage failover takeover -ofnode impaired_ node_name...

  • Page 81: Replacing The Rtc Battery

    Step 5. Turn the controller module over and place it on a flat, stable surface. Step 6. Open the cover by sliding in the blue tabs to release the cover, and then swing the cover up and open. Replacing the RTC battery To replace the RTC battery, locate it inside the controller and follow the specific sequence of steps.

  • Page 82: Reinstalling The Controller

    Step 3. Gently push the battery away from the holder, rotate it away from the holder, and then lift it out of the holder. Note: Note the polarity of the battery as you remove it from the holder. The battery is marked with a plus sign and must be positioned in the holder correctly.

  • Page 83: Completing The Replacement Process

    Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 84: Shutting Down The Controller

    Shutting down the controller You must shut down the controller or controllers in the chassis prior to moving them to the new chassis. Before you begin • If you have a cluster with more than two controllers, it must be in quorum. If the cluster is not in quorum or a healthy controller shows false for eligibility and health, you must correct the issue before shutting down the degraded controller.

  • Page 85: Swapping Out A Power Supply

    The confirmation message looks like the following: Warning: Rebooting or halting node "node_name" in an HA-enabled cluster may result in client disruption or data access failure. To ensure continuity of service, use the "storage failover takeover" command. Are you sure you want to halt node "node_name"? {y|n}: Attention: You must perform a clean system shutdown before replacing the chassis to avoid losing unwritten data in the nonvolatile memory (NVMEM).

  • Page 86: Removing The Controller Module

    CAUTION: When removing a power supply, always use two hands to support its weight. Step 5. Repeat the preceding steps for any remaining power supplies. Step 6. Using both hands, support and align the edges of the power supply with the opening in the system chassis, and then gently push the power supply into the chassis using the cam handle.

  • Page 87: Moving Drives To The New Chassis

    Step 5. Set the controller module aside in a safe place, and repeat these steps if you have another controller module in the chassis. Moving drives to the new chassis You need to move the drives from each bay opening in the old chassis to the same bay opening in the new chassis.

  • Page 88: Installing The Controller

    Step 5. Slide the chassis all the way into the equipment rack or system cabinet. Step 6. Secure the front of the chassis to the equipment rack or system cabinet, using the screws you removed from the old chassis. Installing the controller After you install the controller module and any other components into the new chassis, boot it to a state where you can run the interconnect diagnostic test.

  • Page 89: Verifying And Setting The Ha State Of The Chassis

    Verifying and setting the HA state of the chassis You must verify the HA state of the chassis, and, if necessary, update the state to match your system configuration. Step 1. In Maintenance mode, from either controller module, display the HA state of the local controller module and chassis: ha-config show The HA state should be the same for all components.
  • Page 90 Step 2. Repeat the previous step on the second controller if you are in an HA configuration. Note: Both controllers must be in Maintenance mode to run the interconnect test. Step 3. At the LOADER prompt, access the special drivers specifically designed for system-level diagnostics to function properly: boot_diags During the boot process, you can safely respond y to the prompts until the Maintenance mode prompt (*>) appears.
  • Page 91 If the system-level diagnostics tests... Then... Were completed without any failures 1. Clear the status logs: sldiag device clearstatus 2. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present. 3.

  • Page 92: Completing The Replacement Process

    5. Rerun the system-level diagnostics test. Completing the replacement process After you replace the part, you can return the failed part to Lenovo, as described in the RMA instructions shipped with the kit. Contact technical support at if you need the RMA number or additional Lenovo Support help with the replacement procedure.

  • Page 93: Chapter 6. Upgrading Controller Hardware

    Methods for upgrading controller hardware In general, how you upgrade the controller hardware depends on the platform models of the original controllers. You upgrade either by moving the storage (a disruptive procedure) or by moving the volumes (a nondisruptive procedure). © Copyright Lenovo 2018...

  • Page 94: Workflow For Upgrading By Moving Storage

    Workflow for upgrading by moving storage Upgrading by moving storage is a disruptive procedure. Before you start, you should read the considerations. After installing and setting up the new controllers, you can transfer storage and reassign disks to the new controllers. You then perform additional configurations and complete the upgrade. ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 95: Workflow For Upgrading By Moving Volumes

    Workflow for upgrading by moving volumes Upgrading by moving volumes is a nondisruptive procedure. Before you start, you should read the considerations and prepare the original controllers. You join the new controllers to the cluster and move volumes to the new controllers. You then perform additional configurations, unjoin original controllers, reassign disks, and complete the upgrade.

  • Page 96: Upgrading Controller Hardware

    Upgrading controller hardware You upgrade the controller hardware either by moving the storage (a disruptive procedure) or by moving the volumes (a nondisruptive procedure). Upgrading controller hardware by moving storage If you are upgrading by moving storage, you prepare the original controllers and set up the new controllers. Some platform models support transferring internal storage to the new controllers.
  • Page 97 Obtain information about the default cluster ports, data ports, and controller management ports for each new controller that you are upgrading to. Lenovo Press Step 5. As needed, adjust the configuration of the network broadcast domains on the original controllers...
  • Page 98 Step 9. Disable high availability or storage failover on each original controller: If you have a... Enter... Two-controller cluster 1. cluster ha modify -configured false 2. storage failover modify -node node_name -enabled false storage failover modify -node node_name Cluster with more than two controllers -enabled false Step 10.
  • Page 99 *> ucadmin show Current Current Pending Pending Adapter Mode Type Mode Type Status ------- ------- --------- ------- ------- ------ initiator - online initiator - online target online target online Step 16. In Maintenance mode, destroy each original controller's mailboxes: mailbox destroy local The console displays a message similar to the following: Destroying mailboxes forces a node to create new empty mailboxes, which clears any takeover state, removes all knowledge of out-of-date plexes and...
  • Page 100 Turn on the power to the second new controller, and then interrupt the boot process by pressing Ctrl-C at the console terminal to access the boot environment prompt.The power should already be on if both controllers are in the same chassis.Leave the second new controller at the boot environment prompt;...
  • Page 101 If you have… Then… An HA configuration You should verify that the command output shows ha: *> ha-config show Chassis HA configuration: ha Controller HA configuration: ha Systems record in a PROM. The state must be the same on all components within the HA pair The h h a a - - c c o o n n f f i i g g m m o o d d i i f f y y c c o o n n t t r r o o l l l l e e r r h h a a command configures ha for the controller setting.
  • Page 102 Moving internal drives from an original controller If your original controller is one of the supported models, during the process of upgrading by moving storage you can move the controller's internal SATA drives or SSDs to a drive shelf that is attached to the new controller in the same cluster.
  • Page 103 You should contact technical support if you need guidance specific to your configuration. Step 1. Replace the controller modules in the controller you are converting with appropriate IOM modules. Lenovo Press Step 2. Set the drive shelf ID. Each drive shelf, including the chassis, requires a unique ID.
  • Page 104 Locate the original controllers' port and LIF configuration information that you recorded previously. “Preparing for the upgrade when moving storage” on page 90. Step 2. Record information for each new controller's ports, broadcast domains, and IPspaces. Lenovo Press Step 3. Make the following changes: Boot the new controller to the storage system prompt if you have not already done so.
  • Page 105 Add the correct ports to the Cluster broadcast domain: network port modify -ipspace Cluster -mtu 9000 Example This example adds Cluster port e1b on “node-new”: network port modify -node node-new -port e1b -ipspace Cluster -mtu 9000 Migrate the LIFs to the new ports, once for each LIF: network interface migrate -vserver vserver_name -lif lif_name -source-node node-new -destination-node node-new -destination-port port_name SAN data LIFs can be migrated only when they are offline.

  • Page 106: Upgrading Controller Hardware By Moving Volumes

    Step 2. Delete any unused ports from the new controllers by using the n n e e t t w w o o r r k k p p o o r r t t d d e e l l e e t t e e command (advanced privilege level).
  • Page 107 Step 1. Display the volumes on the original controllers by using the v v o o l l u u m m e e s s h h o o w w command. You use the command output to prepare the list of volumes to move to the new controllers. Step 2.
  • Page 108 The following example displays volumes on the “vs1” SVM and the “node0” controller: cluster::> volume show -vserver vs1 -node node0 Vserver Volume Aggregate State Type Size Available Used% --------- ------------ ------------ ---------- ---- ---------- ---------- ----- clone aggr1 online 40MB 37.87MB vol1 aggr1...
  • Page 109 If you want to migrate... Then enter... network interface migrate -vserver vserver_ A specific LIF name -lif lif_name -source-node source_ node_name -destination-node dest_node_ name -destination-port dest_port_name network interface migrate-all -node node_ All the non-SAN data LIFs and cluster- name management LIFs Example The following command migrates a LIF named datalif1 on the SVM vs0 to the port e0d on node0b: cluster::>...
  • Page 110 The following example shows output of the l l u u n n p p o o r r t t s s e e t t s s h h o o w w command: cluster:> lun portset show Virtual Server Portset...
  • Page 111 Completing the upgrade To complete the procedure of upgrading by moving volumes, you need to configure the Service Processor (SP), install new licenses, and set up AutoSupport. You might also need to set up Storage Encryption and configure the FC or NCA ports. Step 1.
  • Page 112 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 113: Chapter 7. System Level Diagnostics

    General requirements • Each system being tested must be on a separate network.The network interface test assigns unique static IP addresses, beginning with 172.25.150.23, to all available network interfaces on a storage system. This © Copyright Lenovo 2018...

  • Page 114: How To Use Online Command-Line Help

    results in network interface ports on different storage controllers being assigned the same IP address. If all the systems being tested are on the same network, then duplicate ip address warning messages appear on the connected consoles. These warning messages do not affect the test results. System memory requirements •...

  • Page 115: Running System Installation Diagnostics

    [ ] (brackets) Indicate that the element inside the brackets is optional. Indicate that the element inside the braces is { } (braces) required. You can also type the question mark at the command line for a list of all the commands that are available at the current level of administration (administrative or advanced).
  • Page 116 • mem is system memory. • nic is a Network Interface Card not connected to a network. • nvram is nonvolatile RAM. • nvmem is a hybrid of NVRAM and system memory. • sas is a Serial Attached SCSI device not connected to a disk shelf. •...
  • Page 117 Adapter reset OK Started Adapter Get Connection State Test. Connection State: 5 Loop on FC Adapter 0b is OPEN Started adapter Retry LIP test Adapter Retry LIP OK ERROR: failed to init adaptor port for IOCTL call ioctl_status.class_type = 0x1 ioctl_status.subclass = 0x3 ioctl_status.info = 0x0 Started INTERNAL LOOPBACK:...

  • Page 118: Running System Panic Diagnostics

    If the system-level diagnostics tests... Then... Were completed without any failures There are no hardware problems and your storage system returns to the prompt. 1. Clear the status logs by entering the following command: sldiag device clearstatus 2. Verify that the log is cleared by entering the following command: sldiag device status The following default response is...
  • Page 119 Your storage system provides the following output while the tests are still running: There are still test(s) being processed. After all the tests are complete, you receive the following default response: *> <SLDIAG:_ALL_TESTS_COMPLETED> Identify the cause of the system panic by entering the following command: sldiag device status Step 5.

  • Page 120: Running Slow System Response Diagnostics

    Error Count: 2 Run Time: 70 secs >>>>> ERROR, please ensure the port has a shelf or plug. END DATE: Sat Jan 3 23:12:07 GMT 2009 LOOP: 1/1 TEST END -------------------------------------------- If the system-level diagnostics tests... Then... Were completed without any failures There are no hardware problems and your storage system returns to the prompt.
  • Page 121 At the storage system prompt, switch to the LOADER prompt: halt Step 1. Enter the following command at the LOADER prompt: boot_diags Step 2. Note: You must run this command from the LOADER prompt for system-level diagnostics to function properly. The b b o o o o t t _ _ d d i i a a g g s s command starts special drivers designed specifically for system-level diagnostics.
  • Page 122 Adapter Retry LIP OK ERROR: failed to init adaptor port for IOCTL call ioctl_status.class_type = 0x1 ioctl_status.subclass = 0x3 ioctl_status.info = 0x0 Started INTERNAL LOOPBACK: INTERNAL LOOPBACK Error Count: 2 Run Time: 70 secs >>>>> ERROR, please ensure the port has a shelf or plug. END DATE: Sat Jan 3 23:12:07 GMT 2009 LOOP: 1/1 TEST END --------------------------------------------...
  • Page 123 If the system-level diagnostics tests... Then... Were completed without any failures There are no hardware problems and your storage system returns to the prompt. 1. Clear the status logs by entering the following command: sldiag device clearstatus 2. Verify that the log is cleared by entering the following command: sldiag device status The following default response is...

  • Page 124: Running Hardware Installation Diagnostics

    If the system-level diagnostics tests... Then... specified device or named device by disabling all others first. 2. Verify that the tests were modified by entering the following command: sldiag option show 3. Repeat Steps 3 through 5 of Running slow system response diagnostics.
  • Page 125 – serviceproc is the Service Processor. – storage is an ATA, FC-AL, or SAS interface that has an attached disk shelf. – toe is a TCP Offload Engine, a type of NIC. • mb specifies that all the motherboard devices are to be tested. •...
  • Page 126 INTERNAL LOOPBACK Error Count: 2 Run Time: 70 secs >>>>> ERROR, please ensure the port has a shelf or plug. END DATE: Sat Jan 3 23:12:07 GMT 2009 LOOP: 1/1 TEST END -------------------------------------------- Then... If the system-level diagnostics tests... Were completed without any failures There are no hardware problems and your storage system returns to the prompt.

  • Page 127: Running Device Failure Diagnostics

    Running device failure diagnostics Running diagnostics can help you determine why access to a specific device becomes intermittent or why the device becomes unavailable in your storage system. At the storage system prompt, switch to the LOADER prompt: halt Step 1. Enter the following command at the LOADER prompt: boot_diags Step 2.
  • Page 128 *> sldiag device status fcal -long -state failed TEST START ------------------------------------------ DEVTYPE: fcal NAME: Fcal Loopback Test START DATE: Sat Jan 3 23:10:56 GMT 2009 STATUS: Completed Starting test on Fcal Adapter: 0b Started gathering adapter info. Adapter get adapter info OK Adapter fc_data_link_rate: 1Gib Adapter name: QLogic 2532 Adapter firmware rev: 4.5.2...
  • Page 129 If the system-level diagnostics tests... Then... Resulted in some test failures Determine the cause of the problem. 1. Exit Maintenance mode by entering the following command: halt 2. Perform a clean shutdown and disconnect the power supplies. 3. Verify that you have observed all the considerations identified for running system-level diagnostics, that cables are securely connected, and that hardware...
  • Page 130 If the system-level diagnostics tests... Then... 2. Verify that the log is cleared by entering the following command: sldiag device status [-dev devtype|mb|slotslotnum] The following default response is displayed: SLDIAG: No log messages are present. 3. Exit Maintenance mode by entering the following command: halt 4.

  • Page 131: Appendix A. Getting Help And Technical Assistance

    Appendix A. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about Lenovo products, you will find a wide variety of sources available from Lenovo to assist you. On the World Wide Web, up-to-date information about Lenovo systems, optional devices, services, and support are available at: http://datacentersupport.lenovo.com...

  • Page 132: Collecting Service Data

    Gathering information needed to call Support If you believe that you require warranty service for your Lenovo product, the service technicians will be able to assist you more efficiently if you prepare before you call. You can also see http:// for more information about your product warranty.
  • Page 133 China product support To contact product support in China, go to: http://support.lenovo.com.cn/lenovo/wsi/es/ThinkSystem.html You can also call 400-106-8888 for product support. The call support is available Monday through Friday, from 9 a.m. to 6 p.m. Taiwan product support To contact product support for Taiwan, call 0800–016–888. The call support is available 24 hours a day, 7 days a week.
  • Page 134 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 135: Appendix B. Lenovo Privacy Policy

    Appendix B. Lenovo Privacy Policy • Chinese: https://www.lenovo.com.cn/public/privacy.html • English (USA): https://www.lenovo.com/us/en/privacy/ • English (UK): https://www3.lenovo.com/gb/en/privacy/ • English (Canada): https://www3.lenovo.com/ca/en/privacy/ • French (Canada): https://canada.lenovo.com/fr/sdwww3/ca/en/privacy/ • German: https://www.lenovo.com/de/de/privacy/ • French: https://www.lenovo.com/fr/fr/privacy/ • Swedish: https://www.lenovo.com/se/sv/privacy/ • Danish: https://www.lenovo.com/dk/da/privacy/ • Spanish: https://www.lenovo.com/es/es/privacy/ • Japanese: http://www.lenovo.com/privacy/jp/ja/...
  • Page 136 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 137: Appendix C. Notices

    Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any Lenovo intellectual property right may be used instead.

  • Page 138: Trademarks

    (TBW). A device that has exceeded this limit might fail to respond to system-generated commands or might be incapable of being written to. Lenovo is not responsible for replacement of a device that has exceeded its maximum guaranteed number of program/erase cycles, as documented in the Official Published Specifications for the device.

  • Page 139: Telecommunication Regulatory Statement

    This product may not be certified in your country for connection by any means whatsoever to interfaces of public telecommunications networks. Further certification may be required by law prior to making any such connection. Contact a Lenovo representative or reseller for any questions. Electronic emission notices When you attach a monitor to the equipment, you must use the designated monitor cable and any interference suppression devices that are supplied with the monitor.

  • Page 140: Taiwan Bsmi Rohs Declaration

    Taiwan BSMI RoHS declaration Taiwan import and export contact information Contacts are available for Taiwan import and export information. ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

  • Page 141: Index

    NVMEM batteries from old to new moving drives to a new prerequisites for replacing replacing setting and verifying system time after replacing running diagnostics shutting down 29, 36, 44, 60, 73, 78 running system-level diagnostics tasks for replacing © Copyright Lenovo 2018...
  • Page 142 verifying and setting HA state of DIMMs system-level diagnostics controllers running cabling to data network switches 19–21 disks cabling to Ethernet switches 20–21 hot-swapping cabling to FC switches 19–20 reassigning to the new controllers cabling to management network switches 19–21 disruptive upgrade methods considerations for replacing DIMMs in controller for controller hardware...
  • Page 143 © Copyright Lenovo 2018...
  • Page 144 introduction to upgrading controller hardware by moving running volumes system-level diagnostics procedures, shutdown running diagnostics controller 36, 44, 60, 73, 78 after device failures PSU replacement after hardware installations workflow diagram after slow system responses after system installations after system panics system-level system-level requirements for rail kit installation instructions...
  • Page 145 © Copyright Lenovo 2018...
  • Page 146 ThinkSystem DM3000x and DM5000x Hardware Installation and Maintenance Guide...

This manual is also suitable for:

Thinksystem dm5000 series

Table of Contents