Cisco o UCS X440p Installation And Service Manual
  1. Manuals
  2. Brands
  3. Cisco Manuals
  4. Network Hardware
  5. o UCS X440p
  6. Installation and service manual
Cisco o UCS X440p Installation And Service Manual

Cisco o UCS X440p Installation And Service Manual

Cie node
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Cisco UCS X440p PCIe Node Installation and Service Guide
First Published: 2022-10-10
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883

Advertisement

Table of Contents
loading

Related Manuals for Cisco o UCS X440p

Summary of Contents for Cisco o UCS X440p

  • Page 1 Cisco UCS X440p PCIe Node Installation and Service Guide First Published: 2022-10-10 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883...
  • Page 2 © 2022 Cisco Systems, Inc. All rights reserved.

  • Page 3: Table Of Contents

    Serviceable Component Locations Removing and Installing the PCIe Node Cover Removing a PCIe Node Cover Installing a PCIe Node Cover Replacing the PCIe Node Companion Module Replacing Riser Cages Required Equipment Cabling Considerations Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 4 A P P E N D I X A PCIe Node Specifications Physical Specifications Environmental Specifications Power Specifications A P P E N D I X B Obtaining Hardware Obtaining Hardware Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 5 ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY. The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules.
  • Page 6 All printed copies and duplicate soft copies of this document are considered uncontrolled. See the current online version for the latest version. Cisco has more than 200 offices worldwide. Addresses and phone numbers are listed on the Cisco website at www.cisco.com/go/offices.
  • Page 7 Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: https://www.cisco.com/c/en/us/about/...
  • Page 8 Preface Communications, Services, and Additional Information Cisco UCS X440p PCIe Node Installation and Service Guide viii...

  • Page 9: Overview

    Overview, on page 1 Overview The Cisco UCS X440p PCIe node (UCSX-440P) is the first PCIe node that is part of the Cisco UCS X-Fabric system. The PCIe node pairs with Cisco UCS X-Series compute nodes and X-Fabric modules to support workloads that require GPUs.

  • Page 10: Required Hardware

    PCIe node. Required Hardware The Cisco UCS X440p PCIe Node is part of an integrated system to provide GPU acceleration for Cisco UCS compute nodes. For a complete system, the PCIe node requires the following hardware components.

  • Page 11: Leds

    Overview LEDs PCIe node LED cluster PCIe node Ejector handles, 2 LEDs, on page PCIe node Ejector Button LEDs The PCIe node front panel has the following status LEDs. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 12: Riser Cage Options

    PCIe node with two HHHL GPUs in one riser, but no GPUs in the second riser, the second riser must contain two Cisco PCIe blanks. Regardless of the riser type, any empty GPU card slot in a riser must be filled with a PCIe slot blank. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 13: Slot Numbering

    • For hardware, slot numbering consists of Riser Number Riser Type/Slot. So, for example, 1A/1 indicates riser number 1, riser type A, slot 1. • For Cisco management software, such as Cisco Intersight Managed Mode (IMM), the slot numbering consists of Riser [number/type]-Slot [number]. So, for example, RISER1A-SLOT1 indicates riser number 1, riser type A, slot 1.

  • Page 14: Supported Gpus

    PCIe node Supported GPUs The Cisco UCS X440p PCIe node supports the following models and form factors of GPU. • Full height, full length (FHFL) GPUs: • NVIDIA A16 PCIe 250W 4X16GB (UCSX-GPU-A16) • NVIDIA Tesla A40 RTX, Passive, 300W, 48GB (UCSX-GPU-A40)
  • Page 15 Overview Supported GPUs • NVIDIA Tesla A100, Passive, 300W, 80GB (UCSX-GPU-A100-80) • Half height, half length (HHHL) GPUs: NVIDIA T4 PCIe 16GB 75W (UCSX-GPU-T4-16) Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 16 Overview Supported GPUs Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 17: Installing The Cisco Ucs X440P Pcie Node

    Be aware of the following guidelines and limitations when installing the Cisco UCS X440p PCIe node. • The Cisco UCS X440p PCIe node is supported in the Cisco UCS X9508 chassis only. Do not attempt to install the PCIe node in any other UCS server chassis.
  • Page 18 Installing the Cisco UCS X440p PCIe Node Installation Guides and Limitations Figure 3: Supported Configuration, Compute Node in Initial Slot Figure 4: Supported Configuration, PCIes Node in Initial Slot Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 19: Pcie Node Companion Module

    Compute nodes can be installed in any slot without restriction where PCIe nodes are not used. Replacing the Cisco UCS X440p PCIe Node The Cisco UCS X440p PCIe Node is tool-less, field replaceable hardware. You can install or remove the node through node's integrated ejectors.

  • Page 20: Removing The Pcie Node

    The Cisco UCS X440p PCIe node itself is hot swappable, but the paired compute node must be powered down first before hot swapping the PCIe node. Step 1 If you have not already done so, use Cisco management software (for example, Cisco IMM) to power down the compute node paired with the PCIe node. Step 2 After the paired compute node is completely powered off, push the PCIe node's ejector button between the two ejectors to disconnect the ejectors from the sheet metal.

  • Page 21: Installing The Pcie Node

    Orient and align the PCIe node so that the ejectors are on the right vertical side of the slot. Step 2 Using one hand to support the PCIe node, hold the node level and slide it into the chassis slot. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 22: Pcie Node Configuration

    The node is fully seated when the ejectors click into place and are flush with the node's faceplate. Step 4 Using Cisco management software, such as Cisco Intersight Managed Mode (IMM), power on the PCIe node's paired compute node. Step 5 After the paired compute node is completely powered on, use Cisco's management software, such as Cisco Intersight Managed Mode (IMM), to rediscover the PCIe node.

  • Page 23: Servicing The Cisco Ucs X440P Pcie Node

    The following image shows the locations of serviceable components on the PCIe node. Note The PCIe node has a heatsink next to the rear mezzanine (MEZZ) slot. This heatsink is not serviceable. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 24 GPU slot 1 This cable is supported on FHFL GPUs only. GPU power cable for LED cable for Front Panel GPU slot 2 This cable is supported on FHFL GPUs only. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 25: Removing And Installing The Pcie Node Cover

    Removing and Installing the PCIe Node Cover The top cover for the Cisco UCS X440p PCIe node can be removed to allow access to internal components, some of which are field-replaceable. The green button on the top cover releases the PCIe node's cover.

  • Page 26: Removing A Pcie Node Cover

    Servicing the Cisco UCS X440p PCIe Node Removing a PCIe Node Cover Removing a PCIe Node Cover To remove the cover of the Cisco UCS X440p PCIe Node, follow these steps: Step 1 Press and hold the button down (1, in the figure below).

  • Page 27: Replacing The Pcie Node Companion Module

    You must power off the PCIe node companion module before replacing it! The PCIe node has a companion module, such as a Cisco UCS X210c compute node. To replace the PCIe node companion module, see the hardware documentation for the specific companion module.

  • Page 28: Required Equipment

    • One cable, the MCIO cable, connects from the PCIe riser cage to the rear mezzanine PCBA. This cable is shown in blue in the following image. Figure 5: PCB Cable Connectors, FHFL GPU Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 29: Removing Riser, Type A

    Remove the top cover. Removing a PCIe Node Cover, on page Step 3 Detach the riser cage from the PCIe node. a) Using a #2 Phillips screwdriver, loosen the three captive thumbscrews. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 30 When both cables are disconnected, lift the riser cage off of the PCIe node. What to do next Choose the appropriate option: • Removing a FHFL GPU • Installing a FHFL GPU, on page 29 Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 31: Installing Riser, Type A

    Using a #2 Phillips screwdriver, tighten the three captive thumbscrews to secure the riser cage to the node. What to do next Choose the appropriate option: • Replace another riser cage. • Installing a PCIe Node Cover , on page 18 Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 32: Removing Riser, Type B

    Lift and slide the riser cage slightly to expose the rear mezzanine connector of the power cable. d) Disconnect the power cable from the node's rear motherboard connector. e) When both cables are disconnected, lift the riser cage off of the PCIe node. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 33: Installing Riser, Type B

    Lower the riser cage onto the PCIe module making sure to align the thumbscrews with the correct screw holes. c) Connect the MCIO cable to the rear mezzanine (MEZZ) connector. d) Connect the power cable to the node's rear motherboard connector. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 34: Replacing A Gpu Card

    • For HHHL GPUs, the riser cage door has a retention block that prevents the HHHL GPU from backing out of its PCIe socket while the door is closed. The retention block has a retaining pin that seats into a hole in the bottom of the riser cage. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 35 When installing an HHHL GPU, make sure that the pin seats into the hole when you close the riser cage door. • Cisco offers Cisco PCIe blanks (UCSX-RIS-BLK-440P=) that fill unused connectors in the PCIe node. If your PCIe node is not fully configured with GPUs, you must install the appropriate number of blanks.

  • Page 36: Removing A Fhfl Gpu

    Holding the FHFL GPU level, slide it along the floor of the riser cage until it clears the retaining bracket on the floor of the riser cage. The retaining bracket is at the opposite end of the GPU's PCIe bracket. Step 5 Lift the GPU out of the riser. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 37: Installing A Fhfl Gpu

    Gently slide the GPU along the floor of the riser, making sure that the bottom notch on the retaining bracket captures the FHFL. Caution Make sure that the GPU power cable does not obstruct the GPU. Do not allow the cable to get pinched or exceed a reasonable bend radius. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 38 Servicing the Cisco UCS X440p PCIe Node Installing a FHFL GPU Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 39 Pushing down or pulling up can apply force to the door's hinge. b) Using a #2 Phillips screwdriver, tighten the vertical securing screw on the wall of the riser. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 40: Removing A Hhhl Gpu

    Make sure to hold the door level when you open it! Do not push the door down or lift the door up while Caution opening it. Pushing down or pulling up can apply force to the door's hinge. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 41 If you feel resistance while swinging the door open, turn the riser over and check the retaining pin. e) Press the retaining pin to release it, then continue opening the door. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 42 PCIe connector, then lift it out of the riser cage. Make sure to hold the GPU level while removing it! Pulling up or pushing down can apply force to the GPU Caution connector or the PCIe socket. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 43 Servicing the Cisco UCS X440p PCIe Node Removing a HHHL GPU What to do next Choose the correct option: • Installing a HHHL GPU, on page 36 • Installing Riser, Type B, on page 25 Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 44: Installing A Hhhl Gpu

    In the following illustration, the GPU is aligning with the bottom connector, so the bottom pin is used. Step 2 Seat the GPU card into the PCIe socket securely. You should feel the GPU snap into place when the connector seats into the PCIe socket. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 45 Make sure to hold the door level when you open it! Do not push the door down or lift the door up while Caution closing it. Pushing down or pulling up can apply force to the door's hinge. b) Verify that the retaining block is keeping the HHHL GPU(s) in place. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 46 Using a #2 Phillips screwdriver, tighten the hinge retention screw (3 in the following illustration). e) Using a #2 Phillips screwdriver, tighten the vertical securing screw on the wall of the riser (4). What to do next Installing Riser, Type B, on page Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 47: Replacing The Rear Mezzanine Card

    You can leave the cable connected to the front panel connector, but make sure to move the cable out of the way so that does not obstruct removing the rear mezzanine card. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 48: Installing A Rear Mezzanine Card

    You might need to gently rock the card while lifting it to disengage it from the socket. Installing a Rear Mezzanine Card Use this task to install a rear mezzanine card onto the PCIe node. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 49: Recycling The Pcb Assemblies

    Reinsert the PCIe node into the chassis and return the node to service. Recycling the PCB Assemblies The Cisco UCS X440p PCIe Node has multiple different PCB assemblies (PCBAs), which consist of the PCB motherboard plus any components mounted on it.

  • Page 50: Recycling The Motherboard Pcba

    Recycling the Motherboard PCBA Each Cisco UCS X440p PCIe Node has a PCBA (motherboard) that is connected to sheet metal. You must disconnect the PCBA from the chassis sheet metal to recycle the PCBA. You will need to disassemble and remove additional parts to gain access to the PCBA.
  • Page 51 PCBA to release the heatsink from the rear mezzanine card. Step 5 Using a T10 Torx driver, remove the seven pan-head screws that secure the PCBA to the PCIe node's frame. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 52 Turn the PCIe node over so that the bottom sheetmetal is facing up. b) Using an H2.0 hex-head screwdriver, remove the low-profile socket-head screw. c) Using a T10 Torx driver, remove the pan-head screw. Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 53 Detach the frame and the PCB from the PCIe node. Step 9 Remove the heatsink. a) Using a #1 Phillips screwdriver, remove the three pan-head screws. b) Detach the heatsink from the PCB. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 54: Recycling The Riser A Pcba

    To remove Riser A's PCBA, the following requirements must be met: • The PCIe node must be disconnected from facility power. • The chassis must be removed from the equipment rack. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 55: Recycling The Riser B Pcba

    Turn the riser cage over so that the sheetmetal bottom is facing up. b) Press the retaining button to unlock the GPU door. Step 3 Remove the GPU (if present) from the riser. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 56: Step

    Using a #1 Phillips screwdriver, remove the six pan-head screws from the riser cage interior side wall (the side opposite the door). Step 5 Detach the PCB from the sheetmetal and dispose of the PCB, any components, and sheetmetal in compliance with relevant e-waste and recycling laws. Cisco UCS X440p PCIe Node Installation and Service Guide...

  • Page 57: Pcie Node Specifications

    Physical Specifications, on page 49 • Environmental Specifications, on page 49 • Power Specifications, on page 50 Physical Specifications The following table shosw the physical specifications for the Cisco UCS X440p PCIe Node. Parameter Value Height 1.80 in. (45.7 mm) Width 11.28 in.

  • Page 58: Power Specifications

    Power Specifications Caution The Cisco UCSX-440P PCIe Node has a power cap of 1300 Watts for all combinations of components. Also, the ambient temperature must be less than 35 degrees C (95 degrees F). For configuration-specific power specifications, use the Cisco power calculator. Go to:...

  • Page 59: Appendix B Obtaining Hardware

    Cisco UCS X-Series compute node that is paired with it. The following table shows the required hardware to support a fully functioning PCIe node. Use the following table when you want to order spares or additional PCIe nodes to scale out your Cisco UCS X-Fabric deployment. Note Power cables are required and ship with the riser cages.
  • Page 60 Cisco X-Series Server chassis Rear Mezzanine Card UCS PCI Mezz card for X-Fabric UCSX-V4-PCIME Connectivity Required for Cisco UCS X-Series compute nodes (for example, the Cisco UCS X210c M6 Compute Node) Cisco UCS X440p PCIe Node Installation and Service Guide...
  • Page 61 Type B riser, removing Type A PCIe node health riser, removing Type B PCIe node locator Type A riser MEZZ card 39 40 Type B riser motherboard, recycling Cisco UCS X440p PCIe Node Installation and Service Guide IN-1...
  • Page 62 INDEX Cisco UCS X440p PCIe Node Installation and Service Guide IN-2...

Table of Contents