1. Manuals
  2. Brands
  3. Cray Manuals
  4. Server
  5. CS400-AC
  6. Replacement procedures

Cray CS400-AC Replacement Procedures

Hardware replacement procedures
Hide thumbs
Table of Contents

Advertisement

Quick Links

CS400-AC Hardware Replacement Procedures
HR90-2009

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the CS400-AC and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Cray CS400-AC

Summary of Contents for Cray CS400-AC

  • Page 1 CS400-AC Hardware Replacement Procedures HR90-2009...

  • Page 2: Table Of Contents

    Contents Contents About the CS400-AC Hardware Replacement Procedures..................3 CCS Parts Repair and Replacement.........................4 CS400-AC Part Numbers..........................5 Power Cords................................10 PCI Card Brackets..............................11 GB522 Overview and Replacement Videos......................13 GB522X Replacement Procedures..........................14 GB522X Power Down............................14 GB522X Chassis Removal and Installation....................14 GB522X Cover Removal..........................15 GB522X Cover Installation..........................16...

  • Page 3: About The Cs400-Ac Hardware Replacement Procedures

    Use dissipative footwear in addition to, not as an alternative to, a wrist strap. ESD Wrist-strap Wear a Cray approved wrist strap when you service or handle an ESD-sensitive device to eliminate possible ESD damage to equipment. Connect the wrist strap cord directly to earth ground. Feedback Visit the Cray Publications Portal at https://pubs.cray.com and use the "Contact us"...

  • Page 4: Ccs Parts Repair And Replacement

    These procedures are unique to specific part categories. Diagnostic utilities may be used to generate log files or output that must be sent to Cray Service when requested before an RMA request is processed. As a minimum, customers must demonstrate that the fault follows the suspect part. Cray will not repair or replace any returned part that does not comply with these troubleshooting requirements and procedures.

  • Page 5: Cs400-Ac Part Numbers

    (antistatic bags and ESD foam) so there is at least 2 inches of threedimensional clearance between the part and the shipping box. Cray will not be responsible for any damage as a result of poor customer packaging and may return the damaged part as is, without repair or replacement. Customers may consolidate multiple RMA requests in a single CrayPort case.
  • Page 6 DIMM, 16GB DDR4-2133 Reg dual rank ECC 1.2V 1GX4 100961801 DIMM FRU,16GB DDR4-2133 REG DUAL RANK ECC 1.2V 1GX4 (HYNIX) 100961802 DIMM FRU,16GB DDR4-2133 REG DUAL RANK ECC 1.2V 1GX4 (SAMSUNG) 101107700 DIMM, 32GB DDR4-2133 Reg dual rank ECC 1.2V 1GX4 HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 7 Disk drive, SATA 120 GB SSD, 2.5" 6 Gb/s, 20nm, R540/W490, Intel Pro 2500 101206600 Disk drive, SATA 240 GB SSD, 2.5" 6 Gb/s, 20nm, R540/W490, Intel Pro 2500 101206700 Disk drive, SATA 480 GB SSD, 2.5" 6 Gb/s, 20nm, R540/W490, Intel Pro 2500 HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 8 PCIe3.0 x8, HCA ConnectX-3 EN dual-port SFP+, 10Gb/s, 40GbE 132-00157A PCIe3.0 x4, HCA ConnectX-3 EN single-port SFP+, 10Gb/s, 10GbE 132-00159A PCIe3.0 x16, HCA Connect-IB dual-port 56Gb/s FDR Power Cords 085-00370B Power cord, LS14 to LS26, 10A-250/277V, 1.2 m (4 ft) HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 9 Power cord, C14 to C19, 14AWG, 15A-250V, 1.8 m (6 ft) 085-00384A Power cord, C14 to C19, 14AWG, 13A-250V, 3.0 m (10 ft) 085-00273A Power cord, C20 to C13, 10A-250V, 1.8 m (6 ft) 085-00351A Power cord, C20 to C13, 15A-250V, 1.5 m (5 ft) HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 10: Power Cords

    Power Cords Power Cords The following power cords are used with CS400-AC systems. 1.2 m (47 in.) 1.5 m (59 in.) LS14 to LS26, 250-277 V, 10 A LS-14 LS-26 1.2 m (47 in.) 1.5 m (59 in.) LS25 to LS26, 250-277 V...

  • Page 11: Pci Card Brackets

    A custom PCI mounting bracket is required to install most PCI expansion cards in a GreenBlade chassis. The following custom Intel and Mellanox PCI brackets are available for popular expansion/add-on cards. If a bracket is not listed for the card that you want to add, please contact your Cray sales representative. HR90-2009...
  • Page 12 Mellanox Connect-IB, ConnectX-2/3: MCB192A-FCAT, Mellanox Connect-IB FDR: MCB191A-FCAT, MCB193A-FCAT MCB194A-FCAT, MCX354A-QCBT/TCBT/FCBT, MHQH29C-XTR, MHRH29C-XTR Brkt: 004-01317A (51010-2749-00) Brkt: 004-01318A (51010-2396-10) Brkt and Gasket Kit: 90301-0426-00 Brkt & Gasket Kit: 002-00398A (90301-0411-00) Mellanox ConnectX-3: MCX353A-QCBT Mellanox ConnectX-3 10GbE: MCX311A-XCCT/XCAT HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 13: Gb522 Overview And Replacement Videos

    Install Bridge Board GB522 Expansion Blade Videos ● Remove from Subrack ● Install in Subrack ● Remove Accelerator ● Install Accelerator ● Separate Expansion Blade and Compute Blade ● Join Expansion Blade and Compute Blade HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 14: Gb522X Replacement Procedures

    The following procedures are included in this section to prepare a GB522X chassis before replacing failing components/assemblies. The replacement procedures in this CS400-AC Hardware Replacement Procedures document begin with the GB522X chassis removed from the subrack and placed on an ESD safe work surface with the cover removed.

  • Page 15: Gb522X Cover Removal

    1. Remove the screw that secures the cover to the chassis. Refer to the following figure. 2. Press down on the latch button and slide the cover toward the rear of the chassis. 3. Lift and remove the cover. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 16: Gb522X Cover Installation

    Detailed step-by-step information describing the location of components and screws for component removal and replacement is not provided in all the replacement procedures in this CS400-AC Hardware Replacement Procedures document. Views of the GB522M/N expansion blades are provided in GB522M and GB522N Exploded Views on page 28.
  • Page 17 GB522X Replacement Procedures HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 18: Pcie Card Installation

    This procedure describes how to install an add-on card into a GreenBlade chassis. Refer to the corresponding step numbers in the following figures. To remove a PCIe card, follow the steps in reverse. Procedure 1. If necessary, remove the blank PCI slot bracket from the front panel. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 19 3. Attach a mounting bracket and EMI gasket to the PCI card. A custom Cray PCI mounting bracket is needed to install most PCI cards into a GreenBlade chassis. Cray has custom brackets and EMI gaskets for supported add-on cards.

  • Page 20: Hdd/Ssd Replacement

    2. Disconnect the SATA power connector (5-4 pin) from the drive. 3. Disconnect the SATA signal (flexible-foil) connector from the drive. 4. Remove the four screws that attach the high-mount bracket to the base of the chassis. Two screws go through the node IFB. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 21: Gb522X Hdd Replacement (First Generation Chassis)

    1. Remove the GreenBlade chassis from the subrack and place it on a stable ESD-safe work surface. Remove the cover. 2. Remove the screw that attaches the drive bracket to the base of the chassis. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 22 7. Position the HDD bracket assembly in the base of the chassis. Then seat the drive to the connector on the node IFB. 8. Attach the HDD bracket assembly to the chassis (one 6-32 x 0.25 screw). HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 23: Gb522M/N Replacement Procedures

    The following procedures are included in this section to prepare a GB522M/N expansion blade before replacing failing components/assemblies. The replacement procedures in this CS400-AC Hardware Replacement Procedures document begin with the GB522MN chassis removed from the subrack and placed on an ESD safe work surface with the cover removed.

  • Page 24: Gb522Mn Cover Removal

    1. Remove the two screws that secure the cover to the expansion chassis. Refer to the following figure. 2. Press down on the latch button and slide the cover toward the rear of the chassis. 3. Lift and remove the cover. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 25: Gb522Mn Cover Installation

    The pins on the underside of the cover fit into the recesses in the rear panel. 2. Slide the cover forward until it latches. 3. Secure the cover to the chassis with two screws. GB522MN: Separate/Join Expansion and Compute Blades Separate the GB522MN Expansion Blade HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 26 2. Unseat the connectors at the front (handle end) of the blade first. 3. Then unseat the connectors at the rear of the blade. 4. Pull the blades apart by lifting the expansion chassis straight up. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 27 1. Position the expansion blade over the compute blade, and line up the PCI connectors and chassis guides. 2. Mate each of the connectors and the two chassis. Press down firmly on the expansion blade. 3. Install 6 screws to secure the expansion blade to the compute blade. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 28: Gb522M And Gb522N Exploded Views

    Detailed step-by-step information describing the location of components and screws for component removal and replacement is not provided in all the replacement procedures in this CS400-AC Hardware Replacement Procedures document.
  • Page 29 GPU front LED/switch cable assembly GPU MIC power cable assembly (10P to 8P & 6P) GPU bridge board/riser Air duct riser bracket GB522 GPU bridge board (KP) Power connectors to rear GPU (8P and 6P) HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 30: Gpu/Coprocessor Replacement

    1. Disconnect the power cable connector(s) from the GPU/Coprocessor. 2. For the rear GPU/Coprocessor (near the GPU node board), remove the air duct GPU bracket. 3. Remove the 2 screws securing the GPU/Coprocessor brackets to the chassis. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 31 4. Position the GPU/Coprocessor in the chassis and seat it to the PCIe connector. 5. Secure the GPU/Coprocessor to the expansion blade chassis with 2 screws. 6. For the rear GPU/Coprocessor, install the air duct GPU bracket. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 32: Motherboard, Processor And Dimm Replacement

    Refer to CS400-AC Part Numbers on page 5 for a list of all spare motherboards About this task This procedure describes how to replace a motherboard in a CS400-AC series GreenBlade chassis. Refer to GB522X Exploded Views on page 16. ●...

  • Page 33: Gb522X Motherboard Installation

    7. Lift the motherboard out of the chassis and place it on an ESD-safe work surface. GB522X Motherboard Installation About this task This procedure describes how to install a motherboard in a CS400-AC series GreenBlade chassis. Refer to GB522X Exploded Views on page 16.

  • Page 34: Processor And Heatsink Replacement

    2. Proceed to loosen the remaining screws (B, C, and D) by giving each two rotations. Repeat this process by loosening each screw two rotations, each time, until all screws are loosened. 3. Lift the heatsink straight up. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 35 7. Use a dry cloth to dry the processor and heatsink so they are ready for a new application of thermal paste. Remove Processor 8. Unlatch the processor load plate as shown in the following figure. a. First, release the lever handle marked with the "Unlock (1)" symbol b. Next, release the second lever handle. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 36 Socket with processor. 10. Remove the processor. Cray Service recommends using a vacuum pen to install and remove processors. a. Carefully lift the processor out of the socket. DO NOT drop the processor on the socket pins. b. Immediately place your other hand underneath the processor to protect the socket pins. Place the processor on an ESD-safe work surface.
  • Page 37 Slide the tip of the lever under the notch in the load plate. Make sure the load plate tab engages under the socket lever when fully closed. c. Repeat the steps to latch the locking lever on the other side. Latch the levers in the order shown. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 38 S2600 motherboards use two different heatsinks for processors 1 and 2. The two heatsinks are not interchangeable. Using the wrong heatsink will cause serious thermal damage. A heatsink (and socket cover) is required even if no processor is installed. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 39: Dimm Replacement

    2. Holding the DIMM by the edges, lift it straight up from the socket and set the DIMM on an ESD-safe work surface. If the DIMM will not be reinstalled soon, store it in an anti-static package. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 40 5. Insert the bottom edge of the DIMM into the socket (A). When the DIMM is inserted, push down on the top edge of the DIMM until the retaining clips snap into place (B). Make sure the clips are firmly in place (C). HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 41: Subrack Parts Replacement Procedures

    Subrack Parts Replacement Procedures Subrack Parts Replacement Procedures The following procedures are included in this section: ● CS400-AC Fan Assembly Replacement ● iSCB Module PCBA Replacement ● SR5110 Midplane and Power Backplane Replacement ● CS400 Subrack Support Angles ● SR Subrack Replacement ●...

  • Page 42: Iscb Module Pcba Replacement (Cs400-Ac)

    Subrack Parts Replacement Procedures iSCB Module PCBA Replacement (CS400-AC) Prerequisites ● 002-00374C - iSCB module ● 22901-0225-00 - iSCB serial port cable assembly ● 22302-0313-01 - PCBA I/O network board ● 22309-00005-04 - PCBA CPU board About this task This procedure describes how to replace either of the two printed circuit board assemblies (PCBAs) in an iSCB module.
  • Page 43 PCBA - I/O network board (22302-0313-01) 002-00374C - iSCB Module G re B la (SR5110/SR8204/SR8116) 6. Remove the I/O, network PCBA. Remove the piece of film tape and use it to secure the ribbon cable to the replacement PCBA. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 44: Sr5110 Midplane And Power Backplane Replacement

    This procedure describes how to access and replace the midplane and power backplane in an SR5110 subrack. Refer to the following exploded view of the SR5110 that shows screw locations and the intended assembly of parts. Procedure 1. Power off all blades and systems in the subrack. HR90-2009 CS400-AC Hardware Replacement Procedures...
  • Page 45 12. To remove the air duct, first carefully remove the two black plastic rivets at the center of the air duct. 13. Then remove the two screws. 14. Remove the screws that attach the backplane PCBA to the plate. DO NOT remove the heatsink screws. HR90-2009 CS400-AC Hardware Replacement Procedures...

  • Page 46: Cs400 Subrack Support Angles

    Each CS400 Subrack (SR5110/SR6110/SR8204/SR8116) sits on a pair of support brackets mounted to the rack. These support brackets are included in all preconfigured Cray® CS400™ cluster supercomputer cabinets. A set of support bracket/angle assemblies (left and right), a cable management bar, screws/nuts, and tie wrap is included with new/replacement SR subracks.

  • Page 47: Sr Subrack Replacement

    SR Subrack Replacement About this task This procedure describes how to remove and replace an entire SR5110 subrack in a CS400-AC cabinet. Components and assemblies can be removed from the rear of the failed subrack before it is removed from the CS400-AC cabinet.
  • Page 48 Subrack Parts Replacement Procedures 2. Power off all blades/systems in the failed subrack 3. Open the front and rear doors of the CS400-AC cabinet. Subrack Component Removal - Rear 4. Disconnect all power cords and data cables connected to the failed subrack.

  • Page 49: Sr Subrack Installation

    9. Install modules: ● PSUs ● iSCB module ● GB522X modules 10. Connect all power cords and data cables. Refer to the numbers on the cable labels. 11. Check all connections before powering up the system. HR90-2009 CS400-AC Hardware Replacement Procedures...

Table of Contents