Advertisement
Quick Links
ThinkSystem SR780a V3 GPU
Water Loop Service Guide
Attention:
• Read "Installation Guidelines" and "Safety inspection checklist" in the ThinkSystem SR780a V3 Hardware
Maintenance Guide to ensure that you work safely.
• Touch the static-protective package that contains the component to any unpainted metal surface on the
server; then, remove it from the package and place it on a static-protective surface.
• Two people and one lifting device on site that can support up to 400 lb (181 kg) are required to perform
this procedure.
• Make sure you have the required tools listed below available to properly replace the NVSwitch cold plate
module:
Torx T15 head screwdriver
Flat head screwdriver
NVSwitch PCM Kit
Alcohol cleaning pad
• Make sure you have the required tools listed below available to properly replace the front or rear H100/
H200 cold plate module:
Torx T10 head screwdriver
Phillips #1 head screwdriver
Flat head screwdriver
H100/H200 PCM Kit
SR780a V3 water loop service kit
• Make sure you have the required tools listed below available to properly replace the GPU complex or GPU
baseboard:
Torx T10 head screwdriver
Phillips #1 head screwdriver
Flat head screwdriver
2 x H100/H200 PCM Kit
NVSwitch PCM Kit
SR780a V3 water loop service kit
H100/H200 GPU service fixture kit
Important: Putty pad/phase change material (PCM) replacement guidelines
• Before replacing the putty pad/PCM, gently clean the hardware surface with an alcohol cleaning pad.
• Hold the putty pad/PCM carefully to avoid deformation. Make sure no screw hole or opening is blocked by
the putty pad/PCM.
• Do not use expired putty pad/PCM. Check the expiry date on putty pad/PCM package. If the putty pads/
PCM are expired, acquire new ones to properly replace them.
Before you start, see the ThinkSystem SR780a V3 Hardware Maintenance Guide to remove the following:
Phillips #1 head screwdriver
Phillips #2 head screwdriver
NVSwitch putty pad kit
Torx T15 head screwdriver
Phillips #2 head screwdriver
Alcohol cleaning pad
SR780a V3 water loop putty pad kit
H100/H200 GPU service fixture kit
Torx T15 head screwdriver
Phillips #2 head screwdriver
Alcohol cleaning pad
2 x SR780a V3 water loop putty pad kit
NVSwitch putty pad kit
GPU baseboard handles
1 1
Advertisement
Related Manuals for Lenovo ThinkSystem SR780a V3
Summary of Contents for Lenovo ThinkSystem SR780a V3
- Page 1 • Do not use expired putty pad/PCM. Check the expiry date on putty pad/PCM package. If the putty pads/ PCM are expired, acquire new ones to properly replace them. Before you start, see the ThinkSystem SR780a V3 Hardware Maintenance Guide to remove the following:...
- Page 2 • Front top cover. • Rear top cover. • CPU complex. • Power complex. • Front fan cage. • Rear fan cage support bracket. • Make a list of each cable and remove all the cables from the GPU complex. GPU numbering and corresponding slot numbering in Hose holder location...
- Page 3 NVSwitch cold plate module components NVSwitch cold plate torque label Leakage sensor module Hose tie Handle NVSwitch cold plate NVSwitch slot number label Manifold Rear H100/H200 GPU cold plate module components Manifold Hose tie Leakage sensor module Shipping bracket GPU cold plate GPU slot number label GPU cold plate screw torque label Rear H100/H200 GPU cold plate module components...
- Page 4 Make preparation for this task 1. Remove the fan cage. 2. Remove the rear fan cage support bracket. Unfasten the six M3 screws that secure the fan Unfasten the eight M3 screws (W1-W2, RF1-RF2) cage to the server. that secure the fan cage support bracket to the chassis.
- Page 5 Follow the following steps to remove rear H100/H200 GPU cold plate module 3. Loosen the screws 720 degrees following the screw 4. Unfasten the four M3 screws (W7-W8) that secure the sequence: specified on the cold plate label, and rear GPU cold plate module manifold to the chassis. repeat to fully loosen the sixteen Torx T10 screws with a torque screwdriver set to the proper torque (0.4±0.05 newton-meter, 3.5±0.5 pound-inch).
- Page 6 6. Align the guide pins on the shipping brackets with the 7. Hold the shipping brackets to remove the front GPU guide holes on the manifold and the cold plates; then, cold plate module from the chassis. lower the shipping brackets onto the rear GPU cold plate Release the hoses from the hose ties that secure module.
- Page 7 Follow the following steps to remove front H100/H200 GPU cold plate module Note: Before removing front H100/H200 GPU cold plate module, remove the rear H100/H200 GPU cold plate module to create space for front H100/H200 GPU cold plate module. 2. Align the guide pins on the shipping brackets with the 1.
- Page 8 3. Unfasten the four M3 screws (W5-W6) that secure the 4. Remove the front H100/H200 GPU cold plate module front H100/H200 GPU cold plate module manifold to the from the chassis. chassis. Release the hoses from the hose ties that secure them to the hose guides.
- Page 9 Follow the following steps to remove the NVSwitch cold module 2. Unfasten the three M3 screws that secure the hose 1. Unfasten the two captive screws that secure the hose guide to the chassis and the manifold; then, remove the holder in place;...
- Page 10 NVSwitch Cold plate module 5. Immediately clean the PCM and putty pads off from the NVSwitches and the cold plate module with alcohol cleaning pads. Gently clean the PCM and putty pads to avoid NVSwitch damage. Attention: • It is recommended to clean the PCM while it is in liquid state. •...
- Page 11 Follow the following steps to remove the H100/H200 GPU complex and GPU baseboard 1. Remove the PCIe switch shuttle. 2. Unfasten the two M3 screws to remove the GPU connector protective bracket. Press the two blue release latches. Rotate the two release levers until they are perpendicular to the PCIe switch shuttle.
- Page 12 3. Unfasten the seventeen Torx T15 captive screws on the GPU baseboard. Note: Loosen or tighten the screws with a torque screwdriver set to the proper torque. For reference, the torque required for the screws to be fully loosen or tighten is 0.6 newton-meters, 5.3 inch-pounds.
- Page 13 Note: Continue with step 6 and step 7 if you are replacing the GPU baseboard. 6. Remove the handles if necessary. 7. Remove the GPUs from the GPU baseboard. Follow the screw sequence shown in the illustration Note: Keep the handles attached to the GPU baseboard , and fully loosen the sixteen Torx T15 screws if it is to be shipped for RMA procedure.
- Page 14 Follow the following steps to Install the H100/H200 GPU complex and GPU baseboard Note: Skip step 1 and step 2 if you are replacing GPU complex. 1. Remove the GPU baseboard from the package box. 2. Install the GPUs. Extend the two handles on both sides of the GPU Carefully lay the GPU onto the GPU baseboard.
- Page 15 5. Remove the handles. 6. Follow the sequence shown in the illustration to fasten the seventeen Torx T15 captive screws to secure the Carefully lay the GPU complex on a flat, static GPU complex. protective surface; then, press the button on the side Important: Do not overtighten the screws to avoid of the handles to adjust the handles and create space damage.
- Page 16 7. Align the GPU connector protective bracket with the 8. Install the PCIe switch shuttle. corresponding screw holes; then, fasten the two M3 Press the two blue release latches. screws (PH2, 2 x M3, 0.5 newton-meters, 4.3 inch- Press the two lock latches on both sides of the pounds) to secure the GPU connector protective bracket PCIe switch shuttle.
- Page 17 Follow the following steps to install the NVSwitch cold plate module 1. Replace the Phase Change Material (PCM) and putty 2. Install the NVswitch cold plate module. pads on the cold plates. Lift the NVswitch cold plate module by the handles; Remove the liner from one side of the pad.
- Page 18 3. Follow the screw sequence specified on the cold plate label, and repeat to fully tighten the sixteen Torx T15 screws with a torque screwdriver set to the proper torque. Set the torque screwdriver to 0.57-0.61 newton- meter, 5-5.4 pound-inch. Fasten the screws for 720 degree following the →...
- Page 19 6. Align the hose guide with the screw hole on the 7. Place the hoses, rear fan power cable, and GPU NVSwitch manifold and the two screw holes on the leakage sensor module cable on the hose guides, and chassis; then, fasten the three M3 screws (PH2, 3 x M3, secure them with the hose ties.
- Page 20 Follow the following steps to install front H100/H200 GPU cold plate module 1. Replace the Phase Change Material (PCM) on the cold 2. Replace the putty pads (x5) on the GPU. plates. Remove the liner from one side of the pad. Remove the liner from one side of the pad.
- Page 21 3. Install the front H100/H200 GPU cold plate module. Hold the front H100/H200 GPU cold plate module by the shipping brackets; then, align the guide slots on the manifold with the guide pins and gently place the cold plate module onto the four front GPUs. Ensure the guide slots on the manifold are securely engaged with the guide pins on the chassis.
- Page 22 Use H100/H200 GPU service fixture kit to install the cold plates. The following illustration shows the components for H100/H200 GPU service fixture. H100/H200 GPU Handle service fixture Clamp head Spacer Table for rear GPU cold Table for front GPU plate cold plate 7.
- Page 23 9. Align the table with the four screws on the cold plate, 10. Adjust the clamp head. then carefully position it onto the cold plate with the Loosen the hex nut on the top of the lever. “REAR” sign facing the rear of the chassis as shown. Loosen the hex nut at the bottom of the lever.
- Page 24 11. Place the spacer onto the clamp head and hold the Push the handle forward to a slightly straightened spacer while pulling the handle into a fully straightened position. Adjust the clamp head so that it rests at the position. center of the table as illustrated.
- Page 25 12. Attach the T10 extended bit to the torque screwdriver. Follow the screw sequence specified on the fixture and cold plate label, and repeat to fully tighten the sixteen Torx T10 screws with the screwdriver set to the proper torque. Set the torque screwdriver to 0.4±0.05 newton- meter, 3.5±0.5 pound-inch.
- Page 26 14. Adjust the position of the handle and clamp head 15. After adjusting the handle and clamp head assembly, assembly by loosening and tightening the four hex socket reattach the four hex socket screws (4 x M6, 0.7 newton- screws (4 x M6, 0.7 newton-meters, 6 inch-pounds) with a meters, 6 inch-pounds) back to the fixture.
- Page 27 Follow the following steps to install rear H100/H200 GPU cold plate module 1. Replace the Phase Change Material (PCM) on the cold 2. Replace the putty pads (x5) on the GPU. plates. Remove the liner from one side of the pad. Remove the liner from one side of the pad.
- Page 28 3. Install the rear H100/H200 GPU cold plate module. Hold the rear H100/H200 GPU cold plate module by the shipping brackets; then, align the guide slots on the manifold with the guide pins on the chassis and gently place the cold plate module onto the four rear GPUs.
- Page 29 Use H100/H200 GPU service fixture kit to install the cold plates. The following illustration shows the components for H100/H200 GPU service fixture. H100/H200 GPU Handle service fixture Clamp head Spacer Table for rear GPU cold Table for front GPU plate cold plate 7.
- Page 30 8. Adjust the clamp head. Push the handle forward to a slightly straightened Loosen the hex nut on the top of the lever. position. Adjust the clamp head so that it rests at the center of the table as illustrated. Loosen the hex nut at the bottom of the lever.
- Page 31 10. Attach the T10 extended bit to the torque screwdriver. Follow the screw sequence specified on the fixture and cold plate label, and repeat to fully tighten the sixteen Torx T10 screws with the screwdriver set to the proper torque. Set the torque screwdriver to 0.4±0.05 newton- meter, 3.5±0.5 pound-inch.
- Page 32 12. Adjust the position of the handle and clamp head 13. After adjusting the handle and clamp head assembly, assembly by loosening and tightening the four hex socket reattach the four hex socket screws (4 x M6, 0.7 newton- screws (4 x M6, 0.7 newton-meters, 6 inch-pounds) with a meters, 6 inch-pounds) back to the fixture.
- Page 33 16. Place the rear H100/H200 GPU cold plate module 17. Place the left side hose on ( ) hose holder C, and the hoses on the hose guides and secure them with hose ties. right side hose on ( ) hose holder B. Ensure the guiding Note: Ensure not to place the hoses or sensor cable on labels on the hoses match with the markings on the hose top of each other.
- Page 34 Follow the following steps to remove a front H100/H200 GPU. Reposition the rear H100/H200 GPU cold plate module manifold to create space for replacing front H100/H200 GPU. 1. Align the guide pins on the shipping brackets with the 2. Loosen the two captive screws; then, remove the guide holes on the rear GPU cold plates and lower it onto handles from the shipping brackets.
- Page 35 Note: Locate the front GPU that is to be removed. 5. Remove the leakage sensor module cable from the 6. Loosen the screws 720 degrees following the screw cable clips, route it away from the cold plate, and reinstall sequence: specified on the cold plate label, and it in the cable clips adjacent to the cold plate.
- Page 36 8. Install the service bracket and the GPU cold plate assembly onto the front H100/H200 GPU cold plate module manifold. Flip over the service bracket and the GPU cold plate assembly; then, align the two captive screws and two guide pins with the screw holes and guide holes on the manifold.
- Page 37 9. Immediately clean the PCM and putty pads off from 10. With alcohol cleaning pads, wipe off any remaining the GPU and the cold plate module with alcohol cleaning putty pad and PCMs from the GPU cold plate module. pads. Gently clean the PCM and putty pads to avoid GPU Attention: damage.
- Page 38 Follow the following steps to install a front H100/H200 GPU 1. For new GPU, remove the connector covers at the 2. Install the GPU. bottom. Carefully lay the GPU onto the GPU baseboard. Follow the screw sequence shown in the illustration , and fully tighten the sixteen Torx T15 screws with a torque screwdriver set to the proper torque.
- Page 39 3. Replace the PCM on the GPU cold plate. 4. Replace the putty pads (x5) on the GPU. Remove the liner from one side of the pad. Remove the liner from one side of the pad. Align the PCM with the marking on the bottom of Make sure to align the putty pads to the GPU VR the cold plate, and place it onto the cold plate;...
- Page 40 5. Remove the service bracket and GPU cold plate 6. Place the GPU cold plate onto the GPU. assembly. Flip over the GPU cold plate assembly, slightly tilt Loosen the two captive screws that secure the the cold plate as illustrated to avoid interfering with service bracket to the manifold.
- Page 41 Use H100/H200 GPU service fixture kit to install the cold plate. The following illustration shows the components for H100/H200 GPU service fixture. H100/H200 GPU Handle service fixture Clamp head Spacer Table for rear GPU cold Table for front GPU plate cold plate 8.
- Page 42 10. Adjust the position of the handle and clamp head 11. After adjusting the handle and clamp head assembly, assembly by loosening and tightening the four hex socket reattach the four hex socket screws (4 x M6, 0.7 newton- screws (4 x M6, 0.7 newton-meters, 6 inch-pounds) with a meters, 6 inch-pounds) back to the fixture.
- Page 43 14. Place the spacer onto the clamp head and hold the Push the handle forward to a slightly straightened spacer while pulling the handle into a fully straightened position. Adjust the clamp head so that it rests at the position. center of the table as illustrated.
- Page 44 15. Attach the T10 extended bit to the torque screwdriver. Follow the screw sequence specified on the fixture and cold plate label, and repeat to fully tighten the sixteen Torx T10 screws with the screwdriver set to the proper torque. Set the torque screwdriver to 0.4±0.05 newton- meter, 3.5±0.5 pound-inch.
- Page 45 17. Reinstall the leakage sensor module cable to the GPU 18. Reposition the rear H100/H200 GPU cold plate cold plate. module manifold. Remove the leakage sensor module cable from the Disengage the manifold from the shipping bracket; adjacent cable clips. then, move the manifold back to the guide pins marked with B.
- Page 46 21. Fully loosen the four captive screws that secure the shipping brackets to the GPU cold plates; then, lift the shipping brackets away from the GPU cold plates to remove it. 4 4 6 6...
- Page 47 Follow the following steps to remove a rear H100/H200 GPU Note: Locate the rear GPU that is to be removed. 1. Remove the leakage sensor module cable from the 2. Loosen the screws 720 degrees following the screw cable clips, route it away from the cold plate, and reinstall sequence: specified on the cold plate label, and it in the cable clips adjacent to the cold plate.
- Page 48 4. Install the service bracket and the GPU cold plate assembly onto the rear H100/H200 GPU cold plate module manifold. Flip over the cold plate assembly; then, align the captive screw and two guide pins with the screw hole and guide holes on the manifold. Fasten the captive screw (PH1, 1 x M3, 0.5 newton- meters, 4.3 inch-pound) to secure the cold plate assembly onto the manifold.
- Page 49 7. Remove the H100/H200 GPU. Follow the screw sequence shown in the illustration , and fully loosen the sixteen Torx T15 screws with a torque screwdriver set to the proper torque (0.6 newton-meters, 5.3 inch-pounds). 4 4 9 9...
- Page 50 Follow the following steps to install a rear H100/H200 GPU 1. For new GPU, remove the connector covers at the 2. Install the GPU. bottom. Carefully lay the GPU onto the GPU baseboard. Follow the screw sequence shown in the illustration , and fully tighten the sixteen Torx T15 screws with a torque screwdriver set to the proper torque.
- Page 51 3. Replace the PCM on the GPU cold plate. 4. Replace the putty pads (x5) on the GPU. Remove the liner from one side of the pad. Remove the liner from one side of the pad. Align the PCM with the marking on the bottom of Make sure to align the putty pads to the GPU VR the cold plate, and place it onto the cold plate;...
- Page 52 5. Remove the service bracket and GPU cold plate 6. Place the GPU cold plate onto the GPU. assembly from the manifold. Flip over the GPU cold plate assembly; then, gently Loosen the captive screw that secures the service place the cold plate onto the GPU. bracket to the manifold.
- Page 53 Use H100/H200 GPU service fixture kit to install the cold plate. The following illustration shows the components for H100/H200 GPU service fixture. H100/H200 GPU Handle service fixture Clamp head Spacer Table for rear GPU cold Table for front GPU plate cold plate 9.
- Page 54 10. Adjust the position of the handle and clamp head 11. After adjusting the handle and clamp head assembly, assembly by loosening and tightening the four hex socket reattach the four hex socket screws (4 x M6, 0.7 newton- screws (4 x M6, 0.7 newton-meters, 6 inch-pounds) with a meters, 6 inch-pounds) back to the fixture.
- Page 55 13. Place the spacer onto the clamp head and hold the spacer while pulling the handle into a fully straightened position. 5 5 5 5...
- Page 56 14. Attach the T10 extended bit to the torque screwdriver. Follow the screw sequence specified on the fixture and cold plate label, and repeat to fully tighten the sixteen Torx T10 screws with the screwdriver set to the proper torque. Set the torque screwdriver to 0.4±0.05 newton- meter, 3.5±0.5 pound-inch.
- Page 57 16. Reinstall the leakage sensor module cable to the GPU cold plate. Remove the leakage sensor module cable from the adjacent cable clips. Route the leakage sensor module cable back onto the GPU cold plate, and install it in the cable clips on the cold plate.
- Page 58 After you finish, see the ThinkSystem SR780a V3 Hardware Maintenance Guide to reinstall the following: • Reconnect all the cables that were disconnected. • Rear fan cage support bracket.
- Page 60 Third Edition (December 2024) © Copyright Lenovo 2024. LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services Administration (GSA) contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-...
Need help?
Do you have a question about the ThinkSystem SR780a V3 and is the answer not in the manual?
Questions and answers