Power775 Disk Enclosure Fan Service Procedure CONTENTS GENERAL................................4 ........................... 4 ELEASE EVISION ISTORY ........................4 HERE TO FIND THIS DOCUMENT ............................. 4 EQUIRED OCUMENTS ............................4 ELATED OCUMENTS ..............................5 BBREVIATIONS OVERVIEW ................................6 ............................... 6 AFETY OTICES ATTENTION: F ....................
Page 3
Power775 Disk Enclosure Fan Service Procedure Figure List Figure 1 Fan Assembly: Top View..............................10 Figure 2 Fan Assembly: Bottom View ............................10 Figure 3 Fan Assembly: Front View.............................. 11 Figure 4 Fan Assembly: Top View Showing Identify LED Location....................11 Figure 5 DE Enclosure VPD Label..............................
InfoCenter Website: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7ee2/p7ee2kickoff.htm Click “PDF files for the IBM Power 775 (9125-F2C) removing and replacing parts” Under “Disk Enclosure”, click “Disk Enclosure Fan” to download PDF “p775_de_fan.pdf” This is the only valid source for the latest Power775 Disk Enclosure Fan Service Procedure.
The power supplies for the CEC and DE are called the Assembly CEC DCCA and DE DCCA respectively. Disk Enclosure GPFS Global Parallel File System IBM’s file system utilizing software RAID Hard Disk Drive This also means hard drive Light Emitting Diode Licensed Internal Code Printed Circuit Board...
This section is an overview only. Do not start the service procedure until Section 3 which contains the detailed steps. 2.1 Safety Notices Read “Safety_Notices “ available from InfoCenter – see Section 1.3. http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hdx/G229-9054.pdf The following notices apply to all Power775 service procedures: CAUTION: Energy hazard present.
Page 7
Power775 Disk Enclosure Fan Service Procedure DANGER: Rack-mounted devices are not to be used as shelves or work spaces. (L002) DANGER: Hazardous voltage present. Voltages present constitute a shock hazard, which can cause severe injury or death. (L004) CAUTION: Sharp edges, corners, or joints nearby. (L006) CAUTION: Hazardous moving parts nearby.
Page 8
Power775 Disk Enclosure Fan Service Procedure CAUTION: Pinch hazard. (L012) ATTENTION: Small gaps exist that could pinch body parts if care is not exercised. CAUTION: Chemical resistant gloves are needed for this procedure. (L014) DANGER: Risk of electric shock due to water or a water solution which is present in this product. Avoid working on or near energized equipment with wet hands or when spilled water is present.
This service procedure requires powering off a Disk Enclosure and because of this requires interaction with GPFS in order to limit impact to performance. 2.3 Confirm how you got to this Power 775 DE Fan Service Procedure You should be performing this procedure if you have determined a Disk Enclosure Fan has failed and needs replacement.
Power775 Disk Enclosure Fan Service Procedure 2.4 DE Fan Description The Power775 Disk Enclosure contains 12 internal cooling fans. Since the Disk Enclosure is capable of running with only 8 fans, a service request will not be scheduled until at least 2 or 3 fans fail depending on the location of the failed fans. When 2 or more fans fail, the fan speed will increase to compensate and maintain airflow.
Page 11
Power775 Disk Enclosure Fan Service Procedure Figure 3 Fan Assembly: Front View Figure 4 Fan Assembly: Top View Showing Identify LED Location 11 of 61...
Power775 Disk Enclosure Fan Service Procedure 2.4.1 Enclosure VPD label and Location Code The enclosure VPD label is placed on the rear of a Disk Enclosure just above the enclosure LEDs (see Figure 5 DE Enclosure VPD Label). Figure 5 DE Enclosure VPD Label An example of a location code of Fan 4 in the DE with the label shown in Figure 5 is: U78AD.001.992001B-P1-A4 2.5 Concurrency...
2.7 Required SSRs and Roles This service procedure requires one SSR. This service procedure contains steps to be performed by a customer system administrator and an IBM SSR (System Service Representative). The customer system administrator performs the STEPs in Sections marked with “<= CUSTOMER TASK”...
Power775 Disk Enclosure Fan Service Procedure 2.11 Service Procedure Overview This is an overview of the tasks to be performed. Read this overview but do not perform any of the tasks yet. <= CUSTOMER TASK................15 SSESS SHUTDOWN OF FILE SYSTEM <= CUSTOMER TASK..................
Power775 Disk Enclosure Fan Service Procedure 3 SERVICE PROCEDURE STOP – Do not proceed unless you have read “Safety Notices” which is available from InfoCenter; see Section 1.3. 3.1 Assess shutdown of file system <= CUSTOMER TASK STEP 1 The customer must assess whether all client applications can be stopped at this time and whether the Global Parallel File System (GPFS) can be shut down at this time.
Power775 Disk Enclosure Fan Service Procedure 3.3 Identify the frame <= SSR TASK STEP 4 Use the procedure “Appendix A: Power775 BPC FSP Command Line Procedure” (included in Section 5 of this document) to access the BPC FSP command line of the frame containing the Disk Enclosure with the FRU needing replacement.
Page 17
Power775 Disk Enclosure Fan Service Procedure Cage ID (Hex) = 0F Cage ID (Hex) = 0D Cage ID (Hex) = 0B Cage ID (Hex) = 09 Cage ID (Hex) = 07 Cage ID (Hex) = 05 Figure 6 Disk Enclosure HEX Cage ID 17 of 61...
Page 18
Power775 Disk Enclosure Fan Service Procedure STEP 6 Locate the frame. Confirm that it is the correct frame by checking that its UEPO Panel Identify LED is blinking. This LED is located on the UEPO panel and it is marked by the “!” symbol (see Figure 7 and Figure 8). Figure 7 Frame Photo showing UEPO location 18 of 61...
Page 19
Power775 Disk Enclosure Fan Service Procedure Figure 8 UEPO assembly showing frame Identify Amber LED STEP 7 Open the front and rear doors DANGER: Hazardous voltage present. Voltages present constitute a shock hazard, which can cause severe injury or death. (L004) Locate the latch along the left side of the door;...
Page 20
Power775 Disk Enclosure Fan Service Procedure Figure 9 Door Latch Figure 10 Door Latch handle shown extended 20 of 61...
Page 21
Power775 Disk Enclosure Fan Service Procedure STEP 8 If it will be needed for service, bring over the Ladder PN 46G5947 (shipped in the Power 775 Lift Tool Kit). STEP 9 Identify the Disk Enclosure Identify the Disk Enclosure with the failed fans by looking for the blinking amber Enclosure ID LEDs on the DE DCCAs on the front side of the Disk Enclosure (see Figure 11) OR on the right side of the rear of the Disk Enclosure (see Figure 12).
Page 22
Power775 Disk Enclosure Fan Service Procedure Figure 12 Rear Enclosure ID LED is located on the bottom right side of the DE STEP 10 Check the Enclosure VPD Label Verify that the location codes of the Fans to be replaced match the enclosure VPD Label of the DE you have identified (see Figure 5).
Power775 Disk Enclosure Fan Service Procedure 3.4 Power off the Disk Enclosure <= CUSTOMER TASK STEP 12 Power Off the Disk Enclosure by using the following command from the BPC Command Line: This is the command syntax: bpccmd –c 40<blank>0000<cage ID> <blank>...
Page 24
Power775 Disk Enclosure Fan Service Procedure Figure 13 T1 and T4 Input Power LEDs on the DE DCCAs 24 of 61...
Power775 Disk Enclosure Fan Service Procedure 3.6 Move UEPO Panel <= SSR TASK STEP 14 Is the Disk Enclosure being serviced located in U21 or U25 (see Figure 14)? If “YES”, then go to STEP 15. • If “NO”, then go to STEP 19. •...
Page 26
Power775 Disk Enclosure Fan Service Procedure STEP 17 Place the UEPO in the “Frame UEPO Service Position” in the Rack (see Figure 15). Figure 15: Frame UEPO Service Position STEP 18 Hand tighten the UEPO blue thumb screw to secure the UEPO in the Rack. 26 of 61...
Find the cable that was connected to and labeled DCCA1-T2. Connect this cable to Cable Assembly E/NET (test tool) P/N 45D8000 (shipped in Power 775 Fill & Drain Tool Kit). If the test tool is not labelled, follow the E/NET cable to the other end and label it T2. Do not connect it to the DCCA at this time.
Page 28
Power775 Disk Enclosure Fan Service Procedure Figure 17 DE cabling 28 of 61...
Page 29
Find the cable that was connected to and labeled DCCA1-T1. Connect this cable to Cable Assembly, HPIC tool P/N 45D7998 (shipped in Power 775 Fill & Drain Tool Kit), using 0.07Nm torque. If the HPIC tool is not labelled, follow the HPIC cable to the other end and label it T1. Do not connect it to the DCCA at this time.
Page 30
Power775 Disk Enclosure Fan Service Procedure STEP 21 Identify the SAS cables that need to be disconnected and disconnect them. The SAS cables connect to Port Card in the front and rear of the DE. All cables should be labeled to help when re-cabling the DE.
Page 31
Power775 Disk Enclosure Fan Service Procedure STEP 22 Locate the two Front Rail Block Captive Allen head screws (one on the left side and one on the right side of the DE) which hold the Front Rail Block to the DE Rails (see Figure 20). Loosen these screws using the 5mm Hex Torque Tool PN 74Y0986 (shipped in the Hand Tool Kit).
Page 32
Power775 Disk Enclosure Fan Service Procedure Figure 21: Front Rail Block Screws 32 of 61...
Page 33
Power775 Disk Enclosure Fan Service Procedure STEP 24 Disconnect the 2 Water Hoses from the rear of the Disk Enclosure by pulling the retaining ring on the hose (see Figure 22 Water Hose Connector). CAUTION: The water-based coolant solution may contain an additive intended to inhibit corrosion (or provide other functions).
Page 34
Power775 Disk Enclosure Fan Service Procedure STEP 25 Locate the two Rear Rail Block Captive Allen head screws (one on the left side and one on the right side of the DE) which hold the Rear Rail Block to the Rack Slide-Rails (see Figure 23). Loosen these screws using the 5mm Hex Torque Tool PN 74Y0986 (shipped in the Hand Tool Kit).
Power775 Disk Enclosure Fan Service Procedure 3.8 Install Cam Followers and Slide DE to Service Position <= SSR TASK STEP 26 Move the Cam Followers from the storage position near EIA 5 in the lowest slot in the frame (see Figure 19 and 20) to the location of the Disk Enclosure with the failed fans.
Page 36
Power775 Disk Enclosure Fan Service Procedure Figure 24 Cam Follower Storage Location Drawing 36 of 61...
Page 37
Power775 Disk Enclosure Fan Service Procedure Figure 25 Cam Follower Drawing – in storage location at EIA 5 – zoomed in 37 of 61...
Page 38
Power775 Disk Enclosure Fan Service Procedure Figure 26 Cam Followers Picture Left Cam Follower Right Cam Follower Figure 27 Figure 28 38 of 61...
Page 39
Power775 Disk Enclosure Fan Service Procedure Left Cage Cam Follower Rollers Left Cage Channel Channel Figure 29 Cam Follower engaged in Disk Enclosure channels 39 of 61...
Page 40
Check carefully that all cables are out of the way of the top, bottom, sides, and especially the corners of the DE. For this operation it may be necessary to use Ladder P/N 46G5947 shipped with the POWER 775 Lift Tool Kit.
Page 41
Power775 Disk Enclosure Fan Service Procedure Figure 30 Blue-purple Recessed Touch Points Figure 31 Photo of Disk Enclosure in service position 41 of 61...
Page 42
Power775 Disk Enclosure Fan Service Procedure Figure 32 DE Extraction distance (edge of frame to tip of cable tray) 42 of 61...
Page 43
2mm Hex Torque Driver P/N 74Y0983 Cable Assembly, HPIC tool P/N 45D7998 (shipped in Power 775 Fill & Drain Tool Kit) Cable Assembly E/NET (test tool) P/N 45D8000 (shipped in Power 775 Fill & Drain Tool Kit) Extender cables attached to DCCA1...
Page 44
¼ turn fasteners and rotate them ¼ turn counterclockwise. Lift the fan cover off the box. For this operation it may be necessary to use Ladder P/N 46G5947 shipped with the POWER 775 Lift Tool Kit. Figure 34 ¼ turn fastener fan cover removal...
Power775 Disk Enclosure Fan Service Procedure 3.9 Power on the DE to Fan Service Mode and replace the fans <= SSR TASK STEP 30 Power On the Disk Enclosure to Fan Service Mode from the BPC FSP command line by using the following command: This is the command syntax: bpccmd –c 11<blank>00<version><Cage ID><FRU ID>...
Page 46
Power775 Disk Enclosure Fan Service Procedure STEP 31 Blink the Fan Identify LED for the each Fan you are replacing by using the following command from the BPC Command Line: This is the command syntax: bpccmd –c 27<blank>0000<cage ID><FRU ID><LED blink state 00=off, 02=blink> <blank>...
Page 47
The failing fan ID LEDs should be blinking showing which fans are to be replaced (see Figure 30). Confirm also the A1..A12 location labels against the location codes of the failed fans. For the this and the next several STEPs, it may be necessary to use Ladder P/N 46G5947shipped with the POWER 775 Lift Tool Kit. FAN LED...
Page 48
Power775 Disk Enclosure Fan Service Procedure STEP 33 Remove the fans by pulling the retention rings toward each other and lifting the fan out of the DE (see Figure 36 and Figure 37). CAUTION: Hazardous moving parts nearby. (L008) Pull Fan rings toward one another Fan removal rings Figure 36 Lift fan out of disk enclosure...
Page 49
Power775 Disk Enclosure Fan Service Procedure STEP 34 Insert replacement fans Insert a new fan assembly into each open slot (see Figure 38). When fully seated, the fan will be latched into the Disk Enclosure. Pull up on one fan ring to check if the fan is fully seated. Never force the fan down. If the fan is not seating properly, remove the fan and straighten the floating blind mate connector.
Page 50
Power775 Disk Enclosure Fan Service Procedure STEP 35 Turn off the FAN Identify LED for each FAN you are replacing by using the following command from the BPC Command Line: This is the command syntax: bpccmd –c 27<blank>0000<cage ID><FRU ID><LED blink state 00=off, 02=blink> <blank>...
Power775 Disk Enclosure Fan Service Procedure Where “xx” is the Cage ID of the DE you are servicing. This field will be 05,07,09,0B,0D, or 0F (see Figure 6). The correct return code is 001100. If you do not receive this, contact the next level of support. ATTENTION: Be very careful that you are in the correct frame and that you type this command exactly as it will power off the cage you type.
Page 52
Power775 Disk Enclosure Fan Service Procedure Figure 39 T1 and T4 Input Power LEDs on the DE DCCAs 52 of 61...
Page 53
Power775 Disk Enclosure Fan Service Procedure CAUTION: Following the service procedure assures power is removed from 350 VDC power distribution STEP 38 connectors before they are unplugged. However, unplugging 350 VDC power distribution connectors while powered on, should not be done because it can cause connector damage and could result in burn and/or shock injury from electrical arcing.
Page 54
Power775 Disk Enclosure Fan Service Procedure STEP 42 Remove the Cam Followers by pulling the locating pin out of the frame and lifting the Cam Follower (see figure 36). Return the Cam Followers to the original storage location at the lowest position of the frame near EIA 5. Screw the shipping screws back into the cam followers.
Page 55
Power775 Disk Enclosure Fan Service Procedure STEP 43 Install the two Rear Rail Block Captive Allen head screws. STEP 44 Attach the water hoses by pushing the quick connects onto the DE water connectors. STEP 45 Reconnect the rear SAS cables. Using the Location Codes labels, install the cables to the correct Port Card connectors.
Page 56
Power775 Disk Enclosure Fan Service Procedure STEP 47 If you removed the Front Rail Blocks, reinstall them using the Front Rail Block hex screws (see Figure 21). NOTE: Make sure the Rail Blocks will not interfere with removal of the adjacent Drive Carriers INCORRECT: Block Interfering with Drive Carrier Figure 42: Rail Block Rail Block Interfering with Drive Carrier...
Power775 Disk Enclosure Fan Service Procedure STEP 48 Using the 2mm Hex Torque Driver P/N 74Y0983 with torque setting of 0.07Nm, reconnect the four DCCA Power Cables (HPICs) to the DE DCCAs (see Figure 18). STEP 49 Reconnect the four DCCA Service Network Communications (E/NET) cables to the DE DCCAs (see Figure 16 and Figure 17).
Power775 Disk Enclosure Fan Service Procedure STEP 55 Turn on the Disk Enclosure levels (5V and 12V) from the BPC FSP command line by using the following command: This is the command syntax: bpccmd –c 82<blank>0000<Cage ID> <blank> = “11” <Cage ID>...
Power775 Disk Enclosure Fan Service Procedure 5 5 5 5 APPENDIX A: POWER775 BPC FSP COMMAND LINE PROCEDURE Procedure to Access the BPC FSP Command Line 1. The HMC can be accessed via the keyboard/display that resides in the network management rack. 2.
Page 60
5. From the Launch ASM Interface window, select SIDE_A for the ‘Frame IP Address’ then click the OK button. 6. The ASM login window is presented. Acquire the necessary User ID and Password. “celogin” requires Daily PW from the IBM Support Center. “celogin1” might be has enabled by the customer. If so, obtain the password from the customer.
Power775 Disk Enclosure Fan Service Procedure 7. Expand ‘System Service Aids’ + sign and Select ‘Service Processor Command Line’. 8. The ASM BPC FSP Command line will be presented. Enter the commands defined in the paper service procedures at this command line and press the Enter key (or click the Execute button). 9.