Table of Contents
Advertisement
Quick Links
CRAY T3E AC Multiple-cabinet Installation
HMM-369-0
Record of Revision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Safety Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Hazard Statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
ESD Precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Safety Precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Preinstallation Activities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Tools Required . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Checking Site Planning Requirements . . . . . . . . . . . . . . . . . . . . . . . . . .
Checking the Power Cord Receptacles . . . . . . . . . . . . . . . . . . . . . . . . .
Power Wiring for High-leakage Current . . . . . . . . . . . . . . . . . . . . . . . .
Unloading the Computer System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Inspecting the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Opening the "OPEN FIRST" Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Transporting the Mainframe to the Designated Location . . . . . . . . . . . . . .
Unpacking the CRAY T3E AC Cabinets . . . . . . . . . . . . . . . . . . . . . . . . . . .
Unpacking a Crate that Contains a Single Cabinet . . . . . . . . . . . . . . . .
Unpacking a Crate that Contains Two or Three Cabinets . . . . . . . . . . .
Unpacking and Positioning the PC-10 . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Unpacking and Positioning the System Workstation (SWS) . . . . . . . . . . . .
Unpacking and Positioning Additional System Components . . . . . . . . . . .
HMM-369-0
ESD Smock . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Wrist Strap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Cray Research Proprietary
(continued)
8
8
10
10
10
10
11
11
13
13
13
14
16
17
19
20
20
21
22
22
30
37
37
37
1
Advertisement
Table of Contents
Related Manuals for Cray T3E
Summary of Contents for Cray T3E
-
Page 1: Table Of Contents
Shipping Specifications ........Unpacking the CRAY T3E AC Cabinets ...... - Page 2 Complete the following tasks when you bolt cabinets together: Joining Two or More CRAY T3E AC Cabinets ..... . Preparing the CRAY T3E Cabinets for Internal Wiring ... .
- Page 3 Complete the following tasks for ALL cabinets: Verifying the CRAY T3E AC Hardware ......
- Page 4 Figure 19. Lower the Cabinets to the Floor ..... . . Figure 20. CRAY T3E AC Cabinet Layout ..... . .
- Page 5 CRAY T3E AC Multiple-cabinet Installation Figure 31. Six-cabinet System ....... . .
- Page 6 Figure 70. Installing the Side Panels ......Figure 71. CRAY T3E AC Cabinet Layout ..... . .
- Page 7 Example Cable Label ....... Table 6. CRAY T3E AC I/O Bulkhead GigaRing Connections ..Table 7.
-
Page 8: Record Of Revision
Revision 0: October 1996 Original printing. Overview These installation procedures are intended to assist Cray Research personnel with the mechanical installation of 2 or more CRAY T3E air-cooled (AC) cabinets. The installation includes the following tasks: • Unpacking and positioning the system components •... - Page 9 Installation, publication HMM-371. For information on the SWS installation, refer to System Workstation, publication HMM-222. For information on the CRAY T3E software installation, refer to the CRAY T3E Software Installation and Configuration Guide, publication SG-2610. For information on a single-cabinet installation, refer to CRAY T3E AC Single-cabinet Installation Procedures, HMM-164.
-
Page 10: Safety Information
CRAY T3E AC Multiple-cabinet Installation Safety Information The following subsections contain important safety information that you must read and understand before you begin the CRAY T3E AC system installation. Hazard Statements During the installation of the computer system, be alert for hazard advisory statements. -
Page 11: Wrist Strap
• Do not move the cabinets while they are connected to power. • Do not wear watches or jewelry when you work on a CRAY T3E system cabinet. DANGER Keep fingers and conductive tools away from high-voltage areas. Serious injury or death will occur if these precautions are not followed. - Page 12 Safety Information CRAY T3E AC Multiple-cabinet Installation • Set all circuit breakers to the OFF (0) position before you plug in the system power cord. • Unplug, lock, and tag the cabinet power plug before you work on the power system components.
-
Page 13: Preinstallation Activities
Hemostats, tweezers, or wire insertion tool (all optional) Checking Site Planning Requirements Before you install your CRAY T3E system, ensure that your site meets all of the site planning requirements included in Preparing for a CRAY T3E Air-cooled System Installation, Cray Research publication number HR-04118. For example, take some time to verify the following things: •... -
Page 14: Checking The Power Cord Receptacles
Perform the following procedure for each power cord receptacle that will support a CRAY T3E AC cabinet: 1. Turn off, lock, and tag the customer’s circuit breaker(s) that control power for the CRAY T3E AC cabinet power receptacle before you perform Step 2 and Step 3. DANGER... -
Page 15: Table 1. Required Power Receptacle Test Readings
CRAY T3E AC Multiple-cabinet Installation Preinstallation Activities 6. Measure between the ground-post hole and an appropriate earth-ground location. If you detect voltage on the ground-post hole, contact a site-approved electrician. Do not proceed with the installation. NOTE: The ground wire may act as an antenna and, through impedance, generate a low voltage (usually less than 1 Vac). -
Page 16: Power Wiring For High-Leakage Current
Preinstallation Activities CRAY T3E AC Multiple-cabinet Installation Figure 1. Power Plugs and Receptacles 4-post (~250 Vac) Power Plug and Receptacles Ground Ground 5-post (400 Vac) Power Plug and Receptacles Ground Ground Power Wiring for High-leakage Current Please note the following statement by Underwriters Laboratories, Inc. -
Page 17: Unloading The Computer System
1 unit vertical to 6 units horizontal. Refer to Preparing for a CRAY T3E Air-cooled System Installation, publication HR-04118, for more information on site requirements. -
Page 18: Figure 2. Single-Cabinet Shipping Configuration
Unloading the Computer System CRAY T3E AC Multiple-cabinet Installation If the computer site does not have a loading dock, arrange for a forklift to remove the computer from the transportation vehicle. Ensure that at least two people are available to help move the mainframe cabinets. -
Page 19: Inspecting The System
CRAY T3E AC Multiple-cabinet Installation Inspecting the System Figure 3. Three-cabinet Shipping Configuration NOTE: The side panels are shipped separately. Board (35 to 40 in. [889 to 1,016 mm] from top of shipping crate) 76.5 in. (1,943 mm) Rolling Height 112.5 in. -
Page 20: Opening The "Open First" Box
“OPEN FIRST” box to complete the installation. Transporting the Mainframe to the Designated Location The method you use to move the CRAY T3E AC cabinets depends on the shipping configuration. This section provides general guidelines. In addition, follow any instructions that are printed on the packing crates. -
Page 21: Shipping Specifications
CRAY T3E AC Multiple-cabinet Installation Transporting the Mainframe to the Designated Location Shipping Specifications The following list contains the specifications for a shipping crate that contains 1 cabinet: • Weight: 1,640 lbs (744 kg) • Height: 77.5 in. (1,969 •... -
Page 22: Unpacking The Cray T3E Ac Cabinets
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets This section contains unpacking instructions for shipping crates that contain 1 cabinet and for shipping pallets that contain 2 or 3 cabinets. If the system shipping or storage environment is significantly different than the environment in which it is to be installed (40 °F [22 °C] or greater disparity),... -
Page 23: Figure 4. Cabinet Shipping Crate
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 3. While someone holds the ramp, cut the horizontal strap. Set the ramp aside temporarily. CAUTION Someone must hold the ramp when you cut the strap. Failure to do so may cause the ramp to fall and result in injury to personnel. -
Page 24: Figure 5. Retaining Block And Screws
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 4. With an 11-mm wrench, remove the 2 retaining screws that secure the retaining block to the shipping crate, then remove the block, as shown in Figure 5. Retain the screws for the next step. -
Page 25: Figure 6. Installing The Ramp
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 5. Install the wooden ramp: Position the ramp as shown in Figure 6, so that the screw holes on the ramp align with the holes on the pallet. Insert the screws that you removed in Step 4 through the holes. -
Page 26: Figure 7. Cardboard Shipping Container
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 6. Remove the cardboard cover, the side panels, and the pad: Lift the cardboard cover from the top of the crate. Remove the two U-shaped side panels from the crate by lifting up and then out. -
Page 27: Figure 8. Removing The Inside Retaining Bar
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 7. Use an 11-mm wrench to remove the inside retaining bar. Four screws secure the bar to the shipping crate as shown in Figure 8. Figure 8. Removing the Inside Retaining Bar... -
Page 28: Figure 9. Shipping Bolts
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 8. Use an adjustable wrench (or a 16-mm wrench) to remove the 4 shipping bolts that secure the cabinet to the pallet. To access them, reach under the shipping pallet between the floor pads. There are 2 bolts (with washers) on each side of the pallet. - Page 29 CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 10. With one or more partners, carefully roll the cabinet down the ramp. CAUTION The system is heavy, and momentum may carry it down the ramp quickly. Ensure that the system does not roll off the pallet or the system may be damaged.
-
Page 30: Unpacking A Crate That Contains Two Or Three Cabinets
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Unpacking a Crate that Contains Two or Three Cabinets After you move the shipping crates to the designated location, use the following procedure to remove the cabinets from the crate. -
Page 31: Figure 10. Remove The Blocks
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 2. Remove the 4 wooden blocks from the shipping pallet. The blocks may be secured by tie straps as shown in Figure 10. Set the blocks aside for use in Step 4. -
Page 32: Figure 12. Place The Blocks Beneath The Corner Levelers
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 4. Raise the system and place a block beneath the cabinet leveler (leg) at each corner of the system. Refer to Figure 12. Figure 12. Place the Blocks beneath the Corner Levelers Blocks (Under cabinet levelers) –... -
Page 33: Figure 14. Remove The Straps
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 6. Cut the horizontal and vertical straps (bands). CAUTION The straps are tight and may hit you or someone nearby when you cut them. Wear eye protection and protect your body and face when you cut the straps. -
Page 34: Figure 16. Remove The Four Shipping Bolts
Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 8. Remove the 4 shipping bolts that secure the cabinets to the pallet, using an adjustable wrench (or a 16-mm wrench). There are 2 bolts on each side of the pallet. The bolts are located behind the 4 cabinet casters (wheels) at the corners of the system, as shown in Figure 16. -
Page 35: Figure 18. Remove The Blocks
CRAY T3E AC Multiple-cabinet Installation Unpacking the CRAY T3E AC Cabinets 10. Raise the cabinets with the ROL-A-LIFTs and remove the blocks. (To do this, reposition the ROL-A-LIFTs on the sides of the cabinets. Ensure that you position the 2 x 4 boards between the ROL-A-LIFTs and the cross braces on the cabinets.) - Page 36 Unpacking the CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 12. If necessary, roll the cabinets into the final location indicated on your site plan. This requires two or more personnel. CAUTION Ensure that cabinet casters (wheels) do not fall into floor cutouts. Failure to do...
-
Page 37: Unpacking And Positioning The
Unpacking and Positioning Additional System Components At this point, you should unpack and position any additional system components that shipped with your CRAY T3E AC cabinet. Refer to the appropriate installation documents for details on unpacking additional system components. HMM-369-0... -
Page 38: Joining Two Or More Cray T3E Ac Cabinets
If your system contains CRAY T3E cabinets that you must physically join together, then you must complete the procedures in this section. If all of your CRAY T3E cabinets are shipped prejoined as a single unit, you may skip this section and go to page 97 “Positioning Cabinets (for... -
Page 39: Figure 21. Door Latches And Handle (Front Door)
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 2. Open the front cabinet door: a. The door has two latches: top and bottom. For each latch, insert a 4-mm ball-end hex (Allen) wrench into the latch and turn the latch counterclockwise 1/4 turn. -
Page 40: Figure 22. Cabinet Floor Plan
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 3. Lower the cabinet power cord through the bottom of the cabinet, through the appropriate floor cutout, and into the underfloor area. If needed, move the cabinet to provide access to the floor cutout. If the computer area does not have a raised floor, position the power cord under the cabinet. -
Page 41: Figure 23. Temporary Cabinet Positions
Separate the cabinets temporarily by approximately 24 in. (60 cm) as shown in Figure 23. If your system configuration includes 3 or more CRAY T3E cabinets, place the third cabinet (cabinet 2) to the right of cabinet 1, place the fourth cabinet (cabinet 3) cabinet to the right of cabinet 2, etc. -
Page 42: Positioning Cabinets Temporarily When Some Cabinets Are Prejoined
CRAY T3E AC Multiple-cabinet Installation Positioning Cabinets Temporarily When Some Cabinets Are Prejoined Use this procedure when 2 or more of your CRAY T3E cabinets were bolted to one another during shipment. 1. Position cabinet 0 (the master cabinet, which contains clock module 0) and the attached cabinet(s) in the computer room as designated in the site floor plans. -
Page 43: Figure 25. Door Latches And Handle (Front Door)
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Figure 25. Door Latches and Handle (Front Door) Door Latch (1/4-turn) Insert Tool Here and Pull Door Latch (1/4-turn) 3. Lower the cabinet power cord through the bottom of each cabinet, through the appropriate floor cutouts, and into the underfloor area. -
Page 44: Figure 26. Cabinet Floor Plan
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 26. Cabinet Floor Plan Floor Cutouts for I/O Cables Cabinet Front Cabinet Front Perforated .... -
Page 45: Figure 27. Temporary Cabinet Positions For Prejoined Cabinets
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 6. Position the other cabinet(s) on the right side of cabinet 0, as you face the front of the cabinets. Separate the cabinets temporarily by approximately 24 in. (60 cm) as shown in Figure 27. -
Page 46: Removing Doors
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Removing Doors Remove the following doors from the cabinets. A door removal procedure follows the list. • Remove the rear door of each cabinet where you will connect internal wires, except the last cabinet (highest-numbered cabinet) in the system. -
Page 47: Removing The Blower Exhaust Shields
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 4. Carefully lift the door straight up about 1 in. (2.54 cm) until the door hardware clears the frame hinge, then remove the door. 5. Set the door in a protected location. -
Page 48: Figure 28. Access Panel Locations
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 28. Access Panel Locations Blower Upper Logic Exhaust Shield Panel Upper Plenum Panel Module Panel Lower Plenum Panel Lower Logic Panel I/O Panel Cray Research Proprietary... -
Page 49: Removing Wire-Duct Covers
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Removing Wire-duct Covers The side trim bolts to the system through four frame-bolt holes in the side of the cabinet, one hole at each corner, as shown in Figure 29. These holes are also used to bolt cabinets together. -
Page 50: Figure 29. Frame-Bolt Holes And Wire-Duct Locations
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 29. Frame-bolt Holes and Wire-duct Locations Top Frame-bolt Holes Bottom Frame-bolt Holes Lower-left Wire-duct Cover on Cabinet Front Cray Research Proprietary HMM-369-0... -
Page 51: Removing The Side Trim And Logic Panels (Optional)
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Removing the Side Trim and Logic Panels (Optional) If you choose to remove side trim panels and outside access panels (logic panels) for more light and additional access, use the following procedure: NOTE: This procedure requires two people, and is not recommended. -
Page 52: Attaching Cable Troughs
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Attaching Cable Troughs Check to see whether intercabinet cable troughs are installed on the cabinets that you must bolt together. (One set of cable troughs must be installed between each pair of cabinets.) Figure 30 shows a set of cable troughs. -
Page 53: Joining The Cabinets
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Joining the Cabinets We recommend that you join all of the cabinets before you begin the wiring process. For each cabinet that you add, complete the following steps -- one cabinet at a time. -
Page 54: Figure 32. Frame-Joiner Bolt Locations
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 2. Lower the cabinet power cord through the bottom of the cabinet, through the appropriate floor cutout, and into the underfloor area. If needed, move the cabinet to provide access to the floor cutout. If the computer area does not have a raised floor, position the power cord under the cabinet. -
Page 55: Figure 33. Frame-Joiner Bolts
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 4. For each of the 4 frame bolt holes: insert a 4-mm hex (allen) bolt (P/N 13145305), with lock washer (P/N 13160905) and flat washer (P/N 57244500), through the hole so that it passes through the frames of both cabinets. -
Page 56: Opening The Cable Ducts
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Opening the Cable Ducts In order to complete the intercabinet wiring, you must open the top and bottom cable ducts between the cabinets, as noted in the following list. Use the procedure that follows the list. -
Page 57: Figure 35. Intercabinet Cable Duct (As Viewed From Inside Cabinet)
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Figure 35. Intercabinet Cable Duct (as viewed from inside cabinet) Closed Cable Duct Duct Seal Duct Seal Retaining Screws Open Cable Duct Foam Strips Open Duct HMM-369-0... -
Page 58: Grounding The Mainframe Chassis
Grounding the Mainframe Chassis Use the following procedure to ground each mainframe chassis: NOTE: Each chassis is grounded through the power cord; however, Cray Research recommends that you connect an additional chassis ground to each chassis. If your site chooses not to connect an additional ground for a chassis, you must remove the ground strap, which could act as an antenna. -
Page 59: Removing Clock And Logic Modules
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Removing Clock and Logic Modules When you install two or more cabinets, you must connect clock wires to the clock rail connectors. To make these connections, you must remove the clock module(s). - Page 60 Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 3. If applicable, uncam clock module 1, which is in slot 6 of cabinet 3. 4. Disconnect the clock connector that plugs into each clock PCB near the lower part of the clock handle.
-
Page 61: Figure 38. Module Setscrew Locations (Rear View Of Cabinet)
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Figure 38. Module Setscrew Locations (Rear View of Cabinet) Modules Module Setscrew HMM-369-0 Cray Research Proprietary... -
Page 62: Preparing The Rails For Wire Insertion
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Preparing the Rails for Wire Insertion For most people, the most efficient way to install the clock wires is to unscrew the clock connectors, pull the connectors into the card cage, and then complete the wiring. -
Page 63: Removing Rail Connectors
Ensure that you do not lose the brass spacer that is on connector ’s first hex screw. d. If you are installing 2 or 3 CRAY T3E cabinets: Remove the hex screws from the next 3 connectors in the top rail: , and . -
Page 64: Figure 41. Clock Connector Locations
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation e. If you are installing 4, 5, or 6 CRAY T3E cabinets: Remove the hex screws from all of the other connectors in the top rail: , and... -
Page 65: Figure 43. Connector Locations - Bottom Clock Rail
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 2. If you are installing 4, 5, or 6 CRAY T3E cabinets: Remove connectors from the top clock rail in cabinet 3. Use the method you used in Step 1; do not remove the last hex screw from connector 3. -
Page 66: Removing Connector Pin Locks
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Removing Connector Pin Locks Carefully remove the plastic pin lock (P/N 01775900) from the module side of each loose connector. You may use a dental pick, or another sharp instrument, to pry the pin lock loose from the connector. -
Page 67: Completing The Internal Wiring
Torus connections Completing the Clock Connections You must make some or all of the following clock connections when you connect multiple CRAY T3E cabinets (the procedure for connecting wires begins on page 70): • From cabinets 1 and 2 to cabinet 0: •... -
Page 68: Figure 46. Example - Clock Wire Labels
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation • You must make a direct GigaRing clock connection from each PEM in cabinets 4 and 5 to the top rail of clock module 1. One end of each wire assembly is preinstalled in connector , pin 07, of each PEM rail. -
Page 69: Figure 47. Clock Connections
Joining Two or More CRAY T3E AC Cabinets Figure 47 provides an overview of the clock connections in 6 fully-populated CRAY T3E AC cabinets. Figure 48 shows the clock connectors where the system clock and GigaRing clock wires connect. Figure 47. Clock Connections... - Page 70 Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Use the following procedure to connect the clock wires: 1. Locate the disconnected clock wires and carefully route them from cabinet to cabinet. (You must route all cables that pass from cabinet to cabinet through the cable ducts above [or below] the modules.)
-
Page 71: Figure 49. Pin Locations
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets b. Route the wire to the appropriate rail connector. You will pass the wire through the rail and to the connector. Ensure that the wire passes through the same slot as the connector. -
Page 72: Figure 50. 2-Pin Connector Position
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 50. 2-pin Connector Position Curved Edge of 2-pin Connector Lock Curved Edge of 2-pin Connector Outside Wall of Rail Connector Outside Wall of Rail Connector Figure 51. Wire Insertion... -
Page 73: Figure 52. Wire Insertion With Wire Rod
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Figure 52. Wire Insertion with Wire Rod 1. Thread the wire rod through the appropriate pin slot in the connector block, as shown. Ensure that the plastic tip on the wire rod is at the wire-insertion end of... -
Page 74: Completing The Boundary Scan Connections
CRAY T3E AC Multiple-cabinet Installation Completing the Boundary Scan Connections You must make some or all of the following boundary scan connections when you install a multiple-cabinet CRAY T3E system (the procedure for connecting wires begins on page 75): •... -
Page 75: Connecting The Point-To-Point Wires - 4 Or More Cabinets
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Connecting the Point-to-point Wires – 4 or More Cabinets 1. If your system contains 4 or more cabinets, connect clock module 0 to clock module 1: a. Locate the edge-to-edge connection (P/N 15224009) that links clock module 0 to clock module 1. -
Page 76: Figure 55. Direct Boundary Scan Connections
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 55. Direct Boundary Scan Connections Cabinet 5 Cabinet 4 Cabinet 3 Cabinet 2 Cabinet 1 Cabinet 0 6 5 4 3 2 1 6 5 4 3 2 1... -
Page 77: Connecting 4-Pin Edge-To-Pigtail Cables - P/N 15237701
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Connecting 4-pin Edge-to-Pigtail Cables – P/N 15237701 Complete this procedure if your cabinets were split in any location other than between cabinet 2 and cabinet 3 (the third and fourth cabinets). -
Page 78: Figure 56. 4-Pin Edge-To-Pigtail Connections
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 56. 4-pin Edge-to-pigtail Connections Cabinet 5 Cabinet 4 Cabinet 3 Cabinet 2 Cabinet 1 Cabinet 0 6 5 4 3 2 1 6 5 4 3 2 1... -
Page 79: Figure 57. 4-Pin Edge-To-Pigtail Cable - P/N 15237701
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Procedure 1. At the clock module’s top rail, select a disconnected boundary scan cable (P/N 15237701). One end of the cable is plugged into the top clock rail. -
Page 80: Connecting The Daisy Chain
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Connecting the Daisy Chain Complete this procedure if your cabinets were split in any location other than between cabinet 2 and cabinet 3 (the third and fourth cabinets). -
Page 81: Figure 59. Scan Jumper/Intermediate Connection - P/N 15223802
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Procedure Use the following procedure to connect the daisy chain between cabinets that you bolt together (except between cabinet 2 and cabinet 3): 1. Go to the lower-numbered cabinet of the two cabinets where you must connect the daisy chain. -
Page 82: Connecting Scan Chain 0 To The Scan Master
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Connecting Scan Chain 0 to the Scan Master Complete this procedure if your cabinets were split between cabinet 0 and cabinet 1 and/or between cabinet 1 and cabinet 2. -
Page 83: Figure 61. 2-Position Socket, Edge-To-Pigtail Cable - P/N 15237601
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Procedure Use the following procedure to complete the daisy chain in cabinets 0, 1, and 2 (i.e., to link the last PEM in the daisy chain to the scan master PEM): 1. -
Page 84: Connecting Scan Chain 1 To The Scan Master
CRAY T3E AC Multiple-cabinet Installation Connecting Scan Chain 1 to the Scan Master Complete this procedure if your system includes 4 or more CRAY T3E cabinets. Background The PEMs in cabinets 3, 4, and 5 are all on scan chain 1. Scan chain 1 connects to the scan master via 3 cable connections to PEM 17 in slot 1 of cabinet 3. -
Page 85: Figure 63. Scan Jumper/Intermediate Connection - P/N 15223802
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Procedure Use the following procedure to connect scan chain 1: 1. Connect the jumper wire between the last PEM in scan chain 1 and the PEM in slot 1 of cabinet 3:... -
Page 86: Figure 64. 2-Position Pin, Edge-To-Pigtail Cable - P/N 15237801
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation 2. Connect cable 15237801 between the scan master and the PEM in slot 1 of cabinet 3: a. In cabinet 0, locate cable 15237801, which is labelled for connection to the PEM in slot 1 of cabinet 3 (specifically,... -
Page 87: Figure 65. 2-Position Socket, Edge-To-Pigtail Cable - P/N 15237601
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 3. Connect cable 15237601 between the scan master and the PEM in slot 1 of cabinet 3: a. In cabinet 0, locate cable 15237601, which is labelled for connection to the PEM in slot 1 of cabinet 3 (specifically,... -
Page 88: Reinstalling The Connectors In The Top Clock Rail
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Reinstalling the Connectors in the Top Clock Rail When you complete the clock and boundary scan wiring, reinstall the clock connectors in the rails. 1. Insert plastic pin locks (P/N 01775900) in any connector blocks that do not contain them and ensure that the pins are straight. - Page 89 CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets 2. Install each connector in the top clock rail. Start with the connector that is closest to the power supplies, then work your way to connector Carefully insert the connector in the rail. Ensure that the connector is properly oriented and that the wires are not tangled with the spring (if installed).
-
Page 90: Completing The Torus Interconnect Network Connections
The torus wire list Engineering Specification (#800502) that you received with your installation materials specifies the required torus connections for your size CRAY T3E AC system. Background Figure 67 is a simplified illustration of torus connections. It shows how both ribbon cables from one torus cable assembly connect to both ribbon cables from another assembly. -
Page 91: Figure 68. Connectors P2 And P3 - Torus Cable Assembly
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Two locking levers hold each connector pair together. To connect a torus connection: align the alignment pins with the alignment grooves in the connector pair, then push the two connectors together until the locking levers snap into place, as shown in Figure 68. - Page 92 Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Procedure 1. Study the torus wire list specification. If the wires that you must connect (those that pass from cabinet to cabinet) are not marked or otherwise identified in the specification, take a moment to mark them.
-
Page 93: Closing The Cable Ducts
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Closing the Cable Ducts When you complete the wiring, seal the intercabinet cable troughs by “closing” the duct seals. 1. Carefully close the cable ducts between the chassis to restrict air leaks (and to secure the wires and cables). -
Page 94: Figure 69. Module Camming
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation it is fully seated, then try to cam it. 3. Insert plastic shuttle locks in the modules, if applicable. Figure 69. Module Camming Uncams Cams Uncams Cams... -
Page 95: Installing Side Access Panels And Trim
CRAY T3E AC Multiple-cabinet Installation Joining Two or More CRAY T3E AC Cabinets Installing Side Access Panels and Trim If applicable, install side access panels and system side trim using the following procedure: WARNING Install the panel carefully; the side panel may start tipping. -
Page 96: Figure 70. Installing The Side Panels
Joining Two or More CRAY T3E AC Cabinets CRAY T3E AC Multiple-cabinet Installation Figure 70. Installing the Side Panels Stud Spacer (Stand-off) Spacer (Stand-off) Cray Research Proprietary HMM-369-0... -
Page 97: Positioning Cabinets (For Prejoined Cabinets)
Complete this procedure only if you did not join any cabinets. 1. Position the cabinets in the computer room as designated in the site floor plans. Figure 71. CRAY T3E AC Cabinet Layout NOTE: The grids represent 24 in. X 24 in. (61 cm X 61 cm) floor tiles. -
Page 98: Figure 72. Door Latches And Handle (Front Door)
Positioning Cabinets (for Prejoined Cabinets) CRAY T3E AC Multiple-cabinet Installation Figure 72. Door Latches and Handle (Front Door) Door Latch (1/4-turn) Insert Tool Here and Pull Door Latch (1/4-turn) 3. For each cabinet, lower the cabinet power cord through the bottom of the cabinet, through the appropriate floor cutout, and into the underfloor area. -
Page 99: Figure 73. Cabinet Floor Plan
CRAY T3E AC Multiple-Cabinet Installation Positioning Cabinets (for Prejoined Cabinets) Figure 73. Cabinet Floor Plan Floor Cutouts for I/O Cables Cabinet Front Cabinet Front Perforated .... -
Page 100: Grounding The Mainframe Chassis (For Prejoined Cabinets)
If you did not ground each mainframe chassis earlier, use the following procedure to ground them now. Complete this procedure if you did not join any cabinets. NOTE: Each chassis is grounded through the power cord; however, Cray Research recommends that you connect an additional chassis ground to each chassis. -
Page 101: Installing The Cabinet Side Panels (For Prejoined Cabinets)
CRAY T3E AC Multiple-Cabinet Installation Installing the Cabinet Side Panels (for Prejoined Cabinets) Installing the Cabinet Side Panels (for Prejoined Cabinets) Use the following procedure to install each of the two side panels, one on each end of the system. Complete this procedure if you did not join any cabinets. -
Page 102: Figure 75. Installing Side Panels
Installing the Cabinet Side Panels (for Prejoined Cabinets) CRAY T3E AC Multiple-cabinet Installation Figure 75. Installing Side Panels Stud Spacer (Stand-off) Spacer (Stand-off) Cray Research Proprietary HMM-369-0... -
Page 103: Verifying The Cray T3E Ac Hardware
This section contains procedures that you must complete to ensure that the condition of cabinet components is suitable for power-up. You must complete these procedures for every CRAY T3E AC cabinet in the system. Refer to Figure 76, which shows several of the cabinet components, as you work. -
Page 104: Verifying The Voltage Selector Switch
3. If the customer does not plan to connect an optional alarm to the CRAY T3E AC cabinet, install the power cord cover now. (The cover is not preinstalled. Instead, it is wedged between the left side of the power box and the side of the cabinet. -
Page 105: Connecting The Optional Customer Alarm
Power Cord Connecting the Optional Customer Alarm If the CRAY T3E cabinet will connect to the customer’s alarm system, use the following procedure to connect it now. 1. Remove the air filter, which will provide greater access to the power box and remote alarm contacts: a. -
Page 106: Figure 79. Filter Bracket
Verifying the CRAY T3E AC Hardware CRAY T3E AC Multiple-cabinet Installation Figure 79. Filter Bracket Filter Bracket Retaining Screw 2. Remove the cover from the power box: WARNING Electrical shock hazard. Ensure that the power plug is not connected to the power receptacle. -
Page 107: Figure 80. Remote Alarm Contacts - Locations
CRAY T3E AC Multiple-Cabinet Installation Verifying the CRAY T3E AC Hardware Figure 80. Remote Alarm Contacts - Locations Table 2. Remote Alarm Contacts - Descriptions Contact Description TB2-1 NC (normally closed) TB2-2 Remote alarm common TB2-3 NO (normally open) TB2-4 Shield (ground) 6. -
Page 108: Verifying The Control System Hardware
Verifying the CRAY T3E AC Hardware CRAY T3E AC Multiple-cabinet Installation Verifying the Control System Hardware 1. Open the warning and control system (WACS) panel, which is shown in Figure 81. Use a medium flatblade screwdriver to turn the 2 panel-latch screws clockwise, which loosens them. -
Page 109: Figure 82. Wacs With Front Panel Open
CRAY T3E AC Multiple-Cabinet Installation Verifying the CRAY T3E AC Hardware Figure 82. WACS with Front Panel Open Scanner B DANGER Blower Controller High voltage. Bypass Turn power off before servicing. Switch Caution BYPASS Scanner B Scanner A NORMAL BLOWER... -
Page 110: Verifying Additional Power Hardware
Verifying the CRAY T3E AC Hardware CRAY T3E AC Multiple-cabinet Installation Verifying Additional Power Hardware 1. Ensure that all of the power supply cords and power supply control cables are properly seated. Refer to Figure 83. 2. Ensure that the Remote Restart Enable switch is in the disabled (0) position. -
Page 111: Verifying That The Modules Are Seated And Cammed
CRAY T3E AC Multiple-Cabinet Installation Verifying the CRAY T3E AC Hardware Verifying that the Modules Are Seated and Cammed 1. On the module end of the chassis, use a #2 Phillips screwdriver to remove the module panel. Eight 1/4-turn screws secure the panel. Pull the panel out at an angle. -
Page 112: Completing The System Cabling
System cabling is variable, and the cabling plan for your system may require modification of the following cabling procedures. Figure 85 is a block diagram of a typical CRAY T3E system (the GigaRing channels are simplified). -
Page 113: Cable Labels
CRAY T3E AC Multiple-Cabinet Installation Completing the System Cabling Cable Labels Cable connections depend upon the customer’s system configuration. Ensure that each cable is labeled at both ends with the source and destination connection. For connections to the PC-10, the cable labels refer to the position of the PC-10 subrack where the cable connects. -
Page 114: Connecting The Wacs
2. Refer to the cable labels and to the system configuration documentation for details on the WACS cabling configuration. 3. Route the serial-port cable between the CRAY T3E cabinet and the SWS (or the serial-port concentrator). The 9-pin connector connects to the CRAY T3E cabinet, and the RJ45 connector connects to the SWS. -
Page 115: Connecting The Gigaring Cables
Connecting the GigaRing Cables Background In the CRAY T3E system, data input and output takes place via GigaRing channels. If connected on a GigaRing channel, a PEM serves as a GigaRing node and connects to an MPN (and to other nodes, if applicable) via four GigaRing connections: two for the positive ring and two for the negative ring. -
Page 116: Figure 88. Example Gigaring Connections
NRO to NRI PRO to PRI In this example, slots 2, 3, and 4 are on a customer I/O GigaRing channel. PEM 0, in slot NOTE: 1, is the only CRAY T3E node on the boundary scan channel. Cray Research Proprietary HMM-369-0... -
Page 117: Figure 89. Gigaring Connectors On Pc-10 (Rear View)
CRAY T3E AC Multiple-Cabinet Installation Completing the System Cabling 4. Ensure that the other ends of the GigaRing cables connect to the MPN, SPN, etc. Figure 89 is a rear view of a PC-10 cabinet and shows GigaRing connections on the MPN-1 and NSR-1 subracks. Figure 90 shows detail of an NSR-1 subrack, and Figure 91 shows detail of an MPN-1. -
Page 118: Figure 90. Nsr-1 Gigaring Connectors
Completing the System Cabling CRAY T3E AC Multiple-cabinet Installation Figure 90. NSR-1 GigaRing Connectors Negative Ring In Positive Ring In Negative Ring Out Positive Ring Out Figure 91. MPN-1 GigaRing Connectors SBUS SLOT 0 SBUS SLOT 1 SBUS SLOT 4... -
Page 119: Verifying System Cabling
CRAY T3E AC Multiple-Cabinet Installation Powering Up the System Workstation (SWS) Verifying System Cabling When you complete the cabling between the CRAY T3E cabinet and the other system components, ensure that all other system connections are complete, including GigaRing, WACS, and Ethernet connections. -
Page 120: Verifying Cabinet Operation
Verifying Cabinet Operation CRAY T3E AC Multiple-cabinet Installation Verifying Cabinet Operation Complete the following procedure for each cabinet to verify correct operation of the cabinet components. Verifying WACS Control 1. Close the WACS circuit breaker (CB9). 2. Set the Remote Restart Enable switch to the enable (1) position. Verify that the switch indicator light is on. -
Page 121: Verifying Operation Of The Blower
CRAY T3E AC Multiple-Cabinet Installation Verifying Cabinet Operation Verifying Operation of the Blower 1. Turn on the blower circuit breaker (CB8). WARNING Keep hands away from the blower (fan), and keep eyes and face away from the blower exhaust. Failure to do so could result in severe injury. -
Page 122: Verifying Remote Alarm Operation (Optional)
Powering Up the Modules CRAY T3E AC Multiple-cabinet Installation Verifying Remote Alarm Operation (Optional) 1. Apply heat to the inlet air thermistors to create a fault. 2. Listen for the main contactor (CT1) to open and remove power from the blower (and module power supplies). -
Page 123: Verifying Remote Power On/Off
2. At the SWS, use the nwacs Switches window to perform a remote power-off. 3. Check the CRAY T3E AC cabinet to ensure that the main contactor opened and removed power from the blower and the module power supplies. -
Page 124: Running Boundary Scan And Diagnostics
CRAY T3E AC Multiple-cabinet Installation Running Boundary Scan and Diagnostics After you complete the mechanical installation of the CRAY T3E AC cabinets, the PC-10(s), and the SWS, you are ready to prepare the system for operation. At the time of this publication, the procedure consists of the following tasks: 1. -
Page 125: Figure 94. T3Ems Main Window
CRAY T3E AC Multiple-Cabinet Installation Running Boundary Scan and Diagnostics 9. In nwacs, set the CRAY T3E soft switches for boundary scan operation: Set the switch (formerly the switch) to ON. Soft Scan Enable Testmode Set the (test clock select soft switch) to TCKS. -
Page 126: Figure 95. T3Ems Scan Tool Options Window
Running Boundary Scan and Diagnostics CRAY T3E AC Multiple-cabinet Installation 10. Under the menu item in the T3EMS main window, select Tools . When the window appears, click Boundary Scan T3EMS Scan Tool Options on the button to run boundary scan. Figure 95 shows the... -
Page 127: Figure 96. Load Program Window
CRAY T3E AC Multiple-Cabinet Installation Running Boundary Scan and Diagnostics 13. Under the menu item in the T3EMS main window, select Scripts Load & . The window appears, as shown in Figure 96. Load Program 14. Select the diagnostic from the window and giga_diag.pgm... -
Page 128: Figure 97. Pe Configuration Window
Running Boundary Scan and Diagnostics CRAY T3E AC Multiple-cabinet Installation 15. Disable the I/O ports on all PEs that do not connect to GigaRing channels: Under the menu item in the T3EMS main window, select Config . The window appears. Refer to... - Page 129 CRAY T3E AC Multiple-Cabinet Installation Running Boundary Scan and Diagnostics 16. Select the command buffer from the Load Program window and mile.pgm click on the button. This starts the offline diagnostic suite listed in Accept Table 7. This diagnostic offers a series of interactive windows that contain program choices.
-
Page 130: Table 7. Offline Diagnostic Tests
Running Boundary Scan and Diagnostics CRAY T3E AC Multiple-cabinet Installation Table 7. Offline Diagnostic Tests Test Pass Count The following test runs alone under the T3EMS scripts: giga_diag The following tests run under the mile.pgm command buffer: todt (time_of_day_test) 1,000... -
Page 131: Installing Panels And Doors
CRAY T3E AC Multiple-Cabinet Installation Installing Panels and Doors Installing Panels and Doors When you confirm that the system is fully functional and ready for customer operation, replace the access panels and doors that you removed earlier. Installing Rear Access Panels Install the rear access panels that you removed earlier. -
Page 132: Installing The Doors
4. Ensure that the door opens and closes properly. 5. Connect the ground wire. This completes the mechanical installation procedures for a CRAY T3E single-cabinet system. Refer to the CRAY T3E Software Installation and Configuration Guide, publication SG-2610, for the software installation and initialization procedures. -
Page 133: Appendix - Wire Removal
CRAY T3E AC Multiple-Cabinet Installation Appendix – Wire Removal Appendix – Wire Removal Use the following procedure to remove a 2-pin connector (clock or boundary scan wire) from a rail connector: 1. Position yourself so that you can see the pins. - Page 134 Appendix – Wire Removal CRAY T3E AC Multiple-cabinet Installation Cray Research Proprietary HMM-369-0...
Need help?
Do you have a question about the T3E and is the answer not in the manual?
Questions and answers