IBM 9008-22L Site And Hardware Planning
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Server
  5. 9008-22L
  6. Site and hardware planning
IBM 9008-22L Site And Hardware Planning

IBM 9008-22L Site And Hardware Planning

Hide thumbs Also See for 9008-22L:
Table of Contents

Advertisement

Quick Links

See also: Manual
Power Systems
Site and hardware planning
IBM

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the 9008-22L and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for IBM 9008-22L

Summary of Contents for IBM 9008-22L

  • Page 1 Power Systems Site and hardware planning...
  • Page 2 Note Before using this information and the product it supports, read the information in “Safety notices” on page v, “Notices” on page 139, the IBM Systems Safety Notices manual, G229-9054, and the IBM Environmental Notices and User Guide, Z125–5823. ®...

  • Page 3: Table Of Contents

    Expansion unit and migration tower specifications................18 Rack specifications..........................22 Hardware Management Console specifications.................. 64 Rack switch specifications........................67 Rack installation specifications for racks that are not purchased from IBM........70 Planning for power.............................78 Determining your power requirements....................78 Plugs and receptacles.......................... 80 Modification of IBM-provided power cords..................95...

  • Page 5: Safety Notices

    Das Produkt ist nicht für den Einsatz an Bildschirmarbeitsplätzen im Sinne § 2 der Bildschirmarbeitsverordnung geeignet. Laser safety information IBM servers can use I/O cards or features that are fiber-optic based and that utilize lasers or LEDs. Laser compliance IBM servers may be installed inside or outside of an IT equipment rack.
  • Page 6 – For racks with a DC power distribution panel (PDP), connect the customer’s DC power source to the PDP. Ensure that the proper polarity is used when attaching the DC power and DC power return wiring. • Connect any equipment that will be attached to this product to properly wired outlets. •...
  • Page 7 • Rack-mounted devices are not to be used as shelves or work spaces. Do not place objects on top of rack-mounted devices. In addition, do not lean on rack mounted devices and do not use them to stabilize your body position (for example, when working from a ladder). •...
  • Page 8 – Remove all devices in the 32U position (compliance ID RACK-001 or 22U (compliance ID RR001) and above. – Ensure that the heaviest devices are installed in the bottom of the rack cabinet. – Ensure that there are little-to-no empty U-levels between devices installed in the rack cabinet below the 32U (compliance ID RACK-001 or 22U (compliance ID RR001) level, unless the received configuration specifically allowed it.
  • Page 9 DANGER: Rack-mounted devices are not to be used as shelves or work spaces. Do not place objects on top of rack-mounted devices. In addition, do not lean on rack-mounted devices and do not use them to stabilize your body position (for example, when working from a ladder). (L002) (L003) Safety notices ix...
  • Page 10 DANGER: Multiple power cords. The product might be equipped with multiple AC power cords or multiple DC power cables. To remove all hazardous voltages, disconnect all power cords and power cables. (L003) (L007) CAUTION: A hot surface nearby. (L007) (L008) CAUTION: Hazardous moving parts nearby.
  • Page 11 Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call.
  • Page 12 Freewheeling will cause uneven cable wrapping around winch drum, damage cable, and may cause serious injury. • This TOOL must be maintained correctly for IBM Service personnel to use it. IBM shall inspect condition and verify maintenance history before operation. Personnel reserve the right not to use TOOL if inadequate.
  • Page 13 The dc-powered system employs an isolated DC return (DC-I) design. The DC battery return terminal shall not be connected to the chassis or frame ground. The dc-powered system is intended to be installed in a common bonding network (CBN) as described in GR-1089-CORE.
  • Page 14 xiv Power Systems: Site and hardware planning...

  • Page 15: Site And Hardware Physical Planning Overview

    The physical planning section of this topic collection provides the physical characteristics of many system units, and associated products. For information on products not included in this topic collection, contact your sales representative or your IBM reseller. Before you proceed with planning, ensure that the hardware and software you chose meets your needs.
  • Page 16 2 Power Systems: Site and hardware planning...

  • Page 17: Planning Activities

    • Adequate space for maintaining and servicing the devices. • Physical security requirements necessary for the devices. • Weight of the devices. • Heat output of the devices. • Operating temperature requirements of the devices. © Copyright IBM Corp. 2018, 2019...

  • Page 18: Site Preparation And Physical Planning Guidelines

    • Humidity requirements of the devices. • Air flow requirements of the devices. • Air quality of the location where the devices are used. For example, excess dust can damage your system. Note: The system and devices are designed to operate in normal office environments. Dirty or other poor environments might damage the system or the devices.
  • Page 19 • General guidelines for data centers • Temperature and humidity design criteria • Temperature and humidity recording instruments • Relocation and temporary storage • Acclimation • System air distribution Planning for the installation of rear door heat exchangers • Planning for the installation of rear door heat exchangers •...
  • Page 20 6 Power Systems: Site and hardware planning...

  • Page 21: Site And Hardware Planning

    1. The depth is measured from the front bezel to the back of the top cover. The depth from the front rack EIA mounting post to the back of the server where the PCI cables exit is 713 mm (28 inches). Table 4. Shipping dimensions for the 9008-22L, 9009-22A, and 9223-22H (without pallet) Width...
  • Page 22 3. Power draw and heat load vary greatly by configuration. When you plan for an electrical system, it is important to use the maximum values. However, when you plan for heat load, you can use the IBM Systems Energy Estimator to obtain a heat output estimate based on a specific configuration. For more information, see The IBM Systems Energy Estimator website.
  • Page 23 Table 8. Environment requirements (continued) Environment requirements 2,3,4 Properties Recommended Allowable ASHRAE class A2 (Fourth edition) Airflow direction Front-to-back Temperature 18.0°C – 27.0°C (64.4°F – 10.0°C – 35.0°C (50.0°F – 80.6°F) 95.0°F) Low end moisture -9.0°C (15.8°F) dew point -12.0°C (10.4°F) dew point and 8% relative humidity High end moisture 60% relative humidity and 15°C...
  • Page 24 Environment requirements Notes: 1. IBM provides the recommended operating environment as the long-term operating environment that can result in the greatest reliability, energy efficiency, and reliability. The allowable operating environment represents where the equipment is tested to verify functionality. Due to the stresses that operating in the allowable envelope can place on the equipment, these envelopes must be used for short-term operation, not continuous operation.
  • Page 25 Table 9. Noise emissions for the 9008-22L, 9009-22A, and 9223-22H (continued) 1, 2, 3, 4, 5 Declared noise emission values in accordance with ISO 9296 Production Declared A-weighted Declared A-weighted Statistical adder for description sound power level, L sound pressure level, L...
  • Page 26 Directives) might govern noise level exposure in the workplace and might apply to you and your server installation. This IBM system is available in racks with optional acoustical door features that can help reduce the noise that is emitted from this system. The actual sound pressure levels in your installation depend upon various factors, including the number of racks in the installation;...
  • Page 27 Table 10. Noise emissions for the 9009-41A (continued) 1, 2, 3, 4, 5 Declared noise emission values in accordance with ISO 9296 Production Declared A-weighted Declared A-weighted Statistical adder for description sound power level, L sound pressure level, L verification, K WA,m pA,m (dB)
  • Page 28 Directives) might govern noise level exposure in the workplace and might apply to you and your server installation. This IBM system is available in racks with optional acoustical door features that can help reduce the noise that is emitted from this system. The actual sound pressure levels in your installation depend upon various factors, including the number of racks in the installation;...
  • Page 29 Table 11. Noise emissions for the 9009-42A and 9223-42H (continued) 1, 2, 3, 4, 5 Declared noise emission values in accordance with ISO 9296 Production Declared A-weighted Declared A-weighted Statistical adder for description sound power level, L sound pressure level, L verification, K WA,m pA,m...
  • Page 30 Directives) might govern noise level exposure in the workplace and might apply to you and your server installation. This IBM system is available in racks with optional acoustical door features that can help reduce the noise that is emitted from this system. The actual sound pressure levels in your installation depend upon various factors, including the number of racks in the installation;...
  • Page 31 HMC that it replaces. This local device is needed by the service representative to service the system. Model 9008-22L, 9009-22A, and 9223-22H Technical Documentation for EU Regulation 617/2013 International Business Machines Corporation New Orchard Road Armonk, New York 10504 http://www.ibm.com/customersupport/...

  • Page 32: Expansion Unit And Migration Tower Specifications

    Table 16. System characteristics System characteristics Properties Product type Computer server Year first manufactured 2018 Noise levels (declared A-weighted sound 8.3 bels (B) power level of the computer) Table 17. Power characteristics Power characteristics Properties Internal/external power supply efficiency 80 PLUS Verification and Testing Report 1025 W 80 PLUS Verification and Testing Report 1400 W Maximum power (watts) 1400 W and 1025 W...
  • Page 33 Table 20. Electrical Electrical characteristics Properties kVA (maximum) 0.32 Rated voltage and frequency 100 - 127 V ac or 200 - 240 V ac at 50 - 60 Hz Thermal output (maximum) 1024 Btu/hr Power requirements (maximum) 300 W Power factor 0.94 Leakage current (maximum) 1.2 mA...
  • Page 34 2. All measurements made in conformance with ISO 7779 and declared in conformance with ISO 9296. 3. AC and HVDC power supplies cannot be mixed in the same server or I/O drawer. IBM recommends that AC products and HVDC products with HVDC PDUs are installed in separate racks. However, AC and HVDC products can be supported in the same rack if all grounding (earthing) is done in accordance with the applicable electrical code or codes.
  • Page 35 Table 27. Environment requirements (continued) Environment Recommended operating Allowable operating Nonoperating Shipping temperature -40°C to 60°C (-40°F to 140°F) Shipping relative humidity 5% - 100% 1. Derate maximum allowable dry-bulb temperature 1°C per 175 m above 950 m. Table 28. Service clearances for rack-mounted expansion unit Front Back Sides...

  • Page 36: Rack Specifications

    Select your rack model to view its specifications. Related reference Rack installation specifications for racks that are not purchased from IBM Learn about the requirements and specifications for installing IBM systems into racks that were not purchased from IBM. Planning for the 7014-T00 and 7014-T42 racks Rack specifications provide detailed information for your rack, including dimensions, electrical, power, temperature, environment, and service clearances.
  • Page 37 Model 7014-T00 rack Hardware specifications provide detailed information for your rack, including dimensions, electrical, power, temperature, environment, and service clearances. Table 33. Dimensions for rack Rack Width Depth Height Weight Weight EIA unit configuratio (empty) (maximum capacity configuratio Rack Only 644 mm 1016 mm 1804 mm...
  • Page 38 Rack airflow requirements depend on the number and type of drawers installed. Note: Acoustic doors are available for IBM racks. Feature code 6248 is available for the 0551 and 7014- T00 racks. Feature code 6249 is available for 7014-T42 racks. The overall sound reduction is approximately 6 dB.
  • Page 39 - 90 amperes with a maximum load of 600 amperes. FC EPB8 does not include circuit breakers or DC power cables. The circuit breakers and associated DC power cables are typically supplied with IBM products. For OEM products, you must provide the applicable circuit breakers and DC power cables.
  • Page 40 Figure 1. FC EPB8 - power distribution panel 26 Power Systems: Site and hardware planning...
  • Page 41 Figure 2. FC EPB8 - power distribution panel (top-down view) Table 36. Dimensions for 7014-T00 rack with FC 6117 or FC EPB8 installed Dimensions Properties Width (rack with side panels) 644 mm (25.4 in.) Depth 1148 mm (45.2 in.) Height with -48 v DC power only 1926 mm (75.8 in.) Height with -48 v DC power and overhead cable tray 1941 mm (76.4 in.)
  • Page 42 Table 37. Environment requirements for FC 6117 and FC EPB8 (continued) Environment Recommended operating Allowable operating Nonoperating Shipping temperature -40°C to 70°C (-40°F to 158°F) Shipping relative humidity 0% - 93% Model 7014-T42 and 7014-B42 rack Hardware specifications provide detailed information for your rack, including dimensions, electrical, power, temperature, environment, and service clearances.
  • Page 43 Table 38. Dimensions for rack (continued) Rack Width Depth Height Weight Weight EIA unit configuration (empty) (maximum capacity configuration Rack with FC 644 mm (25.4 1413 mm 2015 mm 289 kg (635 6249 acoustic in.) (55.6 in.) (79.3 in.) front and rear doors Rack with FC 644 mm (25.4...
  • Page 44 FC EC07 and EC08 639 mm (25.2 in.) 1946 mm (76.6 in.) 114.3 mm (4.5 in.) 19 kg (42 lb) acoustic doors, each each each black IBM, front and rear 30 Power Systems: Site and hardware planning...
  • Page 45 Rack airflow requirements depend on the number and type of drawers installed. Note: Acoustic doors are available for IBM racks. Feature code 6248 is available for 7014-T00 racks. Feature code 6249 is available for 7014-T42 racks. The overall sound reduction is approximately 6 dB.
  • Page 46 Figure 3. Caster and leveler locations Note: Rack units are large and heavy and are not easily moved. As maintenance activities require access at both the front and the back, extra room is needed. The footprint illustration does not show the radius of the swinging doors on the I/O rack.
  • Page 47 7014-T00 and 7014-T42 service clearances and caster location Use the service clearances and caster locations for 7014-T00 and 7014-T42 racks to plan the correct service clearances and caster locations for your rack. Service clearances Table 42. Service clearances for 7014-T00, 7014-T42, and 0553 racks Front Rear Sides...
  • Page 48 Figure 4. Caster and leveler locations Note: Rack units are large and heavy and are not easily moved. As maintenance activities require access at both the front and the back, extra room is needed. The footprint illustration does not show the radius of the swinging doors on the I/O rack.
  • Page 49 Figure 5. FC ERG0 rear rack extender (top-down view) Site and hardware planning 35...
  • Page 50 Figure 6. FC ERG0 assembled view 7014-T00 and 7014-T00 multiple attachment racks Model 7014-T00 or 7014-T42 racks can be bolted together in a multiple-rack arrangement. This figure shows that arrangement. A kit is available including the bolts, spacers, and decorative trim pieces to cover the 25.4 mm (1 in.) space.
  • Page 51 Hardware specifications provide detailed information for your rack, including dimensions, electrical, power, temperature, environment, and service clearances. 7014-T00 and 7014-T42 rack weight distribution and floor loading Racks can be heavy when populated with several drawers. Use the Weight distribution distances for racks when loaded and Floor loading for racks when loaded tables to ensure proper floor loading and weight distribution.
  • Page 52 Table 44. Floor loading for racks when loaded (continued) Rack Floor loading Raised kg/m Non-raised kg/m Raised lb/ft Non-raised lb/ft 7014-T42 82.5 73.5 7014-T42 7014-T42 341.4 297.5 Notes: 1. Dimensions without covers, units are mm with inches in parentheses. 2. Weight distribution distance is one half of the service clearance values that is shown in the figure plus cover thickness.
  • Page 53 128.3 mm (5.2 in.) Measured from the front flat surface of the door. Measured from the IBM logo on the front of the door. Multiple racks that are placed side-by-side must have a 6 mm (0.24 in.) minimum clearance between racks to allow the triplex front door to hinge properly.
  • Page 54 Table 50. Service clearances Front Back Side 915 mm (36 in.) 915 mm (36 in.) 610 mm (24 in.) Side service clearance is only required when outriggers are on the rack. Side service clearance is not required during normal operation of the rack when outriggers are not installed. Rear door heat exchanger Specifications for Power orderable feature code (FC): EC05 - Rear door heat exchanger indicator (Model 1164-95X).
  • Page 55 Figure 7. Caster locations Cabling the 7953-94X and 7965-94Y rack Learn about the different cable routing options available for the 7953-94X and 7965-94Y rack. Cabling within the rack Side cable channels are available in the rack to route cables. Two cable channels are on each side of the rack as shown in Figure 8 on page 42.
  • Page 56 Figure 8. Cabling within the rack Cabling under the floor A cable access bar on the bottom rear of the rack helps to route the cables, leaving the rack in place. This bar can be removed for installation and then reattached after the rack is installed and cabled. 42 Power Systems: Site and hardware planning...
  • Page 57 Figure 9. Cable access bar Cabling overhead Front and rear rectangular cable access openings that are on the top of the rack cabinet allow cables to be routed up and out of the rack. Cable access covers are adjustable by loosing the side screws and sliding the covers forward or backward.
  • Page 58 Figure 10. Cable access covers Side stabilizing outriggers Learn about the side stabilizing outriggers available for the 7953-94X and 7965-94Y rack. The outriggers are stabilizers with wheels that are installed on the sides of the rack cabinet. The outriggers can be removed only after the rack is in the final location and is not moved more than 2 m (6 ft) away in any direction.
  • Page 59 Table 52. Dimensions for rack with outriggers EIA unit Width Depth Height Weight capacity 780 mm (30.7 in.) 1095 mm (43.1 in.) 2002 mm (78.8 in.) 261 kg (575 lb) 42 EIA units Figure 11. Outrigger locations Site and hardware planning 45...
  • Page 60 Multiple racks Learn how to attach multiple 7953-94X and 7965-94Y racks together. Multiple 7953-94X and 7965-94Y racks can be attached together by using attachment brackets that connect the units at the front of the rack. See Figure 12 on page 46. Figure 12.
  • Page 61 Model 1164-95X rear door heat exchanger Learn about the specifications of the 1164-95X rear door heat exchanger (feature code ECR2). Model 1164-95X rear door heat exchanger specifications Table 53. Dimensions for the 1164-95X rear door heat exchanger Width Depth Height Weight (empty) Weight (filled) 600 mm (23.6 in.) 129 mm (5.0 in.)
  • Page 62 Figure 13. Typical performance of the heat exchanger, 20 kW heat load Figure 14. Typical performance of the heat exchanger, 30 kW heat load Water specifications for the secondary cooling loop Important: 48 Power Systems: Site and hardware planning...
  • Page 63 The water that is being supplied to the heat exchanger must meet the requirements that are described in this section. Do not use glycol solutions because they can adversely affect the cooling performance of the heat exchanger. Cooling loop requirements A secondary cooling loop, separate from the main site cooling loop, is required for the rear door heat exchanger.
  • Page 64 Air exposure: The secondary cooling loop is a closed loop, with no continuous exposure to room air. After you fill the loop, remove all air from the loop. An air bleed valve is provided at the top of a heat exchanger manifold for purging all air from the system.
  • Page 65 2.54 cm (1 in.) female national pipe thread (NPT) fitting for each supply and return hose connection to the facility. The IBM supplied hoses contain the quick connect fittings to mate to the fittings on the rear door heat exchanger.
  • Page 66 1942 mm (76.5 in.) 115.5 mm (4.6 in) 17.7 kg (39 lb) ECRD acoustic in.) front and rear doors, black IBM FC ECRC and 590 mm (23.2 1942 mm (76.5 in.) 110 mm (4.3 in) 17.7 kg (39 lb) ECRD acoustic in.)
  • Page 67 1. The final ASHRAE class is determined by the hardware that is installed in the rack. Individual specifications for each piece of hardware must be reviewed. 2. Derate maximum allowable dry-bulb temperature 1°C per 175 m above 950 m. IBM recommends a temperature range of 18°C - 27°C (64°F - 80.6°F).
  • Page 68 Figure 15. Floor cutout Caster and leveler locations The following diagram provides the caster and leveler locations for the 7965-S42 rack. 54 Power Systems: Site and hardware planning...
  • Page 69 Figure 16. Caster and leveler locations Cabling the 7965-S42 rack Learn about the different cable routing options available for the 7965-S42 rack. Cabling within the rack Side cable channels are available in the rack to route cables. Three cable channels are on each side of the rack.
  • Page 70 Figure 17. Cabling within the rack Cabling under the floor Cables can be routed straight down through the side channels of the rack or routed towards the center of the opening. 56 Power Systems: Site and hardware planning...
  • Page 71 Figure 18. Cabling under the floor Cabling overhead Front and rear cable access openings that are on the top of the rack cabinet allow cables to be routed up and out of the rack. Cable access covers on the rear are adjustable by loosening the side screws and sliding the covers forward or backward.
  • Page 72 Figure 19. Cabling overhead Multiple racks Learn how to attach multiple 7965-S42 racks together. Multiple 7965-S42 racks can be attached together. For racks that are on a 600 mm (23.6 in.) pitch, you can use screws to clamp the racks together. For racks that are on a 609 mm (24.0 in.) pitch, two spacer brackets must be added to set the proper spacing before you can use screws to clamp the racks together.
  • Page 73 Figure 20. Attaching multiple racks with spacer brackets Model 1164-95X rear door heat exchanger Learn about the specifications of the 1164-95X rear door heat exchanger (feature code ECR2). Model 1164-95X rear door heat exchanger specifications Table 61. Dimensions for the 1164-95X rear door heat exchanger Width Depth Height...
  • Page 74 – 22°C ± 1°C (71.6°F ± 1.8°F) for ASHRAE Class 2 Environment • Required water flow rate (as measured from the supply entrance to the heat exchanger) – Minimum: 22.7 liters (6 gallons) per minute – Maximum: 56.8 liters (15 gallons) per minute Heat exchanger performance A heat removal of 100% indicates that an amount of heat that is equivalent to that generated by the devices has been removed by the heat exchanger and the average air temperature leaving the heat...
  • Page 75 Figure 22. Typical performance of the heat exchanger, 30 kW heat load Water specifications for the secondary cooling loop Important: The water that is being supplied to the heat exchanger must meet the requirements that are described in this section. Do not use glycol solutions because they can adversely affect the cooling performance of the heat exchanger.
  • Page 76 The system that supplies the cooling water must be able to measure the room dew point and automatically adjust the water temperature accordingly. Otherwise, the water temperature must be above the maximum dew point for that data center installation. For example, the following minimum water temperature must be maintained: •...
  • Page 77 2.54 cm (1 in.) female national pipe thread (NPT) fitting for each supply and return hose connection to the facility. The IBM supplied hoses contain the quick connect fittings to mate to the fittings on the rear door heat exchanger.

  • Page 78: Hardware Management Console Specifications

    The HMC controls managed systems, including the management of logical partitions and the use of capacity on demand. Using service applications, the HMC communicates with managed systems to detect, consolidate, and send information to IBM for analysis. The HMC provides service technicians with diagnostic information for systems that can operate in a multiple-partitioned environment.
  • Page 79 The HMC controls managed systems, including the management of logical partitions and the use of capacity on demand. Using service applications, the HMC communicates with managed systems to detect, consolidate, and send information to IBM for analysis. The HMC provides service technicians with diagnostic information for systems that can operate in a multiple-partitioned environment.
  • Page 80 Table 67. Electrical Electrical characteristics Properties Maximum measured power 300 W Maximum kVA 0.330 Maximum thermal output 1024 BTU/hr Input voltage 100 - 127 V ac or 200 - 240 V ac Frequency 50 or 60 Hz 1. Power consumption and heat output vary depending on the number and type of optional features that are installed and the power-management optional features that are in use.

  • Page 81: Rack Switch Specifications

    This IBM system is available with an optional acoustical door feature that can help reduce the noise that is emitted from this system. The actual sound pressure levels in your installation depend upon various factors, including the number of racks in the installation;...
  • Page 82 G8052R RackSwitch specification sheet Hardware specifications provide detailed information for your IBM BNT RackSwitch, including dimensions, electrical, power, temperature, environment, and service clearances. Table 70. Dimensions Height Width Depth Weight (maximum) 44 mm (1.73 in.) 439 mm (17.3 in.) 445 mm (17.5 in.) 8.3 kg (18.3 lb)
  • Page 83 4573 m (15000 ft) Heat dissipation 1100 Btu/hr Acoustic noise Less than 65 dB G8264R RackSwitch specification sheet Hardware specifications provide detailed information for your IBM BNT RackSwitch, including dimensions, electrical, power, temperature, environment, and service clearances. Table 76. Dimensions Height Width Depth Weight (maximum) 44 mm (1.73 in.)

  • Page 84: Rack Installation Specifications For Racks That Are Not Purchased From Ibm

    Learn about the requirements and specifications for 19-inch racks. These requirements and specifications are provided as an aid to help you understand the requirements to install IBM systems into racks. It is your responsibility, working with your rack manufacturer, to ensure that the rack that is chosen meets the requirements and specifications that are listed here.
  • Page 85 IBM development labs to comply with applicable safety and regulatory requirements. These racks are also tested and verified to fit and function with IBM products. The customer is responsible for verifying with the rack manufacturer that any non-IBM racks comply with IBM specifications.
  • Page 86 • The following rack hole sizes are supported for racks where IBM hardware is mounted: – 7.1 mm (0.28 in.) plus or minus 0.1 mm (round) – 9.5 mm (0.37 in.) plus or minus 0.1 mm (square) The rack or cabinet must be capable of supporting an average load of 20 kg (44 lb) of product weight per EIA unit.
  • Page 87 Figure 24. Model 9008-22L, 9009-22A, 9009-41A, 9009-42A, 9223-22H, and 9223-42H rear rack clearance For model 9040-MR9, you must have a minimum rear clearance of 246 mm (9.7 in.) or 280 mm (11.0 in.) depending on the type of rack bracket that is used during installation.
  • Page 88 Figure 26. Model 9040-MR9 rear rack clearance For model 9080-M9S, you must have a minimum rear clearance of 240 mm (9.45 in.) or 280 mm (11.0 in.) depending on the width of the available rack space and the type of rack bracket that is used during installation.
  • Page 89 The mounting rails and mounting hardware that are provided with IBM products are designed and tested to safely support the product during operation and service activities, and to safely support the weight of your drawer or device.
  • Page 90 • Any product or component that plugs into either an IBM power distribution unit or mains power (by using a power cord), or uses any voltage over 42 V ac or 60 V dc (considered to be hazardous voltage) must be Safety Certified by a Nationally Recognized Test Laboratory (NRTL) for the country in which it is installed.
  • Page 91 IBM Service Branch Office). Some products can have rack installation limitations. Refer to the specific server or product specifications for any restrictions. Products that are installed over 2.9 m (9 ft) above the floor require a Special Bid to be completed before they can be serviced by IBM service personnel.

  • Page 92: Planning For Power

    Your server can have power requirements different from a PC (such as different voltage and different plugs). IBM supplies power cords with an attached plug that corresponds to the power outlet most commonly used in the country or region to which the product is being shipped. You are responsible for supplying the proper power outlets.
  • Page 93 • Contact an electrician. Contact a qualified electrician to take care of your server power requirements and install needed power outlets. Give the electrician a copy of your power information. You can print the recommended power distribution wiring diagram as a reference for your electrician. Server Information Form 3A Use this form to record the type and quantity of power cords that you need for your server.

  • Page 94: Plugs And Receptacles

    Table 84 on page 80 lists power cords to use from the server to the power mains. These power cords are not used with IBM supplied PDUs. Table 85 on page 84 lists power cords that connect IBM servers to a PDU. Table 84. Supported power cords for POWER9 systems...
  • Page 95 Table 84. Supported power cords for POWER9 systems (continued) Feature codes Description Voltage, cord IBM shipped Matched female IBM part (FC) set amperage, plug wall receptacle number and length (on wall) 6472 Type 18 CEE (7) 200 - 240 V ac,...
  • Page 96 Table 84. Supported power cords for POWER9 systems (continued) Feature codes Description Voltage, cord IBM shipped Matched female IBM part (FC) set amperage, plug wall receptacle number and length (on wall) 6478 Type 25 CEI 200 - 240 V ac,...
  • Page 97 Table 84. Supported power cords for POWER9 systems (continued) Feature codes Description Voltage, cord IBM shipped Matched female IBM part (FC) set amperage, plug wall receptacle number and length (on wall) Type 76 CNS 200 - 240 V ac, Plug type 76...
  • Page 98 Restriction of the Use of Certain Hazardous Substances in Electrical and Electronic Equipment. 2. FC EPAC can be used to allow IBM Manufacturing to select a length of cord (1.0 m (3.3 ft), 1.5 m (4.9 ft), or 2.5 m (8 ft)) during rack integration.
  • Page 99 Table 85. Supported server to PDU power cords on POWER9 systems (continued) Voltage, Feature codes amperage, and Power cord (left Power cord IBM part (FC) Description length end) (right end) number 6665 IEC 320 200 - 240 V ac, Connector Type...
  • Page 100 Table 85. Supported server to PDU power cords on POWER9 systems (continued) Voltage, Feature codes amperage, and Power cord (left Power cord IBM part (FC) Description length end) (right end) number EPAL Rong Feng/IEC 200 – 240 V ac, RF-203P-M...
  • Page 101 Table 86. Supported power cords by countries (continued) Supported countries 6470 American Samoa, Antigua and Barbuda, Aruba, Bahamas, Barbados, Belize, Bermuda, Bolivia, Canada, Cayman Islands, Columbia, Costa Rica, Cuba, Dominican Republic, Ecuador, El Salvador, Guam, Guatemala, Haiti, Honduras, Jamaica, Japan, Marshall Islands, Mexico, Micronesia (Federal States of), Montserrat, Netherlands Antilles, Nicaragua, Northern Mariana Islands, Palau, Panama, Peru, Philippines, Puerto Rico, San Marino, Saudi Arabia, Thailand, Turks and Caicos Islands, United States,...
  • Page 102 Table 86. Supported power cords by countries (continued) Supported countries 6479 Australia, New Zealand 6488 Argentina, Paraguay, Uruguay 6489 Afghanistan, Albania, Algeria, Andorra, Angola, Antarctica, Antigua and Barbuda, Argentina, Armenia, Azerbaijan, Bahrain, Bangladesh, Belarus, Belgium, Belize, Benin, Bhutan, Bolivia, Bosnia and Herzegovina, Botswana, Bouvet Island, Brazil, British Indian Ocean Territory, Brunei Darussalam, Bulgaria, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Central African Republic, Chad, Chile, China, Christmas Island, Cocos (Keeling) Islands, Comoros, Congo, Congo (The Democratic...
  • Page 103 Table 86. Supported power cords by countries (continued) Supported countries 6491 Afghanistan, Albania, Algeria, Andorra, Angola, Antarctica, Antigua and Barbuda, Argentina, Armenia, Azerbaijan, Bahrain, Bangladesh, Belarus, Belgium, Belize, Benin, Bhutan, Bolivia, Bosnia and Herzegovina, Botswana, Bouvet Island, Brazil, British Indian Ocean Territory, Brunei Darussalam, Bulgaria, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Central African Republic, Chad, Chile, China, Christmas Island, Cocos (Keeling) Islands, Comoros, Congo, Congo (The Democratic Republic of the), Cook Islands, Cote D'Ivoire (Ivory Coast), Croatia (Republic of), Cuba,...
  • Page 104 Table 86. Supported power cords by countries (continued) Supported countries 6654 Algeria, American Samoa, Anguilla, Antigua and Barbuda, Aruba, Bahamas, Barbados, Belarus, Belize, Bermuda, Bolivia, Brazil, Canada, Cayman Islands, Colombia, Congo, Congo (The Democratic Republic of the), Costa Rica, Cuba, Dominican Republic, Ecuador, El Salvador, French Polynesia, Guam, Guatemala, Haiti, Honduras, Jamaica, Japan, Kazakhstan, Liberia, Mali, Marshall Islands, Martinique, Mexico, Micronesia (Federal States of), Moldova (Republic of), Netherlands Antilles, Nicaragua, Northern...
  • Page 105 Table 86. Supported power cords by countries (continued) Supported countries 6665 Afghanistan, Albania, Algeria, American Samoa, Andorra, Angola, Anguilla, Antarctica, Antigua and Barbuda, Argentina, Armenia, Aruba, Australia, Austria, Azerbaijan, Bahamas, Bahrain, Bangladesh, Barbados, Belarus, Belgium, Belize, Benin, Bermuda, Bhutan, Bolivia, Bosnia and Herzegovina, Bulgaria, Bouvet Island, Brazil, British Indian Ocean Territory, Brunei Darussalam, Bulgaria, Burkina Faso, Burundi, Cambodia, Cameroon, Canada, Cape Verde, Cayman Islands, Central African Republic, Chad, Chile, China, Christmas Island, Cocos (Keeling) Islands, Colombia, Comoros, Congo,...
  • Page 106 Table 87. Supported PDU power cords for POWER9 systems Featur Description View of Matched Matched IBM part Countries e code shipped plug female female number • Voltage (FC) plug connector wall • Amperage (on cord) receptacle (on wall) • Phase •...
  • Page 107 Table 87. Supported PDU power cords for POWER9 systems (continued) Featur Description View of Matched Matched IBM part Countries e code shipped plug female female number • Voltage (FC) plug connector wall • Amperage (on cord) receptacle (on wall) • Phase •...
  • Page 108 Table 87. Supported PDU power cords for POWER9 systems (continued) Featur Description View of Matched Matched IBM part Countries e code shipped plug female female number • Voltage (FC) plug connector wall • Amperage (on cord) receptacle (on wall) • Phase •...

  • Page 109: Modification Of Ibm-Provided Power Cords

    SRM excerpts A cable group that is associated with a purchased IBM machine, and bearing an IBM label, is the property of the IBM machine owner. All other IBM furnished cable groups (except those for which specific purchase invoices have been paid) are the property of IBM.

  • Page 110: Uninterruptible Power Supply

    After inspection, IBM will continue to make Warranty Service or Maintenance available, as appropriate, for the unaltered portion of an IBM machine. IBM will not maintain the altered portion of an IBM machine under either an IBM Agreement or on an Hourly Service basis.

  • Page 111: Power Distribution Unit And Power Cord Options For 7014, 7953, And 7965 Racks

    Figure 29. Feature code ECCF Figure 30. UPS wiring for the Power distribution unit and power cord options for 7014, 7953, and 7965 racks Power distribution units (PDUs) can be used with 7014, 7953, and 7965 racks. The various configurations and specifications are provided.
  • Page 112 Figure 31. Power distribution unit vertical locations Power distribution units (PDUs) are required for all IBM racks except for the 7014-B42 rack. If a PDU is not defaulted or ordered, a power cord is provided with each individual rack-mounted drawer for connection to a country-specific utility mains receptacle or uninterruptible power supply.
  • Page 113 The amperage rating of the PDU is either 16 A, 24 A, 48 A, or 63 A, single phase or three-phase, depending on the power cord. Note: All power cords are 4.3 m (14 ft). For installation in Chicago, only 2.8 m (6 ft) of the 4.3 m (14 ft) power cord can extend beyond the perimeter of the rack frame.
  • Page 114 7109 or 5889 PDU+ Table 89. 7109 or 5889 PDU+ features PDU Number Supported power cords (PDU to wall) 7109 or 5889 PDU+ “Supported PDU power cords” on page 91 Table 90. 7109 PDU+ specifications Characteristics Properties PDU number 7109 Height 43.9 mm (1.73 in.) Width...
  • Page 115 Table 92. 7196 PDU+ specifications (continued) Characteristics Properties Additional clearance 25 mm (0.98 in.) for circuit breakers 3 mm (0.12 in.) for outlets Weight (not including power cord) 6.3 kg (13.8 lb) Weight of power cord (approximate) 5.4 kg (11.8 lb) Operating temperature at 0 - 914 m (0 - 3000 10 - 32°C (50 - 90°F) ft) (room ambient)
  • Page 116 Figure 33. Wiring diagram for the 7196 PDU+ HVDC PDU Table 93. HVDC PDU features PDU Number Supported power cords (PDU to wall) EPAA Not applicable - fixed power cord 102 Power Systems: Site and hardware planning...
  • Page 117 Figure 34. HVDC PDU The rating of the HVDC PDU is 240 - 380 V dc, 90 A. The HVDC PDU has a permanently attached 4.3 m (14 ft) power cord and is unterminated (no plug). The minimum cross-sectional area of the two conductors and grounding conductor is 16 AWG (1.3 mm).
  • Page 118 Table 94. Intelligent Switched PDU features (continued) Description • Voltage • Amperage Provided power Supported power cords • Phase Feature code (FC) receptacles (PDU to wall) EPTP (Base) Twelve IEC 320-C13 Not applicable - fixed IEC • 208 V ac receptacles 60309, 60 A, plug (3P+G) EPTQ (Additional)

  • Page 119: Calculating The Power Load For 7188 Or 9188 Power Distribution Units

    Learn about the power loading requirements and proper loading sequence for the 7188 or 9188 power distribution unit. The IBM 7188 or 9188 rack-mounted power distribution unit (PDU) contains 12 IEC 320-C13 outlets that are connected to six 20 amps (A) circuit breakers (two outlets per circuit breaker). The PDU employs an inlet current that allows various power cord options that are listed in the following chart.
  • Page 120 Loading sequence Follow these loading sequence steps: 1. Collect power requirements for all units that are connected to the 7188 or 9188 PDU. See your server specifications for specific power requirements. 2. Sort list by total power that is required from highest power draw to lowest power draw. 3.

  • Page 121: Planning For Cables

    Related concepts Supported PDU power cords Find out which power distribution unit (PDU) power cords are supported for your system. Planning for cables Learn how to develop plans for cabling your server and devices. Cable management These guidelines ensure that your system and its cables have optimal clearance for maintenance and other operations.
  • Page 122 1. Power cables 2. Communications (serial attached SCSI, InfiniBand, remote input/output, and peripheral component interconnect express) cables Note: Install and route the communications cables, starting with the smallest diameter first and then progressing to the largest diameter. This applies to installing them into the cable management arm and retaining them to the rack, brackets, and other features that might be provided for cable management.
  • Page 123 Figure 35. Cable management bridge lances Site and hardware planning 109...
  • Page 124 Figure 36. Cable bend radius Power cord routing and retention Proper power cord routing and retention ensures that your system remains connected to a power supply. The primary purpose of power cord retention is to prevent unexpected power loss to your system that can potentially cause system operations to stop functioning.

  • Page 125: Planning For Serial-Attached Scsi Cables

    Figure 37. Cable management bracket Planning for serial-attached SCSI cables Serial-attached SCSI (SAS) cables provide serial communication for transfer of data for directly attached devices, such as hard disk drives, solid-state drives, and CD-ROM drives. SAS cable overview Serial-attached SCSI (SAS) is an evolution of the parallel SCSI device interface into a serial point-to-point interface.
  • Page 126 • Cable routing is important. For example, YO and X cables must be routed along the right side of the rack frame (as viewed from the rear) when you connect to a disk expansion drawer. Additionally, X cables must be attached to the same numbered port on both SAS adapters to which it connects. •...
  • Page 127 The following table contains specific information about each supported SAS cable for PCIe SAS adapters. Table 98. Supported SAS cables for PCIe SAS adapters Name Length IBM part number Feature code SAS 4x AE cable 3 m (9.8 ft) 44V4163 3684 6 m (19.6 ft)
  • Page 128 Table 99. Supported SAS cables for PCIe3 SAS adapters (continued) Name Length IBM part number Feature code HD SAS YO narrow 1.5 m (4.9 ft) 00E6292 ECBT connector cable 3 m (9.8 ft) 00E6293 ECBU 6 m (19.6 ft) 00E6294 ECBV 10 m (32.8 ft)
  • Page 129 Table 100. SAS cable labeling (continued) Name Connects Label SAS adapter to a disk expansion SAS YO cable drawer Two SAS adapters to a disk SAS X cable expansion drawer in a RAID configuration Cable section lengths Figure 38. SAS external X cable assembly cable lengths Figure 39.
  • Page 130 SAS cabling configurations The following sections provide the typical supported SAS cabling configurations. Many configurations can be constructed that are not supported and will either not function correctly or generates errors. To avoid problems, restrict cabling to only the general types of configurations that are shown in the following sections.
  • Page 131 Figure 41. SAS adapter to both a disk expansion drawer and a media expansion drawer Note: The YO cable must be routed along the right side of the rack frame. System external SAS port to disk expansion drawer Figure 42 on page 118 illustrates connecting a system external SAS port to a disk expansion drawer. Disk expansion drawers cannot be cascaded.
  • Page 132 Figure 42. System external SAS adapter port to a disk expansion drawer Two RAID SAS adapters with HD connectors to disk expansion drawer in a multi-initiator high availability (HA) mode (dual storage adapter configuration) Figure 43 on page 119, Figure 44 on page 120, and Figure 45 on page 121 illustrate connecting two SAS RAID adapters with HD connectors to one, two, or three disk expansion drawers in a multi-initiator HA mode.
  • Page 133 Notes: • No cascading allowed for the 5887 storage drawer. • The 5887 storage drawer is connected to same numbered port on each adapter. • HD AA cable is required. Figure 43. Two RAID SAS adapters with HD connectors to a disk expansion drawer in a multi-initiator HA mode Site and hardware planning 119...
  • Page 134 Notes: • No cascading allowed for the 5887 storage drawer. • The 5887 storage drawers are connected to same numbered port on each adapter. • HD AA cable is required. Figure 44. Two RAID SAS adapters with HD connectors to two disk expansion drawer in a multi-initiator HA mode 120 Power Systems: Site and hardware planning...
  • Page 135 Note: • No cascading allowed for the 5887 storage drawer. • The 5887 storage drawers are connected to same numbered port on each adapter. Figure 45. Two RAID SAS adapters with HD connectors to three disk expansion drawers in a multi-initiator HA mode Site and hardware planning 121...
  • Page 136 For more information about the PCI adapters topic, see Installing PCIe adapters in the 9008-22L, 9009-22A, or 9223-22H system. Please review the tasks in the Before you begin section before you proceed with the following procedure.
  • Page 137 a. Attach the cable to the SAS port on the rear bulkhead of the system unit enclosure to the top port in the SAS Storage Controller as shown in the following figure. Restriction: Internal disk drive sharing is only available when internal cable feature FC 1815 is installed from the DASD backplane to the read bulkhead of the system unit enclosure.
  • Page 138 Learn about the different serial-attached SCSI (SAS) cabling configurations that are available for the 5887 disk drive enclosure. For more information about connecting the 5887 disk drive enclosure to the system, see Connecting the 5887 disk drive enclosure to your system (http://www.ibm.com/support/knowledgecenter/POWER9/ p9ee3/p9ee3_connect_to_server.htm). SAS adapter to the 5887 There are seven supported configurations to connect SAS adapters to the 5887.
  • Page 139 Figure 47. Mode 1 connection of a 5887 enclosure by using a YO cable to a single SAS adapter 2. Single SAS adapter to two 5887 enclosures by using a mode 1 connection. • 5887 enclosures with two sets of 24 hard disk drives (HDDs). •...
  • Page 140 Figure 48. Mode 1 connection of two 5887 enclosures by using YO cables to a single SAS adapter 3. Dual SAS adapters to one 5887 enclosure by using a mode 1 connection. • 5887 enclosure with one set of 24 hard disk drives (HDDs). •...
  • Page 141 Figure 49. Mode 1 connection of one 5887 enclosure by using YO cables to a SAS adapter pair 4. Dual SAS adapters to two 5887 enclosures by using a mode 1 connection. • 5887 enclosures with two sets of 24 hard disk drives (HDDs). •...
  • Page 142 Figure 50. Mode 1 connection of two 5887 enclosures by using YO cables to a SAS adapter pair 5. Two SAS adapters to one 5887 enclosure by using a mode 2 connection. • 5887 enclosure with two sets of 12 hard disk drives (HDDs). •...
  • Page 143 Figure 51. Mode 2 connection of one 5887 enclosure by using YO cables to two independent SAS adapters 6. Two SAS adapter pairs to one 5887 enclosure by using a mode 2 connection. • 5887 enclosure with two sets of 12 hard disk drives (HDDs). •...
  • Page 144 Figure 52. Mode 2 connection of a 5887 enclosure by using X cables to two SAS adapter pairs 7. Four independent SAS adapters to one 5887 enclosure by using a mode 4 connection. • 5887 enclosure with four sets of six hard disk drives (HDDs). •...
  • Page 145 Learn about the different serial-attached SCSI (SAS) cabling configurations that are available for the ESLL and ESLS storage enclosures. For more information about connecting ESLL and ESLS storage enclosures to the system, see Connecting an ESLL or ESLS storage enclosure to your system (http://www.ibm.com/support/knowledgecenter/ POWER9/p9eiu/p9eiu_connect_to_server.htm). SAS adapter to the ESLL and ESLS storage enclosures...
  • Page 146 Figure 54. Mode 1 connection of one ESLL or ESLS storage enclosure by using a YO12 cable to a single SAS adapter 2. Single SAS adapter to two ESLL or ESLS storage enclosures by using a mode 1 connection. • Connection by using SAS YO12 cables to connect to the ESLL or ESLS storage enclosure. 132 Power Systems: Site and hardware planning...
  • Page 147 Figure 55. Mode 1 connection of two ESLL or ESLS storage enclosures by using YO12 cables to a single SAS adapter 3. One pair of SAS adapters to one ESLL or ESLS storage enclosure by using a mode 1 connection. •...
  • Page 148 Figure 56. Mode 1 connection of one ESLL or ESLS storage enclosure by using YO12 cables to one pair of SAS adapters 4. One pair of SAS adapters to two ESLL or ESLS storage enclosures by using a mode 1 connection. •...
  • Page 149 Figure 57. Mode 1 connection of two ESLL or ESLS storage enclosures by using YO12 cables to one pair of SAS adapters 5. Two independent SAS adapters to one ESLL or ESLS storage enclosure by using a mode 2 connection. •...
  • Page 150 Figure 58. Mode 2 connection of ESLL or ESLS storage enclosure by using YO12 cables to two independent SAS adapters 6. Two pairs of SAS adapters to one ESLL or ESLS storage enclosure by using a mode 2 connection. • For SAS adapter pairs, you must attach the cables to the same port on both adapters. •...
  • Page 151 Figure 59. Mode 2 connection of one ESLL or ESLS storage enclosure by using X12 cables to two pairs of SAS adapters 7. Four independent SAS adapters to one ESLL or ESLS storage enclosure by using a mode 4 connection. •...
  • Page 152 Figure 60. Mode 4 connection of one ESLL or ESLS storage enclosure by using X12 cables to four independent SAS adapters 138 Power Systems: Site and hardware planning...

  • Page 153: Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 154: Accessibility Features For Ibm Power Systems Servers

    This product uses standard navigation keys. Interface information The IBM Power Systems servers user interfaces do not have content that flashes 2 - 55 times per second. The IBM Power Systems servers web user interface relies on cascading style sheets to render content properly and to provide a usable experience.

  • Page 155: Privacy Policy Considerations

    Contact the vendor for accessibility information about its products. Related accessibility information In addition to standard IBM help desk and support websites, IBM has a TTY telephone service for use by deaf or hard of hearing customers to access sales and support services:...

  • Page 156: Class A Notices

    Class A Notices The following Class A statements apply to the IBM servers that contain the POWER9 processor and its features unless designated as electromagnetic compatibility (EMC) Class B in the feature information. Federal Communications Commission (FCC) Statement Note: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
  • Page 157 Japan Electronics and Information Technology Industries Association Statement This statement explains the Japan JIS C 61000-3-2 product wattage compliance. This statement explains the Japan Electronics and Information Technology Industries Association (JEITA) statement for products less than or equal to 20 A per phase. This statement explains the JEITA statement for products greater than 20 A, single phase.
  • Page 158 Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.

  • Page 159: Class B Notices

    Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. Proper cables and connectors are available from IBM-authorized dealers. IBM is not responsible for any radio or television interference caused by unauthorized changes or modifications to this equipment.
  • Page 160 Tel: +49 800 225 5426 email: halloibm@de.ibm.com VCCI Statement - Japan Japan Electronics and Information Technology Industries Association Statement This statement explains the Japan JIS C 61000-3-2 product wattage compliance. This statement explains the Japan Electronics and Information Technology Industries Association (JEITA) statement for products less than or equal to 20 A per phase.

  • Page 161: Terms And Conditions

    Permissions for the use of these publications are granted subject to the following terms and conditions. Applicability: These terms and conditions are in addition to any terms of use for the IBM website. Personal Use: You may reproduce these publications for your personal, noncommercial use provided that all proprietary notices are preserved.
  • Page 162 IBM reserves the right to withdraw the permissions granted herein whenever, in its discretion, the use of the publications is detrimental to its interest or, as determined by IBM, the above instructions are not being properly followed.
  • Page 164 IBM®...

This manual is also suitable for:

9009-41aPower systems series9009-22a9009-42a9223-42h9223-22h

Table of Contents