1. Manuals
  2. Brands
  3. Oracle Manuals
  4. Server
  5. SPARC Enterprise M4000
  6. Installation and service manual

Oracle SPARC Enterprise M4000 Installation And Service Manual

External i/o expansion unit
Hide thumbs Also See for SPARC Enterprise M4000:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Reference Manual, Installation Manual
External I/O Expansion Unit
for SPARC Enterprise
M4000/M5000/M8000/M9000 Servers
Installation and Service Manual
Part No.: E22742-01,
Manual Code: C120-E329-07EN
April 2011

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SPARC Enterprise M4000 and is the answer not in the manual?

Questions and answers

Related Manuals for Oracle SPARC Enterprise M4000

Summary of Contents for Oracle SPARC Enterprise M4000

  • Page 1 External I/O Expansion Unit for SPARC Enterprise M4000/M5000/M8000/M9000 Servers Installation and Service Manual Part No.: E22742-01, Manual Code: C120-E329-07EN April 2011...
  • Page 2 INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. Unless otherwise expressly set forth in such agreement, to the extent allowed by applicable law, in no event shall Oracle or Fujitsu Limited, and/or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits, loss of use or data, or business interruptions, or for...
  • Page 3 Ce document, bien qu’il vous ait été fourni, ne vous confère aucun droit et aucune licence, expresses ou tacites, concernant le produit ou la technologie auxquels il se rapporte. Par ailleurs, il ne contient ni ne représente aucun engagement, de quelque type que ce soit, de la part d’Oracle ou de Fujitsu Limited, ou des sociétés affiliées de l’une ou l’autre entité.

  • Page 5: Table Of Contents

    Contents Preface xi Overview 1–1 General Description 1–2 1.1.1 Chassis 1–4 1.1.2 Power Supply Units 1–5 1.1.2.1 AC Power 1–6 1.1.2.2 Fans 1–6 1.1.3 I/O Boats 1–7 Card Slots 1–9 1.2.1 Carriers 1–9 1.2.1.1 Carrier Slots 1–10 1.2.1.2 Dummy Cards 1–11 1.2.2 Link Kits 1–12 1.2.3...
  • Page 6 1.3.3 Tightening Sequence for Card Locks 1–21 1.3.3.1 Tightening Sequence for Wide Cards 1–22 1.3.3.2 Tightening Sequence for Narrow Cards 1–22 1.3.4 Examples of PCI Card Installation 1–23 1.3.4.1 Using Card Locks With Tall PCI Cards 1–25 1.3.4.2 Using Card Locks With Low and Very Low Height PCI Cards 1–26 1.3.4.3 Using Card Locks With Unusual PCI Card Shapes 1–27...
  • Page 7 Installing the AC Cords 2–13 Installing the Link Kit 2–16 2.6.1 Installing the Optical Link Kit 2–17 2.6.2 Installing the Copper Link Kit 2–18 Working With PCI Cards 3–1 Installing a PCI Card 3–1 Replacing a PCI Card 3–9 Installing Cables for PCI Cards 3–16 Servicing and Replacing Components 4–1 Service Procedures Task Map 4–2 Identifying Firmware Versions 4–3...
  • Page 8 4.12.3 Moving the Bezel to the New Chassis 4–26 4.12.4 Installing the External I/O Expansion Unit in the Rack 4–30 4.13 Powering Up a Link After Service 4–33 4.13.1 The cfgadm -c configure Command 4–33 4.13.2 Example of the cfgadm -c configure Command 4–34 A.
  • Page 9 Using Hardware Symptoms to Troubleshoot Problems D–2 Using Manual Techniques of Fault Isolation to Diagnose Error Messages D–4 D.2.1 Error Messages and Fault Managed Resource Identifiers D–4 D.2.2 C Failures D–6 D.2.2.1 C Fault Isolated to a Single FRU D–7 D.2.2.2 C Fault Spanning Multiple FRUs D–7 D.2.2.3...
  • Page 10 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 11: Preface

    External I/O Expansion Unit Documents All documents for your External I/O Expansion Unit are available online at the following locations: Oracle documents: ■ http://download.oracle.com/docs/cd/E19322-01/index.html Fujitsu documents: ■ http://www.fujitsu.com/sparcenterprise/manual/ Sun Oracle software-related manuals (Oracle Solaris OS, and so on): ■ http://www.oracle.com/technetwork/documentation/index.html...
  • Page 12 External I/O Expansion Unit Documents External I/O Expansion Unit Installation and Service Manual External I/O Expansion Unit Product Notes External I/O Expansion Unit Safety and Compliance Guide Text Conventions This manual uses the following fonts and symbols to express specific types of information.
  • Page 13 ■ SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers Important Legal and ■ Safety Information Documentation Feedback If you have any comments or requests regarding this document, go to the following web sites. For Oracle users: ■ http://www.oraclesurveys.com/se.ashx?s=25113745587BE578 For Fujitsu users: ■ http://www.fujitsu.com/global/contact/computing/sparce_index.html Preface...
  • Page 14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 15: Overview

    C H A P T E R Overview The External I/O Expansion Unit provides a host server with additional slots for PCI cards. The single I/O boat configuration provides six slots for I/O cards. ■ The optional two I/O boat configuration ( ) provides twelve slots.

  • Page 16: General Description

    External I/O Expansion Unit, Front and Rear Views FIGURE 1-1 Figure Legend Front view Rear view General Description shows the major units for the External I/O Expansion Unit, which are FIGURE 1-2 described separately in this chapter. Note – All slot numbers run from left to right, regardless of whether you are viewing the front or the back of the External I/O Expansion Unit.
  • Page 17 Major Units for the External I/O Expansion Unit, Top View FIGURE 1-2 Figure Legend Chassis I/O boat 1 Power Supply Unit 1 Internal AC cable Power Supply Unit 0 Cable management unit (One of two types is included. Type 8a routes cables to both sides of a rack. Type 8b routes cables only the right side of a rack.) Centerplane Link kit (One of two types is included.

  • Page 18: Chassis

    1.1.1 Chassis The External I/O Expansion Unit chassis includes the centerplane (item 4 in ) and two non-removable internal AC cables (item 7 in FIGURE 1-2 FIGURE 1-2 There are no serviceable components inside the chassis. If the centerplane or the internal AC cables are damaged, the chassis must be replaced.

  • Page 19: Power Supply Units

    1.1.2 Power Supply Units The External I/O Expansion Unit has two power supply units (PSUs) for redundancy. See FIGURE 1-3 Each PSU includes an integral fan. Power Supply Unit FIGURE 1-3 Figure Legend Handle locking screw Caution labels Handle PSU slot 0 AC switch PSU slot 1 Chapter 1...

  • Page 20: Ac Power

    1.1.2.1 AC Power The PSU slots are powered through internal AC cables that extend out of the rear of the chassis (item 7 in FIGURE 1-2 The PSUs do not share AC current. Connect both internal AC cables to AC power. The internal AC cable for a PSU is the cable terminating nearest that PSU slot.

  • Page 21: I/O Boats

    1.1.3 I/O Boats The External I/O Expansion Unit can contain up to two I/O boats ( FIGURE 1-4 I/O Boat FIGURE 1-4 Figure Legend I/O boat Boat slot 0 Captive screws Boat slot 1 Link card carrier (slot 0) Caution labels PCI card carriers (slots 1-6) There are two types of I/O boat, PCI-X and PCI Express.
  • Page 22 PCI-X and PCI Express I/O Boat Layouts, Compared FIGURE 1-5 PCI Express I/O boat PCI-X I/O boat PCI-E I/O boat 32 lane switch 32 lane switch 32 lane 32 lane Bridge Bridge Bridge switch switch 6 PCI-X slots 6 PCI Express slots 6 PCI-E slots A PCI-X I/O boat is shown on the left side of .

  • Page 23: Card Slots

    Card Slots The card slots have the following characteristics: An I/O boat has seven card slots. Slot numbers 0 through 6 are counted from left ■ to right. Slot 0 is reserved for the link card. Slot 0 is the first slot in the left side of the I/O ■...

  • Page 24: Carrier Slots

    Caution – If you install a PCI card when the External I/O Expansion Unit is running, be prepared to complete the installation within two minutes or so. If you leave a carrier slot empty, the External I/O Expansion Unit might overheat. New carriers include dummy cards.

  • Page 25: Dummy Cards

    1.2.1.2 Dummy Cards New carriers are shipped with dummy cards ( FIGURE 1-7 There are two types of dummy card, PCI-X and PCI Express. (The PCI Express card might be labelled “PCI-E”.) Note that there are differences in their edge connectors. Dummy Cards FIGURE 1-7 PCI-E...

  • Page 26: Link Kits

    Caution – The two types of dummy cards are not interchangeable. If you replace a PCI card with a dummy card, be sure that you use the right type of dummy card. The differences in edge connectors on the dummy cards ( ) are enough to FIGURE 1-7 damage the PCI card socket on the I/O boat.

  • Page 27: Cable Management

    Slot 0 in each I/O boat is the dedicated link card slot. Use slot 0 only for the link card. 1.2.3 Cable Management A cable management unit attaches to the rear of the system rack. There are two types of cable management units. Some racks allow the routing of cables along both sides of the rack.
  • Page 28 Cable Management Unit (Type A) for Routing Cables to Both Sides of the FIGURE 1-9 Rack Figure Legend Type A cable plate Support brackets Cable plate locking screws 1-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 29: Minimum Bend Radius For Link Cables

    Cable Management Unit (Type B) for Routing Cables Only to the Right Side of FIGURE 1-10 a Rack Figure Legend Type B cable plate Support brackets Cable plate locking screws Note – If the PSU1 power cable does not reach the rack power distribution unit, route the cable on the left side of the rack.

  • Page 30: Cable Management Unit

    Caution – Coiling the link cables with a smaller bend radius than listed above will break the cables. 1.2.3.2 Cable Management Unit The cable management unit contains two support brackets and a cable plate. The support brackets attach with screws to the rear of the system rack. The cable plate rests on the support brackets.
  • Page 31 Note – The service life of a carrier is at least 100 PCI card insertions. To avoid premature failure of the carrier, do not repeatedly open and close the carrier more than is necessary to familiarize yourself with its operation. Carrier FIGURE 1-12 Figure Legend...

  • Page 32: Carrier Removal And Insertion

    Carrier Features FIGURE 1-13 Figure Legend Carrier main body (metal) Carrier handle Section 1.3.2, “Card Locks” on page 1-20) Carrier plate (plastic) Card locks (see Carrier slot keyholes Turnaround area for card lock 1.3.1 Carrier Removal and Insertion A carrier operates by raising or lowering a PCI card into or out of a card socket. The vertical movement is approximately 0.4 in./10 mm.
  • Page 33 After the carrier is out of the I/O boat, you can unlock the carrier handle by pushing in the metal latch while pushing the carrier handle into its closed position. Note that the closed position provides more vertical clearance for a PCI card when you install or remove the PCI card.

  • Page 34: Card Locks

    1.3.2 Card Locks A PCI card is attached to the carrier with screw-mounted locks or retainers ). Card locks hold a PCI card to its carrier and prevent the PCI card from FIGURE 1-15 shifting or tilting. The PCI card must be securely mounted in order for the carrier to correctly seat the PCI card in the card socket in the I/O boat.

  • Page 35: Tightening Sequence For Card Locks

    Type C is a small quarter-round lock. It can support the bottom edge of a wide PCI ■ card, but only when the lock is at the far right side of its slot (the side farthest from the front of the carrier). For a narrow width card, use this lock only to support the side of the card.

  • Page 36: Tightening Sequence For Wide Cards

    1.3.3.1 Tightening Sequence for Wide Cards Card Lock Sequence for Wide Cards FIGURE 1-16 ● Rest the bottom edge of the PCI card on the type C card lock (number 1 in ) to ensure that the bottom of the PCI card is perfectly horizontal, FIGURE 1-16 then tighten the remaining card locks in the sequence shown.

  • Page 37: Examples Of Pci Card Installation

    1.3.4 Examples of PCI Card Installation shows the locks for a typical PCI card. FIGURE 1-15 However, cards can be much wider or narrower, or taller or shorter. FIGURE 1-18 , and show how cards can vary in height, width, and shape. FIGURE 1-19 FIGURE 1-20 Note –...
  • Page 38 Card and Lock Styles (Continued) TABLE 1-1 Suggested Lock Type PCI Card Shape Top Lock/Card Height Side Lock/Card Width Bottom Lock Example Low height Type A Type A FIGURE 1-19 2.0 in./51 mm 5.75 in./146 mm minimum card height minimum card width Type B 5.0 in./127 mm Type B...

  • Page 39: Using Card Locks With Tall Pci Cards

    1.3.4.1 Using Card Locks With Tall PCI Cards Lock Arrangements for Wide and Narrow PCI cards FIGURE 1-18 Figure Legend Tall and wide card 2 type A on top, 1 type A on right, 1 type C on bottom of the PCI card Tall and average width card 2 type A on top, 1 type A on right, 1 type C on bottom of the PCI card Tall and narrow card...

  • Page 40: Using Card Locks With Low And Very Low Height Pci Cards

    1.3.4.2 Using Card Locks With Low and Very Low Height PCI Cards Lock Arrangements for Low and Very Low Height PCI cards FIGURE 1-19 Figure Legend Low height card 2 type A on top, 1 type A on right side, 1 type C on lower right side of the PCI card Very low height card 1 type B on top, 1 type A on right edge, 1 type C on lower right side of the PCI card 1-26...

  • Page 41: Using Card Locks With Unusual Pci Card Shapes

    1.3.4.3 Using Card Locks With Unusual PCI Card Shapes Lock Arrangements for Unusually-Shaped Cards FIGURE 1-20 Figure Legend Very low height and narrow width card 1 type B on top, 1 type C on right side of the PCI card Irregularly-shaped card 1 type A and 1 type B on top, 1 type A on right side, 1 type C on lower right side of the PCI card...
  • Page 42 Excessive Force on a Lock Can Bend or Break the PCI Card FIGURE 1-21 Figure Legend Correct Incorrect Here are some rules to avoid the tilting of PCI cards: 1. You must have at least one lock on top of the card. If the top of the card is too low to accept a lock, the card cannot be used.

  • Page 43: Hidden Problems

    1.3.5.2 Hidden Problems The following features are located inside the front housing of the carrier. Because they are difficult to see, they can complicate the mounting of cards on carriers. Card alignment post ( ■ FIGURE 1-22 FIGURE 1-23 Card alignment tab ( ■...
  • Page 44 The post fits in a notch in the metal bracket of the PCI card (item 1 in ). If FIGURE 1-22 you do not position the post in the notch, the card mounting bracket might bend, so that the card lies at an angle on the carrier. The angle prevents the card from making proper electrical contact with the socket in the I/O boat.
  • Page 45 Card Alignment Post (Detail) FIGURE 1-23 Figure Legend Carrier front housing Card alignment post PCI card bracket Chapter 1 Overview 1-31...
  • Page 46 Internal RFI Gasket An RFI gasket is located inside the carrier housing, next to the card alignment post. (A smaller RFI gasket is located on the outside of the carrier housing.) When you insert the PCI card into the carrier, be sure that the bottom of the metal card bracket does not scrape or loosen the bottom of the gasket ( FIGURE 1-24 The gasket material is flexible enough that you might not notice that the bracket has...

  • Page 47: Carrier Keys

    1.3.6 Carrier Keys Each carrier is keyed to a specific slot ( ) in the I/O boat. The key is an M2 FIGURE 1-25 screw on the top of each carrier. Each carrier slot (0 through 6) will accept only a carrier that has a key in the hole location for that slot.

  • Page 48: External I/O Expansion Unit Configurations

    External I/O Expansion Unit Configurations The External I/O Expansion Unit is available with one or two I/O boats. Two types of link kits (copper and optical) are also available. 1.4.1 Single Boat Configuration The base configuration for an External I/O Expansion Unit has a single boat, with a filler panel in the second boat bay.

  • Page 49: Dual Boat Configuration

    Optical Cables Connect TX Sockets to RX Sockets FIGURE 1-26 Figure Legend External I/O Expansion Unit Host server 1.4.2 Dual Boat Configuration The dual boat configuration provides twelve I/O slots. Each of the I/O boats requires its own link kit, so the host server must have two I/O slots available for this purpose. Chapter 1 Overview 1-35...

  • Page 50: Leds

    Note – If you are installing a second boat in the External I/O Expansion Unit, both boats must be connected to the same host server. Do not connect the second boat to a different server. The second boat can be connected to a different domain on the same server, but not to a domain on a different server.
  • Page 51 Figure Legend Chassis overtemp PSU1 fault/locate PSU0 ready to remove PSU1 DC power PSU0 fault/locate PSU1 AC power Note – The Locate LED is a lighted push-button switch. When the flashing of its LED has helped you to locate the External I/O Expansion Unit, turn off the LED by pressing the switch.

  • Page 52: System Management

    Figure Legend I/O boat 0 ready to remove Link card management I/O boat 0 fault/locate Slot attention/locate (all PCI carriers) I/O boat 0 DC power Slot power (all PCI carriers) Note – On the optical link card, the LEDs for link card data and link card management are located next to the optical cable sockets.

  • Page 53: Maximum Temperatures In The External I/O Expansion Unit

    1.6.1 Maximum Temperatures in the External I/O Expansion Unit summarizes the maximum temperatures for the External I/O Expansion TABLE 1-1 Unit. The table also includes error messages that the host might display if these temperatures exceed the maximum values. Two types of error messages might be displayed on the host console, Ereport (error report) and FMA (Fault Management Architecture) messages.

  • Page 54: Electrical Requirements

    Service access to the External I/O Expansion Unit is from the front or rear. The ■ mounting rails do not slide. The choice of mounting location in a rack can be limited by the length of the link ■ cable: The optical link kit includes either 33 ft/10 m or 80 ft/25 m cables.

  • Page 55: Service Information

    Service Information Service and installation information is also available on service labels that are located on the External I/O Expansion Unit top cover and on the dummy cards that are shipped with new carriers. Service Information Summary TABLE 1-3 Topic Comments Access •...
  • Page 56 Service Information Summary (Continued) TABLE 1-3 Topic Comments Link cables • The optical version of the link kit includes two unidirectional cables. The ends of the cables are marked TX and RX (transmit and receive, respectively). • The copper link kit has one cable. The connector is designed in a way such that it cannot be connected upside down.

  • Page 57: Electrostatic Discharge Precautions

    Electrostatic Discharge Precautions Caution – Circuit board components are vulnerable to damage by electrostatic discharge (ESD). An electrostatic charge can build up on the human body and then discharge when you touch a board. Such discharge can be produced by walking across a carpet and touching a board, or by other similar cause.
  • Page 58 1-44 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 59: Installing The External I/O Expansion Unit In A Rack

    C H A P T E R Installing the External I/O Expansion Unit in a Rack The following topics are in this chapter: Section 2.1, “Tools” on page 2-1 ■ Section 2.2, “Installing the Mounting Brackets in a Rack” on page 2-2 ■...

  • Page 60: Installing The Mounting Brackets In A Rack

    Installing the Mounting Brackets in a Rack The External I/O Expansion Unit can be installed in either an equipment rack or the rack space in the SPARC Enterprise M8000 server. The External I/O Expansion Unit mounting kit ( ) includes a right-side FIGURE 2-1 mounting bracket and a left-side mounting bracket.
  • Page 61 The External I/O Expansion Unit occupies a height of four rack units (6.9 in./175 ■ mm). Mount the heaviest subassemblies at the lowest available opening to minimize the ■ precarious effects of a top-heavy system. If you are installing more than one External I/O Expansion Unit, install them ■...
  • Page 62 Installing the Chassis Lock Brackets FIGURE 2-3 4. Loosen the screws ( ) that hold the sliding flanges to the mounting FIGURE 2-4 brackets. This action allows the rear flanges to adjust to fit different rack depths. External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 63 Sliding Flange FIGURE 2-4 Figure Legend Sliding flange Flange crews Step 5. If your rack has threaded holes, continue at 6. If your rack has square holes, install cage nuts in the rack pillars. lists the locations for the cage nuts. Note that these are relative locations. TABLE 2-1 Adjust the actual hole locations as needed to leave space for a power distribution unit, additional External I/O Expansion Units, or other rack-mounted equipment.
  • Page 64 Cage Nut Locations TABLE 2-1 Rack Unit Hole No. Front Rear cage nut cage nut cage nut cage nut cage nut cage nut cage nut cage nut 7. Attach the mounting brackets to the rack ( FIGURE 2-5 a. At the front of the rack, orient the hooked portion of the mounting bracket away from you.

  • Page 65: Installing The External I/O Expansion Unit In The Rack

    Installing the Mounting Brackets in a Rack FIGURE 2-5 8. Tighten the screws at the front of the rack. 9. Verify that the brackets at the rear of the rack can still slide slightly to the left and right. Installing the External I/O Expansion Unit in the Rack The External I/O Expansion Unit can be installed in either an expansion rack or the 19-inch rack space in the SPARC Enterprise M8000 server.
  • Page 66 2. Place the External I/O Expansion Unit on the front of the mounting brackets and slide the External I/O Expansion Unit into the rack. As you slide the External I/O Expansion Unit into the rack, the sides of the External I/O Expansion Unit chassis push the ends of the brackets apart from each other.

  • Page 67: Installing The Cable Management Unit

    Installing the Cable Management Unit At the rear of the rack, install the cable management support brackets: 1. Use an antistatic strap for this procedure. 2. Place the support brackets just above the chassis mounting brackets ( FIGURE 2-7 and loosely attach the support brackets to the rack with two screws each. Do not tighten the screws yet.
  • Page 68 Installing the Support Brackets FIGURE 2-7 2-10 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 69 Type A Cable Plate FIGURE 2-8 Type B Cable Plate FIGURE 2-9 Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-11...
  • Page 70 3. Place the cable plate between the support brackets ( FIGURE 2-10 On each side of the cable plate, the forward tab rests on the bottom of the large cutout in the support bracket. The rear tab rests in a small depression in the top of the support bracket.

  • Page 71: Installing The Ac Cords

    Installing the AC Cords 1. Use an antistatic strap for this procedure. 2. Attach an AC cord to an internal AC cable at the rear of the External I/O Expansion Unit, then connect the AC cord to an AC outlet. The PSUs should be connected to two independent external AC power sources so ■...
  • Page 72 AC Cables for Type A Cable Management Plate FIGURE 2-11 Figure Legend Internal AC cable, left Internal AC cable, right 2-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 73 AC Cables and Cords for Type B Cable Management Plate FIGURE 2-12 Figure Legend Internal AC cable, left AC cord (connectors are placed in rectangular opening to reduce height) Internal AC cable, right Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-15...

  • Page 74: Installing The Link Kit

    4. If you wish to test the External I/O Expansion Unit for basic electrical functionality, do the following: a. Turn on the PSU AC switches. The switches are located on the front of the power supplies. The LEDs on the power supplies should display the following indications after a short initialization period.

  • Page 75: Installing The Optical Link Kit

    Optical interface and two cables — see Section 2.6.1, “Installing the Optical Link ■ Kit” on page 2-17 Copper interface and one cable — see Section 2.6.2, “Installing the Copper Link ■ Kit” on page 2-18 2.6.1 Installing the Optical Link Kit Note –...

  • Page 76: Installing The Copper Link Kit

    Note – Low profile brackets that are included in some copper link kits are not used for SPARC Enterprise M4000/M5000/M8000/M9000 servers. 3. If a link card is not already installed in the I/O boat, install it now.
  • Page 77 Caution – The carrier can be damaged during removal and during insertion. For safe handling of the carrier, read the cautions in Section 3.1, “Installing a PCI Card” on page 3-1. 4. Connect the link cable to both link cards. Copper Link Cable Plug FIGURE 2-14 Note –...
  • Page 78 2-20 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 79: Working With Pci Cards

    C H A P T E R Working With PCI Cards This chapter gives procedures for installing PCI and link cards, and related cables. Section 3.1, “Installing a PCI Card” on page 3-1 ■ Section 3.2, “Replacing a PCI Card” on page 3-9 ■...
  • Page 80 Unlocking and Removing a Carrier FIGURE 3-1 Figure Legend Carrier handle Carrier locking screw 4. Press lightly on the front of the carrier, and pull out the carrier handle until it clicks into the open position (approximately 1.5 in./38 mm). Pressing the front of the carrier prevents movement of the carrier when you pull the carrier handle.
  • Page 81 Locator Bar on Carrier FIGURE 3-2 5. Pull the carrier out of the slot and place it on an antistatic work surface. 6. Press the locking latch ( ) while you push the carrier handle into the FIGURE 3-3 closed position. This action lowers the carrier plate, giving you more room to move the PCI card into place on the carrier.
  • Page 82 Screws for Card Locks FIGURE 3-4 Figure Legend Card lock screws 8. Turn the carrier over and remove the dummy card or PCI card. 9. For very small PCI cards (1.25 in./31 mm tall or 3.0 in./76 mm wide), it is necessary to do one or both of the following: Move the long card lock (type B lock) from the horizontal slider slot to the front ■...
  • Page 83 Inserting the PCI Card FIGURE 3-5 Figure Legend See the following caution. Caution – Do not allow the bottom edge of the PCI card bracket to tear the RFI gasket in the front of the carrier ( FIGURE 3-5 b. A rectangular notch is located on the bottom front of the PCI card. Fit the notch over the card alignment tab (item 1 in ), then fit the top of the FIGURE 3-6...
  • Page 84 Placing the PCI Card on the Carrier FIGURE 3-6 Figure Legend Card alignment tab Card alignment post 11. Attach the PCI card to the carrier with one card lock: a. Slide a card lock to the right edge of the PCI card. b.
  • Page 85 Using Card Lock to Hold the PCI Card FIGURE 3-7 Figure Legend Card lock 12. Slide the remaining card locks to the edges of the PCI card and tighten the screws. The shape of a PCI card might prevent the use of some card locks. The minimum requirement is one card lock on the side of the PCI card and one card lock on the top.
  • Page 86 Caution – Do not apply excessive pressure on the upper card locks. Too much pressure will bend the PCI card bracket. See FIGURE 3-9 Excessive Pressure Bends the PCI Card Bracket FIGURE 3-9 Figure Legend Moderate pressure on an upper card lock holds the PCI card in a horizontal position. Excessive pressure bends the PCI card bracket.

  • Page 87: Replacing A Pci Card

    17. Use the carrier locking screw located on the top of the handle to lock the carrier handle in place. 18. Add the PCI card to an Oracle Solaris domain. For details, refer to the service manual for your host server.
  • Page 88 3. Remove the carrier from the carrier slot in the I/O boat. a. Loosen the carrier locking screw on the carrier handle. b. Press lightly on the front of the carrier, and pull the carrier handle out fully. Caution – Pulling the carrier handle raises the carrier plate. If the carrier moves forward before the carrier plate is completely raised, the plastic locator bar ) might be damaged by hitting the lower front edge of the I/O boat.
  • Page 89 8. Place the PCI card on the carrier. a. Place the front of the card inside the housing ( FIGURE 3-12 Inserting the PCI Card FIGURE 3-12 Figure Legend See the following caution. Caution – Do not allow the bottom edge of the PCI card bracket to tear the RFI gasket in the front of the carrier ( FIGURE 3-5 b.
  • Page 90 Placing the PCI Card on the Carrier FIGURE 3-13 Figure Legend Card alignment tab Card alignment post 9. Attach the PCI card to the carrier with one card lock: a. Slide a card lock to the right edge of the PCI card. b.
  • Page 91 Using Card Lock to Hold the PCI Card FIGURE 3-14 Figure Legend Card lock 10. Slide the remaining card locks to the edges of the PCI card and tighten the screws. The shape of a PCI card might prevent the use of some card locks. The minimum requirement is one card lock on the side of the PCI card and one card lock on the top.
  • Page 92 Caution – Do not apply excessive pressure on the upper card locks. Too much vertical pressure will bend the PCI card bracket. See FIGURE 3-16 Excessive Pressure Bends the PCI Card Bracket FIGURE 3-16 Figure Legend Moderate pressure on an upper card lock holds the PCI card in a horizontal position. Excessive pressure on an upper card lock can bend the PCI card bracket.
  • Page 93 Locator Bar on Carrier (Carrier Handle Shown in the Closed Position) FIGURE 3-17 12. Carefully place the carrier in the card guides at the top and bottom of the carrier slot in the I/O boat. 13. Press on the metal front panel of the carrier to push the carrier fully into the carrier slot.

  • Page 94: Installing Cables For Pci Cards

    15. Use the carrier locking screw located on the top of the handle to lock the carrier handle in place. 16. Add the PCI card to an Oracle Solaris domain. For details, refer to the service manual for your host server.
  • Page 95 Note – Before tightening the cable ties, ensure that each cable has a service loop (freedom of movement) of at least 2 in./50 mm. This allows the cable plate and cables to be moved from the normal position ( ) to the service position FIGURE 4-4 without the need to untie the cables.
  • Page 96 Example of Cable Management for the Type B Cable Plate FIGURE 3-20 3. Attach I/O cables from the PCI cards and their respective devices or network ports. 3-18 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 97: Servicing And Replacing Components

    C H A P T E R Servicing and Replacing Components This chapter includes the service procedures for replacing field-replaceable units and installing optional assemblies. This chapter includes the following topics: Section 4.1, “Service Procedures Task Map” on page 4-2 ■...

  • Page 98: Service Procedures Task Map

    Service Procedures Task Map Service Task Map TABLE 4-1 Task Comments PCI card • Install a new PCI card Section 3.1, “Installing a PCI Card” on page 3-1 • Replace an existing PCI card Section 3.2, “Replacing a PCI Card” on page 3-9 •...

  • Page 99: Identifying Firmware Versions

    Identifying Firmware Versions It might be helpful to identify firmware versions in the External I/O Expansion Unit when troubleshooting problems. Firmware is located on the motherboard and on each link card. To identify versions of firmware, use the ioxadm -v list command. In the output, firmware versions are listed in the column marked “FW Ver”.

  • Page 100: Replacing A Power Supply Unit

    Replacing a Power Supply Unit This is a hot replacement procedure, meaning that the PSU can be replaced while the system is still running, provided that a second PSU is working properly. 1. Use an antistatic strap for this procedure. 2.
  • Page 101 FIGURE 4-1 Figure Legend Handle Handle locking screw Warning labels 8. Set the PSU flat on an antistatic surface. 9. Insert the new PSU into the External I/O Expansion Unit. The pivoting flap automatically swings up and out of the way. Note –...

  • Page 102: Powering Down A Link Before Service

    Example of the cfgadm -c disconnect Command The following examples are for an External I/O Expansion Unit with one I/O boat connected to a SPARC Enterprise M4000 server. In the examples, is the iou#0-pci#1 ap_id for the server IOU slot to which the I/O boat is connected.

  • Page 103: Preparing The Cable Plate For Service

    iou#0-pci#1:iobE02EF.pcie4 unknown empty unconfigured unknown iou#0-pci#1:iobE02EF.pcie5 fibre/hp connected configured iou#0-pci#1:iobE02EF.pcie6 unknown empty unconfigured unknown iou#0-pci#2 unknown empty unconfigured unknown iou#0-pci#3 etherne/hp connected configured iou#0-pci#4 pci-pci/hp connected configured The next example shows the command that powers down (disconnects) the link, followed by a command that displays the results. # cfgadm -c disconnect iou#0-pci#1 # cfgadm iou#0-pci#0...
  • Page 104 Type A Cable Plate FIGURE 4-2 Type B Cable Plate FIGURE 4-3 The left side of shows the cable plate in its normal position. FIGURE 4-4 The right side of the illustration shows the service position. External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 105: Replacing A Carrier

    Cable Plate (Side Views of Normal and Service Positions) FIGURE 4-4 Figure Legend Cable plate in the normal position (lowered) Cable plate in the service position (raised) Cable plate locking screw (two places) 5. After the carrier or I/O boat has been replaced, move the cable plate down into its normal position and tighten the cable plate locking screws.
  • Page 106 4. Disconnect the I/O cable(s) from the PCI card in the carrier. 5. Remove the carrier from the I/O boat: a. Loosen the carrier locking screw on the carrier handle. b. Pull the carrier handle out fully. Caution – Pulling the carrier handle raises the carrier plate. If the carrier moves forward before the carrier plate is completely raised, the plastic locator bar ) might be damaged by hitting the lower front edge of the I/O boat.
  • Page 107 Screw Hole Locations for the Carrier Slot Key FIGURE 4-5 Figure Legend Keyholes 0-7 Carrier label * Keyhole 7 is reserved for future use. 7. Attach a label with the slot name and number to the carrier. The replacement carrier includes an assortment of adhesive labels including LINK 0, PCIX 1, PCIE 1, and so forth.
  • Page 108 c. Unlock the PCI card from the defective carrier and install the card on the replacement carrier. d. If the type C lock is used, ensure that it is not located where it will hit the card socket in the I/O boat. 9.

  • Page 109: Replacing A Link Cable

    Replacing a Link Cable This is not a hot replacement procedure. Link operations will be interrupted. Note – Ordering a complete set of replacements at one time can shorten the troubleshooting process. If you cannot determine if a link problem is caused by a link card or a link cable, order replacement link cards for the host and the I/O boat, along with a copper link cable or two optical link cables, as appropriate.

  • Page 110: Replacing A Link Card In An I/O Boat

    3. Disconnect the link cable or cables from the link card in the host server. A copper link has one cable. An optical link has two cables. 4. Replace the link card in the host server. Refer to the service manual for your host server for instructions on replacing PCI cards.
  • Page 111 b. Pull the carrier handle out fully. Caution – Pulling the carrier handle raises the carrier plate. If the carrier moves forward before the carrier plate is completely raised, the plastic locator bar ) might be damaged by hitting the lower front edge of the I/O boat. FIGURE 3-2 c.

  • Page 112: Installing A Second I/O Boat

    Note – If the External I/O Expansion Unit has two I/O boats, both boats must be connected to the same host server. Do not connect the second boat to a different server. Also, do not connect the second boat to the first boat; a daisy-chain configuration is not allowed.
  • Page 113 d. Press the locking latch ( ) while you push the carrier handle into the FIGURE 3-1 closed position. This action lowers the carrier plate, giving you more room to move the PCI card into place on the carrier. e. Remove the dummy card from the carrier. One side of the dummy card provides instructions for removal from the carrier.
  • Page 114 a. Loosen the cable plate locking screw(s) (item 3 in FIGURE 4-4 b. Pull the cable plate toward you approximately 0.5 in./13 mm, then raise it approximately 0.75 in./20 mm, until the bottom of the plate is above the tops of the support brackets.

  • Page 115: Replacing An I/O Boat

    4.11 Replacing an I/O Boat 4.11.1 Replacing a Boat in a Single Boat Configuration This is a cold service procedure. 1. If the link is still running, power down the link. Section 4.4, “Powering Down a Link Before Service” on page 4-6.
  • Page 116 Caution – Do not allow the rear of the I/O boat to drop. The connector at the rear of the boat can be damaged if it strikes the edge of the slot. Do not rest an I/O boat vertically. The plastic electrical connector on the back is breakable.

  • Page 117: Replacing A Boat In A Dual Boat Configuration

    Caution – If the carrier handle does not close easily, the PCI card might not be seating properly in the card socket in the I/O boat. Remove the carrier and inspect the PCI card. If the bottom of the PCI card is not perfectly horizontal, loosen the card locks and realign the card on the carrier.
  • Page 118 c. Push the cable plate forward to its service position ( ) so that the FIGURE 4-4 cable plate rests on the support brackets. The tabs on the sides of the cable plate should lie in the small notches on the tops of the support brackets.
  • Page 119 b. Remove the dummy card from a carrier. One side of the dummy card provides instructions for removal from the carrier. The other side of the dummy card provides instructions for installing a PCI card. c. Install a link card on the carrier. For help in choosing the correct card locks to install a PCI card, see Section 1.3.2, “Card Locks”...

  • Page 120: Replacing The External I/O Expansion Unit Chassis

    12. Power up the link. Section 4.13, “Powering Up a Link After Service” on page 4-33. 4.12 Replacing the External I/O Expansion Unit Chassis In this procedure, the following parts are moved from the old chassis to the replacement chassis: Front bezel ■...
  • Page 121 5. At the rear of the External I/O Expansion Unit, disconnect the AC cords from the internal AC cables. 6. Move the cable plate to the service position: a. Loosen the cable plate locking screw(s) (item 3 in FIGURE 4-4 b.

  • Page 122: Moving The Bezel To The New Chassis

    Caution – The PSU is heavy (7.5 lb/3.4 kg). When you can see the warning label on the top of the PSU, the PSU is almost fully out of the PSU slot. Caution – Do not allow the rear of the PSU to drop. The connector at the rear of the PSU can be damaged if it strikes the edge of the slot.
  • Page 123 Removing the Chassis Top Cover FIGURE 4-6 Figure Legend Top screw locations (10 total) Side screw locations (4 total) b. Set the cover aside. c. Use a No. 1 Phillips screwdriver to remove 4 screws from the top of the bezel ), then tilt the top of the bezel away from the External I/O FIGURE 4-7 Expansion Unit and lift it off.
  • Page 124 Bezel Screws FIGURE 4-7 Figure Legend Bezel screws 3. Install new serial number labels on the bezel. The current serial number labels are located at the left PSU opening of the bezel FIGURE 4-8 4-28 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 125 Serial Number Labels FIGURE 4-8 Figure Legend Upper serial number label Lower serial number label 4. Use a No. 1 Phillips screwdriver to remove the top cover ( ) from the FIGURE 4-6 new chassis. 5. Set the cover aside. This cover will be used with the new chassis.

  • Page 126: Installing The External I/O Expansion Unit In The Rack

    7. Install the new top cover on the replacement External I/O Expansion Unit chassis. Note – The new top cover does not have system serial number label. The new system serial number is located only on labels on the bezel ( ) and inside the FIGURE 4-8 left I/O boat bay of the FRU chassis.
  • Page 127 Uninstalling the Chassis Lock Brackets FIGURE 4-9 3. Set the old chassis aside for return or proper disposal. 4. Install the chassis lock brackets on the sides of the replacement chassis. 5. Slide the replacement chassis into the rack and lock the chassis in place, using two No.
  • Page 128 Installing the External I/O Expansion Unit in the Rack FIGURE 4-10 6. At the front of the chassis, install the PSUs: a. Pull the PSU handle to the unlocked position. b. Slide the PSU into the slot until the rear of the PSU contacts the centerplane. c.

  • Page 129: Powering Up A Link After Service

    ) and DC power ( ) LEDs should light. For other LED indications, see Appendix 13. Add the PCI card to an Oracle Solaris domain. # cfgadm -c configure ap_id For details, refer to the service manual for your host server. 4.13 Powering Up a Link After Service 4.13.1...

  • Page 130: Example Of The Cfgadm -C Configure Command

    Example of the cfgadm -c configure Command The following examples are for an External I/O Expansion Unit with one I/O boat connected to a SPARC Enterprise M4000 server. In the examples, the ap_id for the server IOU slot to which the I/O boat is connected is...
  • Page 131 A P P E N D I X Specifications This guide provides the specifications and site requirements you need when planning for the installation of an External I/O Expansion Unit. Topics in this appendix include: Section A.1, “Physical Specifications” on page A-2 ■...

  • Page 132: Physical Specifications

    Physical Specifications Measure U.S. Metric Width 17.3 in. 440 mm Depth 29 in. 730 mm Depth with cable management unit 39 in. 1000 mm Height (4 rack units) 6.9 in. 175 mm Weight with 1 I/O boat and 2 PSUs 63 lb 28.6 kg Weight with 2 I/O boats and 2 PSUs...

  • Page 133: Environmental Specifications

    Environmental Specifications Environmental Factor Operating Range Nonoperating Range Optimum Ambient 5˚C to 35˚C Unpacked: 21˚C to 23˚C temperature (41˚F to 95˚F) (70˚F to 74˚F) 0˚C to 50˚C (32˚F to 122˚F) Packed: ‡ -20˚C to 60˚C (-4˚F to 140˚F Relative 20% RH to 80% RH, Up to 93% RH, 45% RH to 50% RH, humidity...

  • Page 134: Power Source Requirements

    Power Source Requirements Description Specification Input voltage range 100 VAC to 240 VAC, 50-60 Hz Maximum input current 8.0 A at 100 VAC 4.0 A at 220 VAC Rush current, per AC cord 30 A (peak) Maximum input power 600 W Phases Single Leakage current, per AC cord...

  • Page 135: Agency Compliance Specifications

    Agency Compliance Specifications The External I/O Expansion Unit complies with the following specifications. Category Relevant Standards Safety Standards UL/CSA60950-1, EN60950-1, IEC60950-1, IEC825, and CB Scheme with all national differences Emissions FCC, EN55022/CISPR22(All Class A) & EN61000-3-2 & -3-3 Immunity EN55024, EN61000-4-2, -4-3, -4-5, -4-5, -4-6, -4-8, -4-11, EN300-386 Regulatory markings system level CE, UL, BSMI, FCC, VCCI, ICES, C-tick, GOST-R, MIC, WEEE, &...
  • Page 136 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

  • Page 137: External I/O Expansion Unit Led Status Indicators

    A P P E N D I X External I/O Expansion Unit LED Status Indicators The following tables list the status states for the LEDs on the front ( ) and FIGURE B-1 rear ( ) of the External I/O Expansion Unit. FIGURE B-2 Topics in this appendix include: Section B.1, “LED Locations”...

  • Page 138: B.1 Led Locations

    LED Locations LEDs on the Front of the Chassis FIGURE B-1 Figure Legend Chassis locate (LED and switch) PSU0 DC power Chassis fault/service required PSU0 AC power Chassis power PSU1 ready to remove Chassis overtemp PSU1 fault/locate PSU0 ready to remove PSU1 DC power PSU0 fault/locate PSU1 AC power...
  • Page 139 LEDs on the Rear of the Chassis FIGURE B-2 Figure Legend Chassis locate (LED and switch) I/O boat 1 ready to remove Chassis fault/service required I/O boat 1 fault/locate Chassis power I/O boat 1 DC power Chassis overtemp Link card data I/O boat 0 ready to remove Link card management I/O boat 0 fault/locate...

  • Page 140: Led States

    LED States Note – Text shown in bold font indicates the normal operating state for each LED. External I/O Expansion Unit Chassis (Front) TABLE B-1 LED Name Color State Meaning Locate White Flash The unit is located here. (4 Hz) To turn off the flashing LED, press the button for 0.5 second or longer.
  • Page 141 External I/O Expansion Unit Chassis (Rear) TABLE B-2 LED Name Color State Meaning Locate White Flash The unit is located here. (4 Hz) To turn off the flashing LED, press the button for 0.5 second or longer. Fault/service required Amber No fault.
  • Page 142 Carriers 1-6 TABLE B-5 LED Name Color State Meaning Power Green Card in slot. Slot empty. Flash Power transition in progress. Attention/Locate Amber No fault. Fault present. Flash Locate on. (1 Hz) * When the External I/O Expansion Unit is first powered on, a lighted Power LED means the slot has power. An unlighted Power LED means the slot is not powered.

  • Page 143: Pci Cards And Device Mapping

    A P P E N D I X PCI Cards and Device Mapping This appendix shows examples of device maps (device paths) for PCI cards in an External I/O Expansion Unit attached to a host system. Use this information to identify and locate PCI cards in the External I/O Expansion Unit I/O boats.
  • Page 144 IOU slots in the SPARC Enterprise M4000/M5000 servers. For TABLE C-1 more information about IOU slot names, refer to the discussions of I/O device mapping in the SPARC Enterprise M4000/M5000/M8000/M9000 Servers Administration Guide. IOU Slots in SPARC Enterprise M4000/M5000 Servers...

  • Page 145: Device Map For Pci Express Cards

    Device Map Examples As shown in the diagrams below, the OpenBoot PROM displays the following parts in sequence for each PCI card in an External I/O Expansion Unit: The I/O Unit (IOU) slot in the server ■ Multiple devices inside the I/O boat ■...

  • Page 146: Device Map For Pci-X Cards

    Parts of a Device Path for a PCI Express I/O Boat TABLE C-3 Item Description Device Tree Path Example IOU slot /pci@xy,700000 link cards (Nothing is displayed for link cards. This is normal behavior. They are not visible to the OpenBoot PROM.) /pci@0 /pci@xy,700000/pci@0 /pci@9...
  • Page 147 Device Path for PCI-X PCI Cards FIGURE C-2 PCI-X slot 6 PCI-X slot 5 PCI-X slot 4 PCI-X slot 3 PCI-X slot 2 PCI-X slot 1 Parts of a Device Path for a PCI-X I/O Boat TABLE C-4 Item Description Device Tree Path Example IOU slot /pci@xy,700000...

  • Page 148: Software Commands For The External I/O Expansion Unit

    Run this command from the OpenBoot prompt. cfgadm (1M) The cfgadm (1M) command displays dynamic reconfiguration EXAMPLE C-2 information for a system. Run this command from the Oracle Solaris superuser prompt. prtdiag (1M) The prtdiag (1M) command displays system configuration and any EXAMPLE C-3 failed field replaceable units (FRUs).

  • Page 149: The Ioxadm Command

    PCI Cards in a Typical External I/O Expansion Unit (Continued) TABLE C-6 Boat Slot PCI Card Dual Ultra320 SCSI adapter Dual gigabit Ethernet 4 gigabit fibre channel C.3.1 The ioxadm Command Use the ioxadm (8) command to display information about the External I/O Expansion Unit and to manage External I/O Expansion Unit functions.

  • Page 150: The Show-Devs Command

    C.3.2 The show-devs Command The show-devs command displays the paths from the host system to the PCI cards in the I/O boat. Typical Output of the show-devs Command (1 of 3) EXAMPLE C-1 {0} ok show-devs /pci@3,700000 /pci@2,600000 /pci@1,700000 /pci@0,600000 /pci@8,4000 /cmp@408,0 /cmp@400,0...
  • Page 151 Typical Output of the show-devs Command (2 of 3) EXAMPLE C-1 /pci@3,700000/pci@0/pci@8/pci@0/pci@4/network@1 /pci@3,700000/pci@0/pci@8/pci@0/pci@4/network@0 /pci@3,700000/pci@0/pci@8/pci@0/pci@4/scsi@2,1/tape /pci@3,700000/pci@0/pci@8/pci@0/pci@4/scsi@2,1/disk /pci@3,700000/pci@0/pci@8/pci@0/pci@4/scsi@2/tape /pci@3,700000/pci@0/pci@8/pci@0/pci@4/scsi@2/disk /pci@3,700000/pci@0/pci@1/pci@0,1 /pci@3,700000/pci@0/pci@1/pci@0 /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4,1 /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4 /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4,1/fp@0,0 /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4,1/fp@0,0/disk /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4/fp@0,0 /pci@3,700000/pci@0/pci@1/pci@0,1/SUNW,qlc@4/fp@0,0/disk /pci@3,700000/pci@0/pci@1/pci@0/pci@4 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@4 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@0 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@4/network@3 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@4/network@2 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@0/network@1 /pci@3,700000/pci@0/pci@1/pci@0/pci@4/pci@0/network@0 /pci@2,600000/pci@0 /pci@2,600000/pci@0/pci@9 /pci@2,600000/pci@0/pci@8 /pci@2,600000/pci@0/pci@1 /pci@2,600000/pci@0/pci@9/pci@0 /pci@2,600000/pci@0/pci@9/pci@0/pci@9 /pci@2,600000/pci@0/pci@9/pci@0/pci@1 /pci@2,600000/pci@0/pci@9/pci@0/pci@0 /pci@2,600000/pci@0/pci@9/pci@0/pci@9/fibre-channel@0,1 /pci@2,600000/pci@0/pci@9/pci@0/pci@9/fibre-channel@0 /pci@2,600000/pci@0/pci@9/pci@0/pci@1/fibre-channel@0,1...
  • Page 152 Typical Output of the show-devs Command (3 of 3) EXAMPLE C-1 /pci@2,600000/pci@0/pci@1/pci@0/pci@9/network@0,1 /pci@2,600000/pci@0/pci@1/pci@0/pci@9/network@0 /pci@2,600000/pci@0/pci@1/pci@0/pci@1/network@0,1 /pci@2,600000/pci@0/pci@1/pci@0/pci@1/network@0 /pci@2,600000/pci@0/pci@1/pci@0/pci@0/network@0,1 /pci@2,600000/pci@0/pci@1/pci@0/pci@0/network@0 /pci@0,600000/pci@0 /pci@0,600000/pci@0/pci@9 /pci@0,600000/pci@0/pci@8 /pci@0,600000/pci@0/pci@1 /pci@0,600000/pci@0/pci@8/pci@0,1 /pci@0,600000/pci@0/pci@8/pci@0 /pci@0,600000/pci@0/pci@8/pci@0/pci0,0@7 /pci@0,600000/pci@0/pci@8/pci@0/network@2,1 /pci@0,600000/pci@0/pci@8/pci@0/network@2 /pci@0,600000/pci@0/pci@8/pci@0/scsi@1 /pci@0,600000/pci@0/pci@8/pci@0/scsi@1/disk /pci@0,600000/pci@0/pci@8/pci@0/scsi@1/tape /pci@8,4000/ebus@1 /pci@8,4000/ebus@1/panel@14,280030 /pci@8,4000/ebus@1/scfc@14,200000 /pci@8,4000/ebus@1/serial@14,400000 /pci@8,4000/ebus@1/flashprom@10,0 /cmp@408,0/core@1 /cmp@408,0/core@0 /cmp@408,0/core@1/cpu@1 /cmp@408,0/core@1/cpu@0 /cmp@408,0/core@0/cpu@1 /cmp@408,0/core@0/cpu@0 /cmp@400,0/core@1 /cmp@400,0/core@0 /cmp@400,0/core@1/cpu@1...

  • Page 153: The Cfgadm Command

    C.3.3 The cfgadm Command The cfgadm command displays devices connected to the main server bus. To use this command, refer to the cfgadm man page. (1M) This is typical output of the cfgadm command; Typical Output of the cfgadm Command (1 of 2) EXAMPLE C-2 # cfgadm -la Ap_Id...

  • Page 154: The Prtdiag Command

    Typical Output of the cfgadm Command (2 of 2) EXAMPLE C-2 pcie3 etherne/hp connected configured pcie4 fibre/hp connected configured pcie5 fibre/hp connected configured pcie6 fibre/hp connected configured C.3.4 The prtdiag Command The prtdiag command displays information about the server, including basic details about the PCI cards in the External I/O Expansion Unit.
  • Page 155 Typical prtdiag Output EXAMPLE C-3 network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pcie-no network SUNW,pci-qge network SUNW,pci-qge network SUNW,pci-qge network SUNW,pci-qge Appendix C PCI Cards and Device Mapping C-13...
  • Page 156 C-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 157 A P P E N D I X Troubleshooting This appendix includes these topics for the External I/O Expansion Unit from Oracle and Fujitsu: Section D.1, “Using Hardware Symptoms to Troubleshoot Problems” on page D-2 ■ Section D.2, “Using Manual Techniques of Fault Isolation to Diagnose Error ■...

  • Page 158: Troubleshooting

    Using Hardware Symptoms to Troubleshoot Problems Troubleshooting (1 of 3) TABLE D-1 Area Symptom Comments Carrier Carrier does not seat. • Pull the carrier handle out fully before inserting the carrier in the I/O boat slot. The PCI card and carrier plate will strike the card socket if the handle is not fully retracted.
  • Page 159 Troubleshooting (2 of 3) TABLE D-1 Area Symptom Comments • If PCI Express data path failures are detected during initial Power-On Self Test (POST), POST will turn off power to the link card slot in the host. FRUs in the External I/O Expansion Unit are detected by the host service processor during POST but disappear when power to the slot is removed.

  • Page 160: Using Manual Techniques Of Fault Isolation To Diagnose Error Messages

    Troubleshooting (3 of 3) TABLE D-1 Area Symptom Comments • The card might not fit the socket in the boat. The card might be the wrong type for the PCI Express or PCI-X socket. • Verify that there is no broken plastic lying inside the socket. PCI card is difficult to install •...
  • Page 161 XSCF> fmdump -v -u 1a56dc98-aa6d-4128-adaf-428d45fcb024 TIME UUID MSG-ID Sep 15 13:05:53.8069 1a56dc98-aa6d-4128-adaf-428d45fcb024 IOXSCF-8000-CQ fault.chassis.iox.i2c.device Problem in: hc:///iox=983555/ps=1/ledctrl=0 Affects: hc:///iox=983555/ps=1/ledctrl=0 FRU: hc://:product-id=SPARC Enterprise M4000 :chassis-id= 0000000000:server-id=burl-m4000-0:serial=DD0566:part=CF003001701\ 3001701:revision=04/component=IOX@X084/PS1 Location: IOX@X084/PS1 fault.chassis.iox.i2c.bus Problem in: hc:///iox=983555/iob=0/i2c_local=0 Affects: hc:///iox=983555/iob=0/i2c_local=0 FRU: hc://:product-id=SPARC Enterprise M4000 :chassis-id= 0000000000:server-id=burl-m4000-0:serial=1E0041:part=5016939:revision=...

  • Page 162: I 2 C Failures

    Affects: hc:///iox=983555/i2c_a=0 FRU: hc://:product-id=SPARC Enterprise M4000 :chassis-id= 0000000000:server-id=burl-m4000-0:serial=XCX084:part=CF005016937\ 5016937:revision=03/component=IOX@X084 Location: IOX@X084 In the example above, the MSG-ID is IOXSCF-8000-CQ. The FMRIs are: hc:///iox=983555/ps=1/ledctrl=0 ■ (the I C device in PSU IOX@X084/PS1) ■ hc:///iox=983555/iob=0/i2c_local=0 (the I C bus segment in boat IOX@X084/IOB0) hc:///iox=983555/ps=1/i2c_local=0 ■...

  • Page 163: I 2 C Fault Isolated To A Single Fru

    If the failure is on a bus that spans multiple FRUs, follow the suggested steps in Section D.2.2.2, “I C Fault Spanning Multiple FRUs” on page D-7 to isolate the problem FRU. If the failure is in the host, see Section D.2.2.3, “I C Fault When Accessing the Link Card Installed in the Host”...
  • Page 164 Possible Causes There is a power design issue where an I C hot-swap buffer may prevent ■ communication to I C devices in a PSU. A FRU is not fully seated. ■ A FRU is faulty. ■ Resolution Contact a certified service technician for assistance in selecting one of the following alternative methods for testing the I C power design issue in the External I/O Expansion Unit.
  • Page 165 h. If this workaround does not correct the problem, repeat Step a through Step f for the remaining PSU. Step i. If fault messages continue to appear, go to 2. Use the power cord method to determine if the I C buffer power design issue is at fault: a.
  • Page 166 4. If the fault list in the error message includes i2c_a or i2c_b, use the following steps to find the faulty FRU. If the fault list does not include i2c_a or i2c_b, go to Step a. Power off the affected domains. b.

  • Page 167: I 2 C Fault When Accessing The Link Card Installed In The Host

    -- I/O boat 1 Test the FRUs listed above before suspecting the following: -- Link card (see Step -- Chassis (see Step iv. Power on both PSUs. v. Power on the affected domains. If the problem has been corrected, the fault messages will not appear. vi.

  • Page 168: Management Bus Failures

    Resolution 1. Reseat the host link card. If this step corrects the problem, you do not have to do anything more to ■ resolve this issue. If this step does not correct the problem, and an empty slot is available in the ■...

  • Page 169: Cable Removed Or Power Loss

    A link card has failed. ■ Resolution 1. See Section D.2.7.4, “Bridge Controller Timeout” on page D-21 for details on Bridge Controller timeouts. 2. Replace the link cable. 3. Replace the link card in the I/O boat. 4. Replace the link card in the host. D.2.4 Cable Removed or Power Loss MSGID IOXSCF-8000-84 fault.chassis.iox.device.missing...

  • Page 170: Interrupt Signal Failures

    4. Swap link cards with known good link cards to determine if a similar failure occurs. D.2.5 Interrupt Signal Failures MSGID IOXSCF-8000-2S fault.chassis.iox.device.intr C components in the FRUs generate interrupts to report hardware state changes and alarm events. Interrupt failures are reported if a problem is discovered during an interrupt signal test or if an interrupt cannot be cleared during normal interrupt processing.

  • Page 171: Fru Discovery Failures

    3. If no other fault conditions are present, the following interrupt failures indicate a component or connector failure. You will have to swap out FRUs to determine which FRU contains the faulty signal. hc:///iox=box_instance/iob=x ■ This indicates a DEMUX port interrupt failure. The signal spans the chassis and the I/O boat.

  • Page 172: Boat Not Monitored

    2. The following FMRIs indicate failure of a boat location signal: hc:///iox=box_instance/boat_loc=x ■ hc:///iox=box_instance/iob=x/loc_sig=0 ■ Two I/O boats were reported to be in the same location in a chassis. Try testing each I/O boat separately and examine if the reported location of the I/O boat is correct.

  • Page 173: Link Card Mode Failure

    D.2.6.3 Link Card Mode Failure MSGID IOXSCF-8001-9Y fault.chassis.iox.ulc-wrong-mode The link card installed in an External I/O Expansion Unit I/O boat is operating as if it were installed in a host PCI Express add-in slot. The link card included in the FMRI is not faulty.
  • Page 174 I/O boat 0 ■ I/O boat 1 ■ Chassis ■ Link card ■ Resolution 1. Trace the cable identified with the fault to find the attached External I/O Expansion Unit: hc:///chassis=0/iou=x/pcislot=y/link=0/cable=0 a. Power off the domains that use the FRUs and remove one FRU. i.

  • Page 175: Reported Failures On The Microcontroller

    If the I C problems are resolved by removal of a PSU, assume the PSU is ■ faulty. If the I C problems are resolved by removing an I/O boat, determine ■ whether the problem is with the I/O boat itself or the link card in the I/O boat.

  • Page 176: Fan Controller Timeout

    2. If the fan controller resets still occur, try to discover the faulty FRU by replacing the link cards in the I/O boats. If the problem still occurs, replace the I/O boats. If the problem still occurs, replace the chassis. D.2.7.2 Fan Controller Timeout The fan controller continuously monitors sensors in the PSUs and I/O boats.

  • Page 177: Bridge Controller Timeout

    D.2.7.4 Bridge Controller Timeout If commands are not serviced within the expected time frame, timeout errors are detected. This may cause a device failure reported for: hc:///chassis=0/iou=x/pcislot=y/link=0/controller=0 Possible Causes The I2C_LOCAL bus within the link card is faulty. ■ If the PCI Express link does not train, the bridge controller may not service the ■...
  • Page 178 D-22 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...
  • Page 179 Index direction of air flow, 1-41 direction of slot numbering, 1-2 AC cable, internal, 1-3 dummy cards, 1-11 AC power, 1-6 air flow direction, 1-41 alignment post, carrier, 1-29 electrical requirements, 1-40 alignment tab, carrier, 1-29 error message syntax, D-4 ESD precautions, 1-43 event ID, D-5 behavior of fan, 1-6...
  • Page 180 hc, hardware component in error message, D-5 PCI card lock, types of, 1-20 PCI card locks for various card sizes and shapes, 1- I/O boat, 1-7 C bus failures, D-6 PCI carrier alignment post, 1-29 identifier, FMRI fault managed resource, D-5 alignment tab, 1-29 installation rules, type S rack, 2-3 carrier key, 1-33...
  • Page 181 syntax of error message, D-4 system management, 1-38 tab, carrier alignment, 1-29 troubleshooting error message syntax, D-4 event ID in fmdump command, D-5 eventID/troubleshooting fault event, D-4 fault isolation techniques, D-4 fault managed resource identifier (FMRI), D-5 fmdump, D-4 hardware symptoms host, D-3 LEDs, D-3 PCI card, D-3...
  • Page 182 Index-4 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011...

This manual is also suitable for:

Sparc enterprise m5000Sparc enterprise m8000Sparc enterprise m9000

Table of Contents