Table of Contents
Advertisement
Quick Links
Advertisement
Table of Contents
Related Manuals for Cisco UCS 6500 Series
Summary of Contents for Cisco UCS 6500 Series
- Page 1 Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide First Published: 2022-07-14 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883...
- Page 2 © 2022 Cisco Systems, Inc. All rights reserved.
-
Page 3: Table Of Contents
Grounding Requirements Planning for Power Requirements Airflow Requirements Rack and Cabinet Requirements Clearance Requirements C H A P T E R 3 Installing the Fabric Interconnect Safety Installation Options with Rack-Mount Kits Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 4 Connecting Interface Ports to Other Devices Fabric Interconnect Configuration Fabric Interconnect Port Configuration Port Breakout Migrating a Cisco 6400 Series Fabric Interconnect to a Cisco 6500 Series Fabric Interconnect C H A P T E R 5 Replacing the Fabric Interconnect Replacing the Fabric Interconnect...
- Page 5 Additional Kits Rack Mount Kit UCS-ACC-6536= A P P E N D I X C Site Planning and Maintenance Records Site Preparation Checklist Contact and Site Information Chassis and Module Information Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 6 Contents Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 7 Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 8 Cisco has more than 200 offices worldwide. Addresses and phone numbers are listed on the Cisco website at www.cisco.com/go/offices. Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: https://www.cisco.com/c/en/us/about/...
- Page 9 Cisco Bug Search Tool Cisco Bug Search Tool (BST) is a web-based tool that acts as a gateway to the Cisco bug tracking system that maintains a comprehensive list of defects and vulnerabilities in Cisco products and software. BST provides you with detailed defect information about your products and software.
- Page 10 Preface Communications, Services, and Additional Information Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 11: Overview
• Overview, on page 1 Overview The Cisco UCS 6536 Fabric Interconnect (UCSC-FI-6536) is a 1-rack unit (RU), top of rack (TOR), fixed-port data center platform that provides both network connectivity and management capabilities to the Cisco UCS system. The fabric interconnect can provide Ethernet and Fibre Channel connectivity to the servers in the system. The servers connect to the fabric interconnect, and then to the LAN or SAN. - Page 12 • 1100-W AC power supply with dark grey latch coloring (UCS-PSU-6536-AC) Note All fan modules and power supplies must use the same airflow direction. The following figure shows the fabric interconnect features on the port side of the chassis. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 13 1 (left) to shown) with slots 6 (right). numbered 1 (left) and 2 For additional (right). information, see For additional Module LEDs, on page information, see Power Supply LEDs, on page Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 14 Fabric scripts. Interconnect Chassis LEDs, on page Status (STS) LED For additional information, see Fabric Interconnect Chassis LEDs, on page The following figure shows the side of the chassis. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 15: Fabric Interconnect Chassis Leds
The BCN, STS, and ENV, LEDs are located on the left side of the front of the fabric interconnect. The port LEDs appear as triangles pointing up or down to the nearest port. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 16: Lane Link Leds
The Lane Link LEDs indicate which of the breakout lanes are being checked. If none of the Lane Link LEDs is lit, all four lanes are being checked. Power Supply LEDs The power supply LEDs are located on the right upper corner of the power supply. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 17: Fan Module Leds
• Low voltage • Slow power supply fan Fan Module LEDs The fan module LED is located in the upper left corner above the air holes on the front of the module. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 18: Management Port Leds
Each port has a pair of LEDs, one indicates link and the other indicates activity. LED Location LED State Indicates Left No physical link Left Solid Green Physical link detected Right No Activity Right Blinking Green Activity Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 19: Network Management And Console Port Leds
PSU 2. Each port has a pair of LEDs, one indicates link and the other indicates activity. LED Location LED State Indicates Left No physical link Left Solid Green Physical link detected Right No Activity Right Blinking Green Activity Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 20 Overview Network Management and Console Port LEDs Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 21: Preparing For Installation
Altitude Requirements Altitude rating is based on power supply installed; see critical components list in the system CB report for altitude rating. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 22: Dust And Particulate Requirements
The wiring is unlikely to emit radio interference if you use a twisted-pair cable with a good distribution of grounding conductors. If you exceed the recommended distances, use a high-quality twisted-pair cable with one ground conductor for each data signal when applicable. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 23: Shock And Vibration Requirements
The surfaces shall be cleaned and an antioxidant applied before installation. Planning for Power Requirements The fabric interconnect includes two power supplies (1-to-1 redundancy with current sharing) in one of the following combinations: Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 24: Airflow Requirements
The fan and power supply modules must have the same direction of airflow (even if their coloring is different). If you must change the airflow direction for the fabric interconnect, you must shutdown the fabric interconnect before changing the modules. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 25: Rack And Cabinet Requirements
Provide the chassis with adequate clearance to route cables, provide airflow, and maintain the fabric interconnect. For the clearances required for an installation of this chassis in a four-post rack, see the following figure. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 26 19.0 in (43.3 cm) Note Both the front and rear of the chassis must be open to both aisles for airflow. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 27: Installing The Fabric Interconnect
This unit is intended for installation in restricted access areas. Only skilled, instructed, or qualified personnel can access a restricted access area. Warning Statement 1030 Equipment Installation Only trained and qualified personnel should be allowed to install, replace, or service this equipment. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 28: Installation Options With Rack-Mount Kits
You can install the fabric interconnect using the its accessory kit (UCS-ACC-6536=), which you can order from Cisco. This option offers you easy installation, greater stability, increased weight capacity, added accessibility, and improved removability with front and rear removal. -
Page 29: Unpacking And Inspecting The Fabric Interconnect
Check for damage and report any discrepancies or damage to your customer service representative. Have the following information ready: • Invoice number of shipper (see packing slip) • Model and serial number of the damaged unit Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 30: Installing The Fabric Interconnect Using The Ucs-Acc-6536 Kit
(3 inches [7.6 mm] minimum) and module handles (1 inch [2.5 mm] minimum). Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 31 (see the following figure). Tighten 12-24 screws to 30 in-lb (3.39 N·m) of torque and tighten 10-32 screws to 20 in-lb (2.26 N·m) of torque. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 32 Slide the rack-mount guides onto the slider rails, and then gently slide the fabric interconnect all the way into the rack until the front rack-mount brackets come in contact with two rack or cabinet posts. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 33: Grounding The Fabric Interconnect
This equipment must be grounded. To reduce the risk of electric shock, never defeat the ground conductor or operate the equipment in the absence of a suitably installed ground conductor. Contact the appropriate electrical inspection authority or an electrician if you are uncertain that suitable grounding is available. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 34 Secure the grounding lug to the chassis grounding pad with two M4 screws, see the previous figure. Tighten the screws to 11 to 15 in-lb (1.24 to 1.69 N·m) of torque. Step 4 Prepare the other end of the grounding wire and connect it to the facility ground. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 35: Starting The Fabric Interconnect
• On the fan modules, the Status (STA or STS) LED is green. If a fan module Status LED is not green, try reinstalling the fan module. • After initialization, the fabric interconnect chassis Status (labeled as STA or STS) LED is green. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 36 Verify that the system software has booted, and the fabric interconnect has initialized without error messages. A setup utility automatically launches the first time that you access the fabric interconnect and guides you through the basic configuration. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 37: Connecting The Fabric Interconnect
When running cables in overhead or subfloor cable trays, we strongly recommend that you locate power cables and other potential noise sources as far away as practical from network cabling that terminates on Cisco equipment. In situations where long parallel cable runs cannot be separated by at least 3.3 feet (1 meter), we recommend that you shield any potential noise sources by housing them in a grounded metallic conduit. -
Page 38: Connecting A Console To The Fabric Interconnect
• 1 stop bit • No parity Step 2 Connect an RJ-45 rollover cable to the console port on the fabric interconnect. You can find this cable in the accessory kit. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 39: Setting Up The Management Interface
This helps to prolong the life of both the transceiver and cables. When removing transceivers from the fabric interconnect, it is best to remove the optical cable first and then remove the transceiver. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 40: Fabric Interconnect Configuration
Fabric Interconnect Port Configuration Port Types The Cisco UCS 6500 Series Fabric Interconnect has the following ports which shall be configured through supported Cisco management platforms: • Server port: Port connected to the adapter in a UCS B-series or C-series server. This is typically a converged port that can carry Ethernet and FCoE traffic. -
Page 41: Port Breakout
Native Ethernet • Ethernet Uplink Port • Server port • FCoE uplink port • Appliance port (EHM only) • Monitor Port Port Breakout Port breakout is supported with the following configurations. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 42: Migrating A Cisco 6400 Series Fabric Interconnect To A Cisco 6500 Series Fabric Interconnect
Migrating a Cisco 6400 Series Fabric Interconnect to a Cisco 6500 Series Fabric Interconnect Migrating from a Cisco 6400 Series Fabric Interconnect to a Cisco 6500 Series Fabric Interconnect is supported. Cisco Intersight Managed Mode is required to migrate to 6500 Series Fabric Interconnects. -
Page 43: Replacing The Fabric Interconnect
Replacing a fabric interconnect that is managed by Cisco Intersight Managed Mode (IMM) is a straight forward process that occurs by selecting the fabric interconnect(s) and using either of the following Replace options to start the replacement workflow. -
Page 44: Replacing A Single Fabric Interconnect, Intersight
Use the following procedure when you need to replace a fabric interconnect with the same model of fabric interconnect. Use Cisco UCS Intersight Managed Mode (IMM) to perform software tasks after the new fabric interconnect comes online. For more information, see "Upgrades and RMA of Servers and Fabric Interconnects" in the Cisco Intersight Managed Mode Configuration Guide. - Page 45 In the Fabric Interconnects list, click the checkbox to select the fabric interconnect that you removed. Step 12 Click the Replace Fabric Interconnect icon. This step starts the Replace workflow, which guides you through decommissioning the fabric interconnect. Step 13 Follow the workflow to completion. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 46: Preparing Fabric Interconnects In A Ucs Domain For Removal, Intersight
Use the following procedure when you need to replace a pair of fabric interconnects in the same domain that are the same model of fabric interconnect. For example, a Cisco UCS 6400 Series Fabric Interconnect cannot be paired with a Cisco UCS 6500 Series Fabric Interconnect in the same domain. - Page 47 Type Ctrl-C at any time to abort configuration and reboot system. To back track or make modifications to already entered values, complete input till end of section and answer no when prompted to apply configuration. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 48 Verify that end-to-end Ethernet connectivity is up for both fabric interconnects. i) Verify that end-to-end Fibre Channel connectivity is up for both fabric interconnects. j) Verify that you can launch a virtual KVM session on both fabric interconnects. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 49: Removing A Cisco Ucs Fabric Interconnect From A Rack
Procedure Step 1 Ensure that the weight of the Cisco UCS Fabric Interconnect is fully supported and that the chassis is being held by another person. Step 2 Remove the two screws holding the grounding cable to the chassis (if installed). - Page 50 Replacing the Fabric Interconnect Repacking the Cisco UCS Fabric Interconnect for Return Shipment Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 51: Replacing Components
During operations, all of the modules must have the same direction of airflow. Fans intake air, blow it through the chassis, and exhausts heated air through the port side. Make sure to install fans correctly for proper airflow. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 52: Removing A Fan Module
Holding the handle, pull the module out of the chassis. Caution Do not touch the electrical connectors on the back side of the module and prevent anything else from coming into contact with and damaging the connectors. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 53: Installing A Fan Module
Holding the fan module by its handle, align the back of the fan module (the side with the electrical connectors) to the open fan slot in the chassis. Step 2 Slide the fan module into the slot until it clicks in place. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 54: Replacing A Power Supply Module
If there is only one power supply installed in the fabric interconnect and you need to replace it, install the new power supply in the open slot and power it up before removing the original power supply. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 55: Installing An Ac Power Supply
What to do next You are ready to install the replacement power supply. Installing an AC Power Supply You can replace one power supply while the other one provides power to the fabric interconnect. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 56 (2). Note If the power supply does not fit into the open slot, turn the module over before sliding it carefully into the open slot. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 57: Recycling The Pcba
The PCBA is secured to the fabric interconnect's sheet metal through the following: • 32 M3 screws. • Two M5 hex nuts. You must disconnect the PCBA from the sheet metal before recycling the PCBA. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 58 Lift the top cover off of the fabric interconnect. Step 4 Grasp the center of the airflow baffle and pull it toward the port side of the fabric interconnect to remove it. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 59 Slide the faceplate off of the fabric interconnect. Step 6 Remove the PSU baffles. a) Using a #2 Phillips screwdriver, remove four screws (2 screws per baffle.) b) Grasp each baffle and lift it off of the PCBA. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 60 Using a #2 Phillips screwdriver, remove the screws that secure the heatsinks to the PCBA. b) Lift each of the heatsinks off of the PCBA. c) Grasp and remove the DIMMs from their sockets. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 61 Using a #2 Phillips screwdriver, remove the 32 M3 screws (shown in red circles) that secure the PCBA to the sheet metal. b) Using an 8mm hex wrench, remove the two M5 hex nuts (shown in green circles) that secure the PCBA to the sheet metal. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 62 Replacing Components Recycling the PCBA c) Lift the PCBA off of the sheet metal. Step 9 Recycle or dispose of the PCBA in compliance with your local e-waste regulations. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 63: Appendix A Specifications
Regulatory Standards Compliance Specifications, on page 58 Rack Specifications Observe the following rack specifications for the Cisco UCS 6500 Series Fabric Interconnect. Overview of Racks You can install the fabric interconnect in the following types of cabinets and racks, assuming an external ambient air temperature range of 0 to 104°F (0 to 40°C):... -
Page 64: General Requirements For Cabinets And Racks
To help with cable management, you might want to allow additional space in the rack above and below the chassis to make it easier to route all of the fiber optic or copper cables through the rack. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 65: System Specifications
Specifications System Specifications System Specifications Observe the following system specifications when installing and operating the Cisco UCS 6500 Series Fabric Interconnect. Environmental Specifications Environment Specification Temperature Ambient operating temperature 32 to 104°F (0 to 40°C) Ambient nonoperating –40 to 158°F (–40 to 70°C) -
Page 66: Fabric Interconnect Power Input Requirements
Maximum hold-up time 12 ms at 1100 W Power supply output voltage 12 VDC Power supply standby voltage 12 VDC Efficiency rating Climate Savers Platinum Efficiency (80Plus Platinum certified) Form factor RSP1 Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 67: Power Cable Specifications
CAB-N5K6A-NA 200/240V, 6A, 8.2 feet (2.5 m) Peoples Republic of China CAB-250V-10A-CN 250 V, 10 A, 8.2 feet (2.5 m) South Africa CAB-250V-10A-ID 250 V, 10 A, 8.2 feet (2.5 m) Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 68: Regulatory Standards Compliance Specifications
• UL 62368-1 • CAN/CSA 22.2 No 62368-1 • EN 62368-1 • IEC 62368-1 with all country deviations • Additional Certifications may be required as countries adopt new Standards like IEC 62368-1 Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 69 • CNS13438 Class A EMC: Immunity • EN55024 • CISPR24 • EN300386 • KN 61000-4 series RoHS The product is RoH-6 compliant with exceptions for leaded-ball grid-array (BGA) balls and lead press-fit connectors. Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 70 Specifications Specifications Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 71: Additional Kits
• M4 Phillips pan-head screws Ground lug kit • Two-hole lug (1) • M4 x 8-mm Phillips pan-head screws (2) Not applicable EAC Compliance document Not applicable Hazardous substances list for customers in China Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 72 Additional Kits Additional Kits Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 73: Site Planning And Maintenance Records
Table 2: Site Planning Checklist Task No. Planning Activity Verified By Time Date Space evaluation: • Space and layout • Floor covering • Impact and vibration • Lighting • Maintenance access Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 74 • Dedicated circuit for power supply • Dedicated (separate) circuits for redundant power supplies • UPS for power failures Grounding evaluation: • Circuit breaker size • CO ground (AC- powered systems) Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
-
Page 75: Contact And Site Information
Use the following worksheet to record contact and site information. Table 3: Contact and Site Information Contact person Contact phone Contact e-mail Building/site name Data center location Floor location Address (line 1) Address (line 2) Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... -
Page 76: Chassis And Module Information
System IP address System IP netmask Hostname Domain name IP broadcast address Gateway/router address DNS address Modem telephone number Table 5: Module Information Slot Module Type Module Serial Number Notes Fixed Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide... - Page 77 Site Planning and Maintenance Records Table 6: Fabric Interconnect Port Connection Record Fabric Interconnect A or B Connected to Slot Port Chassis Port LAN or SAN Port Connection Pin Group Channel Notes Group Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 78 Site Planning and Maintenance Records Site Planning and Maintenance Records Fabric Interconnect A or B Connected to Slot Port Chassis Port LAN or SAN Port Connection Pin Group Channel Notes Group Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide...
- Page 79 Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide IN-1...
- Page 80 INDEX Cisco UCS 6500 Series Fabric Interconnect Hardware Installation Guide IN-2...