Cisco APIC M3 Installation And Service Manual
  1. Manuals
  2. Brands
  3. Cisco Manuals
  4. Server
  5. APIC M3
  6. Installation and service manual

Cisco APIC M3 Installation And Service Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Cisco APIC M3/L3 Server Installation and Service Guide
First Published: 2018-10-25
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883

Advertisement

Table of Contents
loading

Related Manuals for Cisco APIC M3

Summary of Contents for Cisco APIC M3

  • Page 1 Cisco APIC M3/L3 Server Installation and Service Guide First Published: 2018-10-25 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883...
  • Page 2 Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental. Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com trademarks.

  • Page 3: Table Of Contents

    Initial Server Setup Connecting to the Server Locally For Setup Connecting to the Server Remotely For Setup Setting Up the System With the Cisco IMC Configuration Utility NIC Mode and NIC Redundancy Settings Updating the BIOS and Cisco IMC Firmware...
  • Page 4 HHHL Form-Factor NVME SSD Requirements and Restrictions Replacing an HHHL Form-Factor NVMe SSD Replacing Fan Modules Replacing Memory DIMMs DIMM Population Rules and Memory Performance Guidelines Replacing DIMMs Replacing CPUs and Heatsinks CPU Configuration Rules Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 5 Installing a Trusted Platform Module (TPM) TPM Considerations Installing and Enabling a TPM Service Headers and Jumpers Using the Clear CMOS Header (J38, Pins 9 - 10) Using the BIOS Recovery Header (J38, Pins 11 - 12) Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 6 Using the Boot Alternate Cisco IMC Image Header (J39, Pins 1 - 2) Using the Reset Cisco IMC Password to Default Header (J39, Pins 3 - 4) Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6)
  • Page 7 1. Updating the Server BIOS 2. Updating the GPU Card Drivers A P P E N D I X D Installation For Cisco UCS Manager Integration Installation For Cisco UCS Manager Integration Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 8 Contents Cisco APIC M3/L3 Server Installation and Service Guide viii...

  • Page 9: Overview

    External Features This topic shows the external features of the server versions. Cisco APIC M3 and L3 Server (SFF Drives) Front Panel Features The following figure shows the front panel features of the small form-factor drive versions of the server.
  • Page 10 Overview External Features Figure 1: Cisco APIC M3 and L3 Server (SFF Drives) Front Panel Drive bays 1 – 10 support SAS/SATA hard disk Fan status LED drives (HDDs) and solid state drives (SSDs) • APIC-Server-M3 and L3: Drive bays 1 and Network link activity LED 2 support NVMe PCIe SSDs.
  • Page 11 Overview Serviceable Component Locations Figure 2: Cisco APIC M3 and L3 Server Rear Panel USB 3.0 ports (two) Rear unit identification button/LED Dual 1-Gb/10-Gb Ethernet ports (LAN1 and Power supplies (two, redundant as 1+1) LAN2) The dual LAN ports can support 1 Gbps and 10 Gbps, depending on the link partner capability.
  • Page 12 Overview Serviceable Component Locations Figure 3: Cisco APIC M3 and L3 Server, Serviceable Component Locations Front-loading drive bays 1–10 support SAS/SATA RTC battery, vertical socket drives. Cooling fan modules (seven, hot-swappable) Power supplies (hot-swappable when redundant as 1+1) Supercap unit mounting bracket (RAID backup)

  • Page 13: Summary Of Server Features

    Baseboard management BMC, running Cisco Integrated Management Controller (Cisco IMC) firmware. Depending on your Cisco IMC settings, Cisco IMC can be accessed through the 1-Gb dedicated management port, the 1-Gb/10-Gb Ethernet LAN ports, or a Cisco virtual interface card. Network and management I/O Rear panel: •...
  • Page 14 • A PCIe-style interposer card for the server’s embedded SATA RAID controller. RAID backup The server has a mounting bracket near the cooling fans for the supercap unit that is used with the Cisco modular RAID controller card. Integrated video Integrated VGA video.

  • Page 15: Installing The Server

    Initial Server Setup, on page 14 • NIC Mode and NIC Redundancy Settings, on page 19 • Updating the BIOS and Cisco IMC Firmware, on page 20 • Accessing the System BIOS, on page 21 • Smart Access Serial, on page 21 •...
  • Page 16 Caution Avoid uninterruptible power supply (UPS) types that use ferroresonant technology. These UPS types can become unstable with systems such as the Cisco UCS, which can have substantial current draw fluctuations from fluctuating data traffic patterns. Caution To prevent loss of input power, ensure the total maximum loads on the circuits supplying power to the switch are within the current ratings for the wiring and breakers.

  • Page 17: Grounding Requirements

    Supported Cisco Slide Rail Kits The server supports the following rail kit options: Rack Installation Tools Required The slide rails sold by Cisco Systems for this server do not require tools for installation. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 18: Installing The Server In A Rack

    Open the front securing plate on both slide-rail assemblies. The front end of the slide-rail assembly has a spring-loaded securing plate that must be open before you can insert the mounting pegs into the rack-post holes. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 19 Push the inner rails into the slide rails on the rack until they stop at the internal stops. c) Slide the inner-rail release clip toward the rear on both inner rails, and then continue pushing the server into the rack until its front slam-latches engage with the rack posts. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 20: Installing The Cable Management Arm (Optional)

    With the server pushed fully into the rack, slide the CMA tab of the CMA arm that is farthest from the server onto the end of the stationary slide rail that is attached to the rack post. Slide the tab over the end of the rail until it clicks and locks. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 21: Reversing The Cable Management Arm (Optional)

    Pivot the tab that is at the end of the width-adjustment slider. Depress and hold the metal button on the outside of the tab and pivot the tab 180 degrees so that it points toward the rear of the server. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 22: Initial Server Setup

    (VIC) to access the Cisco Integrated Management Interface (Cisco IMC). If you want to use the 10/100/1000 dedicated management ports to access Cisco IMC, you can connect to the server and change the NIC mode as described in...

  • Page 23: Connecting To The Server Locally For Setup

    There are two methods for connecting to the system for initial setup: • Local setup—Use this procedure if you want to connect a keyboard and monitor directly to the system for setup. This procedure can use a KVM cable (Cisco PID N20-BKVM) or the ports on the rear of the server.

  • Page 24: Connecting To The Server Remotely For Setup

    Allow your preconfigured DHCP server to assign an IP address to the server node. Step 4 Use the assigned IP address to access and log in to the Cisco IMC for the server node. Consult with your DHCP server administrator to determine the IP address.

  • Page 25: Setting Up The System With The Cisco Imc Configuration Utility

    In this NIC mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because the server is in standalone mode, further DHCP requests from the Cisco card are disabled.
  • Page 26 • None—The Ethernet ports operate independently and do not fail over if there is a problem. This setting can be used only with the Dedicated NIC mode. • Active-standby—If an active Ethernet port fails, traffic fails over to a standby port. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active settings.

  • Page 27: Nic Mode And Nic Redundancy Settings

    What to do next Use a browser and the IP address of the Cisco IMC to connect to the Cisco IMC management interface. The IP address is based upon the settings that you made (either a static address or the address assigned by your DHCP server).

  • Page 28: Updating The Bios And Cisco Imc Firmware

    When you upgrade the BIOS firmware, you must also upgrade the Cisco IMC firmware to the same version or the server does not boot. Do not power off the server until the BIOS and Cisco IMC firmware are matching or the server does not boot.

  • Page 29: Accessing The System Bios

    • This feature has the following requirements: • A serial cable connection, which can use either the RJ-45 serial connector on the server rear panel, or a DB-9 connection when using the KVM cable (Cisco PID N20-BKVM) on the front-panel KVM console connector.

  • Page 30: Smart Access Usb

    • Disabled: the front-panel USB device is connected to the host. • In a case where no management network is available to connect remotely to Cisco IMC, a Device Firmware Update (DFU) shell over serial cable can be used to generate and download technical support files to the USB device that is attached to front panel USB port.

  • Page 31: Front-Panel Leds

    Status LEDs and Buttons This section contains information for interpreting front, rear, and internal LED states. Front-Panel LEDs Figure 9: Front Panel LEDs Table 2: Front Panel LEDs, Definition of States LED Name States Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 32 Power button/LED • Off—There is no AC power to the server. • Amber—The server is in standby power mode. Power is supplied only to the Cisco IMC and some motherboard functions. • Green—The server is in main power mode. Power is supplied to all server components.
  • Page 33 Temperature status • Green—The server is operating at normal temperature. • Amber, steady—One or more temperature sensors breached the critical threshold. • Amber, blinking—One or more temperature sensors breached the non-recoverable threshold. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 34: Rear-Panel Leds

    • Green—Link is active. • Green, blinking—Traffic is present on the active link. Rear unit identification • Off—The unit identification function is not in use. • Blue, blinking—The unit identification function is activated. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 35: Internal Diagnostic Leds

    • Amber, solid—Critical error detected; 12 V main power off (for example, over-current, over-voltage, or over-temperature failure). Internal Diagnostic LEDs The server has internal fault LEDs for CPUs, DIMMs, and fan modules. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 36: Preparing For Component Installation

    These LEDs operate only when the server is in standby power mode. • Amber—CPU has a fault. • Off—CPU is OK. Preparing For Component Installation This section includes information and tasks that help prepare the server for component installation. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 37: Required Equipment For Service Procedures

    • Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately enter standby mode. Step 3 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the power supplies in the server. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 38: Shutting Down Using The Cisco Imc Gui

    With the latch in the fully open position, place the cover on top of the server about one-half inch (1.27 cm) behind the lip of the front cover panel. The opening in the latch should fit over the peg that sticks up from the fan tray. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 39: Serial Number Location

    The serial number for the server is printed on a label on the top of the server, near the front. Hot Swap vs Hot Plug Some components can be removed and replaced without shutting down and removing power from the server. This type of replacement has two varieties: hot-swap and hot-plug. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 40: Removing And Replacing Components

    This section describes how to install and replace server components. Serviceable Component Locations This topic shows the locations of the field-replaceable components and service-related items. The view in the following figure shows the server with the top cover removed. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 41 Maintaining the Server Serviceable Component Locations Figure 13: Cisco APIC M3 and L3 Server, Serviceable Component Locations Front-loading drive bays 1–10 support SAS/SATA RTC battery, vertical socket drives. Cooling fan modules (seven, hot-swappable) Power supplies (hot-swappable when redundant as 1+1)

  • Page 42: Replacing Sas/Sata Hard Drives Or Solid State Drives

    • Operating system support on 4K sector drives is as follows: Windows: Win2012 and Win2012R2; Linux: RHEL 6.5, 6.6, 6.7, 7.0, 7.2; SLES 11 SP3, and SLES 12. ESXi/Vmware is not supported. Procedure Command or Action Purpose Step 1 Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 43: Replacing A Sas/Sata Drive

    Under Boot Option Priorities, verify that the OS you installed is listed as your Boot Option #1. Setting Up UEFI Mode Booting in the Cisco IMC GUI Step 1 Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface. Step 2 Navigate to Server > BIOS.

  • Page 44: Replacing A Front-Loading Nvme Ssd

    To replace HHHL form-factor NVMe SSDs in the PCIe slots, see Replacing HHHL Form-Factor NVMe Solid State Drives. Front-Loading NVMe SSD Population Guidelines The front drive bay supports 2.5- inch NVMe SSDs. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 45: Front-Loading Nvme Ssd Requirements And Restrictions

    Save your changes and exit the utility. Enabling Hot-Plug Support Using the Cisco IMC GUI Step 1 Use a browser to log in to the Cisco IMC GUI for the server. Step 2 Navigate to Compute > BIOS > Advanced > PCI Configuration.

  • Page 46: Replacing A Front-Loading Nvme Ssd

    Observe the drive-tray LED and wait until it returns to solid green before accessing the drive: • Off—The drive is not in use. • Green, blinking—the driver is initializing following hot-plug insertion. • Green—The drive is in use and functioning properly. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 47: Installing A Pcie Cable For Front-Loading Nvme Ssds

    • If the server was ordered with 2.5-inch form-factor NVMe SSDs, this cable was preinstalled at the factory. No action is required. • If you are adding 2.5-inch form-factor NVMe SSDs for the first time, you must order and install the cable as described in the following procedure. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 48: Replacing Hhhl Form-Factor Nvme Solid State Drives

    HHHL form-factor SSDs you can populate is 1, in PCIe slot 1. HHHL Form-Factor NVME SSD Requirements and Restrictions Observe these requirements: • All versions of the server support HHHL form-factor NVMe SSDs. Observe these restrictions: Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 49: Replacing An Hhhl Form-Factor Nvme Ssd

    Carefully push down on both ends of the PCIe riser to fully engage its two connectors with the two sockets on the motherboard. g) Replace the top cover to the server. h) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 50: Replacing Fan Modules

    Each fan module has a fault LED next to the fan connector on the motherboard. This LED lights green when the fan is correctly seated and is operating OK. The LED lights amber when the fan has a fault or is not correctly seated. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 51: Replacing Memory Dimms

    DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation. Caution Cisco does not support third-party DIMMs. Using non-Cisco DIMMs in the server might result in system problems or damage to the motherboard.
  • Page 52 (G1, H1); (K1, L1) (A1, B1); (C1, D1); (G1, H1); (J1, K1); (E1, F1) (L1, M1) (A1, B1); (D1, E1) (A2, B2); (D2, E2) (G1, H1); (K1, L1) (G2, H2); (K2, L2) Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 53: Replacing Dimms

    LEDs light amber to indicate a faulty DIMM. Step 1 Remove an existing DIMM: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 54: Replacing Cpus And Heatsinks

    • Front-loading NVME drives are unavailable (they require PCIe riser 2). Tools Required For CPU Replacement You need the following tools and equipment for this procedure: • T-30 Torx driver—Supplied with replacement CPU. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 55: Replacing A Cpu And Heatsink

    • Heatsink cleaning kit—Supplied with replacement CPU. Orderable separately as Cisco PID UCSX-HSCK=. • Thermal interface material (TIM)—Syringe supplied with replacement CPU. Use only if you are reusing your existing heatsink (new heatsinks have a pre-applied pad of TIM). Orderable separately as Cisco PID UCS-CPU-TIM=. See also...
  • Page 56 Place the heatsink with CPU assembly so that it is oriented upside-down as shown below. Note the thermal-interface material (TIM) breaker location. TIM BREAKER is stamped on the CPU carrier next to a small slot. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 57 On the remaining two corners of the CPU carrier, gently pry outward on the outer-latches and then lift the CPU-assembly from the heatsink. Note Handle the CPU-assembly by the plastic carrier only. Do not touch the CPU surface. Do not separate the CPU from the carrier. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 58 Angled corner on CPU assembly tool (pin 1 alignment feature) Step 4 Apply new TIM to the heatsink: Note The heatsink must have new TIM on the heatsink-to-CPU surface to ensure proper cooling and performance. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 59 Note the alignment features. The pin 1 angled corner on the heatsink must align with the pin 1 angled corner on the CPU socket. The CPU-socket posts must align with the guide-holes in the assembly. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 60 CPU socket lie flat. e) Replace the top cover to the server. f) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 61: Additional Cpu-Related Parts To Order With Rma Replacement Cpus

    Additional CPU-Related Parts to Order with RMA Replacement System Chassis When a return material authorization (RMA) of the system chassis is done on a Cisco APIC M3 or L3 server, you move existing CPUs to the new chassis.

  • Page 62: Moving An M5 Generation Cpu

    4, 3, 2, 1. b) Lift straight up on the CPU/heatsink assembly to remove it from the board. c) Set the CPUs with heatsinks aside on an anti-static surface. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 63 Remove the socket covers from the replacement system. Grasp the two recessed finger-grip areas marked "REMOVE" and lift straight up. Keep a firm grasp on the finger-grip areas at both ends of the cover. Do not make contact with the CPU Note socket pins. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 64 Press until you feel and hear a click. Note You must press until you feel and hear a click to ensure that the dust covers do not come loose during shipping. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 65 Note the alignment features. The pin 1 angled corner on the heatsink must align with the pin 1 angled corner on the CPU socket. The CPU-socket posts must align with the guide-holes in the assembly. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 66: Replacing A Mini-Storage Module

    CPU socket lie flat. Replacing a Mini-Storage Module The mini-storage module plugs into a motherboard socket to provide additional internal storage. The module is available in two different versions: Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 67: Replacing A Mini-Storage Module Carrier

    Push down on the carrier so that the securing clips click over it at both ends. Step 6 Replace the top cover to the server. Step 7 Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 68: Replacing An Sd Card In A Mini-Storage Carrier For Sd

    • You can use one or two SD cards in the carrier. • Dual SD cards can be configured in a RAID 1 array through the Cisco IMC interface. • SD slot 1 is on the top side of the carrier; SD slot 2 is on the underside of the carrier (the same side as the carrier's motherboard connector).

  • Page 69: Replacing An M.2 Ssd In A Mini-Storage Carrier For M.2

    Install the mini-storage module carrier back into the server and then power it on as described in Replacing a Mini-Storage Module Carrier, on page Replacing a Micro SD Card There is one socket for a Micro SD card on the top of PCIe riser 1. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 70 Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Figure 30: Internal Micro SD Card Socket Location of Micro SD card socket on the top Plastic retainer (push aside to access socket) of PCIe riser 1 Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 71: Replacing An Internal Usb Drive

    Push the USB drive horizontally to fully engage it with the socket. c) Replace the top cover to the server. d) Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 72: Enabling Or Disabling The Internal Usb Port

    On the USB Configuration page, select USB Ports Configuration. Step 5 Scroll to USB Port: Internal, press Enter, and then choose either Enabled or Disabled from the dialog box. Step 6 Press F10 to save and exit the utility. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 73: Replacing The Rtc Battery

    The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The battery type is CR2032. Cisco supports the industry-standard CR2032 battery, which can be ordered from Cisco (PID N20-MBLIBATT) or purchased from most electronic stores.

  • Page 74: Replacing Power Supplies

    Do not mix power supply types or wattages in the server. Both power supplies must be identical. Step 1 Remove the power supply that you are replacing or a blank panel from an empty bay: a) Perform one of the following actions: Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 75: Replacing A Pcie Card

    Replacing a PCIe Card Note Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular card occurs.

  • Page 76: Replacing A Pcie Card

    Note Riser 1/Slot 1 is not available in single-CPU configurations. Replacing a PCIe Card Note If you are installing a Cisco Virtual Interface Card, there are prerequisite considerations. See Cisco Virtual Interface Card (VIC) Considerations, on page Note RAID controller cards install into a separate mRAID riser. See...
  • Page 77 Figure 35: PCIe Riser Assembly PCIe slot 1 rear-panel opening Hinged card retainer (one each slot) External riser handle PCIe connector for cable that supports front-panel NVMe SSDs Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 78: Cisco Virtual Interface Card (Vic) Considerations

    This section describes VIC card support and special considerations for this server. Note If you use the Cisco Card NIC mode, you must also make a VIC Slot setting that matches where your VIC is installed. The options are Riser1, Riser2, and Flex-LOM. See...

  • Page 79: Replacing An Mlom Card

    Push the card horizontally to fully engage the card's edge connector with the socket. c) Tighten the captive thumbscrew to secure the card to the standoff on the chassis floor. d) Return the mRAID riser to its socket. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 80: Replacing An Mraid Riser (Riser 3)

    Replacing an mRAID Riser (Riser 3) The server has a dedicated internal riser that is used for either a Cisco modular storage controller card (RAID or HBA) or the SATA interposer card for embedded software RAID. This riser plugs into a dedicated motherboard socket and provides a horizontal socket for the installed card.
  • Page 81 Step 4 Replace the top cover to the server. Step 5 Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 82: Replacing A Sas Storage Controller Card (Raid Or Hba)

    Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level. See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: Guides.

  • Page 83: Replacing A Sas Storage Controller Card (Raid Or Hba)

    Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Step 8 If your server is running in standalone mode, use the Cisco Host Upgrade Utility to update the controller firmware and program the correct suboem-id for the controller.

  • Page 84: Replacing The Supercap (Raid Backup)

    SKU. If you do not do this, drive enumeration might not display correctly in the software. This issue does not affect servers controlled in UCSM mode. See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: Guides.
  • Page 85 Connect the supercap cable from the RAID controller card to the connector on the new supercap cable. Step 4 Replace the top cover to the server. Step 5 Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 86: Replacing A Sata Interposer Card

    SATA interposer card that plugs into a horizontal socket on a dedicated mRAID riser (internal riser 3). Note You cannot use a hardware RAID controller card and the embedded software RAID controller at the same time. Step 1 Prepare the server for component installation: Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 87 Reconnect the cables to their connectors on the new card. Step 7 Replace the top cover to the server. Step 8 Replace the server in the rack, replace cables, and then fully power on the server by pressing the Power button. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 88: Replacing A Chassis Intrusion Switch

    Use a #1 Phillips-head screwdriver to loosen and remove the single screw that holds the switch mechanism to the chassis wall. c) Slide the switch mechanism straight up to disengage it from the clips on the chassis. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 89: Installing A Trusted Platform Module (Tpm)

    • If there is an existing TPM 1.2 installed in the server, you cannot upgrade to TPM 2.0. If there is no existing TPM in the server, you can install TPM 2.0. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 90: Installing And Enabling A Tpm

    Install the single one-way screw that secures the TPM to the motherboard. e) If you removed the PCIe riser assembly to provide clearance, return it to the server now. Step 4 Replace the cover to the server. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 91 Press F10 to save your settings and reboot the server. Step 2 Verify that TPM support is now enabled: a) Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 92 Return to the Intel TXT(LT-SX) Hardware Support window if you are not already there. b) Set TXT Support to Enabled. Step 5 Press F10 to save your changes and exit the BIOS Setup utility. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 93: Service Headers And Jumpers

    J39 pin 1 arrow printed on motherboard Clear CMOS: J38 pins 9 - 10 Boot Cisco IMC from alternate image: J39 pins 1 - Recover BIOS: J38 pins 11 - 12 Reset Cisco IMC password to default: J39 pins 3 -...

  • Page 94: Using The Clear Cmos Header (J38, Pins 9 - 10)

    • If the BIOS BootBlock is corrupted, you might see the system get stuck on the following message: Initializing and configuring memory/hardware • If it is a non-BootBlock corruption, a message similar to the following is displayed: Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 95: Procedure 1: Reboot With Recovery.cap File

    During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Note Do not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete. Procedure 2: Use BIOS Recovery Header and bios.cap Recovery File Step 1 Download the BIOS update package and extract it to a temporary location.

  • Page 96: Using The Clear Password Header (J38, Pins 13 - 14)

    During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete. Step 12 After the server has fully booted, power off the server again and disconnect all power cords.

  • Page 97: Using The Boot Alternate Cisco Imc Image Header (J39, Pins 1 - 2)

    Remove the top cover from the server. Step 10 Remove the jumper that you installed. If you do not remove the jumper, the server will boot from an alternate Cisco IMC image every time that you Note power cycle the server or reboot Cisco IMC.

  • Page 98: Using The Reset Cisco Imc Password To Default Header (J39, Pins 3 - 4)

    Remove the jumper that you installed. Note If you do not remove the jumper, the server will reset the Cisco IMC password to the default every time that you power cycle the server. The jumper has no effect if you reboot Cisco IMC.
  • Page 99 Step 10 Remove the jumper that you installed. If you do not remove the jumper, the server will reset the Cisco IMC to the default settiings every time that Note you power cycle the server. The jumper has no effect if you reboot Cisco IMC.
  • Page 100 Maintaining the Server Using the Reset Cisco IMC to Defaults Header (J39, Pins 5 - 6) Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 101: Appendix A Server Specifications

    Server with slide rail: 31.0 in (787.4 mm) Weight Maximum: 37.5 lb. (17.0 Kg) Minimum: 29.0 lb. (13.2 Kg) Environmental Specifications The following table lists the environmental requirements and specifications for the server. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 102: Power Specifications

    Power Specifications Note Do not mix power supply types or wattages in the server. Both power supplies must be identical. You can get more specific power information for your exact server configuration by using the Cisco UCS Power Calculator: http://ucspowercalc.cisco.com The power specifications for the supported power supply options are listed in the following sections.

  • Page 103: 1050 W Dc Power Supply

    Climate Savers Platinum Efficiency (80Plus Platinum certified) Form factor RSP2 Input connector IEC320 C14 1050 W DC Power Supply This section lists the specifications for each 1050 W DC power supply (Cisco part number UCSC-PSUV2-1050DC). Table 12: 1050 W DC Specifications Description Specification DC Input Voltage...

  • Page 104: Power Cord Specifications

    AC power cord, 10 A; C13 to C14, recessed receptacle CAB-250V-10A-AR AC power cord, 250 V, 10 A Argentina CAB-C13-C14-2M-JP AC Power Cord, C13 to C14 Japan PSE Mark CAB-9K10A-EU AC Power Cord, 250 V, 10 A; CEE 7/7 Plug Europe Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 105 AC power cord, 200/240 V, 6 A, North America CAB-250V-10A-ID AC power Cord, 250 V, 10 A, India CAB-9K10A-SW AC power cord, 250 V, 10 A, MP232 plug Switzerland CAB-250V-10A-BR AC power Cord, 250 V, 10 A Brazil Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 106 AC power cord, NEMA L6-20 to C13 connectors CAB-9K10A-IT AC power cord, 250 V, 10 A, CEI 23-16/VII plug Italy R2XX-DMYMPWRCORD No power cord; PID option for ordering server with no power cord Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 107: Storage Controller Considerations

    Supported Storage Controllers and Cables, on page 99 • Storage Controller Card Firmware Compatibility, on page 100 • Write-Cache Policy for Cisco 12G SAS Modular RAID Controller, on page 101 • Mixing Drive Types in RAID Groups, on page 101 •...

  • Page 108: Storage Controller Card Firmware Compatibility

    Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level. See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: Guides.

  • Page 109: Write-Cache Policy For Cisco 12G Sas Modular Raid Controller

    For servers running in standalone mode only: After you replace controller hardware (APIC-RAID-M5), you must run the Cisco Host Upgrade Utility (HUU) to update the controller firmware, even if the firmware Current Version is the same as the Update Version. This is necessary to program the controller's suboem-id to the correct value for the server SKU.

  • Page 110: Raid Controller Migration

    This section describes cabling connections for the storage controllers and the backplane. The SAS/SATA cables are factory-installed and are used for all supported internal controllers in the SFF 10-drive (APIC-SERVER-M3 and APIC-SERVER-L3) servers. This section also contains diagrams that show the cable-to-drive mapping. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 111 2. Connect SAS/SATA cable A2 from the A2 card connector to the A2 backplane connector. 3. For SFF-10-drive servers only: Connect SAS/SATA cable B2 from the B2 card connector to the B2 backplane connector. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 112: Embedded Sata Raid Controller

    • Interposer card UCSC-SATAIN-220M5. This must be installed in internal mRAID riser 3. • The SAS/SATA cables that are preinstalled in the chassis. • Primary controller: SATA drives only (up to eight, in front drive bays 1–8). Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 113: Embedded Sata Raid Controller Considerations

    Embedded SATA RAID: Two SATA Controllers The embedded RAID platform controller hub (PCH) is split into two controllers: primary SATA (pSATA) and secondary SATA (sSATA). These two controllers are seen as separate RAID controllers in the Cisco IMC interface and are configurable separately.

  • Page 114: Enabling Sata Mode For The Embedded Controllers

    M.2 drive is installed in the mini-storage module. • AHCI—Enable control of the internal SATA M.2 drives by AHCI through your OS rather than the embedded RAID controller. • Disabled—Disable the embedded sSATA RAID controller. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 115: Accessing The Software Raid Configuration Utility

    Click UCS C-Series Rack-Mount Standalone Server Software in the right-hand column. d) Click your model of server in the right-hand column. e) Click Unified Computing System (UCS) Drivers. f) Click the release number that you are downloading. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 116: Microsoft Windows Server Drivers

    • To install from local media, connect an external USB DVD drive to the server and then insert the first Windows installation disk into the drive. Skip to Step 6. • To install from remote ISO, log in to the server’s Cisco IMC interface and continue with the next step. Step 4 Launch a Virtual KVM console window and click the Virtual Media tab.

  • Page 117: Linux Drivers

    MegaRAID stack. Note The LSI MegaSR drivers that Cisco provides for RHEL and SLES are for the original GA versions of those distributions. The drivers do not support updates to those OS kernels. Preparing Physical Thumb Drive for Linux This topic describes how to prepare physical Linux thumb drive from the driver image files.
  • Page 118 Storage Controller Considerations Installing the Red Hat Enterprise Linux Driver Step 1 Download the Cisco UCS C-Series drivers ISO, as described in Downloading the MegaSR Drivers, on page 107 and save it to your Linux system. Step 2 Extract the dud.img file: a) Burn the ISO image to a disc.
  • Page 119 • To install from local media, connect an external USB DVD drive to the server and then insert the first RHEL installation disk into the drive. Then continue with Step 6. • To install from remote ISO, log in to the server’s Cisco IMC interface. Then continue with the next step. Step 4 Launch a Virtual KVM console window and click the Virtual Media tab.
  • Page 120 • To install from local media, connect an external USB DVD drive to the server and then insert the first SLES installation disk into the drive. Then continue with Step 6. • To install from remote ISO, log in to the server’s Cisco IMC interface. Then continue with the next step. Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 121: For More Raid Utility Information

    12Gb/s MegaRAID SAS Software User Guide, Version 2.8 • For embedded software MegaRAID and the utility that is accessed via the server BIOS (refer to Chapter 4)—Broadcom Embedded MegaRAID Software User Guide, March 2018. Cisco APIC M3/L3 Server Installation and Service Guide...
  • Page 122 Storage Controller Considerations For More RAID Utility Information Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 123: Gpu Card Installation

    • Do not mix different brands or models of GPU cards in the server. Requirement For All GPUs: Memory-Mapped I/O Greater Than 4 GB All supported GPU cards require enablement of the BIOS setting that allows greater than 4 GB of memory-mapped I/O (MMIO). Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 124: Replacing A Single-Wide Gpu Card

    If you need to change this setting, enter the BIOS Setup Utility by pressing F2 when prompted during bootup. • If the server is integrated with Cisco UCS Manager and is controlled by a service profile, this setting is enabled by default in the service profile when a GPU is present.
  • Page 125 Figure 47: PCIe Riser Assembly PCIe slot 1 rear-panel opening Hinged card retainer (one each slot) External riser handle PCIe connector for cable that supports front-panel NVMe SSDs PCIe slot 2 rear-panel opening Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 126: Installing Drivers To Support The Gpu Cards

    1. Update the server BIOS. 2. Update the GPU drivers. 1. Updating the Server BIOS Install the latest Cisco UCS C240 M4 server BIOS by using the Host Upgrade Utility for the Cisco UCS C240 M4 server. Note You must do this procedure before you update the NVIDIA drivers.

  • Page 127: Updating The Gpu Card Drivers

    Navigate to the following URL: http://www.cisco.com/cisco/software/navigator.html. Step 2 Click Servers–Unified Computing in the middle column. Step 3 Click Cisco UCS C-Series Rack-Mount Standalone Server Software in the right-hand column. Step 4 Click the name of your model of server in the right-hand column. Step 5 Click Unified Computing System (UCS) Server Firmware.
  • Page 128 GPU Card Installation 2. Updating the GPU Card Drivers Cisco APIC M3/L3 Server Installation and Service Guide...

  • Page 129: Installation For Cisco Ucs Manager Integration

    Refer to the guide that is for the version of Cisco UCS Manager that you are using. Also refer to the release notes for Cisco UCS Manager software and C-Series Cisco IMC software for any special considerations regarding integration in your release.
  • Page 130 Installation For Cisco UCS Manager Integration Installation For Cisco UCS Manager Integration Cisco APIC M3/L3 Server Installation and Service Guide...

This manual is also suitable for:

Apic l3

Table of Contents