Advertisement

Quick Links

AOC-IBH-X6HS
User's Guide
Revision 1.0

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the AOC-IBH-X6HS and is the answer not in the manual?

Questions and answers

Summary of Contents for Supermicro AOC-IBH-X6HS

  • Page 1 AOC-IBH-X6HS User's Guide Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3: About This Add-On Card

    PC users. It provides information for the installation and use of the AOC-IBH-X6HS add-on card. About this Add-on Card This product is sold only as part of an integrated solution with Supermicro server systems. An Important Note to the User All images and layouts shown in this user's guide are based upon the latest PCB revision available at the time of publishing.
  • Page 4: Conventions Used In The User's Guide

    AOC-IBH-X6HS Add-on Card User's Guide Conventions Used in the User's Guide Pay special attention to the following symbols for proper system installation and to prevent damage to the system or injury to yourself: Note: Additional information given to differentiate between various models or provides information for correct system setup.
  • Page 5: Contacting Supermicro

    Preface Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 6: Table Of Contents

    AOC-IBH-X6HS Add-on Card User's Guide Table of Contents Preface About this User's Guide ....................iii About this Add-on Card ....................iii An Important Note to the User ..................iii Returning Merchandise for Service ................iii Conventions Used in the User's Guide .................iv Naming Convention .......................iv...
  • Page 7 Preface Unpacking ....................... 3-1 Before Installation ................... 3-2 Add-on Card Installation ................. 3-2 Installing Drivers on Windows ................. 3-4 Installing Drivers on Linux ................3-10 Build a Binary RPM Package................ 3-10 Installing Drivers on FreeBSD ..............3-12 Installing Drivers (for Mellanox ConnectX-6 VPI) ......... 3-14 Linux Drivers ....................
  • Page 8: Chapter 1 Overview

    Overview Congratulations on purchasing your add-on card from an acknowledged leader in the industry. Supermicro products are designed with the utmost attention to detail to provide you with the highest standards in quality and performance. For product support and updates, please refer to our website at https://www.supermicro.com/...
  • Page 9: Infiniband

    AOC-IBH-X6HS Add-on Card User's Guide InfiniBand • IBTA specification 1.3 compliant • RDMA, Send/Receive semantics • Hardware-based congestion control • 16 million I/O channels • 256 to 4Kbyte MTU, 2Gbyte messages • 8 virtual lanes + VL15 • HDR / HDR100 / EDR / FDR / QDR / DDR / SDR •...
  • Page 10: Enhanced Features

    Chapter 1: Overview • IEEE 802.1Qbg • IEEE 1588v2 • Jumbo frame support (9.6KB) Enhanced Features • Hardware-based reliable transport • Collective operations offloads • Vector collective operations offloads • Mellanox PeerDirectT RDMA communication acceleration • 64/66 encoding • Extended Reliable Connected transport (XRC) •...
  • Page 11: Cpu Offloads

    AOC-IBH-X6HS Add-on Card User's Guide CPU Offloads • RDMA over Converged Ethernet (RoCE) • TCP/UDP/IP stateless offload • LSO, LRO, checksum offload • Intelligent interrupt coalescence • RSS (also on encapsulated packet), TSS, HDS, VLAN and MPLS tag insertion/ stripping, Receive flow steering •...
  • Page 12: Hardware-Based I/O Features Virtualization

    Chapter 1: Overview Hardware-Based I/O Features Virtualization • Single root IOV • Address translation and protection • VMware NetQueue support Virtualization • SR-IOV: Up to 1K virtual functions • SR-IOV: Up to 8 physical functions per host • Virtualization hierarchies (e.g., NPAR) •...
  • Page 13: Remote Boot

    AOC-IBH-X6HS Add-on Card User's Guide Remote Boot • Remote boot over InfiniBand, Ethernet, and iSCSI • PXE and UEFI Management Features • NC-SI, MCTP over SMBus, and MCTP over PCIe - Baseboard Management Controller interface • PLDM for Monitor and Control DSP0248 •...
  • Page 14: Operating Conditions

    Card PCB dimensions: 75.1mm (2.95in) x 132mm (5.19in) x 2.31mm (0.09in) (W x L x D) Supported Platforms • Supermicro® SuperBlade motherboard with mezzanine slot Note: This product is sold only as part of an integrated solution with Supermicro blade systems. Available SKUs...
  • Page 15: Chapter 2 Hardware Components

    Chapter 2: Hardware Components Chapter 2 Hardware Components Add-On Card Image and Layout Figure 2-1. Image of AOC-IBH-X6HS Figure 2-2. Layout of AOC-IBH-X6HS 1. Mellanox ConnectX-6 VPI InfiniBand HDR 3. ExaMEZZ® Connector 2. Mounting Holes 4. Board to Board Connector...
  • Page 16: Major Components

    AOC-IBH-X6HS Add-on Card User's Guide Major Components The following major components are built-in on the AOC-IBH-X6HS: 1. One (1) Mellanox ConnectX-6 VPI InfiniBand HDR controller 2. Five (5) Mounting Holes 3. One (1) ExaMEZZ Connector 4. One (1) Board to Board Connector...
  • Page 17: Chapter 3 Installation

    Chapter 3: Installation Chapter 3 Installation Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam- aging your add-on card, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD. Precautions •...
  • Page 18: Before Installation

    AOC-IBH-X6HS Add-on Card User's Guide Before Installation Before you install the add-on card, follow the instructions below. 1. Use industry-standard anti-static equipment such as gloves or a wrist strap and follow the precautions on page 3-1 to avoid damage caused by ESD.
  • Page 19 Chapter 3: Installation Add-on card Figure 3-1. Installing the Add-on Card 3. Insert the screws into the add-on card's and motherboard’s mounting holes. 4. Secure the add-on card and motherboard to the chassis using the screws. Note: To avoid the motherboard being damaged, DO NOT overtighten the screws.
  • Page 20: Installing Drivers On Windows

    AOC-IBH-X6HS Add-on Card User's Guide Installing Drivers on Windows Follow the steps below to install the drivers for Windows. 1. Check for driver support at https://www.mellanox.com/support/firmware/winof_ matrix?mtag=windows_sw_drivers. 2. Visit the driver download website at https://www.mellanox.com/products/adapt- er-software/ethernet/windows/winof-2. 3. Save the file named MLNX_WinOF2-2_60_50000_All_x64.
  • Page 21 Chapter 3: Installation 4. Execute MLNX_WinOF2-2_60_50000_All_x64.exe.
  • Page 22 AOC-IBH-X6HS Add-on Card User's Guide 5. Follow the prompts to complete the installation.
  • Page 23 Chapter 3: Installation...
  • Page 24 AOC-IBH-X6HS Add-on Card User's Guide...
  • Page 25 Chapter 3: Installation...
  • Page 26: Installing Drivers On Linux

    AOC-IBH-X6HS Add-on Card User's Guide Installing Drivers on Linux Follow the steps below to install the drivers in Linux. Build a Binary RPM Package Run ‘rpmbuild -tb <filename.tar.gz>’ 2. Replace <filename.tar.gz> with the specific filename of the driver. Note: For the build to work properly, the current running kernel MUST match the version and configuration of the installed kernel sources.
  • Page 27 Chapter 3: Installation Note: IXGBE_NO_LRO is a compile time flag. The user can enable it at compile time to remove support for LRO from the driver. The flag is used by adding CFLAGS_EXTRA=-”DIXGBE_NO_LRO” to the make file when it’s being compiled. make CFLAGS_EXTRA=”-DIXGBE_NO_LRO”...
  • Page 28: Installing Drivers On Freebsd

    AOC-IBH-X6HS Add-on Card User's Guide Installing Drivers on FreeBSD Follow the instructions below to install the drivers in FreeBSD kernel 4.8 or later. In the instructions below, x.x.x is the driver version as indicated in the name of the drive tar file.
  • Page 29 Chapter 3: Installation 7. If you want the driver to load automatically when the system is booted: cd ixgb-x.x.x/src make load cp if_ixgb.ko /modules Edit /boot/loader.conf, and add the following line: if_ixgb_load="YES" compile the driver into the kernel (see item 8). Edit /etc/rc.conf, and create the appropriate ifconfig_ixgb<interface_num>...
  • Page 30: Installing Drivers (For Mellanox Connectx-6 Vpi)

    Use the following procedures to install drivers on the Linux operating system. Installing InfiniBand Drivers for the Linux Operating System 1. Download the driver from the Supermicro CDR-NIC LAN driver CD, the Mella- nox® Support website that contains the latest driver, or go to the Supermicro site at https://www.supermicro.com/wftp/Networking_Drivers/Mellanox/.
  • Page 31: Using The Mellanox Controller For Pxe Boot

    Chapter 3: Installation Using the Mellanox Controller for PXE Boot Please follow the instructions below to use PXE boot. 1. Boot up the system and wait for the FlexBoot v3.6.101 Message to appear. 2. Press CTRL+B to enter the System setup page. When it appears, select "net0: Port1".
  • Page 32 AOC-IBH-X6HS Add-on Card User's Guide 4. Select "PXE" under "Legacy boot protocol", then press CTRL+S to save the setting. (To use PXE in InfiniBand mode, InfiniBand needs to be selected under "VPI link type".) 5. Go to BIOS. From the top of the tool bar, select "Boot" to enter the submenu.
  • Page 33 Chapter 3: Installation 6. To boot from PXE automatically, make sure Boot Option #1 is "Network: Flex boot" as the image shown below. 3-17...

This manual is also suitable for:

Aoc-ibh-x4es

Table of Contents