Supermicro AOC-MHIBF-m2Q2G User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Controller
  5. AOC-MHIBF-m2Q2G
  6. User manual

Supermicro AOC-MHIBF-m2Q2G User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
AOC-MHIBF-m2Q2G
AOC-MHIBF-m1Q2G
User's Guide
Revision 1.0b

Advertisement

Table of Contents
loading

Related Manuals for Supermicro AOC-MHIBF-m2Q2G

Summary of Contents for Supermicro AOC-MHIBF-m2Q2G

  • Page 1 AOC-MHIBF-m2Q2G AOC-MHIBF-m1Q2G User's Guide Revision 1.0b...
  • Page 2 For more information, go to www.P65Warnings.ca.gov. The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage.
  • Page 3 The AOC-MHIBF-m2Q2G and AOC-MHIBF-m1Q2G are the most powerful Infini- Band controllers in the market. In the small form factor SIOM, available as part of an integrated solution with Supermicro servers, they provide both InfiniBand FDR 56Gbps and 40Gbps Ethernet as well as remote server management through a dedicated Gigabit LAN controller.
  • Page 4 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Conventions Used in the User's Guide Pay special attention to the following symbols for proper system installation and to prevent damage to the system or injury to yourself: Note: Additional information given to provide information for correct sys- tem setup.
  • Page 5 Preface Confidential Supermicro Networking Adapter List Dimension Power Model Type Form Factor Interface Controller Connection (w/o Brackets) (L x H) AOC-SGP-i2 Standard LP PCI-E x4 Intel® i350 AM2 2 RJ45 (1Gb/port) 3.9” (99mm) x 2.73” (69mm) AOC-SGP-i4 Standard LP PCI-E x4 Intel®...
  • Page 6 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 7: Table Of Contents

    Table of Contents Table of Contents Preface Chapter 1 Overview Overview ......................1-1 Key Features ....................1-1 Specifications ....................1-1 Available SKUs ....................1-7 Similar Products ....................1-7 Optional Accessories ..................1-8 Chapter 2 Hardware Components Add-On Card Image and Layout ..............2-1 Major Components ..................

  • Page 8: Chapter 1 Overview

    Overview Congratulations on purchasing your add-on card from an acknowledged leader in the industry. Supermicro products are designed with the utmost attention to detail to provide you with the highest standards in quality and performance. For product support and updates, please refer to our website at http://www.supermicro.com/ products/nfo/networking.cfm#adapter.
  • Page 9 • Supermicro® motherboards with Super I/O Module (SIOM) slot • Supermicro® server systems with Super I/O Module slot (see SIOM Compat- ibility Matrix online at http://www.supermicro.com/support/resources/AOC/ AOC_Compatibility_SIOM.cfm) Note: This product is sold only as part of an integrated solution with...
  • Page 10 Chapter 1: Overview InfiniBand FDR QSFP Specifications Connectivity • Interoperable with InfiniBand or 40GbE switches • Passive copper cable with ESD protection InfiniBand • IBTA specification 1.2.1 compliant • Hardware-based congestion control • 256 to 4K byte MTU, 2GB messages Enhanced InfiniBand •...
  • Page 11 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Hardware-based I/O Virtualization • Single root IOV • Address translation and protection • Dedicated adapter resources • Multiple queues per virtual machine • Enhanced QoS for vNICs • VMware NetQueue support Overlay Networks • VXLAN and NVGRE Additional CPU Offloads •...
  • Page 12 Jumbo frames support Performance and Efficiency Features • Energy Efficient Ethernet (EEE) • TCP/UDP, IPv4, and IPv6 checksum offloads to improve CPU usage • Low latency interrupts Management Features • Asset Management support on Supermicro® platforms • Preboot eXecution Environment (PXE) support...
  • Page 13 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide • iSCSI remote boot support • NC-SI for remote management via Intel® i350 GbE RJ45 connector Operating System Support • Windows Server 2012 R2, 2012, 2008 R2 (x64 Edition) • Windows 8.1, 8, 7 (x64 Edition) •...

  • Page 14: Available Skus

    Chapter 1: Overview Available SKUs SKUs Bracket Included Description AOC-MHIBF-m2Q2G 2-port InfiniBand FDR Adapter with a swappable bracket for BKT-0122L 2U+ chassis (Storage Servers) AOC-MHIBF-m2Q2GM 2-port InfiniBand FDR Adapter with an internal bracket for 1U BKT-0118L chassis (Twin Servers) AOC-MHIBF-m1Q2G...

  • Page 15: Optional Accessories

    AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Optional Accessories Product Part Number Part Number Description QSFP Copper Cable CBL-0490L 1M QSFP to QSFP InfiniBand FDR 56Gb/s Passive Copper, PBF, 30AWG QSFP Copper Cable CBL-NTWK-0642 2M QSFP to QSFP InfiniBand FDR 56Gb/s Passive Copper, PBF, 30AWG...

  • Page 16: Chapter 2 Hardware Components

    Chapter 2: Hardware Components Chapter 2 Hardware Components Add-On Card Image and Layout The AOC-MHIBF-m1Q2G Image LED1 QSFP1 LAN2 LAN1 JPL1 Intel® i350 AOC-MHIBF-m1Q2G AOC-MHIBF-m1Q2G REV:1.00 REV:1.00 Mellanox® DESIGNED IN USA DESIGNED IN USA ConnectX®-3 Pro The AOC-MHIBF-m1Q2G Layout The AOC-MHIBF-m1Q2G Layout (Top View) (Bottom View) 1.
  • Page 17 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide The AOC-MHIBF-m2Q2G Image LED1 LED2 QSFP2 QSFP1 LAN2 LAN1 JPL1 Intel® i350 AOC-MHIBF-m2Q2G AOC-MHIBF-m2Q2G REV:1.00 REV:1.00 Mellanox® DESIGNED IN USA DESIGNED IN USA ConnectX®-3 Pro The AOC-MHIBF-m2Q2G Layout The AOC-MHIBF-m2Q2G Layout (Top View) (Bottom View) 1.

  • Page 18: Major Components

    4. Single QSFP (Small Form Factor Pluggable) port 5. JPL1: RJ45 LAN ports Enable/Disable 6. LED1: QSFP Link LED The following major components are installed on the AOC-MHIBF-m2Q2G: 1. Intel® i350 2. Mellanox® ConnectX-3 Pro 3. Dual RJ45 LAN ports 4.

  • Page 19: Qsfp Ethernet Connections And Led Indicators

    QSFP Ports A single QSFP port is located on the AOC-MHIBF-m1Q2G. Two QSFP ports are located on the AOC-MHIBF-m2Q2G. Connect a QSFP cable to the port to provide Infiniband (56Gb/s) and Ethernet (40Gbp/s) communication. See the layout below for the locations.
  • Page 20 Chapter 2: Hardware Components QSFP PCB LEDs On the back of the AOC-MHIBF-m2Q2G/m1Q2G, two LEDs are on the AOC-MHIBF- m2Q2G, and one LED is on the AOC-MHIBF-m1Q2G. A solid green LED indicates the link-up connection. Refer to the layout below for the locations.

  • Page 21: Rj45 Lan Ports And Lan Led Indicators

    RJ45 LAN Ports and LAN LED indicators RJ45 LAN Ports (LAN1/LAN2) There are two RJ45 LAN ports (LAN1/LAN2) on the AOC-MHIBF-m2Q2G/m1Q2G. These LAN ports support connection speeds of 1Gbps. Use a direct-attach RJ45 type LAN cable. See the layout below for the locations.

  • Page 22: Rj45 Lan Ports Enable/Disable

    The default setting is Enabled. RJ45 LAN Ports Enable/Disable Jumper Settings Jumper setting Definition Enabled Pins 1-2 Pins 2-3 Disabled 1. JPL1 QSFP2 QSFP1 LAN2 LAN1 JPL1 Intel® i350 AOC-MHIBF-m2Q2G REV:1.00 Mellanox® DESIGNED IN USA ConnectX®-3 Pro...

  • Page 23: Chapter 3 Installation

    Chapter 3: Installation Chapter 3 Installation Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam- aging your add-on card, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD. Precautions •...

  • Page 24: Before Installation

    AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Before Installation Before you install the add-on card, follow the instructions below. 1. Power down the system. 2. Unplug the power cord. 3. Use industry-standard anti-static equipment such as gloves or a wrist strap and follow the precautions on page 3-1 to avoid damage caused by ESD.
  • Page 25 SKU. It needs to be installed onto the chassis. Insert the SIOM card into the motherboard Tighten the screw Install the bracket onto the chassis Install the motherboard in the chassis Note: Supermicro recommends that this SIOIM card be installed by a system integrator or by the manufacturer.
  • Page 26 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide Follow the steps below to install the add-on card into your system that supports a swappable bracket. The add-on card must be installed in the swappable bracket before it can be installed in the your system 1.

  • Page 27: Installing Drivers On Windows (For Intel® I350)

    Supermicro site at https://www.supermicro.com/wftp/ Networking_Drivers/. 1. Run CDR-NIC. 2. When the SUPERMICRO window appears, click on the computer icon next to the product model. Note: If the FOUND NEW HARDWARE WIZARD screen displays on your system, click CANCEL.
  • Page 28 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide 2. Replace <filename.tar.gz> with the specific filename of the driver. Note: For the build to work properly, the current running kernel MUST match the version and configuration of the installed kernel sources. If you have just recompiled the kernel, reboot the system at this time.

  • Page 29: Installing Drivers On Freebsd (For Intel® I350)

    Chapter 3: Installation 5. Load the module: For kernel 2.6.x, use the modprobe command: modprobe ixgbe <parameter>=<value> For 2.6 kernels, the insmod command can be used if the full path to the driver module is specified. For example: insmod/lib/modules/[KERNEL_VERSION]/kernel/drivers/net/ ethernet/intel/ixgbe/ixgbe.ko In addition, when using 2.6-based kernels, make sure that older ixgbe drivers are removed from the kernel before loading the new module.
  • Page 30 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide 3. To install man page: cd ixgb-x.x.x gzip -c ixgb.4 > /usr/share/man/man4/ixgb.4.gz 4. To load the driver onto a running system, perform the following steps: cd ixgb-x.x.x make cd ixgb-x.x.x/src make load 5. To assign an IP address to the interface, enter the following: ifconfig ixgb<interface_num>...
  • Page 31 Chapter 3: Installation cp if_ixgb* /usr/src/sys/dev/ixgb cp ixgb* /usr/src/sys/dev/ixgb cp Makefile.kernel /usr/src/sys/modules/ixgb/Makefile Edit the /usr/src/sys/conf/files.i386 file, and add the following lines: dev/ixgb/ixgb_hw.c optional ixgb dev/ixgb/ixgb_ee.c optional ixgb dev/ixgb/if_ixgb.c optional ixgb Remove the following lines from the /usr/src/sys/conf/files.i386 file, if they exist: /dev/ixgb/if_ixgb_fx_hw.c optional ixgb /dev/ixgb/if_ixgb_phy.c optional ixgb Edit the kernel configuration file (i.e., GENERIC or MYKERNEL) in /usr/src/sys/...

  • Page 32: Installing Drivers (For Mellanox® Connectx®-3 Pro)

    Mellanox® support website for more driver installation information. Installing InfiniBand Drivers for the Linux Operating System 1. Download the driver from the Supermicro CDR-NIC LAN driver CD, the Mel- lanox® support website that contains the latest driver, or go to the Supermicro site at https://www.supermicro.com/wftp/Networking_Drivers/Mellanox/.

  • Page 33: Changing From Infiniband To Ethernet Mode

    Chapter 3: Installation Changing from InfiniBand to Ethernet mode AOC-MHIBF-m1Q2G and AOC-MHIBF-m2Q2G are by default set to InfiniBand mode. To change the setting to Ethernet mode, please follow the instructions below. 1. Double-check and make sure that the add-on card is detected. Run the Ispci...
  • Page 34 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide 3. To check whether the add-on card is set to Ethernet or InfiniBand mode and to verify if the LAN ports are active or not, run the following command: Ibv_devinfo [root@localhost ~]# ibv_devinfo hca_id: mlx4_0...
  • Page 35 Chapter 3: Installation 4. Use the command #mlxfwmanager to extract the "vendor_part id" parametar. [root@localhost ~]# mlxfwmanager Querying Mellanox devices firmware... Device#1: - - - - - - - Device Type: ConnectX3Pro Part Number: Super_Micro_AOC-MHIBF-m2Q2G Description: Hybrid SIOM 2-port IB FDR CX3-Pro PSID: SM_1171000001000 PCI Device Name: /dev/mst/mt4103_pci_cr0...
  • Page 36 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide 6. Reboot your computer and then the changes made will take effect. 7. Once the system is rebooted, you can use the following command to verify whether the LAN ports are changed to Ethernet mode or not:...

  • Page 37: Using Mellanox Controller For Pxe Boot

    Chapter 3: Installation Using Mellanox Controller for PXE Boot To use PXE boot, the Mellanox (QSFP) ports need to be configured as either Ethernet or InfiniBand mode depending on the previous setup. Please follow the instructions below to use PXE boot. 1.
  • Page 38 AOC-MHIBF-m2Q2G/m1Q2G Add-on Card User's Guide 4. Go to BIOS. From the top of the tool bar, select "Boot" to enter the submenu. Select "Network Drive BBS Priorities" and then select "FlexBoot v#.#.###..." under Boot Option #1. 5. To boot from PXE automatically, make sure Boot Option #1 is "Network: Flex boot"...

This manual is also suitable for:

Aoc-mhibf-m1q2g

Table of Contents