Table of Contents

Advertisement

Quick Links

EB4400 8-SLOT GEN4
INSTALLATION GUIDE
EB4400 8-SLOT Gen4
www.onestopsystems.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the EB4400 8-SLOT GEN4 and is the answer not in the manual?

Questions and answers

Summary of Contents for OSS EB4400 8-SLOT GEN4

  • Page 1 EB4400 8-SLOT GEN4 INSTALLATION GUIDE EB4400 8-SLOT Gen4 www.onestopsystems.com...
  • Page 2: Table Of Contents

    One Stop Systems Table of Contents Introduction ................................... 5 General Specifications ....................................5 Features ........................................6 EB4400 Architecture (8 Slot) ..................................6 PCIe Slots ........................................6 Backplane Block Diagram ..................................7 Dimensions........................................ 8 Parts Overview ......................................9 HIB x16 Gen 4 Card ....................................11 Backplane ........................................
  • Page 3 One Stop Systems Connect Power Cord(s) ................................... 29 Powering UP the Host ..............................31 Hardware Check ................................32 Verify Board LEDs ....................................32 Fault LEDs (RED) ...................................... 33 Verify Adapter Card LEDs ..................................34 Adapter Card LED Definitions .................................. 35 Slot LEDs ........................................35 Power Distribution Board LED .................................
  • Page 4 My PCIe devices are showing UP with a Yellow Exclamation mark ....................65 15.3 No link between host and target cards .............................. 65 15.4 Broken OSS-Backplane ..................................65 15.5 My PCIe cards are not detected ................................. 65 15.6 Windows Error Codes ..................................66 15.7...
  • Page 5: Introduction

    Host Options 1x PCIe4 x16 Host-to-Target 2x PCIe4 x16 Host-to-Target SmartNIC Host uplink (32 GB/s) uplinks (64 GB/s) Backplane Options OSS-538:  1x single-width PCIe 4.0 x16 FHFL upstream slot  4x dual-width PCIe 4.0 x16 FHFL downstream slots OSS-521: ...
  • Page 6: Features

    One Stop Systems Features  PCIe Gen4 architecture  Small, rugged frame design  Dynamic fan speed control  Configurable slot and host uplinks to optimize throughput  Integrated IPMI based systems monitoring  AC and DC power inlet options EB4400 Architecture (8 Slot) PCIe Slots Slot Type: Closed-ended PCIe slot / connector, all the slots are x16 mechanical.
  • Page 7: Backplane Block Diagram

    One Stop Systems Backplane Block Diagram EB4400 (8SLOT BP)
  • Page 8: Dimensions

    One Stop Systems Dimensions EB4400 (8SLOT BP)
  • Page 9: Parts Overview

    One Stop Systems Parts Overview Number Description Number Description Number Description EB4400 (8SLOT BP)
  • Page 10 One Stop Systems Number Description EB4400 (8SLOT BP)
  • Page 11: Hib X16 Gen 4 Card

    One Stop Systems HIB x16 Gen 4 Card x4 cable Ports There are four x4 cable ports /connectors available on the HIB Gen4 card. Port #0 is located nearest to the Link LED.  A single x4 SFF-8644 cable must be inserted into port#0 of the Target card. ...
  • Page 12: Backplane

    One Stop Systems Backplane Item Name Description 12V Input Power 12V input power for the 538 board. Not to be used for external GPU aux ARF 6 Top Connectors For connecting ARC 6 cables between ”Option slot” and PEX switch I2C and temp sensors interface Connector for I2C and temp sensors interface to the power backplane Ethernet port...
  • Page 13: Slot Configurations

    One Stop Systems 1.10 Slot Configurations Configuration# 1: Default slot configuration. One Upstream slot and eight Downstream slots.  ARC6 cables are attached between the edge of the board and the slot connectors under the backplane. NOTE: Without the ARC6 cables nothing will work in SLOT 8. Configuration# 2: Two Upstream slots (Slot 0 and SLOT 8) with two partitions.
  • Page 14: Use Case Diagrams

    Configuration 1 The OSS-521 backplane is linked to a single host computer.  Four x4 link cables are connected between OSS Gen4 Host card and Target card. 8 Downstream slots  6 x8 slots (Slot 1, 2, 3, 4, 5 and 6) ...
  • Page 15: Main Components

    1.12 Main Components The EB4400 unit is composed of following major components 8-slot Backplanes (OSS-521) One or Two Target Cards : PCIe 4.0 x16 One or Two Host Cards: PCIe 4.0 x16 (Installed in the host systems) Four or eight SFF-8644 PCIe Gen4 PCIe Cables...
  • Page 16: Getting Started

    Power ON the host computer. Check the hardware by verifying all LED status indicators. Boards LED Target & Host cards Unit front power LED Power supplies LED Check the OSS devices via operating system, verifying all OSS devices are properly recognized. EB4400 (8SLOT BP)
  • Page 17: Hardware Set-Up / Installation

    One Stop Systems Hardware Set-up / Installation The following steps will guide you through the installation of your One Stop Systems expansion system. Remove Top Cover Remove the two (2) mounting screws on top of the chassis. Slide the enclosure cover towards the back of the unit to disengage it from the guides and then lift the cover off.
  • Page 18: Install Host Card

    One Stop Systems Once the dipswitches are set correctly, plug in the target card, make sure it is fully seated in the PCie slot. Install Host Card  Before installation, you must check the switches on the Host card.  By default, all the switches on the Host card are set to OFF position (“Auto-Negotiation”...
  • Page 19 One Stop Systems x4 Dip switch Settings:  SW1 #2 = ON; #5 = ON  SW2 = All OFF Once the Host-card is configured, install the card into a x16 Gen4 PCIe slot on a computer motherboard.  Check the PCIe slot for any foreign debris as this can damage the card during installation. ...
  • Page 20: Dip Switch Settings

    One Stop Systems Dip switch Settings EB4400 (8SLOT BP)
  • Page 21: Pcie Cards Installation

    IMPORTANT: You need the ARC6 cables attached between the edge of the board and the slot connectors under the backplane. Without those cables nothing will work in slot 8. For more information on the option slot configuration, you can download the installation guide from the OSS support website.
  • Page 22: Before You Begin

    One Stop Systems Before you begin The EB4400 unit can accommodate standard full length PCIe cards and either single-width or dual-width GPUs.  When installing multiple double-width GPUs, begin placing the GPU in the far right end of the backplane (looking from the rear). ...
  • Page 23: Connect Aux Power Cables

    Use the supplied compatible auxiliary power cable for your GPU or PCIe card.  Photos below is an example of an auxilirary power cable available from OSS for purchase. Plug in the auxiliary cable to the GPU. EB4400 (8SLOT BP)
  • Page 24 One Stop Systems Plug in the other end of the auxiliary cable to any of the available auxiliary power connectors on the power distribution board (see photo below). Photo below shows the GPU auxiliary power cable connected to the auxiliary power distribution board. Reinstall the air-baffle and card hold-down top bracket when done installing the GPU / PCIe cards.
  • Page 25: Connect Link Cables

    One Stop Systems Connect Link Cables Use Gen4 Cables Mini-SAS HD SFF-8644 Cable Installation Connect all the appropriate PCIe link cables needed for the system.  When the host card is configured to operate at x16 mode, connect all four link cables ...
  • Page 26: X8 Configuration: Two Cables

    One Stop Systems 6.1.2 x8 Configuration: TWO cables Note: Make sure the HIB616-x16 host card is manually set to x8 configuration; see the x8 switch setting section for more details  Plug-in the 1 cable to Port#0 (Top port) on both Target and Host cards ...
  • Page 27: X4 Configuration: One Cable

    One Stop Systems 6.1.3 x4 Configuration: ONE cable  Plug-in the single cable to Port # 0 (Top port) on both Target and Host cards On the Host card side, you can use any ports. The other end of the cable stays connected on Target card PORT # 0. Photo A1: Cable stays connected on the Target card PORT # 0.
  • Page 28: Disconnecting Mini-Sas Hd Sff-8644 Cable

    One Stop Systems Diagrams below are different x4 cable configurations. Disconnecting Mini-SAS HD SFF-8644 Cable To disconnect the link cable, pull back the PLASTIC thumb tab to release metal clamp while slowly pulling the cable out. EB4400 (8SLOT BP)
  • Page 29: Applying Power Correctly

    If you are using a 250V power cord, you would need to connect that to a PDU (power distribution unit). You can buy the PDU on any online electronic stores. OSS does not sell the PDU. Connect Power Cord(s) Connect the supplied power cord to the back of the power supply.
  • Page 30 If Power LED indicator is showing “Amber” in color, it indicates a fault or power issue. The two front LEDs , the OSS logo will illuminate as blue and the “STANDBY”(MAIN PWR) will come ON as “solid-green”. EB4400 (8SLOT BP)
  • Page 31: Powering Up The Host

    One Stop Systems Powering UP the Host Before powering UP or turning ON the Host computer, make sure the Host adapter card is seated properly in a x16 Gen3 / Gen4 PCIe slot and the cables are firmly connected. Upon powering up the Host computer, it will initialize a link between the target and the host. The Link LED on both target and host cards will illuminate as solid green.
  • Page 32: Hardware Check

    One Stop Systems Hardware Check Verify Board LEDs Check the Target SLOT LED, when a PCIe card is installed in the target slot, the LED will illuminate as solid green. A fully operational back plane will illuminate the following LEDs. Check LEDs D19, D18 and D16, make sure they are correctly illuminated. ...
  • Page 33: Fault Leds (Red)

    One Stop Systems Fault LEDs (RED) A solid RED led on the backplane signifies a fault or an error. Below photos are list of RED LED locations and definitions. EB4400 (8SLOT BP)
  • Page 34: Verify Adapter Card Leds

    One Stop Systems Verify Adapter Card LEDs A working HIB adapter cards will illuminate the following LEDs (on both Host and Target cards). CE( Card edge) Solid green PWR (Power) Blinking green LED 0 Solid green LED1 Solid green LED2 Solid green LED3 Solid green...
  • Page 35: Adapter Card Led Definitions

    One Stop Systems Adapter Card LED Definitions LEDs for SFF-8644 Cable Link cases: Target mode (x16): D1 is the link indicator Host Mode, x16: D1 is the link indicator Host Mode, x8x8: D1 or D5 are the link indicators (one for each corresponding group of two SFF cages) Host Mode, x4x4x4x4: D1, D3, D5, D7 are the link indictors (one for each SFF cage) Slot LEDs ...
  • Page 36: Power Distribution Board Led

    One Stop Systems Power Distribution Board LED  When the PSU DC GOOD led is not illuminated, it is an indication of a faulty power supply and the unit will not power ON.  Solid green- the PSU is working properly. See photos below for the location of the “PSU DC GOOD”...
  • Page 37: Power Supply Led Indicator

    One Stop Systems Power Supply LED Indicator Both LEDs on the Power Supply should be ON as solid green, it indicates the OK status of the DC GOOD signal. The LED shall continue to glow under normal operation of the power supply. During protection mode (main 12V rail), the LED should be amber.
  • Page 38: Software Installation

    One Stop Systems Software Installation 10.1 Software Driver Installation One Stop Systems EB4400 expansion unit requires no driver on Windows 7, Windows 8, Windows 10, Windows Server, Linux, Unix, Centos and Mac OS. Before attempting to install any software / drivers , you should ensure that you have set a Restore Point or created a backup of your system / data..
  • Page 39: Verify Hib Device

    This sections contains information on how to check / verify the OSS devices on Linux and Windows OS environments. 11.1 Linux OS To check if the OSS HIB cards and backplane are detected, use the following commands on the terminal window. Make sure you are logged-in as “super user (or as root)” when running the lspci command. ...
  • Page 40: Windows 10 / Server

     Displaying a link between Host and Target cards.  OSS backplane / board with PCIe cards installed—the downstream slots on the backplane are not populated.  Showing multiple layers of PCI Express standard Upstream Switch Port and PCI Express standard Downstream Switch Port.
  • Page 41 One Stop Systems Viewing devices by type Both adapter cards (host and target cards) and backplane are recognized / detected. The devices are coming up with a Yellow Exclamation point, this is normal. No need to install any drivers. EB4400 (8SLOT BP)
  • Page 42: Verify Pcie Cards

    –vtt” command. Output below is a screenshot of the “lspci –vtt” showing the OSS backplane with five cards installed. You can also grep the vendor name of the PCIe card. For example, if you have an NVIDIA GPUs, run the command on the terminal window “...
  • Page 43: Windows

    The screenshot below shows the OSS backplane is populated with five PCIe cards (but showing a yellow exclamation mark next to it, which means the driver is not loaded). You can obtain the driver from the card manufacturer or you can download it from the vendor’s website. OSS does not provide 3 party driver / software.
  • Page 44 One Stop Systems The screenshot below shows an Ethernet card is detected and it installed in slot#1. The image below was captured on a computer running Windows Server OS. EB4400 (8SLOT BP)
  • Page 45: Ipmi

    One Stop Systems IPMI IPMI is a configurable feature and it is not included with the base model. The IPMI module is installed during assembly. If you require this feature, select this option or contact your One Stop Systems sales representative at sales@onestopsystems.com. Unit equipped with IPMI, below photo shows the location of IPMI module installed in the unit.
  • Page 46: Locate Mac Address & Ip Address

    One Stop Systems Upon connecting the power, observe the IPMI LED, it will illuminate from solid red to blinking green and to solid green. When the led status is solid green, the IPMI is ready. 13.2 Locate Mac Address & IP Address ...
  • Page 47: Start Internet Browser

    One Stop Systems Use the Mac address to find the IP address assigned to that port over the network to access the IPMI web interface. You can use “arp –a” command on Windows and “arp – n” on Linux.  From the output arp table, search for the Mac address of your IPMI module and match that to the assigned IP address ...
  • Page 48: Other Technical Information

    14.1 Upstream and Downstream Slots Upstream Slot: Also known as target slot. This is the designated slot for the Target adapter card only. OSS Host card or any PCIe cards will not operate in the Upstream slot / Target slot.
  • Page 49: Board Leds

    One Stop Systems 14.3 Board LEDs LED# NAME Description FE LED FE-Fault Error (SYS_ERROR#) LED DC LED PCIe slot LEDs Daisy Chain Port Link Status LED LED 0 All Power Good LED 1 FPGA Blinking LED (When FPGA code is loaded and working: 8 blinks, 2 pause counts, 8 blinks CONFIG Config output from the FPGA, but enabled as an FPGA option.
  • Page 50: Slot Number And Port Mapping

    14.6 Slot Number and Port Mapping Each slot on the OSS backplane is mapped to a PCIe port on the 88096 PCIe switch. Port mapping is hard-coded, it is essentially fixed. No means of changing or modifying it. For example, a single GPU or PCIe card is seated in slot 2 on the backplane, PCIe port 56 will be automatically assigned to the card.
  • Page 51: Power Cords

    Two types of power cords can be used with this expansion unit, 125V and 250V. This is only applicable to AC power supplies 14.7.1 Specifications OSS PART#: 290-001-012-RC (125V) OSS PART#: 290-001-032-RC (250V) Description: CORD NEMA5-15P C-13SJT Description: CORD PWR MALE-FEMALE SJT...
  • Page 52: Power Supply

    One Stop Systems 14.8 Power Supply Power Options  Single/Dual AC 1600W  Single/Dual DC 1600W  Single/Dual AC 2600W AC Power Supply DC Power Supply Standard EB4400 unit comes with one or two replaceable AC power supply modules.  With two power supply modules installed: Share the power load requirements during normal operations.
  • Page 53: Removing Ac Power Supply

    One Stop Systems 14.9 Removing AC Power Supply Disconnect the power cord from the power supply you are removing. Grasp the power-supply handle. Press the black release latch upward and hold it. Pull the power supply out of the bay. EB4400 (8SLOT BP)
  • Page 54: Specifications

    One Stop Systems 14.9.1 Specifications Input Rating The power supply shall operate within all specified limits over the following input range. Harmonic distortions of up to10% of the rated line voltage must not cause the power supply to go out of specified limits. The power supply shall power off if the AC input is below VAC and shall start (auto recovery) if the VAC is reached.
  • Page 55: Led Indicator

    One Stop Systems 14.9.2 LED Indicator EB4400 (8SLOT BP)
  • Page 56: Fan

    One Stop Systems 14.10 The expansion unit has two fans installed with sufficient capacity to provide cooling to the extreme-high-heat- generating GPUs. These are high CFM / RPM replaceable fans. The fans have a PWM controlled fan speed (4x lead wires), regulated by the temperature sensors within the system.
  • Page 57: 14.10.2 How To Remove Fan

    One Stop Systems 14.10.2 How to remove Fan Loose n the thumbscrew and slowly pull the fan out, see photos below. 14.11 Fan Foam Air Filter The EB4400 can be configured to come with fan foam air filters with minimal airflow resistance to prevent dust from entering the expansion unit.
  • Page 58: Auxiliary Power Cables

    290-010-037-RC- Cable Assy, Aux Pwr, 8 Pin, NVIDIA 2.0, 12", Expansion System, 8-pin male to 8-pin male One 8-pin connector M176 (OSS) 290-010-037-RC- Cable Assy, Aux Pwr, 8 Pin, NVIDIA 2.0, 24" Expansion System, 8-pin male to 8-pin male One 8-pin connector...
  • Page 59: 14.12.1 Aux Power Cable Installation

    One Stop Systems 14.12.1 Aux power cable installation The auxiliary power is supplied directly from the power supply backplane and there are 8 available AUX power connections / ports in which the auxiliary power cables are plugged in, see photo below. To plug in the 6+2 pin cable correctly, connect the end connector of the cable to the power distribution board, see photos below.
  • Page 60: 14.12.2 Pin Outs

    One Stop Systems 14.12.2 Pin Outs PSU board aux port pin outs 8-pin aux power cable and pin outs Figure A1 EB4400 (8SLOT BP)
  • Page 61 One Stop Systems Figure A2 6+2-pin aux power cable and pin outs Figure B 1 EB4400 (8SLOT BP)
  • Page 62: 14.12.3 Using The Auxiliary Power Cable

    One Stop Systems 14.12.3 Using the Auxiliary Power Cable When using a PCIe card such an FPGA GPU cards that requires additional power, you may need auxiliary power cables . Depending on the power requirement of your PCIe card, it will have a different built-in aux power port in which you attach the aux power cable. A PCIe slot provides 75 watts of slot power, which is not enough to meet the power requirement for a high-end add-in card with power consumption.
  • Page 63 One Stop Systems The photo below is an example of a PCIe card that has an 8pin power connector. You need one 8-pin aux cable to provide extra power. Each PCIe x16 slot on the backplane provides 75 Watts of power which is adequate for most video cards. But a high-end GPU cards usually need more power.
  • Page 64: Expansion Unit Power Consumption

    The EB4400 expansion unit draws a maximum of 304 Watts (2 Fans + 1Backplane + 1Interface board + IPMI board) of power without any boards / cards installed. 14.14 Power consumption breakdown per hardware Item Hardware Power Consumption Target Card OSS Gen 4 60 Watts Fans 88.80 Watts (44.40 Watt per fan) Backplane 150 Watt per backplane IPMI board...
  • Page 65: Troubleshooting

    Broken OSS-Backplane If you received a brand new DOA (Dead on Arrival) board, please contact OSS to RMA board and request for a replacement. If you have an out of warranty board, please contact OSS Sales team and buy a new replacement board.
  • Page 66: Windows Error Codes

    System board fails to power UP A faulty OSS board can cause the expansion system not to power UP properly. For troubleshooting, you can force power ON the OSS board by placing a jumper on J1 connector, see photos below. This will help you determine whether the board is functioning properly. You need the following items to perform this task.
  • Page 67: Pcie Upstream And Downstream Ports Are Not Detected

    One Stop Systems 15.8 PCIe Upstream and Downstream Ports are not detected 1. Shutdown the system 2. Remove all PCIe cards from the slot. 3. Reseat the Target card and host card. 4. Reseat the cables. 5. Power UP the system. 6.
  • Page 68: How To Get More Help

    We test, certify and support many third party hardware and software products along with OSS hardware and are happy to integrate a fully supported system. Ask us about that service and we would be happy to help. If an OSS product is fully functional and a support issue is related to third-party hardware or software that did not ship from the OSS factory, the customer requesting support should reach out to the third-party vendor for assistance to fully troubleshoot the issue.
  • Page 69 One Stop Systems EB4400 (8SLOT BP)

Table of Contents