One Stop Systems Table of Contents Introduction ................................... 5 General Specifications ....................................5 Features ........................................6 EB4400 Architecture (8 Slot) ..................................6 PCIe Slots ........................................6 Backplane Block Diagram ..................................7 Dimensions........................................ 8 Parts Overview ......................................9 HIB x16 Gen 4 Card ....................................11 Backplane ........................................
Page 3
One Stop Systems Connect Power Cord(s) ................................... 29 Powering UP the Host ..............................31 Hardware Check ................................32 Verify Board LEDs ....................................32 Fault LEDs (RED) ...................................... 33 Verify Adapter Card LEDs ..................................34 Adapter Card LED Definitions .................................. 35 Slot LEDs ........................................35 Power Distribution Board LED .................................
Page 4
My PCIe devices are showing UP with a Yellow Exclamation mark ....................65 15.3 No link between host and target cards .............................. 65 15.4 Broken OSS-Backplane ..................................65 15.5 My PCIe cards are not detected ................................. 65 15.6 Windows Error Codes ..................................66 15.7...
One Stop Systems Features PCIe Gen4 architecture Small, rugged frame design Dynamic fan speed control Configurable slot and host uplinks to optimize throughput Integrated IPMI based systems monitoring AC and DC power inlet options EB4400 Architecture (8 Slot) PCIe Slots Slot Type: Closed-ended PCIe slot / connector, all the slots are x16 mechanical.
One Stop Systems HIB x16 Gen 4 Card x4 cable Ports There are four x4 cable ports /connectors available on the HIB Gen4 card. Port #0 is located nearest to the Link LED. A single x4 SFF-8644 cable must be inserted into port#0 of the Target card. ...
One Stop Systems Backplane Item Name Description 12V Input Power 12V input power for the 538 board. Not to be used for external GPU aux ARF 6 Top Connectors For connecting ARC 6 cables between ”Option slot” and PEX switch I2C and temp sensors interface Connector for I2C and temp sensors interface to the power backplane Ethernet port...
One Stop Systems 1.10 Slot Configurations Configuration# 1: Default slot configuration. One Upstream slot and eight Downstream slots. ARC6 cables are attached between the edge of the board and the slot connectors under the backplane. NOTE: Without the ARC6 cables nothing will work in SLOT 8. Configuration# 2: Two Upstream slots (Slot 0 and SLOT 8) with two partitions.
Configuration 1 The OSS-521 backplane is linked to a single host computer. Four x4 link cables are connected between OSS Gen4 Host card and Target card. 8 Downstream slots 6 x8 slots (Slot 1, 2, 3, 4, 5 and 6) ...
1.12 Main Components The EB4400 unit is composed of following major components 8-slot Backplanes (OSS-521) One or Two Target Cards : PCIe 4.0 x16 One or Two Host Cards: PCIe 4.0 x16 (Installed in the host systems) Four or eight SFF-8644 PCIe Gen4 PCIe Cables...
Power ON the host computer. Check the hardware by verifying all LED status indicators. Boards LED Target & Host cards Unit front power LED Power supplies LED Check the OSS devices via operating system, verifying all OSS devices are properly recognized. EB4400 (8SLOT BP)
One Stop Systems Hardware Set-up / Installation The following steps will guide you through the installation of your One Stop Systems expansion system. Remove Top Cover Remove the two (2) mounting screws on top of the chassis. Slide the enclosure cover towards the back of the unit to disengage it from the guides and then lift the cover off.
One Stop Systems Once the dipswitches are set correctly, plug in the target card, make sure it is fully seated in the PCie slot. Install Host Card Before installation, you must check the switches on the Host card. By default, all the switches on the Host card are set to OFF position (“Auto-Negotiation”...
Page 19
One Stop Systems x4 Dip switch Settings: SW1 #2 = ON; #5 = ON SW2 = All OFF Once the Host-card is configured, install the card into a x16 Gen4 PCIe slot on a computer motherboard. Check the PCIe slot for any foreign debris as this can damage the card during installation. ...
IMPORTANT: You need the ARC6 cables attached between the edge of the board and the slot connectors under the backplane. Without those cables nothing will work in slot 8. For more information on the option slot configuration, you can download the installation guide from the OSS support website.
One Stop Systems Before you begin The EB4400 unit can accommodate standard full length PCIe cards and either single-width or dual-width GPUs. When installing multiple double-width GPUs, begin placing the GPU in the far right end of the backplane (looking from the rear). ...
Use the supplied compatible auxiliary power cable for your GPU or PCIe card. Photos below is an example of an auxilirary power cable available from OSS for purchase. Plug in the auxiliary cable to the GPU. EB4400 (8SLOT BP)
Page 24
One Stop Systems Plug in the other end of the auxiliary cable to any of the available auxiliary power connectors on the power distribution board (see photo below). Photo below shows the GPU auxiliary power cable connected to the auxiliary power distribution board. Reinstall the air-baffle and card hold-down top bracket when done installing the GPU / PCIe cards.
One Stop Systems Connect Link Cables Use Gen4 Cables Mini-SAS HD SFF-8644 Cable Installation Connect all the appropriate PCIe link cables needed for the system. When the host card is configured to operate at x16 mode, connect all four link cables ...
One Stop Systems 6.1.2 x8 Configuration: TWO cables Note: Make sure the HIB616-x16 host card is manually set to x8 configuration; see the x8 switch setting section for more details Plug-in the 1 cable to Port#0 (Top port) on both Target and Host cards ...
One Stop Systems 6.1.3 x4 Configuration: ONE cable Plug-in the single cable to Port # 0 (Top port) on both Target and Host cards On the Host card side, you can use any ports. The other end of the cable stays connected on Target card PORT # 0. Photo A1: Cable stays connected on the Target card PORT # 0.
One Stop Systems Diagrams below are different x4 cable configurations. Disconnecting Mini-SAS HD SFF-8644 Cable To disconnect the link cable, pull back the PLASTIC thumb tab to release metal clamp while slowly pulling the cable out. EB4400 (8SLOT BP)
If you are using a 250V power cord, you would need to connect that to a PDU (power distribution unit). You can buy the PDU on any online electronic stores. OSS does not sell the PDU. Connect Power Cord(s) Connect the supplied power cord to the back of the power supply.
Page 30
If Power LED indicator is showing “Amber” in color, it indicates a fault or power issue. The two front LEDs , the OSS logo will illuminate as blue and the “STANDBY”(MAIN PWR) will come ON as “solid-green”. EB4400 (8SLOT BP)
One Stop Systems Powering UP the Host Before powering UP or turning ON the Host computer, make sure the Host adapter card is seated properly in a x16 Gen3 / Gen4 PCIe slot and the cables are firmly connected. Upon powering up the Host computer, it will initialize a link between the target and the host. The Link LED on both target and host cards will illuminate as solid green.
One Stop Systems Hardware Check Verify Board LEDs Check the Target SLOT LED, when a PCIe card is installed in the target slot, the LED will illuminate as solid green. A fully operational back plane will illuminate the following LEDs. Check LEDs D19, D18 and D16, make sure they are correctly illuminated. ...
One Stop Systems Fault LEDs (RED) A solid RED led on the backplane signifies a fault or an error. Below photos are list of RED LED locations and definitions. EB4400 (8SLOT BP)
One Stop Systems Verify Adapter Card LEDs A working HIB adapter cards will illuminate the following LEDs (on both Host and Target cards). CE( Card edge) Solid green PWR (Power) Blinking green LED 0 Solid green LED1 Solid green LED2 Solid green LED3 Solid green...
One Stop Systems Adapter Card LED Definitions LEDs for SFF-8644 Cable Link cases: Target mode (x16): D1 is the link indicator Host Mode, x16: D1 is the link indicator Host Mode, x8x8: D1 or D5 are the link indicators (one for each corresponding group of two SFF cages) Host Mode, x4x4x4x4: D1, D3, D5, D7 are the link indictors (one for each SFF cage) Slot LEDs ...
One Stop Systems Power Distribution Board LED When the PSU DC GOOD led is not illuminated, it is an indication of a faulty power supply and the unit will not power ON. Solid green- the PSU is working properly. See photos below for the location of the “PSU DC GOOD”...
One Stop Systems Power Supply LED Indicator Both LEDs on the Power Supply should be ON as solid green, it indicates the OK status of the DC GOOD signal. The LED shall continue to glow under normal operation of the power supply. During protection mode (main 12V rail), the LED should be amber.
One Stop Systems Software Installation 10.1 Software Driver Installation One Stop Systems EB4400 expansion unit requires no driver on Windows 7, Windows 8, Windows 10, Windows Server, Linux, Unix, Centos and Mac OS. Before attempting to install any software / drivers , you should ensure that you have set a Restore Point or created a backup of your system / data..
This sections contains information on how to check / verify the OSS devices on Linux and Windows OS environments. 11.1 Linux OS To check if the OSS HIB cards and backplane are detected, use the following commands on the terminal window. Make sure you are logged-in as “super user (or as root)” when running the lspci command. ...
Displaying a link between Host and Target cards. OSS backplane / board with PCIe cards installed—the downstream slots on the backplane are not populated. Showing multiple layers of PCI Express standard Upstream Switch Port and PCI Express standard Downstream Switch Port.
Page 41
One Stop Systems Viewing devices by type Both adapter cards (host and target cards) and backplane are recognized / detected. The devices are coming up with a Yellow Exclamation point, this is normal. No need to install any drivers. EB4400 (8SLOT BP)
–vtt” command. Output below is a screenshot of the “lspci –vtt” showing the OSS backplane with five cards installed. You can also grep the vendor name of the PCIe card. For example, if you have an NVIDIA GPUs, run the command on the terminal window “...
The screenshot below shows the OSS backplane is populated with five PCIe cards (but showing a yellow exclamation mark next to it, which means the driver is not loaded). You can obtain the driver from the card manufacturer or you can download it from the vendor’s website. OSS does not provide 3 party driver / software.
Page 44
One Stop Systems The screenshot below shows an Ethernet card is detected and it installed in slot#1. The image below was captured on a computer running Windows Server OS. EB4400 (8SLOT BP)
One Stop Systems IPMI IPMI is a configurable feature and it is not included with the base model. The IPMI module is installed during assembly. If you require this feature, select this option or contact your One Stop Systems sales representative at sales@onestopsystems.com. Unit equipped with IPMI, below photo shows the location of IPMI module installed in the unit.
One Stop Systems Upon connecting the power, observe the IPMI LED, it will illuminate from solid red to blinking green and to solid green. When the led status is solid green, the IPMI is ready. 13.2 Locate Mac Address & IP Address ...
One Stop Systems Use the Mac address to find the IP address assigned to that port over the network to access the IPMI web interface. You can use “arp –a” command on Windows and “arp – n” on Linux. From the output arp table, search for the Mac address of your IPMI module and match that to the assigned IP address ...
14.1 Upstream and Downstream Slots Upstream Slot: Also known as target slot. This is the designated slot for the Target adapter card only. OSS Host card or any PCIe cards will not operate in the Upstream slot / Target slot.
One Stop Systems 14.3 Board LEDs LED# NAME Description FE LED FE-Fault Error (SYS_ERROR#) LED DC LED PCIe slot LEDs Daisy Chain Port Link Status LED LED 0 All Power Good LED 1 FPGA Blinking LED (When FPGA code is loaded and working: 8 blinks, 2 pause counts, 8 blinks CONFIG Config output from the FPGA, but enabled as an FPGA option.
14.6 Slot Number and Port Mapping Each slot on the OSS backplane is mapped to a PCIe port on the 88096 PCIe switch. Port mapping is hard-coded, it is essentially fixed. No means of changing or modifying it. For example, a single GPU or PCIe card is seated in slot 2 on the backplane, PCIe port 56 will be automatically assigned to the card.
Two types of power cords can be used with this expansion unit, 125V and 250V. This is only applicable to AC power supplies 14.7.1 Specifications OSS PART#: 290-001-012-RC (125V) OSS PART#: 290-001-032-RC (250V) Description: CORD NEMA5-15P C-13SJT Description: CORD PWR MALE-FEMALE SJT...
One Stop Systems 14.8 Power Supply Power Options Single/Dual AC 1600W Single/Dual DC 1600W Single/Dual AC 2600W AC Power Supply DC Power Supply Standard EB4400 unit comes with one or two replaceable AC power supply modules. With two power supply modules installed: Share the power load requirements during normal operations.
One Stop Systems 14.9 Removing AC Power Supply Disconnect the power cord from the power supply you are removing. Grasp the power-supply handle. Press the black release latch upward and hold it. Pull the power supply out of the bay. EB4400 (8SLOT BP)
One Stop Systems 14.9.1 Specifications Input Rating The power supply shall operate within all specified limits over the following input range. Harmonic distortions of up to10% of the rated line voltage must not cause the power supply to go out of specified limits. The power supply shall power off if the AC input is below VAC and shall start (auto recovery) if the VAC is reached.
One Stop Systems 14.10 The expansion unit has two fans installed with sufficient capacity to provide cooling to the extreme-high-heat- generating GPUs. These are high CFM / RPM replaceable fans. The fans have a PWM controlled fan speed (4x lead wires), regulated by the temperature sensors within the system.
One Stop Systems 14.10.2 How to remove Fan Loose n the thumbscrew and slowly pull the fan out, see photos below. 14.11 Fan Foam Air Filter The EB4400 can be configured to come with fan foam air filters with minimal airflow resistance to prevent dust from entering the expansion unit.
290-010-037-RC- Cable Assy, Aux Pwr, 8 Pin, NVIDIA 2.0, 12", Expansion System, 8-pin male to 8-pin male One 8-pin connector M176 (OSS) 290-010-037-RC- Cable Assy, Aux Pwr, 8 Pin, NVIDIA 2.0, 24" Expansion System, 8-pin male to 8-pin male One 8-pin connector...
One Stop Systems 14.12.1 Aux power cable installation The auxiliary power is supplied directly from the power supply backplane and there are 8 available AUX power connections / ports in which the auxiliary power cables are plugged in, see photo below. To plug in the 6+2 pin cable correctly, connect the end connector of the cable to the power distribution board, see photos below.
One Stop Systems 14.12.3 Using the Auxiliary Power Cable When using a PCIe card such an FPGA GPU cards that requires additional power, you may need auxiliary power cables . Depending on the power requirement of your PCIe card, it will have a different built-in aux power port in which you attach the aux power cable. A PCIe slot provides 75 watts of slot power, which is not enough to meet the power requirement for a high-end add-in card with power consumption.
Page 63
One Stop Systems The photo below is an example of a PCIe card that has an 8pin power connector. You need one 8-pin aux cable to provide extra power. Each PCIe x16 slot on the backplane provides 75 Watts of power which is adequate for most video cards. But a high-end GPU cards usually need more power.
The EB4400 expansion unit draws a maximum of 304 Watts (2 Fans + 1Backplane + 1Interface board + IPMI board) of power without any boards / cards installed. 14.14 Power consumption breakdown per hardware Item Hardware Power Consumption Target Card OSS Gen 4 60 Watts Fans 88.80 Watts (44.40 Watt per fan) Backplane 150 Watt per backplane IPMI board...
Broken OSS-Backplane If you received a brand new DOA (Dead on Arrival) board, please contact OSS to RMA board and request for a replacement. If you have an out of warranty board, please contact OSS Sales team and buy a new replacement board.
System board fails to power UP A faulty OSS board can cause the expansion system not to power UP properly. For troubleshooting, you can force power ON the OSS board by placing a jumper on J1 connector, see photos below. This will help you determine whether the board is functioning properly. You need the following items to perform this task.
One Stop Systems 15.8 PCIe Upstream and Downstream Ports are not detected 1. Shutdown the system 2. Remove all PCIe cards from the slot. 3. Reseat the Target card and host card. 4. Reseat the cables. 5. Power UP the system. 6.
We test, certify and support many third party hardware and software products along with OSS hardware and are happy to integrate a fully supported system. Ask us about that service and we would be happy to help. If an OSS product is fully functional and a support issue is related to third-party hardware or software that did not ship from the OSS factory, the customer requesting support should reach out to the third-party vendor for assistance to fully troubleshoot the issue.
Need help?
Do you have a question about the EB4400 8-SLOT GEN4 and is the answer not in the manual?
Questions and answers