User Guide Table of Contents Table of Contents Revision History......................................iv Notices............................................ v Points of Contact......................................vi Chapter 1. Overview......................1 Ultrastar Transporter Appliance Description...........................2 Electrical Specification..................................... 3 Environmental Specification.................................3 Mechanical Specification..................................3 System Specification....................................4 Ultrastar Transporter Physical Design............................5 LED Identification....................................6 System Level Block Diagram..............................
Page 3
User Guide Table of Contents DDR4 RDIMM Description..................................18 DDR4 RDIMM Specifications..............................18 System Fan Module....................................19 System Fan Module Specifications...........................19 Rail Kit..........................................20 Rail Kit Specifications.................................20 Chapter 3. Management....................21 Configuration and Initial Bring Up............................... 22 Configuration...................................... 22 Connecting the Ultrastar Transporter System and Entering Bios Setup..........22 Operating System Installation.................................
Page 4
User Guide Table of Contents Electrostatic Discharge..................................57 Optimizing Location....................................57 Power Connections....................................57 Power Cords........................................58 Rack-Mountable Systems.................................. 58 Replaceable Batteries....................................58 Safety and Service....................................59 Safety Warnings and Cautions..............................59 Chapter 5. Regulatory......................61 Country Certifications.................................... 62 Electromagnetic Compatibility (EMC) Class A Compliance..................62 Regulatory Statement of Compliance............................63 Europe (CE Declaration of Conformity)...........................
Per Western Digital Terms and Conditions of Sale, the user of Western Digital products in life support applications assumes all risk of such use and indemnifies Western Digital against all damages.
Points of Contact Points of Contact For further assistance with a Western Digital product, contact Western Digital Datacenter Platforms technical support. Please be prepared to provide the following information, as applicable: part number (P/N), serial number (S/N), product name and/or model number, software version, and a brief description of the issue.
Overview This section provides an overview of the design and features of the Ultrastar® Edge portable storage server, the components within it, and the environment in which it operates. In This Chapter: - Ultrastar Transporter Appliance Description............2 - Electrical Specification....................3 - Environmental Specification..................
• Integrated six-button LCD display • Two (2) 10GBase-T Ethernet capacity ports (LOM) • Intel® Ice Lake 4310 2.10GHz, 12C • Twenty four (24) Western Digital • Two (2) 64GB DDR4 ECC DRAM SN650 15.36TB NVMe SSDs • Two (2) Western Digital 2TB •...
1. Overview User Guide 1.2 Electrical Specification 1.2 Electrical Specification Table 2: Electrical Specifications Specification Value Max Power Consumption 1300W Input Voltage 100 - 240VAC, auto-ranging PSU Connector Type AC line inrush current will not exceed 40A Inrush Current Maximum peak, for up to one-quarter of the AC cycle.
368TB using Western Digital SN650 15.36TB NVMe SSDs Capacity Drives 24x Western Digital SN650 15.36TB NVMe SSDs Boot Drives 2x Western Digital SN740 2TB M.2 SSDs CPU Intel Ice Lake, 4310 2.10GHz, 12C CPU Memory 2x 64GB DDR4 ECC DRAM •...
1. Overview User Guide 1.6 Ultrastar Transporter Physical Design 1.6 Ultrastar Transporter Physical Design This section shows the dimensions and layout of the primary physical features of the Ultrastar Transporter. Figure 2: Ultrastar Transporter Dimensions Figure 3: Ultrastar Transporter Primary External Features Figure 4: Ultrastar Transporter Rear Ports and Features...
1. Overview User Guide 1.6 Ultrastar Transporter Physical Design 1.6.1 LED Identification The Ultrastar Transporter has a number of LEDs that display various system statuses. Front LED Locations Figure 5: Front LED Locations Table 6: Front LED Identification LED Name Color Behavior Power Green...
Page 14
1. Overview User Guide 1.6 Ultrastar Transporter Physical Design Rear LED Locations Figure 6: Rear LED Locations Table 7: Rear LED Identification LED Name Color Behavior Solid Green – On and providing power to the system Power Supply Fault/ Green/ Blink Green @ 1 Hz –...
1. Overview User Guide 1.6 Ultrastar Transporter Physical Design 1.6.2 System Level Block Diagram The system block diagram for the Ultrastar Transporter is a conceptual depiction of the communication and power relationships between major components within the system. Figure 7: System Block Diagram Table 8: Port Accessibility Externally Accessible Not Externally Accessible...
The following table lists the operating systems tested on the Ultrastar Transporter. Operating System Kernel Ubuntu 22.04 LTS Server 1.8 Supported SKUs The following table lists the versions of Western Digital product that are supported by this document. Table 10: System Configurations System Volume Part Number...
Page 17
1. Overview User Guide 1.9 List of CRUs Part Component Packaged Dimensions Packaged Weight Number : 330.2 mm x : 254 mm x : 101.6 mm PDU Power Cable 0.71 kg / 1.6 lbs 1EX0084 : 13 in x : 10 in x : 4 in : 330.2 mm x : 254...
Page 18
1. Overview User Guide 1.9 List of CRUs Part Component Packaged Dimensions Packaged Weight Number : 285.75 mm x : 163.32 NVMe 15.36TB Solid mm x : 69.85 mm Est. 1.74 kg / 3.84 lbs 1EX3107 State Drive (SSD) : 11.25 in x : 6.43 in x : 2.75 in : 330.2 mm x...
Components This section provides information about the major internal and external components of the Ultrastar Transporter portable storage server. In This Chapter: - NVMe 15.36TB Solid State Drive (SSD)..............13 - M.2 Solid State Drive (SSD)..................14 - Host Bus Adapter (HBA)....................15 - Network Interface Card (NIC)..................
2.1 NVMe 15.36TB Solid State Drive (SSD) 2.1 NVMe 15.36TB Solid State Drive (SSD) The Ultrastar Transporter is configured with twenty four (24) Western Digital SN650 15.36TB NVMe Solid State Drives (SSDs). The NVMe 15.36TB SSD offers improved performance consistency, high storage utilization, and are optimized for moving large datasets fast and efficiently.
User Guide 2.2 M.2 Solid State Drive (SSD) 2.2 M.2 Solid State Drive (SSD) The Ultrastar Transporter contains two (2) Western Digital SN740 2TB M.2 SSD boot drives that hold the operating system. 2.2.1 M.2 Solid State Drive (SSD) Specifications Table 13: M.2 Solid State Drive (SSD) Specification Summary...
2. Components User Guide 2.3 Host Bus Adapter (HBA) 2.3 Host Bus Adapter (HBA) The Ultrastar Transporter contains two (2) Atto® S4FF HBAs that provide the connection between all of the system drives. Each HBA handles the connections for twelve (12) drives. 2.3.1 HBA Specifications Table 14: Host Bus Adapter (HBA) Specification Summary Specification...
2. Components User Guide 2.4 Network Interface Card (NIC) 2.4 Network Interface Card (NIC) The Ultrastar Transporter contains a Mellanox® ConnectX7® 200Gb Dual port QSFP112 Ethernet controller that controls the wired network connections. The dual 200Gb-capable port can be accessed from the rear of the system.
2. Components User Guide 2.5 Power Supply Unit (PSU) 2.5 Power Supply Unit (PSU) The Ultrastar Transporter contains a 1300W PSU requiring an input voltage between 100 - 240VAC, auto-ranging. The PSU is 80PLUS Titanium certified and utilizes a C14 power cable receptacle. 2.5.1 ...
2. Components User Guide 2.6 DDR4 RDIMM Description 2.6 DDR4 RDIMM Description The Ultrastar Transporter contains two (2) 64GB DDR4 RDIMMs installed into slots C1 and G1. The RDIMMs are prepopulated into the approved configuration to maximize system performance. 2.6.1 DDR4 RDIMM Specifications DDR4 RDIMM Specification Summary Specification Value...
2. Components User Guide 2.7 System Fan Module 2.7 System Fan Module The Ultrastar Transporter contains five (5) internal fan modules mounted behind the drive plane to maintain proper cooling across the entire system and its components. 2.7.1 System Fan Module Specifications Table 18: System Fan Module Specification Summary Specification Value...
2. Components User Guide 2.8 Rail Kit 2.8 Rail Kit The Ultrastar Transporter can be installed into a rack using rack mounted rails. The rail kit contains a set of two 2U, shelf-style rails with spring-loaded inner arms that accommodate different rack rail lengths. The rails include mounting hardware with captive screws to secure the rails and system in place.
Management The Ultrastar Transporter Appliance contains a number of components with firmware that can be upgraded, configured, or reloaded, depending on the maintenance need. This section provides the steps required to successfully power up, install an operating system, and manage the Ultrastar Transporter.
3. Management User Guide 3.1 Configuration and Initial Bring Up 3.1 Configuration and Initial Bring Up 3.1.1 Configuration The following is required to operate the system: • Standard Power Cable – 120/240 VAC • VGA Monitor • USB Mouse & Keyboard •...
Page 30
3. Management User Guide 3.1 Configuration and Initial Bring Up • Method 2 - Connect the system to a host using the DB9 to USB-A Cable: This method requires a host with terminal emulations with a keyboard, Note: mouse, and display. a.
Page 31
3. Management User Guide 3.1 Configuration and Initial Bring Up Figure 18: Initial BIOS Screen...
3. Management User Guide 3.2 Operating System Installation 3.2 Operating System Installation Installing an Operating System To install an Operating System on the Ultrastar Transporter, navigate to the BIOS Boot options by using the arrow keys on the keyboard. Set the boot order for either <USB> or <PXE> and follow the OS vendor's installation instructions.
3. Management User Guide 3.3 Updating the Motherboard Firmware 3.3 Updating the Motherboard Firmware The following section provides information on updating the BIOS, BMC, and CPLD on the ASRock Rack SPC621D8-2L2T Motherboard. Important: The Ultrastar Transporter ships with the latest version of approved firmware customized specifically for the Ultrastar Transporter.
Page 34
3. Management User Guide 3.3 Updating the Motherboard Firmware 3.3.3 Upgrading the CPLD Firmware The CPLD firmware is very rarely be changed and therefore is not described in the ASRock Rack FAQs. The upgrade paths supported at this time are via the Ultrastar Transporter's IPMI Web Interface and via the asrrmgmttool command line.
Page 35
3. Management User Guide 3.3 Updating the Motherboard Firmware Step 4 : Once the Firmware has been uploaded to the unit, select Proceed . 3.3.3.2 Upgrading the CPLD Firmware (Command Line) If programming via command line, first verify the CPLD Firmware version with the following command from the asrrmgmttool utility:...
3. Management User Guide 3.4 Motherboard 10GBase-T Driver Update ./asrrmgmttool cpld_update get_fw_ver -h <IPMI IP Address> -u <Username – default admin> -p <Password – default admin or password> Upgrade the CPLD Firmware with the following command: Firmware file provided by the portal in *.jed ./asrrmgmttool cpld_update -f <...
Page 37
3. Management User Guide 3.5 Atto Storage Add in Card Firmware Update $sudo apt-get install make gcc Firmware Driver lnx_drv_envmsc1_1020b5.tgz #tar xvzf ./ lnx_drv_envmsc1_1020b5.tgz #cd lnx_drv_envmsc1_1020b5 and install the driver #./install.sh This will install the driver. Atto CLI tools Atinfo Examples: •...
Page 39
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install Network Adapter Updates Network Adapter Management Download Browse to the following web site and download the Linux tools in DEB format. https://network.nvidia.com/products/adapter-software/firmware-tools/ Figure 28: Ethernet management tools download Unpack the tgz file with the mft management tool From your ~/home/Download directory Install gcc make dkms...
Page 40
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install Figure 29: Install Mellanox management tools Figure 30: Install Mellanox Management Tools Network Adapter Ubuntu 22.04 Driver Download Download the appropriate driver in tgz format. https://network.nvidia.com/products/ethernet-drivers/linux/mlnx_en/...
Page 41
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install Figure 31: Mellanox Driver Download Unpack the driver #tar xvzf ./mlnx_en-23.07-0.5.1.2-ubuntu22.04-x86_64.tgz #cd ./mlnx-en-23.07-0.5.1.2-ubuntu22.04-x86_64 #./install...
Page 42
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install Figure 32: Mellanox Driver Download Restart the driver Verify the ethernet interfaces are up #lshw -c network -short...
Page 44
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install #unzip Obtain the correct device name using the following command: # mlxfwmanager Figure 38: mlxfwmanager current version Figure 39: Mellanox Ethernet Adapter PCIe Device Update the firmware Figure 40: Mellanox Ethernet Controller Firmware Update When complete, follow the instructions to reset the network adapter...
Page 45
3. Management User Guide 3.6 Mellanox Ethernet Adapter Utilities and Firmware Install # mlxfwreset –d 51:00.0 reset Figure 41: Reset Mellanox Ethernet Controller #mlxfwmanager Figure 42: Mellanox Ethernet Controller Updated Firmware Managing networks with netplan on Ubuntu22.04 Edit the yaml file in /etc/netplan to add the static IP address The correct number of spaces and indentation is important –...
3. Management User Guide 3.7 Advanced BIOS Settings # ethtool eno1 3.7 Advanced BIOS Settings The following section covers advanced BIOS settings that are required to configure the M.2 and data drive RAID sets. Figure 43: VMD Technology VMD for the M.2 SSD’s is enable to allow for a RAID1 configuration of the Operating System. VMD for Storage expansion is enabled for PCIe slots 3 and 7.
Page 47
3. Management User Guide 3.7 Advanced BIOS Settings Figure 45: VMD Enabled for PCIe Slot 7 Advanced – Intel Virtual RAID on CPU M.2 modules configured as RAID1 Figure 46: VROC Configured for M.2 RAID1 VROC configuration showing 24 NVME SSD’s that can be configured as a RAID 1,2,5 Set...
3. Management User Guide 3.7 Advanced BIOS Settings Figure 47: VROC Configured for NVMe SSD’s Boot – CSM Compatibility CSM needs to be Disabled to run in UEFI mode. If it is enabled or custom, the BIOS will hang when VMD is enabled.
3. Management User Guide 3.8 WDC SN740 Management 3.8 WDC SN740 Management The following procedure provides the necessary information needed to update the firmware on the Western Digital SN740 2TB M.2 NVMe SSD. Configuring the M.2 modules for RAID1 Operating System Installation Figure 49: Create RAID1 Volume on 2 - M.2 Modules...
Page 50
3. Management User Guide 3.8 WDC SN740 Management Figure 50: Name M.2 RAID1 Volume...
Page 51
3. Management User Guide 3.8 WDC SN740 Management Figure 51: Select RAID1 Volume Select the SSD's - The M.2 modules will be part of one VMD. Do not select span VMD Controllers...
Page 52
3. Management User Guide 3.8 WDC SN740 Management Figure 52: Select M.2’s for RAID1 Volume Scroll down and select Create Volume...
Page 53
3. Management User Guide 3.8 WDC SN740 Management Figure 53: Create RAID1 Volume Confirm you want to create a new volume on the RAID1 M.2 modules Figure 54: Confirm RAID1 Volume creation The RAID1 volume will show up as a valid RAID Volume...
Page 54
3. Management User Guide 3.8 WDC SN740 Management Figure 55: RAID1 Volume created ESC up to main menu and save changes and exit WDC SN740 Firmware Download and Install Install nvme-cli utility Login as root $sudo -s #apt update #apt install nvme-cli -y Verify the m.2 module is installed #nvme list M.2 information is displayed.
3. Management User Guide 3.9 WDC SN650 NVMe SSD Firmware Update #nvme list 3.9 WDC SN650 NVMe SSD Firmware Update Make sure the SSDs are found by the controller #nvme list Figure 57: NVMe Storage Use the following to download new firmware to the SSDs #nvme -fw-download -fw=./coffeebay_GN_RA410001.vpkg /dev/nvmeXn1 Then commit the firmware #nvme -fw-commit /dev/nvmeXn1 -slot 2 -action 1...
Page 56
3. Management User Guide 3.10 Configure Software RAID Set Figure 58: NVMe Storage Verify the software RAID devices are found The OS NVMe device should show up as /dev/md126 as shown below: Figure 59: OS RAID1 volume Install mdadm #apt update #apt install mdadm -y To verify the SSDs are assigned to the VMD controllers type the following command: # mdadm –detail-platform...
Page 57
3. Management User Guide 3.10 Configure Software RAID Set Figure 60: VMD/VROC Devices Special commands and arguments are required to create a VROC RAID volume from NVMe devices attached to a VMD Controller. If the two M.2 modules have been configured into a RAID1 set, then the next available device is imsm1.
3. Management User Guide 3.11 Removing a RAID Volume This will substantially improve the initialization time. Make an ext4 file system on the 320 TB array #mkfs.ext4 –F /dev/md124 Create a directory to mount the software RAID volume. /mnt/raid5 Mount the filesystem #mount /dev/md124 /mnt/raid5 Verify the new space is available #df -h -x /dev/tmpfs -x tmpfs...
3. Management User Guide 3.12 Front Panel LCD Display Setup 3.12 Front Panel LCD Display Setup Figure 61: Front Panel LCD Display The Ultrastar Transporter's handle has an integrated 4-Line, 6-Button LCD display module. The primary function of the module is to power up/down/reset the system and enable user interaction with the system. It has two interfaces: an I2C interface that communicates with the unit’s fan control module, and a USB interface that connects to a USB port on the motherboard.
Page 60
3. Management User Guide 3.12 Front Panel LCD Display Setup Table 20: Button Timing User Behavior System State Result Press .25 seconds System Powers Up Green Check Press and hold 4 seconds System Resets Green Check Press and hold 4 seconds System Powers Down Red X Important:...
LCD module properly. This address is programmed during manufacturing and should never change. If the address does get corrupted, symptoms may include errant power/fault status LED operation, and lack of Western Digital logo displaying on the LCD module during boot.
Below is an example code snippet to write a character string at a given (x, y) cell location on the LCD module. Figure 66: Writing Character String to an (x, y) Cell Location Contact Western Digital if further assistance is required.
4.1 Electrostatic Discharge CAUTION Electrostatic discharge can harm delicate components inside Western Digital products. Electrostatic discharge (ESD) is a discharge of stored static electricity that can damage equipment and impair electrical circuitry. It occurs when electronic components are improperly handled and can result in complete or intermittent failures.
4. Safety User Guide 4.4 Power Cords When power cycling the unit, wait 10 seconds before re-applying power. Failure to do so may cause the enclosure to boot up in an inaccessible state. If this is encountered, remove power, wait 10 seconds, and then reapply power.
All maintenance and service actions appropriate to the end-users are described in the product documentation. All other servicing should be referred to a Western Digital-authorized service technician. To avoid shock hazard, turn off power to the unit by unplugging the power cord before servicing the unit.
Page 67
4. Safety User Guide 4.8 Safety Warnings and Cautions Indicates disconnect all power sources before servicing.
Regulatory In This Chapter: - Country Certifications....................62 - Electromagnetic Compatibility (EMC) Class A Compliance......62 - Regulatory Statement of Compliance..............63 - Europe (CE Declaration of Conformity)..............63 - FCC Class A Notice......................64 - ICES-003 Class A Notice—Avis NMB-003, Classe A........64 - Japanese Compliance Statement, Class A ITE..........
5. Regulatory User Guide 5.1 Country Certifications 5.1 Country Certifications Ultrastar Transporter The Ultrastar Transporter (DCS0030) complies to the latest country certifications: Table 21: Ultrastar Transporter Country Certifications Country/Region Authority or Mark Australia/New Zealand Europe EN 62368-1 2nd Edition Europe CE CE - EN55032/EN55024 Japan VCCI...
European Union, including the Electromagnetic Compatibility Directive (2014/30/EU) and the Low Voltage Directive (2014/30/EU). A “Declaration of Conformity” in accordance with the applicable directives has been made and is on file at Western Digital Europe. • Ecodesign Directive (2019/424/EU) • RoHS Directive 2011/65/EU...
Any modifications made to this device that are not approved by Western Digital may void the authority granted to the user by the FCC to operate equipment.
5. Regulatory User Guide 5.8 Korean KCC Notice, Class A 5.8 Korean KCC Notice, Class A English translation: NOTICE Class A equipment (equipment for business use). This equipment has been evaluated for its suitability for use in a business environment. When used in a residential environment, there is a concern of radio interference.
Page 73
5. Regulatory User Guide 5.10 Taiwan Warning Label Statement, Class A ITE English translation: Please read the following instructions carefully 1. Do not place the device in a humid place. 2. Check the voltage before connecting to the power source. 3.
Need help?
Do you have a question about the Ultrastar Edge and is the answer not in the manual?
Questions and answers