Page 2
IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA. Dell EMC Hopkinton, Massachusetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 www.DellEMC.com...
CONTENTS Figures Tables Chapter 1 Hardware Components and Configurations ECS Appliance hardware components............10 U-Series components..............10 D-Series components..............12 C-Series components..............13 U-Series Appliance (Gen2) configurations and upgrade paths....15 U-Series Appliance (Gen1) configurations and upgrade paths.....18 D-Series Appliance configurations and upgrade paths.........19 C-Series Appliance (Gen2) configurations and upgrade paths....20 C-Series Appliance (Gen1) configurations and upgrade paths....
Page 4
CONTENTS U-Series three-phase AC power cabling............. 74 D-Series single-phase AC power cabling ............ 77 D-Series three-phase AC power cabling............. 79 C-Series single-phase AC power cabling ........... 83 C-Series 3-phase AC power cabling ............84 Chapter 7 SAS Cabling U-Series SAS cabling................. 90 D-Series SAS cabling..................93 Chapter 8 Network Cabling...
FIGURES U-Series minimum and maximum configurations............11 D-Series minimum and maximum configurations............13 C-Series minimum and maximum configurations............15 Phoenix-16 (Gen1) and Rinjin-16 (Gen2) server chassis front view ......27 Phoenix-12 (Gen1) and Rinjin-12 (Gen2) server chassis front view ......27 Server chassis rear view (all)..................29 Rear ports on nodes (all)....................
Page 6
FIGURES U-Series (Gen1) SAS cabling for eight-node configurations........93 D-Series SAS cabling for eight-node configurations........... 94 Linear or daisy-chain topology..................96 Linear or daisy-chain split-brain..................96 Ring topology......................96 Star topology......................97 Public switch cabling for U- and D-Series..............98 U-Series and D-Series network cabling..............99 Network cabling labels....................
RPQ be submitted and approved. Optional three-phase WYE or delta PDUs with two power drops (one per side) Front and rear doors Racking by Dell EMC manufacturing Private switch One 1 GbE switch Public switch Two 10 GbE switches...
Hardware Components and Configurations Table 1 U-Series hardware components (continued) Component Description Disk array enclosure (DAE) The U-Series disk array enclosure (DAE) drawers hold up to 60 3.5-inch disk drives. Features include: Gen1 hardware uses 6TB disks and Gen2 hardware uses 8 TB and 12 TB disks Two 4-lane 6 Gb/s SAS connectors SAS bandwidth of 3500 MB/s...
RPQ be submitted and approved. Optional three-phase WYE or delta PDUs with two power drops (one per side) Front and rear doors Racking by Dell EMC manufacturing Private switch One 1 GbE switch Public switch Two 10 GbE switches Nodes Intel-based unstructured server in eight-node configurations.
Hardware Components and Configurations Figure 2 D-Series minimum and maximum configurations Note These rack configurations are available with either 8 TB or 10 TB disks. C-Series components The C-Series ECS Appliance includes the following hardware components. Table 3 C-Series hardware components Component Description 40U rack...
Page 14
Optional two three-phase WYE or delta PDUs in a 2U configuration with two power drops Front and rear doors Racking by Dell EMC manufacturing Private switch One or two 1 GbE switches. The second switch is required for configurations with more than six servers.
Hardware Components and Configurations Figure 3 C-Series minimum and maximum configurations U-Series Appliance (Gen2) configurations and upgrade paths Describes the second generation U-Series ECS Appliance configurations and the upgrade paths between the configurations. The Gen2 hardware became generally available in October 2015. U-Series configurations (Gen2) The U-Series Appliance is a commodity object storage solution.
Hardware Components and Configurations Table 4 U-Series (Gen2) configurations Storage capacity Model number Nodes DAEs Disks in DAE Switches (8 TB disks) (12 TB disks) U400 (minimum 320 TB 480 TB One private and two configuration) public U400-E 400 TB 600 TB One private and two public...
Hardware Components and Configurations The best practice is to have only one storage pool in a VDC, unless you have more than one storage use case at the site. In a site with a single storage pool, each DAE in each rack must have the same number of disks. Upgrade rules for systems with either four nodes/DAEs 8 TB or four nodes/DAEs 12 TB (upgrade will include mixed disk capacities in the rack): The minimum number of disks in a DAE is 10.
Hardware Components and Configurations Table 6 U-Series (Gen2) node upgrades (continued) Current nodes Kit for upgrade to 5 nodes Kit for upgrade to 6 nodes Kit for upgrade to 8 nodes Five Not applicable One node. Three nodes. (all five nodes have One DAE with the same Three DAEs with the same either all 8 TB disks...
Hardware Components and Configurations Table 7 U-Series (Gen1) configurations (continued) Model Nodes DAEs Disks in DAE 1 to Disks in DAE 5 to Storage Switches number capacity U1800 1800TB One private and two public U2100 2160TB One private and two public U2500 2520TB...
Hardware Components and Configurations Table 9 D-Series configurations Model number Nodes DAEs Disks in each Disk Size Storage Switches capacity D4500 4.5 PB One private and two public D5600 10TB 5.6 PB One private and two public D6200 6.2 PB One private and two public D7800...
Hardware Components and Configurations Table 11 C-Series (Gen2) configurations (continued) Phoenix-12 Nodes Storage Switches Compute Servers capacity 360TB One private and two public 432TB One private and two public 504TB Two private and four public 576TB Two private and four public 648TB Two private and four public 720TB...
Hardware Components and Configurations Table 12 C-Series (Gen2) upgrades (continued) Model number Disk upgrade (to the next Hardware upgrade (to higher model) the next higher model) 11 Phoenix-12 Compute 12 integrated disks One server chassis (four Servers nodes) 12 Phoenix-12 Compute 12 integrated disks One server chassis (four Servers (maximum...
Hardware Components and Configurations Table 14 C-Series (Gen1) upgrades Model number Disk upgrade (to the next Hardware upgrade (to higher model) the next higher model) 2 Phoenix-12 Compute Not applicable Not applicable Servers (minimum configuration) 3 Phoenix-12 Compute 12 integrated disks One server chassis (four Servers nodes)
Page 24
Hardware Components and Configurations Table 15 ECS Certified hardware Server models Switch models Dell S3048-ON Cisco Nexus 3048 Two 10 GbE switches are required to handle data traffic: Arista 7050SX-64 Arista 7050S-52 Arista 7150S-24 Arista 7124SX D- and U-Series Hardware Guide...
Servers ECS Appliance servers Provides a quick reference of servers. ECS has the following server types: D-Series Gen2 Rinjin-16 for Object and HDFS (October 2016) U-Series Gen2 Rinjin-16 for Object and HDFS (November 2015) U-Series Gen1 Phoenix-16 for Object and HDFS (June 2014) C-Series Gen2 Rinjin-12 for Object and HDFS (February 2016) C-Series Gen1 Phoenix-12 for Object and HDFS (March 2015) D-Series...
Servers Eight 8 GB DDR4 RDIMMs One system disk per node LED indicators for each node Dual hot-swap chassis power supplies C-Series Gen1 Phoenix-12 nodes have the following standard features: Four-node servers (2U) with two CPUs per node 2.4 GHz four-core Ivy Bridge CPUs Four channels of native DDR3 (1333) memory The first disk that is assigned to each node is a 6TB hybrid system/storage disk LED indicators for each node...
Servers Table 16 Server LEDs 1. System Power Button with LED for each node. 2. System ID LED Button for each NODE 3 NODE 4 node. 3. System Status LED for each node. 4. LAN Link/Activity LED for each node. NODE 1 NODE 2 CL5558...
Servers Figure 6 Server chassis rear view (all) 1. Node 1 2. Node 2 3. Node 3 4. Node 4 Note In the second server chassis in a five- or six- node configuration, the nodes (blades) must be populated starting with the node 1 slot. Empty slots must have blank fillers. Figure 7 Rear ports on nodes (all) 1.
Servers 2. RMM: A dedicated port for hardware monitoring (per node) 3. SAS to DAE. Used on U- and D-Series servers only. U-Series Gen1 has a single port. U-Series Gen2 hardware has two ports. The D-Series has one high density SAS cable with one connector.
Page 31
Servers Table 18 Default node names (continued) Node Node name Node Node name Node Node name sandy chicago seattle orem houston denver ogden phoenix portland layton dallas tucson logan detroit atlanta Lehi columbus fresno murray austin mesa Nodes positioned in the same slot in different racks at a site will have the same node name.
Switches ECS Appliance switches Provides a quick reference of private and public switches. Private switch—One 1 GbE private switch to handle management traffic. In a C- Series appliance with more than six servers, a second private switch is added. Public switch—Two 10 GbE switches to handle data traffic. In a C-Series appliance with more than six servers, two more public switches are added.
Switches Private switch: Cisco 3048 48-P The private switch is used for management traffic. It has 52 ports and dual power supply inputs. The switch is configured in the factory. Figure 8 Cisco 3048 ports (rear) Figure 9 Cisco 3048 ports (front) Table 20 Cisco 3048 switch configuration detail Figure label Ports Connection description...
Switches Note 1. The NAN (Nile Area Network) links all ECS Appliances at a site. 2. Ports 49 through 52 use CISCO 1G BASE-T SFPs (part number 100-400-141). In an ECS Appliance, these four SFPs are installed in the 1 GbE switch. In a customer-supplied rack order, these SFPs need to be installed.
Switches Private switch: Arista 7048T-48 The private switch is used for management traffic. It has 52 ports and dual power supply inputs. The switch is configured in the factory. Figure 11 Arista 7048T-48 ports Table 22 Arista 7048T-48 switch configuration detail Figure label Ports Connection description 1–24...
Switches Public switch: Arista 7050SX-64 The 7050SX-64 switch is a 52-port switch. The switch is equipped with 52 SFP+ ports, dual hot-swap power supplies, and redundant, field-replaceable fan modules. Figure 12 Arista 7050SX-64 ports hare ) Table 23 7050SX-64 switch port connections used on the top 10 GbE switch ( Figure label Ports Connection description 1–8...
10 GbE switches ship with one SFP - RJ-45 copper SFP installed in port 1. Fibre SFPs can be ordered through Dell EMC. An ECS appliance that is shipped in a Dell EMC rack has all SFPs installed, but not installed for a customer rack installation. In either case, the switch may require additional SFPs to be installed or reconfigured in ports 1–8...
10 GbE switches ship with one SFP - RJ-45 copper SFP installed in port 1. Fibre SFPs can be ordered through Dell EMC. An ECS appliance that is shipped in a Dell EMC rack has all SFPs installed, but not installed for a customer rack installation. In either case, the switch may require additional SFPs to be installed or reconfigured in ports 1–8...
10 GbE switches ship with one SFP - RJ-45 copper SFP installed in port 1. Fibre SFPs can be ordered through Dell EMC. An ECS appliance that is shipped in a Dell EMC rack has all SFPs installed, but not installed for a customer rack installation. In either case, the switch may require additional SFPs to be installed or reconfigured in ports 1–8...
Switches Public switch: Arista 7124SX The Arista 7124SX switch is equipped with 24 SFP+ ports, dual hot-swap power supplies, and redundant field replaceable fan modules. Figure 15 Arista 7124SX hare ) Table 29 7124SX switch port connections used on the top 10 GbE switch ( Figure label Ports Connection description The 10 GbE uplink data ports.
Page 43
10 GbE switches ship with one SFP - RJ-45 copper SFP installed in port 1. Fibre SFPs can be ordered through Dell EMC. An ECS appliance that is shipped in a Dell EMC rack has all SFPs installed, but not installed for a customer rack installation. In either case, the switch may require additional SFPs to be installed or reconfigured in ports 1–8...
Page 44
Switches D- and U-Series Hardware Guide...
CHAPTER 4 Disk Drives Integrated disk drives..................46 Storage disk drives.....................46 Disk array enclosures..................47 Disk Drives...
Disk Drives Integrated disk drives Describes disk drives that are integrated into the server chassis of the ECS Appliance. D-Series In D-Series servers, OS disks are integrated into the server chassis and are accessible from the front of the server chassis. Each node has one OS SSD drive. U-Series In U-Series servers, OS disks are integrated into the server chassis and are accessible from the front of the server chassis.
Disk Drives All disk drives must be the same size within a DAE All disk drives must be the same speed Disk array enclosures The D-Series and U-Series Appliance include disk array enclosures (DAEs). The DAE is a drawer that slides in and out of the 40U rack. The storage disk drives, I/O modules, and cooling modules are located inside of the DAE.
Disk Drives One I/O module containing two replaceable power supply units (PSUs). Serviced from the front. Three exhaust fans or cooling modules; n+1 redundant. Serviced from the rear. Two power supplies; n+1 redundant. Serviced from within the I/O module in front. Blank filler sleds for partially populated configurations.
Disk Drives Figure 18 Pikes Peak chassis with I/O module and power supplies removed, sleds extended Figure 19 Enclosure LEDs from the front Table 32 Enclosure LEDs Color State Description Enclosure "OK" Green Solid Enclosure operating normally Enclosure Fail Yellow Fast flashing Enclosure failure Enclosure Identify...
Disk Drives Sleds and disks The seven sleds are designated by letters A through G. Figure 20 Sleds letter designations Each sled must be fully populated with 14 8 TB drives of the same speed. The D6200 uses seven sleds and the D4500 uses five sleds. In the D4500 configuration, sleds positions C and E are populated by blank filler sleds.
Disk Drives Figure 21 Drive designations and sled LEDs Each sled and drive slot has an LED to indicate failure or to indicate that the LED was enabled by an identify command. Table 33 Sled and drive LEDs Color State Description Sled Identify/Fail Amber...
Disk Drives Figure 22 Disk drive in carrier Figure 23 Empty drive carrier I/O module and power supplies I/O module At the front of the enclosure is a removable base that includes the I/O module on the bottom and two power supplies on top. The I/O module contains all of the SAS functionality for the DAE.
Disk Drives Figure 24 I/O module separated from enclosure The front of the I/O module has a set of status LEDs for each SAS link. Figure 25 SAS link LEDs Pikes Peak (dense storage)
Disk Drives Table 34 SAS link LEDs Color State Description Mini-SAS Link OK Green Solid Valid SAS link detected Mini-SAS Identify/ Amber Slow flashing SAS link received an identify Fail command Mini-SAS Identify/ Amber Fast flashing SAS link failure Fail Note The Link OK and SAS A and B Fail are not Green and Amber fast flashing when the DAE is powered on and the node/SCSi HBA is not online (NO LINK).
Disk Drives Figure 27 Power supply LEDs Table 35 SAS link LEDs Color State Description PSU Fail Amber Solid There is a fault in the power supply PSU Identify Blue Solid The power supply received an identify command AC OK Green Solid AC power input is within regulation...
Disk Drives Figure 28 Enclosure fan locations Voyager DAE The Voyager DAE is used in U-Series ECS Appliances. Disk drives in Voyager DAEs Disk drives are encased in cartridge-style enclosures. Each cartridge has a latch that allows you to snap-out a disk drive for removal and snap-in for installation. The inside of each Voyager has physically printed labels that are on the left and the front sides of the DAE that describe the rows (or banks) and columns (or slots) where the disk drives are installed.
Disk Drives (Gen1) A DAE can contain 15, 30, 45, or 60 disks. (Gen1) The lower four DAEs must contain the same number of disks. (Gen1) The upper DAEs are added only after the lower DAEs contain 60 disks. (Gen1) The upper DAEs must contain the same number of disks. The figures show example layouts.
Disk Drives Figure 33 U-Series disk layout for 60-disk configurations Link control cards Each DAE includes a link control card (LCC) whose main function is to be a SAS expander and provide enclosure services. The LCC independently monitors the environment status of the entire enclosure and communicates the status to the system.
Disk Drives Figure 34 LCC with LEDs Figure 35 LCC Location CL4669 Fan control module Each DAE includes three fan control modules (cooling modules) on the front of the DAE. The fan control module augments the cooling capacity of each DAE. It plugs directly into the DAE baseboard from the top of the DAE.
Disk Drives Table 37 Fan control module fan fault LED Color State Description Fan fault Amber Fault detected. One or more fans faulted. — No fault. Fans operating normally. Figure 36 Fan control module with LED Figure 37 Location of fan modules Interconnect Module The Interconnect Module (ICM) is the primary interconnect management element.
Disk Drives connectors with corresponding LEDs. These LEDs indicate the link and activity of each SAS connector for input and output to devices. Note Disconnect power to the DAE when changing the ICM. Table 38 ICM bus status LEDs Color State Description Power fault...
Disk Drives Figure 38 ICM LEDs 1. Power fault LED (amber) 2. Power LED (green) 3. Link activity LEDs (blue/green) 4. Single SAS port that is used for Gen1 hardware. 5. Two SAS ports that are used for Gen2 hardware. Power supply The power supply is hot-swappable.
Disk Drives Table 40 DAE AC power supply/cooling module LEDs Color State Description AC power on (12 V Green OK. AC or SPS power applied. All output power): one LED for voltages are within respective operating each power cord. ranges, not including fan fault. —...
Transfers from Dell EMC to customer rack. Option: Customer rack enables the adjustment of rear rails to 24 inches so that Dell EMC fixed rails can be used. RPQ is not required if all third-party rack requirements in Table 41 on page 68 are met.
Page 69
The customer rack should have redundant power zones, one on each side of the rack with separate PDU power strips. Each redundant power zone should have capacity for the maximum power load. NOTE: Dell EMC is not responsible for any failures, issues, or outages resulting from failure of the customer provided PDUs.
Page 70
Third Party Rack Requirements D- and U-Series Hardware Guide...
CHAPTER 6 Power Cabling ECS power calculator..................72 U-Series single-phase AC power cabling ............72 U-Series three-phase AC power cabling.............74 D-Series single-phase AC power cabling ............77 D-Series three-phase AC power cabling.............79 C-Series single-phase AC power cabling ............83 C-Series 3-phase AC power cabling ..............
Power Cabling ECS power calculator Use the power and weight calculator to refine the power and heat values to more- closely match the hardware configuration for your system. The calculator contains the latest information for power and weight planning. U-Series single-phase AC power cabling Provides the single-phase power cabling diagram for the U-Series ECS Appliance.
Power Cabling Figure 40 U-Series single-phase AC power cabling for eight-node configurations (continued) Note For a four-node configuration, counting from the bottom of the rack, ignore DAEs 5 through 8 and server chassis 2. U-Series three-phase AC power cabling Provides cabling diagrams for three-phase AC delta and wye power. Three-phase Delta AC power cabling The legend maps colored cables that are shown in the diagram to part numbers and cable lengths.
Power Cabling Figure 42 Three-phase AC delta power cabling for eight-node configuration (continued) Note For a four-node configuration, counting from the bottom of the rack, ignore DAEs 5–8 and server chassis 2. Three-phase WYE AC power cabling The legend maps colored cables that are shown in the diagram to part numbers and cable lengths.
Power Cabling Figure 44 Three-phase WYE AC power cabling for eight-node configuration Note For a four-node configuration, counting from the bottom of the rack, ignore DAEs 5–8 and server chassis 2. D-Series single-phase AC power cabling Provides the single-phase power cabling diagram for the D-Series ECS Appliance. The switches plug into the front of the rack and route through the rails to the rear.
Power Cabling D-Series three-phase AC power cabling Provides cabling diagrams for three-phase AC delta and wye power. Three-phase Delta AC power cabling The legend maps colored cables shown in the diagram to part numbers and cable lengths. D-Series three-phase AC power cabling...
Power Cabling Figure 46 Three-phase AC delta power cabling for eight-node configuration D- and U-Series Hardware Guide...
Page 81
Power Cabling Figure 46 Three-phase AC delta power cabling for eight-node configuration (continued) Note For a four-node configuration, counting from the bottom of the rack, ignore DAEs 5–8 and server chassis 2. Three-phase WYE AC power cabling The legend maps colored cables shown in the diagram to part numbers and cable lengths.
Power Cabling Figure 47 Three-phase WYE AC power cabling for eight-node configuration (continued) Note For a four-node configuration, counting from the bottom of the rack, ignore DAEs 5–8 and server chassis 2. C-Series single-phase AC power cabling Provides the single-phase power cabling diagram for the C-Series ECS Appliance. The switches plug into the front of the rack and route through the rails to the rear.
Power Cabling Figure 49 C-Series single-phase AC power cabling for eight-node configurations: Bottom C-Series 3-phase AC power cabling Provides the 3-phase power cabling diagrams for the C-Series ECS Appliance. The switches plug into the front of the rack and route through the rails to the rear. D- and U-Series Hardware Guide...
Power Cabling Figure 51 C-Series 3-phase AC power cabling for eight-node configurations: Bottom D- and U-Series Hardware Guide...
Page 87
Power Cabling Figure 51 C-Series 3-phase AC power cabling for eight-node configurations: Bottom (continued) C-Series 3-phase AC power cabling...
Page 88
Power Cabling D- and U-Series Hardware Guide...
SAS Cabling U-Series SAS cabling Provides wiring diagrams for the SAS cables that connect nodes to Voyager DAEs. Gen2 Gen2 use two SAS cables for each node to DAE connection. The top port on the DAE is port 0 and always connects to the SAS adapter's left port on the node.
SAS Cabling Figure 53 U-Series (Gen2) SAS cabling Gen1 Note Hardware diagrams number nodes starting with zero. In all other discussions of ECS architecture and software, nodes are numbered starting with one. D- and U-Series Hardware Guide...
SAS Cabling Figure 54 U-Series (Gen1) SAS cabling for eight-node configurations D-Series SAS cabling Provides wiring diagrams for the SAS cables that connect nodes to Pikes Peak DAEs. D-Series has one High Density SAS cable (two cables put together); One connector on the HBA and one connector on the I/O Module.
Network Cabling Connecting ECS appliances in a single site The ECS appliance management networks are connected together through the Nile Area Network (NAN). The NAN is created by connecting either port 51 or 52 to another turtle switch of another ECS appliance. Through these connections, nodes from any segment can communicate to any other node in the NAN.
The following figure shows a simplified network cabling diagram for an eight-node configuration for a U- or D-Series ECS Appliance as configured by Dell EMC or a customer in a supplied rack. Following this figure, other detailed figures and tables provide port, label, and cable color information.
Network Cabling Figure 67 C-Series private switch cabling for the upper segment from the rear D- and U-Series Hardware Guide...
Page 113
Network Cabling Figure 67 C-Series private switch cabling for the upper segment from the rear (continued) Network cabling...
Page 114
Network Cabling Figure 67 C-Series private switch cabling for the upper segment from the rear (continued) Customer network connections Customers connect to an ECS Appliance by way of 10 GbE ports and their own interconnect cables. When multiple appliances are installed in the same data center, daisy chain or home-run connections the private switches to a customer-provided switch.
Need help?
Do you have a question about the ECS D Series and is the answer not in the manual?
Questions and answers