Dell PowerEdge R730xd Deployment Manual

Dell PowerEdge R730xd Deployment Manual

Emc networking with isilon front-end deployment and best practices guide
Hide thumbs Also See for PowerEdge R730xd:

Advertisement

Dell EMC Networking with Isilon Front-End
Deployment and Best Practices Guide
Dell EMC Networking Infrastructure Solutions
June 2018

Advertisement

Table of Contents
loading

Summary of Contents for Dell PowerEdge R730xd

  • Page 1 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide Dell EMC Networking Infrastructure Solutions June 2018...
  • Page 2 Gerald Myres, Jordan Wilson The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.
  • Page 3: Table Of Contents

    Configuration of S4048-ON OS10EE Leaf Switches ..................45 Configuration of S4048-ON OS9 Leaf Switches ....................50 Validation ..................................58 OS10EE Validation commands ........................58 OS9 Validation commands ..........................63 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 4 Dell EMC Networking Switches ........................76 Dell EMC Isilon Array ............................76 Dell EMC PowerEdge Servers ......................... 76 Product Manuals and technical guides ........................77 Support and feedback ..............................78 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 5: Introduction

    Introduction Dell EMC Isilon is the leading scale-out network-attached storage (NAS) platform and offers the right blend of performance and capacity to support a wide range of unstructured data workloads including high-performance computing (HPC), file shares, home directories, archives, media content, video surveillance, and in-place data analytics.
  • Page 6 The Dell EMC S4048-ON will be used as leaf switches, and the Dell EMC Z9100-ON will be used in this guide as a spine switch. The Dell EMC S3048-ON will be used as a management switch for the iDRAC connections, out-of-band switch management, as well as the external Isilon connections.
  • Page 7: Typographical Conventions

    This .pdf includes switch configuration file attachments. To access attachments in Adobe Acrobat Reader, click the icon in the left pane halfway down the page, then click the icon. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 8: Hardware Overview

    Dell EMC PowerEdge R730xd The Dell EMC PowerEdge R730xd is a 2-RU, two-socket server platform. It allows up to 32 x 2.5” SSDs or HDDs with SAS, SATA, and NVMe support. In this guide, two R730xd servers are used to connect to the Isilon storage.
  • Page 9: Dell Emc Poweredge R640

    Dell EMC PowerEdge R640 Isilon X210 The Dell EMC Isilon X210 is a 2-RU, scale-out NAS system. The Isilon X210 is used to create a storage cluster to support an SMB share in this guide. Dell EMC Isilon X210 front view Dell EMC Isilon X210 rear view Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 10: Management

    This can be seen in Figure 9 below, all equipment in other racks is configured in a similar fashion. Management configurations for rack 1 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 11: Leaf-Spine Overview

    In a layer 3 topology, additional spines may be added as needed to provide additional paths and bandwidth. Therefore, a layer 3 topology is more scalable and is better suited for very large networks. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 12: Oversubscription

    Configuring each leaf pair in a Virtual Link Trunking (VLT). • Dell EMC recommends that RSTP always is configured as a best practice. Although configuring VLT will create a loop free topology, RSTP will prevent loops if there is a misconfiguration in the network.
  • Page 13: Scaling

    0.950 : 1 Scaling An example of scaling this solution in a two-tier leaf-spine is a configuration of up to 16 racks. The Dell/EMC Z9100-ON has thirty-two 40/100GbE interfaces that would support 16 leaf pairs using VLT. This provides one rack that contains WAN-edge connectivity and 15 racks for servers and storage nodes.
  • Page 14: Layer 3 Leaf-Spine Topology

    2. Connections to external networks are made from a pair of edge or border leafs as shown in Figure 12. Layer 3 leaf-spine network Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 15: Layer 2 Leaf-Spine Topology

    Connections from hosts to leaf switches are also layer 2. For connections to external networks, layer 3 links are added between the spines and a pair of edge leafs. Layer 2 leaf-spine network Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 16: Layer 3 Topology Preparation

    Figure 15 shows the loopback addresses used as router IDs in the example provided. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 17: Point-To-Point Interfaces

    Eth1/1/49 192.168.1.0/31 Spine 1 Eth1/1/1 Leaf 1 Eth1/1/50 192.168.2.0/31 Spine 2 Eth1/1/1 Leaf 2 Eth1/1/49 192.168.1.2/31 Spine 1 Eth1/1/2 Leaf 2 Eth1/1/50 192.168.2.2/31 Spine 2 Eth1/1/2 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 18 Spine 1 Eth1/1/4 Leaf 4 Eth1/1/50 192.168.2.6/31 Spine 2 Eth1/1/4 The point-to-point IP addresses used in this guide are shown in Figure 16: Point-to-point IP addresses Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 19: Configuration Of Layer 3 Topology

    This section will cover the configuration of the layer 3 topology. In the example provided there are three Isilon nodes connected to each leaf pair as well as two Dell PowerEdge servers that will be consuming the storage. The connections for the first node are shown in the diagram. Each subsequent node is cabled similarly. The configurations for all connections are detailed in the following sections.
  • Page 20 Next, assign IP addresses per Table 3. Configure a loopback interface to be used as the router ID. Isilon’s OneFS supports and recommends the use of jumbo frames. Each interface used below will be configured using jumbo frames. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 21 The command seq 10 permit 10.0.1.0/24 ge 32 includes all addresses in the 10.0.1.0/24 address range with a mask greater than or equal to 32. This includes all loopback addresses used as router IDs. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 22 This is to prevent BGP speakers from advertising updates immediately upon receipt. Instead, they will advertise them in batched intervals of one second. This delay is to prevent overhead. Finally, exit configuration mode and save the configuration. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 23: Configuration Of S4048-On Os10Ee Leaf Switches

    Configuration of S4048-ON OS10EE Leaf Switches Configurations of the leaf switches one and two running OS10EE will be shown next as seen in Figure 19. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 24 Interface enumeration Server/Isilon Node Switch Leaf interface Node 01-1 Leaf 1 ethernet 1/1/1 Leaf 2 ethernet 1/1/1 Node 01-2 Leaf 1 ethernet 1/1/3 Leaf 2 ethernet 1/1/3 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 25 VLTi to a value of 9216. Isilon’s OneFS supports and recommends the use of jumbo frames. Note: Refer to Isilon Network Design Considerations for more information on specific protocols as they relate to OneFS. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 26 VLAN 100. The vlt-port-channel command enables port channels on VLT peers to function as a single port channel. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 27 The downstream interfaces will be configured in the next section. Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to reduce packet drops and resulting retransmissions.
  • Page 28 The two upstream layer 3 interfaces connected to the spine switches are configured. Assign IP addresses per Table 3. Configure a loopback interface to be used as the router ID. This is used with BGP. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 29 24 ge 24 Uplink Failure Detection (UFD) is configured next. UFD is a feature that shuts down specified downstream interfaces when all specified uplinks become disabled. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 30 This is to prevent BGP speakers from advertising updates immediately upon receipt. Instead, they will advertise them in batched intervals of one second. This delay is to prevent overhead. Finally, exit configuration mode and save the configuration. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 31 192.168.2.0 neighbor 192.168.2.2 inherit template spine-leaf inherit template spine-leaf remote-as 64602 remote-as 64602 no shutdown no shutdown write memory write memory Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 32: Configuration Of S4048-On Os9 Leaf Switches

    The ports for additional Isilon nodes and servers in this example can be found in the following table: Interface enumeration Server/Isilon Node Switch Leaf interface Node 01-4 Leaf 3 tengigabitethernet 1/1/1 Leaf 4 tengigabitethernet 1/1/1 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 33 The backup destination is only utilized for the VLT heartbeat. Once VLT is enabled, it will dynamically change the MTU settings for the VLTi to a value of 9216. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 34 The downstream interfaces will be configured in the next section. Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to reduce packet drops and resulting retransmissions. This feature should be applied on all host interfaces that support flow control. In OS10EE this is enabled by default, in OS9 it must be configured.
  • Page 35 LACP port-channel-protocol LACP port-channel 102 mode active port-channel 102 mode active mtu 9216 mtu 9216 flowcontrol rx on tx off flowcontrol rx on tx off Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 36 Isilon nodes. Each port channel is assigned an MTU of 9216 to support jumbo frames. The vlt-port-channel # command enables port channels on VLT peers to function as a single port channel. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 37 172.16.2.240/24. Server 3’s default gateway is configured as 172.16.2.254/24. The virtual address assigned to the VRRP group will provide fault tolerance if either leaf goes offline. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 38 32. This includes all loopback addresses used as router IDs. The command seq 20 permit 172.16.0.0/16 ge 24 includes the 172.16.1.0/24 network used on Leafs 1 and 2 as shown in Figure 14. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 39 This number should be equal to or greater than the number of spines, up to 64. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 40 192.168.2.4 remote-as 64602 neighbor 192.168.2.6 remote-as 64602 neighbor 192.168.2.4 peer-group spine-leaf neighbor 192.168.2.6 peer-group spine-leaf neighbor 192.168.2.4 no shutdown neighbor 192.168.2.6 no shutdown write memory write memory Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 41: Configuration Of Layer 2 Topology

    This section will cover the configuration of the layer 2 topology. In the example provided there are three Isilon nodes connected to each leaf pair as well as two Dell PowerEdge servers that will be consuming the storage. The connections from the spine switches to the OS10EE leaf pair will be configured in port channel 49, while the connections to the OS9 leaf pair will be configured in port channel 50.
  • Page 42 First, configure the VLT on each spine switch. Once VLT is enabled, it will dynamically change the MTU settings for the VLTi to a value of 9216. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 43 Z9100-ON Spine 1 Z9100-ON Spine 2 interface breakout 1/1/1 map 40g-1x interface breakout 1/1/1 map 40g-1x interface breakout 1/1/2 map 40g-1x interface breakout 1/1/2 map 40g-1x Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 44 R2-Leaf-B no shutdown no shutdown no switchport no switchport channel-group 50 mode active channel-group 50 mode active mtu 9216 mtu 9216 write memory write memory Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 45: Configuration Of S4048-On Os10Ee Leaf Switches

    Configuration of S4048-ON OS10EE Leaf Switches Configurations of Leaf 1 and Leaf 2 running OS10EE will be shown next as seen in Figure 23. OS10EE Leaf pair Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 46 VLT peer routing on each switch. Once VLT is enabled, it will dynamically change the MTU settings for the VLTi to a value of 9216. Isilon’s OneFS supports and recommends the use of jumbo frames. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 47 VLAN 100. The vlt-port-channel # command enables port channels on VLT peers to function as a single port channel. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 48 The downstream interfaces will be configured in the next section. Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to reduce packet drops and resulting retransmissions.
  • Page 49 9216 flowcontrol receive on flowcontrol receive on flowcontrol transmit off flowcontrol transmit off Next, Configure the upstream port channels as well as the corresponding interfaces. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 50: Configuration Of S4048-On Os9 Leaf Switches

    Finally, exit configuration mode and save the configuration. Configuration of S4048-ON OS9 Leaf Switches Configurations in this section cover the leaf switches 3 and 4 running OS9 as seen in Figure 24. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 51 1/1/1 Leaf 4 tengigabitethernet 1/1/1 Node 01-5 Leaf 3 tengigabitethernet 1/1/3 Leaf 4 tengigabitethernet 1/1/3 Node 01-6 Leaf 3 tengigabitethernet 1/1/5 Leaf 4 tengigabitethernet 1/1/5 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 52 The unit-id # command will designate the primary VLT member. Once VLT is enabled, it will dynamically change the MTU settings for the VLTi to a value of 9216. Isilon’s OneFS supports and recommends the use of jumbo frames. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 53 Note: When port channel 128 is added to the vlt domain the MTU setting is automatically changed to 9216. The downstream interfaces will be configured in the next section. Dell recommends asymmetrical flow control (rx on tx off) on S4048-ON leaf switches which have sufficient egress buffers to reduce packet drops and resulting retransmissions.
  • Page 54 The vlt-peer-lag-port-channel # command ensures that each switch in the VLT is aware of all port channels and can act accordingly in the event of a switch failure. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 55 “Server 4” description “Server 4” no shutdown no shutdown switchport switchport mtu 9216 mtu 9216 vlt-peer-lag port-channel 102 vlt-peer-lag port-channel 102 spanning-tree rstp edge-port spanning-tree rstp edge-port Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 56 1,3,5,101,102 tagged port-channel 50 tagged port-channel 50 Uplink Failure Detection (UFD) is configured next. UFD shuts down all downstream interfaces if all uplinks fail. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 57 50 upstream port-channel 50 write memory write memory Finally, exit configuration mode and save the configuration with the end and write commands. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 58: Validation

    10.60.1.0 and 172.16.1.0, each have two paths from Z9100-Spine1, one through each leaf. The first set of routes with a subnet mask of /32 are the IPs configured for router IDs. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 59 20/0 01:00:11 EX 10.0.2.2/32 via 192.168.1.0 20/0 00:59:23 via 192.168.2.0 EX 10.0.2.3/32 via 192.168.1.0 20/0 01:00:11 via 192.168.2.0 EX 10.0.2.4/32 via 192.168.1.0 20/0 01:00:11 via 192.168.2.0 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 60 VLANs of all VLT LAGs. The local and peer status must both be up. S4048-Leaf1# show vlt 127 vlt-port-detail vlt-port-channel ID : 1 VLT Unit ID Port-Channel Status Configured ports Active ports Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 61 This command is used to validate the UFD status on leaf switches in this topology. Status: Enabled, Up indicates UFD is enabled and no interfaces are currently disabled by UFD. S4048-Leaf1# show uplink-state-group 1 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 62 Role PortID Prio Cost Cost Link-type Edge ------------------------------------------------------------------------------- port-channel1 Desg 128.2517 128 1000 AUTO port-channel3 Desg 128.2519 128 1000 AUTO port-channel5 Desg 128.2521 128 1000 AUTO Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 63: Os9 Validation Commands

    If all paths do not appear, make sure the maximum-paths statement in the BGP configuration is equal to or greater than the number of spines in the topology. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 64 Remote system version: 6(8) Delay-Restore timer: 90 seconds Delay-Restore Abort Threshold: 60 seconds Peer-Routing : Enabled Peer-Routing-Timeout timer: 0 seconds Multicast peer-routing timeout: 150 seconds Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 65 This command validates spanning tree is enabled on the leaf switches. All interfaces are forwarding (Sts column shows FWD). One of the leaf switches (S4048-Leaf1 in this example) is the root bridge, and sever- facing interfaces are edge ports. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 66: Show Vrrp Brief

    S4048-Leaf3#show vrrp brief Interface Group Pri Pre State Master addr Virtual addr(s) Description -------------------------------------------------------------------------------- Vl 200 IPv4 200 150 Y Master 172.16.2.252 172.16.2.254 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 67: Isilon Configuration

    The 10gige-1 and 10gige-2 interfaces for user connectivity will be configured in the next section. Isilon configuration parameters Parameter Value Option [ 1] Create a new cluster Configure root/admin "password" passwords Configuration Name Cluster-01 Cluster Encoding [ 8] UTF-8 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 68 3. Repeat for all nodes that need to be added to the cluster. Each node will be dynamically assigned an IP address out of the IP pool that was designated in the cluster creation. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 69: Configuring Lacp To Each Node

    1. Navigate to a web page and use the first IP address in the range defined for the ext-1 interface, https://100.67.170.140:8080. This will bring you to the first node in the cluster. OneFS Web GUI Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 70 9. Set the SmartConnect Service subnet, subnet1. 10. Ensure that the Aggregation Mode is set to LACP. 11. Complete steps 4-10 to create pool2 in subnet2. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 71 Parameter Value Subnet 172.16.2.0 Netmask 255.255.255.0 Gateway 172.16.1.254 2. Navigate Network configurations>subnet2>pool2, Add static route to subnet 1. Parameter Value Subnet 172.16.1.0 Netmask 255.255.255.0 Gateway 172.16.2.254 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 72: Configuring Smb Share

    1. From the OneFS GUI select File System > File System Explorer. 2. Select Create Directory. 3. Define the directory name, “SMB,” as well as the user, group, and permission settings as shown. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 73: Setting Up Dns For Smartconnect

    Using the FQDN that was configured previously for the SmartConnect zones is required. This section will cover the completion of the SmartConnect configuration. 1. Login to the DNS server. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 74: Validation

    SmartConnect zone within the OneFS file system. The Delegation zone, however, needs to have a name that matches the SmartConnect zone. This will ensure that a connection to sczone1.dell.local will reference the SmartConnect Zone 1 IP of 172.16.1.249. When this IP is referenced, it will round robin through each node IP, assigning the workload to each node in turn, ensuring a balanced workload.
  • Page 75 Validation 1. Login to Server 01 and issue a Run command of \\sczone2.dell.local. This will bring up the folder structure that was created in the OneFS file system. 2. Create a file or a folder in order to verify read/write permissions.
  • Page 76: A Validated Hardware And Components

    14.20.18.20 adapter Inter®Ethernet 10G X520 18.3.6 Intel® Ethernet 10G X710 rNDC 18.3.6 R640 Windows Server 2016 BIOS 1.2.11 iDRAC 3.15.17.15 Intel® Ethernet 10G X710 rNDC 18.3.6 Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 77: Product Manuals And Technical Guides

    Create a New NIC Team on a Host Computer or VM Microsoft's DNS Resource Record Management Dell EMC Leaf-Spine Deployment Guide Dell EMC Networking L3 Design for Leaf-Spine with OS10EE Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...
  • Page 78: C Support And Feedback

    Telephone: USA: 1-800-945-3355 Feedback for this document We encourage readers to provide feedback on the quality and usefulness of this publication by sending an email to Dell_Networking_Solutions@Dell.com. Dell EMC Networking with Isilon Front-End Deployment and Best Practices Guide | version 1.0...

This manual is also suitable for:

S3048-onS4048-onIsilon x210Z9100-onPoweredge r640

Table of Contents