Dell EMC VxRail E Series Network Manual
  1. Manuals
  2. Brands
  3. Dell EMC Manuals
  4. Server
  5. VxRail E series
  6. Network manual

Dell EMC VxRail E Series Network Manual

Physical and logical network considerations and planning
Hide thumbs Also See for VxRail E Series:
Table of Contents

Advertisement

Quick Links

See also: Owner's Manual
WHITE PAPER
-
DELL EMC VxRAIL™ NETWORK GUIDE
Physical and Logical Network Considerations and Planning
ABSTRACT
This is a planning and consideration guide for VxRail Appliances. It can be used to
understand better the networking required for VxRail implementation. This
whitepaper does not replace the requirement for implementation services with
VxRail Appliances and should not be used in an attempt to implement the
required networking for VxRail Appliances.
December 2018

Advertisement

Table of Contents
loading

Related Manuals for Dell EMC VxRail E Series

Summary of Contents for Dell EMC VxRail E Series

  • Page 1 WHITE PAPER DELL EMC VxRAIL™ NETWORK GUIDE Physical and Logical Network Considerations and Planning ABSTRACT This is a planning and consideration guide for VxRail Appliances. It can be used to understand better the networking required for VxRail implementation. This whitepaper does not replace the requirement for implementation services with VxRail Appliances and should not be used in an attempt to implement the required networking for VxRail Appliances.

  • Page 2: Table Of Contents

    Step 9. Decide on VxRail Logging Solution ..............................24 Step 10: Decide on Passwords for VxRail Management .......................... 24 Step 11: Prepare for Dell EMC SmartFabric services enablement ...................... 25 Setting up the upstream network for VxRail ............................ 26 Setting up the network switch for VxRail connectivity ........................ 27 Step 1.
  • Page 3 Limit Spanning Tree Protocol on VxRail Switch Ports ........................30 Step 3. Configure Ports and VLANs on Your Switch(es) .......................... 30 Confirm Your Data Center Network..............................32 Configuring a Workstation/Laptop for VxRail Initialization ..................... 33 Perform Initialization to create VxRail cluster ..........................34 After VxRail Initialization Network Considerations ........................

  • Page 4: Intended Use And Audience

    The compute nodes are based on Dell EMC PowerEdge servers. The G Series consists of up to four nodes in a single chassis, whereas all other models based on a single node. A 10Gb Ethernet switch (or a 1Gb Ethernet switch for certain models of VxRail) is required.

  • Page 5: Planning Your Data Center Network For Vxrail

    Planning Your Data Center Network for VxRail The network considerations for VxRail are no different from those of any enterprise IT infrastructure: availability, performance, and extensibility. VxRail Appliances are delivered to your data center ready for deployment. The nodes in the appliance can attach to any compatible network infrastructure at 10 or 25GbE speeds with either RJ45 or SFP+ ports.
  • Page 6 Each VxRail model series offers choices for network connectivity. The following illustrations show some of the physical network port options for the VxRail models. Figure 1. Back view of VxRail E Series on Dell 14th Generation PowerEdge Servers Figure 2. Back view of VxRail V, P and S Series on Dell 14 Generation PowerEdge Servers Figure 3.

  • Page 7: Network Switch

    VxRail 14 Generation Node Connectivity Summary • E, P, S and V Series (14th Generation Dell EMC PowerEdge Servers) Appliance Connectivity Options 2x10GbE in either SFP+ or RJ-45 NIC ports 4x10GbE in either SFP+ or RJ-45 NIC ports Network Planning Guide...
  • Page 8 VxRail Pre-14 Generation Node Connectivity Summary • E, P, S and V Series (13th Generation Dell EMC PowerEdge Servers) 2x10GbE + 2x1GbE in either SFP+ or RJ-45 NIC ports • E, P, and S Series (13th Generation Dell EMC PowerEdge Servers) 1GbE connectivity is supported on single processor models only The 2x10GbE ports will auto-negotiate to 1GbE when used with 1GbE networking.

  • Page 9: Topology And Connections

    • VxRail nodes supporting 10GbE can be configured with either 2 ports supporting VxRail cluster network traffic, or all 4 ports can be configured for the VxRail cluster network traffic. • 4 ports are required for each VxRail node when utilizing 1GbE networking on the supported single processor models. •...

  • Page 10: Out-Of-Band Management (Optional)

    Figure 6. Network topology of a 4-node VxRail cluster connected to two 10GbE switches using 2x10Gb connections per node, and a separate switch for out-of-band management For 13th generation PowerEdge servers in the E, P, S and V series VxRail Appliances utilizing 1GbE with two switches, the switches must be interconnected.

  • Page 11: Dell-Emc Smartfabric Network Mode

    More detailed information on VMware Validated Design on VxRail is located here: https://community.emc.com/docs/DOC-66332 Dell-EMC SmartFabric Network Mode Dell network switches support SmartFabric services, which enables the configuration and operations of the switches to be controlled outside of the standard management console through a REST-API interface. Certain Dell switch models support initializing the switches with a VxRail personality profile at power-on, which then forms a unified network fabric, and enables VxRail becomes the source for the automated configuration and...

  • Page 12: Vsan Stretched Cluster

    • At the time of VxRail deployment, you must choose the method of network switch configuration. Enabling the VxRail personality profile on the switches resets the switches to the default state, and passes switch configuration responsibility to VxRail. If you choose this method, all of the switch configuration functionality except basic management functions are disabled at the console, and VxRail and the Dell-EMC OMNI plug-in are the tools going forward for network switch configuration management.

  • Page 13: Planning The Vxrail Implementation

    VxRail nodes with SFP+ ports require optics modules (transceivers) and optical cables, or Twinax Direct-Attach- Copper (DAC) cables. These cables and optics are not included; you must supply your own. The NIC and switch connectors and cables must be on the same wavelength. Step 4.

  • Page 14: Step 1: Decide On Vxrail Single Point Of Management

    Dell EMC VxRail vCenter Server Planning Guide for details. Dell EMC strongly recommends that you take care during this planning and preparation phase, and decide on the single point of management option that will work most effectively for your organization Once VxRail initialization has configured the final product, the configuration cannot be changed easily.
  • Page 15 Alternately, you can configure a custom management VLAN to allow tagged management traffic after you power on each node, but before you run VxRail initialization. Your Dell EMC service representative will take care of this during installation. The Internal Management network is used solely for device discovery by VxRail Manager during initial implementation and node expansion.
  • Page 16 Network Configuration Enter a VLAN ID for vSphere vMotion. Table (Enter a 0 in the VLAN ID field for untagged traffic) ✓ Row 34 Network Configuration Enter a VLAN ID for vSAN. Table (Enter a 0 in the VLAN ID field for untagged traffic) ✓...

  • Page 17: Step 3: Plan Network Settings For Vxrail Management Components

    Step 3: Plan Network Settings for VxRail Management Components During the VxRail automated implementation process, IP addresses entered are assigned to the components within the VxRail cluster that are part of the Management network. The IP addresses assigned to the components within the Management network must follow certain rules: •...
  • Page 18 Reserve 1 IP address if you choose to deploy SRS-VE (Secure Remote Services Virtual Edition) in the VxRail cluster • If you are planning to deploy a VxRail cluster that requires a witness at a remote third site, such as VxRail stretched cluster, then two IP addresses are required to deploy the witness virtual appliance.

  • Page 19: Step 4: Identify Unique Hostnames For Vxrail Management Components

    Network Configuration Table Enter the IP address for VxRail vCenter ✓ Row 15 Network Configuration Table Enter the IP address for VxRail Platform Service Controller ✓ Row 17 Record the IP address for Log Insight. Leave this entry blank if you will not deploy Log Insight on VxRail Network Configuration Table Enter the IP address for vSphere Log Insight...
  • Page 20 the first ESXi host. For example, if the prefix is “host,” the separator is “None,” the iterator is “Num 0X”, the offset is empty, and the suffix is “lab”, and the domain is “local,” the first ESXi hostname would be “host01lab.local”. The domain is also automatically applied to the VxRail management components.

  • Page 21: Step 5: Identify External Applications And Settings For Vxrail

    Network Configuration Table Enter the hostname for Log Insight. ✓ Row 41 Step 5: Identify external applications and settings for VxRail VxRail is dependent on specific applications in your data center to be available to VxRail over your data center network. These data center applications must be accessible to the VxRail management network.

  • Page 22: Step 7: Prepare Customer-Supplied Vcenter Server

    and are assigning a hostname and IP address. These components can include VxRail Manager, VxRail vCenter Server, VxRail Platform Service Controller, Log Insight, and each ESXi host in the VxRail cluster. The DNS entries must support both forward and reverse lookups. Figure 8.

  • Page 23: Step 8. Reserve Ip Addresses For Vxrail Vmotion And Vsan Networks

    Provide vCenter login credentials with administrator privileges Create a new set of credentials in your vCenter for this purpose. Two new roles will be created and assigned to this user by your Dell EMC Representative. Network Configuration Enter the administrative username/password for the Customer Supplied vCenter Server., or the...

  • Page 24: Step 9. Decide On Vxrail Logging Solution

    NOTE: The Dell EMC service representative will need passwords for the VxRail accounts in this table. For security purposes, you can choose to enter the passwords during the VxRail initialization process, as opposed to providing them visibly in a document.

  • Page 25: Step 11: Prepare For Dell Emc Smartfabric Services Enablement

    Server password documentation. Step 11: Prepare for Dell EMC SmartFabric services enablement NOTE: Skip this section if you do not plan to enable Dell-EMC SmartFabric services to pass control of switch configuration to VxRail If you have decided to want to enable the Dell-EMC SmartFabric feature, and pass control of switch configuration management to VxRail and the Dell-EMC OMNI vCenter plug-in, then a VLAN for the VxRail Cluster Build Network must be defined.

  • Page 26: Setting Up The Upstream Network For Vxrail

    Network Configuration If you plan to enable Dell-EMC SmartFabric services on your switches and Table enable the VxRail personality profile, enter a VLAN ID for the VxRail Cluster ✓ Row 44 Build Network. Network Configuration Table Enter the IP address for Dell-EMC OMNI vCenter plug-in ✓...

  • Page 27: Setting Up The Network Switch For Vxrail Connectivity

    Step 3. If applicable, configure the VxRail Cluster Build Network VLAN (Row 44) on the spine switch Step 4. If applicable, configure the VxRail Witness Traffic Separation Network VLAN (Row 50) on the spine switch Step 5. Create a logical pair (port channel) on the spine switch ports that will connect downstream to the uplinks on the TOR switch.

  • Page 28: Enable Uplinks To Pass Inbound And Outbound Vxrail Network Traffic

    Prior to VxRail 4.5.0, IPv4 multicast is required for the vSAN VLAN. The network switch(es) that connect to VxRail must allow for pass-through of multicast traffic on the vSAN VLAN. Multicast is not required on your entire network, just on the ports connected to VxRail.

  • Page 29: Do Not Enable Link Aggregation On Vxrail Switch Ports

    • Tagged-access mode – The port accepts only tagged packets. Do not enable Link Aggregation on VxRail Switch Ports Do not use link aggregation, including protocols such as LACP and EtherChannel, on any ports directly connected to VxRail nodes. VxRail Appliances use the vSphere active/standby configuration (NIC teaming) for network redundancy. However, LACP could be enabled on non-system ports, such as additional NIC ports or 1G ports, for user traffic.

  • Page 30: Limit Spanning Tree Protocol On Vxrail Switch Ports

    Virtual Standby Active Unused Unused Machines Limit Spanning Tree Protocol on VxRail Switch Ports Network traffic must be allowed uninterrupted passage between the physical switch ports and the VxRail nodes. Certain Spanning Tree states can place restrictions on network traffic, and can force the port into an unexpected timeout mode. These conditions caused by Spanning Tree can disrupt VxRail normal operations and impact performance.
  • Page 31 • VM Networks VLANs Figure 10. VxRail Logical Networks: Prior to version 4.7 and version 4.7 and later • If required, the additional VxRail Witness Traffic Separation VLAN Using the VxRail Network Configuration Table, perform the following steps: Step 1. Configure a VLAN on the switch(es) for each VxRail logical network Step 2.

  • Page 32: Confirm Your Data Center Network

    Step 8. Configure the VLANs for your VM Networks (Rows 39-41) on the switch ports. Step 9. Configure the switch uplinks to allow the External Management VLAN (Row 1) and VM Network VLANs (Rows 39-40) to pass through. Include the optional VxRail Witness Traffic Separation VLAN (Row 50) on the uplinks if required.

  • Page 33: Configuring A Workstation/Laptop For Vxrail Initialization

    Otherwise, change the IP address on your workstation/laptop when instructed to and then return to VxRail Manager to continue with the initialization process. If you cannot reach the VxRail initial IP address, Dell EMC support team can configure a custom IP address, subnet mask, and gateway on VxRail Manager before initialization.

  • Page 34: Perform Initialization To Create Vxrail Cluster

    If you have successfully followed all of the steps listed in this document, you are ready to move to the final phase: connect the laptop/workstation to a switch port, and perform VxRail initialization. These steps are done by Dell EMC service representatives, and are included here to help you understand the complete process.

  • Page 35: After Vxrail Initialization Network Considerations

    Step 15. If the Dell-EMC SmartFabric services was enabled to pass control of switch configuration to VxRail, the Dell-EMC OMNI plug-in is deployed on the vCenter instance After VxRail Initialization Network Considerations Support for NSX VxRail is fully compatible with other software in the VMware ecosystem, including VMware NSX. A primer on deploying NSX on VxRail can be found in Appendix A.

  • Page 36: Vxrail Network Configuration Table

    VxRail Network Configuration Table The Dell EMC service representative will use a VxRail Pre-Site Installation tool with the following information: Category Description VxRail External The recommended is untagged traffic on the Native VLAN. If you want the host to send only tagged frames, manually configure the VLAN on each ESXi™...
  • Page 37 Build Network services, then this VLAN is entered at the time of profile enablement. The VLAN is permanent, VLAN ID and can only be changed by a switch fabric reset. Dell-EMC IP address OMNI plug-in Subnet Mask Gateway Witness Site Management IP Witness management network IP address Address...

  • Page 38: Vxrail Password Tables

    VxRail Password Tables Item Account Password VxRail Manager root VxRail vCenter Server administrator@<SSO Domain> root management VxRail Platform Service Controller root vRealize Log Insight root admin Item Account Password ESXi Host #1 root ESXi Host #2 root ESXi Host #3 root ESXi Host #4 root...

  • Page 39: Vxrail Setup Checklist

    VxRail Setup Checklist Physical Network ✓ VxRail cluster: Decide if you want to plan for additional nodes beyond the initial three (or four)-node cluster. You can have up to 64 nodes in a VxRail cluster ✓ VxRail ports: Decide how many ports to configure per VxRail node, what port type, and what network speed Network switch: Ensure your switch supports VxRail requirements, and provides the connectivity option you chose for your VxRail nodes.
  • Page 40 Configure your selected external management VLAN (recommended is untagged/native). ✓ If applicable, configure your internal management VLAN ✓ Confirm that IPv6 multicast is configured/enabled on either the external management VLAN (prior to version 4.7) or ✓ internal management VLAN (version 4.7 and later) ✓...

  • Page 41: Appendix A: Nsx Support On Vxrail

    Appendix A: NSX Support on VxRail VxRail supports VMware NSX software-defined networking (SDN) through vCenter Server. vCenter Server offers a fully integrated option for SDN and network-layer abstraction with NSX. The NSX network-virtualization platform delivers for networking what VMware delivers for compute and storage. In much the same way that server virtualization allows operators to programmatically create, snapshot, delete, and restore software-based virtual machines (VMs) on demand, NSX enables virtual networks to be created, saved, deleted, and restored on demand without requiring reconfiguration of the physical network.
  • Page 42 Figure 11. NSX component information flow: NSX Manager, NSX Controller, NSX Edge, NSX vSwitch One NSX Manager maps to a single vCenter Server and multiple NSX Edge, vShield Endpoint, and NSX Data Security instances. Before you install NSX in your vCenter Server environment, consider your network configuration and resources using the chart below.
  • Page 43 NSX Resource Requirements: Memory Disk Space vCPU NSX Manager 12GB 60GB NSX Edge: • Compact 512MB 512MB • Large 512MB • Extra Large 4.5GB (with 4GB swap) • Quad Large 512MB vShield Endpoint NSX Data Security 512MB 6GB per ESXi host In a VxRail cluster, the key benefits of NSX are consistent, simplified network management and operations, plus the ability to leverage connected workload mobility and placement.

  • Page 44: Appendix B: Vxrail Open Ports Requirement

    Appendix B: VxRail Open Ports Requirement Use the tables in this appendix for guidance on firewall settings specific for the VxRail cluster The VxRail cluster needs to be able to connect to specific applications in your data center. DNS is required and NTP is optional. Open the necessary ports to enable connectivity to the external syslog server, and for LDAP and SMTP Data Center Application Access Description...
  • Page 45 Required port to access VMware vCenter TCP and UDP Ports required to access VMware vCenter Server and VMware ESXi hosts Server and VMware ESXi hosts Dell EMC Secure Remote Services Documentation Secure Remote Services Port Requirements Network Planning Guide 45 |...

  • Page 46: Appendix C: Physical Network Switch Examples

    Appendix C: Physical Network Switch Examples These diagrams show different physical network switch wiring examples. They are provided as illustrative examples. Figure 12. VxRail nodes with 2 ports connected to 2 x ToR switches, 1 x Optional Management Switch with iDRAC Network Planning Guide 46 | ©...
  • Page 47 Figure 13. VxRail nodes with 4 ports connected to 2 x ToR switches, 1 x Optional Management Switch with iDRAC Network Planning Guide 47 | © 2018 Dell Inc. or its subsidiaries...
  • Page 48 Figure 14. VxRail nodes with 4 ports connected to 4 x ToR switches, 1 x Optional Management Switch with iDRAC Learn more about Dell Contact a Dell EMC Expert View more resources Join the conversation EMC VxRail Appliances @DellEMC_CI with #VxRail ©...

This manual is also suitable for:

Vxrail v seriesVxrail g seriesVxrail s seriesVxrail p series

Table of Contents