Dell Force10 C150 Manual

Dell Force10 C150 Manual

Deploying the dell force10 mxl into a cisco nexus network environment
Hide thumbs Also See for Force10 C150:

Advertisement

Deploying the Dell Force10 MXL into a
Cisco Nexus Network Environment
A guide with basic examples for deploying the Dell Force10 MXL
modular switch into the access layer of a Cisco Nexus network
Authors
Network Enabled Solutions Team
Jason Pearce, Manjesh Siddamurthy
Networking Enterprise Technologist
Kevin Horton

Advertisement

Table of Contents
loading

Summary of Contents for Dell Force10 C150

  • Page 1 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment A guide with basic examples for deploying the Dell Force10 MXL modular switch into the access layer of a Cisco Nexus network Authors Network Enabled Solutions Team Jason Pearce, Manjesh Siddamurthy...
  • Page 2 The content is provided as is, without express or implied warranties of any kind. © 2012 Dell Inc. All rights reserved. Dell and its affiliates cannot be responsible for errors or omissions in typography or photography. Dell, the Dell logo, and PowerEdge are trademarks of Dell Inc. Intel and Xeon are registered trademarks of Intel Corporation in the U.S.
  • Page 3: Table Of Contents

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Contents Introduction ......................5 Content Overview ..................... 6 Document Conventions ....................7 Device Introduction ....................8 Dell Force10 MXL Deployment ..................12 Initial Configuration ....................12 Access Port Downlink Configuration ................16 Trunk Port Downlink Configuration ................
  • Page 4 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Figures Figure 1. Dell Force10 MXL Switch .................. 5 Figure 2. Example Network Topology ................7 Figure 3. MXL External Interfaces ................... 8 Figure 4. FlexIO 40GbE QSFP+ Module ................9 Figure 5.
  • Page 5: Introduction

    This document is an easy-to-use guide of recommended basic deployment practices for the Dell Force10 MXL in the access layer of a Cisco Nexus network environment. The Dell Force 10 MXL—an I/O module for the Dell PowerEdge M1000e chassis—is a 10 and 40 gigabit Ethernet multilayer switch targeted at deployment in data center networks.
  • Page 6: Content Overview

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Content Overview This document is broken up topically to allow the steps and concepts of MXL switch deployment to be addressed separately in a simple manner as detailed in Document Conventions.
  • Page 7: Document Conventions

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Document Conventions This document is intended as a quick reference guide for use during basic deployment of a Force10 MXL switch. As such, many details, configuration options, and specific features of the MXL are left out of this document.
  • Page 8: Device Introduction

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Device Introduction The Dell Force10 MXL is an I/O Module for the M1000e modular server chassis that is a line-speed, multilayer, 10 and 40Gb Ethernet switch that provides 32 internal 10GbE links—enabling full connectivity to M420 quarter-height server blades—and flexible 10 and 40Gb Ethernet options for...
  • Page 9: Figure 4. Flexio 40Gbe Qsfp+ Module

    Figure 4. FlexIO 40GbE QSFP+ Module The FlexIO 40GbE QSFP+ module provides two 40Gb Ethernet ports that can be connected using Dell Force10 QSFP+ transceivers or Dell Force10 twinax cabling. Additionally Dell offers breakout fiber and twinax cables that enable each 40GbE port to be split into four 10GbE links that will connect with compatible 10GbE fiber transceivers or SFP+ ports .
  • Page 10: Table 1. Force10 Mxl External Ethernet Interface Numbering

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Due to the availability of FlexIO modules with varying port and link count, the external interface numbering on the MXL can be difficult to understand. Table 1 details the external interface numbering in various modular configurations of the MXL switch.
  • Page 11 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Management Connectivity The MXL switch provides a number of methods for connectivity to its management command-line interface (CLI). Out-of-band console connectivity is available via serial on a physical USB type-A port on the face of the switch when used with the provided cable that is shipped with each MXL (see the previous section—...
  • Page 12: Dell Force10 Mxl Deployment

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Dell Force10 MXL Deployment Initial Configuration This section provides a rapid introduction to some common MXL initial deployment tasks. For more detailed information on deploying the MXL see the Force10 MXL User Guide. The examples that are shown here start in privileged execution mode.
  • Page 13 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL1(conf)#enable password NewEnablePassword MXL1(conf)#exit MXL1# Configuring a username allows an individual to authenticate and is required for remote management. The root user (with password calvin) is automatically configured on the MXL during its first boot to enable rapid remote management during deployment.
  • Page 14 VLAN. This allows network administrators to configure each VLAN with optimal root placement and active paths across a network topology. Most Cisco Nexus network environments run PVST and this document shows how to configure Dell Force10 MXL switches to operate natively in these environments by also running PVST.
  • Page 15 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Split an MXL 40Gb Ethernet Interface into Four 10Gb Ethernet Links The external QSFP+ 40Gb Ethernet ports can be configured as four separate 10Gb Ethernet links. Physical connectivity is enabled by an optical split fiber cable or a split twinax cable. When a 40GbE port is run in quad mode, it provides four 10Gb Ethernet interfaces that number sequentially starting with the port number of the 40GbE interface.
  • Page 16: Access Port Downlink Configuration

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Access Port Downlink Configuration Server’s network interfaces’ default configuration works with a single subnet available on the link and no VLAN tagging. To provide connectivity to this type of server interface, the matching switch interface that it connects to should be configured as an access port in the server’s designated VLAN.
  • Page 17 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL1(conf-if-te-1)#exit MXL1(conf)#exit MXL1# For administrative convenience the above steps can be applied to a range of switch interfaces during configuration. In the following example, the downlinks of MXL1 in the example network are all configured as access ports with interfaces 1-8 on VLAN 11, interfaces 9-24 on VLAN 12, and interfaces 25-32 on VLAN 13.
  • Page 18: Trunk Port Downlink Configuration

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Trunk Port Downlink Configuration Trunk ports can participate in multiple VLANs over one Ethernet interface and are often used for connection to virtualization hosts and other VLAN aware applications. To keep the traffic of the different VLANs from mixing, a numbered tag is inserted in each Ethernet frame (with the optional exception of the interface’s “native”...
  • Page 19 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment And the “portmode hybrid” command allows a trunk port to also carry a single untagged (or native) VLAN. Configure a Native VLAN for a Trunk Port Interface MXL2#configure MXL2(conf)#interface vlan 13...
  • Page 20: Link Aggregation Group Configuration

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Link Aggregation Group Configuration As network switches interconnect more servers and other end nodes, a single active link between devices—especially between switches—often does not provide enough throughput or enough link resiliency for the applications running on the network.
  • Page 21: Trunk Port Uplink Configuration With Mlag At Top Of Rack

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Trunk Port Uplink Configuration with MLAG at Top of Rack The preferred deployment topology for an MXL in the access layer of a Cisco Nexus network is to use the Nexus vPC feature between two top-of-rack peer switches to provide a multi-chassis LAG connection to the MXL.
  • Page 22 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K1 (conf-vpc-10)#peer-keepalive destination 172.25.188.61 source 172.25.188.60 N5K1 (conf-vpc-10)#ip arp synchronize N5K1 (conf-vpc-10)#exit N5K1 (conf)#interface port-channel 10 N5K1 (conf-if-po-10)#switchport mode trunk N5K1 (conf-if-po-10)#vpc peer-link N5K1 (conf-if-po-10)#exit N5K1 (conf)#interface Ethernet 1/11-14...
  • Page 23 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K1 (conf)#interface Ethernet 1/1-2 N5K1 (conf-if-range)#switchport mode trunk N5K1 (conf-if-range)#channel-group 20 mode active N5K1 (conf-if-range)#exit N5K1 (conf)#exit N5K1# This same command set is now run on N5K2 to configure its half of the multi-chassis LAG.
  • Page 24 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Enable Per-VLAN Spanning Tree on the MXL Most Cisco Nexus networks run per-VLAN spanning tree and the MXL is capable of natively participating in the version of the spanning tree protocol. Here are the commands required to enable it.
  • Page 25 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Enable the MXL Uplink Port-Channels Now that the expected spanning-tree, port-channel, switchport, and VLAN settings are in place; the following commands to enable the link members of the uplink port-channel can be run.
  • Page 26 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Po 20 128.21 1400 1400 24589 0023.04ee.be0a 144.19 [...snipped...]...
  • Page 27: Trunk Port Uplink Configuration With Per-Vlan Spanning Tree

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Trunk Port Uplink Configuration with Per-VLAN Spanning Tree The availability of Per-VLAN spanning tree on the MXL allows it to natively integrate into the spanning- tree environment of a Cisco Nexus network. In the following example the MXL2 switch is configured for the PVST environment of the example network.
  • Page 28 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K2 (conf)#interface port-channel 40 N5K2 (conf-if-po-40)#switchport mode trunk N5K2 (conf-if-po-40)#exit N5K2 (conf)#interface Ethernet 1/17 - 18 N5K2 (conf-if-range)#switchport mode trunk N5K2 (conf-if-range)#channel-group 40 mode active N5K2 (conf-if-range)#exit N5K2 (conf)#exit...
  • Page 29 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL2#configure MXL2(conf)#interface port-channel 30 MXL2(conf-if-po-30)#switchport MXL2(conf-if-po-30)#exit MXL2(conf)#exit MXL2# And now the commands that configure MXL2’s LAG connection to N5K2. MXL2#configure MXL2(conf)#interface port-channel 40 MXL2(conf-if-po-40)#switchport MXL2(conf-if-po-40)#no shutdown MXL2(conf-if-po-40)#exit MXL2(conf)#exit MXL2# Configure Tagged VLANs for the Trunk Port Uplinks In the following commands, note that the MXL’s VLAN membership is configured significantly...
  • Page 30 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL2#configure MXL2(conf)#interface range tengigabitethernet 0/35 - 36 MXL2(conf-if-range-te-0/35-36)#port-channel-protocol lacp MXL2(conf-if-range-te-0/35-36-lacp)#port-channel 40 mode active MXL2(conf-if-range-te-0/35-36-lacp)#exit MXL2(conf-if-range-te-0/33-36)#no shutdown MXL2(conf-if-range-te-0/35-36)#exit MXL2(conf)#exit MXL2# Verify the MXL2’s Spanning-tree State Below is the output from MXL2 showing the general spanning-tree state for VLANs 11-13 and the forwarding status of its uplink LAGs.
  • Page 31: Spanning Tree Protocol Failover And Failback Observations

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Spanning Tree Protocol Failover and Failback Observations The primary role of any Spanning Tree Protocol is to prevent loops from occurring in a network topology. The secondary role is to re-converge after a topology change (link failure) as quickly as possible.
  • Page 32: Nexus Mstp And Mxl Mstp Observations

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Force10 MXL blade switch was the link with the lowest path cost and should, from the Force10 MXL’s perspective, have always been in the Forwarding Status and Root Role when it was available.
  • Page 33 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment As mentioned previously the Nexus switches can run in one of two Spanning Tree modes, MSTP or Rapid PVST+ Here is the command for configuring the Nexus Switches to run MSTP:...
  • Page 34 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Executing IEEE compatible Spanning Tree Protocol Root ID Priority 24576, Address 547f.ee7a.7301 Root Bridge hello time 2, max age 20, forward delay 15, max hops 19 Bridge ID Priority 32768, Address 001e.c9f1.0153...
  • Page 35 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Te 1/2 128.187 128 200000 DIS 2000 No No Te 1/30 128.215 128 200000 DIS 2000 No No Te 1/31 128.216 128 200000 DIS 2000 No No Te 1/32 128.217 128 200000 DIS...
  • Page 36 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment 64 bytes from 192.168.0.42: icmp_seq=15 ttl=254 time=3.035 ms Verify that Spanning Tree is running as expected after the Local Interface Failure Simulation What is shown below as a result of the show spanning-tree command is: 1) Interface 1/43 has a status of Forwarding and is in the Role of Root 2) Interface 1/45 has a status of Disabled and is in the Role of Discarding.
  • Page 37: Nexus Mstp And Mxl Mstp - Remainder Of Test Observations

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Te 1/31 128.216 128 200000 DIS 4000 32768 001e.c9f1.0153 128.216 Te 1/32 128.217 128 200000 DIS 4000 32768 001e.c9f1.0153 128.217 Te 1/43 128.228 128 2000 4000 28672 547f.ee6c.21c1 128.131 Te 1/45 128.230 128 2000...
  • Page 38: Nexus Mstp And Mxl Mstp - Greater Than 64 Instances

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Root Bridge. This scenario was observed with only a single ping being lost during the failback, indicating that the re-convergence took about 1 second. 3) Failover: Backbone Failure Simulation (Backbone Fast). In this test a shutdown was issued on N5K1’s interface 1/25.
  • Page 39 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL2(conf-rstp)#disable MXL2(conf-rstp)#exit MXL2(conf)#no protocol spanning-tree rstp MXL2(conf)#exit MXL2# Enable PVST Spanning Tree on the MXL Here are the commands to configure PVST: MXL2#configure MXL2(conf)#protocol spanning-tree pvst MXL2(conf-pvst)#no disable MXL2(conf-pvst)#exit...
  • Page 40 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Te 1/43 128.228 128 2000 2000 28682 547f.ee6c.21c1 128.131 Te 1/45 128.230 128 2000 2000 24586 547f.ee7a.7301 128.133 Interface Name Role PortID Prio Cost Cost Link-type Edge BpduFilter ---------- ------ -------- ---- ------- ----------- ------- --------- ---- ---------- Te 1/43 Altr 128.228 128 2000...
  • Page 41 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Request 10 timed out 64 bytes from 192.168.0.42: icmp_seq=14 ttl=254 time=3.032 ms 64 bytes from 192.168.0.42: icmp_seq=15 ttl=254 time=3.035 ms Verify that Spanning Tree is running as expected after the Local Interface Failure Simulation...
  • Page 42: Nexus Rapid Pvst+ And Mxl Pvst - Remainder Of Test Observations

    (link failures) and re-converge the network as quickly as possible. In each of the scenarios observed, the Dell Force10 MXL switch indeed proved that it is more than capable of doing just that and doing so in conjunction with Nexus switches.
  • Page 43: Appendices

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Uplink Failback (Uplink Fast) Upstream Failover (Backbone Fast) Upstream Failback (Backbone Fast) Appendices Appendix A: Referenced Network Topology and Device Configurations Figure 4. Topology Diagram: Detailed, Full Example Network...
  • Page 44: Table 3. Devices And Firmware Versions Used In This Document

    Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K2 is the primary root of VLANs 11 and 13’s spanning tree instances and the secondary root of VLAN 12’s. Its port-channel 10 uses Ethernet interfaces 1/17-20, port-channel 20 uses Ethernet interfaces 1/1-2, and its port-channel 40 uses Ethernet interfaces 1/25-26.
  • Page 45 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment MXL1 Running Configuration MXL2 Running Configuration ! Version 8.3.16.1 ! Version 8.3.16.1 boot system stack-unit 0 primary system: B: boot system stack-unit 0 primary system: B: redundancy auto-synchronize full...
  • Page 46 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface TenGigabitEthernet 0/9 interface TenGigabitEthernet 0/9 no ip address no ip address switchport portmode hybrid spanning-tree pvst edge-port switchport no shutdown spanning-tree pvst edge-port no shutdown interface TenGigabitEthernet 0/10...
  • Page 47 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface TenGigabitEthernet 0/19 interface TenGigabitEthernet 0/19 no ip address no ip address switchport portmode hybrid spanning-tree pvst edge-port switchport no shutdown spanning-tree pvst edge-port no shutdown interface TenGigabitEthernet 0/20...
  • Page 48 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface TenGigabitEthernet 0/29 interface TenGigabitEthernet 0/29 no ip address no ip address switchport portmode hybrid spanning-tree pvst edge-port switchport no shutdown spanning-tree pvst edge-port no shutdown interface TenGigabitEthernet 0/30...
  • Page 49 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface fortyGigE 0/49 interface fortyGigE 0/49 no ip address no ip address shutdown shutdown interface fortyGigE 0/53 interface fortyGigE 0/53 no ip address no ip address shutdown shutdown interface ManagementEthernet 0/0 interface ManagementEthernet 0/0 ip address 172.25.188.43/16...
  • Page 50 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K1 Running Configuration version 5.2(1)N1(1) hostname N5K1 no feature telnet cfs eth distribute feature lacp feature vpc feature lldp banner motd #Nexus 5000 Switch no ip domain-lookup logging event link-status default...
  • Page 51 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface Ethernet1/8 interface Ethernet1/9 interface Ethernet1/10 interface Ethernet1/11 interface Ethernet1/12 interface Ethernet1/13 interface Ethernet1/14 interface Ethernet1/15 interface Ethernet1/16 interface Ethernet1/17 switchport mode trunk channel-group 10 mode active interface Ethernet1/18...
  • Page 52 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment N5K2 Running Configuration version 5.2(1)N1(1) hostname N5K2 no feature telnet cfs eth distribute feature lacp feature vpc feature lldp banner motd #Nexus 5000 Switch no ip domain-lookup logging event link-status default...
  • Page 53 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment interface Ethernet1/9 interface Ethernet1/10 interface Ethernet1/11 interface Ethernet1/12 interface Ethernet1/13 interface Ethernet1/14 interface Ethernet1/15 interface Ethernet1/16 interface Ethernet1/17 switchport mode trunk channel-group 10 mode active interface Ethernet1/18 switchport mode trunk...
  • Page 54: Appendix B: Basic Terminology

    MAC address over that link as a learned destination. IO module (IOM) refers to the modules at the rear of the Dell PowerEdge M1000e chassis that will receive and transmit I/O (Ethernet, FC, Infiniband, etc.) from the blade servers located at the front of the chassis.
  • Page 55 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Link Aggregation Group (LAG) is a configured bundle of Ethernet links that are treated as the same logical Ethernet link. There are multiple terms that apply to LAGs including channel group, port channel, trunk, and even some server Ethernet interface teaming involves a collection of links that would be considered a LAG.
  • Page 56 Common out-of-band interface types are Ethernet and serial console—often both are presented with RJ-45 (8P8C) connectors although on IO modules in the Dell PowerEdge M1000e chassis the serial connector is sometimes a physical USB type-A port requiring a special cable.
  • Page 57 Deploying the Dell Force10 MXL into a Cisco Nexus Network Environment Spanning-Tree Protocol (STP)—see Spanning Tree. Switching Switching, in an Ethernet context, is a specific technology but the term has largely been generalized to mean layer-2 Ethernet bridging. Ethernet switching is in fact the employment of ASIC technologies to implement Ethernet traffic forwarding and filtering in specialized circuits and memory structures designed for high throughput, low latency, and low cost performance.

This manual is also suitable for:

Force10 mxl 10 gbe

Table of Contents