Page 1
No part of this manual may be reproduced or transmitted in any form or by any means without prior written consent of New H3C Technologies Co., Ltd. Except for the trademarks of New H3C Technologies Co., Ltd., any trademarks that may be mentioned in this document are the property of their respective owners.
For complete information, see IRF configuration guide for the switch. Hardware requirements An H3C S6890 switch can form an IRF fabric only with devices in the same series. Software requirements All IRF member devices must run the same system software version.
IRF physical interface requirements Use the following ports on the S6890 switch for IRF links: • SFP+ ports. • QSFP28 ports. Connecting IRF ports When you connect two neighboring IRF members, connect the physical interfaces of IRF-port 1 on one member to the physical interfaces of IRF-port 2 on the other. Licensing requirements For a license-based feature to run correctly on an IRF fabric, make sure the licenses installed for the feature on all member devices are the same.
Figure 2 Network diagram after IRF deployment Distribution Access Analysis The requirements in this example include the following categories: • IRF setup • LACP MAD configuration • Network connectivity configuration IRF setup To set up an IRF fabric, determine the items in Table Table 2 Basic IRF setup Item...
LACP MAD configuration IMPORTANT: For LACP MAD to run correctly, you must make sure the intermediate device supports extended LACPDUs for LACP MAD. To run LACP MAD, the IRF fabric and intermediate device must each have a dynamic Ethernet link aggregation.
Figure 5 Connection diagram for the IRF fabrics in a Layer 2 network Software versions used This configuration example was created and verified on S6890-CMW710-R2712. Restrictions and guidelines Restrictions and guidelines for LACP MAD configuration When you configure LACP MAD, follow these restrictions and guidelines: •...
Page 9
[DeviceA] interface range ten-gigabitethernet 1/0/51 to ten-gigabitethernet 1/0/54 [DeviceA-if-range] shutdown [DeviceA-if-range] quit # Bind Ten-GigabitEthernet 1/0/51 and Ten-GigabitEthernet 1/0/52 to IRF-port 1/1. [DeviceA] irf-port 1/1 [DeviceA-irf-port1/1] port group interface ten-gigabitethernet 1/0/51 [DeviceA-irf-port1/1] port group interface ten-gigabitethernet 1/0/52 [DeviceA-irf-port1/1] quit # Bind Ten-GigabitEthernet 1/0/53 and Ten-GigabitEthernet 1/0/54 to IRF-port 1/2. [DeviceA] irf-port 1/2 [DeviceA-irf-port1/2] port group interface ten-gigabitethernet 1/0/53 [DeviceA-irf-port1/2] port group interface ten-gigabitethernet 1/0/54...
Page 10
[DeviceB-irf-port2/2] quit # Bring up the physical interfaces. [DeviceB] interface range ten-gigabitethernet 2/0/51 to ten-gigabitethernet 2/0/54 [DeviceB-if-range] undo shutdown [DeviceB-if-range] quit # Save the running configuration. [DeviceB] quit <DeviceB> save # Connect Device B to Device A, as shown in Figure # Activate the IRF port configuration.
[DeviceC] irf-port-configuration active Device C reboots to join the IRF fabric. A three-chassis IRF fabric is formed. Configure Device D: # Assign member ID 4 to Device D, and reboot the device to effect the member ID change. <DeviceD> system-view [DeviceD] irf member 1 renumber 4 Renumbering the member ID may result in configuration change or loss.
Page 12
<IRF> system-view [IRF] irf domain 1 # Create Bridge-Aggregation 2, set its aggregation mode to dynamic, and enable LACP MAD. [IRF] interface bridge-aggregation 2 [IRF-Bridge-Aggregation2] link-aggregation mode dynamic [IRF-Bridge-Aggregation2] mad enable You need to assign a domain ID (range: 0-4294967295) [Current domain is: 1]: The assigned domain ID is: 1 Info: MAD LACP only enable on dynamic aggregation interface.
[Sysname-Ten-GigabitEthernet3/4/0/1] port link-aggregation group 2 [Sysname-Ten-GigabitEthernet3/4/0/1] quit [Sysname] interface ten-gigabitethernet 3/3/0/2 [Sysname-Ten-GigabitEthernet3/3/0/2] port link-aggregation group 2 [Sysname-Ten-GigabitEthernet3/3/0/2] quit [Sysname] interface ten-gigabitethernet 4/2/0/1 [Sysname-Ten-GigabitEthernet4/2/0/1] port link-aggregation group 2 [Sysname-Ten-GigabitEthernet4/2/0/1] quit [Sysname] interface ten-gigabitethernet 4/3/0/1 [Sysname-Ten-GigabitEthernet4/3/0/1] port link-aggregation group 2 [Sysname-Ten-GigabitEthernet4/3/0/1] quit Configuring network connectivity settings This section provides the VLAN and link aggregation configuration procedure for end devices (for example, a server in VLAN 10).
[Sysname-Bridge-Aggregation2] port trunk permit vlan 10 [Sysname-Bridge-Aggregation2] quit Verifying the configuration Verify the IRF setup, multichassis link aggregations, ring topology, and LACP MAD. Verifying the IRF setup # Verify that the IRF fabric has been formed. [IRF] display irf MemberID Role Priority CPU-Mac...
[IRF-Ten-GigabitEthernet1/0/10] quit # Observe the output on the server configuration terminal. Pinging 10.153.116.111 with 32 bytes of data: Reply from 10.153.116.111: bytes=32 time<1ms TTL=128 Reply from 10.153.116.111: bytes=32 time<1ms TTL=128 Request timed out. Reply from 10.153.116.111: bytes=32 time<1ms TTL=128 Reply from 10.153.116.111: bytes=32 time<1ms TTL=128 The output shows that the IP address can be pinged after transient traffic disruption.
Page 16
%Jan 1 05:19:10:184 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet2/0/52 link status is down. %Jan 1 05:19:10:186 2018 H3C DEV/3/BOARD_REMOVED: Board is removed from Slot 3, type is MAIN_BOARD_TYPE_54QT. %Jan 1 05:19:10:186 2018 H3C DEV/3/BOARD_REMOVED: Board is removed from Slot 4, type is MAIN_BOARD_TYPE_54QT.
Page 17
[Sysname] %Jan 1 05:24:41:249 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet2/0/10 link status is up. %Jan 1 05:24:41:249 2018 H3C IFNET/5/LINK_UPDOWN: Line protocol on the interface Ten-GigabitEthernet2/0/10 is up. %Jan 1 05:24:41:325 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet2/0/49 link status is up. %Jan 1 05:24:41:325 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet2/0/50 link status is up.
The Bridge MAC of the IRF is: 0cda-414a-859b Auto upgrade : yes Mac persistent : 6 min Domain ID IRF mode : normal Configuration files • IRF fabric at the access layer: sysname IRF irf domain 1 irf member 1 priority 31 vlan 10 irf-port1/1 port group interface Ten-GigabitEthernet1/0/51...
Page 19
port group interface Ten-GigabitEthernet4/0/54 interface Bridge-Aggregation2 port link-type trunk port trunk permit vlan 10 link-aggregation mode dynamic mad enable interface Bridge-Aggregation3 port access vlan 10 link-aggregation mode dynamic interface Ten-GigabitEthernet1/0/49 port link-mode bridge port link-aggregation group 2 interface Ten-GigabitEthernet1/0/50 port link-mode bridge port link-aggregation group 2 interface Ten-GigabitEthernet2/0/49 port link-mode bridge...
Page 20
interface Ten-GigabitEthernet2/0/10 port link-mode bridge port link-aggregation group 3 • IRF fabric at the distribution layer: irf domain 2 vlan10 interface Bridge-Aggregation2 port link-type trunk port trunk permit vlan 10 link-aggregation mode dynamic mad enable interface Ten-GigabitEthernet1/2/0/1 port link-mode bridge port link-aggregation group 2 interface Ten-GigabitEthernet1/3/0/1 port link-mode bridge...
Example: Setting up a four-chassis BFD MAD-enabled IRF fabric Network configuration As shown in Figure 8, set up a four-chassis IRF fabric to replace the switches at the distribution layer of the enterprise network (see Figure Use BFD MAD to detect IRF split. The IRF fabric provides gateway services for servers and runs OSPF.
Figure 8 Network diagram after IRF deployment Analysis The requirements in this example include the following categories: • IRF setup • BFD MAD configuration • Network connectivity configuration IRF setup To set up an IRF fabric, determine the items in Table Table 4 Basic IRF setup Choice in this...
Page 23
Choice in this Item Analysis example Make sure the IRF port bindings are consistent with the physical connections. IRF port Table For high availability, bind multiple physical interfaces to an bindings IRF port. These ports will automatically aggregate for load balancing and redundancy.
NOTE: The first segment in a physical interface number is the IRF member ID. By default, the IRF member ID is 1. Table 5 shows the interface numbers after the member IDs are changed. BFD MAD configuration You can deploy BFD MAD by using one of the following methods: •...
Page 25
Figure 11 Connection diagram for the IRF fabric in a Layer 3 network Internet 10.214.60.1/30 10.214.70.1/30 10.214.50.9/30 VLAN 10 Router A Router B 10.214.50.10/30 10.214.50.2/30 10.214.50.6/30 VLAN 20 VLAN 40 10.214.50.1/30 10.214.50.5/30 VLAN 41 10.214.10.1/24 10.214.20.1/24 VLAN 42 Device E Device F Department A Department B...
Category Restrictions and guidelines • Do not enable BFD MAD on VLAN-interface 1. • If you are using an intermediate device, perform the following tasks on both the IRF fabric and the intermediate device: Create a VLAN and VLAN interface for BFD MAD. Assign the ports of BFD MAD links to the BFD MAD VLAN.
Page 28
[DeviceA-irf-port1/1] quit # Bind Ten-GigabitEthernet 1/0/53 and Ten-GigabitEthernet 1/0/54 to IRF-port 1/2. [DeviceA] irf-port 1/2 [DeviceA-irf-port1/2] port group interface ten-gigabitethernet 1/0/53 [DeviceA-irf-port1/2] port group interface ten-gigabitethernet 1/0/54 [DeviceA-irf-port1/2] quit # Bring up the physical interfaces. [DeviceA] interface range ten-gigabitethernet 1/0/51 to ten-gigabitethernet 1/0/54 [DeviceA-if-range] undo shutdown [DeviceA-if-range] quit # Assign IRF member priority 31 to Device A.
Page 29
<DeviceB> save # Connect Device B to Device A, as shown in Figure # Activate the IRF port configuration. <DeviceB> system-view [DeviceB] irf-port-configuration active Device B has a lower priority than Device A, and Device B fails master election and reboots. A two-chassis IRF fabric is formed.
[DeviceD] quit <DeviceD> reboot # Shut down the physical interfaces used for IRF connection. This example uses the port group that contains Ten-GigabitEthernet 4/0/51 to Ten-GigabitEthernet 4/0/54 for IRF connection. <DeviceD> system-view [DeviceD] interface range ten-gigabitethernet 4/0/51 to ten-gigabitethernet 4/0/54 [DeviceD-if-range] shutdown [DeviceD-if-range] quit # Bind Ten-GigabitEthernet 4/0/51 and Ten-GigabitEthernet 4/0/52 to IRF-port 4/1.
# Create VLAN-interface 1000, and configure a MAD IP address for each member device on the interface. [IRF] interface vlan-interface 1000 [IRF-Vlan-interface1000] mad bfd enable [IRF-Vlan-interface1000] mad ip address 192.168.2.1 24 member 1 [IRF-Vlan-interface1000] mad ip address 192.168.2.2 24 member 2 [IRF-Vlan-interface1000] mad ip address 192.168.2.3 24 member 3 [IRF-Vlan-interface1000] mad ip address 192.168.2.4 24 member 4 [IRF-Vlan-interface1000] quit...
Page 32
# Assign Ten-GigabitEthernet 1/0/1, Ten-GigabitEthernet 1/0/2, Ten-GigabitEthernet 1/0/3, and Ten-GigabitEthernet 1/0/4 to the aggregation group for Bridge-Aggregation 40. [RouterA] interface ten-gigabitethernet 1/0/1 [RouterA-Ten-GigabitEthernet1/0/1] port link-aggregation group 40 [RouterA-Ten-GigabitEthernet1/0/1] quit [RouterA] interface ten-gigabitethernet 1/0/2 [RouterA-Ten-GigabitEthernet1/0/2] port link-aggregation group 40 [RouterA-Ten-GigabitEthernet1/0/2] quit [RouterA] interface ten-gigabitethernet 1/0/3 [RouterA-Ten-GigabitEthernet1/0/3] port link-aggregation group 40 [RouterA-Ten-GigabitEthernet1/0/3] quit...
Page 33
[RouterA-ospf-1-area-0.0.0.0] quit [RouterA-ospf-1] quit Configure Router B: # Create VLANs 41 and 42. <RouterB> system-view [RouterB] vlan 41 to 42 # Create Bridge-Aggregation 41, and set its link aggregation mode to dynamic. [RouterB] interface bridge-aggregation 41 [RouterB-Bridge-Aggregation41] link-aggregation mode dynamic [RouterB-Bridge-Aggregation41] quit # Assign Ten-GigabitEthernet 1/0/1, Ten-GigabitEthernet 1/0/2, Ten-GigabitEthernet1/0/3, and Ten-GigabitEthernet 1/0/4 to the aggregation group for Bridge-Aggregation 41.
Page 35
# Repeat the previous Bridge-Aggregation 10 configuration steps to configure Bridge-Aggregation interfaces 20, 40, and 41, in compliance with the scheme in Table (Details not shown.) # Create interfaces for VLANs 10, 20, 40, and 41, and assign IP addresses to the interfaces. [IRF] interface vlan-interface 10 [IRF-Vlan-interface10] ip address 10.214.10.1 24 [IRF-Vlan-interface10] quit...
Verifying the configuration Verify the IRF setup, routing configuration, multichassis link aggregations, ring topology, and BFD MAD. Verifying the IRF setup # Verify that the IRF fabric has been formed. [IRF] display irf MemberID Role Priority CPU-Mac Description Master 00e0-fc0f-8c02 Standby 1 00e0-fc0f-8c03 Standby 1...
10.214.20.0/24 Direct 0 10.214.20.1 Vlan20 10.214.20.1/32 Direct 0 127.0.0.1 InLoop0 10.214.50.0/30 Direct 0 10.214.50.1 Vlan40 10.214.50.1/32 Direct 0 127.0.0.1 InLoop0 10.214.50.4/30 Direct 0 10.214.50.5 Vlan41 10.214.50.5/32 Direct 0 127.0.0.1 InLoop0 10.214.50.8/30 OSPF 10.214.50.2 Vlan40 10.214.60.0/30 OSPF 10.214.50.2 Vlan40 10.214.70.0/30 OSPF 10.214.50.6 Vlan41 127.0.0.0/8...
Page 38
%Jan 1 05:19:10:184 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet2/0/52 link status is down. %Jan 1 05:19:10:186 2018 H3C DEV/3/BOARD_REMOVED: Board is removed from Slot 3, type is MAIN_BOARD_TYPE_54QT. %Jan 1 05:19:10:186 2018 H3C DEV/3/BOARD_REMOVED: Board is removed from Slot 4, type is MAIN_BOARD_TYPE_54QT.
# Recover the IRF links. The following message is displayed: %Jan 1 00:52:25:555 2018 H3C IFNET/3/PHY_UPDOWN: Ten-GigabitEthernet1/0/54 link status is up. %Jan 1 00:52:25:555 2018 H3C IFNET/5/LINK_UPDOWN: Line protocol on the interface Ten-GigabitEthernet1/0/54 is up. %Jan 1 00:52:25:717 2018 H3C STM/6/STM_LINK_STATUS_UP: IRF port 2 is up.
Page 40
irf-port1/1 port group interface Ten-GigabitEthernet1/0/51 port group interface Ten-GigabitEthernet1/0/52 irf-port1/2 port group interface Ten-GigabitEthernet1/0/53 port group interface Ten-GigabitEthernet1/0/54 irf-port2/1 port group interface Ten-GigabitEthernet2/0/51 port group interface Ten-GigabitEthernet2/0/52 irf-port2/2 port group interface Ten-GigabitEthernet2/0/53 port group interface Ten-GigabitEthernet2/0/54 irf-port3/1 port group interface Ten-GigabitEthernet3/0/51 port group interface Ten-GigabitEthernet3/0/52 irf-port3/2 port group interface Ten-GigabitEthernet3/0/53...
Page 41
interface Vlan-interface10 ip address 10.214.10.1 255.255.255.0 interface Vlan-interface20 ip address 10.214.20.1 255.255.255.0 interface Vlan-interface40 ip address 10.214.50.1 255.255.255.252 interface Vlan-interface41 ip address 10.214.50.5 255.255.255.252 interface Vlan-interface1000 mad bfd enable mad ip address 192.168.2.1 255.255.255.0 member 1 mad ip address 192.168.2.2 255.255.255.0 member 2 mad ip address 192.168.2.3 255.255.255.0 member 3 mad ip address 192.168.2.4 255.255.255.0 member 4 interface Ten-GigabitEthernet1/0/1...
Page 42
interface Ten-GigabitEthernet2/0/10 port link-mode bridge port access vlan 10 port link-aggregation group 10 interface Ten-GigabitEthernet2/0/11 port link-mode bridge port access vlan 20 port link-aggregation group 20 interface Ten-GigabitEthernet2/0/13 port link-mode bridge port access vlan 40 port link-aggregation group 40 interface Ten-GigabitEthernet2/0/14 port link-mode bridge port access vlan 41 port link-aggregation group 41...
Page 43
undo stp enable port access vlan 1000 interface Ten-GigabitEthernet4/0/10 port link-mode bridge port access vlan 10 port link-aggregation group 10 interface Ten-GigabitEthernet4/0/11 port link-mode bridge port access vlan 20 port link-aggregation group 20 interface Ten-GigabitEthernet4/0/13 port link-mode bridge port access vlan 40 port link-aggregation group 40 interface Ten-GigabitEthernet4/0/14 port link-mode bridge...
Page 44
interface GigabitEthernet1/0/4 port link-mode bridge port access vlan 1000 interface Ten-GigabitEthernet1/0/49 port link-mode bridge port link-aggregation group 10 interface Ten-GigabitEthernet1/0/50 port link-mode bridge port link-aggregation group 10 interface Ten-GigabitEthernet1/0/51 port link-mode bridge port link-aggregation group 10 interface Ten-GigabitEthernet1/0/52 port link-mode bridge port link-aggregation group 10 •...
Page 45
interface Bridge-Aggregation42 port access vlan 42 link-aggregation mode dynamic interface Vlan-interface40 ip address 10.214.50.2 255.255.255.252 interface Vlan-interface42 ip address 10.214.50.9 255.255.255.252 interface Ten-GigabitEthernet1/0/1 port link-mode bridge port access vlan 40 port link-aggregation group 40 interface Ten-GigabitEthernet1/0/2 port link-mode bridge port access vlan 40 port link-aggregation group 40 interface Ten-GigabitEthernet1/0/3 port link-mode bridge...
Page 46
vlan 41 vlan 42 interface Bridge-Aggregation41 port access vlan 41 link-aggregation mode dynamic interface Bridge-Aggregation42 port access vlan 42 link-aggregation mode dynamic interface Vlan-interface41 ip address 10.214.50.6 255.255.255.252 interface Vlan-interface42 ip address 10.214.50.10 255.255.255.252 interface Ten-GigabitEthernet1/0/1 port link-mode bridge port access vlan 41 port link-aggregation group 41 interface Ten-GigabitEthernet1/0/2 port link-mode bridge...
Need help?
Do you have a question about the S6890 Series and is the answer not in the manual?
Questions and answers