Page 2
END USER LICENSE AGREEMENT The Juniper Networks product that is the subject of this technical documentation consists of (or is intended for use with) Juniper Networks software. Use of such software is subject to the terms and conditions of the End User License Agreement (“EULA”) posted at http://www.juniper.net/support/eula.html.
Page 5
Before You Begin ..........83 QFX3000-G QFabric System Installation Overview ..... . . 83 Understanding QFX3000-G QFabric System Hardware Configurations .
Page 6
QFX3000-G QFabric System Deployment Guide AC Power Specifications for a QFX3008-I Interconnect Device with Single-Phase Wiring Trays ........... . 131 AC Power Specifications for a QFX3008-I Interconnect Device with Three-Phase Delta Wiring Trays .
Page 8
System Control Plane Network ........264 Chapter 15 Cabling the Data Plane for the QFX3000-G QFabric System ..269 Connecting a QFX3600 Node Device to a QFX3008-I Interconnect Device . . . 269 Connecting a QFX3500 Node Device to a QFX3008-I Interconnect Device .
Page 9
Converting the Device Mode for a QFabric System Component ... . . 277 Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Plane ..........283 Example: Configuring a Fiber-Based Control Plane for the QFX3000-G QFabric System .
Page 11
Performing a QFabric System Recovery Installation on the Director Group ..616 (Optional) Creating an Emergency Boot Device Using a Juniper Networks External Blank USB Flash Drive ....... . 617 Performing a Recovery Installation Using a Juniper Networks External USB Flash Drive with Preloaded Software .
Page 14
QFX3000-G QFabric System Deployment Guide Figure 23: Installing Four-Post Mounting Shelf and Rear Support Bracket for QFX3008-I Interconnect Device Four-Post Rack or Cabinet Mounting ..161 Figure 24: Installing Spacer Bar and Shelves for QFX3008-I Interconnect Device Four-Post Rack or Cabinet Mounting .
Page 19
Chapter 13 Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System ............225 Table 64: Virtual Chassis-to-Virtual Chassis Copper-Based Control Plane Port Assignments .
Page 20
Table 76: Support for device mode options ......278 Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments .
® To obtain the most current version of all Juniper Networks technical documentation, see the product documentation page on the Juniper Networks website at http://www.juniper.net/techpubs/ If the information in the latest release notes differs from the information in the documentation, follow the product Release Notes.
QFX3000-G QFabric System Deployment Guide If the example configuration does not start at the top level of the hierarchy, the example is a snippet. In this case, use the command. These procedures are load merge relative described in the following sections.
Page 24
QFX3000-G QFabric System Deployment Guide Table 2: Text and Syntax Conventions (continued) Convention Description Examples Fixed-width text like this Represents output that appears on the user@host> show chassis alarms terminal screen. No alarms currently active Italic text like this Introduces or emphasizes important A policy term is a named structure new terms.
7 days a week, 365 days a year. Self-Help Online Tools and Resources For quick and easy problem resolution, Juniper Networks has designed an online self-service portal called the Customer Support Center (CSC) that provides you with the following features: Find CSC offerings: http://www.juniper.net/customers/support/...
Download the latest versions of software and review release notes: http://www.juniper.net/customers/csc/software/ Search technical bulletins for relevant hardware and software notifications: http://kb.juniper.net/InfoCenter/ Join and participate in the Juniper Networks Community Forum: http://www.juniper.net/company/communities/ Open a case online in the CSC Case Management tool: http://www.juniper.net/cm/...
QFX3000-G QFabric System Deployment Guide Figure 1: Legacy Data Center Architecture The access layer connects servers and other devices to a Layer 2 switch and provides an entry point into the data center. Several access switches are in turn connected to intermediate Layer 2 switches at the aggregation layer (sometimes referred to as the distribution layer) to consolidate traffic.
Chapter 1: Before You Begin QFX Series QFabric System Architecture In contrast to legacy multi-tiered data center architectures, the Juniper Networks QFX Series QFabric System architecture provides a simplified networking environment that solves the most challenging issues faced by data center operators. A fabric is a set of devices that act in concert to behave as a single switch.
Page 32
QFX3000-G QFabric System Deployment Guide Essentially, a QFabric system can be viewed as a single, nonblocking, low-latency switch that supports thousands of 10-Gigabit Ethernet ports or 2-Gbps, 4-Gbps, or 8-Gbps Fibre Channel ports to interconnect servers, storage, and the Internet across a high-speed, high-performance fabric.
Page 34
Interconnect device is a QFX3008-I Interconnect device. (See also Node device.) Junos Space Carrier-class network management system for provisioning, monitoring, and diagnosing Juniper Networks routing, switching, security, and data center platforms. network Node group Set of one to eight Node devices that connects to an external network.
Page 36
(Interconnect devices), and finishes with the Node groups. Routing Engine Juniper Networks-proprietary processing entity that implements QFabric system control plane functions, routing protocols, system management, and user access. Routing Engines can be either physical or virtual entities.
QFX3000-G QFabric System Deployment Guide An example of a four-level interface name is: node2:xe-0/0/2 QSFP+ Interfaces The QFX3500 Node device provides four 40-Gbps QSFP+ (quad small form-factor pluggable plus) interfaces (labeled through ) for uplink connections between your Node device and your Interconnect devices.
QFX3000-G QFabric System Deployment Guide Table 4: QFX3600 Node Device Port Mappings (continued) 40-Gigabit Data Plane Uplink Port Number Interfaces 10-Gigabit Ethernet Interfaces Not supported on this port xe-0/0/48 xe-0/0/49 xe-0/0/50 xe-0/0/51 Not supported on this port xe-0/0/52 xe-0/0/53 xe-0/0/54...
Supported Platforms QFabric System QFabric System Hardware Architecture Overview on page 15 QFX3000-G QFabric System Features on page 18 QFX3000-M QFabric System Features on page 18 QFabric System Hardware Architecture Overview The QFabric system is a single-layer networking tier that connects servers and storage devices to one another across a high-speed, unified core fabric.
QFX3000-G QFabric System Deployment Guide Figure 3: QFabric System Hardware Architecture Director devices Node devices Interconnect devices Virtual Chassis (control plane) The four major QFabric system components include the following: Director group—The Director group is a management platform that establishes, monitors, and maintains all components in the QFabric system.
QFX3000-G QFabric System Deployment Guide QFX3000-G QFabric System Features A QFX3000-G QFabric system provides the following key features: Support for up to 128 Node devices and 4 Interconnect devices, which provides a maximum of 6144 10-Gigabit Ethernet ports. Low port-to-port latencies that scale as the system size grows from 48 to 6144 10-Gigabit Ethernet ports.
Software-Based External Routing Engines on page 20 Hardware-Based Routing Engines A traditional Juniper Networks Routing Engine is a hardware field-replaceable unit that runs routing protocols, builds the routing and switching tables, sends routing information to the Packet Forwarding Engine, and handles several software processes for the device (such as interface control, chassis component monitoring, system management, and user access).
QSFP+ connections. These front card ports attach to the high-speed backplane to reach the eight slots in the rear of the chassis, which provide the heavy-duty interconnections for the entire QFX3000-G QFabric system. In addition, four interfaces (two per Control Board) provide Gigabit Ethernet access to the control plane management network.
QFX3000-G QFabric System Deployment Guide Figure 7: QFX3600-I Data Plane and Control Plane Connections Node0 Node0:xe-0/0/46 Node0:xe-0/0/0 Node0:fte-0/1/1 Node0:fte-0/1/3 Server Storage Data Plane IC0:fte-0/1/0 IC1:fte-0/1/0 Control Plane Port C0 Port C1 Port C0 Port C1 ge-0/0/16 ge-0/0/17 ge-0/0/16 ge-0/0/17 Related...
QFX3000-G QFabric System Deployment Guide Figure 8: QFX3500 Data Plane and Control Plane Connections Data Plane IC0:fte-7/0/6 IC1:fte-0/0/6 Rear view Node0:fte-0/1/0 Node0:fte-0/1/2 Node0:xe-0/0/0 Node0:xe-0/0/46 Storage Server Node0 Front view Control Plane ge-0/0/0 ge-0/0/0 QFX3600 Node Devices The QFX3600 Node device works as part of a QFabric system. A QFX3600 chassis provides 16 40-Gbps QSFP+ interfaces.
QFX3000-G QFabric System Deployment Guide Node groups help you combine multiple Node devices into a single virtual entity within the QFabric system to enable redundancy and scalability at the edge of the data center. This topic covers: Network Node Groups on page 28...
QFX3000-G QFabric System Deployment Guide Related Understanding QFabric System Terminology on page 7 Documentation Understanding the QFabric System Hardware Architecture on page 15 Understanding the Director Software on page 32 Understanding Partitions on page 33 Understanding the QFabric System Control Plane on page 35...
QFX3000-G QFabric System Deployment Guide Figure 10: QFabric System Topology - Default Partition Director devices Interconnect devices Node devices Virtual Chassis control plane NOTE: The initial release of the QFabric system supports a single default partition. All equipment and resources belong to the default partition.
QFabric system.) For example, the control plane switch for the QFX3000-G QFabric system requires two Virtual Chassis containing four EX4200 switch members each. The two Virtual Chassis connect to each other across a 10-Gigabit Ethernet LAG link to provide maximum resiliency for the QFabric system control plane.
Page 63
For the most current guidance on the QFabric control plane configuration and cabling recommendations, see: Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Plane on page 283 Example: Configuring EX4200 Switches for the Copper-Based QFX3000-M QFabric...
Many of these services are provided by the external Routing Engines that run in software on the Director group. Related Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Documentation Plane on page 283 Example: Configuring EX4200 Switches for the Copper-Based QFX3000-M QFabric...
QFX3000-G QFabric System Deployment Guide cross-connect system for the QFX3008-I Interconnect device is shown as an example Figure 13 on page Figure 13: QFX3008-I Interconnect Device Cross-Connect System Incoming traffic Front Card Rear Card Outgoing traffic The design of the cross-connect system provides multistage Clos switching, which results in nonblocking paths for data traffic and any-to-any connectivity for the Node devices.
QFX3000-G QFabric System Deployment Guide QFX3500 Device Hardware Documentation QFX3600 Device Hardware Documentation Understanding Software Upgrade on the QFabric System Supported Platforms QFabric System The QFabric system software package contains software for the QFabric system infrastructure and for all of the different component devices in the QFabric system: Director group, Interconnect devices, and Node devices.
Page 70
QFX3000-G QFabric System Deployment Guide If you need to minimize service impact, preserve the forwarding operations of the data plane during the upgrade, and are willing to take the extra time required for component switchovers (in many cases, several hours), issue...
Page 72
QFX3000-G QFabric System Deployment Guide The QFabric system downloads, validates, and installs the new software in all Interconnect devices and fabric control Routing Engines (FC-0 and FC-1). One fabric control Routing Engine reboots and comes back online. The other fabric control Routing Engine reboots and comes back online.
QFX3000-G QFabric System Deployment Guide node-group node-device Chassis Commands The Junos OS CLI contains additions to the existing chassis commands. These additions reflect new options as a result of adding the interconnect-device node-group , and chassis statements at the hierarchy level.
QFX3000-G QFabric System Deployment Guide NOTE: Do not install Junos Space and AIS on the control plane network EX4200 switches or EX4200 Virtual Chassis in a QFX3000 QFabric system Related Advanced Insight Scripts (AI-Scripts) Release Notes Documentation Understanding Device and Network Management Features...
RFC 4188, Definitions of Managed Objects for Bridges RFC 4293, Management Information Base for the Internet Protocol (IP) RFC 4363b, Q-Bridge VLAN MIB Support for the following Juniper Networks enterprise-specific MIBs: Chassis MIB (mib-jnx-chassis.txt) Class-of-Service MIB (mib-jnx-cos.txt) Configuration Management MIB (mib-jnx-cfgmgmt.txt) Fabric Chassis MIB (mib-jnx-fabric-chassis.txt)
QFX3000-G QFabric System Deployment Guide You can filter the types of logs that the Director group collects from a component device when you configure the filter all facility severity filter all match statements at the hierarchy level. “regular-expression” [edit system syslog]...
QFX3000-G QFabric System Deployment Guide to the QFabric system default partition CLI, issue the command from the component’s exit operational mode CLI prompt. Related Example: Configuring QFabric System Login Classes on page 374 Documentation remote-debug-permission on page 439 request component login on page 484...
Page 84
QFX3000-G QFabric System Deployment Guide Table 7: QFX3600 Node Device Port Mappings (continued) 40-Gigabit Data Plane Uplink Port Number Interfaces 10-Gigabit Ethernet Interfaces Not supported on this port xe-0/0/32 xe-0/0/33 xe-0/0/34 xe-0/0/35 Not supported on this port xe-0/0/36 xe-0/0/37 xe-0/0/38...
QFX3000-G QFabric System Deployment Guide NOTE: When you configure routing protocols on the QFabric system, you must use interfaces from the Node devices assigned to the network Node group. If you try to configure routing protocols on interfaces from the Node devices assigned to server Node groups, the configuration commit operation fails.
QFX3000-G QFabric System Deployment Guide The 10-Gigabit Ethernet interfaces that connect to FCoE devices must include a native VLAN to transport FIP traffic because FIP VLAN discovery and notification frames are exchanged as untagged packets. Each FCoE VLAN interface can present multiple VF_Port interfaces to the FCoE network.
QFX3000-G QFabric System Deployment Guide Viewing Fabric Forwarding Class Set Information on page 73 Summary of Fabric Forwarding Class Set and Node Device Forwarding Class Set Differences on page 75 Default Fabric Forwarding Class Sets Interconnect devices have 12 default fabric fc-sets, including five visible default fabric fc-sets, four for unicast traffic and one for multidestination (multicast, broadcast, and destination lookup failure) traffic.
Page 92
QFX3000-G QFabric System Deployment Guide Table 9: Default Forwarding Class to Fabric Forwarding Class Set Mapping (continued) Maximum Fabric Supported Fabric Forwarding Class Output for Lossless Forwarding Class Queue Operation No forwarding classes are mapped by fabric_fcset_noloss5 default to this hidden fabric fc-set.
QFX3000-G QFabric System Deployment Guide to Node device fc-sets. To do this, use exactly the same statement that you use to map forwarding classes to fc-sets, but instead of specifying a Node device fc-set name, specify a fabric fc-set name.
QFX3000-G QFabric System Deployment Guide Table 10: Class Group Scheduling Properties and Membership Forwarding Classes (Default Class Group Scheduling Properties Class Group Fabric fc-sets Mapping) (Weight) Strict-high priority fabric_fcset_strict_high strict-high priority Traffic in the strict-high priority class forwarding classes group is served first. This class group...
Page 98
QFX3000-G QFabric System Deployment Guide Case 3—If the IEEE 802.1p priority is mapped to the lossless forwarding class, no-loss and the forwarding class is mapped to the fabric fc-set, no-loss fabric_fcset_noloss2 then the congestion control mechanism is PFC. Case 4—If the IEEE 802.1p priority...
Page 100
QFX3000-G QFabric System Deployment Guide mcast Forwarding class set: fabric_fcset_mcast2, Type: fabric-type, Forwarding class set index: 6 Forwarding class set: fabric_fcset_mcast3, Type: fabric-type, Forwarding class set index: 7 Forwarding class set: fabric_fcset_mcast4, Type: fabric-type, Forwarding class set index: 8 Forwarding class set: fabric_fcset_noloss1, Type: fabric-type, Forwarding class...
To clear the error message and use the licensed feature properly, you must install and verify the required license. For information about how to purchase software licenses, contact your Juniper Networks sales representative.
QFX Series software feature. For information about how to purchase a software license, contact your Juniper Networks sales representative. Table 14: Junos OS Feature Licenses and Model Numbers for QFX Series Devices...
QFX3000-G QFabric System Deployment Guide The MX5, MX10, MX40, and MX80 routers support the following types of MICs: A built-in 10-Gigabit Ethernet MIC with four 10-Gigabit Ethernet ports Two front-pluggable MICs A feature ID is assigned to every license upgrade for enhancing port capacity.
QFX3000-G QFabric System Installation Overview Supported Platforms QFX3000-G A QFX3000-G QFabric system is formed by interconnecting QFX3500 or QFX3600 Node devices, QFX3008-I Interconnect devices, and QFX3100 Director devices. Two Virtual Chassis, composed of four EX4200 switches each, are used to interconnect the control plane and management network.
Page 110
Interconnect the two Virtual Chassis using the 10-Gigabit Ethernet SFP+ uplink ports. These ports will later be configured in a LAG. See “Interconnecting Two Virtual Chassis for Copper-Based QFX3000-G QFabric System Control Plane Redundancy” on page 225. Interconnect the two QFX3100 Director devices for control plane redundancy. See “Connecting QFX3100 Director Devices in a Director Group”...
Virtual Chassis configurations. QFX3100 Director devices—Two QFX3100 Director devices are required for a QFX3000-G QFabric system. Together, the two Director devices are called a Director group. Six Gigabit Ethernet RJ-45 or six SFP ports on each QFX3100 Director device provide connection to the control plane and management network through the Virtual Chassis.
Virtual Chassis. QFX3008-I Interconnect devices—Two QFX3008-I Interconnect devices are required for a QFX3000-G QFabric system. Up to four QFX3008-I Interconnect devices can be used in a QFX3000-G QFabric sysem. Up to 128 40-Gbps QSFP+ ports on each QFX3008-I Interconnect device connect the QFX3500 and QFX3600 Node devices to the data plane network across fiber-optic cables and a high-speed backplane.
Page 114
QFX3000-G QFabric System Deployment Guide Table 17: Maximum Number of Node Devices Supported Based on Oversubscription Ratio and Number of Interconnect Devices (continued) Number of QFX3008-I Oversubscription Ratio Interconnect Devices Maximum Number of Node Devices 1:1 (Supported on QFX3600 Node...
QFX3000-G QFabric System Deployment Guide Clearance Requirements for Airflow and Hardware Maintenance for a QFX3100 Director Device Clearance Requirements for Airflow and Hardware Maintenance for a QFX3008-I Interconnect Device Clearance Requirements for Airflow and Hardware Maintenance for a QFX3600 or...
QFX3000-G QFabric System Deployment Guide Power Supply in EX2200 Switches Power Supply in EX3200 Switches Power Supply in EX3300 Switches Power Supply in EX4200 Switches AC Power Supply in EX4500 Switches DC Power Supply in EX4500 Switches AC Power Supply in EX4550 Switches...
QFX3000-G QFabric System Deployment Guide Table 21: QFX3008-I Interconnect Device Environmental Tolerances Description Tolerance Altitude No performance degradation to 10,000 feet (3048 meters) Relative humidity Normal operation ensured in relative humidity range of 5% through 85%, noncondensing Temperature Normal operation ensured in temperature range of 32° F through 104° F (0° C through 40° C) Short-term operation ensured in temperature range of 23°...
QFX3000-G QFabric System Deployment Guide Table 23: QFX3600 and QFX3600-I Device Environmental Tolerances Description Tolerance Altitude No performance degradation to 10,000 feet (3048 meters) Relative humidity Normal operation ensured in relative humidity range of 5% through 85%, noncondensing Temperature Normal operation ensured in temperature range of 32° F through 104° F (0° C through 40° C) Short-term operation ensured in temperature range of 23°...
QFX3000-G QFabric System Deployment Guide You can use SFP transceivers to connect the QFX3600 device to a management network, or the control plane and management network of a QFabric system. The 1000BASE-SX Gigabit Ethernet SFP module (QFX-SFP-1GE-SX) is supported in the SFP management ports labeled .
QFX3000-G QFabric System Deployment Guide Interface Support for the QFX3500 Device Supported Platforms QFabric System The 48 small form-factor pluggable plus (SFP+) access ports in the QFX3500 device support SFP and SFP+ transceivers, as well as SFP+ direct-attach copper (DAC) cables.
QFX3000-G QFabric System Deployment Guide Table 26: Supported Transceivers for the QFX3500 Device (continued) QFX3500 Node Device in QFX3500 Node Device in QFX3500 Device as a QFX3000-M QFabric a QFX3000-G QFabric Description Standalone Switch System System 40GBASE-SR4 QSFP+ Junos OS 12.2X50.D40 Junos OS 12.2X50-D40...
. The command does not give any show interfaces diagnostics optics output for copper transceivers or transceivers not purchased from Juniper Networks. The three tables in this topic describe the optical interface support over single-mode fiber-optic (SMF) and multimode fiber-optic (MMF) cables and copper interface support...
Page 132
QFX3000-G QFabric System Deployment Guide Table 28: Copper Interface Support and Optical Interface Support for Gigabit Ethernet SFP Transceivers for the QFX Series (continued) Ethernet Standard Specifications 1000BASE-SX Model number QFX-SFP-1GE-SX Rate 1000 Mbps Connector type Fiber count Dual Transmitter wavelength...
QFX3000-G QFabric System Deployment Guide Table 29: Optical Interface Support for Fibre Channel SFP+ Transceivers for the QFX Series Fibre Channel Standard Specifications 2GFC, 4GFC, 8GFC Model number QFX-SFP-8GFC-SW (Short-Wavelength) Rate 2.125 Gbps, 4.25 Gbps, 8.5 Gbps Connector type Fiber count...
Page 136
QFX3000-G QFabric System Deployment Guide Table 30: Optical Interface Support for 10-Gigabit Ethernet SFP+ Transceivers for the QFX Series (continued) Ethernet Standard Specifications 10GBASE-SR Model number QFX-SFP-10GE-SR Rate 10 Gbps Connector type Transmitter 850 nm wavelength Minimum launch –7.3 dBm...
Page 138
QFX3000-G QFabric System Deployment Guide Table 30: Optical Interface Support for 10-Gigabit Ethernet SFP+ Transceivers for the QFX Series (continued) Ethernet Standard Specifications 10GBASE-ER Model Number QFX-SFP-10GE-ER Rate 10 Gbps Connector type Fiber count Dual Transmitter 1550 nm wavelength Minimum launch –4.7 dBm...
QFX3000-G QFabric System Deployment Guide Table 31: Interface Support for 40-Gigabit Ethernet QSFP+ Transceivers for the QFX Series (continued) Ethernet Standard Specifications 40GBASE-SR4 Model number QFX-QSFP-40G-ESR4 Rate 40 Gbps Connector type 12-ribbon multimode fiber crossover cable with female MTP connectors...
QFX3000-G QFabric System Deployment Guide Table 33: SFP+ Passive Direct Attach Copper Cable Specifications Model Specifications QFX-SFP-DAC-1M Rate 10-Gbps full-duplex serial transmission Connector type Copper pigtail Supply voltage 3.3 V Power consumption (per end) 0.015 W ° ° Storage temperature –40...
QFX3000-G QFabric System Deployment Guide Table 34: SFP+ Active Direct Attach Copper Cable Specifications Model Specifications QFX-SFP-DAC-1MA Rate 10-Gbps full-duplex serial transmission Connector type Copper pigtail Supply voltage 3.3 V Power consumption (per end) 0.627 W ° ° Storage temperature –40...
QFX3000-G QFabric System Deployment Guide Table 34: SFP+ Active Direct Attach Copper Cable Specifications (continued) Model Specifications QFX-SFP-DAC-10MA Rate 10-Gbps full-duplex serial transmission Connector type Copper pigtail Supply voltage 3.3 V Power consumption (per end) 0.627 W ° ° Storage temperature –40...
QFX3000-G QFabric System Deployment Guide Table 36: QSFP+ DAC Breakout Cable Specifications Model Specifications QFX-QSFP-DACBO-1M Rate 10-Gbps full-duplex serial transmission Connector type Copper pigtail Supply voltage 3.3 V ° ° Storage temperature –40 C to 85 Cable type Twinax Wire AWG...
QFX3000-G QFabric System Deployment Guide NOTE: The QSFP+ DAC cables consist of a cable assembly terminated with QSFP+ transceivers on either end. If you use the QSFP+ DAC cable as the data plane connection between a QFX3600-I and QFX3600 or QFX3500 Node device, the interface is automatically configured to operate at 40 Gbps.
) ports QFX3500 Node device management ( ) ports Related Connecting QFX3100 Director Devices to a Copper-Based QFX3000-G QFabric System Documentation Control Plane Network on page 231 Connecting QFX3100 Director Devices to a Copper-Based QFX3000-M QFabric System Control Plane Network...
Page 153
Connecting a QFX3600-I Interconnect Device to a Copper-Based QFX3000-M QFabric System Control Plane Network Connecting a QFX3500 Node Device to a Copper-Based QFX3000-G QFabric System Control Plane Network on page 241 Connecting a QFX3600 Node Device to a Copper-Based QFX3000-G QFabric System...
QFX3000-G QFabric System Deployment Guide Table 41: AC Power Specifications for a QFX3100 Director Device (continued) Item Specifications AC input current rating 5 A at 100 VAC 2 A at 240 VAC Typical power consumption Maximum power consumption Related AC Power Supply in a QFX3100 Director Device...
QFX3000-G QFabric System Deployment Guide Table 43: AC Power Specifications for a QFX3008-I Interconnect Device with Single-Phase Wiring Trays (continued) Item Specifications AC system input power 9000 W (3000 W per power supply) Related AC Power Supply in a QFX3008-I Interconnect Device...
QFX3000-G QFabric System Deployment Guide WARNING: Translation from Japanese: The attached power cable is only for this product. Do not use the cable for another product. CAUTION: Power cords and cables must not block access to device components or drape where people could trip on them.
QFX3000-G QFabric System Deployment Guide The power cords you provide must comply with the specifications listed in Table 47 on page 136. NOTE: In North America, AC power cords must not exceed 4.5 m (approximately 14.75 ft) in length, to comply with National Electrical Code (NEC) Sections 400-8 (NFPA 75, 5-2.2) and 210-52, and Canadian Electrical...
QFX3000-G QFabric System Deployment Guide Table 49 on page 138 describes the AC power specifications for a QFX3600 or QFX3600-I device. Table 49: AC Power Specifications for a QFX3600 or QFX3600-I Device Item Specification AC input voltage Operating range: 100–240 VAC AC input line frequency 50–60 Hz...
QFX3000-G QFabric System Deployment Guide Table 51: AC Power Cord Specifications (continued) Country/Region Electrical Specifications Plug Standards Switzerland 250 VAC, 10 A, 50 Hz SEV 1011 SEV 6534/2 United Kingdom 250 VAC, 10 A, 50 Hz BS 1363A Figure 16 on page 140...
“QFX3000-G QFabric System Installation Overview” on page 83 for information about the steps to install and configure your QFX3000-G QFabric system. See QFX3000-M QFabric System Installation Overview for information about the steps to install and configure your QFX3000-M QFabric system.
QFX3000-G QFabric System Deployment Guide Unpacking a QFX3100 Director Device Supported Platforms QFabric System The QFX3100 Director devices are shipped in a cardboard carton, secured with foam packing material. The carton also contains an accessory box and quick start instructions.
QFX3000-G QFabric System Deployment Guide Mounting a QFX3100 Director Device on Two Posts in a Rack or Cabinet Supported Platforms QFabric System You can mount a QFX3100 Director device on two posts of a 19-in. rack or cabinet by using the mounting brackets provided with the device. (The remainder of this topic uses “rack”...
Page 174
QFX3000-G QFabric System Deployment Guide Ensure that you have the following parts and tools available: Electrostatic discharge (ESD) grounding strap (provided). Phillips (+) screwdriver, number 2. Screws to secure the chassis and mounting brackets to the rack (not provided). One pair of adjustable rear mounting brackets (provided). These mounting brackets support the rear of the chassis, and must be installed.
QFX3000-G QFabric System Deployment Guide Ensure that you have the following parts and tools available: A power cord appropriate for your geographical location To connect AC power to a QFX3100 Director device (see Figure 20 on page 150): Ensure that the power supplies are fully inserted in the QFX3100 Director device.
Page 178
QFX3000-G QFabric System Deployment Guide Before you power on the QFX3100 Director device, ensure that: All required QFX3100 Director device components are installed. You understand how to protect the QFX3100 Director device from electrostatic damage. See Prevention of Electrostatic Discharge Damage.
Installing the Cable Management System on a QFX3008-I Interconnect Device and Installing the Lockable Front Doors on a QFX3008-I Interconnect Device. “QFX3000-G QFabric System Installation Overview” on page 83 for information about the next steps to install and configure your QFX3000 QFabric system.
If any part on the packing list is missing, contact your customer service representative or contact Juniper Networks customer care from within the U.S. or Canada by telephone at 1-800-638-8296. For international-dial or direct-dial options in countries without toll-free numbers, see http://www.juniper.net/support/requesting-support.html...
QFX3000-G QFabric System Deployment Guide Table 55 on page 158 lists the parts and their quantities in the packing list for a QFX3008-I Interconnect device. Table 55: Parts List for QFX3008-I Interconnect Device Configurations Component Quantity Chassis, including the midplane and rack-mounting brackets...
QFX3000-G QFabric System Deployment Guide Before you install the QFX3008-I Interconnect device in a four-post rack or cabinet, you must first install mounting hardware and remove the center-mounting brackets from the chassis. NOTE: In a rack, the device uses 21 U. You can mount two QFX3008-I Interconnect devices on a 42 U rack provided that the racks meet the strength requirements to support the combined weight of the devices.
QFX3000-G QFabric System Deployment Guide Installing Cage Nuts for the Four-Post Mounting Shelf and Support Bracket for QFX3008-I Interconnect Device Four-Post Rack or Cabinet Mounting For racks without threaded holes, you must install cage nuts on the rack or cabinet rails...
QFX3000-G QFabric System Deployment Guide Figure 24: Installing Spacer Bar and Shelves for QFX3008-I Interconnect Device Four-Post Rack or Cabinet Mounting For a four-post rack or cabinet, Table 60 on page 164 specifies the holes in which you insert mounting screws (an indicates a mounting hole location), and cage nuts if needed.
QFX3000-G QFabric System Deployment Guide Install the small shelf on the back rack rails. Rest the bottom slot of each ear on a mounting screw. The small shelf installs on the back of the rear rails, extending toward the center of the rack. The bottom of the small shelf should align with the bottom of the large shelf.
QFX3000-G QFabric System Deployment Guide Figure 25: Installing the Mounting Hardware for a Two-Post Rack Open-frame rack Small mounting shelf Large mounting shelf For a two-post rack, Table 61 on page 168 specifies the holes in which you insert mounting screws (an indicates a mounting hole location), and cage nuts if needed.
QFX3000-G QFabric System Deployment Guide Before you begin, ensure that you have the following parts and tools available to install the small mounting shelf: A Phillips (+) screwdriver, number 2 or 3, depending on the size of your rack mounting...
Page 198
QFX3000-G QFabric System Deployment Guide NOTE: Earlier versions of the four-post rack mounting hardware did not require the rear support anchors. If your four-post rack mounting hardware includes spacer bars and two shelves the rear support anchors are not required.
QFX3000-G QFabric System Deployment Guide TIP: Because the rear support anchors are attached to the chassis grounding points, it is best to connect the chassis to earth ground while performing this step. See “Connecting Earth Ground to a QFX3008-I Interconnect Device” on page 174 for more information.
QFX3000-G QFabric System Deployment Guide In a four-post rack, place the grounding lug attached to the grounding cable over one of the rear support anchors, as shown in Figure 28 on page 176. In a two-post rack, place the grounding cable lug over the grounding points on the bottom rear of the chassis below the wiring trays.
QFX3000-G QFabric System Deployment Guide Set the switch, which is near the top of the wiring tray faceplate, to the OFF (O) position. Locate the power cord or cords shipped with the device; the cords have plugs appropriate for your geographical location.
Page 208
QFX3000-G QFabric System Deployment Guide NOTE: Each wiring tray must be connected to a dedicated AC power source outlet. Before you begin to prepare the wiring trays for installation: Ensure that you understand how to prevent ESD damage. See Prevention of Electrostatic Discharge Damage.
Page 210
QFX3000-G QFabric System Deployment Guide A QFX3008-I Interconnect device receives additional grounding when you plug the power supply in the device into a grounded AC power outlet by using the AC power cord appropriate for your geographical location. See “AC Power Cord Specifications for a QFX3008-I Interconnect Device with Three-Phase Delta Wiring Trays”...
QFX3000-G QFabric System Deployment Guide Connect the wires to the AC terminal block on the three-phase delta wiring tray (Figure 35 on page 186). Use a 1/4-in. slotted screwdriver to loosen the input terminal or grounding point screw, insert each wire into the grounding point or input terminal, and tighten the screw to between 23 in-lb (2.6 Nm) and 25 in-lb (2.8 Nm).
Page 214
QFX3000-G QFabric System Deployment Guide Ensure that a licensed electrician has prepared the power cords. See “Preparing Delta and Wye Three-Phase Power Cords” on page 178. Ensure that you have the following parts and tools available to connect power to the...
QFX3000-G QFabric System Deployment Guide Replace the cover on the wiring compartment, and using a number 1 Phillips (+) screwdriver, tighten the four screws. Repeat Step through Step for the other wiring tray. Related Powering On a QFX3008-I Interconnect Device on page 191...
QFX3000-G QFabric System Deployment Guide If you are using the QFX3600 device as a Node device in a QFX3000-G QFabric system, see “QFX3000-G QFabric System Installation Overview” on page 83 information about the steps to install and configure your QFX3000-G QFabric system.
Page 222
QFX3000-G QFabric System Deployment Guide Ensure you understand how to prevent electrostatic discharge (ESD) damage. See Prevention of Electrostatic Discharge Damage. Verify that the site meets the requirements described in Site Preparation Checklist for a QFX3600 or QFX3600-I Device. Place the rack in its permanent location, allowing adequate clearance for airflow and maintenance, and secure it to the building structure.
QFX3000-G QFabric System Deployment Guide Related Rack-Mounting and Cabinet-Mounting Warnings Documentation Connecting Earth Ground to QFX3600 or QFX3600-I Devices on page 201 Connecting AC Power to a QFX3500, QFX3600, or QFX3600-I Device on page 203 Connecting DC Power to a QFX3500, QFX3600, or QFX3600-I Device on page 205...
QFX3000-G QFabric System Deployment Guide Figure 41: Attaching the Installation Blades to the Rear of the Rack Prepare the device for mounting. a. Place the device on a flat, stable surface. b. Align the mounting brackets along the front or rear of the side panels of the device chassis depending on how you want to mount the device.
Page 228
QFX3000-G QFabric System Deployment Guide To meet safety and electromagnetic interference (EMI) requirements and to ensure proper operation, you must connect the QFX3600 and QFX3600-I devices to earth ground before you connect it to power. For installations that require a separate grounding conductor to the chassis, use the...
QFX3000-G QFabric System Deployment Guide Power Cord Specifications for a QFX3500, QFX3600, or QFX3600-I Device” on page 139). Install the power supply in the chassis. For instructions on installing a power supply in a QFX3500 device, see Installing a Power Supply in a QFX3500 Device. For instructions on installing a power supply in a QFX3600 or QFX3600-I device, see Installing a Power Supply in a QFX3600 or QFX3600-I Device.
Page 232
QFX3000-G QFabric System Deployment Guide NOTE: The battery returns of the DC power supply should be connected as an isolated DC return (DC-I). Before you begin connecting DC power to the device: Ensure that you have taken the necessary precautions to prevent electrostatic discharge (ESD) damage (see Prevention of Electrostatic Discharge Damage).
QFX3000-G QFabric System Deployment Guide power supply on the other side of the chassis. This configuration provides the commonly deployed A/B feed redundancy for the system. Secure the ring lug of the positive (+) DC power source cable to the V+ terminal on the DC power supply.
QFX3000-G QFabric System Deployment Guide Connect the other end of the Ethernet cable into the console server (see Figure 21 on page 151) or management console (see Figure 22 on page 151). Figure 48: Connecting the QFX Series to a Management Console Through...
If you are using the QFX3500 device as a standalone switch, follow the instructions in Configuring a QFX3500 Device as a Standalone Switch. If you are using the QFX3500 device as a Node device in a QFX3000-G QFabric system, see “QFX3000-G QFabric System Installation Overview”...
QFX3000-G QFabric System Deployment Guide Related Rack Requirements for a QFX3500 Device Documentation Cabinet Requirements for a QFX3500 Device Clearance Requirements for Airflow and Hardware Maintenance for a QFX3500 Device Unpacking a QFX3500 Device Supported Platforms QFabric System QFX3500 The QFX3500 device chassis is a rigid sheet-metal structure that houses the hardware components.
QFX3000-G QFabric System Deployment Guide Eight screws to secure the chassis and rear installation blades to the rack (not provided). Appropriate screwdriver for the mounting screws (not provided). WARNING: The QFX3500 device must be supported at all four corners. Mounting the chassis using only the front brackets will damage the chassis and can result in serious bodily injury.
Page 242
QFX3000-G QFabric System Deployment Guide To meet safety and electromagnetic interference (EMI) requirements and to ensure proper operation, you must connect the QFX3500 device to earth ground before you connect it to power. For installations that require a separate grounding conductor to the chassis, you must...
Page 244
QFX3000-G QFabric System Deployment Guide CAUTION: Before you connect power to the device, a licensed electrician must attach a cable lug to the grounding and power cables that you supply. A cable with an incorrectly attached lug can damage the device (for example, by causing a short circuit).
QFX3000-G QFabric System Deployment Guide Connecting DC Power to a QFX3500, QFX3600, or QFX3600-I Device Supported Platforms QFabric System QFX3500, QFX3600 The power supply in QFX3500, QFX3600, and QFX3600-I devices is a hot-removable and hot-insertable field-replaceable unit (FRU). You can remove and replace it without powering off the device or disrupting device functions.
QFX3000-G QFabric System Deployment Guide CAUTION: The DC power supply has four terminals labeled V+, V+, V–, and V– for connecting DC power source cables labeled positive (+) and negative (–). The V+ terminals are shunted internally together, as are the V- terminals.
QFX3000-G QFabric System Deployment Guide To connect the QFX Series to a management console (see Figure 21 on page 151 Figure 22 on page 151): Connect one end of the Ethernet cable to the console port (labeled CONSOLE Connect the other end of the Ethernet cable into the console server (see...
Supported Platforms QFX3000-G A QFX3000-G QFabric system control plane and management network is formed by connecting the QFX Series devices in your network to two Virtual Chassis. If you are creating a copper-based control plane network, you use four EX4200-48T Ethernet switches in each Virtual Chassis.
Before you begin to interconnect two Virtual Chassis for QFX3000-G QFabric system control plane redundancy: Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). See “Installing and Connecting a QFX3100 Director Device” on page 143, “Installing and Connecting a QFX3008-I Interconnect Device”...
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System Table 64: Virtual Chassis-to-Virtual Chassis Copper-Based Control Plane Port Assignments Member 0 Member 1 Member 2 Member 3 Connect Connect Connect Connect xe-0/1/0 xe-0/1/0 xe-1/1/0 xe-1/1/0 xe-2/1/0 xe-2/1/0...
Figure 61 on page 228 through Figure 63 on page 229). Figure 61: QFX3100 Director Group Control Plane Connections for QFX3000-G QFabric System Using Copper-Based Control Plane 0 1 2 3 0 1 2 3 Patch cables between Director devices 0 1 2 3...
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System Figure 62: QFX3100 Director Group Control Plane Connections for QFX3000-G QFabric System Using Fiber-Based Control Plane 0 1 2 3 0 1 2 3 Patch cables between Director devices...
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System Connecting QFX3100 Director Devices to a Fiber-Based QFX3000-G QFabric System Control Plane Network on page 251 Connecting QFX3100 Director Devices to a Copper-Based QFX3000-M QFabric System Control Plane Network...
Page 258
“Cable Specifications for Copper-Based Control Plane Connections for the QFabric System” on page 126. To connect a QFX3100 Director device to the QFX3000-G QFabric control plane network (see Figure 64 on page 231): Connect both network modules on the first Director device (labeled...
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System Table 65: QFX3100 Director Device-to-Virtual Chassis Control Plane Port Assignments for DG0 Network Module Port Network Module Port Network Module Port Network Module Port 3 Virtual Chassis port...
Supported Platforms QFX3000-G A QFX3000-G QFabric system control plane and management network is formed by connecting the QFabric system devices in your network to two Virtual Chassis composed of four EX4200 switches each. QFX3008-I Interconnect Devices have four small form factor pluggable plus (SFP+) management ports on each Control Board.
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System Figure 65: QFX3008-I Interconnect Device Control Plane Connections Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 ge-0/0/39 ge-0/0/39 ge-1/0/39 ge-1/0/39...
Interconnect the two Virtual Chassis switches using the 10-Gigabit Ethernet SFP+ uplink ports. For more information, see “Interconnecting Two Virtual Chassis for Copper-Based QFX3000-G QFabric System Control Plane Redundancy” on page 225. Ensure that 1000BASE-T SFP transceivers are installed in port...
Page 263
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System To connect each QFX3008-I Interconnect Device to the QFX3000-G QFabric system control plane network (see Figure 65 on page 235: Connect the first Interconnect device. Connect one end of the first RJ-45 patch cable to the first SFP management port...
Figure 66: QFX3600 Node Device Control Plane Connections Node ge-0/0/0 ge-0/0/0 Before you begin to cable the QFX3000-G QFabric system control plane and management network: Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). For more information, see “Installing and Connecting a QFX3100 Director...
Node 127: ge-0/0/31 ge-1/0/31 ge-2/0/31 ge-3/0/31 To connect a QFX3600 Node device to the QFX3000-G QFabric system control plane network (see Figure 66 on page 239): Connect one end of the first RJ-45 patch cable to the first management port (labeled ) on the Node device front panel.
Interconnect the two Virtual Chassis switches using the 10-Gigabit Ethernet SFP+ uplink ports. For more information, see “Interconnecting Two Virtual Chassis for Copper-Based QFX3000-G QFabric System Control Plane Redundancy” on page 225. Ensure that you have two RJ-45 patch cables available. For cable specifications, see “Cable Specifications for Copper-Based Control Plane Connections for the QFabric...
Page 269
Chapter 13: Cabling a Copper-Based Control Plane for the QFX3000-G QFabric System To connect a QFX3500 Node device to the QFX3000-G QFabric system control plane network (see Figure 67 on page 241): Connect one end of the first RJ-45 patch cable to the first management port (labeled ) on the Node device management board.
Supported Platforms QFX3000-G A QFX3000-G QFabric system control plane and management network is formed by connecting the QFX Series devices in your network to two Virtual Chassis. If you are creating a fiber-based control plane network, you use eight EX4200-24F Ethernet switches in each Virtual Chassis.
Before you begin to interconnect two Virtual Chassis for QFX3000-G QFabric system control plane redundancy: Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). See “Installing and Connecting a QFX3100 Director Device” on page 143, “Installing and Connecting a QFX3008-I Interconnect Device”...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Virtual Chassis to connect to each of the QFabric system device types. Such design simplifies installation and facilitates timely deployment of a QFabric system. It also permits the use of a standard Virtual Chassis configuration (see “Example: Configuring...
Figure 61 on page 228 through Figure 63 on page 229). Figure 70: QFX3100 Director Group Control Plane Connections for QFX3000-G QFabric System Using Copper-Based Control Plane 0 1 2 3 0 1 2 3 Patch cables between Director devices 0 1 2 3...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Figure 71: QFX3100 Director Group Control Plane Connections for QFX3000-G QFabric System Using Fiber-Based Control Plane 0 1 2 3 0 1 2 3 Patch cables between Director devices...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Connecting QFX3100 Director Devices to a Fiber-Based QFX3000-G QFabric System Control Plane Network on page 251 Connecting QFX3100 Director Devices to a Copper-Based QFX3000-M QFabric System Control Plane Network...
Series device types. Such design simplifies installation and facilitates timely deployment of a QFabric system. It also permits the use of a standard Virtual Chassis configuration (see “Example: Configuring a Fiber-Based Control Plane for the QFX3000-G QFabric System” on page 327).
Page 279
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). See “Installing and Connecting a QFX3100 Director Device” on page 143, “Installing and Connecting a QFX3008-I Interconnect Device” on page 155, “Installing...
QFX3000-G QFabric System Deployment Guide on the second network module (also labeled through ) to the second Virtual Chassis ). The ports used are the same on each Virtual Chassis. Table 71: QFX3100 Director Device-to-VIrtual Chassis Control Plane Port Assignments for DG0...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System To connect a QFX3100 Director device to a network for out-of-band management: Connect one end of the Ethernet cable to the management port (labeled MGMT the Director device front panel).
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). For more information, see “Installing and Connecting a QFX3100 Director Device” on page 143, “Installing and Connecting a QFX3008-I Interconnect Device” on...
Page 284
QFX3000-G QFabric System Deployment Guide Table 73: Interconnect Device Port Mappings (continued) Interconnect Device Virtual Chassis VC0 Virtual Chassis VC1 CB0, port 0 ge-0/0/18 CB0, port 1 ge-0/0/18 CB1, port 0 ge-1/0/18 CB1, port 1 ge-1/0/18 CB0, port 0 ge-2/0/18...
Page 285
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System To connect each QFX3600-I Interconnect device to the fiber-based control plane network: WARNING: Do not look directly into a fiber-optic transceiver or into the ends of fiber-optic cables. Fiber-optic transceivers and fiber-optic cables connected to transceivers emit laser light that can damage your eyes.
Page 286
QFX3000-G QFabric System Deployment Guide CB 1 Connect the other end of that cable to port on the first Virtual Chassis. ge-3/0/19 Connect one end of the fourth fiber optic cable to the SFP optical transceiver in the second management port (labeled...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Connect the other end of that cable to port on the second Virtual Chassis. ge-3/0/18 Related Connecting a QFX3600 Node Device to a QFX3008-I Interconnect Device on page 269...
Page 288
QFX3000-G QFabric System Deployment Guide Before you begin to connect a QFX3600 Node device to the fiber-based QFX3000-G QFabric system control plane network: Install your QFabric system hardware (Director group, Interconnect devices, and Node devices). For more information, see “Installing and Connecting a QFX3100 Director Device”...
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Table 74: QFX3600 Node Device-to-Virtual Chassis Fiber-Based Control Plane Port Assignments Member 0 Member 1 Member 2 Member 3 Member 4 Member 5 Member 6 Member 7 Node: 0...
Supported Platforms QFX3000-G A QFX3000-G QFabric system control plane and management network is formed by connecting the QFX Series devices in your network to two Virtual Chassis composed of EX4200 switches. If you are creating a fiber-based control plane network, you use eight EX4200-24F Ethernet switches in each Virtual Chassis.
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System Figure 76: QFX3500 Node Device Fiber-Based Control Plane Connections for QFX3000-M QFabric System ge-0/0/0 ge-0/0/0 Use the following QFX3500 Node devices and EX4200 switches for a fiber-based QFX3000-G QFabric system control plane network: QFX3500 Node devices with an SFP management board installed.
QFX3000-G QFabric System Deployment Guide Ensure that you have installed 1-Gigabit Ethernet SFP transceivers in management ports on each QFX3500 Node device (see Installing a Transceiver in a QFX Series Device). For a list of supported transceivers and required cables, see “Interface...
Page 293
Chapter 14: Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric System To connect a QFX3500 Node device to the fiber-based QFX3000-G QFabric system control plane network (see Figure 76 on page 265): WARNING: Do not look directly into a fiber-optic transceiver or into the ends of fiber-optic cables.
Connecting a QFX3600 Node Device to a QFX3008-I Interconnect Device Supported Platforms QFX3000-G To form the data plane in a QFX3000-G QFabric system, you connect the QSFP+ uplink ports (labeled through ) on the QFX3600 Node device to the QSFP+ ports on the 16-port QSFP+ front cards in a QFX3008-I Interconnect device.
Page 296
QFX3000-G QFabric System Deployment Guide Review “Interface Specifications for SFP, SFP+, and QSFP+ Transceivers for the QFX Series” on page 104 for information about the optical interface characteristics. Ensure that you have taken the necessary precautions for safe handling of lasers (see Laser and LED Safety Guidelines and Warnings for the QFX Series).
Connecting a QFX3500 Node Device to a QFX3008-I Interconnect Device Supported Platforms QFX3000-G To form the data plane in a QFX3000-G QFabric system, you connect the QSFP+ uplink ports (labeled through ) on the QFX3500 Node device to the QSFP+ ports on the 16-port QSFP+ front cards in a QFX3008-I Interconnect device.
Page 298
QFX3000-G QFabric System Deployment Guide If the connector at the other end of the fiber-optic cable is covered by a rubber safety cap, remove the cap. Save the cap. Remove the rubber safety cap from the QSFP+ optical transceiver on the 16-port QSFP+ front card on the QFX3008-I Interconnect device.
QFabric System Initial and Default Configuration Information on page 275 Converting the Device Mode for a QFabric System Component on page 277 Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Plane on page 283 Example: Configuring a Fiber-Based Control Plane for the QFX3000-G QFabric...
Page 302
Set an IP address for the default partition. Add the software serial number for your QFabric system. (Review the e-mail containing the software serial number that you received from Juniper Networks when you purchased your QFabric system.) Set the starting MAC address and the range of MAC addresses for the QFabric system.
QFX3000-M QFabric System Installation Overview Converting the Device Mode for a QFabric System Component on page 277 Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Plane on page 283 Example: Configuring EX4200 Switches for the Copper-Based QFX3000-M QFabric...
QFX3000-G QFabric System Deployment Guide You can configure some devices to act as a standalone switch or participate in a QFabric system in a particular role. To change the role of your device, you must set the device mode. Table 76 on page 278 shows the device modes available for various devices.
Page 306
QFX3000-G QFabric System Deployment Guide root@switch# load configuration-name external-path Node Device to Interconnect Device To convert your device from Node device mode to Interconnect device mode, follow these steps: From the default partition CLI prompt, back up your QFabric system configuration to an external location.
Page 308
QFX3000-G QFabric System Deployment Guide To convert your QFabric component from either Interconnect device mode or Node device mode to standalone switch mode, follow these steps: From the default partition CLI prompt, back up your QFabric system configuration to an external location.
QFabric System This example shows you how to connect QFabric system components and configure the Virtual Chassis used by the QFX3000-G QFabric system control plane network. Proper wiring of Director devices, Interconnect devices, and Node devices to the Virtual Chassis, combined with a standard configuration, enables you to bring up the internal QFabric system management network and prepare your QFabric system for full operation.
Page 310
EX4200, EX4500, or EX4550 Virtual Chassis (CLI Procedure). Overview The QFX3000-G QFabric system control plane network connects the Director group, Interconnect devices, and Node devices in a QFabric system across a pair of redundant Virtual Chassis. By separating the management control plane from the data plane, the QFabric system can scale efficiently.
Table 77 on page 285 shows the specific mappings of QFabric system control plane network ports from the Virtual Chassis to the QFabric system components. Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments Member Port QFabric System...
Page 312
QFX3000-G QFabric System Deployment Guide Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments (continued) Member Port QFabric System Member 0 Member 1 Member 2 Member 3 Number Component Node1 Node33 Node65 Node97 ge-X/0/1 Node devices ge-0/0/1 ge-1/0/1...
Page 313
Chapter 16: Initial Setup Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments (continued) Member Port QFabric System Member 0 Member 1 Member 2 Member 3 Number Component Node14 Node46 Node78 Node110 ge-X/0/14 Node devices ge-0/0/14 ge-1/0/14 ge-2/0/14...
Page 314
QFX3000-G QFabric System Deployment Guide Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments (continued) Member Port QFabric System Member 0 Member 1 Member 2 Member 3 Number Component Node27 Node59 Node91 Node123 ge-X/0/27 Node devices ge-0/0/27 ge-1/0/27...
Page 315
Chapter 16: Initial Setup Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port Assignments (continued) Member Port QFabric System Member 0 Member 1 Member 2 Member 3 Number Component DG0 port 0 DG0 port 1 DG0 port 2 Reserved...
QFX3000-G QFabric System Deployment Guide Figure 78: QFX3000-G QFabric System Control Plane—Director Group to Virtual Chassis Connections 0 1 2 3 0 1 2 3 Patch cables between Director devices 0 1 2 3 0 1 2 3 To port 40...
QFX3000-G QFabric System Deployment Guide Figure 79: QFX3000-G QFabric System Control Plane—Interconnect Device to Virtual Chassis Connections Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 ge-0/0/39 ge-0/0/39 ge-1/0/39 ge-1/0/39 ge-2/0/39 ge-2/0/39 ge-3/0/39...
Virtual Chassis. In general, connect the first management port from a Node device to the first Virtual Chassis, and the second management port to the second Virtual Chassis. Figure 80: QFX3000-G QFabric System Control Plane—Node Device to Virtual Chassis Connections ge-0/0/0...
Virtual Chassis portion of the control plane. In general, connect each 10-Gigabit Ethernet uplink port from the first Virtual Chassis to the corresponding 10-Gigabit Ethernet uplink port on the second Virtual Chassis. Figure 81: QFX3000-G QFabric System Control Plane—Inter-Virtual Chassis LAG Connections xe-0/1/0...
Page 336
QFX3000-G QFabric System Deployment Guide The following portion of the configuration applies to the specific requirements of your management network. Modify this section to meet the needs of your network. [edit] system { host-name qfabric-control-plane; services { ssh; telnet; web-management { http;...
Page 340
QFX3000-G QFabric System Deployment Guide ge-1/0/11.0 down eth-switch ge-1/0/12 down ge-1/0/12.0 down eth-switch ge-1/0/13 down ge-1/0/13.0 down eth-switch ge-1/0/14 down ge-1/0/14.0 down eth-switch ge-1/0/15 down ge-1/0/15.0 down eth-switch ge-1/0/16 down ge-1/0/16.0 down eth-switch ge-1/0/17 down ge-1/0/17.0 down eth-switch ge-1/0/18 down ge-1/0/18.0...
Page 342
QFX3000-G QFabric System Deployment Guide ge-2/0/23.0 down eth-switch ge-2/0/24 down ge-2/0/24.0 down eth-switch ge-2/0/25 down ge-2/0/25.0 down eth-switch ge-2/0/26 down ge-2/0/26.0 down eth-switch ge-2/0/27 down ge-2/0/27.0 down eth-switch ge-2/0/28 down ge-2/0/28.0 down eth-switch ge-2/0/29 down ge-2/0/29.0 down eth-switch ge-2/0/30 down ge-2/0/30.0...
Page 344
QFX3000-G QFabric System Deployment Guide ge-3/0/37.0 down eth-switch ge-3/0/38 down ge-3/0/38.0 down eth-switch ge-3/0/39 ge-3/0/39.0 eth-switch ge-3/0/40 down ge-3/0/40.0 down aenet --> ae0.0 ge-3/0/41 down ge-3/0/41.0 down aenet --> ae1.0 ge-3/0/42 down ge-3/0/42.0 down aenet --> ae2.0 ge-3/0/43 down ge-3/0/43.0 down aenet -->...
Page 348
QFX3000-G QFabric System Deployment Guide ge-1/0/12.0 down eth-switch ge-1/0/13 down ge-1/0/13.0 down eth-switch ge-1/0/14 down ge-1/0/14.0 down eth-switch ge-1/0/15 down ge-1/0/15.0 down eth-switch ge-1/0/16 down ge-1/0/16.0 down eth-switch ge-1/0/17 down ge-1/0/17.0 down eth-switch ge-1/0/18 down ge-1/0/18.0 down eth-switch ge-1/0/19 down ge-1/0/19.0...
Page 350
QFX3000-G QFabric System Deployment Guide ge-2/0/24.0 down eth-switch ge-2/0/25 down ge-2/0/25.0 down eth-switch ge-2/0/26 down ge-2/0/26.0 down eth-switch ge-2/0/27 down ge-2/0/27.0 down eth-switch ge-2/0/28 down ge-2/0/28.0 down eth-switch ge-2/0/29 down ge-2/0/29.0 down eth-switch ge-2/0/30 down ge-2/0/30.0 down eth-switch ge-2/0/31 down ge-2/0/31.0...
Page 352
QFX3000-G QFabric System Deployment Guide ge-3/0/38.0 down eth-switch ge-3/0/39 ge-3/0/39.0 eth-switch ge-3/0/40 down ge-3/0/40.0 down aenet --> ae0.0 ge-3/0/41 down ge-3/0/41.0 down aenet --> ae1.0 ge-3/0/42 down ge-3/0/42.0 down aenet --> ae2.0 ge-3/0/43 down ge-3/0/43.0 down aenet --> ae3.0 ge-3/0/44 down ge-3/0/44.0...
QFabric System This example shows you how to connect components and configure switches used by a fiber-based QFX3000-G QFabric system control plane network. Proper wiring of Director devices, Interconnect devices, and Node devices to the control plane switches, combined with a standard configuration, enables you to bring up the internal QFabric system management network and prepare your QFabric system for full operation.
Page 354
EX4200, EX4500, or EX4550 Virtual Chassis (CLI Procedure). Overview The QFX3000-G QFabric system control plane network connects the Director group, Interconnect devices, and Node devices in a QFabric system across a pair of redundant Virtual Chassis. By separating the management control plane from the data plane, the QFabric system can scale efficiently.
23 to Director devices. Table 84 on page 330 shows the details of the QFabric system device-to-Virtual Chassis port mappings for a fiber-based control plane network. Figure 82: QFX3000-G QFabric System Fiber-Based Control Plane—Virtual Chassis Port Ranges Node devices Interconnect devices...
QFX3000-G QFabric System Deployment Guide Table 84 on page 330 shows the specific mappings of QFabric system control plane network ports from the Virtual Chassis to the QFabric system components. Table 84: QFX3000-G QFabric System Virtual Chassis Fiber-Based Control Plane Port Assignments Member QFabric...
Page 357
Chapter 16: Initial Setup Table 84: QFX3000-G QFabric System Virtual Chassis Fiber-Based Control Plane Port Assignments (continued) Member QFabric Member Member Member Member Member Member Member Member Port System Number C omponent Node12 Node28 Node44 Node60 Node76 Node92 Node108 Node124...
Page 358
QFX3000-G QFabric System Deployment Guide Table 84: QFX3000-G QFabric System Virtual Chassis Fiber-Based Control Plane Port Assignments (continued) Member QFabric Member Member Member Member Member Member Member Member Port System Number C omponent IC0 CB0 IC0 CB1 IC1 CB0 IC1 CB1...
Director group that you must connect to the Virtual Chassis and interconnect between the Director devices. Figure 83: QFX3000-G QFabric System Fiber-Based Control Plane—Director Group to Virtual Chassis Connections 0 1 2 3 0 1 2 3...
QFX3000-G QFabric System Deployment Guide Table 85: Director Group Port Mappings Director Device Virtual Chassis VC0 Virtual Chassis VC1 Module 0, port 0 to ge-0/0/22 on VC0 Module 1, port 0 to ge-0/0/22 on VC1 Module 0, port 1 to ge-1/0/22 on VC0...
Chapter 16: Initial Setup Figure 84: QFX3000-G QFabric System Fiber-Based Control Plane—Interconnect Device to Virtual Chassis Connections Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 Port 0 Port 1 ge-0/0/19 ge-0/0/19 ge-1/0/19 ge-1/0/19 ge-2/0/19 ge-2/0/19 ge-3/0/19...
QFX3000-G QFabric System Deployment Guide Table 87: Interconnect Device Port Mappings (continued) Interconnect Device Virtual Chassis VC0 Virtual Chassis VC1 CB0, port 0 to ge-2/0/19 CB0, port 1 to ge-2/0/19 CB1, port 0 to ge-3/0/19 CB1, port 1 to ge-3/0/19 As required, you can extend the number of Interconnect devices from two to four.
Chapter 16: Initial Setup Figure 85: QFX3000-G QFabric System Fiber-Based Control Plane—Node Device to Virtual Chassis Connections ge-0/0/0 ge-0/0/0 In this specific example, for Node device Node0, connect port C0 (also known as me0) to Virtual Chassis VC0 port ge-0/0/0, and connect port C1 (also known as me1) to Virtual Chassis VC1 port ge-0/0/0.
Virtual Chassis portion of the control plane. In general, connect each 10-Gigabit Ethernet uplink port from the first Virtual Chassis to the corresponding 10-Gigabit Ethernet uplink port on the second Virtual Chassis. Figure 86: QFX3000-G QFabric System Fiber-Based Control Plane—Inter-Virtual Chassis LAG Connections xe-0/1/0...
Page 368
QFX3000-G QFabric System Deployment Guide set virtual-chassis member 2 role line-card set virtual-chassis member 2 serial-number ghi789 set virtual-chassis member 3 role line-card set virtual-chassis member 3 serial-number jkl012 set virtual-chassis member 4 role line-card set virtual-chassis member 4 serial-number mno321...
Page 370
QFX3000-G QFabric System Deployment Guide user@switch# set groups qfabric class-of-service interfaces ae* unit 0 classifiers inet-precedence IP_qfabric_classifier user@switch# set groups qfabric class-of-service scheduler-maps cpe_network_smap forwarding-class class_3 scheduler scheduler_3 user@switch# set groups qfabric class-of-service scheduler-maps cpe_network_smap forwarding-class class_2 scheduler scheduler_2 user@switch# set groups qfabric class-of-service scheduler-maps...
Page 372
QFX3000-G QFabric System Deployment Guide user@switch# set system syslog time-format millisecond user@switch# set interfaces vme unit 0 family inet address 192.168.157.26/24 user@switch# set routing-options static route 0.0.0.0/0 next-hop 192.168.157.1 user@switch# set virtual-chassis preprovisioned user@switch# set virtual-chassis member 0 role routing-engine...
Page 378
QFX3000-G QFabric System Deployment Guide family ethernet-switching { vlan { members qfabric; The following portion of the configuration applies to the specific requirements of your management network. Modify this section to meet the needs of your network. [edit] system { host-name qfabric-control-plane;...
Page 380
QFX3000-G QFabric System Deployment Guide Verifying the QFabric System Control Plane—Virtual Chassis VC0 Purpose Verify that your first Virtual Chassis is operational. Action Connect to the Junos OS CLI of Virtual Chassis VC0, either from your management network or from the console port of the master Virtual Chassis member. In operational...
Page 386
There are two methods of importing the configuration file to the QFabric control plane Virtual Chassis. You can load the configuration file onto a USB flash drive from the Juniper Networks software download site before inserting the USB flash drive into the Virtual...
QFabric System Each QFabric system requires a range of reserved MAC addresses that is assigned by Juniper Networks. You must specify the MAC address range when you perform the initial setup of the QFX3100 Director group (see “Performing the QFabric System Initial Setup on a QFX3100 Director Group”...
QFX3000-G QFabric System Deployment Guide Select the option button, and click QFX Series Product Fabric Continue The Generate Licenses - QFX Series Product Fabrics page appears. In the Software Serial No field, enter the software serial number for your QFabric system, and press the Tab key.
Software serial number for your QFabric system (found in the e-mail containing the software serial number that you received from Juniper Networks when you purchased your QFabric system) IP addresses and a default gateway IP address for your QFabric system default partition...
Page 390
QFX3000-G QFabric System Deployment Guide Enter the IP addresses and prefixes for both Director devices. NOTE: The Director group devices and QFabric system default partition IP addresses must be on the same subnet as your management network. Please enter the Director Group 0 IP address and prefix: ip address/prefix...
QFX3000-G QFabric System Deployment Guide Restoring a Backup Configuration Before you restore a backup configuration for the Director group: You must have a backup configuration file. You create the backup file with the request command and save it on an external USB flash system software configuration-backup drive.
Page 396
This design enables the data plane network to focus on efficient, low-latency delivery of data, voice, and video traffic. The QFX3000-G QFabric system control plane uses two sets of four EX4200 switches each, configured as a pair of Virtual Chassis to connect all components within the QFabric system.
Page 398
QFX3000-G QFabric System Deployment Guide Most existing Junos OS configuration statements and operational mode commands are supported (for example, interfaces, VLANs, protocols, and firewall filters). To view QFabric system components and check connectivity of the system, issue the commands. show fabric administration inventory Alias configuration for Director devices, Interconnect devices, and Node devices—Enables you to set user-defined aliases for QFabric system Director devices,...
Related Converting the Device Mode for a QFabric System Component on page 277 Documentation Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System Control Plane on page 283 Example: Configuring EX4200 Switches for the Copper-Based QFX3000-M QFabric System Control Plane...
QFX3000-G QFabric System Deployment Guide RUNNING ON DIRECTOR DEVICE : dg1 root@qfabric> NOTE: The QFabric system is load balanced, so the CLI session might be hosted on either Director device Enter configuration mode (the default mode in the QFabric system is...
Page 401
Chapter 17: QFabric System Configuration Requirements This example uses the following hardware and software components: One QFX3000-G QFabric system containing: Two QFX3100 Director devices Two QFX3008-I Interconnect devices Eight QFX3500 Node devices Junos OS Release 12.2 for these QFX Series components...
Page 402
QFX3000-G QFabric System Deployment Guide username and password to the component. The component accepts these credentials and permits access. NOTE: The three QFabric system login classes give access to the components only. To provide access to the QFabric system as a whole through the default partition command-line interface (CLI), you must configure the usual Junos OS login classes or permissions (such as the super-user class).
Page 404
QFX3000-G QFabric System Deployment Guide permissions all; user Adam { class all-qfabric; authentication { encrypted-password "$1$aoYSFkvE$G/dYqsTV5iSvVW2sND69U."; ## SECRET-DATA remote-debug-permission qfabric-admin; user Oscar { class all-qfabric; authentication { encrypted-password "$1$3e.3wJQ8$31SrzV0.efdRbk.ZJncKm0"; ## SECRET-DATA remote-debug-permission qfabric-operator; user Ulf { class all-qfabric; authentication { encrypted-password "$1$qt9Ncm0o$okNYSN8O4fVITE/SHBdYj0";...
Page 405
Chapter 17: QFabric System Configuration Adam@qfabric.network.net's password: Last login: Sun Nov 20 14:12:29 2011 from 192.168.28.19 Juniper QFabric Director 11.3.5510 2011-10-21 16:31:44 UTC RUNNING ON DIRECTOR DEVICE : dg0 Adam@qfabric> Adam@qfabric> ? Possible completions: clear Clear information in the system...
Page 406
> ssh Oscar@qfabric.network.net Warning: Permanently added 'qfabric.network.net' (RSA) to the list of known hosts. Oscar@qfabric.network.net's password: Last login: Sun Nov 19 19:21:29 2011 from 192.168.28.14 Juniper QFabric Director 11.3.5510 2011-10-22 18:33:41 UTC RUNNING ON DIRECTOR DEVICE : dg1 Oscar@qfabric> Oscar@qfabric> ?
QFX3000-G QFabric System Deployment Guide Ulf@qfabric> Ulf@qfabric> ? Possible completions: clear Clear information in the system configure Manipulate software configuration information file Perform file operations help Provide help information load Load information from file Invoke an operation script ping Ping remote target...
Page 412
QFX3000-G QFabric System Deployment Guide Discover the serial number of the Director device you wish to rename by issuing the context-sensitive help command. set fabric aliases director-device ? root@qfabric# set fabric aliases director-device ? Possible completions: <aliasable-item-name> The name of the item to be aliased...
Page 416
QFX3000-G QFabric System Deployment Guide Member Device Id/Alias Status Role ------ ---------------- ------- --------- Director1 online backup Director Group Managed Services ------------------------------- Shared File System online Network File System online Virtual Machine Server online Load Balancer/DHCP online Hard Drive Status...
QFX3000-G QFabric System Deployment Guide Related aliases on page 416 Documentation show fabric administration inventory on page 584 show fabric administration inventory director-group status on page 589 show fabric administration inventory interconnect-devices on page 597 show fabric administration inventory node-devices on page 599...
Page 420
QFX3000-G QFabric System Deployment Guide [edit chassis node-group name node-device name pic 1] root@qfabric# delete fte port-range port-range-low port-range-high For example, to delete the 40-gigabit data plane uplink port configuration for ports Q4 through Q7: [edit chassis node-group BBAK8281 node-device BBAK8309 pic 1]...
Page 422
QFX3000-G QFabric System Deployment Guide NOTE: The following rules apply to QFabric Node group naming: Node group names must use alphabetic (A through Z and a through z), numeric (0 through 9), or dash (-) characters. The maximum length of a Node group name is 30 characters.
Page 424
QFX3000-G QFabric System Deployment Guide NW-NG-0 Connected Configured Node0 BBAK8309 Connected Node1 BBAK8283 Connected To create a redundant server Node group: Specify the two Node devices you wish to add to the redundant server Node group by including the node-device...
Page 426
QFX3000-G QFabric System Deployment Guide Step-by-Step The following example requires that you navigate various levels in the configuration Procedure hierarchy. For instructions on how to do that, see Using the CLI Editor in Configuration Mode in the CLI User Guide.
QFX3000-G QFabric System Deployment Guide after a system restart. This also enables the network Node group to resume routing operations rapidly if there is a restart in the QFabric system (such as a software upgrade). As a result, we recommend enabling graceful restart for routing protocols in the QFabric CLI.
QFX3000-G QFabric System Deployment Guide Configuring Graceful Restart Options for OSPF and OSPFv3 To configure the duration of the OSPF/OSPFv3 graceful restart period, include the statement at the hierarchy restart-duration [edit protocols (ospf | ospf3) graceful-restart] level. To specify the length of time for which the router notifies helper routers that it has...
Page 432
QFX3000-G QFabric System Deployment Guide Because of the distributed nature of QFabric systems, the default configuration does not allow the maximum number of supported Layer 3 multicast flows to be created. To allow a QFabric system to create the maximum number of supported flows, configure the...
When you purchase a Junos OS software feature license for a QFabric system, you receive an e-mail containing an authorization code for the feature license from Juniper Networks. You can use the authorization code to generate a unique license key (a combination of the authorization code and the QFabric system ID ) for the QFabric system, and then add the license key on the QFabric system.
Page 434
QFX3000-G QFabric System Deployment Guide To generate the license keys for a QFabric system: In a browser, log in to the Juniper Networks License Management System at https://www.juniper.net/lcrs/license.do The Manage Product Licenses page appears. NOTE: To access the licensing site, you must have a service contract with Juniper Networks and an access account.
QFX3000-G QFabric System Deployment Guide NOTE: If the router has two Routing Engines, add the new license on each Routing Engine separately. This ensures that the license key is enabled on the backup Routing Engine during changeover of mastership between the Routing Engines.
QFX3000-G QFabric System Deployment Guide From the CLI operational mode, enter one of the following CLI commands: To save the installed license keys to a file or URL, enter the following command: user@host> request system license save filename | url For example, the following command saves the installed license keys to a file named license.config...
Page 440
QFX3000-G QFabric System Deployment Guide Any configured licenses appear in the output. The output lists features in ascending alphabetical order by license name. The number of licenses appears in the third column. Verify that you have installed the appropriate number of licenses.
QFX3000-G QFabric System Deployment Guide director-device (Aliases) Supported Platforms QFabric System Syntax director-device director-device-name { assigned-director-device-name; Hierarchy Level [edit fabric aliases] Release Information Statement introduced in Junos OS Release 12.2 for the QFX Series. Description (QFabric systems only) Specify the mapping of user-defined names to QFabric system Director devices.
Page 454
QFX3000-G QFabric System Deployment Guide NOTE: helper-disable statement and the no-strict-lsa-checking statement cannot be configured at the same time. If you attempt to configure both statements at the same time, the routing device displays a warning message when you enter the command.
QFX3000-G QFabric System Deployment Guide interconnect-device (Aliases) Supported Platforms QFabric System Syntax interconnect-device interconnect-device-name { assigned-interconnect-device-name; Hierarchy Level [edit fabric aliases] Release Information Statement introduced in Junos OS Release 12.2 for the QFX Series. Description (QFabric systems only) Specify the mapping of user-defined names to QFabric system Interconnect devices.
QFX3000-G QFabric System Deployment Guide no-make-before-break Supported Platforms QFabric System Syntax no-make-before-break; Hierarchy Level [edit fabric routing-options multicast] Release Information Statement introduced in Junos OS Release 12.2 for the QFX Series. Description (QFabric systems only) Disable the default make-before-break multicast feature on QFabric systems to prevent the duplication of system traffic.
QFX3000-G QFabric System Deployment Guide resources Supported Platforms QFabric System Syntax resources { node-group node-group-name { network-domain; node-device node-device-name; Hierarchy Level [edit fabric] Release Information Statement introduced in Junos OS Release 11.3 for the QFX Series. Description (QFabric systems only) Define resources within a QFabric system and handle a variety of component assignments.
Release 13.1X50-D10, you must have Junos OS Release 12.2X50-D42 or later installed. You cannot perform a nonstop software upgrade with Junos OS Release 12.2X50-D41 or earlier. Contact the Juniper Technical Assistance Center for information on how to download Junos OS Release 12.2X50-D42.
QFX3000-G QFabric System Deployment Guide Rebooting Interconnect devices and fabric control Routing Engines one at a time, so that one Interconnect device or one fabric control Routing Engine is always operational Switching mastership of a Node group to the backup Node device before upgrading...
Supported Platforms NOTE: To access the download site, you must have a service contract with Juniper Networks and an access account. If you need help obtaining an account, complete the registration form at the Juniper Networks website https://www.juniper.net/registration/Register.jsp Using a Web browser, navigate to the http://www.juniper.net/support...
QFX3000-G QFabric System Deployment Guide Retrieve the software from the location in which you downloaded it. To do this, issue the command. The software package is copied from request system software download where you downloaded it and is placed locally on the QFabric system.
QFX3000-G QFabric System Deployment Guide When you perform a nonstop software upgrade on a network Node group, the Node devices in the network Node group are upgraded in a serial fashion except when upgrade groups are configured. If you perform a nonstop upgrade on a redundant server Node group, both Node devices must be online for a successful upgrade.
Page 478
QFX3000-G QFabric System Deployment Guide Diagnostic routing engine DRE-0 Connected Configured session1@qfabric> show fabric administration inventory director-group status Director Group Status Tue Jun 5 15:11:26 UTC 2012 Member Status Role Mgmt Address CPU Free Memory VMs Up Time ------ ------ -------- --------------- --- ----------- --- ------------- online master 10.49.215.38...
Page 480
QFX3000-G QFabric System Deployment Guide --------------------- Management Interface Control Plane Bridge Control Plane LAG CP Link [0/2] CP Link [0/1] CP Link [0/0] CP Link [1/2] down CP Link [1/1] down CP Link [1/0] down Crossover LAG CP Link [0/3] CP Link [1/3] session1@qfabric>...
Page 482
QFX3000-G QFabric System Deployment Guide 423G 6.0G 395G /boot 7.3G 86G /pbdata Director Group Processes ------------------------ Director Group Manager online Partition Manager online Software Mirroring online Shared File System master online Secure Shell Process online Network File System online DHCP Server master...
Page 484
QFX3000-G QFabric System Deployment Guide NOTE: If your second SSH session is being hosted by the rebooting Director device, your session terminates and you need to log back in to establish a new session running on the active Director device.
Page 486
QFX3000-G QFabric System Deployment Guide root@qfabric> Read from remote host qfabric-partition0: Connection reset by peer Connection to qfabric-partition0 closed. Upon reopening the SSH session, notice that Director device DG0 is now the master device hosting the session and Director device DG1 does not appear in the QFabric system inventory while it is rebooting.
QFX3000-G QFabric System Deployment Guide Verifying a Fabric Nonstop Software Upgrade Supported Platforms Purpose During the fabric portion of a nonstop software upgrade, you should expect to see both fabric control Routing Engines upgrade first, followed by the upgrade of each Interconnect device one at a time.
QFX3000-G QFabric System Deployment Guide P1550-C Disconnected P1571-C Connected Interconnect device IC-F4912 Connected Configured F4912/RE0 Connected Fabric manager FM-0 Connected Configured Fabric control FC-0 Connected Configured FC-1 Connected Configured Diagnostic routing engine DRE-0 Connected Configured After both Node devices in the redundant server Node group come back online, both...
QFX3000-G QFabric System Deployment Guide group :0 [NW-NG-0 2012-06-01 10:18:37]: Preparing for Switchover [NW-NG-0 2012-06-01 10:18:55]: Switchover Completed [Status 2012-06-01 10:18:58]: Upgrade completed with 0 errors Success Issue the command to view the status of the show system software upgrade status upgrade.
Supported Platforms NOTE: To access the download site, you must have a service contract with Juniper Networks and an access account. If you need help obtaining an account, complete the registration form at the Juniper Networks website https://www.juniper.net/registration/Register.jsp Using a Web browser, navigate to the http://www.juniper.net/support...
QFX3000-G QFabric System Deployment Guide A login screen appears. Enter your user ID and password and click Login Read the End User License Agreement, select the I agree option button, and then click Proceed Save the file on your computer.
Page 500
QFX3000-G QFabric System Deployment Guide JUNOS Online Documentation [11.3X30.6] JUNOS Enterprise Software Suite [11.3X30.6] JUNOS Packet Forwarding Engine Support (QFX RE) [11.3X30.6] JUNOS Routing Software Suite [11.3X30.6] FC-1: Hostname: qfabric Model: qfx-jvre JUNOS Base OS boot [11.3X30.6] JUNOS Base OS Software Suite [11.3X30.6] JUNOS Kernel Software Suite [11.3X30.6]...
(First time only) Implement the following one-time procedure to prepare your QFabric system to use the system backup and recovery feature: Insert a Juniper Networks software installation USB flash drive into the master Director device. (This drive was provided to you as one of the components of your QFabric system shipment.)
Page 502
QFX3000-G QFabric System Deployment Guide recover the QFabric system. The files are saved to a shared memory directory in the Director group. NOTE: As you upgrade your system with new software and change the system configuration over time, remember to reissue this command periodically to save the newest files for recovery purposes.
QFX3000-G QFabric System Deployment Guide show fabric administration system mac-pool show fabric inventory show fabric session-host show log show system software upgrade status QFabric System Operational Mode Commands Supported Platforms QFabric System Table 91 on page 478 summarizes the command line interface (CLI) commands that you can use to monitor and troubleshoot the QFabric system operations.
QFX3000-G QFabric System Deployment Guide Filtering Operational Mode Command Output in a QFabric System Supported Platforms QFabric System When you issue an operational mode command in a QFabric system, the output generated can be fairly extensive because of the number of components contained within the system.
Page 508
QFX3000-G QFabric System Deployment Guide List of Sample Output request chassis device-mode interconnect-device (Starting in Node Device or Standalone Mode) on page 482 request chassis device-mode node-device (Starting in Interconnect Device or Standalone Mode) on page 482 request chassis device-mode standalone (Starting in Interconnect Device or Node...
QFX3000-G QFabric System Deployment Guide request component login Supported Platforms QFabric System Syntax request component login component-name Release Information Command introduced in Junos OS Release 11.3 for the QFX Series. Description (QFabric systems only) Log in to a QFabric system component. To gain access to...
QFX3000-G QFabric System Deployment Guide request fabric administration director-group change-master Supported Platforms QFabric System Syntax request fabric administration director-group change-master (director-device director-device-name) Release Information Command introduced in Junos OS Release 11.3 for the QFX Series. Description (QFabric systems only) Select a Director device to become the new primary device within a Director group.
QFX3000-G QFabric System Deployment Guide request fabric administration system mac-pool delete Supported Platforms QFabric System Syntax request fabric administration system mac-pool delete mac-base starting-mac-address Release Information Command introduced in Junos OS Release 11.3 for the QFX Series. Description (QFabric systems only) Delete a range of MAC addresses assigned manually to the QFabric system.
Page 520
QFX3000-G QFabric System Deployment Guide —(Optional) Number of minutes from now to stop the software. This option in minutes is an alias for the at +minutes option. media (compact-flash | disk | removable-compact-flash | usb) —(Optional) Boot medium for the next boot. (The options...
Page 522
QFX3000-G QFabric System Deployment Guide Sample Output request system halt user@host> request system halt Halt the system ? [yes,no] (no) yes *** FINAL System shutdown message from root@section2 *** System going down IMMEDIATELY Terminated syncing disks... 11 8 done The operating system has halted.
Page 524
QFX3000-G QFabric System Deployment Guide —(QFabric systems only) (Optional) Reboots the software on the Director director-group group and the default partition (QFabric CLI). fabric —(QFabric systems only) (Optional) Reboots the fabric control Routing Engines and the Interconnect devices. —(QFabric systems only) (Optional) Allows the QFabric component to reboot graceful with minimal impact to network traffic.
QFX3000-G QFabric System Deployment Guide request system software format-qfabric-backup Supported Platforms QFabric System QFX Series standalone switches Syntax request system software format-qfabric-backup Release Information Command introduced in Junos OS Release 13.1 for the QFX Series. Description (QFabric systems only) Copy the install media files from a USB flash drive to your QFabric system recovery directory on the Director group.
Page 528
QFX3000-G QFabric System Deployment Guide —Install software package on the redundant server Node group, server node-group name Node group, or network Node group. Required Privilege maintenance Level Related Performing a Nonstop Software Upgrade on the QFabric System on page 445...
Page 530
QFX3000-G QFabric System Deployment Guide [DRE-0 2012-06-05 16:15:22]: Waiting for DRE-0 to terminate ... [DRE-0 2012-06-05 16:15:34]: Waiting for DRE-0 to come back ... [DRE-0 2012-06-05 16:18:44]: Running Uptime Test for DRE-0 [DRE-0 2012-06-05 16:18:51]: Uptime Test for DRE-0 Passed ...
—Copy the QFabric system software package and system configuration file to a none Director group recovery directory. NOTE: If this command fails, insert a Juniper Networks software installation USB flash drive into the master Director device and issue the command. For more request system software format-qfabric-backup...
Page 534
QFX3000-G QFabric System Deployment Guide request system software system-backup usb-create on page 508 Output Fields When you enter these commands, you are provided feedback on the status of your request. Sample Output request system software system-backup user@qfabric> request system software system-backup user@qfabric>...
Page 536
QFX3000-G QFabric System Deployment Guide —(TX Matrix Plus routers and EX4200 and QFX Series only) On the fpc-slot slot-number router or switch, display the text message on the craft interface for a specific Flexible PIC Concentrator (FPC). Replace with a value from through .
Page 538
QFX3000-G QFabric System Deployment Guide set chassis display message (EX Series and QFX Series) The following example shows how to set the display message and verify the result: user@host> set chassis display message "Joe 888-555-4321" message sent user@host> show chassis lcd...
Page 540
QFX3000-G QFabric System Deployment Guide LEDs status: Status LED: Green LED info for: RC 4 FPC - 12 --------------------------------- LEDs status: Status LED: Green LED info for: RC 5 FPC - 13 --------------------------------- LEDs status: Status LED: Green LED info for: RC 6 FPC - 14...
QFX3000-G QFabric System Deployment Guide Table 92: show chassis device-mode Output Fields Field Name Field Description Current device-mode Existing operational mode for the device. The device can be in Interconnect device mode, Node device mode, or standalone mode. Future device-mode Future operational mode for the device after you reboot it.
Release Information Command introduced in Junos OS Release 12.2 for the QFX Series. Description (QFX3000-G QFabric systems only) Display Ethernet switch information for the Control Board (CB) ports in an Interconnect device. Options —Display Ethernet switch information about each connected port on each online none CB in the Interconnect device.
Page 546
QFX3000-G QFabric System Deployment Guide Table 93: show chassis ethernet-switch interconnect-device fpc Output Fields (continued) Field Name Field Description TX Mult. Collision Number of packets sent after multiple collisions. frames TX Late Collision Number of packets aborted during sending because of collisions after 64 bytes.
Page 548
QFX3000-G QFabric System Deployment Guide Sample Output show chassis ethernet-switch interconnect-device cb user@switch> show chassis ethernet-switch interconnect-device IC-WS001 cb Displaying summary for switch 0 Link is down on XE port 1 connected to device: FPC7 Flow Control TX is Disabled...
Release Information Command introduced in Junos OS Release 12.2 for the QFX Series. Description (QFX3000-G QFabric systems only) Display Ethernet switch information for the front card Flexible Port Concentrators (FPCs) in an Interconnect device. Options —Display Ethernet switch information about each connected port on each online none FPC in the Interconnect device.
Page 562
QFX3000-G QFabric System Deployment Guide Table 94: show chassis ethernet-switch interconnect-device fpc Output Fields (continued) Field Name Field Description Duplex is Duplex type of the Ethernet link: full half Autonegotiate is By default, built-in Fast Ethernet ports on a PIC autonegotiate whether to operate at 10 Mbps or 100 Enabled (or Disabled) Mbps.
Page 564
QFX3000-G QFabric System Deployment Guide Table 94: show chassis ethernet-switch interconnect-device fpc Output Fields (continued) Field Name Field Description RX Multicast Packets Number of multicast packets received. RX Broadcast Packets Number of broadcast packets received. RX FCS Errors Number of packets discarded because of frame check sequence errors.
Page 566
QFX3000-G QFabric System Deployment Guide Link is good on XE port 29 connected to device: CB1 Speed is 10000Mb Duplex is full Autonegotiate is Enabled Flow Control TX is Disabled Flow Control RX is Disabled TX Octets RX Octets root@qfabric> show chassis ethernet-switch interconnect-device IC-WS001 fpc...
Page 574
QFX3000-G QFabric System Deployment Guide Port statistics for FC5 switch Empty fpc slot number 5 Port statistics for FC6 switch Empty fpc slot number 6 Port statistics for FC7 switch Empty fpc slot number 7 show chassis ethernet-switch fpc detail slot user@qfabric>...
Page 582
QFX3000-G QFabric System Deployment Guide Flow Control RX is Disabled TX Octets 229932 RX Octets 315346 Link is good on XE port 29 connected to device: CB1 Speed is 10000Mb Duplex is full Autonegotiate is Enabled Flow Control TX is Disabled...
QFX3000-G QFabric System Deployment Guide show chassis fabric connectivity Supported Platforms QFabric System Syntax show chassis fabric connectivity (device | slot) Release Information Command introduced in Junos OS Release 11.3 for the QFX Series. Description (QFabric systems only) Display the status of the data plane connections in your QFabric system.
Page 596
QFX3000-G QFabric System Deployment Guide (EX6200 or EX8200 switches)—Display the information that appears on the LCD panel for the line card in the line-card slot specified by the value. fpc-slot-number Also display the status of the currently selected port parameter of the Status LED for each network port.
Page 606
QFX3000-G QFabric System Deployment Guide LED info for: CB - 0 --------------------------------- LEDs status: Status LED: Green Mastership LED: Green Interface STATUS LED LINK/ACTIVITY LED --------------------------------------------------------- IC-F1012:pme0 : Green IC-F1012:pme1 : Green IC-F1012:pme2 : IC-F1012:pme3 : LED info for: CB - 1...
Page 612
QFX3000-G QFabric System Deployment Guide Table 99: show fabric administration inventory Output Fields (continued) Field Name Field Description Level of Output Fabric control Name of the virtual Junos Routing Engines responsible for route selection within a QFabric system detail partition. The fabric control Routing Engine can be either...
Page 616
QFX3000-G QFabric System Deployment Guide Table 100: show fabric administration inventory director-group status Output Fields (continued) Field Name Field Description Number of virtual machines operating on the Director device. A Routing Engine issue exists on a particular Director device when the system displays a star (...
QFX3000-G QFabric System Deployment Guide show fabric administration inventory infrastructure Supported Platforms QFabric System Syntax show administrator inventory infrastructure <brief | detail> (fabric-controls | fabric-managers | diagnostic-routing-engines) Release Information Command introduced in Junos OS Release 11.3 for the QFX Series.
Page 626
QFX3000-G QFabric System Deployment Guide Table 103: show fabric administration inventory node-devices Output Fields (continued) Field Name Field Description Node device Name of the Node devices associated with the Node group. The device can be either Connected , depending on whether or not the Director software has detected keepalive messages Not Connected for the device.
Page 628
QFX3000-G QFabric System Deployment Guide Table 104: show fabric administration inventory node-groups Output Fields (continued) Field Name Field Description Configuration Whether or not the configuration for a QFabric system component has been received and installed. The configuration can be (unsuccessful),...
QFX3000-G QFabric System Deployment Guide show fabric inventory Supported Platforms QFabric System Syntax show fabric inventory <brief | detail | terse> <infrastructure fabric-controls <FC-0 | FC-1>> <node-devices node-device-name> <node-groups node-group-name> Release Information Command introduced in Junos OS Release 12.2 for the QFX Series.
QFX3000-G QFabric System Deployment Guide show log Supported Platforms EX Series J Series M Series MX Series PTX Series QFabric System QFX Series standalone switches T Series List of Syntax Syntax on page 608 Syntax (QFabric System) on page 608...
(First time only) Implement the following one-time procedure to prepare your QFabric system to use the system backup and recovery feature: Insert a Juniper Networks software installation USB flash drive into the master Director device. (This drive was provided to you as one of the components of your QFabric system shipment.)
QFX3000-G QFabric System Deployment Guide Remove the Juniper Networks software installation USB drive from the master Director device. Issue the command to backup the software request system software system-backup package and configuration file. This command saves the current files necessary to recover the QFabric system.
Flash Drive Supported Platforms If you do not have an external USB flash drive preloaded with the software from Juniper Networks to use as an emergency boot device, you can create your own, using a blank external USB flash drive provided by Juniper Networks. Download the install media from...
Untar the install-media-qfabric-<version> .img.tgz file on your UNIX workstation. tar -xvzf install-media-qfabric-11.3X30.6.img.tgz Insert a blank external USB (4-gigabyte) flash drive supplied by Juniper Networks into your UNIX workstation. Burn the software image you just downloaded to your UNIX workstation onto your external USB flash drive using the dd command: dd if=install-media-qfabric-11.3X30.6.img of=/dev/sdb bs=16k...
Page 645
The following menu appears on the Director device console when the Director device boots up: Juniper Networks QFabric Director Install/Recovery Media To boot from the local disk, wait 10 seconds or press the Enter key. To reinstall the QFabric software on this Director device, type: install Type install and then press to install the software on the Director device.
Page 646
QFX3000-G QFabric System Deployment Guide root@dg0 ~]# ls /mnt Issue the mkdir command to create a directory within the mount directory. root@dg0 ~]# mkdir /mnt/myusb Issue the mount /dev/sdb2 /mnt/myusb/ command to mount the external USB flash drive to the local drive of the Director device.
Page 648
QFX3000-G QFabric System Deployment Guide FC-1: Hostname: qfabric Model: qfx-jvre JUNOS Base OS boot [11.3X30.6] JUNOS Base OS Software Suite [11.3X30.6] JUNOS Kernel Software Suite [11.3X30.6] JUNOS Crypto Software Suite [11.3X30.6] JUNOS Online Documentation [11.3X30.6] JUNOS Enterprise Software Suite [11.3X30.6] JUNOS Packet Forwarding Engine Support (QFX RE) [11.3X30.6]...
Page 650
QFX3000-G QFabric System Deployment Guide [edit system] user@device> request system reboot If you do not have access to the CLI, power cycle the QFX Series device. The emergency boot device (external USB install media) is detected. At this time, you can load the Junos OS from the emergency boot device onto the internal flash storage.
In the following procedure, we assume that you are creating the emergency boot device on a QFX3500 device. You can create the emergency boot device on another Juniper Networks switch or router, or any PC or laptop that supports Linux. The steps you take to create the emergency boot device vary, depending on the device.
Page 652
QFX3000-G QFabric System Deployment Guide root@device% dd if=/var/tmp/install-media-qfx3500.junos_11.1 of=/dev/da1 bs=16k 11006+1 records in 11006+1 records out 180332544 bytes transferred in 71.764266 secs (2512846 bytes/sec) Log out of the shell: root@device% exit % exit user@device> Related USB Port Specifications for the QFX Series...