Features And Benefits - Nvidia ConnectX-6 Dx User Manual

Features and Benefits


This section describes hardware features and capabilities. Please refer to the relevant
driver and/or firmware release notes for feature availability.
Feature
PCI Express
(PCIe)
Up to
200GbE
Memory
Overlay
Networks
RDMA
over Conver
ged
Ethernet
(RoCE)
NVIDIA
PeerDirect
®
Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from Downloaded from
PCIe Gen 4.0 SERDES@ 8.0GT/s / 16.0GT/s through x8/x16 Edge Connector
NVIDIA adapters comply with the following IEEE 802.3 standards:
200GbE / 100GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE
– IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
– IEEE 802.3by, Ethernet Consortium25, 50 Gigabit Ethernet, supporting all FEC modes
– IEEE 802.3ba 40 Gigabit Ethernet
– IEEE 802.3by 25 Gigabit Ethernet
– IEEE 802.3ae 10 Gigabit Ethernet
– IEEE 802.3ap based auto-negotiation and KR startup
– IEEE 802.3ad, 802.1AX Link Aggregation
– IEEE 802.1Q, 802.1P VLAN tags and priority
– IEEE 802.1Qau (QCN)
– Congestion Notification
– IEEE 802.1Qaz (ETS)
– IEEE 802.1Qbb (PFC)
– IEEE 802.1Qbg
– IEEE 1588v2
– Jumbo frame support (9.6KB)
• PCI Express - stores and accesses Ethernet fabric connection information and packet
data.
• SPI Quad - includes 256Mbit SPI Quad Flash device (MX25L25645GXDI-08G device by
Macronix)
• Available only in QSFP cards: FRU EEPROM - Stores the parameters and personality of the
card. The EEPROM capacity is 128Kbit. FRU I2C address is (0x50) and is accessible
through the PCIe SMBus
In order to better scale their networks, data center operators often create overlay networks
that carry traffic from individual virtual machines over logical tunnels in encapsulated formats
such as NVGRE and VXLAN. While this solves network scalability issues, it hides the TCP packet
from the hardware offloading engines, placing higher loads on the host CPU. ConnectX-6 Dx
effectively addresses this by providing advanced NVGRE and VXLAN hardware offloading engines
that encapsulate and de-capsulate the overlay protocol.
ConnectX-6 Dx, utilizing RoCE (RDMA over Converged Ethernet) technology, delivers low-latency
and high-performance over Band and Ethernet networks. Leveraging data center bridging (DCB)
capabilities, as well as ConnectX-6 Dx, advanced congestion control hardware mechanisms,
RoCE provides efficient low-latency RDMA services over Layer 2 and Layer 3 networks.
NVIDIA PeerDirect® communication provides high-efficiency RDMA access by eliminating
unnecessary internal data copies between components on the PCIe bus (for example, from GPU
to CPU), and therefore significantly reduces application run time. ConnectX-6 Dx advanced
acceleration technology enables higher cluster efficiency and scalability to tens of thousands of
nodes.
Description
(Note: Address 0x58 is reserved.)
13