10Gbe Roce Express Sample Configuration; D.2.6 10Gbe Roce Express Configuration Example - IBM z13s Technical Manual

If the IBM 10GbE RoCE Express features are connected to 10 GbE switches, the switches
must support the following requirements:
Global Pause function frame (as described in the IEEE 802.3x standard) should be
enabled
Priority Flow Control (PFC) disabled
No firewalls, no routing, and no intraensemble data network (IEDN)
The maximum supported unrepeated point-to-point distance is 300 meters (984.25 ft.).
A client-supplied cable is required. Three types of cables can be used for connecting the port
to the selected 10 GbE switch or to the 10GbE RoCE Express feature on the attached server:
OM3 50 micron multimode fiber optic cable rated at 2000 MHz-km terminated with an
LC Duplex connector (supports 300 m (984.25 ft.))
OM2 50 micron multimode fiber optic cable rated at 500 MHz-km terminated with an
LC Duplex connector (support 82 m (269 ft.))
OM1 62.5 micron multimode fiber optic cable rated at 200 MHz-km terminated with an
LC Duplex connector (support 33 m (108.2 ft.))

D.2.6 10GbE RoCE Express configuration example

Figure D-5 illustrates a sample configuration that allows redundant SMC-R connectivity
among LPAR A and C, and LPARs 1, 2, and 3. Each feature can be shared or dedicated to an
LPAR. Like the sample configuration, two features per LPAR are advised for redundancy.
Figure D-5 10GbE RoCE Express sample configuration
The configuration that is shown in Figure D-5 allows redundant SMC-R connectivity among
LPAR A, LPAR C, LPAR 1, LPAR 2, and LPAR 3. LPAR to LPAR OSD connections are
required to establish the SMC-R communications. 1 GbE OSD connections can be used
Appendix D. Shared Memory Communications
481