Octant - IBM Power Systems 775 Manual

Figure 1-13 Power 775 octant logic diagram
32w SMP w / 2 Tier SMP Fabric, 4 chip Processor QCM + Hub SCM w/ On-Board Optics
Mem
SN
Mem SN
Mem
SN
Mem SN
Mem SN
Mem
SN
Mem
SN
Mem SN
48GB/s (pk)
48GB/s (pk)
Mem Mem SN
Mem
Mem
SN
Mem Mem
SN
Mem
Mem SN
Mem Mem SN
Mem
Mem SN
Mem Mem
SN
Mem
Mem SN
48GB/s (pk)
48GB/s (pk)
D-Link
A=# of D -Link Transceivers; A=16
B=# of Transmitter lanes ; B=10
C=# of Receiver lanes; C=10
D=bit rate per lane ; D=10Gb/S
E=8:10 Coding: E=8/10
BW = Ax(B+C)xDxE
16x(10+10)x10x8/10 = 2560Gb/S=320GB/s
(20GB/S/D-Link)
L-remote Link
A=# of L -Link Transceivers; A=12
B=# of Transmitter lanes ; B=10
C=# of Receiver lanes; C=10
D=bit rate per lane ; D=10Gb/S
E=8:10 Coding: E=8/10
BW = Ax(B+C)xDxE
12x(10+10)x10x8/10 = 1920Gb/S=240GB/s
(20GB/S/L-Link)
Each Power 775 planar consists of eight octants, as shown in Figure 1-14 on page 26. Seven
of the octants are composed of 1x QCM, 1 x HUB, 2 x PCI Express 16x. The other octant
contains 1x QCM, 1x HUB, 2x PCI Express 16x, 1x PCI Express 8x.
A Clk Grp
8c uP
B Clk Grp
C Clk G rp
P7-0
D Clk G rp
A Clk Grp
B
88GB/s
B Clk Grp
Y
44GB/s
C Clk G rp
C
D Clk G rp
Z
W
A X
B W
Z
C
A Clk Grp
B Clk Grp Y
C Clk Grp 44GB/s
A
D Clk Grp
X
88GB/s
A Clk Grp
P7-3
B Clk Grp
C Clk Grp
D Clk Grp
8c uP
10 x 10x
10 x 10x
10x 10 x 10 x 10x
Z
10 x 10x
10x 10 x 10 x 10x
10 x 10x
10x 10 x 10 x 10x
10 x 10x
164 164
W
10x 10 x 10 x 10x 10 x 10x
Ll0 Ll1
D0-D15 Lr0-Lr23
7 Inter-Hub Board Level L-Buses
(160+160) (120+120)
GB/s GB/s
L-local Link
A=L links; A=7
B=# of Transmitter bits /bus; B=64
C=# of Receiver bits /bus; C=64
D=bit rate per lane ; D=3Gb/S
E=Framing Efficiency ; E=22/24
BW = Ax(B+C)xDxE
7x(64+64)x3x(22/24) = 2464Gb/S=308GB/s
(44BG/S/L-Local)
Chapter 1. Understanding the IBM Power Systems 775 Cluster

Octant

8c uP
P7-1
48GB/s (pk)
A
88GB/s
48GB/s (pk)
X
44GB/s
C
Y
B W
A X
C
Z
48GB/s (pk)
44GB/s
B
48GB/s (pk)
Y
88GB/s
P7-2
8c uP
Hub Chip Module
164 164 164 164 164 72
Ll2 Ll3 Ll4 Ll5 Ll6 EG2
(154+154)
GB/s
A Clk Grp
SN Mem Mem
B Clk Grp
Mem
SN Mem
C Clk Grp
Mem
SN Mem
D Clk Grp
Mem
Mem
SN
A Clk Grp
SN Mem
Mem
B Clk Grp
Mem
SN Mem
C Clk Grp
Mem
SN Mem
D Clk Grp
Mem
SN Mem
48GB/s (pk)
Z
48GB/s (pk)
W
A Clk G rp
SN Mem Mem
B Clk G rp
Mem
Mem
SN
C Clk G rp
Mem Mem
SN
D Clk G rp
Mem
SN Mem
A Clk G rp
Mem
SN Mem
B Clk G rp
Mem
Mem
SN
C Clk G rp
Mem
SN Mem
D Clk G rp
Mem
SN Mem
48GB/s (pk)
Y
48GB/s (pk)
72 72
X
EG1 EG2
Three 2.5 PCI-E2 (2-16x, 1-8x)
5.0Gb/s @ 2B +2B with 8/10 Encoding
25