Page 2
The furnishings of this document to you does not give you any rights or licenses, express or implied, with respect to the product or technology to which it pertains, and this document does not contain or represent any commitment of any kind on the part of Oracle or Fujitsu Limited or any affiliate of either of them.
Contents Preface v Chapter 1 PCI Card Mounting Rules for the SPARC M12-1 1 1.1 Prerequisites 1 1.1.1 Domain OS 1 1.2 Maximum Number of Each Type of Mounted PCI Card and Available PCI Slots 2 1.3 Hardware Configuration Diagram 8 Chapter 2 PCI Card Mounting Rules for the SPARC M12-2 9...
Page 4
4 1 Appendix C Cards/On-Board Devices That Support SR-IOV 47 Appendix D Cards/On-Board Devices That Support Assignment of PCIe End Point Devices (PCIe Cards) 53 Appendix E Cards That Support EFI (GPT) Labeled Disks 57 Fujitsu SPARC M12 PCI Card Installation Guide ・ July 2017...
This document describes the mounting rules for PCI cards mounted in the SPARC M12 from Oracle or Fujitsu. Fujitsu SPARC M12 is sold as SPARC M12 by Fujitsu in Japan. Fujitsu SPARC M12 and SPARC M12 are identical products. ...
Fujitsu SPARC M12 Quick Guide Fujitsu SPARC M12 Getting Started Guide (*2) Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 Important Legal and Safety Information (*2) Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 Safety and Compliance Guide Software License Conditions for Fujitsu SPARC M12 and Fujitsu M10/SPARC M10...
Page 7
*1 The listed manuals are subject to change without notice. *2 Printed manuals are provided with the product. *3 This document applies specifically to the SPARC M12/M10 and FUJITSU ETERNUS disk storage system. Notes on Safety Read the following documents thoroughly before using or handling SPARC M12.
Page 8
While the XSCF commands have a section number of (8) or (1), it is omitted from the text. For details on the commands, see the Fujitsu SPARC M12 and Fujitsu M10/SPARC M10 XSCF Reference Manual. Syntax of the Command-Line Interface...
Chapter 1 PCI Card Mounting Rules for the SPARC M12-1 This chapter describes the maximum number of each type of mounted PCI card and the rules for mounting PCI cards in PCI slots when mounting PCI cards in the SPARC M12-1.
SPARC M12-1. - Do not mount other PCI cards in the PCI slots of the same root complex. Table 1-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 11 (Fujitsu Product ID) Maximum Number...
Page 11
Table 1-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 11 (Fujitsu Product ID) (continued) Maximum Number Type Product Name Product ID Mounted Without PCI With PCI expansion unit expansion unit Dual Gigabit Ethernet card (MMF)
Page 12
Table 1-2 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 11 (Oracle Product ID) (continued) Factory-Mounted Maximum Type Product Name When Shipped Number Mounted Without PCI (Expanded on Site) With PCI expansion unit...
Page 13
Table 1-3 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Fujitsu Product ID) Maximum Number Type Product Name Product ID Mounted Without PCI expansion...
Page 14
Table 1-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) Factory-Mounted Maximum Number Type Product Name When Shipped Mounted Without PCI expansion...
Page 15
Table 1-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-1 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) (continued) Factory-Mounted Maximum Number Type Product Name When Shipped Mounted...
Chapter 2 PCI Card Mounting Rules for the SPARC M12-2 This chapter describes the maximum number of each type of mounted PCI card and the rules for mounting PCI cards in PCI slots when mounting PCI cards in the SPARC M12-2.
"Maximum Number Mounted" means the maximum number of PCI cards that can ■ be mounted in the SPARC M12-2 and the PCI expansion unit. The numbers in ( ) indicate the slot numbers where cards can be mounted, among the PCI slots of the...
Page 19
SPARC M12-2. - Do not mount other PCI cards in the PCI slots of the same root complex. Table 2-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 11 (Fujitsu Product ID) Maximum...
Page 20
Table 2-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 11 (Fujitsu Product ID) (continued) Maximum Type Product Name Product ID Number Mounted Without PCI With PCI expansion unit expansion unit 1CPU: 41...
Page 21
Table 2-2 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 11 (Oracle Product ID) Maximum Factory-Mounted Type Product Name Number When Shipped Mounted Without PCI (Expanded on Site) With PCI expansion unit expansion unit...
Page 22
GFX550e_1.5.tar.Z includes the drivers for Oracle Solaris 11 and Oracle Solaris 10. Table 2-3 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Fujitsu Product ID)
Page 23
Table 2-3 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Fujitsu Product ID) (continued) Maximum Number Type Product Name Product ID Mounted Without PCI expansion...
Page 24
Table 2-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) (continued) Factory-Mounted Maximum Number Type Product Name When Shipped Mounted...
Page 25
Table 2-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2 Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) (continued) Factory-Mounted Maximum Number Type Product Name When Shipped Mounted...
Configuration and Number of Root Complexes The 1-CPU configuration of the SPARC M12-2 consists of four root complexes, and the 2-CPU configuration consists of four or eight root complexes. A root complex consists of an I/O controller mounted on a processor and the PCI switches, PCI devices, etc.
Page 27
SPARC M12-2 with 1 CPU. Figure 2-2 is a hardware configuration diagram of the SPARC M12-2 with 2 CPUs. Figure 2-1 Hardware Configuration Diagram of the SPARC M12-2 With 1 CPU Root Complex #2 Slot #10...
Chapter 3 PCI Card Mounting Rules for the SPARC M12-2S This chapter describes the maximum number of each type of mounted PCI card and the rules for mounting PCI cards in PCI slots when mounting PCI cards in the SPARC M12-2S.
"Maximum Number Mounted" means the maximum number of PCI cards that can ■ be mounted in the SPARC M12-2S and the PCI expansion unit. The numbers in ( ) indicate the slot numbers where cards can be mounted, among the PCI slots of the...
Page 31
SPARC M12-2S. - Do not mount other PCI cards in the PCI slots of the same root complex. Table 3-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 11 (Fujitsu Product ID) Maximum Number...
Page 32
Table 3-1 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 11 (Fujitsu Product ID) (continued) Maximum Number Group Product Name Product ID Mounted Japanese Without PCI expansion With PCI expansion unit Product ID...
GFX550e_1.5.tar.Z includes the drivers for Oracle Solaris 11 and Oracle Solaris 10. Table 3-3 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Fujitsu Product ID)
Table 3-3 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Fujitsu Product ID) (continue d) Group Product Name Product ID Maximum Number Mounted...
Page 35
Table 3-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) Factory-Mounted When Maximum Number Group Product Name Shipped Mounted Without PCI expansion...
Page 36
Table 3-4 Maximum Number of Each Type of Mounted PCI Card: SPARC M12-2S Oracle Solaris 10 or a Mixture of Oracle Solaris 10 and 11 (Oracle Product ID) (continued) Factory-Mounted When Maximum Number Group Product Name Shipped Mounted...
Page 37
Configuration and Number of Root Complexes The 1-CPU configuration of the SPARC M12-2S consists of four root complexes, and the 2-CPU configuration consists of four or eight root complexes. A root complex consists of an I/O controller mounted on a processor and the PCI switches, PCI devices, etc.
Page 38
SPARC M12-2S with 1 CPU. Figure 3-2 is a hardware configuration diagram of the SPARC M12-2S with 2 CPUs. Figure 3-1 Hardware Configuration Diagram of the SPARC M12-2S With 1 CPU XB#1 XB#0...
(from highest to lowest) shown in Table 4-1 Table 4-2. In the PCI slots of the SPARC M12-1, the PCI cards of each group are mounted in the PCI slot order shown in the corresponding column of Table 4-3.
Page 42
Table 4-1 Mounting Priority Order of PCI Cards (Fujitsu Product ID) Group Product Name Product ID Mounting Priority Order PCI expansion unit connection card SPME8LK1F High Graphics card SP0X7GR1F Dual Port InfiniBand 4x QDR card SP1X7BA12F Dual-Channel 10 Gbps FCoE card (for optical cable)
Page 43
Sun Quad Port GbE PCIe 2.0 7100479 Low Profile Adapter, UTP Sun Dual Port GbE PCIe 2.0 Low Profile Adapter, MMF 7100482 Low Table 4-3 Mounting Order of PCI Slots in the SPARC M12-1 Group A Group B Group C Link Card Graphics...
Page 44
Table 4-5 Mounting Order of PCI Slots in the SPARC M12-2S (continued) Group A Group B Group C Link Card Graphics Slot#6 Slot#7 Table 4-6 Mounting Order of PCI Slots in the PCI Expansion Unit Slot#1...
Page 45
This appendix describes the list of the operating environment (minimum supported versions) when PCI cards are used in the SPARC M12. If you use each PCI card in the SPARC M12, use it in an environment where Oracle Solaris and XCP versions and requirements under other items are met.
Page 46
Table A-1 List of the Operating Environment of the PCI Cards (Fujitsu Product ID) (continued) Type Product Name Product ID Oracle Solaris Others Solaris 11 Solaris 10 40 Gb Ethernet card SP1X7HG1F Solaris Not supported XCP 3021 11.3 SRU...
Table A-2 List of the Operating Environment of the PCI Cards (Oracle Product ID) Type Product Name Factory-Mounted When Oracle Solaris Others Shipped (Expanded on Site) Solaris 11 Solaris 10 Link Link card kit 7105513 (7105576) XCP 3021 Supported by PCI expansion...
7104073 (7104074) Solaris Solaris 10 8/11 XCP 3021 QDR InfiniBand 11.1 SRU patch 150400-13 Adapter M3 14.5 Graphic Raptor GFX 550e Solaris Solaris 10 1/13 XCP 3021 11.2 SRU 15.5 Fujitsu SPARC M12 PCI Card Installation Guide ・ July 2017...
Page 49
Dynamic Reconfiguration This appendix describes cards that support PCI Hot Plug and dynamic reconfiguration. The SPARC M12 on-board PCI slots and the PCI expansion unit support active replacement and active addition of PCI cards using PCI Hot Plug (PHP). The SPARC M12 supports the physical partition dynamic reconfiguration (DR) function.
Page 50
Table B-1 Cards That Support PHP/DR (Fujitsu Product ID) (continue d) Category Name Product ID Driver PHP: PCI Hot Plug DR: Dynamic Reconfiguration Path Name Redundancy Active Active Active Active Suspend/ Software Software Replace Addition Replace Addition Resume...
Page 51
Table B-1 Cards That Support PHP/DR (Fujitsu Product ID) (continued) Category Name Product ID Driver PHP: PCI Hot Plug DR: Dynamic Reconfiguration Path Name Redundancy Active Active Active Active Suspend/ Software Software Replace Addition Replace Addition Resume Product...
Table B-2 Cards That Support PHP/DR (Oracle Product ID) (continue d) Category Name Factory- Driver PHP: PCI Hot Plug DR: Dynamic Reconfiguration Path Mounted Name Redundancy Active Active Active Active Suspend/ When Software Software Replace Addition Replace Addition Resume Shipped Product...
Table C-1 lists the SR-IOV supporting cards that have Fujitsu product IDs. Table C-2 lists the SR-IOV supporting cards that have Oracle product IDs. Table C-1 Cards That Support SR-IOV (Fujitsu Product ID) Category Name Product ID Driver Name...
Page 56
Table C-1 Cards That Support SR-IOV (Fujitsu Product ID) (continued) Category Name Product ID Driver Name Software Product Name Domain Resiliency Dual-Channel 16 Gbps Fibre SP1X7FAB2F Oracle Solaris (qlc) Supported Channel card (LR SFP+) (*5) *1 An InfiniBand switch that supports SR-IOV is required. For details, see the Oracle VM Server for SPARC 3.3 Administration Guide.
Page 57
SR-IOV supporting cards that have Fujitsu product IDs. Table C-5 lists the numbers of PFs/VFs on the SR-IOV supporting cards that have Oracle product IDs. Table C-4 Numbers of PFs/VFs on the SR-IOV Supporting Cards (Fujitsu Product ID) Category Name Product ID...
Page 58
I/O domain in Oracle Solaris 10 has been eliminated in Oracle VM Server for SPARC 3.3. Therefore, use Oracle Solaris 11.1 or later with all logical domains to use the SR-IOV function. Table C-6 lists the numbers of PFs/VFs on the SR-IOV supporting on-board device. Fujitsu SPARC M12 PCI Card Installation Guide ・ July 2017...
Page 59
Table C-6 Numbers of PFs/VFs on the SR-IOV Supporting On-board Device Category Name Number of PFs Number of Number of VFs/Domain (*2) VFs/PF (*1) On-board LAN (10 GbE) 63 (Solaris 11) 1 (Solaris 10) *1 The number of VFs created for each PF *2 The number of VFs assigned from each PF/card for a domain of Oracle Solaris 10 or Oracle Solaris 11 Note that support for the SR-IOV I/O domain in Oracle Solaris 10 has been eliminated in Oracle VM Server for SPARC 3.3.
Page 61
Fujitsu product IDs. Table D-2 lists the supporting cards that have Oracle product IDs. Table D-1 Cards That Support Assignment of PCIe End Point Devices (PCIe Cards) (Fujitsu Product ID) Category Name Product ID...
Page 62
Table D-1 Cards That Support Assignment of PCIe End Point Devices (PCIe Cards) (Fujitsu Product ID) (continue d) Category Name Product ID Dynamic Static Static Assignment Assignment Assignment OVM 3.1.1 or OVM 3.1 or OVM 3.0 Later Later...
Page 63
Table D-2 Cards That Support Assignment of PCIe End Point Devices (PCIe Cards) (Oracle Product ID) (continued) Category Name Product ID Dynamic Static Static Assignment Assignment Assignment OVM 3.1.1 OVM 3.1 OVM 3.0 or Later or Later with the 10 Gb FCoE with 7101677 (7101678) Supported Not supported...
Page 65
EFI (GPT) labeled disks and have Fujitsu product IDs. Table E-2 lists the cards that support EFI (GPT) labeled disks and have Oracle product IDs. Table E-1 Cards That Support EFI (GPT) Labeled Disks (Fujitsu Product ID) Category Name Product ID Disk Size...