Page 2
State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
Page 3
This user's guide is written for system integrators, IT technicians, and knowledgeable end users. It provides information for the installation and use of Intel® Optane™ Persistent Memory 200 Series (PMem) in a system based on a Supermicro X12SPx/X12Dxx/X12Qxx motherboard. About This User's Guide This user's guide provides the Intel®...
Page 4
Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML...
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Chapter 1 Introduction Congratulations on purchasing your motherboard or your system from an industry leader. Supermicro products are designed to provide you with the highest standards in quality and performance. 1.1 Intel® Persistent™ Memory 200 Series Overview ®...
Chapter 1: Introduction software, it will eliminate I/O overloading, greatly enhancing system performance and functionality. Note: Mixed Memory (MX) Mode is not supported by the X12SPx/X12Dxx/X12Qxx motherboards. 1.3 Basic Terminology of PMem Provisioning This section lists the basic terms used in managing and configuring PMem 200 Series modules.
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide create namespaces in PMem 200 Series modules, the ndctl utility is recommended for the Linux operating system, and PowerShell cmdlets, for Microsoft Windows operating systems. Types of Namespaces When a PMem module is configured in App Direct Mode, the namespace can be provisioned in one of the following modes: •...
Page 9
Chapter 1: Introduction that is immune to single-bit errors so that the data that is read from each word is always the same as the data that had been written to it. ECC memory will protect against any additional memory failure caused by a ‘single-bit’ error in the same memory rank. SDDC SDDC (Single Device Data Correction) checks and corrects single-bit or multiple-bit (4-bit max.) memory corruptions and errors that affect an entire single x4 DRAM device.
Page 10
Processor Platform Support Intel PMem 200 Series is supported by the following processors: • 3nd Gen Intel® Xeon Scalable (83xx/63xx/53xx/4314 series) processors Motherboard Platform Support • Intel PMem 200 Series supports Supermicro X12SPx/X12Dxx/X12Qxx motherboards based on the Xeon 3rd Gen processors.
Use only the correct type of onboard CMOS battery. Do not install the onboard battery upside down to avoid possible explosion. Unpacking Supermicro's motherboards are shipped in antistatic packaging to avoid static damage. When unpacking a motherboard, make sure that the person handling it is static protected.
Persistent Memory Population Requirements For proper memory installation, please pay close attention to the following instructions: 1. Intel PMem 200 Series is supported by Supermicro X12SPx/X12Dxx/X12Qxx motherboards based on 3rd Gen Intel® Xeon Scalable (83xx/63xx/53xx/4314 Series) processors. 2. Memory speeds are dependent upon the processors used in your system.
Page 13
Chapter 2: Intel PMem 200 Series Installation Maximum Memory Capacity Supported on a Platform The maximum memory capacity that is supported on a platform is dependent on the suffix of the 3rd Generation Xeon Scalable Processor used in your system. Restrictions on Memory Configuration Settings When configuring memory mirroring and memory sparing settings, please note the following restrictions:...
2.3 PMem Population for the X12SPx Motherboards These memory population tables were created based on the general memory population guidelines provided by Intel to support Supermicro X12SPx motherboards. PMem 200 Series Population Table for X12SPx Motherboards Note: PMem 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors.
2.4 PMem Population for the X12Dxx Motherboards These memory population tables were created based on the general memory population guidelines provided by Intel to support Supermicro X12Dxx motherboards. PMem 200 Series Population Table for X12Dxx Motherboards (with 16 Slots) Note: PMem 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors.
Page 16
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide PMem 200 Series Population Table for X12Dxx Motherboards (with 18 Slots) ® Note: The Intel Optane Persistent Memory (PMem) 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors. PMem 200 Series Population Table for X12Dxx 18-DIMM Motherboards (within 1 CPU socket) DDR4+PMem Mode...
Page 17
Chapter 2: Intel PMem 200 Series Installation PMem 200 Series Population Table for X12Dxx Motherboards (with 20 Slots) ® Note: The Intel Optane Persistent Memory (PMem) 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors. PMem 200 Series Population Table for X12Dxx 20-DIMM Motherboards (within 1 CPU socket) DDR4+PMem Mode...
Page 18
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide PMem 200 Series Population Table for X12Dxx Motherboards (with 32 Slots) ® Note: The Intel Optane Persistent Memory (PMem) 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors. PMem 200 Series Population Table for X12Dxx 32-DIMM Motherboards (within 1 CPU socket) DDR4+ AD Inter-...
Page 19
Chapter 2: Intel PMem 200 Series Installation Validation Matrix (DDR4 DIMMS with PMem 200 Series Modules) DIMM Capacity (GB) Ranks Per DIMM DIMM Type & Data Width DRAM Density (Stack) 16Gb 1Rx8 1Rx4 16GB 32GB RDIMM (up to 3200) 2Rx8 16GB 32GB 2Rx4...
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide 2.5 PMem Population for the X12Qxx Motherboards These memory population tables were created based on the general memory population guidelines provided by Intel to support Supermicro X12Qxx motherboards. PMem 200 Series Population Table for X12Qxx Motherboards (with 48 Slots) Note: PMem 200 Series is supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx Series) Processors.
Page 21
Chapter 2: Intel PMem 200 Series Installation DIMM Installation JVGA1 USB0/1 IPMI_LAN (3.0) 1. Insert the desired number of DIMMs into the memory slots based on the recommended DIMM population tables in the previous section. BATTERY AIOM:CPU1 PCI-E 4.0 X16 X12DPFR-AN6 Locate memory slots on your motherboard.
Memory population is based on the Memory Population Table below. For more information on memory population, please refer to the Memory Configuration User Guide for the X12 Motherboards posted on our wetsite at https://www.supermicro.com/support/manuals/. • Only App Direct Mode and Memory Mode are supported for the X12 motherboards.
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS 3.1 To Enter the BIOS Setup Utility To enter the BIOS setup utility, please follow the instructions below. • Press the <del> key continuously during system boot to enter the BIOS setup utility •...
Page 24
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • After selecting the Intel(R) Optane(TM) Persistent Memory Configuration submenu, press <Enter>, and the screen below will display showing that 8 PMem modules are de- tected on this motherboard. A.2. Onboard PMem Modules Detected...
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS 3.2 T o Configure PMem as App Direct (AD) Mode Please complete all steps listed in Section 3.1. When the screen shown on the previous page displays, select the Provisioning submenu as shown below. B.1. Provisioning Submenu After selecting Provisioning, press <Enter>, and the Create goal config screen will display.
Page 26
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Create App Direct (AD) Mode • Set the values of "Reserved [%]" and "Memory Mode [%]" to 0. • Change PMem Memory type to App Direct as needed. B.4. App Direct Mode Setup Screen •...
Page 27
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS • The following screen will display to show all your Created Goals. B.6. All the Created Goals Displayed B.7. All the Created Goals Displayed Screen...
Page 28
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • Once you've confirmed your created goals, press <F4> to invoke the Save & Exit Setup submenu and press <Yes> to save the changes. B.8. Save the Configuration and Exit • Reboot the system, and enter the BIOS utility again to continue with PMem configuration. Note: Be sure to reboot your system for the changes you've made to take effect.
Page 29
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS Continuation with PMem configuration To continue with PMem Configuration, follow the steps below: • Select the Intel(R) Optane(TM) Persistent Memory Configuration submenu and press <Enter>. B.9. PMem Configuration Continuation • Select Regions and press <Enter>. (Please note that this feature is not applicable to Memory Mode).
Page 30
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • To double confirm AD Mode configuration, select Total Capacity and press <Enter>. B.12. Total Capacity Entry Screen • The total memory resource allocation across the host server submenu will be dis- played as shown below.
Page 31
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS To Delete a Goal Configuration Once you've created a goal configuration, select the Create goal config submenu and press <Enter> to re-confirm the current goal configuration. B.14. Select Create Goal Config to Reconfirm • The memory allocation goal configuration detail settings will display as shown below. B.15. Memory Allocation Goal Configuration Screen •...
Page 32
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • The "Delete Goal Config for" submenu will display as shown below. Select the goal con- figuration you want to delete and then press <Enter> B.17. Delete Goal Config For Screen • Once you've selected the goal configuration to delete, select the Delete goal config sub- menu and press <Enter>...
Page 33
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS To Re-create a New Goal without Deleting the Goal that You've Just Created and Confirmed If you have just created a new goal and have confirmed it, and you want to re-create another new goal to replace this newly created goal without first deleting it, you will encounter an error message as illustrated below.
Page 34
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • However, an error message will display also asking you to first delete the goal that you've just created and confirmed before re-creating another new goal as shown below. B.21. An Error Message Displayed Asking to Delete the Current Goal First •...
Page 35
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS To Create a Namespace for a Region (for App. Direct Mode Only) This section provides the instructions on how to create a namespace for a PMem region. To create a namespace, please follow the steps below. •...
Page 36
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • Once you are certain that the Created namespace change is correct, select and enter the Create namespace again to reconfirm that the Name entered in the Create Namespace is correct as shown below. B.28. To Confirm the Name Entered in the Namespace Change is Correct •...
Page 37
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS To Delete a Namespace in a Region (for App. Direct Mode Only) To delete a namespace in a Region for App Direct (AD) Mode, please follow the steps listed below. •...
Page 38
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide • Scroll down the screen to select the Delete submenu as shown below and press <Enter>. B.33. Delete Submenu Screen • A Warning message will display, asking you to confirm if you really want to delete the namespace and all information pertaining to the namespace.
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS 3.3 T o Configure PMem as Memory Mode (MM) This section provides instructions on how to configure PMem as Memory mode. To configure PMem as Memory Mode, please complete all steps listed in Section 3.1. B.35. No Namespaces in the System screen •...
Page 40
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Create Memory Mode To configure PMem as Memory Mode, select Memory Mode [%] and enter 100 as the default. Save the setting and reboot the system for the changes you've made to take effect. Note: To configure PMem as Memory Mode, Memory Mode [%] needs to be set to 100.
Page 41
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS • After pressing <Enter>, the following screens will display to show the goal you've created. C.5. Memory Mode Setup • Press F4 to invoke the Save & Exit Setup submenu and press Yes to save the changes as shown below.
Page 42
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Continuation with PMem configuration To continue with PMem configuration, following the following steps: • Enter the Intel(R) Optane(TM) Persistent Memory Configuration submenu. C.7. Intel Optane Persistent Memory Configuraion Submenu • To confirm the status of Memory Mode, select the Total Capacity submenu which will display total memory resource allocation.
Page 43
Chapter 3: Configuring Intel PMem 200 Series Settings Using BIOS Note: The X12 motherboards do not support PMem Mixed (MX) mode as shown in the screen below. C.10. Screen Showing Mixed Mode Not Supported...
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Chapter 4 Configuring Intel PMem 200 Series Settings Using Open Source Utilities 4.1 PMem Configuration Introduction to ipmctl ipmctl is an open source utility used to configure and manage Intel PMem 200 Series modules for memory performance enhancement. This utility, created and maintained by Intel, is available for download from GitHub.
Page 45
Chapter 4: Configuring Intel PMem 200 Series Settings Using Open Source Utilities Some Important Concepts for PMem 200 Series Provisioning Region A region is a group of one or more PMem modules. A memory region can be created in either a non-interleaved or n-way interleaved format. In an interleaved region, all PMem modules are seen as one single monolithic space, which is similar, in concept, to RAID 0 in storage.
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide 4.2 I pmctl Configuration The full list of commands can be seen by running ipmctl help from the command line. Show Topology Use the ipmctl sudo show -topology command to display the PMem modules and DDR DIMMs discovered in the system by enumerating the SMBIOS Type 17 tables.
Page 47
Chapter 4: Configuring Intel PMem 200 Series Settings Using Open Source Utilities Show DIMM Information Use the ipmctl show -dimm command to display the PMem 200 Series modules discovered in the system and the communication status between applications and memory modules. This command also displays DIMM IDs, capacities, health state, and firmware version.
Page 48
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Provisioning During the provisioning process, a goal is specified and configured into Memory Mode or App Direct Mode. This goal will be applied after the system has been reboot. Memory Mode Configuration Use the ipmctl create -goal MemoryMode=n command to provision any percentage of PMem capacity on all sockets, where n represents the percentage number of capacity to be provisioned in Memory Mode.
Page 49
Chapter 4: Configuring Intel PMem 200 Series Settings Using Open Source Utilities App Direct Mode Configuration In App Direct Mode, Persistent Memory can be provisioned with either interleaved or non-interleaved enabled. In interleaved configurations, all PMem modules are seen as one monolithic space, which is similar in concept to RAID 0 in traditional storage. In non- interleaved configurations, each PMem is seen as a separate space, which is similar in concept to JBOD in traditional storage.
Page 50
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Create a Goal from a Configuration File Use the ipmctl load -source <file> -goal command to load goals and special configurations from a configuration file. Use the ipmctl dump -destination <file> -system -config command to save the current configuration to a file. G.1. Create a Goal from a Configuration File (CentOS) G.2. Create a Goal from a Configuration File (Windows) H.1. Save Current Goal Configuration to a File (CentOS)
Page 51
Chapter 4: Configuring Intel PMem 200 Series Settings Using Open Source Utilities I.1. Show Current Goal (CentOS) I.2. Show Current Goal (Windows) J.1. Delete Goal (CentOS) J.2. Delete Goal (Windows) Confirm Mode Change Use the ipmctl show -memoryresources command to confirm if the mode has been changed successfully after a system reboot.
Page 52
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide K.1. Confirm Mode Change (CentOS) K.2. Confirm Mode Change (Windows) L.1. Display Region (CentOS) L.2. Display Region (Windows)
Page 53
Chapter 4: Configuring Intel PMem 200 Series Settings Using Open Source Utilities Create Namespaces with ndctl Follow the instructions below to properly create namespaces using the ndctl commands: • ndctl create-namespace [--mode | fsdax, sector] • Example: ndctl create-namespace --mode fsdax •...
Page 54
Super Intel® Optane™Persistent Memory 200 Series Configuration User's Guide Destroy Namespace Use the ndctl destroy-namespace X command to destroy the namespace of the user’s choice. X represents the namespace on the active namespaces list. List Active Regions Use ndctl list -R to display the active regions list. Delete Region Use the ndctl disable-region X command to delete the region of the user’s choice.
Need help?
Do you have a question about the Optane Persistent Memory 200 Series and is the answer not in the manual?
Questions and answers