Huawei ES3000 V3 User Manual

Huawei ES3000 V3 User Manual

Nvme pcie ssd
Table of Contents

Advertisement

ES3000 V3 NVMe PCIe SSD
User Guide
Issue
20
Date
2019-02-27
HUAWEI TECHNOLOGIES CO., LTD.

Advertisement

Table of Contents
loading

Summary of Contents for Huawei ES3000 V3

  • Page 1 ES3000 V3 NVMe PCIe SSD User Guide Issue Date 2019-02-27 HUAWEI TECHNOLOGIES CO., LTD.
  • Page 2 Notice The purchased products, services and features are stipulated by the contract made between Huawei and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendations in this document are provided "AS IS"...
  • Page 3: About This Document

    About This Document Purpose This document provides the product information about the Huawei ES3000 V3 PCIe SSD (ES3000 V3 for short) and describes how to install, configure, operate, and maintain the ES3000 V3. NOTE The document does not contain the commands for production, equipment, and return detection. These commands are commonly used during engineering implementation and fault locating.
  • Page 4 ES3000 V3 NVMe PCIe SSD User Guide About This Document Symbol Description Provides a tip that may help you solve a problem or save time. Provides additional information to emphasize or NOTE supplement important points in the main text. Change History Changes between document issues are cumulative.
  • Page 5 ES3000 V3 NVMe PCIe SSD User Guide About This Document Issue 12 (2017-05-05) Optimized descriptions about some operation steps. Issue 11 (2017-03-21) Updated the 2.4 Specifications section. Issue 10 (2017-02-14) Updated the 6.4 Formatting section. Issue 09 (2017-01-20) Updated the 3.2 Installing ES3000 V3...
  • Page 6: Table Of Contents

    3.5 Transferring Files by Using WinSCP........................... 30 3.6 Installing the Driver..............................32 3.6.1 Installing the ES3000 V3 Driver in Linux.........................32 3.6.2 Installing the ES3000 V3 Driver in Windows......................35 3.6.3 Installing the ES3000 V3 Driver in ESXi......................... 42 3.7 Installing the Tool Package............................43 3.7.1 Installing the Tool Package (Linux)..........................
  • Page 7 5.11.1 ES3000 SSD Disk Indicator State Descriptions...................... 85 5.11.2 ES3000 SSD Card Indicator State Descriptions...................... 86 5.12 Removing an ES3000 V3............................86 5.12.1 Removing a Non-Hot-Swappable ES3000 V3 NVMe PCIe SSD Disk..............87 Issue 20 (2019-02-27) Copyright © Huawei Technologies Co., Ltd.
  • Page 8 Contents 5.12.2 Removing a Hot Swappable ES3000 V3 NVMe PCIe SSD Disk................88 5.12.3 Removing an ES3000 V3 NVMe PCIe SSD Card on a Riser Card................ 89 5.12.4 Removing an ES3000 V3 NVMe PCIe SSD Card from the Mainboard..............90 6 Command Description....................... 92 6.1 Querying Information..............................
  • Page 9 ES3000 V3 NVMe PCIe SSD User Guide Contents 6.14 Querying or Setting the Atomic Write Status......................130 6.14.1 Querying the Atomic Write Status of a Specified SSD..................130 6.14.2 Setting the Atomic Write Status for a Specified SSD................... 131 6.15 Querying Historical Amount of Written Data......................131 6.16 Restoring Default Attributes.............................132...
  • Page 10 C.5 SNMP OID.................................179 D Obtaining Device Logs by Using an Open-Source Tool..........181 E Introduction to Windows GUI....................183 F Installing an OS on the ES3000 V3..................190 G How to Get Help........................196 G.1 Preparations Before Contacting Huawei........................196 G.1.1 Collecting Fault Information..........................196 G.1.2 Making Debugging Preparations..........................
  • Page 11: Safety

    이 기기는 업무용 환경에서 사용할 목적으로 적합성평가를 받은 기기로서 가정용 환경 에서 사용하는 경우 전파간섭의 우려가 있습니다. When operating Huawei equipment, you must follow the local laws and regulations. The safety instructions in this document are only supplements to the local laws and regulations.
  • Page 12: Labels On Devices

    When operating Huawei equipment, in addition to following the general precautions in this document, follow the specific safety instructions given by Huawei. Only trained and qualified personnel are allowed to install, operate, and maintain Huawei equipment. Ground Do not damage the ground conductor or operate the device in the absence of a properly installed ground conductor.
  • Page 13: Electrical Safety

    ES3000 V3 NVMe PCIe SSD User Guide 1 Safety Table 1-1 Safety labels Label Meaning Description Warning This label indicates that wrong operations may cause device damage or human injury. External grounding This label indicates grounding of external devices. The terminals of...
  • Page 14: Power Cable

    ES3000 V3 NVMe PCIe SSD User Guide 1 Safety High Voltage l The high voltage power supply provides power for the device operation. Direct or indirect contact (through damp objects) with high voltage and AC mains supply may result in fatal danger.
  • Page 15: Electrostatic Discharge

    ES3000 V3 NVMe PCIe SSD User Guide 1 Safety Electrostatic Discharge The static electricity generated by human bodies may damage the electrostatic-sensitive components on boards, for example, the large-scale integrated (LSI) circuits. Human body movement, friction between human bodies and clothes, friction between shoes and floors, or handling of plastic articles causes static electromagnetic fields on human bodies.
  • Page 16: Getting To Know The Es3000 V3

    This section describes the information security features of the ES3000 V3. Huawei is committed to ensuring stability and security of customer networks and services. As a storage device within a server or storage host, the ES3000 V3 provides the following security features:...
  • Page 17: Overview

    The ES3000 V3 NVMe PCIe SSD disk is a 2.5-inch PCIe 3.0 x 4 SSD disk that uses the HiSilicon Hi1812 chip and complies with the SFF-8639 standard. It can be installed in universal servers, such as rack servers.
  • Page 18 2 Getting to Know the ES3000 V3 Label The label on an ES3000 V3 NVMe PCIe SSD provides the World Wide Name (WWN) and serial number (S/N). A WWN uniquely identifies an ES3000 V3 NVMe PCIe SSD and is a string generated from the MAC address.
  • Page 19: Features

    Figure 2-3 ES3000 V3 NVMe PCIe SSD card 2.3 Features This section describes the features and technical specifications of the ES3000 V3. The ES3000 V3 NVMe PCIe SSD provides the following features: Uses the PCIe 3.0 x4 interface, complies with PCIe 3.0 electrical specifications, and is backward compatible with PCIe 2.0 and 1.0.
  • Page 20: Specifications

    This section describes the specifications of the ES3000 V3. The ES3000 V3 comes in two form factors: disk and card. The disk consists of the ES3500P V3, ES3600P V3 and ES3620P V3 series. The card consists of the ES3600C V3 and ES3620C V3 series.
  • Page 21 ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Figure 2-4 ES3500P V3 series nameplate Table 2-1 lists the power consumption specifications for the ES3500P V3 series. Table 2-1 Power consumption specifications for the ES3500P V3 series...
  • Page 22: Es3600P V3 Specifications

    ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Table 2-2 Reliability specifications for the ES3500P V3 series Parameter Specifications Mean time 2 x 10 hours between failures (MTBF) Annual ≤ 0.44% failure rate (AFR)
  • Page 23 ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Figure 2-5 ES3600P V3 series nameplate Table 2-4 lists the power consumption specifications for the ES3600P V3 series. Table 2-4 Power consumption specifications for the ES3600P V3 series...
  • Page 24: Es3620P V3 Specifications

    ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Table 2-5 Reliability specifications for the ES3600P V3 series Parameter Specifications Mean time 2 x 10 hours between failures (MTBF) Annual ≤ 0.44% failure rate (AFR)
  • Page 25 ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Figure 2-6 ES3620P V3 series nameplates Table 2-7 lists the power consumption specifications for the ES3620P V3 series. Table 2-7 Power consumption specifications for the ES3620P V3 series...
  • Page 26: Es3600C V3 Specifications

    ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Parameter Specifications Data ≥ 3 months (40°C, powered off) protection NOTE 6400 GB disks of the ES3620P V3 supports the 4096B LBA format only. Table 2-9 lists the environmental specifications for the ES3620P V3 series.
  • Page 27 ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Figure 2-7 ES3600C V3 series nameplate Table 2-10 lists the power consumption specifications for the ES3600C V3 series. Table 2-10 Power consumption specifications for the ES3600C V3 series...
  • Page 28: Es3620C V3 Specifications

    ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Parameter Description Bit error rate (BER) Data ≥ 3 months (40°C, powered off) protection Table 2-12 lists the environmental specifications for the ES3600C V3 series. Table 2-12 Environmental specifications for the ES3600C V3 series...
  • Page 29 ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Figure 2-8 ES3620C V3 series nameplates Table 2-13 lists the power consumption specifications for the ES3620C V3 series. Table 2-13 Power consumption specifications for the ES3620C V3 series...
  • Page 30: System Requirements

    The minimum requirements for server hardware are as follows: 2 GB memory To use the ES3000 V3 NVMe PCIe SSD disk, the server must provide at least one 2.5- inch SSD disk slot that supports the PCIe SFF-8639 connector. To use the ES3000 V3 NVMe PCIe SSD card, the server must provide at least one half- height, half-length (167.5 mm x 70 mm x 18.6 mm) PCIe 3.0 x4 card slot.
  • Page 31: Software Requirements

    ES3000 V3 NVMe PCIe SSD User Guide 2 Getting to Know the ES3000 V3 Software Requirements For details about the OS types and versions supported by the ES3000 V3, visit Server Compatibility Checker, find the Compatibility List of the corresponding server.
  • Page 32: Installation And Configuration

    3.6 Installing the Driver This section describes how to install the ES3000 V3 driver in different operating systems (OSs). The ES3500P V3, ES3600P V3, ES3620P V3, ES3600C V3, and ES3620C V3 series use the same drivers and firmware.
  • Page 33: Installation And Configuration Process

    Installing the ES3000 V3 NVMe PCIe SSD Disk. If the PCIe card slots are on a riser card, the ES3000 V3 NVMe PCIe SSD card needs to be installed on the riser card. For details, see Installing the ES3000 V3 NVMe PCIe SSD card on a Riser Card.
  • Page 34 Place the ES3000 V3 into the hard disk tray. See step (1) in Figure 3-2. Use four screws to secure the ES3000 V3 to the hard disk tray. See step (2) in Figure 3-2. Then go to h. Issue 20 (2019-02-27)
  • Page 35 Figure 3-2 Placing the ES3000 V3 into the hard disk tray Place the ES3000 V3 to the converter. See step (1) in Figure 3-3. Use two screws to secure the ES3000 V3 to the converter. See step (2) in Figure 3-3. Issue 20 (2019-02-27)
  • Page 36 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-3 Securing the ES3000 V3 to the converter Use four screws to secure the ES3000 V3 to the hard disk tray. See step (3) in Figure 3-4 and (4) in Figure 3-5.
  • Page 37 User Guide 3 Installation and Configuration Figure 3-5 Securing the ES3000 V3 to the hard disk tray (2) Open the ejector lever and push the ES3000 V3 into the server until it does not move. See step (1) in Figure 3-6.
  • Page 38 Take the ES3000 V3 out of the ESD bag. Hold the upper edge of the ES3000 V3, align its connecting part with a PCIe slot on the riser card, and insert the ES3000 V3 slowly into the PCIe slot. See Figure 3-7.
  • Page 39: Driver Information

    After the ES3000 V3 is connected to power, the startup process takes about 30 seconds. If the active indicator associated with the ES3000 V3 NVMe PCIe SSD is on and the fault indicator is off, the SSD hardware is installed successfully.
  • Page 40: Verifying The Upgrade Package Integrity

    User Guide 3 Installation and Configuration If the server running Linux uses both ES3000 V3 NVMe PCIe SSD disks and SSDs provided by other vendors, use the NVMe driver integrated in the OS and you do not need to install Huawei's NVMe driver.
  • Page 41 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration You have obtained the following data: IP address of the remote host to be connected User name and password for logging in to the remote host to be connected Software WinSCP.exe: a free software available on the Internet.
  • Page 42: Installing The Driver

    The system starts to copy the file from the local PC to the remote host. ----End 3.6 Installing the Driver This section describes how to install the ES3000 V3 driver in different operating systems (OSs). The ES3500P V3, ES3600P V3, ES3620P V3, ES3600C V3, and ES3620C V3 series use the same drivers and firmware.
  • Page 43 Procedure Step 1 Log in to the OS as an administrator. Step 2 Go to the directory that stores the ES3000 V3 driver package, for example, /home. Step 3 Run the installation command based on the OS type. For RHEL, CentOS, OEL, SLES, or UVP, run rpm -ivh driver package name.
  • Page 44 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration If yes, go to Step If no, go to Step Step 7 Check whether the following message is displayed. The message indicates that the new NVMe driver fails to be installed during the installation.
  • Page 45: Installing The Es3000 V3 Driver In Windows

    If you install multiple ES3000 V3s on a server, you need to install the driver only once. l The ES3000 V3 tool is incompatible with the NVMe driver built in the Windows OS. Ensure that you have installed Huawei's NVMe driver before using the tool.
  • Page 46 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Right-click Computer and choose Properties from the shortcut menu. The System window is displayed, as shown in Figure 3-10. Figure 3-10 System Click Device Manager. The Device Manager is displayed, as shown in Figure 3-11.
  • Page 47 Determine the next step based on the driver type. – If the driver is provided by the OS, go to 5. – If the driver is provided by Huawei, uninstall the driver by referring to 5.1.2 Uninstalling the Driver in Windows and go to 8.
  • Page 48 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-12 Installed Updates Right-click the KB2990941 patch in the Microsoft Windows column and choose Uninstall from the shortcut menu. Install the driver. Double-click the driver installation file hiodriver_v3.3.5.2_2008R2_x84_64.msi.
  • Page 49 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Click Next. The End-User License Agreement window is displayed, as shown in Figure 3-14. Figure 3-14 End-User License Agreement window 10 Select I accept the terms in the License Agreement and click Next.
  • Page 50 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-15 Choose Setup Type window Click Complete. The Ready to install window is displayed, as shown in Figure 3-16. Figure 3-16 Ready to install window Issue 20 (2019-02-27)
  • Page 51 Figure 3-17 Completing Setup Wizard window 13 Click Finish. Verify the Installation. 14 Open Device Manager and expand Storage controllers. Check whether Huawei ES3000V3 storage controller exists under Storage controllers. Figure 3-18. – If yes, go to 15. – If no, contact Huawei technical support.
  • Page 52: Installing The Es3000 V3 Driver In Esxi

    ----End 3.6.3 Installing the ES3000 V3 Driver in ESXi Operation Scenario You need to install the ES3000 V3 driver on the server before using the ES3000 V3 for the first time. NOTE l If you install multiple ES3000 V3s on a server, you need to install the driver only once.
  • Page 53: Installing The Tool Package

    [root@esxi113:~] esxcli software vib list | grep hiodriverhiodriver 3.3.5.2-1OEM. 550.0.0.1391871 Huawei ESXiCertified 2016-01-04 Step 5 If the SSD device has been inserted into the server, run the lspci | grep "Huawei ES3000 V3" command. If the device is displayed, it is detected by the OS.
  • Page 54: Installing The Tool Package (Windows)

    3.7.2 Installing the Tool Package (Windows) Operation Scenario Install the tool package for managing the ES3000 V3. The ES3000 V3 tool is incompatible with the NVMe driver built in the Windows OS. Ensure that you have installed Huawei's NVMe driver before using the tool.
  • Page 55 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-20 Installation interface Step 3 Click Next. The End-User License Agreement window is displayed, as shown in Figure 3-21. Figure 3-21 End-User License Agreement window Issue 20 (2019-02-27)
  • Page 56 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Step 4 Select I accept the terms in the License Agreement and click Next. The Destination Folder window is displayed, as shown in Figure 3-22. Figure 3-22 Destination Folder window Step 5 Select a folder for installing the tool and click Next.
  • Page 57 ES3000 V3 NVMe PCIe SSD User Guide 3 Installation and Configuration Figure 3-23 Ready to install window Step 6 Click Install to start installation. When the installation is complete, the Completing Setup Wizard window is displayed, as shown in Figure 3-24.
  • Page 58: Installing The Tool (Esxi)

    Step 8 Copy windows\Windows_Tool\diagnostic_win.bat to C:\Program Files (x86)\hioadm. ----End 3.7.3 Installing the Tool (ESXi) Operation Scenario Install the tool for managing the ES3000 V3. Procedure Method 1 Step 1 Integrated into the driver package, the tool will be automatically installed during the driver package installation.
  • Page 59: Hot Plug

    SSD hot plug may affect services running on the SSD. Before performing a hot plug, notify system maintenance personnel to ensure service security. l If you insert the ES3000 V3 disk when it is not installed on a hard disk tray, it may fail to be detected.
  • Page 60: Oss Supporting Hot Plug

    You have correctly installed the ES3000 V3 disk on the server. Configuring Linux kernel In Linux (such as Red Hat7.0), hot plug of the ES3000 V3 NVMe PCIe SSD disk will cause unmatched maximum payload size, I/O write errors, and other issues. This is because Linux does not fully support hot plug.
  • Page 61 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug Red Hat (6.6, 6.7) and CentOS (6.6, 6.7) => Go to Red Hat (6.6, 6.7) and CentOS (6.6, 6.7). Oracle Enterprise Linux (7.0, 7.1, 7.2) => Go to Oracle Enterprise Linux (7.0, 7.1, 7.2).
  • Page 62 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug search --no-floppy --fs-uuid --set=root b64fedb9- b1e9-465d-994f-9cee287c1d57 linux16 /vmlinuz-0-rescue-17e12da386e9435aa7f2b6b718079678 root=UUID=b054ccd0-c3d3-47eb-a449-f897f63f1b76 ro rd.lvm.lv=centos/swap vconsole.font=latarcyrheb-sun16 rd.lvm.lv=centos/root crashkernel=auto vconsole.keymap=us rhgb quiet pciehp.pciehp_force=1 pci=pcie_bus_perf initrd16 /initramfs-0-rescue-17e12da386e9435aa7f2b6b718079678.img if [ "x$default" = 'CentOS Linux, with Linux 3.10.0-123.el7.x86_64' ];...
  • Page 63 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug set gfxpayload=keep insmod gzio insmod part_msdos insmod xfs set root='hd0,msdos1' if [ x$feature_platform_search_hint = xy ]; then search --no-floppy --fs-uuid --set=root --hint-bios=hd0,msdos1 --hint-efi=hd0,msdos1 --hint-baremetal=ahci0,msdos1 --hint='hd0,msdos1' fcf9f115-8f51-496e-a7a8-905f03350b4e else search --no-floppy --fs-uuid --set=root fcf9f115-8f51-496e- a7a8-905f03350b4e linux16 /vmlinuz-3.10.0-123.el7.x86_64...
  • Page 64 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug if [ "x$default" = 'Oracle Linux Server, with Unbreakable Enterprise Kernel 3.8.13-35.3.1.el7uek.x86_64' ]; then default='Advanced options for Oracle Linux Server>Oracle Linux Server, with Unbreakable Enterprise Kernel 3.8.13-35.3.1.el7uek.x86_64'; fi; ### END /etc/grub.d/10_linux ### …(Some code omitted.)
  • Page 65 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug echo 'Loading Linux 3.12.28-4-default ...' linux /boot/vmlinuz-3.12.28-4-default root=UUID=dcbfdecb-bcd9-4003-ba51-a95c7e31c56e ${extra_cmdline} resume=/dev/disk/by-uuid/9a586421-38ef-43bb-9209-afe5eede22e3 splash=silent quiet crashkernel=216M-:108M showopts pciehp.pciehp_force=1 pci=pcie_bus_perf echo 'Loading initial ramdisk ...' initrd /boot/initrd-3.12.28-4-default menuentry 'SLES12, with Linux 3.12.28-4-default (recovery mode)' --hotkey=3 --class sles12 --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.12.28-4-default-recovery-dcbfdecb-...
  • Page 66 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug pciehp.pciehp_force=1 pci=pcie_bus_perf echo 'Loading initial ramdisk ...' module --nounzip /boot/initrd-3.12.28-4-xen submenu 'Advanced options for SLES12 (with Xen hypervisor)' $menuentry_id_option 'gnulinux-advanced-dcbfdecb-bcd9-4003-ba51- a95c7e31c56e' { submenu 'Xen hypervisor, version 4.4.1_06-2.2' $menuentry_id_option 'xen-hypervisor-4.4.1_06-2.2-dcbfdecb-bcd9-4003- ba51-a95c7e31c56e' { menuentry 'SLES12, with Xen 4.4.1_06-2.2 and Linux...
  • Page 67 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug root=UUID=dcbfdecb-bcd9-4003-ba51-a95c7e31c56e single ${extra_cmdline} pciehp.pciehp_force=1 pci=pcie_bus_perf echo 'Loading initial ramdisk ...' module --nounzip /boot/initrd-3.12.28-4-xen ### END /etc/grub.d/20_linux_xen ### …(Some code omitted.) NOTE Whether the file content includes "### BEGIN /etc/grub.d/20_linux_xen ###" depends on whether Xen Hypervisor is selected during OS installation.
  • Page 68 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug NOTE Whether the file content includes "title Xen" depends on whether Xen Hypervisor is selected during OS installation. Press Esc, enter :wq, and press Enter to save the edits. Restart the OS for the settings to take effect.
  • Page 69 ES3000 V3 NVMe PCIe SSD User Guide 4 Hot Plug linux /boot/vmlinuz-3.13.0-24-generic root=UUID=b7889e8e- dbc4-4fe9-bf5c-dab9c20a93f8 ro pciehp.pciehp_force=1 pci=pcie_bus_perf initrd /boot/initrd.img-3.13.0-24-generic submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux- advanced-b7889e8e-dbc4-4fe9-bf5c-dab9c20a93f8' { menuentry 'Ubuntu, with Linux 3.13.0-24-generic' --class ubuntu -- class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.13.0-24-generic-advanced-b7889e8e-dbc4-4fe9-bf5c-...
  • Page 70: Orderly Hot Plug Of A Disk In Windows

    ----End 4.2.2 Orderly Hot Plug of a Disk in Windows Operation Scenario Notify the Windows OS before hot removing the ES3000 V3 disk. Preparations You have correctly installed the ES3000 V3 disk on the server. You have installed the Windows tool package. For details, see 3.7.2 Installing the Tool...
  • Page 71 Figure 4-1 and then click eject succeed OK. If a success message is displayed, you can hot remove the ES3000 V3 disk. If a failure message indicating the OS is accessing the ES3000 V3 disk, stop related services before clicking eject again. You can hot remove the ES3000 V3 disk only when a success message is displayed.
  • Page 72: Maintenance And Upgrade

    This topic describes how to perform hardware maintenance, software upgrades, and troubleshooting for the ES3000 V3. 5.1 Uninstalling the Driver This topic describes how to uninstall the ES3000 V3 driver on various operating systems (OSs). 5.2 Upgrading the Driver This section describes how to upgrade the ES3000 V3 driver in different operating systems (OSs).
  • Page 73: Uninstalling The Driver In Linux

    5 Maintenance and Upgrade 5.1.1 Uninstalling the Driver in Linux Operation Scenario If you want to stop using or replace the ES3000 V3, uninstall the driver first. Procedure Step 1 Log in to the OS as an administrator. Step 2 Stop or exit the programs or files that are accessing the ES3000 V3.
  • Page 74: Uninstalling The Driver In Windows

    Uninstall the ES3000 V3 driver by following the procedure described in this topic. Do not uninstall the ES3000 V3 driver by using Device Manager. If you have uninstalled the ES3000 V3 driver by using Device Manager, you still need to uninstall the driver by following the procedure described in this topic before installing the driver again.
  • Page 75: Uninstalling The Driver In Esxi

    5.1.3 Uninstalling the Driver in ESXi Operation Scenario If you want to stop using or replace the ES3000 V3, uninstall the driver first. Procedure Step 1 Log in to the OS as an administrator or a member of the administrator groupo ,hadeo.
  • Page 76: Upgrading The Driver In Linux

    Procedure Step 1 Log in to the OS as an administrator. Step 2 Go to the directory that stores the ES3000 V3 driver package, for example, /home. Step 3 Run the upgrade command based on the OS type. For RHEL, CentOS, OEL, or SLES, run rpm -Uvh driver package name.
  • Page 77 ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Step 6 Check whether the following message is displayed. The message indicates that the original NVMe driver fails to be uninstalled during the upgrade. Warning: fail to uninstall the old nvme kernel module.
  • Page 78: Upgrading The Es3000 V3 Driver In Windows

    ----End 5.2.2 Upgrading the ES3000 V3 Driver in Windows Operation Scenario You can upgrade the ES3000 V3 driver after a later version is released. Preparations Before upgrading the driver, check that: You have downloaded the later driver software to the server, and verified the package integrity.
  • Page 79: Uninstalling, And Upgrading The Tool Package

    You can download the software package as follows: log in to Huawei Enterprise support website http://support.huawei.com/enterprise, choose Select a Product to Get Support > IT > Server > TaiShan > ES3000 V3, click Downloads, and download the required software package. The software package contains host tools (including hioadm) and Huawei's NVMe driver.
  • Page 80: Uninstalling The Tool (Esxi)

    5.3.4 Upgrading the Tool Package (Linux) Operation Scenario Upgrade the tool package to better manage the ES3000 V3 when a new version is available. The tool package naming rules are as follows: For RHEL, CentOS, OEL, or SLES, the package name is hioadm-version number- release number.hardware architecture.rpm, for example, hioadm-3.3.5.2-1.x86_64.rpm.
  • Page 81: Upgrading The Tool Package (Windows)

    ----End 5.3.5 Upgrading the Tool Package (Windows) Operation Scenario Upgrade the tool package to better manage the ES3000 V3 when a new version is available. Two upgrade methods are available: Uninstall the old version and install the new version. Upgrade the old version directly.
  • Page 82: Upgrading The Tool (Esxi)

    5.3.6 Upgrading the Tool (ESXi) Operation Scenario Upgrade the tool to better manage the ES3000 V3 when a new version is available. Procedure Step 1 The tool is integrated into the driver package. You can install the driver package by referring 5.2.3 Upgrading the Driver in...
  • Page 83: Uninstalling Citrix Drivers And Tools

    –qa | grep hiodriver ----End 5.5 Upgrading the Controller Firmware This section describes how to upgrade the ES3000 V3 controller firmware in different operating systems (OSs). NOTE The ES3500, ES3600P, and ES3600C series use the same drivers and firmware.
  • Page 84 User Guide 5 Maintenance and Upgrade Stop or exit the ES3000 V3 SSD applications or services, and umount the file system that uses the SSD device. The firmware upgrade does not damage data on SSDs. However, you are advised to back up important data on SSDs.
  • Page 85: Upgrading The Controller Firmware In Windows

    Preparations Before upgrading the firmware, check that: You have uploaded the ES3000 V3 software package to a directory on the server, for example, the D:\ directory. Stop or exit the ES3000 V3 SSD applications or services, and uninstall the file system that uses the SSD device (make the to-be-upgraded SSD to be offline in the disk manager).
  • Page 86: Upgrading The Controller Firmware In Esxi

    You can upgrade the controller firmware when a new version is released. Preparations Before upgrading the firmware, check that: Stop or exit the ES3000 V3 SSD applications or services. The firmware upgrade does not damage data on SSDs. However, you are advised to back up important data on SSDs.
  • Page 87: Querying Health Status

    ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade If yes, no further action is required. If no, go to Step Step 8 Contact Huawei technical support for help. ----End 5.6 Querying Health Status Operation Scenario Check the SSD health status.
  • Page 88: Collecting Ssd Logs

    ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Step 2 Run the following command to query basic information about the SSD controller (such as nvme0): hioadm info -d nvme0 The command output is similar to the following: [root@localhost tool]# hioadm info -d nvme0 Namespace<1>...
  • Page 89: One-Click Log Collection

    Prerequisite You have downloaded the software package from the Software Download tab at http:// support.huawei.com/enterprise (Product Support > Enterprise Data Center > Servers > Acceleration Component > ES3000 V3. Install the hioadm tool before performing one-click log collection. For details about how to install the tool, see section 3.7 Installing the Tool...
  • Page 90: Securely Erasing Ssd Data

    ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade ESXi Step 1 Copy host_okc.sh from /vmware in the package to /scratch/hio/. Step 2 Log in to the OS as an administrator or a member in the administrator group.
  • Page 91: Querying Ssd Lifespans

    ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Step 2 Run the following command to securely erase data from the SSD (such as nvme0): hioadm secure -d nvme0 The warning of the risks of data erasure is displayed.
  • Page 92: Common Faults

    Step 3 The percentage used parameter displays the used lifespan percentage of the SSD. If the value of percentage used exceeds 100%, the SSD lifespan has expired, and Huawei's warranty service is unavailable. You need to back up data on the SSD as soon as possible and replace the SSD.
  • Page 93 ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade formatted metadata size: 0 Byte maximum capacity : 1.6TB current capacity : 1.6TB volatile write cache : Enable serial number : 0503023HDCN107C80013 model number : HWE32P430016M00N firmware version : 2.14 NVMe version : 1.2...
  • Page 94 ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Table 5-1 Critical Warning parameters Parameter Description critical warning Critical warning, such as l 0: No warning. overtemperature and l 1: The available spare insufficient redundant space. space has fallen below the threshold.
  • Page 95: Indicator Status Descriptions

    ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Step 2 Obtain disk logs by following instructions in 5.7.3 One-Click Log Collection and contact Huawei technical support. ----End The service life exceeds the threshold. Step 1 Check whether the value of percentage used in the SMART information exceeds 100%, if the value is greater than or equal to 100%, stop using the disk and back up data immediately.
  • Page 96: Es3000 Ssd Card Indicator State Descriptions

    5.12.1 Removing a Non-Hot-Swappable ES3000 V3 NVMe PCIe SSD Disk. – If the system supports hot swap, hot-swap an NVMe PCIe SSD disk. For details, 5.12.2 Removing a Hot Swappable ES3000 V3 NVMe PCIe SSD Disk. Issue 20 (2019-02-27) Copyright © Huawei Technologies Co., Ltd.
  • Page 97: Removing A Non-Hot-Swappable Es3000 V3 Nvme Pcie Ssd Disk

    Preparations Before removing an ES3000 V3 NVMe PCIe SSD, make the following preparations: Wear ESD gloves. Used to prevent ESD damage when you insert, remove, or hold the ES3000 V3 or a precision device. Back up data. – Stop the access to a hot swappable SSD disk.
  • Page 98: Removing A Hot Swappable Es3000 V3 Nvme Pcie Ssd Disk

    Plug. Wear ESD gloves. Procedure Step 1 Determine the position of the disk in the server and stop the services on the ES3000 V3 NVMe PCIe SSD disk to be removed. Step 2 Perform operations described in 4.2 Orderly Hot Plug.
  • Page 99: Removing An Es3000 V3 Nvme Pcie Ssd Card On A Riser Card

    Step 1 Turn off the power to the server and remove the chassis cover. Step 2 Remove all the cables from the riser card. Step 3 Hold the upper part of an ES3000 V3 NVMe PCIe SSD card and remove it slowly. See Figure 5-8.
  • Page 100: Removing An Es3000 V3 Nvme Pcie Ssd Card From The Mainboard

    Step 1 Turn off the power to the server and remove the chassis cover. Step 2 Open the latch on the PCIe card. Step 3 Hold the upper part of an ES3000 V3 NVMe PCIe SSD card and remove it upwards slowly. Figure 5-9.
  • Page 101 ES3000 V3 NVMe PCIe SSD User Guide 5 Maintenance and Upgrade Figure 5-9 Removing an ES3000 V3 NVMe PCIe SSD card Step 4 Place the removed PCIe card in an ESD bag. ----End Issue 20 (2019-02-27) Copyright © Huawei Technologies Co., Ltd.
  • Page 102: Command Description

    V3. This chapter describes the hioadm command. The command output varies according to the actual operation result. hioadm Tool hioadm is an ES3000 V3 management tool. Its command format is as follows: hioadm <major cmd> <minor cmd1> <parameter1> <minor cmd2> <parameter2> ... <major cmd> can be any of the following:...
  • Page 103 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Operation Logs All setting operations performed on the ES3000 V3 by using the hioadm tool are recorded. The log file location is as follows: For Linux, /opt/hio/operationLogs/operations.log. For Windows, .\operationLogs\operations.log in the installation directory.
  • Page 104: Querying Information

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description 6.1 Querying Information. 6.1.1 Querying the SSD List Function This command is used to query the SSD list. Format hioadm info Parameters None Usage Guidelines None Example #Query the list of existing SSDs.
  • Page 105: Querying Basic Information About A Device

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description 6.1.2 Querying Basic Information About a Device Function This command is used to query basic information about an SSD (SSD controller) or logical disk. If you query information about an SSD, information about all of its logical disks is also displayed.
  • Page 106: Querying The Smart Information About A Device

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value formatted LBA Formatted logical block Example: 512 byte size address (LBA) size of the namespace. Unit: byte formatted Formatted metadata size Example: 0 byte metadata size of the namespace. Unit:...
  • Page 107 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Format hioadm info -d devicename -s Parameters Parameter Description Value devicename Name of a device Examples: nvme0 and nvme1 Usage Guidelines None Example # Query the SMART information about nvme0.
  • Page 108 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description composite Temperature. Unit: Example: 328 degree K (55 degree C) temperature degree Kelvin and Celsius available spare Redundant space Example: 100 % proportion. available spare Warning threshold of...
  • Page 109: Querying Advanced Information Of A Device

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description data status Data health status. Example: OK Values are as follows: l OK: The status is normal. l need recovery: Data needs to be restored. 6.1.4 Querying Advanced Information of a Device Function This command is used to query the advanced information about an SSD (SSD controller).
  • Page 110 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description bad block rate : 1.693702% total blocks count : 142528 bad blocks count : 2414 factory bad blocks count : 2414 flash program failed count : 0 flash erase failed count...
  • Page 111: Querying, Upgrading, And Activating Firmware

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description capacitance Number of discharge/ Example: 3 times charging time charge cycles of the capacitor. active power Current total power Example: 7041 mW consumption. maximum power Highest power Example: 7041 mW consumption recorded.
  • Page 112: Upgrading The Firmware Of An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of an SSD Example: nvme0 or nvme1 Usage Guidelines None Example # Query the firmware version of nvme0. [root@localhost tool]# hioadm updatefw -d nvme0...
  • Page 113: Activating The Firmware Of An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value slot Slot of the target 1, 2 or 3 firmware. NOTE l If this parameter is not specified, a slot with firmware not in use will be selected.
  • Page 114: Querying And Setting The Capacity

    6.3 Querying and Setting the Capacity The capacity size affects the write performance. A small capacity results in a high random write IOPS. The ES3000 V3 allows you to set the capacity within a specified range. 6.3.1 Querying the Capacity of an SSD Function This command is used to query the current capacity of an SSD.
  • Page 115: Setting The Capacity Of An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines None Example # Query the current capacity of nvme0. [root@localhost tool]# hioadm capacity -d nvme0 current capacity : 1.0TB (1000000000000Byte) maximum capacity : 1.8TB (1800000000000Byte) System Response Parameter...
  • Page 116 Before running this command, stop all I/O services of the SSD, and unmount all logical disks of the SSD. If a Huawei-developed driver is installed, the setting takes effect immediately. If an open-source or system-provided driver is installed, the setting takes effect after the driver is uninstalled and reinstalled or the server is restarted.
  • Page 117: Formatting

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Description maximum Original available Example: 1.6TB (1600321314816Byte) capacity capacity (with one decimal place) of the SSD. Unit: GB or TB. In Linux and ESXi, 1 GB equals 1000 MB. In Windows, 1 GB equals 1024 MB.
  • Page 118: Formatting An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description – For Linux, unmount the logical disk. Stop all the processes on the logical disk, and run the fuser command to check that these processes are all stopped. The following information indicates that a process is using the logical disk.
  • Page 119 0. If this parameter is not specified, the sector size and type are not changed. l In the ES3000 V3 series, an SSD with a capacity greater than 4 TB does not support 512B sectors. Usage Guidelines...
  • Page 120: Safely Erasing User Data Of An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Figure 6-2 Making a logical disk offline Do not read or write data when running this command. Otherwise, I/O errors may occur. Example # Perform secure formatting of the nvme0 SSD, and set the sector size to 512 B and metadata size to 0 B.
  • Page 121 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameters Parameter Description Value devicename Name of an SSD. Example: nvme0 Usage Guidelines This command supports NVMe SSDs provided by other vendors. Before running this command, stop all I/O services of the SSD and perform the following: –...
  • Page 122: Querying And Setting The Power Consumption Level

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description 6.6 Querying and Setting the Power Consumption Level 6.6.1 Querying the Power Consumption Level of an SSD Function This command is used to query the power consumption level of an SSD.
  • Page 123: Obtaining Logs

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value powerstate Power consumption level. l 0: 22 W l 1: 15 W l 2: 8 W NOTE l The power consumption level affects device performance. The lower the power consumption, the poorer the performance.
  • Page 124: Obtaining All Logs Of A Device At A Time

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines The path and name of the generated log file is as follows. nvme0 is an example device name. Linux: The file path is /opt/hio/; the key log file name is nvme0_key.log; the full log file name is nvme0_fw.log;...
  • Page 125: Querying And Setting Temperature Thresholds

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description save firmware core dump log file successed(/opt/hio/nvme0_coredump.log) other log saving..OK save other logs file successed(/opt/hio/nvme0_other.log) logs has been saved. 6.8 Querying and Setting Temperature Thresholds 6.8.1 Querying the Temperature Information About a Device Function This command is used to query the temperature and temperature thresholds of an SSD.
  • Page 126 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description System Response Parameter Parameter Value Descripti composite Highest Example: 363 degree K (90 degree C) highest temperature temperatur e recorded. Unit: K and °C composite Number of Example: 5 overtemperatu...
  • Page 127: Setting The Temperature Thresholds Of A Device

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Value Descripti overtemperatu Overtempe Example: 341(68) re threshold rature threshold. Unit: K and °C undertemperat Undertemp Example: 273(0) ure threshold erature threshold. Unit: K and °C 6.8.2 Setting the Temperature Thresholds of a Device Function This command is used to set the temperature thresholds of an SSD or controller.
  • Page 128 Either the overtemperature or undertemperature threshold must be specified. NOTE ES3000 V3 SDDs have two alarm severities. The second alarm severity restricts disk I/O speed. If an overtemperature alarm occurs, check server heat dissipation and ambient temperature.
  • Page 129: Querying And Setting The Write Mode

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description 6.9 Querying and Setting the Write Mode 6.9.1 Querying the Write Mode of an SSD Function This command is used to query the write mode of an SSD. Format hioadm writemode -d devicename...
  • Page 130: Querying The Diagnosis Result Of A Specified Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines None Example # Set the write mode of the nvme0 SSD to cache. [root@localhost tool]# hioadm writemode -d nvme0 -m 1 setting write mode successed. write mode: cache...
  • Page 131 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description System Response Parameter Parameter Description Value selftest result Overall test result. The value is passed or Example: passed empty. If the result is success, all the following sub-tests succeed and sub-test results are not displayed.
  • Page 132: Querying The Electronic Label Information About An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Parameter Description Value data check Data check test result. Values are passed Example: passed and failed. 6.11 Querying the Electronic Label Information About an Function This command is used to query the electronic label information about an SSD.
  • Page 133: Querying And Configuring Namespaces

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Format hioadm recovery -d devicename [-t type] Parameters Parameter Description Value devicename Name of a device. Example: nvme0 type Data recovery mode. l 0: common recovery l 1: forcible recovery...
  • Page 134: Creating A Namespace For An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Format hioadm namespace -d devicename Parameters Parameter Description Value devicename Name of a device Example: nvme0 Usage Guidelines None Example # Query the namespace distribution of the nvme0 SSD. [root@localhost tool]# hioadm namespace -d nvme0 total capacity: 1.8T...
  • Page 135: Attaching A Namespace To An Nvme Controller

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Format hioadm namespace -d devicename -t operationtype -s size -f shareflag Parameters Parameter Description Value devicename Name of a device Example: nvme0 operationtype Operation type l 0: Create a namespace.
  • Page 136: Detaching A Namespace From An Nvme Controller

    The value of this parameter is 1. Usage Guidelines If a Huawei-developed driver is installed, the setting takes effect immediately without needing to stop I/O services. If an open-source or system-provided driver is installed, the setting takes effect after the server is restarted.
  • Page 137 Select 3 in this command. namespaceid ID of a namespace. controllerid ID of an NVMe controller. The ES3000 V3 SSD has only one controller. The value of this parameter is 1. Usage Guidelines Before running this command, stop all I/O services of the namespace and perform the following operations for the namespace.
  • Page 138: Deleting A Namespace Of An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description If a Huawei-developed driver is installed, the setting takes effect immediately without needing to stop I/O services. If an open-source or system-provided driver is installed, the setting takes effect after the server is restarted.
  • Page 139: Setting The Number Of Namespaces For An Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines l Before running this command, stop all I/O operations related to the namespace. l Before running this command, detach the namespace from all controllers. l Exercise caution because deleting the namespace will also delete its storage data.
  • Page 140: Querying Or Setting The Atomic Write Status

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Usage Guidelines None Example # Set the number of namespaces to be created on the nvme0 SSD to 2. [root@localhost tool]# hioadm namespace -d nvme1 -t 6 -n 2 Setting the namespace number 2 successed.
  • Page 141: Setting The Atomic Write Status For A Specified Ssd

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description 6.14.2 Setting the Atomic Write Status for a Specified SSD Function This command is used to set the atomic write status for a specified SSD. Format hioadm atomicwrite -d devicename -f flag...
  • Page 142: Restoring Default Attributes

    ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description Parameter Description Value days Number of days for query. The value ranges between 1 and 360, for example, Usage Guidelines None Example # Query the amount of written data of nvme0.
  • Page 143 ES3000 V3 NVMe PCIe SSD User Guide 6 Command Description − For ESXi, delete all partitions of the logical disk. − For Windows, make the logical disk offline. See Figure 6-5. Figure 6-5 Making a logical disk offline Do not read or write data when restoring the default attributes of an SSD. Otherwise, I/O errors may occur.
  • Page 144: A Supported Nvme Commands

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Supported NVMe Commands The ES3000 V3 supports all management and I/O commands required by the NVMe 1.2 protocol. A.1 Supported NVMe Management Commands A.2 Supported NVMe I/O Commands A.3 Supported Get Log Page Commands A.4 SMART Properties...
  • Page 145: Supported Nvme I/O Commands

    Reservation Acquire Reservation Release A.3 Supported Get Log Page Commands The ES3000 V3 supports all get log page commands required by the NVMe 1.2 protocol. The commands are as follows: Error information (log identifier 01h) SMART/Health information (log identifier 02h)
  • Page 146 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-1 SMART properties (log identifier 02h) Description Critical Warning: This domain indicates a critical warning about the controller status. Critical warnings are returned to the host through asynchronous events.
  • Page 147 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Description 95:8 Host Write Commands: indicates the number of write commands sent to the controller. Controller Busy Time indicates the busy period when the controller processes I/O 111: commands. The controller is busy from command delivery (to the SQ) to the response (to the CQ).
  • Page 148 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-2 Customized SMART properties (log identifier C0h) Bytes Description Buck converter voltage. Unit: V Current power consumption. Unit: W Highest power consumption recorded. Unit: W Highest SSD temperature recorded. Unit: Kelvin...
  • Page 149 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 75:72 Number of FTL table rebuilds due to power outage 79:76 Number of deep rebuilds of the FTL table 95:80 Number of read failures 111:96 Number of read operations...
  • Page 150 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 435:432 Number of bad programming blocks 439:436 Number of bad erase blocks 443:440 Number of UNC bad blocks 447:444 Number of DIE bad blocks 451:448 Number of DDR single-bit ECC errors...
  • Page 151 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Current system time in seconds (number of seconds elapsed since January 1, 587:584 1970) 595:588 Firmware version information 1 603:596 Firmware version information 2 635:604 Firmware compilation time...
  • Page 152 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Internal error 2 Internal error 3 Internal error 4 BBU check exception Reserved Internal error 5 Internal error 6 Internal error 7 Internal error 8 Internal error 9...
  • Page 153 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 691:688 Reserved 695:692 Port 0 function reset count 699:696 Reserved 703:700 Port 0 subsystem reset count 707:704 Reserved 711:708 Port 0 controller reset count 715:712 Reserved 719:716...
  • Page 154 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Reserved 22:17 Current Raw Value (Erase_Fail_Count) Reserved Wear Leveling Count 26:25 Reserved Normalized Value (Wear Leveling) Reserved 34:29 Current Raw Value (Wear Leveling) Reserved End To End Error Detection Count...
  • Page 155 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description Reserved 82:77 Current Raw Value (Timed Workload Host Reads) Reserved Timed Workload Timer Count 86:85 Reserved Normalized Value (Timed Workload Timer) Reserved 94:89 Current Raw Value (Timed Workload Timer)
  • Page 156: Supported Set Feature Commands

    Besides SMART information, the host can use the Get Features command to obtain feature parameters related to working and health status. The ES3000 V3 can also use the following Set Features commands defined by NVMe 1.2 to change the feature parameter settings:...
  • Page 157 All sensors Temperature Threshold (TMPTH) indicates the SSD or controller temperature 15:00 threshold in unit of Kelvin. The ES3000 V3 also supports the following vendor-customized set feature command: Set/Get Device Time (Feature Identifier C0h) Table A-5 C0h-Temperature Threshold-Command Dword 11 Description...
  • Page 158: Supported Customized Management Commands

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands A.6 Supported Customized Management Commands The ES3000 V3 supports not only the commands required by specifications but also customized commands for query and configuration. Table A-6 Opcode Opcode Opcode...
  • Page 159: Obtaining The Enablement Status Of User Functions

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-9 Command Dword 10 Description 31:00 Data_Len: The length of data transmission is in the unit of Dword. If data transmission is not needed, then the value is 0 h.
  • Page 160: Obtaining Logs

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands The enablement status of each function is returned through CQ Dword0. Table A-13 Completion Queue Entry Dword 0 Description Enable Status: 1 indicates that the function is enabled. 0 indicates that the function is disabled.
  • Page 161 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-16 PRP 2 Description 63:00 PRP Entry 2 (PRP2): This field indicates the second PRP entry. If PRP Entry 1 specifies enough space for the data structure, this field is reserved. If the data structure requires two PRP entries, this field represents the second PRP entry address.
  • Page 162: Obtaining Ssd Id Parameters

    A-21. In the following table, "Field" indicates the combination of the field name, equal sign, field value, and carriage return. For example, "VendorName=Huawei\r\n" is a string, where "VendorName" is the field name and "Huawei" is the field value. Table A-21 Electronic label information...
  • Page 163 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Area Description Maximum Maximum Remarks Field Field Value Length Length (Bytes) (Bytes) \r\n and the information description area. Informatio [Board Properties]\r description area BoardType= Product model number <Model>\r\n BarCode=<S SN on the paper label N>\r\n...
  • Page 164: Obtaining The Enablement Status Of Functions

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands The subcommand is used to set the SSD part number (PN). The host uses PRP1 and PRP2 to send PN information in the format described in Table A-22. Table A-22 PN...
  • Page 165: Querying The Maximum Available Capacity Of The Ssd

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-26 Sub_OpType Sub_OpType Description Flash inspection enablement Capacitor inspection enablement DDR inspection enablement Temperature inspection enablement Endurance management enablement CE concurrency enablement Read Retry enablement Wear leveling enablement...
  • Page 166: Obtaining The Vendor Log Length

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands A.6.1.6 Obtaining the Vendor Log Length This command is used to obtain the length of vendor logs (including the log parsing package, full logs, and key logs). Sub_OpType indicates the log type.
  • Page 167: Obtaining The Dieid Of A Chip

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Description Firmware error test (front-end error check: whether the disk is in the controller disk mode, whether the disk is in read-only mode, and whether the available space is...
  • Page 168: Obtaining Virtualization Information

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Description Chip ID 11:8 The DIEID is displayed in bytes 0 to 3. …… 27:24 The DIEID is displayed in bytes 16 to 19. 31:28 Reserved A.6.1.10 Obtaining Virtualization Information This command is used to obtain VF information.
  • Page 169 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-36 Obtaining the virtual resource data structure Bytes Description Controller Identifier (CNTLID): ID of the primary controller. Port Identifier (PORTID): Port ID of the primary controller in the NVM subsystem.
  • Page 170 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-37 Controller information Bytes Description Number of controller virtualization information entries. The maximum number is 127. The value 0 indicates not entry. (VF only) 31:1 Reserved 63:32 Controller virtualization entry 0: This field contains the first controller topology entry in the list, if present.
  • Page 171: Obtaining The Number Of Sriov Vfs

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Bytes Description 31:16 Reserved A.6.1.11 Obtaining the Number of SRIOV VFs This command is used to obtain the effective numVFs value of SRIOV. The number of VFs is returned by Dword0 of CQ.
  • Page 172: Configuration Commands

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands SubOpType Description Content to be obtained. When SubOpType delivered to obtain the uniqueID length is 0, the length is returned by DWORD0 of CQ. Table A-43 Cq Command Dword0...
  • Page 173: Configuring The Enablement Status Of User Functions

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-46 PRP 2 Description 63:00 PRP Entry 2 (PRP2): This field indicates the second PRP entry. If PRP Entry 1 specifies enough space for the data structure, this field is reserved. Otherwise, it specifies the remainder of the data buffer.
  • Page 174: Deleting Vendor Logs And Monitoring Data

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-50 Sub_OpType Sub_OpType Description Reserved SRIOV enablement status. The enablement status of each function is returned through CQ Dword0. Table A-51 Command Dword13 Description Enable Status: 1 indicates that the function is enabled.
  • Page 175: Recovering Data

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-53 Dword13&Dword14 Description 63:00 Capacity of the entire SSD (unit: byte) A.6.2.4 Recovering Data Run this command to recover data of the SSD. The recovery may take up to 20 minutes.
  • Page 176 ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Description 000b VQ Resources 001b VI Resources 010b–111b Reserved 07:04 Reserved 03:00 Action: Operation type. Value Description Reserved Primary Controller Remove: Remove the flexible resources of the primary controller. DW11.FR and DW11.NR must be specified.
  • Page 177: Configuring The Number Of Sriov Vfs

    ES3000 V3 NVMe PCIe SSD User Guide A Supported NVMe Commands Table A-56 Command Dword11 Description 31:16 First Resource Identifier (FR): The first resource ID. This field is valid only when resources are removed from the primary controller. 15:00 Number of Controller Resources (NR): Number of resources to be removed, assigned, or set as default.
  • Page 178: B Out-Of-Band Management

    ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Out-of-Band Management This section describes the out-of-band management functions of the ES3000 V3. The ES3000 V3 provides the following out-of-band management functions: NVMe basic management commands VPD information Temperature sensors NOTE To use out-of-band management functions, the server must support them.
  • Page 179 ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset (Byte) Description Code Status Flags(SFLGS): This field indicates the status of the NVM subsystem. SMBus Arbitration: Bit 7 is set '1' after a SMBus block read is completed all the way to the stop bit without bus contention and cleared to '0' if a SMBus Send Byte FFh is received on this SMBus slave address.
  • Page 180 ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset (Byte) Description Code Composite Temperature(CTemp): This field indicates the current temperature in degrees Celsius. If a temperature value is reported, it should be the same temperature as the Composite Temperature from the SMART log of hottest controller in the NVM subsystem.
  • Page 181: Vpd

    ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Command Offset (Byte) Description Code Serial Number: 20 characters that match the serial number 30:11 in the NVMe Identify Controller command response. First character is transmitted first. PEC: An 8 bit CRC calculated over the slave address, command code, second slave address and returned data.
  • Page 182 ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Table B-3 VPD definition Function Byte Value Description Class Code Device type and programming interface PCI-SIG vendor ID 5 to 24 Serial Number Serial number (ASCII string) 25 to 64...
  • Page 183: Temperature Register

    ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Function Byte Value Description SM-Bus SM-Bus address of the temperature Address sensor reserved Warning Warning threshold of temperature Threshold for controller 1 Warning threshold of temperature for controller 2 Overtemp...
  • Page 184 ES3000 V3 NVMe PCIe SSD User Guide B Out-of-Band Management Binary Temperature xxx0 0000 0000 010x +0.25°C xxx0 0000 0000 000x 0°C xxx1 1111 1111 110x –0.25°C xxx1 1111 1110 000x –1C xxx1 1110 1100 000x –20°C Issue 20 (2019-02-27)
  • Page 185: C Snmp Function

    C.3 Configuring the SNMP Function in Linux This section describes how to configure the SNMP function in Linux. C.4 Querying SNMP Information This section describes the software for querying ES3000 V3 SNMP information and where to obtain the software. C.5 SNMP OID This section describes the SNMP object identifier (OID) defined by the ES3000 V3.
  • Page 186: Configuring The Snmp Function In Windows

    You have correctly installed the ES3000 V3 on the server. You have installed the SNMP service utility in Windows. For details, see https:// msdn.microsoft.com/en-us/library/cc759570(v=ws.10).aspx. You have uploaded the ES3000 V3 software package to a directory on the server, for example, the D:\ directory. Procedure Install the software.
  • Page 187: Querying Snmp Information

    /usr/lib/es3000v3_snmp_5.7.so ----End C.4 Querying SNMP Information This section describes the software for querying ES3000 V3 SNMP information and where to obtain the software. Using the Net-SNMP Command Set You need to install net-snmp-utils before using the Net-SNMP command set to query ES3000 V3 SNMP information.
  • Page 188: Common Problems

    #snmpd –Dread_config –H 2>&1 | grep "Reading" | sort -u Example If Net-SNMP 5.7 is used, use the snmpd.conf file provided by the ES3000 V3 to start the snmpd program. snmpd –d –Lo –c /opt/hio/snmpd.conf Use the snmpwalk command tool to query ES3000 V3 through SNMP v2c.
  • Page 189: Snmp Oid

    = STRING: "volatile write cache Enable" C.5 SNMP OID This section describes the SNMP object identifier (OID) defined by the ES3000 V3. The SNMP OID is a value defined in the management information base (MIB) and used to identify MIB members.
  • Page 190 ES3000 V3 NVMe PCIe SSD User Guide C SNMP Function Node Node OIDs Description Type Permiss Name compositeTe 1.3.6.1.4.1.2011.2.319.3.1. Overall OCTET Read- mperature temperature STRING only maxCapacity 1.3.6.1.4.1.2011.2.319.3.1. Maximum Unsigned32 Read- capacity only currentCapac 1.3.6.1.4.1.2011.2.319.3.1. Current Unsigned32 Read- capacity only dataUnitsRe 1.3.6.1.4.1.2011.2.319.3.1.
  • Page 191: D Obtaining Device Logs By Using An Open-Source Tool

    ES3000 V3 NVMe PCIe SSD User Guide D Obtaining Device Logs by Using an Open-Source Tool Obtaining Device Logs by Using an Open-Source Tool This topic describes how to obtain device logs by using the open-source tool nvme-cli. Function You can use the python script hiolog.py to obtain device logs without using hioadm. The hiolog.py script can be obtained from the driver installation package.
  • Page 192 ES3000 V3 NVMe PCIe SSD User Guide D Obtaining Device Logs by Using an Open-Source Tool 100% ||....................done Reading log key(32) 100% ||......... done Reading log coredump(13) 100% ||....done Parsing log fw 100% ||....................done Parsing log key 100% ||................
  • Page 193: E Introduction To Windows Gui

    Introduction to Windows GUI This section describes the Windows GUI tool in the Windows tool package. After installing the ES3000 V3 tool package in Windows, access the Windows GUI tool as follows: If the .NET Framework version is 2.0 or 3.5, double-click the HioadmGUI_DotNet_2.0.exe file in the tool installation directory.
  • Page 194 See Figure E-2. Figure E-2 Basic information Update Page This page is used to upgrade the ES3000 V3 firmware, as shown in Figure E-3 Figure E-4. Issue 20 (2019-02-27) Copyright © Huawei Technologies Co., Ltd.
  • Page 195 Figure E-3 Update page with no firmware upgrade image selected Figure E-4 Update page with a firmware upgrade image selected select image: Select a ES3000 V3 firmware upgrade image provided by Huawei. select slot: only slots 1, 2, and 3 are available. Slot 1 supports only activation and does not support upgrade.
  • Page 196 ES3000 V3 NVMe PCIe SSD User Guide E Introduction to Windows GUI DiskMgnt Page This page is used to format the ES3000 V3, as shown in Figure E-5. Figure E-5 DiskMgnt page Functions on this page are the same as the operations described in...
  • Page 197 ES3000 V3 NVMe PCIe SSD User Guide E Introduction to Windows GUI Figure E-6 SelfTest page Functions on this page are the same as the operations described in 6.10 Querying the Diagnosis Result of a Specified SSD. NS Mgnt Page...
  • Page 198 ES3000 V3 NVMe PCIe SSD User Guide E Introduction to Windows GUI This page provides the following functions, which are the same as the operations described in 6.13 Querying and Configuring Namespaces. Create a namespace. You can create a namespace with a size not exceeding the remaining capacity.
  • Page 199 ES3000 V3 NVMe PCIe SSD User Guide E Introduction to Windows GUI Figure E-9 DevMgnt page This page provides the following functions: power state: Set the power consumption level. write mode: Set the write mode. temperature: View disk temperature information, including the highest historical temperature, number of overtemperature occurrences, and overtemperature duration.
  • Page 200: F Installing An Os On The Es3000 V3

    You can install one of the OSs supported on the ES3000 V3 as required. To install Red Hat 7.0, CentOS 7.0, or OEL 7.0 in an ES3000 V3 with a 4K sector size, secure formatting the ES3000 V3 first by referring to 6.4.2 Formatting an SSD...
  • Page 201 F Installing an OS on the ES3000 V3 Figure F-1 Creating partitions manually Preparations You have correctly installed the ES3000 V3 on the server. Installing Windows Server 2012 64-Bit on the ES3000 V3 Step 1 Download the hiodriver_2012_x86_64.img driver image and mount it to the virtual floppy drive of the server.
  • Page 202 ES3000 V3 NVMe PCIe SSD User Guide F Installing an OS on the ES3000 V3 Figure F-2 Selecting Load driver Step 3 Click Next to install the driver, as shown in Figure F-3. Figure F-3 Installing the driver Issue 20 (2019-02-27)
  • Page 203 ES3000 V3 NVMe PCIe SSD User Guide F Installing an OS on the ES3000 V3 Step 4 After the driver is installed, select the ES3000 V3 for OS installation, as shown in Figure F-4. Figure F-4 Selecting the ES3000 V3 If the ES3000 V3 has previous partition information, such as OS data, the installation may fail.
  • Page 204 User Guide F Installing an OS on the ES3000 V3 Figure F-6 Running the diskpart command Step 7 Enter select disk # (# indicates the number of the ES3000 V3 disk for OS installation) and press Enter, as shown in Figure F-7.
  • Page 205 Windows Server 2012 R2 is built with the NVMe driver. Therefore, the driver image does not need to be mounted for OS installation. Note that the ES3000 V3 is identified as 64 disks during the OS installation. Select the disk with a total size of greater than 0 for installing the l After the OS is installed by using its built-in drivers, install the SSD driver hiodriver_v*.*.*.*_2012R2_x84_64.msi released by Huawei.
  • Page 206: G How To Get Help

    User Guide G How to Get Help How to Get Help This topic describes how to contact Huawei for technical support if a fault persists during routine maintenance or troubleshooting. G.1 Preparations Before Contacting Huawei Before you get technical support from Huawei, collect fault information or prepare the commissioning environment.
  • Page 207: Making Debugging Preparations

    NOTE The following describes the faults that may occur on the product. If a fault persists after you handle it based on the recommended solution, contact the local office or Customer Service Center of Huawei for technical support in time.
  • Page 208 For enterprise customers, find the local contact information at Global Service Hotline. For carriers, find the local contact information at Global TAC Information. Contact the technical support personnel of the local Huawei office. Issue 20 (2019-02-27) Copyright © Huawei Technologies Co., Ltd.
  • Page 209: H Acronym Or Abbreviation

    ES3000 V3 NVMe PCIe SSD User Guide H Acronym or Abbreviation Acronym or Abbreviation China Compulsory Certification Cyclic Redundancy Check error checking and correcting IOPS I/O operations per second multi-level cell MTBF mean time between failures PCIe PCI Express RAID...

Table of Contents