Dell EMC VxFlex Ready Node Operating System Installation Manual
  1. Manuals
  2. Brands
  3. Dell Manuals
  4. Server
  5. EMC VxFlex Ready Node
  6. Operating system installation manual

Dell EMC VxFlex Ready Node Operating System Installation Manual

Hide thumbs Also See for EMC VxFlex Ready Node:
Table of Contents

Advertisement

Quick Links

Download this manual
Dell EMC VxFlex Ready Node
Operating System Installation and Configuration Guide
for ESXi
Rev 01
October 2019

Advertisement

Table of Contents
loading

Related Manuals for Dell EMC VxFlex Ready Node

Summary of Contents for Dell EMC VxFlex Ready Node

  • Page 1 Dell EMC VxFlex Ready Node Operating System Installation and Configuration Guide for ESXi Rev 01 October 2019...
  • Page 2 MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell Technologies, Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA.

  • Page 3: Table Of Contents

    Contents Figures ............................5 Tables ............................7 Chapter 1 VxFlex Ready Node deployment overview..............9 Typographical conventions............................. 10 Supported operating systems and requirements......................10 Hardware and operating systems............................ 11 VxFlex OS packages..............................11 VxFlex OS component requirements..........................12 VxFlex OS cluster components..........................12 VxFlex OS Gateway server requirements—VxFlex Ready Node................12 General prerequisites..............................13 Java requirements..............................
  • Page 4 Install the iSM using the vSphere CLI........................61 Next steps..................................62 Chapter 9 Reference material....................63 DTK - Hardware Update Bootable ISO........................... 64 Dell EMC OpenManage DRAC Tools (RACADM)...................... 64 Recommended BIOS and firmware settings......................66 Troubleshooting the Hardware ISO...........................68 Additional resources..............................70 Chapter 10 Getting help......................

  • Page 5: Figures

    Figures R640 and R740xd PCI slots, integrated NICs and iDRAC port locations..............37 R840 PCI slots, integrated NICs, and iDRAC port locations..................42 VxFlex Ready Node Operating System Installation Guide for ESXi...
  • Page 6 Figures VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 7: Tables

    Tables ESXi..................................10 Windows, except Core systems (see note) ......................10 ESXi..................................11 Windows................................... 11 VxFlex OS management IP network.........................30 VxFlex OS data IP network for Subnet #1........................ 31 VxFlex OS data IP network for Subnet #2........................31 VxFlex OS management IP network.........................32 VxFlex OS data IP network for Subnet #1........................32 VxFlex OS data IP network for Subnet #2.......................
  • Page 8 Tables VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 9: Vxflex Ready Node Deployment Overview

    CHAPTER 1 VxFlex Ready Node deployment overview This guide explains how to install the operating system and perform system configurations such as network connectivity and ports, on VxFlex Ready Node servers. Use this guide after installing a new or replacement VxFlex Ready Node server at the customer site, before deploying the system.

  • Page 10: Typographical Conventions

    The following is a list of supported operating systems and additional requirements for this version of VxFlex OS on VxFlex Ready Node servers. For the most updated information, see the Dell EMC VxFlex Ready Node Firmware and Driver Matrix at https:// support.emc.com/products/42216_ScaleIO-Ready-Node--PowerEdge-14G.

  • Page 11: Hardware And Operating Systems

    VxFlex Ready Node deployment overview Table 2 Windows, except Core systems (see note) (continued) Component Requirement Secure authentication mode Ensure that the following are installed on all servers in the system: OpenSSL 64-bit v1.0.1 or later (v1.1, however, is not supported) Visual C++ redistributable 2010 package, 64-bit Note: Windows OS is supported for the VxFlex OS Gateway and SDC, and is required for LIA.

  • Page 12: Vxflex Os Component Requirements

    VxFlex Ready Node deployment overview Note: You are also required to download and extract the VxFlex OS GUI for Windows Software Download. VxFlex OS component requirements Components and servers in the VxFlex OS system must meet the following requirements: VxFlex OS cluster components The following is the list of required VxFlex OS servers: VxFlex OS component servers 3-node cluster...

  • Page 13: General Prerequisites

    The following TCP ports are not used by any other application, and are open in the local firewall of the server: 80 and 443 (or 8080 and 8443). You can change the default ports. For more information, see "Communication Security Settings" in the Dell EMC VxFlex OS Security Configuration Guide .

  • Page 14: Disk Prerequisites

    VxFlex Ready Node deployment overview Note: VxFlex Ready Node servers shipped with a factory-installed ESXi image are configured with root as the username and either the service tag number or Scaleio123 as the password. Connection via a service PC or laptop computer using SSH/RDP Ensure that the computer has a functional network port and an available IP address, subnet, and gateway on the management network.
  • Page 15 VxFlex Ready Node deployment overview Cabling Ensure that you have the correct quantity of cables. Calculate the number of cables needed, according to the following guidelines: For RJ45 NIC ports on your switch, Cat6 6 m Ethernet cables are required, four cables per node. (These cables are included with the server nodes) VxFlex Ready Node Operating System Installation Guide for ESXi...
  • Page 16 VxFlex Ready Node deployment overview VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 17: Configuring The Hardware

    CHAPTER 2 Configuring the hardware This section describes how to configure the hardware, set iDRAC IP addresses, and map the ISO for servers in a VxFlex Ready Node environment. Set up the iDRAC IP address and BIOS........................18 Verify the status of the system hardware and drives.....................20 Log in to the KVM console ............................

  • Page 18: Set Up The Idrac Ip Address And Bios

    - Scaleio123 Note: Dell EMC recommends that you change the iDRAC password as soon as possible, because leaving the default password may create a security risk. During the iDRAC IP and BIOS setup, use the following keyboard operations: Use the arrow keys to navigate in the BIOS screens.
  • Page 19 Configuring the hardware Static IP Address = Static IP address (customer-provided). The static IP address must be accessible by the remote computer that will be used for system setup. Static Gateway = Gateway IP address Static Subnet Mask = Subnet mask IP address From the IPv6 Settings pane, configure the IPv6 parameter values for the iDRAC port.

  • Page 20: Verify The Status Of The System Hardware And Drives

    A table displays information regarding the physical drives, and an option to Blink/Unblink the selected drive. Verify that no drive is in failed state. If any of the drives has failed, refer to the drive FRU procedure in the relevant Dell EMC VxFlex Ready Node Field Replaceable Unit Guide .

  • Page 21: Log In To The Kvm Console

    <iDRAC_IP_address> . From your Internet browser, go to https:// In the DELL Console Login window, type the user name and password, and click Login. From the dashboard, click Launch Virtual Console to start a console session. If a security warning appears, select Accept, and then click Run.

  • Page 22: Updating The Bios, Firmware And Settings

    To perform any updates needed to meet VxFlex Ready Node requirements, use the VxFlex Ready Node Hardware Update Bootable ISO ("Hardware ISO"). The Hardware ISO is based on the Dell OpenManage Deployment Toolkit (DTK). The DTK provides a framework of tools necessary for the configuration of VxFlex Ready Node servers. For VxFlex OS, a custom script has been injected, along with specific qualified BIOS/firmware update packages.
  • Page 23 For each VxFlex Ready Node server, after the updates are finalized, clear the iDRAC job queue using the iDRAC GUI: <iDRAC_IP_address> . From your Internet browser, go to https:// In the DELL Console Login window, type these credentials: username: root <password> password: Click Login.
  • Page 24 Configuring the hardware VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 25: Installing The Esxi Operating System

    CHAPTER 3 Installing the ESXi operating system This section describes the procedures for installing the VMware ESXi operating system on a VxFlex Ready Node server. ESXi system requirements.............................26 Driver support for ESXi nodes..........................26 Rebuild the RAID 1 boot device using the replaced M.2 module................

  • Page 26: Esxi System Requirements

    Ensure that correct drivers are installed in your system. The best source for supported storage drivers is the Dell EMC customized ISO for ESXi 6.7 EP 05. If this cannot be used, consult the VMware support matrix for Dell EMC products on the VMware website.

  • Page 27: Map The Esxi Iso File On A Vxflex Ready Node Server

    To verify the ISO file selection, click Virtual Media and view the ISO selection in the drop down list. Reset the server: In the main DELL System Setup console window, select Power Reset System (warm boot) to display the >...
  • Page 28 Installing the ESXi operating system In the vSphere Web Client, select Storage New Datastore Create New VMFS datastore. > > Select the empty partition for the datastore. Datastore 1 is created on the empty BOSS card. VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 29: Network Architecture And Physical Connectivity

    CHAPTER 4 Network architecture and physical connectivity This section provides networking requirements and connectivity information for VxFlex Ready Node ESXi servers. Networking connectivity architecture and cabling best practice................30 IP addresses for R640 and R740xd servers......................30 IP addresses for R840 servers..........................

  • Page 30: Networking Connectivity Architecture And Cabling Best Practice

    Network architecture and physical connectivity Networking connectivity architecture and cabling best practice The following information describes connectivity architecture, cabling best practice information, and cable connection examples from typical VxFlex OS configurations in ESXi environments in order to help you plan your network. Note: If you are not familiar with VxFlex Ready Node system architecture, refer to the "Architecture"...

  • Page 31: Vxflex Os Data Ip Network For Subnet #1

    Network architecture and physical connectivity Table 5 VxFlex OS management IP network (continued) Item Description The formula to calculate IP address subnet pool or subnet needs is: N*Node_MGMT_IP+N*SVM_MGMT_IP+N*BMC_MGMT_IP + Optional (AMS server IP address) Note: Each pool can belong to a single subnet or to several subnets, as long as the AMS server has routable networking access to the Management IP address.

  • Page 32: Ip Addresses For R840 Servers

    Network architecture and physical connectivity 1024 IP addresses for hosts per data network. IP address pools may be modified to allow additional IP addresses to be added to new nodes. IP addresses for R840 servers Prepare IP addresses in your network for the VxFlex Ready Node servers in ESXi environments, based on the following calculations: Note: In addition to the networking requirements below, ensure that you have prepared the items described in...
  • Page 33 Network architecture and physical connectivity Table 10 VxFlex OS data IP network for Subnet #2 (continued) Item Description Comments IP address pool The pools of IP addresses used for static allocation for the following groups: For clarity, the second for Subnet #2 subnet is referred to as Node_DATA2_IP = internal (interconnect) IP addresses of the VxFlex Ready "Data2"...
  • Page 34 Network architecture and physical connectivity VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 35: Configuring Network Ports On Esxi Hosts

    CHAPTER 5 Configuring network ports on ESXi hosts This section describes how to configure the ports on a VxFlex Ready Node ESXi host. Configure network ports on R640 or R740xd servers.................... 36 Configure network ports on R840 servers......................42 VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 36: Configure Network Ports On R640 Or R740Xd Servers

    Procedure <iDRAC_IP_address> . From your Internet browser, go to http:// In the DELL Console Login window, type the user name and password, and click Login. In the navigation pane, select System Inventory Hardware inventory, and then select the CPU node.
  • Page 37 Configuring network ports on ESXi hosts Figure 1 R640 and R740xd PCI slots, integrated NICs and iDRAC port locations Integrated (iDRAC) NICs iDRAC Integrated (iDRAC) NICs Data cables are connected to two switches for high availability, via the nodes' 10 GbE, 25 GbE, or 100 GbE ports. Management interfaces are connected to a switch on a separate management network using onboard and iDRAC ports.

  • Page 38: Vxflex Ready Node R640 Port Designations - Esxi

    Configuring network ports on ESXi hosts If there are only 2*25GbE onboard ports, the left port is used for both the management and data network, and the right port for is used for data. Note: The application\client network will have to run on those same two ports. If there are only 4*10G onboard ports: The left port is used for management The left port, and the third port from the left are used for VxFlex OS data...

  • Page 39: Vxflex Ready Node R740Xd Port Designations - Esxi

    Configuring network ports on ESXi hosts Table 12 R640 server configuration for 10/25GbE, 2CPU, SFP+/SFP28 (continued) Description iDRAC VxFlex OS VxFlex OS VxFlex OS VxFlex VxFlex OS Not in Use Monitoring Data1 Client Client Management Network Port1 Network Data2 Network Port2 Physical Port iDRAC (remote...

  • Page 40: R740Xd Server Configuration For 10/25Gbe, 12Xnvme, Sfp+/Sfp28

    Configuring network ports on ESXi hosts Table 13 R740xd server configuration for 10/25 GbE, 32xSAS, SFP+/SFP28 (continued) Description iDRAC VxFlex OS VxFlex OS VxFlex OS VxFlex VxFlex OS Not in Use Monitoring Data1 Client Client Management Network Port1 Network Data2 Network Port2 Physical...

  • Page 41: R740Xd Server Configuration For 10Gbe, 3Xgpu (M60)/ 2Xgpu (M10), Sfp

    Configuring network ports on ESXi hosts Table 15 R740xd server configuration for 25GbE, 3xGPU (M60)/ 2xGPU (M10), SFP28 (continued) Description iDRAC Monitoring VxFlex OS Data1/ VxFlex VxFlex OS Not in Use OS Management Data2 Network Physical Switch Mgmt Switch Data Switch 1 Data Switch 2 Note: The above configuration supports only two 25 GbE onboard NICs in three-GPU configuration.

  • Page 42: Configure Network Ports On R840 Servers

    Configuring network ports on ESXi hosts Select the desired vmnic by pressing the Space bar. Click OK to approve the selection. In the Configure Management Network window, scroll to IP Configuration, and press Enter. In the IP Configuration popup window, change the selected option to Set static IP address and network configuration, using the Up/Down arrow keys for navigation and the Space bar for selection.

  • Page 43: Vxflex Ready Node R840 Port Designations - Esxi

    Configuring network ports on ESXi hosts Data cables are connected to two switches for high availability, via the nodes' 25 GbE ports (not supported for integrated NICs). Management interfaces are connected to a switch on a separate management network using onboard and iDRAC ports.

  • Page 44: R840 Server Configuration For 2X25Gbe Rndc, 2Xgpu - Sas Or Nvme

    Configuring network ports on ESXi hosts Table 17 R840 server configuration for 2x10GbE+2GbE rNDC, 2x10/25GbE PCIe slot 3, 2x10/25GbE PCIe slot 6 – SAS or NVME, no GPU (continued) Description iDRAC VxFlex OS VxFlex OS VxFlex OS VxFlex VxFlex OS Not in Use Monitoring Data1...
  • Page 45 Configuring network ports on ESXi hosts Using the Up/Down arrow keys, scroll to the appropriate vmnic for your hardware (the management port vmnic differs per server type: 1U1N, 2U1N Storage-Only, 2U1N Converged, etc.) Select the desired vmnic by pressing the Space bar. Click OK to approve the selection.
  • Page 46 Configuring network ports on ESXi hosts VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 47: Installing The Drivers

    CHAPTER 6 Installing the Drivers The following topics contain information regarding VxFlex OS drivers. Install the VxFlex OS drivers on an ESXi server..................... 48 VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 48: Install The Vxflex Os Drivers On An Esxi Server

    Installing the Drivers Install the VxFlex OS drivers on an ESXi server Dell EMC recommends that you install all applicable VxFlex OS drivers on the ESXi server in preparation for installing the VxFlex OS software. Procedure Download the VxFlex OS driver Zip file from https://support.emc.com/products/42216...
  • Page 49 Installing the Drivers Verify that the correct versions of drivers are running: Get the list of drivers currently installed on the server: esxcli software vib list Get the information for each driver that was updated: esxcli software vib get -n <driver_name> VxFlex Ready Node Operating System Installation Guide for ESXi...
  • Page 50 Installing the Drivers VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 51: Preparing Drives

    CHAPTER 7 Preparing Drives For R640 and R740xd systems, if necessary, prepare the drives so that they can be added to VxFlex OS SDS devices. Verify the disk controller type..........................52 Enable PERCCLI on an ESXi-based system......................52 Create virtual drives with PERCCLI........................

  • Page 52: Verify The Disk Controller Type

    Preparing Drives Verify the disk controller type Verify the controller type installed on a VxFlex Ready Node R640 or R740xd server using the integrated Dell Remote Access Controller (iDRAC) web utility. Before you begin Ensure that you have access to:...

  • Page 53: Create Virtual Drives With Perccli

    Preparing Drives Run the installation command on the server: esxcli software vib install -f -v /tmp/vmware-esx-perccli-7.529.00.vib Before running PERCCLI commands, change your working directory to the utility's binary location: cd /opt/lsi/perccli/ Results PERCCLI can now be used either from the ESXi console or via SSH. Note: PERCCLI commands are run in the following format: ./perccli command...

  • Page 54: Verify The Storage And Disk Controller Status

    Preparing Drives Node contains Caching options Mix of HDD and SSD, where some HDDs or SSDs RFcache are for storage and others provide acceleration Before creating VDs, you must gather some information about the drives and devices configured on each node. Verify the storage and disk controller status Before creating virtual drives (VDs), verify the storage and disk controller status.

  • Page 55: Create Virtual Drives For An Hdd Using Perccli On Esxi Systems

    Preparing Drives Verify that the VDs exist on the node: /opt/lsi/perccli/perccli /c0/vall show Output similar to the following is displayed: If the output confirms that VDs exist on the node, perform the next step to remove them. Otherwise, skip the next step.

  • Page 56: Create Virtual Drives For Ssd With Perccli On Esxi Systems

    Preparing Drives <EID> and <Slt> are the Enclosure ID and Slot ID values, identified in a previous step. where Output similar to the following is displayed: Controller = 0 Status = Success Description = Add VD Succeeded Results The VD was created successfully. Create virtual drives for SSD with PERCCLI on ESXi systems Use PERCCLI to create virtual drives (VDs) for SSDs on a VxFlex Ready Node server.
  • Page 57 Preparing Drives Procedure Log in to the server. Display the physical device (PD) information: /opt/lsi/perccli/perccli /c0/eall/sall show Output similar to the following is displayed: Verify that all the devices have a virtual drive created on them. In the Drive Information output, the device state displayed as "Onln" in the State column shows that the device has a virtual drive created on it.
  • Page 58 Preparing Drives Cache = NRWTD (for SSDs) Cache = RWBD (for HDDs) VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 59: Additional Configurations

    CHAPTER 8 Additional configurations This section describes additional configurations required for the VxFlex Ready Node server installation process. Install OpenManage Enterprise..........................60 Activate the NVIDIA GPU on the server........................ 60 Installing the iDRAC Service Module on an ESXi server..................60 Next steps................................62 VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 60: Install Openmanage Enterprise

    Additional configurations Install OpenManage Enterprise Dell EMC OpenManage Enterprise is a web-based console that simplifies hardware monitoring and firmware maintenance on VxFlex Ready Node servers. It is recommended that you install OpenManage Enterprise. About this task Note: An additional SupportAssist option is available for hardware home call capabilities.

  • Page 61: Install The Ism Using Ssh

    Additional configurations Install the iSM using SSH Install the iDRAC Service Module (iSM) software on the ESXi host via SSH. Procedure Download the Driverpack file for the iSM package from https://support.emc.com/products/42216. Unzip the file to a local directory on the system. Upload the VIB to the ESXi host's datastore.

  • Page 62: Next Steps

    The server is now ready for VxFlex OS deployment. Take note of the following required steps for deploying your system: The Dell EMC Deploy VxFlex OS Guide explains how to deploy VxFlex OS on VxFlex Ready Node servers. Follow the preparation guidelines and deployment procedures relevant to your environment.

  • Page 63: Chapter 9 Reference Material

    CHAPTER 9 Reference material This section contains additional information that may be required for the procedures described in this document. DTK - Hardware Update Bootable ISO........................64 VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 64: Dtk - Hardware Update Bootable Iso

    Update the hardware using remote RACADM You can install and execute the Dell EMC RACADM tool from any management system with access to the iDRAC network. The remote RACADM command set is useful in this situation to mount and execute the Hardware ISO to a large number of VxFlex Ready Node servers.
  • Page 65 Reference material Mount the Hardware ISO to the iDRAC from the remote share, where the following command is all on one line: racadm -r <dracIP> -u root -p <password> remoteimage -c -u <myuser> -p <mypass> -l // <myip>/SIORN/VxFlex-Ready-Node-Hardware-Update-for-Dell_14G_2018_May_A00.iso Where: <dracIP> is the iDRAC IP address <password>...

  • Page 66: Recommended Bios And Firmware Settings

    ISO attempts to apply all firmware updates, but only those updates that are compatible will be installed. Applying settings using RACADM The individual firmware files are also available on the Dell EMC Online Support site, and can easily be installed using the following remote RACADM command: racadm -r <dracIP>...

  • Page 67: Hardware Iso Configuration Settings

    Reference material Note: The default password is Scaleio123. Configuration settings The Hardware ISO runs a script that automatically configures the BIOS and iDRAC settings listed in the table below. Some settings are dependent on the server model. Table 19 Hardware ISO configuration settings Description Setting Value...

  • Page 68: Troubleshooting The Hardware Iso

    Reference material <password> is the password for the server <setting> is the BIOS/iDRAC setting name <value> is the BIOS/iDRAC setting value Note: When setting the BIOS configuration, include this command: racadm -r <dracIP> -u root -p <password> jobqueue create BIOS.Setup.1-1 <value> Troubleshooting the Hardware ISO This section describes troubleshooting procedures for problems you may encounter while using the Hardware ISO.
  • Page 69 Open the log to check the contents for errors: less /bundleapplicationlogs/apply_components.log You can also view the script for the Hardware ISO, which is useful in helping to identify and troubleshoot log entries: less /opt/dell/toolkit/systems/drm_files/apply_bundles.sh VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 70: Additional Resources

    Node system. For additional information regarding the VxFlex Ready Node product, documentation, advisories, downloads, and white papers, visit https://support.emc.com/products/42216. Dell Lifecycle Controller (LC) At the heart of the VxFlex Ready Node servers' embedded management is the iDRAC with Lifecycle Controller (LC) technology.
  • Page 71 Dell EMC OpenManage Deployment Toolkit (DTK) The Dell EMC OpenManage Deployment Toolkit (DTK) includes a set of utilities, sample scripts, and sample configuration files that you can use to deploy and configure Dell systems. You can use the DTK to build script-based and RPM-based installation for deploying large number of systems on a pre- operating system environment in a reliable way, without changing their current deployment processes.
  • Page 72 Reference material VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 73: Chapter 10 Getting Help

    CHAPTER 10 Getting help This section explains the different resources available for getting help for your system. Contacting Dell EMC............................. 74 Secure Remote Services............................74 Recycling or End-of-Life service information......................74 VxFlex Ready Node Operating System Installation Guide for ESXi...

  • Page 74: Contacting Dell Emc

    Dell EMC provides several online and telephone-based support and service options. Availability varies by country and product, and some services may not be available in your area. To contact Dell EMC for sales, technical support, or customer service issues use the steps in this task.

This manual is also suitable for:

Emc vxflex ready node r640Emc vxflex ready node r840Emc vxflex ready node r740xd

Table of Contents