NetApp FAS9500 Manual
  1. Manuals
  2. Brands
  3. NetApp Manuals
  4. Storage
  5. FAS9500
  6. Manual
NetApp FAS9500 Manual

NetApp FAS9500 Manual

Hide thumbs Also See for FAS9500:
Table of Contents

Advertisement

Quick Links

Download this manual
Maintain
ONTAP Systems
NetApp
July 19, 2022
This PDF was generated from https://docs.netapp.com/us-en/ontap-
systems/fas9500/add_io_module.html on July 19, 2022. Always check docs.netapp.com for the latest.

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the FAS9500 and is the answer not in the manual?

Questions and answers

Related Manuals for NetApp FAS9500

Summary of Contents for NetApp FAS9500

  • Page 1 Maintain ONTAP Systems NetApp July 19, 2022 This PDF was generated from https://docs.netapp.com/us-en/ontap- systems/fas9500/add_io_module.html on July 19, 2022. Always check docs.netapp.com for the latest.

  • Page 2: Table Of Contents

    FAS9500.........

  • Page 3: Maintain

    Maintain Add an I/O module - FAS9500 You can add an I/O module to your system by either replacing a NIC or storage adapter with a new one in a fully-populated system, or by adding a new NIC or storage adapter into an empty chassis slot in your system.
  • Page 4 6. Reboot the node from the LOADER prompt: bye 7. Give back the node from the partner node. storage failover giveback -ofnode target_node_name 8. Enable automatic giveback if it was disabled: storage failover modify -node local -auto -giveback true 9. If you are using slots 3 and/or 7 for networking, use the storage port modify -node <node name>...
  • Page 5 The I/O module disengages from the chassis and moves about 1/2 inch out of the I/O slot. c. Remove the I/O module from the chassis by pulling on the pull tabs on the sides of the module face. Make sure that you keep track of which slot the I/O module was in. Animation - Replacing an I/O module Lettered and numbered I/O cam latch I/O cam latch completely unlocked...

  • Page 6: Boot Media

    ◦ The impaired node is the node on which you are performing maintenance. ◦ The healthy node is the HA partner of the impaired node. Pre-shutdown checks for onboard encryption keys - FAS9500 Prior to shutting down the impaired controller and checking the status of the onboard encryption keys, you must check the status of the impaired controller, disable automatic giveback, and check the version of ONTAP that is running.
  • Page 7 NVE, proceed to shut down the controller. ONTAP 9.6 and later Before shutting down the impaired controller, you need to verify whether the system has either NetApp Volume Encryption (NVE) or NetApp Storage Encryption (NSE) enabled. If so, you need to verify the configuration.
  • Page 8 Restore the external key management authentication keys to all nodes in the cluster: security key-manager external restore If the command fails, contact NetApp Support. mysupport.netapp.com b. Verify that the column equals for all authentication keys:...
  • Page 9 Key Manager external Restored yes: a. Enter the onboard security key-manager sync command: security key-manager external sync If the command fails, contact NetApp Support. mysupport.netapp.com b. Verify that the column equals for all authentication keys: Restored security key- manager key-query c.
  • Page 10 About this task • If you are using NetApp Storage Encryption, you must have reset the MSID using the instructions in the “Returning SEDs to unprotected mode” section of the ONTAP 9 NetApp Encryption Power Guide.
  • Page 11 Ctrl-C, and then respond y. Remove the controller, replace the boot media, and transfer the boot image - FAS9500 You must remove and open the controller module, locate and replace the boot media in the controller, and then transfer the image to the replacement boot media.
  • Page 12 Cam handle release button Cam handle 4. Rotate the cam handle so that it completely disengages the controller module from the chassis, and then slide the controller module out of the chassis. Make sure that you support the bottom of the controller module as you slide it out of the chassis. 5.
  • Page 13 Controller module cover locking button Step 2: Replace the boot media You must locate the boot media in the controller and follow the directions to replace it. Steps 1. Lift the black air duct at the back of the controller module and then locate the boot media using the following illustration or the FRU map on the controller module: Animation - Replace boot media Press release tab...
  • Page 14 • A copy of the same image version of ONTAP as what the impaired controller was running. You can download the appropriate image from the Downloads section on the NetApp Support Site ◦ If NVE is enabled, download the image with NetApp Volume Encryption, as indicated in the download button.
  • Page 15 ▪ bootarg.init.switchless_cluster.enable b. If External Key Manager is enabled, check the bootarg values, listed in the ASUP output: kenv ▪ bootarg.storageencryption.support <value> ▪ bootarg.keymanager.support <value> ▪ kmip.init.interface <value> ▪ kmip.init.ipaddr <value> ▪ kmip.init.netmask <value> ▪ kmip.init.gateway <value> c. If Onboard Key Manager is enabled, check the bootarg values, listed in the ASUP output: kenv ▪...
  • Page 16 The changes will be implemented when the system is booted. Boot the recovery image - FAS9500 You must boot the ONTAP image from the USB drive, restore the file system, and verify the environmental variables. 1. From the LOADER prompt, boot the recovery image from the USB flash drive: boot_recovery The image is downloaded from the USB flash drive.
  • Page 17 If your system has… Then… No network connection and is in a a. Press when prompted to restore the backup configuration. MetroCluster IP configuration b. Reboot the system when prompted by the system. c. Wait for the iSCSI storage connections to connect. You can proceed after you see the following messages: date-and-time [node- name:iscsi.session.stateChanged:notice]:...
  • Page 18 -node local command. -auto-giveback true Post boot media replacement steps for OKM, NSE, and NVE - FAS9500 Once environment variables are checked, you must complete steps specific to restore Onboard Key Manager (OKM), NetApp Storage Encryption (NSE) and NetApp Volume Encryption (NVE).
  • Page 19 If the console displays… Then… The LOADER prompt Boot the node to the boot menu: boot_ontap menu Waiting for giveback…. a. Enter at the prompt Ctrl-C b. At the message: Do you wish to halt this node rather than wait [y/n]? , enter: c.
  • Page 20 command. -only-cfo-aggregates true ◦ If the command fails because of a failed disk, physically disengage the failed disk, but leave the disk in the slot until a replacement is received. ◦ If the command fails because of an open CIFS session, check with the customer how to close out CIFS sessions.
  • Page 21 2. Use the boot_ontap command at the LOADER prompt to boot the node. 3. Check the console output: If the console displays… Then… The login prompt Go to step 7. Waiting for giveback… a. Log into the partner node. b. Confirm the target node is ready for giveback with the storage command.

  • Page 22: Hot-Swap A Caching Module - Fas9500

    -node local command. -auto-giveback true Return the failed part to NetApp - FAS9500 Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.
  • Page 23 The following command prepares slot 6-1 on node1 for removal, and displays a slot_number message that it is safe to remove: ::> system controller slot module remove -node node1 -slot 6-1 Warning: SSD module in slot 6-1 of the node node1 will be powered off for removal.

  • Page 24: Chassis

    If you replace the caching module with a caching module from a different vendor, the new vendor name is displayed in the command output. 9. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return &...
  • Page 25 • This procedure is disruptive. For a two-node cluster, you will have a complete service outage and a partial outage in a multi-node cluster. Shutdown the impaired controller - FAS9500 You must shut down the controller or controller in the chassis prior to moving them to the new chassis.
  • Page 26 -node second_node_name -ignore-quorum-warnings true -skip-lif-migration-before-shutdown true Answer when prompted. Move and replace hardware - FAS9500 To replace the chassis, you must remove the components from the old chassis and install them in the replacement chassis. Step 1: Remove the power supplies Removing the power supplies when replacing a chassis involves turning off, disconnecting, and then removing the power supply from the old chassis.
  • Page 27 Locking button 4. Repeat the preceding steps for any remaining power supplies. Step 2: Remove the fans To remove the fan modules when replacing the chassis, you must perform a specific sequence of tasks. 1. If you are not already grounded, properly ground yourself. 2.
  • Page 28 Terra cotta release button Slide fan in/out of chassis 4. Set the fan module aside. 5. Repeat the preceding steps for any remaining fan modules. Step 3: Remove the controller module To replace the chassis, you must remove the controller module or modules from the old chassis.
  • Page 29 Cam handle release button Cam handle 4. Rotate the cam handle so that it completely disengages the controller module from the chassis, and then slide the controller module out of the chassis. Make sure that you support the bottom of the controller module as you slide it out of the chassis. 5.
  • Page 30 b. Rotate the cam latch down until it is in a horizontal position. The I/O module disengages from the chassis and moves about 1/2 inch out of the I/O slot. c. Remove the I/O module from the chassis by pulling on the pull tabs on the sides of the module face. Make sure that you keep track of which slot the I/O module was in.
  • Page 31 DCPM module terra cotta locking button 3. Set the DCPM module aside in a safe place and repeat this step for the remaining DCPM module. Step 6: Replace a chassis from within the equipment rack or system cabinet You must remove the existing chassis from the equipment rack or system cabinet before you can install the replacement chassis.
  • Page 32 Eject the module. Slide out of chassis. 1. Locate the USB LED module on the front of the old chassis, directly under the power supply bays. 2. Press the black locking button on the right side of the module to release the module from the chassis, and then slide it out of the old chassis.
  • Page 33 3. Repeat these steps for the remaining fan modules. 4. Align the bezel with the ball studs, and then gently push the bezel onto the ball studs. Step 10: Install I/O modules To install I/O modules, including the NVRAM/FlashCache modules from the old chassis, follow the specific sequence of steps.
  • Page 34 From the boot menu, select the option for Maintenance mode. Restore and verify the configuration - FAS9500 To complete the chassis replacement, you must complete specific tasks. Step 1: Verify and set the HA state of the chassis You must verify the HA state of the chassis, and, if necessary, update the state to match your system configuration.
  • Page 35 4. If you have not already done so, recable the rest of your system. Step 2: Run system-level diagnostics After installing a new chassis, you should run interconnect diagnostics. Before you begin Your system must be at the LOADER prompt to start System Level Diagnostics. All commands in the diagnostic procedures are issued from the node where the component is being replaced.
  • Page 36 If the system-level diagnostics tests… Then… Were completed without any failures a. Clear the status logs: sldiag device clearstatus b. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present.

  • Page 37: Controller Module

    Rerun the system-level diagnostics test. Step 3: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.
  • Page 38 About this task • If you are using NetApp Storage Encryption, you must have reset the MSID using the instructions in the “Returning SEDs to unprotected mode” section of the ONTAP 9 NetApp Encryption Power Guide.
  • Page 39 When the impaired controller shows Waiting for giveback…, press Ctrl-C, and then respond y. Replace the controller module hardware - FAS9500 To replace the controller module hardware, you must remove the impaired node, move FRU components to the replacement controller module, install the replacement controller module in the chassis, and then boot the system to Maintenance mode.
  • Page 40 Cam handle release button Cam handle 4. Rotate the cam handle so that it completely disengages the controller module from the chassis, and then slide the controller module out of the chassis. Make sure that you support the bottom of the controller module as you slide it out of the chassis. 5.
  • Page 41 Controller module cover locking button Step 2: Move the boot media You must locate the boot media and follow the directions to remove it from the old controller and insert it in the new controller. 1. Locate the boot media using the following illustration or the FRU map on the controller module: Press release tab Boot media 2.
  • Page 42 Step 3: Move the system DIMMs To move the DIMMs, locate and move them from the old controller into the replacement controller and follow the specific sequence of steps. 1. If you are not already grounded, properly ground yourself. 2. Locate the DIMMs on your controller module. 3.
  • Page 43 Visually inspect the DIMM to verify that it is evenly aligned and fully inserted into the slot. 8. Push carefully, but firmly, on the top edge of the DIMM until the ejector tabs snap into place over the notches at the ends of the DIMM. 9.
  • Page 44 Ctrl-C e. Select the option to boot to LOADER. Restore and verify the system configuration - FAS9500 After completing the hardware replacement, you verify the low-level system configuration of the replacement controller, reconfigure system settings as necessary, and then run system-level diagnostics.
  • Page 45 3. At the LOADER prompt, check the date and time on the replacement node: show date The date and time are given in GMT. 4. If necessary, set the date in GMT on the replacement node: set date mm/dd/yyyy 5. If necessary, set the time in GMT on the replacement node: set time hh:mm:ss 6.
  • Page 46 The controller module devices and ports displayed can be any one or more of the following: ◦ bootmedia is the system booting device. ◦ cna is a Converged Network Adapter or interface not connected to a network or storage device. ◦...
  • Page 47 If you want to run diagnostic Then… tests on… Multiple components at the same a. Review the enabled and disabled devices in the output from the time preceding procedure and determine which ones you want to run concurrently. b. List the individual tests for the device: sldiag device show -dev dev_name c.
  • Page 48 If the system-level diagnostics Then… tests… Were completed without any a. Clear the status logs: sldiag device clearstatus failures b. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present. c.
  • Page 49 After you issue the command, wait until the system stops at the LOADER prompt. g. Rerun the system-level diagnostic test. Recable the system - FAS9500 Continue the replacement procedure by recabling the storage and network conigurations. Step 1: Recable the system After running diagnostics, you must recable the controller module’s storage and network connections.
  • Page 50 Step 2: Reassign disks If the storage system is in an HA pair, the system ID of the new controller module is automatically assigned to the disks when the giveback occurs at the end of the procedure. You must confirm the system ID change when you boot the replacement node and then verify that the change was implemented.
  • Page 51 -ofnode replacement_node_name The replacement node takes back its storage and completes booting. If you are prompted to override the system ID due to a system ID mismatch, you should enter y. If the giveback is vetoed, you can consider overriding the vetoes. For more information, see the Manual giveback commands topic to override the veto.
  • Page 52 Complete system restoration - FAS9500 To complete the replacement procedure and restore your system to full operation, you must recable the storage, restore the NetApp Storage Encryption configuration (if necessary), and install licenses for the new controller. You must complete a series of tasks before restoring your system to full operation.
  • Page 53 If the node is in a MetroCluster configuration and all nodes at a site have been replaced, license keys must be installed on the replacement node or nodes prior to switchback. 1. If you need new license keys, obtain replacement license keys on the NetApp Support Site in the My Support section under Software licenses.

  • Page 54: Replace A Dimm - Fas9500

    About this task • If you are using NetApp Storage Encryption, you must have reset the MSID using the instructions in the “Returning SEDs to unprotected mode” section of the ONTAP 9 NetApp Encryption Power Guide.
  • Page 55 3. Take the impaired controller to the LOADER prompt: If the impaired controller is Then… displaying… The LOADER prompt Go to Remove controller module. Waiting for giveback… Press Ctrl-C, and then respond when prompted. System prompt or password Take over or halt the impaired controller from the healthy controller: prompt (enter system password) storage failover takeover -ofnode impaired_node_name...
  • Page 56 Cam handle release button Cam handle 4. Rotate the cam handle so that it completely disengages the controller module from the chassis, and then slide the controller module out of the chassis. Make sure that you support the bottom of the controller module as you slide it out of the chassis. 5.
  • Page 57 3. Eject the DIMM from its slot by slowly pushing apart the two DIMM ejector tabs on either side of the DIMM, and then slide the DIMM out of the slot. Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM circuit board.
  • Page 58 4. Remove the replacement DIMM from the antistatic shipping bag, hold the DIMM by the corners, and align it to the slot. The notch among the pins on the DIMM should line up with the tab in the socket. 5. Make sure that the DIMM ejector tabs on the connector are in the open position, and then insert the DIMM squarely into the slot.
  • Page 59 Cam handle release button Cam handle Do not completely insert the controller module in the chassis until instructed to do so. 4. Cable the management and console ports only, so that you can access the system to perform the tasks in the following sections.
  • Page 60 e. Select the option to boot to Maintenance mode from the displayed menu. Step 5: Run system-level diagnostics After installing a new DIMM, you should run diagnostics. Your system must be at the LOADER prompt to start System Level Diagnostics. All commands in the diagnostic procedures are issued from the node where the component is being replaced.
  • Page 61 If the system-level diagnostics Then… tests… Were completed without any a. Clear the status logs: sldiag device clearstatus failures b. Verify that the log was cleared: sldiag device status The following default response is displayed: SLDIAG: No log messages are present. c.

  • Page 62: Replace The Destage Control Power Module Containing The Nvram11 Battery - Fas9500

    LOADER prompt. f. Rerun the system-level diagnostic test. Step 6: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.
  • Page 63 You must dispose of batteries according to the local regulations regarding battery recycling or disposal. If you cannot properly dispose of batteries, you must return the batteries to NetApp, as described in the RMA instructions that are shipped with the kit.

  • Page 64: Swap Out A Fan - Fas9500

    Safety Information and Regulatory Notices Step 3: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information. Swap out a fan - FAS9500 To swap out a fan module without interrupting service, you must perform a specific sequence of tasks.

  • Page 65: Replace An I/O Module - Fas9500

    7. Align the bezel with the ball studs, and then gently push the bezel onto the ball studs. 8. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return &...
  • Page 66 If the impaired controller is Then… displaying… Press Ctrl-C, and then respond when prompted. Waiting for giveback… System prompt or password Take over or halt the impaired controller from the healthy controller: prompt (enter system password) storage failover takeover -ofnode impaired_node_name When the impaired controller shows Waiting for giveback…, press Ctrl-C, and then respond y.

  • Page 67: Replace An Led Usb Module - Fas9500

    -node local -auto -giveback true Step 4: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.

  • Page 68: Replace The Nvram Module And/Or Nvram Dimms - Fas9500

    There is an audible click when the module is secure and connected to the midplane. Step 2: Return the failed component 1. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return &...
  • Page 69 Before you begin • All disk shelves must be working properly. • If your system is in an HA pair, the partner node must be able to take over the node associated with the NVRAM module that is being replaced. •...
  • Page 70 If the impaired controller is Then… displaying… System prompt or password Take over or halt the impaired controller from the healthy controller: prompt (enter system password) storage failover takeover -ofnode impaired_node_name When the impaired controller shows Waiting for giveback…, press Ctrl-C, and then respond y.
  • Page 71 3. Set the NVRAM module on a stable surface and remove the cover from the NVRAM module by pushing down on the blue locking button on the cover, and then, while holding down the blue button, slide the lid off the NVRAM module.
  • Page 72 Lettered and numbered I/O cam latch I/O latch completely unlocked 3. Set the NVRAM module on a stable surface and remove the cover from the NVRAM module by pushing down on the blue locking button on the cover, and then, while holding down the blue button, slide the lid off the NVRAM module.
  • Page 73 socket until the locking tabs lock in place. 6. Close the cover on the module. 7. Install the NVRAM module into the chassis: a. Align the module with the edges of the chassis opening in slot 6. b. Gently slide the module into the slot until the lettered and numbered I/O cam latch begins to engage with the I/O cam pin, and then push the I/O cam latch all the way up to lock the module in place.
  • Page 74 then, from the healthy node, verify that the new partner system ID has been automatically assigned: storage failover show In the command output, you should see a message that the system ID has changed on the impaired node, showing the correct old and new IDs. In the following example, node2 has undergone replacement and has a new system ID of 151759706.
  • Page 75 partner message. 6. Verify that the disks were assigned correctly: storage disk show -ownership The disks belonging to the replacement node should show the new system ID. In the following example, the disks owned by node1 now show the new system ID, 1873775277: node1>...

  • Page 76: Swap Out A Power Supply - Fas9500

    Restore external key management encryption keys ◦ Step 8: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.
  • Page 77 It is a best practice to replace the power supply within two minutes of removing it from the chassis. The system continues to function, but ONTAP sends messages to the console about the degraded power supply until the power supply is replaced. •...

  • Page 78: Replace The Real-Time Clock Battery - Fas9500

    The green power LED lights when the PSU is fully inserted into the chassis and the amber attention LED flashes initially, but turns off after a few moments. 9. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return &...
  • Page 79 1. If AutoSupport is enabled, suppress automatic case creation by invoking an AutoSupport message: system node autosupport invoke -node * -type all -message MAINT=number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours: cluster1:*> system node autosupport invoke -node * -type all -message MAINT=2h 2.
  • Page 80 Cam handle release button Cam handle 4. Rotate the cam handle so that it completely disengages the controller module from the chassis, and then slide the controller module out of the chassis. Make sure that you support the bottom of the controller module as you slide it out of the chassis. 5.
  • Page 81 Controller module cover locking button Step 3: Replace the RTC battery To replace the RTC battery, you must locate the failed battery in the controller module, remove it from the holder, and then install the replacement battery in the holder. 1.
  • Page 82 8. Reinstall the controller module cover. Step 4: Reinstall the controller module and set time/date After you replace the RTC battery, you must reinstall the controller module. If the RTC battery has been left out of the controller module for more than 10 minutes, you may have to reset the time and date. 1.
  • Page 83 Step 5: Return the failed part to NetApp Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return & Replacements page for further information.
  • Page 84 NetApp. The use or purchase of this product does not convey a license under any patent rights, trademark rights, or any other intellectual property rights of NetApp.

This manual is also suitable for:

Fas9500 systems

Table of Contents

Save PDF