Summary of Contents for IBM System Storage N Series
IBM System Storage N series Gateway Implementation Guide for Native Disk Shelves GC27-2188-03 NA 210-04520_A0...
References in this documentation to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which IBM operates. Any reference to an IBM product, program, or service is not intended to state or imply that only IBM’s product, program, or service may be used.
Trademark IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. A complete and current list of information other IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe on any IBM intellectual property right may be used instead.
IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly.
Attention In this document, the term gateway describes IBM N series storage systems that have been ordered with gateway functionality. Gateways support various types of storage, and they are used with third-party disk storage systems—for example, disk storage systems from IBM, HP®, Hitachi Data Systems®, and EMC®.
N series products are driven by NetApp Data ONTAP software. Some features described in the product software documentation are neither offered nor supported by IBM. Please contact your local IBM representative or reseller for further details. Information about supported features...
This section contains information about where to go for additional information about IBM and IBM products, what to do if you experience a problem with your IBM N series product, and whom to call for service, if it is necessary.
Accessing online For online Technical Support for your IBM N series product, visit the following technical support Web site: www.ibm.com/storage/support/nas/ Hardware service You can receive hardware service through IBM Integrated Technology Services. and support Visit the following Web site for support telephone numbers: www.ibm.com/planetwide/...
Dept. GZW 9000 South Rita Road Tucson, AZ 85744–0001 U.S.A. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.
IBM® N series gateways. Later chapters discuss the requirements and procedures for setting up native disk shelves with a gateway. Note IBM gateway models and filers with gateway functionality are both referred to as gateways. Information The majority of the processes for setting up and managing disk shelves are the provided in this same on all systems running Data ONTAP®.
For information about... See... Disk support, including supported See the information for IBM N series disk speeds, and disk capacity storage systems. Installing the gateway in a rack or On new systems, this task is typically system cabinet performed by the factory.
For information about... See... ◆ Disk management Chapter 6, “Managing a System with Disks and Array LUNs,” on page 55 ◆ Data ONTAP Storage Management Guide Chapter 1: Implementation Overview...
Expanding your virtual storage pool with native disk shelves Combining disk and Starting with Data ONTAP 7.3, the gateway expands its interoperability matrix to array LUN storage include storage for native disk shelves and native disks. The gateway can with the gateway virtualize storage from both third-party storage array vendors and native disk shelves.
Note The preceding illustration shows single-path connections between the gateway controllers and disk shelves. See Appendix B, “Setting up and Managing Multipath Storage,” on page 65 for information about how to set up multipath connections between the gateway controllers and disk shelves. Disk shelves that meet gateway requirements can be installed on new and existing gateways.
Usage scenarios for native disk shelves with gateways This section describes a few ways that customers use native disk shelves with gateways. Expanding storage As an alternative to expanding your storage array, you can add disks shelves to after reaching the gateway when you need additional storage.
“SnapLock Compliance aggregates” on page 22 for more information. Chapter 1: Implementation Overview...
General requirements to use native disk shelves with the gateway Minimum system The following system requirements must be met to support native disk shelves on requirements a gateway: ◆ Data ONTAP 7.3 or higher is required to use native disk shelves ◆...
Where to find the The gateway Interoperability Matrix at http://www.ibm.com/storage/nas/ is most recent updated more frequently than this guide. The gateway Interoperability Matrix is information the final authority about which gateway models and Data ONTAP releases support disk shelves, which switches and storage array models are supported in a particular Data ONTAP release, and so on.
I/O module on the shelves as the equivalent filer models. See supports the appropriate hardware and service guide and Interoperability Matrix on the IBM NAS Support site for more information. Note The gateway requires the software disk ownership scheme, which uses persistent reservations.
Understanding storage provided by native disk shelves Connections and Disks are inserted in disk shelves connected to the gateway or N series storage loops controller. The connection from a storage controller to the disk shelves, which might be daisy-chained, is sometimes called a loop. The loops are described as follows: ◆...
“Supported disk types and disk shelves” on page 10 for details about which disks and disk shelves that the gateway supports. For information about the number of disk shelves and disk types that you can connect to a controller, see the information provided for N series storage systems.
You can use only block checksums for native disk shelves. In contrast, you can use either block checksums or zoned checksums with array LUNs. Chapter 1: Implementation Overview...
Understanding storage provided by native disk shelves...
Planning for Using Disk Shelves with a Gateway About this chapter This chapter provides information to help you plan for using native disk shelves with gateways. Topics in this This chapter contains the following topics: chapter ◆ “Comparing how Data ONTAP functions work with disks and array LUNs”...
Comparing how Data ONTAP functions work with disks and array LUNs Data ONTAP provides a robust variety of features for managing storage, most of which work the same no matter what type of storage your gateway uses. However, when you have a gateway that uses both native disks and array LUNs, you need to think about the differences so that you can set up and manage your “mixed”...
Data ONTAP feature or function Native disk shelves Array LUNs licensing You need only a gateway license. No special license is required to support a specific storage type on a gateway. limits for disks and array LUNs When N series storage system disk limits and gateway array LUN limits differ, the total limit of all the disks plus all array LUNs must be less than or the same as the gateway platform LUN limit.
Data ONTAP feature or function Native disk shelves Array LUNs RAID group size Maximum and default RAID Maximum and default RAID group sizes vary according to the group sizes vary according to the gateway model and the level of version of Data ONTAP RAID group protection provided software.
Data ONTAP feature or function Native disk shelves Array LUNs topology Disk shelves are directly The gateway is connected a connected to the gateway storage array either directly or through a loop-based through a Fibre Channel technology. switched fabric. gateway neighborhood The concept of gateway All gateways in the neighborhood does not apply to...
Considerations when planning storage requirements Before you start setting up your gateways, you need to determine how much storage you need for your organization’s requirements and where you want to locate data—what should go on disks and what should go on array LUNs. You need to know this information to configure your gateway.
Guidelines for creating aggregates Restrictions on Data ONTAP does not support mixing different types of storage in the same mixing storage aggregate because it causes performance degradation. For example, you cannot types in an mix the following storage types in the same aggregate: aggregate ◆...
and volume names that are duplicated, you must change those aggregate and volume names before moving the shelf. See Chapter 5, “Moving a Disk Shelf to a Gateway,” on page 41 for more information. SnapLock SnapLock volumes are write once, read many (WORM) volumes that you create Compliance for data that you want to archive permanently.
Note SnapLock Compliance prevents anyone, including the system administrator, from destroying or altering files, volumes, or aggregates before they reach their expiration date. SnapLock Compliance aggregates cannot be created for array LUNs because government regulations require that the WORM data be protected from alteration.
Considerations when planning for the root volume Root volume Each gateway has a special volume called a root volume. The root volume is defined required for the system to be able to boot and to function properly. The root volume contains system files and configuration information. The root volume can also contain data if you want it to.
Root volumes on In an HA pair, it is highly recommended that the root volume be located on the nodes in an HA pair same type of storage for both nodes—either on a disk shelf for both nodes or on an array LUN for both nodes.
Guidelines for gateway port usage Setting required for All gateway HBAs that are used to access disks or array LUNs must be set to HBAs initiator ports. The factory might configure some HBAs as target ports. Therefore, when you set up your system you need to check the HBA settings and, if necessary, change a target HBA setting to an initiator.
General guidelines Consider redundancy and load balancing when selecting which initiator ports to for determining port use to connect to array LUNs and disk shelves: use redundant port pairs to access assignment storage. For example, on N5200, N5300, N5500, N5600 gateways, the redundant port pairs are as follows: ◆...
Limits on a gateway using both disks and array LUNs How minimum and Minimum and maximum limits that are documented for the gateway are the maximum limits limits for the disks and array LUNs combined. Plan carefully to ensure that your apply combination of disks and array LUNs does not exceed these limits.
Installing a New Gateway with Disks About this chapter This chapter describes the tasks you need to perform to complete setup of a new gateway ordered with disks. If you... See instead... Are adding a disk shelf to an existing Chapter 4, “Adding a New Disk Shelf gateway...
Factory default setup of a gateway with disk shelves Factory cabling of a When you order a stand-alone system, the factory cables it according to your stand-alone system instructions. All internal adapters, such as networking adapters, Fibre Channel adapters, and other adapters, arrive preinstalled in the nodes. Factory cabling of For information about factory cabling of an HA pair and the cabling that you an HA pair...
For this... The factory default is... CompactFlash card Bootloader files and firmware updates, including primary and secondary BIOS images, are installed on the CompactFlash card that is shipped with the system. Disks Disks with the latest firmware are installed. Gateway port settings The gateway ports might or might not be set as initiators.
Installing a gateway with disk shelves Overview of the Because the root volume and Data ONTAP are already installed on a disk for new installation process gateways ordered with disk shelves, software installation is simpler. When you boot the gateway for the first time, Data ONTAP starts the setup script and prompts you to enter basic information about system configuration, network services, network addresses, and protocols.
Booting the new To boot your system for the first time, complete the following steps. gateway with disks for the first time Step Action Check that the disk shelves are set up properly and that the switches are terminated, where applicable. First turn on the power to any switches, then to the disk shelves, and then to any tape backup devices.
Step Action Add any missing licenses by entering the following command for each missing license: license add xxx is the license code for the product. Use the command to specify this gateway as the owner disk assign of array LUNs and additional disks. “Assigning disks and array LUNs to the gateway”...
Adding a New Disk Shelf to a Gateway About this chapter This chapter provides information about how to add a new disk shelf (a disk shelf that has not been used on another system) to an existing gateway. If you... See instead...
General requirements when adding a disk shelf Minimum Data Before you add a disk shelf to your gatewayData ONTAP 7.3 or higher. ONTAP requirement Loop speed If you are adding a disk shelf to an existing gateway, be sure that you understand requirements the characteristics of the disk shelf—including its speed.
Note If you are using the Multipath Storage feature to connect disk shelves to the gateway, you must configure the environment fc-non-array-adapter-list variable before you connect the first disk shelf on a new loop. See Appendix B, “Setting up and Managing Multipath Storage,”...
Overview of adding a new disk shelf Assumptions This section is based on the assumption that the following basic gateway setup has already been completed and tested: ◆ You have completed the basic system setup (setup script). ◆ Data ONTAP software was installed. ◆...
Step Action Details Cable the new disk shelf to the For a stand-alone system, see the hardware gateway. Installation and Setup Overview for your platform. For an HA pair, see the Data ONTAP High Availability Configuration Guide or Data ONTAP Active/Active Configuration Guide.
Step Action Details Assign array LUNs to the gateway “Assigning disks and array LUNs to the gateway” now or later. on page 60 for details about the disk assign command. Configure aggregates on your system. Follow the guidelines in “Restrictions on mixing storage types in an aggregate”...
Moving a Disk Shelf to a Gateway About this chapter This chapter describes how to move a disk shelf from an N series storage system to a gateway. If you... See instead... Are setting up a new gateway with Chapter 3, “Installing a New disks Gateway with...
Planning for moving a disk shelf Types of disk You can move any disk shelf that supports software disk ownership (SANOWN) shelves that you from an N series storage system to a gateway. (See “Supported disk types and can move disk shelves”...
Requirement if the Only one root volume is permitted on a system. A root volume that was N series storage configured for the N series storage system cannot be used on the gateway. system root volume If the root volume for the N series storage system is on the disk shelf that you is on the disk shelf plan to move to the gateway, the requirements are as follows.
Impact on clients of The following table shows the impact on clients of moving a disk shelf. moving a disk shelf For users of this protocol... The impact is... CIFS Shares to the moved data need to be created and the UNC path will likely change.
Requirements if you If you want to preserve the data on a disk shelf for use with the gateway, the want to preserve requirements are as follows: data on the disk ◆ Ensure that the combined total of aggregates and volumes on the disk shelf shelf and on array LUNs does not exceed the limits.
Tasks to perform before disconnecting the shelf Task list The following table shows the tasks to perform before disconnecting the disk shelf from the N series storage system. Stage Task Relevant procedure Check the disks, aggregates, and volumes on the N “Checking the disks, aggregates, and series storage system.
Stage Task Relevant procedure If this is an HA pair and you want to use Multipath “Configuring the gateway environment Storage with it, configure the boot environment variable for Multipath Storage” on variable required for the gateway with Multipath page 71 Storage.
Step Action If... Then... No aggregate or volume names No renaming is necessary. are duplicated. There are duplicate aggregate You need to rename the names. duplicate aggregate name on one of the systems. Go to “Renaming an aggregate” on page 48. There are duplicate volume You need to rename the names.
Renaming a volume To rename a volume on the disk shelf you are moving, complete the following steps. Step Action For Data ONTAP 8.0 7-Mode and 7.x releases, enter the following command: vol rename vol_name new-name vol_name is the name of the volume you want to rename. new-name is the new name of the volume.
Reassigning You need to change ownership of the disks on the shelf to be moved to the ownership of N gateway while the shelf is still attached to the N series storage system. However, series storage you must find out the system name or NVRAM ID of the gateway before you can system disks to a start reassigning the disks on the N series storage system.
Step Action Enter the following command to list the disks that are visible to the N series storage system: disk show -v Result: The output shows the disks, the system that owns the disk, the pool to which the disk is assigned, and the serial number of the disk.
Process overview for physically moving the disk shelf The following table provides an overview of the process for physically moving the shelf and tells you where to find the procedure for how to do each step. Step Action Where to find instructions On the N series storage system, See the appropriate guide for your disk shelf.
Optional configuration after moving the disk shelf Turning on Automatic disk assignment is an optional feature that enables Data ONTAP to automatic disk look for and automatically assign any unassigned disks to same system and pool assignment as all other disks on the same loop. On gateways, automatic disk assignment is available only for disks on the disk shelves connected to it.
Moving a disk shelf that is installed on a gateway You can move a disk shelf that is installed on a gateway to another gateway or to an N series storage system if the destination system supports the disk shelf type. Moving a disk shelf that is installed on a gateway...
Managing a System with Disks and Array LUNs About this chapter This chapter helps you distinguish between data about disks and array LUNs in Data ONTAP command output and to inform you about any differences in managing disks and array LUNs. Topics in this This chapter discusses the following topics: chapter...
Identifying disk and array LUN information in command output Format of disk and Information about native disks and array LUNs is shown in output from some array LUN Data ONTAP commands—for example, in the output from the storage show addressing command.
storage show disk You can use the command to display attribute information storage show disk -T output about all the disks and array LUNs connected to your gateway. When the option is used with the command, the “disk” type is shown. storage show disk (If your output from the command is truncated, try...
DISK SHELF BAY SERIAL VENDOR MODEL REV TYPE ------------------ --------- -------------------- -------- ---------------- ---- ----- a.16 V5Y6GGAA NETAPP X274_HPYTA146F10 NA03 FCAL a.17 V5Y6E1RA NETAPP X274_HPYTA146F10 NA03 FCAL a.18 3KS63VLY00009728WRQU NETAPP X274_S10K7146F10 NA07 FCAL a.19 3HY8P9N6000075033RAG NETAPP X274_SCHT6146F10 NA05 FCAL a.20 V5Y6GWAA NETAPP X274_HPYTA146F10 NA03 FCAL...
The following table describes the columns in the storage show disk -T output. Column Description Disk This is the disk or array LUN “address.” See “Format of disk and array LUN addressing” on page 56. Shelf These columns are relevant only for native disks. ◆...
Assigning disks and array LUNs to the gateway Assigning Automatic disk assignment is enabled for disks by default. If you have disabled ownership of disks, this feature, you must manually assign disk ownership for disks. Automatic disk array LUNs, or both ownership does not apply to array LUNS.
Step Action ◆ pool (cont) Data ONTAP assigns pools automatically for disks. For array LUNs, the requirements for the parameter are as follows: ❖ If you are not going to be deploying the SyncMirror feature, you do not need to enter the pool parameter ( ).
Step Action ◆ -c block zoned (cont) Checksum type can be specified only for array LUNs. The checksum type can be either block or zoned. Block is the default value. Note If you use the parameter, Data ONTAP ignores any checksum type specified.
Configuring Gateway Ports as Initiators Why you need to The factory might configure some gateway HBAs as target ports. However, most check the port gateways do not have targets. Therefore, before you start setup, you need to settings ensure that the gateway HBAs that you are using to access both storage array LUNs and disks are configured as initiators.
Configuring Gateway Ports as Initiators...
Setting up and Managing Multipath Storage About this appendix This appendix provides information specific to the gateway about how to set up and manage Multipath Storage for disk shelves connected to a gateway HA pair. Use the Data ONTAP High Availability Configuration Guide or Data ONTAP Active/Active Configuration Guide for information about cabling and configuration for Multipath Storage that pertains to both N series storage systems and gateways.
Description of Multipath Storage Multipath Storage The optional Multipath Storage feature for HA pairs provides two paths from described each controller to every disk shelf. Setting up Multipath Storage gateways requires configuring an environment variable and adding cables. (See “Setup overview—Multipath Storage on an HA pair”...
Gateway specific requirements for Multipath Storage System Multipath Storage is supported on all gateways that support native disk shelves. requirements See the gateway Interoperability Matrix for a list of the gateways supported. HA pair type Multipath Storage is available for the following types of gateway HA pairs: requirements ◆...
General The following table summarizes the general requirements for the gateway with requirements Multipath Storage. For this... The requirement is... ◆ Gateway port requirements Two Fibre Channel ports for each loop ◆ Enough onboard Fibre Channel ports or HBAs on each node to accommodate the extra cables required for Multipath Storage.
Setup overview—Multipath Storage on an HA pair The following table summarizes the high-level tasks necessary to use Multipath Storage with a gateway with disk shelves. Perform the tasks in the order shown in the table. Step Action Location of detailed information Prerequisites to setting up Multipath Storage Install your HA pair and ensure that it is fully operational Data ONTAP High Availability...
Step Action Location of detailed information Connect the additional cables necessary for redundant Data ONTAP High Availability connections. Configuration Guide or Data ONTAP Active/Active Configuration Guide Configure Data ONTAP to add the new Multipath Storage. Data ONTAP High Availability Configuration Guide or Data ONTAP Active/Active Configuration Guide Completing your setup...
Configuring the gateway environment variable for Multipath Storage When you need to The following table summarizes when you need to set the gateway environment set the environment variable for Multipath Storage. variable Attention If you need to set the environment variable for Multipath Storage, be sure to set the variable on each node before you connect the new disk shelf to it.
Step Action Verify that the FC ports on both vs1 and vs2 are set as initiators. See Appendix A, “Configuring Gateway Ports as Initiators,” on page 63 for instructions. To set the environment variable on vs2 On vs1, enter the following command to force vs1 to take over vs2: cf takeover On vs2, interrupt the boot process by pressing Ctrl-C when you see the following message on the console:...
Step Action On vs2, enter the following command: setenv fc-non-array-adapter-list “adapter,adapter” For example, if you are using gateway initiator ports 0b and 0d to connect to the disk shelf, you would enter the command as follows: setenv fc-non-array-adapter-list “0b,0d” The following message appears: *** Variable(s) modified but NOT saved until the OS is booted *** The ports you specified are not saved until after you reboot your...
Step Action On vs1, enter the following command to start giveback to vs2, then wait for vs2 to boot fully: cf giveback To set the environment variable on vs1 On vs2, enter the following command to force vs2 to take over vs1: cf takeover Repeat the same steps you followed for setting the environment variable for vs2, but this time for vs1.
Troubleshooting Configurations with Disks About this appendix This appendix provides information to help you troubleshoot gateway configurations that use native disk shelves. Topics in this This appendix contains the following topics: appendix ◆ “Common problems” on page 76 ◆ “Error messages”...
Common problems The following table shows how to resolve some common problems with a gateway that uses native disk shelves. Problem Explanation and solution You are not aware that Data If you do not want the gateway to take ownership of the disks immediately, ONTAP automatically assigns new disable automatic disk assignment disks to a system by default.
Problem Explanation and solution Disk shelf IDs are duplicated. Each Fibre Channel and ATA disk shelf in a loop must have a unique ID between 1 and 6. The behavior when disk shelf IDs are duplicated depends on how many disk shelves are in the loop.
Error messages This section includes some error messages for problems commonly seen when users new to native disk shelves on gateways set up their systems. This section is not meant to describe all possible reasons why a particular error message is generated.
Message Explanation This error message is generated when there is Tue Jan 8 18:54:59 GMT [fci.device.invalidate.soft.address:error]: a disk shelf ID conflict. Fibre Channel adapter 0c is invalidating disk See the guide for your disk shelf for drive 0c.14 (0x0300000e) which appears to have taken a soft address.
Reinstalling the system Default selection of If technical support advises you to completely reinstall your system because of a the root volume problem, you need to follow the appropriate procedure so that the root volume is location installed where you want it. When no aggregates or volumes are on the native disk shelves attached to the gateway, Data ONTAP is optimized to select a disk for the root volume.
Step Action Boot the gateway and interrupt the boot process by pressing Ctrl-C when you see the following message on the console: Press Ctrl-C for Boot Menu Create the root volume by selecting the following menu item: Clear configuration and initialize root volume Enter when prompted as to whether you want to install a new file system.
Step Action Enter the following command to see the disks on the disk shelf so that you can decide which disk you want to use for the root volume. disk show -v Result: A list of all disks and array LUNs that are visible to the gateway is displayed.
Step Action Answer the prompts in the setup program, either through the command line or the Web interface, using the information that you recorded in the setup parameters worksheet in the Data ONTAP Software Setup Guide. After the setup script is complete, do the following: ◆...
Index system firmware updates 31 adding a disk shelf 35, 38 aggregates checking names of 47 cabling of a new system creating HA pair 30 guidelines for 21 stand-alone 30 information sources 23 checksum type layout considerations 44 assigning to array LUNs 62 renaming 48 block 12 resolving duplicate names 45, 46, 48...
changing 46, 50 reenabling 53 scheme defined 10 turning it off 49 type supported for array LUNs 16 what happens if enabled 34, 76 type supported for disk shelves 16 disks disk reassign command 51 assigning ownership 60 disk sanitization changing ownership of 46, 50 with array LUNs, not supported 16 checking names of 47...
advantages of 66 completing setup for 53 MetroCluster, not supported 8, 17 connection types 66 models supporting disk shelves 8 described 66 moving a disk shelf 41 for path redundancy 11, 17, 66 Data ONTAP version required 42 required step for the gateway 38 from a gateway 54 root volume location recommendation 25 impact on clients 44...
to gateway 41 RAID0, use by gateways 12, 17 planning for 15 RAID4, described 12 RAID types supported for 12 RAID-DP, described 12, 17 understanding storage provided by 11 reassigning disk ownership 50 ways of using with gateways 6 reinstalling the system 80 which are supported 10 root volume native disks, defined 2...
renaming 49 resolving duplicate names 46, 49 target ports, changing to initiators 63 root volume troubleshooting configuring 81, 82 automatic disk assignment 76 default location 30 common problems 76 defined 24 not all disks are visible 76 location of 18 when disks are on gateway 75 options for location of 24 volumes...
NA 210-04520_A0, Printed in USA GC27-2188-03...