Page 2
Contractor/manufacturer is SGI, 1140 E. Arques Avenue, Sunnyvale, CA 94085. TRADEMARKS AND ATTRIBUTIONS SGI and the SGI logoare registered trademarks of Silicon Graphics International Corp. in the United States and/or other countries worldwide. Windows is a registered trademark of Microsoft Corporation in the United States and/or other countries.
• Remove drives to minimize weight. • Do not try to lift the enclosure by yourself. • Do not lift the InfiniteStorage 6120 by the handles on the power cooling module (PCM); they are not designed to support the weight of the enclosure.
Page 4
• In order to comply with applicable safety, emission, and thermal requirements, the top covers should remain closed while running. • The InfiniteStorage 6120 system must only be operated from a power supply input voltage range of 200 VAC to 240 VAC.
P r e f a c e WARNING: Operation of the InfiniteStorage 6120 with ANY modules missing will disrupt the airflow and the drives will not receive sufficient cooling. It is ESSENTIAL that all apertures are filled before operating the unit.
Related Publications You should also see the following document: SGI InfiniteStorage 6120 RAID CLUI Command Reference (007-5561-xxx) You can find this document on the SGI Technical Publications Library (http://docs.sgi.com). Product Support SGI provides a comprehensive product support and maintenance program for its products. SGI also offers services to implement and integrate Linux applications in your environment.
This section describes the features of the SGI InfiniteStorage 6120 and its hardware. 1.1.1 A SAN Solution The InfiniteStorage 6120 is a compact network storage system. It combines a controller chassis and disk enclosure chassis into a single self-contained enclosure. The InfiniteStorage 6120 plugs seamlessly into existing network environments, thereby protecting and upgrading investments made in legacy storage and networking products to substantially improve their performance, availability and manageability.
Page 14
The unit supports as many hot spares as desired and they can be allocated as global hot spares or assigned to a specific RAID set. • Comprehensive, centralized management capability The InfiniteStorage 6120 provides a wide range of management capabilities via a secured command line user interface (CLUI): configuration management, performance management, and firmware update management.
(Figure 1) controllers provide system management and host connectivity interfaces. The InfiniteStorage 6120 design concept is based on a subsystem together with a set of plug-in modules and (as supplied) comprises: • Enclosure chassis with front panel drive status indicator •...
(4) EIA units of rack space. A mid-plane separates the front and back of the chassis and provides the interconnect system between the power cooling modules, controllers, and the baseboard. Figure 2. InfiniteStorage 6120 Top View 30 Drive Bays Front of...
The Ethernet port provides remote monitoring and configuration capabilities. The LINK LED is off when there is no Ethernet link. The Firmware Status LED blinks green when the InfiniteStorage 6120 firmware is loading. It stays solid green when the InfiniteStorage 6120 is ready to be accessed.
Power Cord Connector Power Switch The InfiniteStorage 6120 must always be operated with two PCM installed. Module replacement should only take a few minutes to perform but must be completed with 10 minutes from removal of the failed module. Four (4) LEDs mounted on the PCM indicate the status of the module and the fans Figure 7 provides a description of the color and status of the LEDs.
• Positive spring loading of the drive/baseplane connector • Drive Status LED incorporated in handle assembly NOTE : The InfiniteStorage 6120 design allows for drive bays to be left empty without the need for fitting dummy drive modules. The InfiniteStorage 6120 supports a SATA interposer card which allows simultaneous access to the SATA HDD from both controllers installed in the enclosure.
The InfiniteStorage 6120 System Hardware 1.2.5 Drive Expander Module (DEM) Card The InfiniteStorage 6120 contains eight (8) top-loadable, hot-swappable DEMs . The (Figure 9) DEMs provide the SAS connectivity between the controllers and the HDDs located with the enclosure. The DEMs are organized into four module pairs, with each module pair controlling a bank of 15 drives.
1.2.6 LED Indicators The InfiniteStorage 6120 has both FRU and status LEDs to indicate the state of various components within the enclosure. Each FRU has a visible blue identity LED. Each FRU, except the drive module, has a visible amber LED which indicates a fault.
The InfiniteStorage 6120 System Hardware 1.2.6.2 Internal Indicators For some components, the failure LED is internal to the enclosure and visible only when the cover is open. The various internal indicators are listed in Figure Figure 13. Internal LED Indicators...
Rackmount the InfiniteStorage 6120 (and expansion enclosure). See Appendix A for physical dimensions and weight of the InfiniteStorage 6120.) Connect the InfiniteStorage 6120 to your Fibre Channel (FC) switch, host computer(s), and expansion enclosure. Power up the system. Configure the storage array (create storage pools, virtual disks, and spare pools) via RS-232 interface or SSH.
Setting Up the InfiniteStorage 6120 Setting Up the InfiniteStorage 6120 This section details the installation of the hardware components of the InfiniteStorage 6120 system. If your controller and disk enclosure configuration is delivered already installed in the rack, it must be removed from the shipping pallet using a minimum of 4 people.
2.2.2 Rack-Mounting the InfiniteStorage 6120 Chassis The InfiniteStorage 6120 is designed to fit within a 4U rack space. Follow these steps to mount the system in your rack: Using eight (8) 10-32 × 0.188" Phillips panhead screws for each slider, attach the four (4) inner...
Page 28
Figure 16. Make sure you leave enough space for the unit—bottom of screw plate aligns to bottom of InfiniteStorage 6120 chassis. At the front, use one (1) screw plate, one (1) shelf locking bracket (installed from behind), and six (6) #10 screws.
Page 29
Setting Up the InfiniteStorage 6120 Using two (2) 10-32 ×0.50" (100d) Phillips flathead screws for each CMA, attach the CMA to the CMA brackets . If the depth of your rack is 25.5 inches (647 mm) or less, attach (Figure 17) the CMA directly to the rack, above the rail kits.
2.2.3.1 Host Connections Each InfiniteStorage 6120 supports up to four Fibre Channel host connections, two per controller. Each connection is auto-sensing and supports 2 Gb/s, 4 Gb/s or 8 Gb/s. You may connect more than four hosts to the unit using a Fibre Channel switch (not provided).
Verify that the power switch on both supplies is in the OFF position (Figure 21) Connect the power cables from the InfiniteStorage 6120 to the appropriate 220 V outlets. For maximum redundancy, connect the two power supplies to different AC circuits.
A single RAID5 storage pool can be configured using 5 or 9 drives. A single RAID6 storage pool can be configured using 6 or 10 drives. The InfiniteStorage 6120 supports up to 24 storage pools in a single system. A storage pool can be configured with drives of different capacity, in which case the InfiniteStorage 6120 will use the lowest capacity for all drives, but this is not recommended.
2.3.2 Drive Layout Figure 23 shows the layout of drives in an InfiniteStorage 6120. Drives are always referenced by enclosure ID and slot number as illustrated. The InfiniteStorage 6120 supports mixing SAS and SATA drives within the same enclosure. For...
2.3.4 Setting System Time & Date The system time and date for the InfiniteStorage 6120 are factory-configured for the U.S. Pacific Standard Time (PST) zone. If you are located in a different time zone, you need to change the settings so that the time stamps for all events are correct.
Configuring the InfiniteStorage 6120 2.3.5 Checking Status of Physical Disks Before creating any storage pools, check the status of all the drives. Enter command SHOW UNASSIGNED_POOL ALL_ATTRIBUTES (Figure 28) Figure 28. Show Unassigned Pool Example Screen RAID$ show unassigned_pool all_attributes...
Configuring the InfiniteStorage 6120 2.3.7 Creating Storage Pools A storage pool on a InfiniteStorage 6120 has the following attributes: • RAID level Storage pools can be configured to use either a RAID5 or RAID6 parity scheme. In RAID5, the capacity of one drive is reserved for parity, allowing data recovery in the event of a single drive loss in the storage pool.
Page 38
Configuring the InfiniteStorage 6120 NOTE : Storage pool initialization is a background process and multiple storage pools can be initialized simultaneously. However, virtual disks on a storage pool are NOT accessible until its initialization is complete. To view the list of configured storage pools, enter command SHOW POOL * (Figure 32) Figure 32.
Configuring the InfiniteStorage 6120 2.3.8 Creating Virtual Disks A virtual disk can be created on just a part of a storage pool or uses all of the capacity of a single storage pool. To create a virtual disk, use the CREATE VIRTUAL_DISK command: At the CLUI prompt, type: CREATE VIRTUAL_DISK CAPACITY=<capacity>...
2.3.9 Creating Spare Pools The InfiniteStorage 6120 supports the concept of a spare pool. A spare pool contains physical disks that can be used as spare disks in one or more storage pools. In the event of drive failure, a drive that is assigned to a spare pool is automatically swapped into the storage pool to replace the failed drive.
Page 41
Configuring the InfiniteStorage 6120 SHOW SPARE_POOL <id> ALL_ATTRIBUTES will display detailed information of the spare pool . SHOW SPARE_POOL <id> PHYSICAL_DISKS will display the list of disks (Figure 40) in the pool. Figure 40. Show Spare Pool Example Screen (2)
Configuring the InfiniteStorage 6120 2.3.10 Initializing the Host System When a storage pool is created, initialization begins automatically and will continue in the background until it is completed. Once the storage pool has completed its initialization, its virtual disk(s) can be accessed immediately.
Managing the InfiniteStorage 6120 Managing the InfiniteStorage 6120 The InfiniteStorage 6120 provides a set of tools that enable administrators to centrally manage the network storage and resources that handle business-critical data. These include configuration management, performance management, and firmware update management.
Managing the InfiniteStorage 6120 3.1.2 User Logins RS-232 Login For a terminal session, hit the <Enter> key to bring up the password prompt. Enter the password: user Login via SSH For a SSH session, enter the user name USER and password USER (Figure 46) Figure 46.
Page 47
Managing the InfiniteStorage 6120 Simple, not full-command, line editing only is supported under the following conditions: • CLUI prompts the user for more information. • The alternate CLUI prompt is active. (The alternate CLUI is used on the RS-232 connection during an active SSH session.)
Configuration Management Configuration Management The InfiniteStorage 6120 provides uniform configuration management across a heterogeneous SAN. 3.2.1 Monitor Status of Storage Assets The drives in the system are categorized into one of the following pools: • Unassigned pool - By default, all the drives or replacement drives are initially allocated to this pool.
UUID: 0x5000cca215c564560 3.2.1.2 Storage Pool View Storage pools are the basic building blocks of the InfiniteStorage 6120. SHOW POOL * displays the list of configured storage pools in the system (Figure 52) Figure 52. Storage Pool List Example Screen RAID$ show pool *...
Configuration Management 3.2.1.4 Spare Pool View SHOW SPARE_POOL * will display the list of configured spare pool(s) (Figure 58) Figure 58. List of Spare Pools Example Screen RAID$ show spare_pool * OID: 0x19bc0006 Index: 0x0006 Name: 19bc0006 SHOW SPARE_POOL <id> ALL_ATTRIBUTES will display detailed information of the spare pool .
3.2.2 Storage Pool and Virtual Disk Management The InfiniteStorage 6120 creates centrally-managed and vendor-independent storage pooling. It enables different types of storage to be aggregated into a single logical storage resource from which virtual volumes (virtual disks) can be served up to multi-vendor host computers. The networked...
Configuration Management You may either explicitly select the disks for the pool by using PHYSICAL_DISK= or specify the number of disks in the pool by using NUMBER= in which case the next available disks will be selected. If you specify the ASSIGN_POLICY and NUMBER parameters together, only the selected type of disks will be used for the storage pool and you will not need to enter the individual disk name.
Configuration Management 3.2.2.6 Creating a Virtual Disk To create a virtual disk, enter command: CREATE VIRTUAL_DISK CAPACITY=<capacity> POOL=<pool-id> where <capacity> is the capacity of the virtual disk in GiB or type max to use all available capacity; <pool-id> is the storage pool to be used by this virtual disk (Figure 62) A message is displayed to indicate whether the virtual disk creation was successful.
3.2.3 Spare Pool Management The InfiniteStorage 6120 supports the concept of a spare pool which contains physical disks that can be used as spare disks. Spare pools can be shared by storage pools or dedicated to a particular storage pool in which case the spare disks will only be used by the designated storage pool. After a spare pool is created, you will need to select drives from the unassigned pool and assign them to the spare pool.
Each storage pool has a sparing policy that determines what happens when a physical disk within the pool fails (or becomes inaccessible). In the event of a drive failure, the InfiniteStorage 6120 will automatically initiate a drive rebuild if the sparing policy is set to automatic and a spare pool has been assigned to the storage pool.
Configuration Management Figure 65. Show Pool All Attributes RAID$ show pool 3 all OID: 0x19b003 Type: STORAGE UUID: 0x00 Global Spare Pool: 0x19bc0006 DiskTimeout(FRT): 10 minutes Init Policy: NO IO permitted Init Priority: Full Rebuild Priority: Fractional Rebuild Priority: Sparing Policy: AUTOMATIC To change the sparing policy setting, use this command: SET POOL <id>...
120 seconds Mirror Synch: The system time and date for the InfiniteStorage 6120 are factory-configured for the U.S. Pacific Standard Time (PST) zone. The system records time using the military method, which records hours from 00 to 24, not in a.m.
SHUTDOWN CONTROLLER [LOCAL|REMOTE|0|1] shuts down the specified controller. SHUTDOWN SUBSYSTEM shuts down both controllers. If you need to power down the InfiniteStorage 6120, use SHUTDOWN prior to shutting off the power. This will cause the InfiniteStorage 6120 to immediately flush its cache, abort all initialization and rebuild operations, and proceed with an orderly shutdown.
For example, two background jobs with priority values of 50 will not use 100% of the system resources. The InfiniteStorage 6120 may or may not limit the number of background jobs to keep the total of their priorities below 100.
Performance Management 3.3.2 Rebuild Policy Priority Each storage pool has its own rebuild policy settings. You may specify the priority values for full rebuild and partial (fractional) rebuild policies. To display the current settings, enter command SHOW POOL <id> ALL_ATTRIBUTES (Figure 71) Figure 71.
NOTE : Before you begin upgrading the firmware, make sure all access to the InfiniteStorage 6120 is stopped, all volumes on the storage array are unmounted, and allow sufficient time for the InfiniteStorage 6120 to flush all cached data.
Firmware Update Management 3.4.2.1 Windows Environment Contact SGI Technical Support to obtain a USB stick with the new firmware. Then follow these steps to update the firmware: Create a USB stick for the code update: • Insert your 4GB USB stick into your computer. •...
Firmware Update Management 3.4.2.2 Linux Environment Follow these steps to update the firmware: Copy the new firmware to the controller using an scp or sftp client. The username is firmware and the password is Firmware (Note that entries are case-sensitive). For example: scp sgi-flash-1825-opt.tgz firmware@10.32.31.240: At the CLUI prompt, enter this command :...
The System Logs The System Logs To display the event log starting at the start sequence number in ascending sequence number order , enter this command: (Figure 78) SHOW CONTROLLER <id> LOG ASCEND Figure 78. Controller Log Example Screen (1) RAID$ show controller 0 log ascend 000001 2009-02-05 12:13:31:3387789 G=0 S=0 T=1 RP=0 VP=63 LOG_JOI_BUILD_INFO1 JOI FW VERSION ON PROCESSOR 0X40 = (1.0.3.1-0).
Remote Management of InfiniteStorage 6120 Remote Management of InfiniteStorage 6120 The InfiniteStorage 6120 can be managed locally through the RS-232 interface or remotely via SSH. The CLUI is the same regardless of the management interface (RS-232 or SSH). 3.6.1 Network Connection Connect the Telnet port on the back of the controllers to your Ethernet network .
Page 69
ECTION Supporting the InfiniteStorage 6120...
Status LED Indicators The InfiniteStorage 6120 system includes an enclosure services processor and associated monitoring and control logic to enable it to diagnose problems within the enclosure’s power, cooling, and drive systems. The sensors for power and cooling conditions are housed within the power supply/cooling modules.
Status LED Indicators Figure 85. Front Panel LED Description Definition Color Status OFF - all DEMs operating correctly DEM Fault Amber ON - at least one DEM has failed; service action required ON - one or more HDDs are failed; SES must determine Drive Fault Amber exact HDD...
Color Status Enclosure fault Front enclosure Amber ON - IO fault detected ON - InfiniteStorage 6120 is ready to be accessed Blinks - firmware is loading Firmware status Rear enclosure Green OFF - InfiniteStorage 6120 is NOT ready to be...
Status LED Indicators 4.1.5 DEM (Drive Expander Module) Figure 90 describes the DEM LED status. • Under normal conditions, the LEDs should be illuminated constant green. • If a problem is detected, the color of the relevant LED will change to amber. Figure 90.
• Cords are too short. Call Customer Service for a replacement. Computer Does Not Recognize the InfiniteStorage 6120 Ensure that the host interface cables from the InfiniteStorage 6120 to the host computer are connected correctly. Ensure that all drive modules have been correctly installed.
Troubleshooting 4.2.3 System Faults Symptom Cause Action 1. The System Fault LED The ESI processor has 1. Check for other amber LED turns amber on front panel. detected an internal fault indications on the power cooling (for example, failure of an modules.
Troubleshooting 4.2.5 Thermal Alarm Symptom Cause Action 1. Enclosure system If the air temperature 1. Ensure that the local ambient environment FAULT LED is amber. through the enclosure temperature is below the upper 40°C exceeds a pre-set specification. 2. An amber LED on threshold, a thermal one or more power 2.
If the InfiniteStorage 6120 is powered up and you remove any module, replace it immediately. If the system is used with modules missing for more than a few minutes, the system can overheat, causing power failure and data loss.
Component Failure Recovery 4.3.2 Replacing a Drive Module NOTE : When a drive is failed by the InfiniteStorage 6120, replace it immediately so that the operation and performance of the system are not affected. Figure 91. Drive Module Removal : Drive spin down—Damage can occur to a drive if it is removed while still AUTION spinning.
Recovering from a Drive Failure Recovering from a Drive Failure When a drive failure occurs on the InfiniteStorage 6120, the storage pool containing that drive will begin operating in degraded mode. This means that the storage pool will continue to handle I/O commands from the host, but there will be no redundancy to protect against additional drive failures on the same storage pool.
Recovering from a Drive Failure To monitor the rebuild progress , enter command SHOW JOB * ALL_ATTRIBUTES (Figure 94) Figure 94. Display Rebuild Progress RAID$ show job * all_attributes OID: 0x2b050003 Target: 0x19b40003 Type: REBUILD Status: RUNNING Priority: Fraction Complete:12% To show the storage pool information , enter command SHOW POOL <id>...
Recovering from a Drive Failure 4.4.4 Manual Rebuild You may manually replace a failed disk using the REPLACE command: REPLACE PHYSICAL_DISK <id> NEW_DISK <new-disk-id> A replace operation is used to replace a failed disk with a healthy spare disk. The operation can take several hours to complete depending on the size of the disk and speed of the replace operation.
Manual Intervention Required (MIR) Conditions Manual Intervention Required (MIR) Conditions Manual Intervention Required (MIR) represents a condition with the controller that requires you to provide a solution before proceeding with normal controller operations. This is to guard against the controller firmware from executing operations that may not necessarily be the desired operation. These conditions will most likely be seen in a new system installation environment.
Page 84
Manual Intervention Required (MIR) Conditions MIR_NO_CONFIG A configuration could not be created on the backend drives. Fix the condition that prevents this controller from creating a configuration on the backend drives. Please refer to the installation guidelines for proper setup. MIR_NO_QUORUM No quorum drives could be found within the disk drives on the backend.
Technical Specifications Here are the technical specifications for the InfiniteStorage 6120. NOTE : Specifications subject to change without notice. Configuration, Performance, & Capacity Host interface Fibre channel 8Gb/s Drive interface SAS / SATA Management interface RS-232 and Ethernet (SSH) Cache memory...
Page 88
Physical, Power & Environmental 7.0" (18 cm) × 17.56" (45 cm) × 37" (94 cm) InfiniteStorage 6120 chassis dimensions (H×W×D) InfiniteStorage 6120 chassis weight 120 lbs (54.5 kg) without drives, 240 lbs (109.1 kg) with drives Electrical/AC 200-240 V @ 47-63 Hz Power consumption (maximum current) 10.3A @ 230VAC...
Safety Requirements for Rack Installation The following safety requirements must be considered when the InfiniteStorage 6120 is mounted in a rack. The rack when configured with the units must meet the safety requirements of UL 60950 and IEC 60950. Mechanical Loading •...
Page 90
Elevated Operating Ambient Temperature If the InfiniteStorage 6120 system is installed in a closed or multi-unit rack assembly, the operating ambient temperature of the rack environment may be greater than room ambient. The rack design should take into consideration the maximum operating ambient temperature for the unit is 35°C.
Index Ethernet connection expansion enclosure, connect background job, see job failure cable connections drive, fixing 69, 70 cache fan, alerts mirrored write back, set fan, fixing write back, set PCM, fixing chunk size power supply, fixing CLUI, using fan, see cooling module components, hardware features, S2A6620 controller...
Page 92
Index power supply fault full 66, 67 system fault manual, initialize partial licensing instructions set priority login recovery logout drive failure replace disk, manual restart Manual Intervention Required controller subsystem clear, state RS-232 terminal set up conditions mirrored write back cache, set safety guidelines, rack installation SATAssure, set netmask, set...
Page 93
Index troubleshooting unassigned pool unpack the system user name version information virtual disk associated with storage pool, view create 29, 44 delete location, physical max number of name, change status, checking visual indication disk enclosure storage pool virtual disk write back cache, set 0 0 7 - 5 5 3 3 - 0 0 1...
Need help?
Do you have a question about the InfiniteStorage 6120 and is the answer not in the manual?
Questions and answers