Advertisement

Sun StorEdge
3000 Family
Best Practices Manual
Sun StorEdge 3510 FC Array
Sun StorEdge 3511 FC Array with SATA
Sun Microsystems, Inc.
www.sun.com
Part No. 816-7325-15
June 2004, Revision A
Submit comments about this document at: http://www.sun.com/hwdocs/feedback

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the StorEdge3000 Series and is the answer not in the manual?

Questions and answers

Summary of Contents for Sun Microsystems StorEdge3000 Series

  • Page 1 Sun StorEdge 3000 Family ™ Best Practices Manual Sun StorEdge 3510 FC Array Sun StorEdge 3511 FC Array with SATA Sun Microsystems, Inc. www.sun.com Part No. 816-7325-15 June 2004, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
  • Page 2 Copyright © 2004 Dot Hill Systems Corporation, 6305 El Camino Real, Carlsbad, California 92009, USA. All rights reserved. Sun Microsystems, Inc. and Dot Hill Systems Corporation may have intellectual property rights relating to technology embodied in this product or document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S.
  • Page 3: Table Of Contents

    Contents Overview 1 Comparison of the Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array 3 Sun StorEdge 3500 Series Architecture 4 DAS and SAN Storage Architectures 5 Fibre Channel Protocols 6 Supported RAID Levels 7 Logical Drives 7 Cache Optimization 9 Array Management Tools 11 Saving and Restoring Configuration Information 12...
  • Page 4 Non-Redundant DAS Configurations 21 Non-Redundant DAS Tips and Techniques 22 Non-Redundant DAS Setup Details 23 High-Availability DAS Configurations 26 High-Availability DAS Tips and Techniques 27 Standard High-Availability DAS Setup Details 28 Six Node High-Availability DAS Setup Details 31 Full-Fabric SAN Configurations 33 Full-Fabric SAN Tips and Techniques 34 Full-Fabric SAN Setup Details 35 High-Performance SAN Configurations 38...
  • Page 5: Overview

    Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays ™ This Best Practices Manual describes both the Sun StorEdge 3510 FC Array and Sun StorEdge 3511 FC Array with SATA, and complements the Sun StorEdge 3000 Family Installation, Operation, and Service Manual for these products. The Sun StorEdge 3511 FC Array with SATA is also known as the Sun StorEdge 3511 SATA array which will be the term used throughout most of this document.
  • Page 6 Both the Sun StorEdge 3500 series arrays feature full 2Gb host Fibre Channel (FC) connections and are next-generation storage systems designed to provide direct attached storage (DAS) to entry-level, mid-range, and enterprise servers, or to serve as the disk storage within a storage area network (SAN). Modern businesses employ servers of all sizes requiring storage to match the type of data storage and processing being used by the applications involved, as well as consider the cost of the server.
  • Page 7: Comparison Of The Sun Storedge 3510 Fc Array And The Sun Storedge 3511 Sata Array

    Comparison of the Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array Before installing and configuring your array, please review the key differences between the . The Sun StorEdge 3510 FC array and the Sun StorEdge 3511 SATA array following list provides a comparison of the Sun StorEdge 3510 FC array and the Sun features.
  • Page 8: Sun Storedge 3500 Series Architecture

    Comparison of Sun StorEdge 3510 FC Array and the Sun StorEdge 3511 SATA Array Features TABLE 1 Sun StorEdge 3510 FC Array Sun StorEdge 3511 SATA Array Maximum Number of Disks 108 (1 RAID array + 8 expansion (1 RAID array + 5 expansion units) per Configuration units) Maximum Number of...
  • Page 9: Das And San Storage Architectures

    All six fibre channels in an I/O controller module support 1-Gbit or 2-Gbit data transfer speeds. RAID controller channels 2 and 3 are dedicated drive channels that connect to expansion units. Each I/O board has two ports designated as disk drive loops. These ports connect to the internal dual-ported FC disk drives and are used to add expansion units to the configuration.
  • Page 10: Fibre Channel Protocols

    Direct-Attached Storage (DAS) Storage Area Network (SAN) DAS and SAN Storage Architectures FIGURE 1 Selecting the best storage architecture for a particular environment can be a confusing exercise. In general, some environments are well-suited for DAS while others will benefit greatly from SAN. The challenge of selecting between DAS and SAN is often further complicated by the need to choose between different storage systems, one designed for DAS or another intended for SAN.
  • Page 11: Supported Raid Levels

    4 (host channels) x 1 (ID per channel) x 32 (LUNs per ID) = 128 maximum addressable LUNs in a fabric point-to-point environment. If dual paths are desired for each logical device, a maximum of 64 dual-pathed LUNs are available. In an FC-AL configuration, multiple IDs can be assigned to any given host channel.
  • Page 12 before building a new logical drive is recommended. In the Sun StorEdge 3511 SATA array, for example, this can result in a supported storage capacity of 16 Tbytes (8 logical drives x 2 Tbytes each = 16 Tbytes total capacity). Maximum Number of Disks per Sun StorEdge 3510 FC Array Logical Drive TABLE 2 Disk Capacity...
  • Page 13: Cache Optimization

    Note – You cannot use all disks for data when using 108 146-Gbyte or 72 250-Gbyte disks. The remaining disks are usually used as spares. Be sure to check the latest product Release Notes for additional guidelines or limitations for large configurations. Each LD can be partitioned into up to 128 separate partitions or used as a single partition.
  • Page 14 “Maximum Number of Disks per Sun StorEdge 3510 FC Array Logical Drive” on page 8 “Maximum Usable Capacity (Gbyte) per Sun StorEdge 3510 FC Array Logical Drive” on page “Maximum Number of Disks per Sun StorEdge 3511 SATA Array Logical Drive” on page 8 “Maximum Usable Capacity (Gbyte) per Sun StorEdge 3511 SATA Array Logical Drive”...
  • Page 15: Array Management Tools

    Array Management Tools The Sun StorEdge 3500 series arrays use the same management interfaces and techniques. The StorEdge 3500 series arrays can be configured and monitored using the following methods as appropriate: Sun StorEdge 3500 series arrays can be configured and monitored through any of the following methods: Using the out-of-band serial port connection (RAID only), a Solaris tip session or terminal emulation program for other supported operating systems can be used...
  • Page 16: Saving And Restoring Configuration Information

    Saving and Restoring Configuration Information An important feature of these management tools is the ability to save and restore configuration information in a number of ways. Using the array’s firmware application, the configuration information (NVRAM) can be saved to disk. This provides a backup of the controller-dependent configuration information such as channel settings, host IDs, FC protocol, and cache configuration.
  • Page 17: Storage Area Networking

    The actual number of servers that can be connected varies according to the number of controllers in the array. It also depends on the number of Fibre Channel connections used for each server and the total number of small form-factor pluggable (SFP) interface modules installed.
  • Page 18: Scaling Capacity

    The number of hosts that can effectively share one Sun StorEdge 3500 series array depends on several factors, such as the type of host application, bandwidth requirements, and the need for concurrent IOPs. Since most applications have moderate performance needs, it is quite feasible to have several hosts sharing the same Sun StorEdge 3510 FC or 3511 SATA array controller, with the following network characteristics: The applications used with the StorEdge 3511 SATA array are characteristically...
  • Page 19 Capacities can be as large as: Sun StorEdge 3510 FC Array. 1.75 Tbyte with twelve 146-Gbyte disks Sun StorEdge 3511 SATA Array. 3.00 Tbyte with twelve 250-Gbyte disks Additional storage capacity can be dynamically created, starting with a system with five disks and then adding one or more disks.
  • Page 20: First Steps

    Caution – For optimum and successful use of each array, check that you are using the array with the correct applications (see “Overview” on page 1) and according to the best practices configurations outlined in this manual. First Steps There are two simple yet effective approaches for designing a Sun StorEdge 3500 series array solution into your environment.
  • Page 21: General Configuration Considerations

    storage. While these solutions do not match every environment exactly, use the closest one as a design blueprint that can be customized to suite your particular environment. For environments with different server configurations, choose the solution that best matches the servers whose applications are mission-critical or most important.
  • Page 22: Configuring An Array's Rccom Channel

    To avoid disruptions to other hosts sharing the same array, do not share a logical drive among multiple hosts. Use either local or global spare drives when creating logical drives. Any free drive can be designated as a spare and more than one drive can be used as a spare. Use dual pathing for each LUN and use Sun StorEdge Traffic Manager software to provide load balancing across controller ports for increased performance.
  • Page 23 because it is now distributed over four channels instead of two. If at a later time you choose to add an expansion unit, it will not be necessary to interrupt service by resetting the controller after reconfiguring a channel. To configure channels 4 and 5 as additional DRV + RCCOM channels: 1.
  • Page 24: Cautions

    6. Choose No to decline the controller reset. 7. Select channel 5. 8. Choose “channel Mode → RCCOM.” 9. Choose Yes to confirm. 10. Choose No to decline the controller reset. 11. Select channel 2. 12. Choose “channel Mode → drive.” 13.
  • Page 25: Non-Redundant Das Configurations

    Non-Redundant DAS Configurations Note – Using single connections between Fibre Channel arrays and servers creates single points of failure (SPOF) that can cause interruptions in the event a connection becomes unreliable or fails. This is not a recommended configuration unless host- based mirroring is utilized to protect against single points of failure.
  • Page 26: Non-Redundant Das Tips And Techniques

    Configuration Overview for Non-Redundant DAS TABLE 7 Single Server Configurations Dual Server Configurations Quad Server Configurations Number of Servers RAID Enclosures Expansion Units As needed As needed One or more Number of Controllers Number of Disks 5 or more 12 or more 24 or more Cache Optimization Random or sequential...
  • Page 27: Non-Redundant Das Setup Details

    Three SFP modules to support five connections (Sun StorEdge 3511 SATA array only) Four SFP modules to support six connections (Sun StorEdge 3511 SATA array only) Using two single-port FC host bus adapters (HBAs) or a dual-port 2-Gbit FC HBA in single-server or dual-server configurations makes optimum use of the Fibre Channel array’s performance.
  • Page 28 Server 1 Server 4 Server 3 Server 2 H/D/RCC Sun StorEdge 3511 SATA Array Non-Redundant DAS Connections FIGURE 6 Setup Summary for Non-Redundant DAS TABLE 8 Secondary ID Channel Number Primary ID Number Number The general procedure for creating this configuration follows. 1.
  • Page 29 3. Configure cache optimization. If you are configuring a Sun StorEdge 3511 SATA array, confirm that cache optimization is sequential. 4. Create one Logical Drive for each server and configure spare disks. 5. Map Logical Drive 0 to controller channel 0. 6.
  • Page 30: High-Availability Das Configurations

    High-Availability DAS Configurations Single Server Dual Servers Quad Servers High-Availability DAS Configurations FIGURE 7 Note – The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi-path and multi-host configurations where the array has a backup or archival role.
  • Page 31: High-Availability Das Tips And Techniques

    Configuration Overview for High Availability DAS (Continued) TABLE 9 Single Server Configurations Dual Server Configurations Quad Server Configurations Number of Disks 5 or more 12 or more 24 or more Cache Optimization Random or sequential Random or sequential Random or sequential (Sun StorEdge 3510 FC Array) Cache Optimization...
  • Page 32: Standard High-Availability Das Setup Details

    Map the logical drive to both of the controller channels to which the server is connected. Standard High-Availability DAS Setup Details show a Sun StorEdge 3510 FC array and a Sun StorEdge 3511 FIGURE 8 FIGURE 9 SATA array in a high-availability DAS configuration. Server 2 Server 1 Server 3...
  • Page 33 Server 4 Server 3 Server 1 Server 2 H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array High-Availability DAS Connections FIGURE 9 Setup Summary for High-Availability DAS TABLE 10 Secondary ID Channel Number Primary ID Number Number The general procedure for creating this configuration follows. 1.
  • Page 34 Sun StorEdge 3511 SATA Array. See “Sun StorEdge 3511 SATA Array High Capacity Configurations” on page 53 3. Configure cache optimization. If you are configuring a Sun StorEdge 3511 SATA array, confirm that cache optimization is sequential. 4. Ensure that the fibre connection is set to loop mode. 5.
  • Page 35: Six Node High-Availability Das Setup Details

    Six Node High-Availability DAS Setup Details show a Sun StorEdge 3511 SATA array connected to six servers in a high- FIGURE 10 availability DAS configuration. Server 2 Server 1 Server 3 Server 4 Server 5 Server 6 H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Six Node High-Availability Connections FIGURE 10 Note –...
  • Page 36 4. Ensure that the fibre connection is set to loop mode. 5. Configure target IDs. 6. Create one logical drive for each server and configure spare disks. 7. Map Logical Drive 0 to channels 0 and 5 of the primary controller. 8.
  • Page 37: Full-Fabric San Configurations

    Full-Fabric SAN Configurations Typical Full-Fabric SAN Configuration FIGURE 11 Note – The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi-path and multi-host configurations where the array has a backup or archival role. Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 38: Full-Fabric San Tips And Techniques

    Configuration Overview for a Full-Fabric SAN TABLE 11 Small Configuration Medium Configuration Large Configuration Sun StorEdge 3511 SATA array Number of Servers 2 to 4 2 to 8 2 to 16 Cache Optimization Sequential Sequential Sequential Sun StorEdge 3510 FC array Number of Servers 2 to 4 2 to 14...
  • Page 39: Full-Fabric San Setup Details

    Use of fabric point-to-point (F_port) connections between an array and fabric switches limits to 128 the total number of LUNs that can be presented. Fibre channel standards allow only one ID per port when operating point-to-point protocols, resulting in a maximum of four IDs, with a maximum of 32 LUNs each, supporting up to 128 LUNs.
  • Page 40 Server 2 Server 1 Switch 1 Switch 2 H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Full-fabric SAN Connections FIGURE 13 Setup Summary for Full Fabric SAN TABLE 12 Channel Number Primary ID Number Secondary ID Number The general procedure for creating this configuration follows. 1.
  • Page 41 Sun StorEdge 3511 SATA Array. See “Sun StorEdge 3511 SATA Array High Capacity Configurations” on page 53 3. Configure cache optimization. If you are configuring a Sun StorEdge 3511 SATA array, confirm that cache optimization is sequential. 4. Ensure that the fibre connection is set to point-to-point. 5.
  • Page 42: High-Performance San Configurations

    High-Performance SAN Configurations Typical High-Performance SAN Configurations FIGURE 14 Note – The Sun StorEdge 3511 SATA array cannot be used to store single instances of data but can be used in multi-path and multi-host configurations where the array has a backup or archival role. Configuration Overview for High-Performance SAN TABLE 13 Small Configuration...
  • Page 43: High-Performance San Tips And Techniques

    Configuration Overview for High-Performance SAN (Continued) TABLE 13 Small Configuration Medium Configuration Large Configuration Number of Disks 12 or more 12 or more 12 or more Cache Optimization Random or sequential Random or sequential Random or sequential (Sun StorEdge 3510 FC array) Cache Optimization Sequential...
  • Page 44: High-Performance San Setup Details

    redundant controller, cannot be used. Similarly, if channel 1 (port FC1) is connected to a fabric switch, the second port for channel 1 on that controller and both FC1 ports on a redundant controller, cannot be used. High-Performance SAN Setup Details shows a Sun StorEdge 3510 FC array and a Sun StorEdge FIGURE 15 FIGURE 16...
  • Page 45 Server 1 Server 2 Switch 1 Switch 2 H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array High-Performance SAN Connections FIGURE 16 Setup Summary for a High-Performance SAN TABLE 14 Channel Number Primary ID Number Secondary ID Number The general procedure for creating this configuration follows. 1.
  • Page 46 Sun StorEdge 3511 SATA Array. See “Sun StorEdge 3511 SATA Array High Capacity Configurations” on page 53 3. Configure cache optimization. If you are configuring a Sun StorEdge 3511 SATA array, confirm that cache optimization is sequential. 4. Ensure that the fibre connection set to point-to-point mode. 5.
  • Page 47: Scaling Arrays Into High Capacity Configurations

    Scaling Arrays Into High Capacity Configurations Note – High capacity Sun StorEdge 3500 series configurations are supported, with certain limitations. For example, only the sequential cache optimization mode can be used. Other important limitations may exist. Consult the Sun StorEdge 3510 and 3511 FC array documentation for additional information.
  • Page 48: Sun Storedge 3510 Fc Array High Capacity Configurations

    Sun StorEdge 3510 FC Array High Capacity Configurations Sun StorEdge 3510 FC arrays typically allow the connection of up to two expansion units to support a maximum of 36 disks. However, you can create larger configurations that support as many as eight expansion units and up to 108 disks if you use the guidelines in this section.
  • Page 49 Connecting One Expansion Unit Sun StorEdge 3510 FC Array Configuration with One Expansion Unit FIGURE 17 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 50 Connecting Two Expansion Units Sun StorEdge 3510 FC Array Configuration with Two Expansion Units FIGURE 18 Sun StorEdge 3000 Family Best Practices Manual • June 2004...
  • Page 51 Connecting Three Expansion Units Sun StorEdge 3510 FC Array Configuration with Three Expansion Units FIGURE 19 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 52 Connecting Four Expansion Units Sun StorEdge 3510 FC Array Configuration with Four Expansion Units FIGURE 20 Sun StorEdge 3000 Family Best Practices Manual • June 2004...
  • Page 53 Connecting Five Expansion Units This high-capacity configuration using five expansion units requires the configuration of RAID channels 4 and 5 as drive channels. This restricts host connections to RAID channels 0 and 1, affecting supported host configurations. Use four expansion units or fewer when possible. Sun StorEdge 3510 FC Array Configuration with Five Expansion Units FIGURE 21 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 54 Connecting Six Expansion Units This high-capacity configuration using six expansion units requires the configuration of RAID channels 4 and 5 as drive channels. This restricts host connections to RAID channels 0 and 1, affecting supported host configurations. Use four expansion units or fewer when possible.
  • Page 55 Connecting Seven Expansion Units This high-capacity configuration using seven expansion units requires the configuration of RAID channels 4 and 5 as drive channels. This restricts host connections to RAID channels 0 and 1, affecting supported host configurations. Use four expansion units or fewer when possible. Sun StorEdge 3510 FC Array Configuration with Seven Expansion Units FIGURE 23 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 56 Connecting Eight Expansion Units This high-capacity configuration using eight expansion units requires the configuration of RAID channels 4 and 5 as drive channels. This restricts host connections to RAID channels 0 and 1, affecting supported host configurations. Use four expansion units or fewer when possible. Sun StorEdge 3510 FC Array Configuration with Eight Expansion Units FIGURE 24 Sun StorEdge 3000 Family Best Practices Manual •...
  • Page 57: Sun Storedge 3511 Sata Array High Capacity Configurations

    Sun StorEdge 3511 SATA Array High Capacity Configurations Sun StorEdge 3511 SATA arrays allow the connection of up to five expansion units to support a maximum of 72 disks. You can create large configurations beyond 12 disks if you use the guidelines in this section. Note –...
  • Page 58 Connecting One Expansion Unit H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Configuration with One Expansion Unit FIGURE 25 Sun StorEdge 3000 Family Best Practices Manual • June 2004...
  • Page 59 Connecting Two Expansion Units H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Configuration with Two Expansion Units FIGURE 26 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 60 Connecting Three Expansion Units H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Configuration with Three Expansion Units FIGURE 27 Sun StorEdge 3000 Family Best Practices Manual • June 2004...
  • Page 61 Connecting Four Expansion Units H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Configuration with Four Expansion Units FIGURE 28 Best Practices for the Sun StorEdge 3510 and 3511 FC Arrays...
  • Page 62 Connecting Five Expansion Units This high-capacity configuration using five expansion units requires the configuration of RAID channels 4 and 5 as drive channels. This restricts host connections to RAID channels 0 and 1, affecting supported host configurations. Use four expansion units or fewer when possible. H/D/RCC H/D/RCC Sun StorEdge 3511 SATA Array Configuration with Five Expansion Units...
  • Page 63: Summary

    Summary Entry-level, mid-range, and enterprise servers are used for a wide range of applications with distinct storage requirements, so the Sun StorEdge 3500 series arrays feature a modular architecture with flexible configurations. For example, a solution can be deployed as direct-attached storage (DAS) or as part of a storage area network (SAN).
  • Page 64 Sun StorEdge 3000 Family Best Practices Manual • June 2004...

This manual is also suitable for:

Storedge 3510Storedge 3511

Table of Contents