Dell DX6000 Deployment Manual
  1. Manuals
  2. Brands
  3. Dell Manuals
  4. Software
  5. DX6000
  6. Deployment manual

Dell DX6000 Deployment Manual

Dell dx object storage file gateway deployment guide
Hide thumbs Also See for DX6000:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Hardware Owner's Manual, Administration Manual
DEL
LL DX
X Obje
File
e Gat
teway
A Dell
l Technica
al White Pa
Dell │ St
torage
Storage E
Engineering
ect S
torag
y Dep
ploym
aper
ge
ment G G uide e

Advertisement

Table of Contents
loading

Related Manuals for Dell DX6000

Summary of Contents for Dell DX6000

  • Page 1 LL DX X Obje ect S torag File e Gat teway y Dep ploym ment G G uide e A Dell l Technica al White Pa aper Dell │ St torage Storage E Engineering...
  • Page 2 AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND. © 2010 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express written permission of Dell Inc. is strictly forbidden. For more information, contact Dell.

  • Page 3: Table Of Contents

    Dell DX Object Storage – File Gateway Deployment Guide Contents Scope of this Document and Requirements ................. 4   Conventions Used in This Document ................. 4   Working with Files and Commands ................... 4   Deployment Checklist ....................5  ...
  • Page 4 Dell DX Object Storage – File Gateway Deployment Guide Install and Configure Red Hat Enterprise Linux ..............17   Create the Master Boot Record (MBR) on the Second Drive ..........23   Disable SELinux ...................... 24   Create the YUM Repository and Install Packages ............... 25  ...
  • Page 5 Shut Down CFS and CNS .................... 62   Special Considerations for MD3200i Spooler ..............63   File Revisions and Dell DX Object Storage File Deletion ............63   Dell DX Object Storage Metadata and Policies ............... 63   Custom Metadata ....................64  ...

  • Page 6: Scope Of This Document And Requirements

    Dell DX Object Storage – File Gateway Deployment Guide Scope of this Document and Requirements This document provides instruction for deploying either a CIFS or NFS gateway solution on the Dell DX Object Storage platform. Successful deployment enables customers to use a common file system with which they are comfortable.

  • Page 7: Deployment Checklist

    Dell DX Object Storage – File Gateway Deployment Guide Deployment Checklist Complete the steps below for the type of CFS solution you are deploying. Single-Server, Standalone Authentication, Local Spooler (DX Cluster + 1 CFS, not a member of Active Directory) Complete the Site Survey Technical review.

  • Page 8: Failover, Standalone Authentication, External Spooler

    Dell DX Object Storage – File Gateway Deployment Guide Failover, Standalone Authentication, External Spooler (DX Cluster + 2 CFS Systems + MD3200i, not a member of Active Directory) Complete the Site Survey Technical review. Order placement and delivery. Rack and cable (power and network) the DX Object Cluster and the CFS Server(s).

  • Page 9: Architecture

    In most cases, none of these components are yet installed at the customer site. CFS Server – This server hosts the content file server software that presents the Dell DX Object Storage system as a standard file system. In single-server solutions, this server also provides a spool cache on local disk.

  • Page 10: Network

    Dell DX Object Storage – File Gateway Deployment Guide PSU: 500Watt Redundant power supplies Embedded Management: iDRAC6 Enterprise Network Adapter: Broadcom NetXtreme II 5709 Gigabit NIC w/TOE & iSOE, Quad Port, Copper, PCIe-4 DVD-ROM Drive Operating System: RHEL 6 X64 Basic with 3 Year Subscription...

  • Page 11: Network

    Dell DX Object Storage – File Gateway Deployment Guide Network Adapter: Broadcom NetXtreme II 5709 Gigabit NIC w/TOE & iSOE, Quad Port, Copper, PCIe-4 DVD-ROM Drive Operating System: RHEL 6 X64 Basic with 3 Year Subscription  (1) iSCSI Storage: MD3200i Controllers: Single or Dual controller options Hard Drives: Up to 12 3.5in HDD with the following HDD options...

  • Page 12: Gateway Protocols

    Node and the CFS Server. Different versions may run on the CFS Server and the CSN. See the interoperability matrix for information about versions. CFS – This is the software on the CFS Server that presents Dell DX Object Storage to clients as a common file system.

  • Page 13: How It All Works Together

    Dell DX Object Storage – File Gateway Deployment Guide How it all works together The data flow in a DX Object Storage File Gateway depends on the type of configuration. The following examples show, a standard DX Object Storage cluster (for reference purposes), a DX Object Storage cluster with a single-server gateway, and a DX Object Storage cluster with a failover gateway.

  • Page 14: Dx Object Storage File Gateway (Single-Server)

    Dell DX Object Storage – File Gateway Deployment Guide DX Object Storage File Gateway (single-server) In a DX Object Storage File Gateway, data objects are written to a CFS server before being written to a Storage Node. In this configuration, the application server and clients are actually viewing objects as they reside in the spool cache of the CFS server.

  • Page 15: Dx Object Storage File Gateway (Failover)

    Dell DX Object Storage – File Gateway Deployment Guide DX Object Storage File Gateway (Failover) A failover configuration (see Figure 3) provides two CFS servers and a separate dedicated spool/cache. This configuration provides continuous service on the gateway, as long as the cluster and the shared storage are running.

  • Page 16: Set Up The Dx Object Storage Cluster

    Dell DX Object Storage – File Gateway Deployment Guide Set up the DX Object Storage Cluster This section includes the steps for setting up and activating the DX Object Storage Cluster. BEFORE YOU BEGIN: Did you complete the Site Survey? Assumptions and Requirements Red Hat Enterprise Linux version 5 or later is factory-installed on the CSN.
  • Page 17 Dell DX Object Storage – File Gateway Deployment Guide 9. Complete the following network information as prompted. (see the Site Survey)  External IP address for the CSN.  External IP address for the cluster.  Subnet mask.  IP address for the customer’s external gateway.

  • Page 18: Set Up The Cfs Server

    Dell DX Object Storage – File Gateway Deployment Guide Set up the CFS Server BEFORE YOU BEGIN: Did you Set up the DX Object Storage Cluster? NOTE: Make sure there is a DNS entry for the CIFS/NFS interface of the server. In the case the site does not have a DNS server, make sure that hostname is resolvable to the CIFS/NFS interface IP address from the /etc/hosts file.

  • Page 19: Create Raid1 Volumes

    Dell DX Object Storage – File Gateway Deployment Guide Create RAID1 Volumes BEFORE YOU BEGIN: Did you Validate BIOS settings Before installing the operating system, you need to create two RAID1 arrays. One array will used for the operating system, and the other will be used for a data spool cache.
  • Page 20 Dell DX O bject Storage e – File Gatew way Deployme ent Guide Enter a fully-qualif fied Hostnam me for the CF S that will id entify it on t the network ( for example, serve r.domain.tld) NOTE E: This hostna...
  • Page 21 Dell DX O bject Storage e – File Gatew way Deployme ent Guide Provid de informatio on about the DNS servers and Search d domains whe ere the CFS se erver will resi ide. Click Apply, click Close to exit...
  • Page 22 Dell DX O bject Storage e – File Gatew way Deployme ent Guide In the e storage devi ices screen, s select only th he boot drive e (smallest dr rive) in the Da ata Storage Devic ces list, and c...
  • Page 23 Dell DX O bject Storage e – File Gatew way Deployme ent Guide Click Next to initia ate formattin ng the hard dr rives, and cli ck Format w when asked to confirm. Click Write change es to disk wh...
  • Page 24 Dell DX O bject Storage e – File Gatew way Deployme ent Guide Select t Desktop as the installati ion type and click Next. Click Next to start t the installat tion. After the installati ion complete s, click Rebo oot when prom mpted.

  • Page 25: Create The Master Boot Record (Mbr) On The Second Drive

    Dell DX Object Storage – File Gateway Deployment Guide On the Kdump screen uncheck the box. Add the master boot record to the second boot drive. Create the Master Boot Record (MBR) on the Second Drive By creating a master boot record on a second logical volume, you can always ensure that the system is bootable if a boot drive is removed, or –...

  • Page 26: Disable Selinux

    Dell DX Object Storage – File Gateway Deployment Guide # grub> setup (hd0) Checking if "/boot/grub/stage1" exists... no Checking if "/grub/stage1" exists... yes Checking if "/grub/stage2" exists... yes Checking if "/grub/e2fs_stage1_5" exists... yes Running "embed /grub/e2fs_stage1_5 (hd0)"... 26 sectors are embedded.

  • Page 27: Create The Yum Repository And Install Packages

    Dell DX Object Storage – File Gateway Deployment Guide NEXT STEP: Create the YUM Repository and Install Packages Create the YUM Repository and Install Packages BEFORE YOU BEGIN: Did you Disable SELinux? The CFS installation process is dependent on additional rpm packages that are not installed on the system by default.
  • Page 28 Dell DX Object Storage – File Gateway Deployment Guide name=Red Hat Enterprise Linux 6.0 mediaid=1285193176.460470 metadata_expire=-1 gpgcheck=0 cost=500 baseurl=file:/root/RHEL6 enabled=1 Ensure that avahi-daemon is running. # service avahi-daemon status If avahi-daemon is not running, use the following command: # service avahi-daemon restart # chkconfig avahi-daemon on 9.
  • Page 29 Dell DX Object Storage – File Gateway Deployment Guide The CFS system is now ready to be updated with all the dependencies required to complete the installation. NEXT STEP: Stop and Disable Services Page 27...

  • Page 30: Stop And Disable Services

    Dell DX Object Storage – File Gateway Deployment Guide Stop and Disable Services BEFORE YOU BEGIN: Did you Disable SELinux? Create a list of file services. # vi list Add the following services to the file. nscd NetworkManager winbind ntpd...

  • Page 31: Configure The Network Interfaces For Bonding

    BEFORE YOU BEGIN: Did you Set up the NTP Server? Channel bonding enables two or more network interfaces to act as one, simultaneously increasing the bandwidth and providing redundancy. Dell recommends the following bonds for the networks that are part of the CFS solution.
  • Page 32 Dell DX Object Storage – File Gateway Deployment Guide Dell supports two different types of bonding: balance-alb (adaptive load balancing) and link aggregation control (LACP, also known as 802.3ad). Balance-alb is configured as mode=6; 802.3ad is configured as mode=4. (see below). You should deploy the type of bonding that the customer site is most comfortable with.

  • Page 33: Configure The Domain Name Service Resolver

    Dell DX Object Storage – File Gateway Deployment Guide ONBOOT=yes (validate this against /etc/udev/rules.d/70-persistent-net.rules) HWADDR=00:26:B9:3D:55:19 (where n is the number of the Ethernet port) NAME="System ethn" BOOTPROTO=none (where x is the number of the bond to which the Ethernet port belongs)

  • Page 34: Install The Cfs Software

    Dell DX Object Storage – File Gateway Deployment Guide 1. Enter the following information in the resolv.conf file: (see Site Survey) search xyz.project.local (see Site Survey) nameserver xx.xx.x.x (see Site Survey) domainname xyz.project.local NOTE: Make sure there is a DNS entry for the CIFS/NFS interface of the server.

  • Page 35: Create The Spooler And Cache File Systems

    Dell DX Object Storage – File Gateway Deployment Guide NOTE: Services should show as not running for all of the above. If they are running, they must be disabled. NOTE: If any of these commands fail (other than saying that the service is not running), this indicates that the required software package was not installed.

  • Page 36: Create Disk Partitions And Spooler File Systems (Single-Server Solution)

    If the CNS cache must be installed on its own spooler file system. Depending on your CFS configuration, you will need to create the spooler on a Dell PowerVault MD3200i (failover CFS solution), or on the CFS File Server itself (single-server solution). Refer to the appropriate section below.

  • Page 37: External Spooler File System (Failover Solution)

    Dell DX Object Storage – File Gateway Deployment Guide /dev/Drive_ID1 /var/spool/cfs/share_name ext4 rw,acl,user_xattr,nodelalloc 1 20 0 Mount the file system. # mount –a Validate that the mount occurred. # df | grep cfs NEXT STEP: Configure the Cluster Name Space (CNS) External Spooler File System (Failover solution) The preferred external storage option (documented in this guide) is the MD3200i.
  • Page 38 Dell DX Object Storage – File Gateway Deployment Guide 1. Cable the MD3200i as follows: a. Connect the management ports on each controller to the public network. b. Connect the data ports (4 on each controller) to the storage network.
  • Page 39 Dell DX Object Storage – File Gateway Deployment Guide If VLAN, click Advanced IPv4 Settings and enter VLAN information. g. Click OK. h. Check Manage iSCSI Settings and Target Authentication set to None. 8. From a root login on the CFS node, ping all eight iSCSI IPs to ensure they are working.
  • Page 40 Dell DX Object Storage – File Gateway Deployment Guide 16. Run the following command to log the server into the storage, and create disks in /dev and mapper entries for the multipath disk-mapper volumes. # iscsiadm -m node –l 17. Display all LUNs in the host group.
  • Page 41 Dell DX Object Storage – File Gateway Deployment Guide 22. After all LUNs are added to /etc/fstab, mount the new file systems. # mount –a 23. Use ‘df’ to verify that all are mounted. WARNING: Do NOT mount the drives on the backup node while the file system is mounted on the primary node.
  • Page 42 Dell DX Object Storage – File Gateway Deployment Guide # service iscsi stop # chkconfig iscsi --level 2345 on && chkconfig iscsi --list # chkconfig iscsid --level 2345 on && chkconfig iscsid --list # service iscsi start # service iscsid start # service multipathd start 28.

  • Page 43: Configure The Cluster Name Space (Cns)

    The file system structure, metadata, and DX Object Storage UUIDs are stored in a journaling name space that stores file metadata into Dell DX Object Storage automatically. After installing the CFS server, it is essential to configure a new name space. This is only required during installation;...
  • Page 44 Dell DX Object Storage cluster. To use Zeroconf, the CNS must be in the same subnet with Dell DX Object Storage. If the CNS must be located on a remote subnet, its address must be capable of routing to the subnet that houses Dell DX Object Storage, and its address must be specified.
  • Page 45 Dell DX Object Storage – File Gateway Deployment Guide If you select Yes, complete the following: Cluster name – name of the Dell DX Object Storage cluster. This must match the value of the Dell DX Object Storage "cluster" parameter in the node.cfg file and be the same target cluster as the one configured for all CFS mounts.

  • Page 46: Configure The Cfs And Its Dx Object Storage Mount Points

    Each mount point must have its own unique name and configuration file. All created configuration files will be located in /opt/caringo/fabric/etc/share_name.conf NOTE: Manual editing of this file is not recommended unless under direct advice from a Dell technical support contact.
  • Page 47 Use Zeroconf for CFS configuration? – Specify whether Zeroconf should be used to discover the list of nodes in the Dell DX Object Storage cluster. The CFS server must be in the same subnet as the Dell DX Object Storage cluster to use Zeroconf.

  • Page 48: Configure Gateway Protocols

    In addition to being able to write to a locally mounted Linux file system, the CFS platform design makes it possible to layer network file services over the Dell DX Object Storage mounted file system using any software that makes basic operating system calls to access a file system.

  • Page 49: Stand-Alone Server (Workgroup Authentication)

    Dell DX Object Storage – File Gateway Deployment Guide NOTE: A customer’s gateway can be configured only as standalone (local authentication) server OR as an Active Directory Domain member server. It cannot be configured as both; it must be one or the other.
  • Page 50 Dell DX Object Storage – File Gateway Deployment Guide NOTE: If the site uses a WINS server, add the following to the above: wins server = 123.45.67.89 (where 123.45.67.89 should be replaced with the IP address of the WINS server for the site) 3.
  • Page 51 Dell DX Object Storage – File Gateway Deployment Guide NOTE: This account will be removed or disabled after the administrator account has been established. Create a Linux account as follows: # useradd -m -g 4 administrator # passwd administrator Enter new UNIX password: xxxxxxxxx Retype new UNIX password;...
  • Page 52 Dell DX Object Storage – File Gateway Deployment Guide vii. Delete the root account from the CIFS password back end by running the following command: # pdbedit -u root –x 5. Add a local UNIX group, which is required for shared resource ownership and access control.

  • Page 53: Active Directory Domain Member Server

    Dell DX Object Storage – File Gateway Deployment Guide NEXT STEP: Configure Share Resources Active Directory Domain Member Server NOTE: A customer’s gateway can be configured only as standalone (local authentication) server OR as an Active Directory Domain member server. It cannot be configured as both; it must be one or the other.

  • Page 54: Configure The Smb/Cifs Server

    Dell DX Object Storage – File Gateway Deployment Guide # vi /etc/krb5.conf Edit the file as shown with your domain name information. [libdefaults] default_realm = XYZ.PROJECT.LOCAL [realms] XYZ.PROJECT.LOCAL xxx.xxx.x.xx (AD DNS server; see Site Survey) w2k8r2.xyz.project.local NEXT STEP: Configure the SMB/CIFS Server...
  • Page 55 Dell DX Object Storage – File Gateway Deployment Guide server string = DX Storage security = ADS log level = 1 log file = /var/log/samba/log.%L.%m max log size = 0 smb ports = 445 machine password timeout = 0 load printers = No...
  • Page 56 Dell DX Object Storage – File Gateway Deployment Guide XYZ+jackb 8. Run the following command to obtain the list of Active Directory domain group accounts: # wbinfo –g XYZ+domain computers XYZ+domain controllers XYZ+schema admins XYZ+enterprise admins XYZ+cert publishers XYZ+domain admins...
  • Page 57 Dell DX Object Storage – File Gateway Deployment Guide 11. Obtain a list of groups: # getent group root:x:0: daemon:x:1: bin:x:2: sys:x:3: XYZ+domain computers:x:5000006: XYZ+domain controllers:x:5000007: XYZ+schema admins:x:5000008:XYZ+administrator XYZ+enterprise admins:x:5000009:XYZ+administrator XYZ+cert publishers:x:5000010: XYZ+domain admins:x:5000011:XYZ+administrator XYZ+domain users:x:5000000: XYZ+domain guests:x:5000001: XYZ+group policy creator owners:x:5000012:XYZ+administrator...

  • Page 58: Nfs Gateway Service

    The CFS file system resource can be accessed from a remote UNIX or Linux machine via the NFS version 3. NOTE: Dell does not support NFS version 4 at this time. The following procedure configures NFS server only. After performing the procedure, you must then configure shared resources.

  • Page 59: Smb/Cifs Shared Resource Configuration

    = No use sendfile = Yes NOTE: Replace the share_name with an appropriate name. Dell recommends using the same name as was used to create the CFS mounted resource. The toplevel directory must be created within the CFS mount point because it creates the share-point for CIFS and NFS use.
  • Page 60 Dell DX Object Storage – File Gateway Deployment Guide In the example above, there is a CFS mounted file system resource under the mount point /mnt/share_name. The contents of this directory will be owned by the user gillian and the group Users.

  • Page 61: Add A Share (Active Directory Domain Member)

    [share_name] comment = ShareName path = /mnt/share_name/toplevel read only = No use sendfile = Yes NOTE: Replace the share_name with an appropriate name. Dell recommends using the same name that was used to create the CFS mounted resource. Page 59...

  • Page 62: Remove A Share

    Dell DX Object Storage – File Gateway Deployment Guide Set file system ownership and group ownership for the user and group that will have write access to the shared resource. In the following example there is a CFS mounted file system resource under the mount point /mnt/share_name/toplevel.

  • Page 63: Add An Nfsv3 Share Point

    Dell DX Object Storage – File Gateway Deployment Guide Add an NFSv3 Share Point 1. Add the nfs mount specification - edit the /etc/exports file: The following is a sample entry, using a mount point with the name "CFS1" and specifying a "rw"...

  • Page 64: Shut Down Cfs And Cns

    Gateway Protocol Configuration section of this document then CFS SMB/CIFS and NFS services will automatically be stopped in the correct order as the system is shut down. To manually stop dell SMB/CIFS and NFS services, use the following commands: # service smb stop...

  • Page 65: Special Considerations For Md3200I Spooler

    File Revisions and Dell DX Object Storage File Deletion Each modification to a file stored in CFS creates a new object in Dell DX Object Storage, with CNS keeping track of the modification revision that is current for each file. Old revisions are quickly deleted from the Dell DX Object Storage via a background garbage collection process.

  • Page 66: Custom Metadata

    Custom Metadata The CFS-admin metadata utility allows a root user to administer the custom metadata that is attached to newly created files when they are ready to be stored in the Dell DX Object Storage (last file close plus 5 seconds).

  • Page 67: Cfs / Dx Object Storage Lifecycle Policies

    In addition to custom metadata, the CFS-admin policy utility allows a root user to administer the content storage constraint policy for newly created files that are ready to be stored in Dell DX Object Storage (last file close plus 5 seconds). To add a new policy to a mount point, the following command can be executed: # cfs-admin policy --add [action-options]<CFS-root>...

  • Page 68: Cfs-Grab

    There can be only one such lifepoint. All times are measured from the date the file is created in Dell DX Object Storage and are not relative to each other when using multiple lifepoints. For instance a lifecycle policy that states a file should...

  • Page 69: Cfs-Loglevel

    Appendix A. Temp and Logging Space Configuration Every file that is written to or read from the Dell DX Object Storage cluster will be cached in the location specified for the spooler directory during the installation process. The spooler directory is integral to the internal function of CFS and should never be manually manipulated, particularly while CFS is actively running.

  • Page 70: Appendix B. Gateway Protocol Support

    SMB/CIFS and NFS. Access Control Lists POSIX ACL (Access Control List) metadata will be mapped into the Dell DX Object Storage HTTP SCSP metadata header content only if the underlying file system has been mounted with POSIX compliant ACL support and with Extended Attributes (EAs) enabled.

  • Page 71: Appendix C. Nfs Client Guidelines

    Dell’s supported configurations. NOTE: Other Samba configuration parameters can be set in the [global] stanza, or in a share stanza, that can impact connection protocol behavior. Dell recommends operation of the CFS protocol gateway server only within Dell supported boundaries.

  • Page 72: Appendix D. Cfs Failover

    Dell DX Object Storage – File Gateway Deployment Guide APPENDIX D. CFS Failover For a failover configuration, two identical CFS servers are required, as well as external storage for the CNS cache and spooler directories (as configured earlier in this document.
  • Page 73 Dell DX Object Storage – File Gateway Deployment Guide Also, when the issues that caused the primary server to be taken out of service are resolved, the backup server must be shut down first before the primary is restarted. 2. Mount the CNS cache and spool file systems. Using the examples in the previous section, the...

This manual is also suitable for:

Dx object storage

Table of Contents