Red Hat CLUSTER SUITE 4.7 DM MULTIPATH Configuration And Administration Manual

Advertisement

Quick Links

Red Hat Cluster Suite 4.7
DM Multipath
DM Multipath Configuration and Administration

Advertisement

Table of Contents
loading

Summary of Contents for Red Hat CLUSTER SUITE 4.7 DM MULTIPATH

  • Page 1 Red Hat Cluster Suite 4.7 DM Multipath DM Multipath Configuration and Administration...
  • Page 2 All other trademarks referenced herein are the property of their respective owners. The GPG fingerprint of the security@redhat.com key is: CA 20 86 86 2B D6 9D FC 65 F6 EC C4 21 91 80 CD DB 42 A6 0E...
  • Page 3: Table Of Contents

    Preface 1. Audience ........................v 2. Related Documentation ....................v 3. Feedback ........................vi 4. Document Conventions ....................vi 4.1. Typographic Conventions ..................vi 4.2. Pull-quote Conventions ..................viii 4.3. Notes and Warnings ................... viii 1. Device Mapper Multipathing 1.1. Overview of DM-Multipath ..................... 1 1.2.
  • Page 5: Preface

    • Red Hat Cluster Suite Release Notes — Provides information about the current release of Red Hat Cluster Suite. Red Hat Cluster Suite documentation and other Red Hat documents are available in HTML and PDF versions online at the following location: http://www.redhat.com/docs...
  • Page 6: Feedback

    3. Feedback If you spot a typo, or if you have thought of a way to make this manual better, we would love to hear from you. Please submit a report in Bugzilla (http://bugzilla.redhat.com/bugzilla/) against the component rh-cs. Be sure to mention the manual's identifier: rh-MPIO(EN)-4.7 (2008-07-31T15:20)
  • Page 7 Typographic Conventions The first sentence highlights the particular key cap to press. The second highlights two sets of three key caps, each set pressed simultaneously. If source code is discussed, class names, methods, functions, variable names and returned values mentioned within a paragraph will be presented as above, in Mono-spaced Bold. For example: File-related classes include filesystem for file systems, file for files, and dir for directories.
  • Page 8: Pull-Quote Conventions

    Preface Aside from standard usage for presenting the title of a work, italics denotes the first use of a new and important term. For example: When the Apache HTTP Server accepts requests, it dispatches child processes or threads to handle them. This group of child processes or threads is known as a server-pool.
  • Page 9 Notes and Warnings Note A note is a tip or shortcut or alternative approach to the task at hand. Ignoring a note should have no negative consequences, but you might miss out on a trick that makes your life easier. Important Important boxes detail things that are easily missed: configuration changes that only apply to the current session, or services that need restarting before an update will...
  • Page 11: Device Mapper Multipathing

    Chapter 1. Device Mapper Multipathing Device Mapper Multipathing (DM-Multipath) allows you to configure multiple I/O paths between server nodes and storage arrays into a single device. These I/O paths are physical SAN connections that can include separate cables, switches, and controllers. Multipathing aggregates the I/O paths, creating a new device that consists of the aggregated paths.
  • Page 12 Chapter 1. Device Mapper Multipathing • HBA failure • FC cable failure • SAN switch failure • Array controller port failure With DM-Multipath configured, a failure at any of these points will cause DM-Multipath to switch to the alternate I/O path. Figure 1.2, “Active/Passive Multipath Configuration with Two RAID Devices”...
  • Page 13: Storage Array Support

    Storage Array Support In this configuration, I/O can be spread among those four paths. Figure 1.3. Active/Active Multipath Configuration with One RAID Device 1.2. Storage Array Support By default, DM-Multipath includes support for the most common storage arrays that support DM- Multipath.
  • Page 14: Dm-Multipath Setup Overview

    Chapter 1. Device Mapper Multipathing Component Description kpartx command Creates device mapper devices for the partitions on a device It is necessary to use this command for DOS-based partitions with DM- MP. The kpartx is provided in its own package, but the device- mapper-multipath package depends on it.
  • Page 15: Multipath Devices

    Chapter 2. Multipath Devices Without DM-Multipath, each path from a server node to a storage controller is treated by the system as a separate device, even when the I/O path connects the same server node to the same storage controller. DM-Multipath provides a way of organizing the I/O paths logically, by creating a single multipath device on top of the underlying devices.
  • Page 16: Multipath Device Attributes

    Chapter 2. Multipath Devices a cluster. For information on the multipaths section of the multipath configuration file, see see Section 4.4, “Multipaths Device Configuration Attributes”. • If you want the system-defined user-friendly names to be consistent across all nodes in the cluster, set up all of the multipath devices on one machine.
  • Page 17: Setting Up Dm-Multipath

    Chapter 3. Setting Up DM-Multipath This chapter provides step-by-step example procedures for configuring DM-Multipath. It includes the following procedures: • Basic DM-Multipath setup • Ignoring local disks • Adding more devices to the configuration file 3.1. Setting Up DM-Multipath Before setting up DM-Multipath on your system, ensure that your system has been updated and includes the device-mapper-multipath package.
  • Page 18: Ignoring Local Disks When Generating Multipath Devices

    Chapter 3. Setting Up DM-Multipath multipath -v2 The multipath -v2 command prints out multipathed paths that show which devices are multipathed. If the command does not print anything out, ensure that all SAN connections are set up properly and the system is multipathed. Section 5.1, “Multipath For further information on the multipath command output, see Command...
  • Page 19 Ignoring Local Disks when Generating Multipath Devices \_ round-robin 0 \_ 2:0:0:1 sdc 8:32 \_ 3:0:0:1 sdg 8:96 create: 3600a0b80001327d800000070436216b3 [size=12 GB][features="0"][hwhandler="0"] \_ round-robin 0 \_ 2:0:0:2 sdd 8:48 \_ 3:0:0:2 sdh 8:112 create: 3600a0b80001327510000009b4362163e [size=12 GB][features="0"][hwhandler="0"] \_ round-robin 0 \_ 2:0:0:3 sde 8:64 \_ 3:0:0:3 sdi...
  • Page 20: Adding Devices To The Multipathing Database

    Chapter 3. Setting Up DM-Multipath [size=12 GB][features="0"][hwhandler="0"] \_ round-robin 0 \_ 2:0:0:1 sdc 8:32 \_ 3:0:0:1 sdg 8:96 create: 3600a0b80001327d800000070436216b3 [size=12 GB][features="0"][hwhandler="0"] \_ round-robin 0 \_ 2:0:0:2 sdd 8:48 \_ 3:0:0:2 sdh 8:112 create: 3600a0b80001327510000009b4362163e [size=12 GB][features="0"][hwhandler="0"] \_ round-robin 0 \_ 2:0:0:3 sde 8:64 \_ 3:0:0:3 sdi...
  • Page 21: The Dm-Multipath Configuration File

    Chapter 4. The DM-Multipath Configuration File By default, DM-Multipath provides configuration values for the most common uses of multipathing. In addition, DM-Multipath includes support for the most common storage arrays that support DM- Multipath. The default configuration values and the supported devices can be found in the /usr/ share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults file.
  • Page 22: Configuration File Blacklist

    Chapter 4. The DM-Multipath Configuration File When the system determines the attributes of a multipath device, first it checks the multipath settings, then the per devices settings, then the multipath system defaults. 4.2. Configuration File Blacklist The devnode_blacklist section of the multipath configuration file specifies the devices that will not be used when the system configures multipath devices.
  • Page 23: Configuration File Defaults

    Configuration File Defaults devnode_blacklist { devnode "^sd[a-z]" You can use a devnode entry in the blacklist section of the configuraion file to specify individual devices to blacklist rather than all devices of specific type; this is not recommended, however. Unless it is statically mapped by udev rules, there is no guarantee that a specific device will have the same name on reboot.
  • Page 24 Chapter 4. The DM-Multipath Configuration File To overwrite the default value for any of the configuration parameters, you can copy the relevant line from this template into the defaults section and uncomment it. For example, to overwrite the path_grouping_policy parameter so that it is multibus rather than the default value of failover, copy the appropriate line from the template to the initial defaults section of the configuration file, and uncomment it, as follows.
  • Page 25: Multipaths Device Configuration Attributes

    Multipaths Device Configuration Attributes Attribute Description Specifies the number of I/O requests to route to a path before rr_min_io switching to the next path in the current path group. The default value is 1000. If set to priorities, then instead of sending rr_min_io rr_weight requests to a path before calling selector to choose the next path, the number of requests to send is determined by...
  • Page 26 Chapter 4. The DM-Multipath Configuration File Attribute Description Specifies the WWID of the multipath device to which the wwid multipath attributes apply. Specifies the symbolic name for the multipath device to which the alias multipath attributes apply. Specifies the default path grouping policy to apply to unspecified path_grouping_policy multipaths.
  • Page 27: Configuration File Devices

    Configuration File Devices multipaths { multipath { wwid 3600508b4000156d70001200000b0000 alias yellow path_grouping_policy multibus path_checker readsector0 path_selector "round-robin 0" failback manual rr_weight priorities no_path_retry multipath { wwid 1DEC_____321816758474 alias rr_weight priorities 4.5. Configuration File Devices Table 4.3, “Device Attributes” shows the attributes that you can set for each individual storage device in the devices section of the multipath.conf configuration file.
  • Page 28 Chapter 4. The DM-Multipath Configuration File If the device is active/passive, but it automatically switches paths with I/O to the passive path, you need to change the checker function to one that does not send IO/ to the path to test if it is working (otherwise, your device will keep failing over).
  • Page 29 Configuration File Devices Attribute Description Specifies a module that will be used to perform hardware specific hardware_handler actions when switching path groups or handling I/O errors. Possible values include 0, 1 emc, and 1 rdac. The default value is 0. Specifies the number of I/O requests to route to a path before rr_min_io switching to the next path in the current path group.
  • Page 31: Dm-Multipath Administration And Troubleshooting

    Chapter 5. DM-Multipath Administration and Troubleshooting This chapter will provide information on administering DM-Multipath on a running system. It includes sections on the following topics: • Multipath Command Output • Multipath Queries with multipath Command • Multipath Command Options • Multipath Queries with dmsetup Command •...
  • Page 32: Multipath Queries With Multipath Command

    Chapter 5. DM-Multipath Administration and Troubleshooting If the path is up and ready for I/O, the status of the path is ready or active. If the path is down, the status is faulty or failed. The path status is updated periodically by the multipathd daemon based on the polling interval defined in the /etc/multipath.conf file.
  • Page 33: Determining Device Mapper Entries With The Dmsetup Command

    Determining Device Mapper Entries with the dmsetup Command Option Description Remove all multipath devices. Table 5.1. Useful multipath Command Options 5.4. Determining Device Mapper Entries with the dmsetup Command You can use the dmsetup command to find out which device mapper entries match the multipathed devices.
  • Page 34 Chapter 5. DM-Multipath Administration and Troubleshooting The following command sequence ensures that multipath has picked up any changes to the multipath.conf, # multipathd -k > > reconfigure > > CTRL-D Use the following command sequence to ensure that the path checker is working properly. # multipathd -k >...
  • Page 35: Revision History

    Appendix A. Revision History Revision History Revision 1.0...
  • Page 37: Index

    Index DM-Multipath, 7 defaults section multipath.conf file, 13 active/active configuration dev/mapper directory, 5 definition, 1 dev/mpath directory, 5 illustration, 2 device name, 5 active/passive configuration device-mapper-multipath package, 7 definition, 1 devices illustration, 1 adding, 10, 17 alias parameter , 16 devices section configuration file, 5 multipath.conf file, 17...
  • Page 38 Index adding, 10, 17 local disks, ignoring, 8 LVM physical volumes udev_dir parameter, 14 multipath devices, 6 user_friendly_names parameter , 5, 13, 14 lvm.conf file , 6 modprobe command, 7 vendor parameter, 18 multipath command , 3, 7 options, 22 output, 21 World Wide Identifier (WWID), 5 queries, 22...

Table of Contents