Red Hat GFS 6.0 - INSTALLING AND CONFIGURING ORACLE9I RAC Manual

Oracle9i rac

Advertisement

Quick Links

Red Hat GFS
Installing and Configuring
Oracle9i RAC with GFS 6.0

Advertisement

Table of Contents
loading

Summary of Contents for Red Hat GFS 6.0 - INSTALLING AND CONFIGURING ORACLE9I RAC

  • Page 1 Red Hat GFS Installing and Configuring Oracle9i RAC with GFS 6.0...
  • Page 2 All other trademarks referenced herein are the property of their respective owners. The GPG fingerprint of the security@redhat.com key is: CA 20 86 86 2B D6 9D FC 65 F6 EC C4 21 91 80 CD DB 42 A6 0E...
  • Page 3: Table Of Contents

    Table of Contents Introduction............................i 1. Audience ..........................i 2. Related Documentation ......................i 3. Document Conventions ......................i 4. More to Come ........................iv 4.1. Send in Your Feedback ..................iv 5. Activate Your Subscription ....................iv 1. Overview ............................1 1.1.
  • Page 5: Introduction

    HTML and PDF versions of all the Red Hat Enterprise Linux manuals and Release Notes are available online at http://www.redhat.com/docs/. 1. Audience This manual is intended primarily for Oracle database administrators and Linux system administrators...
  • Page 6 Introduction file contains information about different system devices and file systems. /etc/fstab Install the RPM if you want to use a Web server log file analysis program. webalizer application This style indicates that the program is an end-user application (as opposed to system software). For example: Use Mozilla to browse the Web.
  • Page 7 Introduction prompt A prompt, which is a computer’s way of signifying that it is ready for you to input something, is shown in this style. Examples: [stephen@maturin stephen]$ leopard login: user input Text that the user types, either on the command line or into a text box on a GUI screen, is displayed in this style.
  • Page 8: More To Come

    If you spot a typo in Red Hat GFS: Installing and Configuring Oracle9i RAC with GFS 6.0, or if you have thought of a way to make this manual better, we would love to hear from you! Please submit a report in Bugzilla (http://www.redhat.com/bugzilla) against the component rh-gfsog. Be sure to mention the manual’s identifier: rh-gfsog(EN)-6.0-Print-RHI (2005-10-13T14:56)
  • Page 9 Red Hat technical support resources, documentation, and Knowledgebase • If you have forgotten your Red Hat login, you can search for your Red Hat login online at: https://rhn.redhat.com/help/forgot_password.pxt Good luck, and thank you for choosing Red Hat GFS! The Red Hat Documentation Team...
  • Page 10 Introduction...
  • Page 11: Overview

    Chapter 1. Overview This manual provides information about installing and configuring Oracle9i Real Application Clusters (RAC) Release 2 on a Linux cluster that uses Red Hat GFS 6.0. It contains procedures for a sample cluster that can be used as a reference for your cluster. You should use this manual in conjunction with the appropriate guides for installing and maintaining Oracle9i RAC on a Linux cluster, and the Red Hat GFS Administrator’s Guide for Red Hat GFS 6.0.
  • Page 12 Chapter 1. Overview WTI NPS: wti2, wti3 External lock servers: lock1, Private network, lock2, and lock3 Netgear switch WTI NPS wti1 rac1/ rac2/ rac3/ rac4/ racpvt1 racpvt2 racpvt3 racpvt4 Four-node Oracle9i RAC Red Hat GFS cluster Red Hat GFS with Oracle9i RAC QLogic switch HP StorageWorks MSA1000:...
  • Page 13: Ble

    Chapter 1. Overview Lock server lock1 WTI NPS wti2 Lock server lock2 Private network, Netgear switch WTI NPS wti3 NPS wti1 Lock server Four-node lock3 Red Hat GFS cluster with Oracle9i RAC Figure 1-2. Sample Cluster: External Lock Servers The GFS nodes are attached to the MSA1000 array via the QLogic switch. Also, the GFS nodes and the external lock-server nodes are connected to the WTI network power switches (NPS) for fencing.
  • Page 14 Chapter 1. Overview Note The procedures in this manual are based on the assumption that you are using a private network for your Oracle cluster software, and that the Oracle management node is rac1/racpvt1. Node Name IP Address lock1 192.168.100.201 lock2 192.168.100.202 lock3...
  • Page 15: Requirements

    Chapter 1. Overview 1.2. Requirements This section provides hardware requirements (Table 1-5), software requirements (Table 1-6), and sam- ple disk layout information (Table 1-7) for the sample cluster used in this manual. Requirement Description Memory A minimum of 2 GB of RAM on each node; more if Java VM is used Swap space Disk space equal to system’s physical memory or 1 GB, whichever is greater...
  • Page 16: Partitions If Using One Lun

    Chapter 1. Overview You can use the command with FQDNs to make sure that each node can see the other nodes. ping # hosts This file describes a number of hostname-to-address mappings for the TCP/IP subsystem. It is mostly used at boot time, when no name servers are running. On small systems, this file can be used instead of a "named"...
  • Page 17: Installing And Configuring Gfs

    1. Install Red Hat GFS 6.0 RPMs according to the directions in the Red Hat GFS Administrator’s Guide for GFS 6.0 (refer to http://www.redhat.com/docs/manuals/csgfs/admin-guide/). 2. Follow the directions in the Red Hat GFS Administrator’s Guide for GFS 6.0 to prepare and set up the servers to use GFS.
  • Page 18: Configuring Pools

    Chapter 2. Installing and Configuring GFS # up2date perl-Net-Telnet <-- Installs/updates latest perl-Net-Telnet (required for fencing) # chkconfig ntpd on <-- Turns on network time server for next reboot # service ntpd start <-- Starts network time server now ntpd: Synchronizing with time server: Starting ntpd: # ls -al /usr/sbin/stunnel <-- Checks for stunnel (for RILOE fencing only)
  • Page 19 Chapter 2. Installing and Configuring GFS poolname oraraw2 subpools 1 subpool 0 0 1 gfs_data pooldevice 0 0 /dev/sda2 Example 2-3. oraraw2.pool 2. Create and save a pool configuration file for the GFS CCA. The suggested name for the pool is , with the corresponding pool configuration file, (refer to ccs_archive...
  • Page 20: Setting Up The Gfs Configuration

    Chapter 2. Installing and Configuring GFS 5. Create and save a pool configuration file for Oracle system and data files. The suggested name for the pool is , with the corresponding pool configuration file, (refer oradata oradata.pool to Example 2-8). For the sample cluster in this manual, the size of this pool is 60 GB. poolname oradata subpools 1 subpool 0 0 1 gfs_data...
  • Page 21 Chapter 2. Installing and Configuring GFS 2.4. Setting Up the GFS Configuration Setting up the GFS configuration consists of creating the GFS CCS configuration files, creating a CCA from the configuration files, and starting the CCS daemon, , for each node. This section describes ccsd how to create the configuration files, create the CCA for each node, and how to start .
  • Page 22 Chapter 2. Installing and Configuring GFS ### fence.ccs ######################################## fence_devices { wti1 { agent = "fence_wti" ipaddr = "192.168.100.211" login = "root" passwd = "password" wti2 { agent = "fence_wti" ipaddr = "192.168.100.212" login = "root" passwd = "password" wti3 { agent = "fence_wti"...
  • Page 23 Chapter 2. Installing and Configuring GFS rac4.example.com { ip_interfaces { eth0 = "192.168.100.104" fence { power { wti1 { port = 2 lock1.example.com { ip_interfaces { eth0 = "192.168.100.201" fence { power { wti2 { port = 1 lock2.example.com { ip_interfaces { eth0 = "192.168.100.202"...
  • Page 24 Chapter 2. Installing and Configuring GFS 5. For the GFS nodes (rac1, rac2, rac3, and rac4), create a CCA on shared storage. At any GFS node, run the command with the source as the configuration files in ccs_tool create the temporary directory (for example, ) and the destination as /root/GFS/ccstemp/ on the shared storage.
  • Page 25: Starting The Lock Servers

    Chapter 2. Installing and Configuring GFS 2.5. Starting the Lock Servers Starting the lock servers consists of running at each node as follows: lock_gulmd 1. Run on the GFS nodes (rac1, rac2, rac3, rac4) and the lock-server nodes (lock1, lock_gulmd lock2, and lock3): rac1 # lock_gulmd rac2 # lock_gulmd...
  • Page 26 Chapter 2. Installing and Configuring GFS 4. Set up the following raw devices on each node: • /dev/raw/raw1 • /dev/raw/raw2 Note Oracle9i RAC requires two raw devices: one for the quorum file and one for the shared config- uration file. 5.
  • Page 27: Installing And Configuring Oracle9I Rac

    Chapter 3. Installing and Configuring Oracle9i RAC This chapter describes how to install and configure Oracle9i RAC for use with Red Hat GFS 6.0, using the sample cluster described in Chapter 1 Overview. This chapter consists of the following sections: Section 3.1 Installation and Configuration Procedure •...
  • Page 28: Preparing Oracle Nodes

    Chapter 3. Installing and Configuring Oracle9i RAC 3.2.2. Setting Up GCC Installing Oracle Database 9.2 requires using GCC 2.96 rather the default GCC 3.2 that ships with Red Hat Enterprise Linux 3. Before installing Oracle, set GCC 2.9.6 as the default GCC as follows: 1.
  • Page 29 Chapter 3. Installing and Configuring Oracle9i RAC 7. Adjust kernel parameters to the values shown in Table 3-1. Note The kernel parameter values are for the example cluster in this manual and may be different for your environment. Kernel Parameter Setting fs.aio-max-size 1048576...
  • Page 30 Chapter 3. Installing and Configuring Oracle9i RAC b. After modifying the file, set the parameters with the command sysctl.conf sysctl -p as follows: # sysctl -p fs.aio-max-size = 1048576 fs.file-max = 327680 fs.aio-max-nr = 1048576 net.ipv4.ip_local_port_range = 1024 65000 net.ipv4.ip_forward = 0 kernel.shmmax = 2147483648 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128...
  • Page 31: Installing And Configuring Oracle Components

    Chapter 3. Installing and Configuring Oracle9i RAC Environment Suggested Value Variable TMPDIR Set a temporary directory path for TMPDIR with at least 100 MB of free space to which the OUI has write permission. ORACLE_SID Set this to what you will call your database instance. This should be a unique value on each node.
  • Page 32: Installing Oracle Cluster Manager

    Chapter 3. Installing and Configuring Oracle9i RAC 3.4.1. Installing Oracle Cluster Manager Installing Oracle Cluster Manager includes using the Red Hat GFS CDPN (Context Dependent Path Name) for the following directories: • $ORACLE_HOME/network • $ORACLE_HOME/oracm Database’s archive directory • To install the Cluster Manager, follow these steps: 1.
  • Page 33: Patching The Cluster Manager

    Chapter 3. Installing and Configuring Oracle9i RAC 11. At the Quorum Disk Information dialog box, type the full name of the raw device that has been mapped to the quorum disk (in the example configuration, oraraw1 /dev/raw/raw1 Click Next. Clicking Next causes a Summary dialog box to be displayed. 12.
  • Page 34: Configuring Cluster Manager

    Chapter 3. Installing and Configuring Oracle9i RAC ### CMCFG.ORA ### HeartBeat=15000 <--------- Added HeartBeat parameter ClusterName=Oracle Cluster Manager, version 9i PollInterval=1000 <--------- Added PollInterval parameter MissCount=215 <--------- Raised to 215 PrivateNodeNames=racpvt1 racpvt2 racpvt3 racpvt4 PublicNodeNames=rac1 rac2 rac3 rac4 ServicePort=9998 KernelModuleName=hangcheck-timer <-- Added, replacing Watchdog timer CmDiskFile=/dev/raw/raw1 HostName=rac1 <--------- Added HostName, using public network name Example 3-2.
  • Page 35: Starting Oracle Cluster Manager

    Chapter 3. Installing and Configuring Oracle9i RAC ### CMCFG.ORA ### HeartBeat=15000 ClusterName=Oracle Cluster Manager, version 9i PollInterval=1000 MissCount=215 PrivateNodeNames=racpvt1 racpvt2 racpvt3 racpvt4 PublicNodeNames=rac1 rac2 rac3 rac4 ServicePort=9998 KernelModuleName=hangcheck-timer CmDiskFile=/dev/raw/raw1 <-- Hostname= set to racpvt1 HostName=racpvt1 Example 3-3. Hostname= Set to racpvt1 3.
  • Page 36: Patching The Rdbms Server

    Chapter 3. Installing and Configuring Oracle9i RAC 5. At the Available Product Components dialog box, ensure that Oracle9i Real Application Cluster 9.2.0.4.0 is selected. Check other components for which you are licensed and click Next. Clicking Next causes the Component Locations dialog box to be displayed. At that dialog box, click Next.
  • Page 37 Chapter 3. Installing and Configuring Oracle9i RAC 3. Create the file; refer to Example 3-6 for a sample file. sqlnet.ora 4. Proceed to Section 3.5.2 Enabling CDPN. network listener_rac1= (DESCRIPTION_LIST = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC)) (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = rac1.example.com)(PORT = 1521)) SID_LIST_LISTENER_RAC1 =...
  • Page 38: Network Cdpn

    Chapter 3. Installing and Configuring Oracle9i RAC (ADDRESS=(PROTOCOL=TCP)(HOST=rac1.example.com)(PORT=1521)) (CONNECT_DATA= (SID = rac1) rac2 = (DESCRIPTION = (ADDRESS_LIST= (ADDRESS=(PROTOCOL=TCP)(HOST=rac2.example.com)(PORT=1521)) (CONNECT_DATA= (SID = rac2) rac3 = (DESCRIPTION = (ADDRESS_LIST= (ADDRESS=(PROTOCOL=TCP)(HOST=rac3.example.com)(PORT=1521)) (CONNECT_DATA= (SID = rac3) rac4 = (DESCRIPTION = (ADDRESS_LIST= (ADDRESS=(PROTOCOL=TCP)(HOST=rac4.example.com)(PORT=1521)) (CONNECT_DATA= (SID = rac4) Example 3-5.
  • Page 39: Setting Up The Cluster Configuration File

    Chapter 3. Installing and Configuring Oracle9i RAC 4. At each node, navigate to the directory and edit the $ORACLE_HOME/network/admin file to reflect the node-specific information. listener.ora 5. After you have edited the node-specific information in the file, start your lis- listener.ora tener and test your configuration.
  • Page 40 Chapter 3. Installing and Configuring Oracle9i RAC You can create a database either manually or by using the Oracle DBCA (Database Configuration Assistant). Create the database from the master node only. To set up the database follow these steps: 1. In the file, use the pound sign (#) to comment out the local_listener parameter init.ora of each node except the one from which you are working.
  • Page 41 Chapter 3. Installing and Configuring Oracle9i RAC 5. Start the database instances from the respective nodes using (the preferred method) or srvctl SQL*Plus. For example: srvctl $ srvctl start instance -d mydb -i mydb2 b. SQL*Plus $ sqlplus /nolog SQL> connect / as sysdba SQL>...
  • Page 42 Chapter 3. Installing and Configuring Oracle9i RAC...
  • Page 43: Index

    Index installing GFS, 7, 7 procedures, 7 introduction, i intended audience, i audience, i lock server cluster, sample, 1 starting, 15 configuration setting up, 11 configuring GFS, 7 procedures, 7 Oracle9i RAC conventions compatibility environment document, i setting up, 17 configuring, 17 procedure, 17 configuring components, 21...
  • Page 44 sample cluster GFS node names and IP addresses ta- ble, 3 sample cluster lock-server node names and IP ad- dresses table, 4 sample cluster network power switch node names and IP addresses table, 4 sample cluster storage table, 4 sample disk layout table, 5 software requirements table, 5 tables hardware requirements, 5...
  • Page 45: Colophon

    Colophon The manuals are written in DocBook SGML v4.1 format. The HTML and PDF formats are produced using custom DSSSL stylesheets and custom jade wrapper scripts. The DocBook SGML files are written using Emacs with the help of PSGML mode. Garrett LeSage created the admonition graphics (note, tip, important, caution, and warning).
  • Page 46 Ankitkumar Rameshchandra Patel — Gujarati translations Rajesh Ranjan — Hindi translations Nadine Richter — German translations Audrey Simons — French translations Francesco Valente — Italian translations Sarah Wang — Simplified Chinese translations Ben Hung-Pin Wu — Traditional Chinese translations Tongjie Tony Fu — Simplified Chinese Translations Manuel Ospina —...

This manual is also suitable for:

Gfs 6.0 -

Table of Contents