移动G3 ORACLE 11g Rac 安装手册
1.前言
2.安装规划
2.1 IP规划
1.使用NTP服务，而不是使用自带的集群时间同步。
2.按照11g RAC的安装建议，建两个用户grid和oracle，分别用于安装管理集群和数据库。
3.使用三个ASM磁盘，组成OCR_VOT磁盘组，冗余为普通，确保OCR和VOTING DISK有个镜像备份。
4.linux版本为Red Hat Enterprise Linux 5.4，oracle版本为11.2.0.3.4。
2.4安装基本步骤
安装过程分了六个步骤：准备工作、安装Grid Infrastructure、创建asm磁盘组、安装oracle软件、建库、验证。
3.安装准备工作
一、配置host信息（双节点执行）
[root@rac01 ~]# vi /etc/hosts
# Public (eth0)
20.222.8.15 rac01
20.222.8.16 rac02
#Private Virtual
20.222.8.17 rac01-vip
20.222.8.18 rac02-vip
#Private Interconnect
192.168.168.1 rac01-priv
192.168.168.2 rac02-priv
#Private
20.222.8.12 rac-scan
完成后用ping分别测试Hosts表里所有主机名，以确保网络正常。
ping -c 3 rac02
ping -c 3 rac02-priv
ping -c 3 zyqwb
ping -c 3 zyqwb-priv
二、检查哪些安装包没有安装（双节点执行）
执行如下命令：
for i in binutils compat-gcc-34 compat-libstdc++-296 control-center \
gcc gcc-c++ glibc glibc-common glibc-devel libaio libgcc elfutils-libelf-devel \
libstdc++ libstdc++-devel libXp make openmotif22 setarch \
compat-libstdc++-33 libaio-devel sysstat unixODBC unixODBC-devel
do
rpm -q $i &>/dev/null || F="$F $i"
done ;echo $F;unset F
根据检查结果安装需要的包。
三、修改内核参数（双节点执行）
vi /etc/sysctl.conf 末尾
#注释掉kernel.shmmax和kernel.shmall两行
添加：
kernel.shmmax = 4398046511104
kernel.shmall = 1073741824
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
fs.aio-max-nr = 1048576
fs.file-max = 6815744
重新加载生效：
[root@rac1 ~]# sysctl –p
四、修改操作系统对oracle、grid用户的限制（双节点执行）
vi /etc/security/limits.conf 末尾添加：
oracle soft nofile 2047
oracle hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft stack 10240
oracle hard stack 32768
grid soft nofile 2047
grid hard nofile 65536
grid soft nproc 2047
grid hard nproc 16384
grid soft stack 10240
grid hard stack 32768
五、修改/etc/pam.d/login文件（双节点执行）
vi /etc/pam.d/login 末尾添加：
session required /lib64/security/pam_limits.so
六、关闭操作系统防火墙和selinux（双节点执行）
service iptables stop
chkconfig iptables off
setenforce 0
getenforce
vi /etc/selinux/config 确保以下内容
SELINUX=disabled
七、配置hangcheck-timer内核模块（双节点执行）
vi /etc/modprobe.conf
在文件末尾增加
options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180
配置为自启动
[root@db1 ~]#vi /etc/rc.d/rc.local
在文件的末尾加入一行：
/sbin/modprobe hangcheck_timer
接着，启动hangcheck：
[root@rac01 ~]# /sbin/modprobe hangcheck_timer
最后，检查hangcheck是否成功启动：
[root@rac01 ~]#grep hangcheck /var/log/messages | tail -2
Aug 26 19:08:17 Mysql1 kernel: Hangcheck: starting hangcheck timer 0.9.0 (tick is 30 seconds, margin is 180 seconds).
八、配置时间服务器（两节点执行）
[root@ rac01~]# vi /etc/ntp.conf
添加一行server 210.12.145.44
[root@ rac01~]# vi /etc/sysconfig/ntpd
OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"
[root@rac01 ~]# service ntpd restart
[root@rac01 ~]# chkconfig ntpd on
九、更改安装所有者的 ulimit 设置（双节点执行）
vi /etc/profile 末尾添加：
if [ /$USER = "oracle" ] || [ $USER = "grid" ]; then
if [ /$SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
umask 022
fi
十、建立必要的用户和组（双节点执行）
groupadd -g 500 oinstall
groupadd -g 501 dba
groupadd -g 502 oper
groupadd -g asmadmin
groupadd -g asmoper
groupadd -g 602 asmdba
useradd -g oinstall -G dba,asmdba,oper oracle
useradd -g oinstall -G asmadmin,asmdba,asmoper,dba grid
用户和组的说明：
十一、建立安装目录（双节点执行）
mkdir -p /u01/app/oracle/product/grid
mkdir -p /u01/app/oracle/product/db
mkdir -p /u01/grid_base
mkdir -p /u01/oracle_base
chown -R grid:oinstall /u01
chown -R oracle:oinstall /u01/app/oracle/product/db
chown -R oracle:oinstall /u01/oracle_base
chown -R grid:oinstall /u01/grid_base
chmod -R 775 /u01
十二、设置oracle和grid用户的环境变量
oracle用户 vi .bash_profile
PATH=$PATH:$HOME/bin
export ORACLE_BASE=/u01/oracle_base
export ORACLE_HOME=/u01/app/oracle/product/db
export ORACLE_SID=orcl1
export ORACLE_OWNER=oracle
export ORACLE_TERM=vt100
export PATH=$PATH:$ORACLE_HOME/bin:$HOME/bin
export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/Apache/Apache/bin:$PATH
LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib:/usr/local/lib
export LD_LIBRARY_PATH
CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib
CLASSPATH=$CLASSPATH:$ORACLE_HOME/network/jlib
export CLASSPATH
set -o vi
export LANG=zh_CN.GBK
export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK
export PATH
grid 用户 vi .bash_profile
export ORACLE_SID=+ASM1
export ORACLE_BASE=/u01/grid_base
export ORACLE_HOME=/u01/app/oracle/product/grid
export ORACLE_TERM=xterm
export TMP=/tmp
export TMPDIR=$TMP
PATH=$PATH:$HOME/bin
export PATH=/usr/sbin:$PATH:$ORACLE_HOME/bin:$PATH
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib
set -o vi
export LANG=zh_CN.GBK
PATH=$PATH:$HOME/bin
export PATH
十三、配置SSH互信(grid和oracle）（双节点执行）
①以oracle和grid用户登录 oracle用户的根目录内创建.ssh目录并设置读取权限
mkdir ~/.ssh
chmod 700 ~/.ssh
cd ~/.ssh
②使用ssh-keygen命令生成基于SSH协议的RSA密钥
cd ~/.ssh
ssh-keygen -t rsa
ssh-keygen -t dsa
③在主节点上执行
cd ~/.ssh
ssh zyqdywa cat /home/grid/.ssh/id_rsa.pub >> authorized_keys
ssh zyqdywb cat /home/grid/.ssh/id_rsa.pub >> authorized_keys
chmod 600 ~/.ssh/authorized_keys
scp authorized_keys zyqdywb:/home/grid/.ssh/
配置完后进行测试
ssh rac01 date
ssh rac02 date
ssh rac01-vip date
ssh rac02-vip date
ssh rac01-priv date
ssh rac02-priv date
十四、安载asm包（双节点执行）
①查看本机内核版本：
[root@rac01]# uname -rm
2.6.18-274.el5 x86_64
②到以下网址下载对应操作系统版本的三个asm包：
http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html
③把下载下来的asm包上传到两个节点，并安装，注意按照以下安装顺序
[root@rac1 ~]# rpm -ivh oracleasm-support-2.1.7-1.el5.x86_64.rpm
warning: oracleasm-support-2.1.7-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
Preparing... ########################################### [100%]
1:oracleasm-support ########################################### [100%]
[root@rac1 ~]# rpm -ivh oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpm
warning: oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
Preparing... ########################################### [100%]
1:oracleasm-2.6.18-274.el########################################### [100%]
[root@rac1 ~]# rpm -ivh oracleasmlib-2.0.4-1.el5.x86_64.rpm
warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
Preparing... ########################################### [100%]
1:oracleasmlib ########################################### [100%]
十五、ASM配置（双节点执行）
[root@ rac01~]# /etc/init.d/oracleasm configure
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver: [ OK ]
Scanning the system for Oracle ASMLib disks: [ OK ]
十六、共享磁盘分区
分为6个区，三个20G分区用于存放OCR+VOT、500G分区用于存放DATA，500G分区用于存放flash_recovery_area。
①在任意一个节点执行fdisk /dev/sdd：
[root@rac2 ~]# fdisk /dev/sda
WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
switch off the mode (command 'c') and change display units to
sectors (command 'u').
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-145737, default 1):
Using default value 1
Last cylinder, +cylinders or +size{K,M,G} (1-145737, default 145737): +20G
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 2
First cylinder (2613-145737, default 2613):
Using default value 2613
Last cylinder, +cylinders or +size{K,M,G} (2613-145737, default 145737): +20G
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 3
First cylinder (5225-145737, default 5225):
Using default value 5225
Last cylinder, +cylinders or +size{K,M,G} (5225-145737, default 145737): +20G
Command (m for help): n
Command action
e extended
p primary partition (1-4)
e
Selected partition 4
First cylinder (7837-145737, default 7837):
Using default value 7837
Last cylinder, +cylinders or +size{K,M,G} (7837-145737, default 145737):
Using default value 145737
Command (m for help): n
First cylinder (7837-145737, default 7837):
Using default value 7837
Last cylinder, +cylinders or +size{K,M,G} (7837-145737, default 145737): +700G
Command (m for help): n
First cylinder (99217-145737, default 99217):
Using default value 99217
Last cylinder, +cylinders or +size{K,M,G} (99217-145737, default 145737):
Using default value 145737
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
②另一个节点同步一下磁盘信息
[root@rac02~]# partprobe
[root@rac02 ~]# ls /dev/sd*
/dev/sda /dev/sda1 /dev/sda2 /dev/sdb /dev/sdc /dev/sdd /dev/sdd1 /dev/sdd2 /dev/sdd3 /dev/sdd4
十六、创建ASM磁盘
/etc/init.d/oracleasm createdisk OCR_VOT1 /dev/sde1
/etc/init.d/oracleasm createdisk OCR_VOT1 /dev/sde2
/etc/init.d/oracleasm createdisk OCR_VOT1 /dev/sde3
/etc/init.d/oracleasm createdisk DATA /dev/sdd1
/etc/init.d/oracleasm createdisk FRA /dev/sdc2
查看磁盘
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d DATA
Disk "DATA" is a valid ASM disk on device /dev/sdd1[8,49]
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d FAR
Disk "FAR" does not exist or is not instantiated
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d FRA
Disk "FRA" is a valid ASM disk on device /dev/sdc2[8,34]
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d OCR VOT
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d OCR_VOT1
Disk "OCR_VOT1" is a valid ASM disk on device /dev/sde1[8,65]
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d OCR_VOT2
Disk "OCR_VOT2" is a valid ASM disk on device /dev/sde2[8,66]
[root@zyqdywa ~]# /etc/init.d/oracleasm querydisk -d OCR_VOT3
Disk "OCR_VOT3" is a valid ASM disk on device /dev/sde3[8,67]
十七、扫描ASM磁盘，检查有哪些asm磁盘（双节点执行）
/etc/init.d/oracleasm scandisks
/etc/init.d/oracleasm listdisks
[root@rac01 ~]# /etc/init.d/oracleasm scandisks
Scanning the system for Oracle ASMLib disks:
[ OK ]
[root@rac01 ~]# /etc/init.d/oracleasm listdisks
DATA
FRA
OCR_VOT1
OCR_VOT2
OCR_VOT3
[root@rac02 ~]# /etc/init.d/oracleasm scandisks
Scanning the system for Oracle ASMLib disks: [ OK ]
[root@rac02 ~]# /etc/init.d/oracleasm listdisks
DATA
FRA
OCR_VOT1
OCR_VOT2
OCR_VOT3
十七、DNS服务器配置
①按要求安装如下安装包
bind-chroot-9.3.6-20.P1.el5
bind-libs-9.3.6-20.P1.el5
bind-utils-9.3.6-20.P1.el5
bind-9.3.6-20.P1.el5
caching-nameserver-9.3.6-20.P1.el5.x86_64.rpm
②加主机和用户提示信息
vi /etc/bashrc
第39行下加:(if [ "$PS1" ]; then --这个判断结束后,即看到fi后面加)
#add by jiangg 2013.07.03 for common user has prompt
[ "$PS1" = "\\s-\\v\\\$ " ] && PS1="[\u@\h \W]\\$ "
vi resolv.conf
options attempts: 2
options timeout: 1
search localdomain
nameserver 127.0.0.1
修改named.rfc1912.zones文件
vi named.rfc1912.zones
// named.rfc1912.zones:
//
// Provided by Red Hat caching-nameserver package
//
// ISC BIND named zone configuration for zones recommended by
// RFC 1912 section 4.1 : localhost TLDs and address zones
//
// See /usr/share/doc/bind*/sample/ for example named configuration files.
//
zone "." IN {
type hint;
file "/dev/null"; //这里需要修改为/dev/null
};
zone "localdomain" IN {
type master;
file "localdomain.zone";
allow-update { none; };
};
zone "localhost" IN {
type master;
file "localhost.zone";
allow-update { none; };
};
zone "0.0.127.in-addr.arpa" IN {
type master;
file "named.local";
allow-update { none; };
};
// 这里需要增加
zone "8.222.10.in-addr.arpa" IN {
type master;
file "8.222.10.in-addr.arpa"; //反向查询文件名 文件名是ip地址的前3位倒着的 在下面会用到这个文件名
allow-update { none; };
};
// 增加结束
zone "0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa" IN {
type master;
file "named.ip6.local";
allow-update { none; };
};
zone "255.in-addr.arpa" IN {
type master;
file "named.broadcast";
allow-update { none; };
};
zone "0.in-addr.arpa" IN {
type master;
file "named.zero";
allow-update { none; };
};
修改:named.caching-nameserver.conf
vi named.caching-nameserver.conf
//
// named.caching-nameserver.conf
//
// Provided by Red Hat caching-nameserver package to configure the
// ISC BIND named(8) DNS server as a caching only nameserver
// (as a localhost DNS resolver only).
//
// See /usr/share/doc/bind*/sample/ for example named configuration files.
//
// DO NOT EDIT THIS FILE - use system-config-bind or an editor
// to create named.conf - edits to this file will be lost on
// caching-nameserver package upgrade.
//
options {
listen-on port 53 { 127.0.0.1; };
listen-on-v6 port 53 { ::1; };
directory "/var/named";
dump-file "/var/named/data/cache_dump.db";
statistics-file "/var/named/data/named_stats.txt";
memstatistics-file "/var/named/data/named_mem_stats.txt";
// Those options should be used carefully because they disable port
// randomization
// query-source port 53;
// query-source-v6 port 53;
allow-query { any; }; //修改为any
allow-query-cache { any; }; //修改为any
};
logging {
channel default_debug {
file "data/named.run";
severity dynamic;
};
};
view localhost_resolver {
match-clients { any; }; //修改为any
match-destinations { any; }; //修改为any
recursion yes;
include "/etc/named.rfc1912.zones";
};
③修改文件:/var/named/chroot//var/named/4.242.10.in-addr.arpa
文件名是ip地址的前3位倒着的，下面是ip地址的最后一位，主机名是/etc/hosts里面配置的
内容如下:
$TTL 86400
@ IN SOA localhost. root.localhost. (
42 ; serial (d. adams)
3H ; refresh
15M ; retry
1W ; expiry
1D ) ; minimum
IN NS localhost.
13 IN PTR RAC01
14 IN PTR RAC02
9 IN PTR RAC01-vip
20 IN PTR RAC02-vip
3 IN PTR RAC01-priv
4 IN PTR RAC02-priv
vi localdomain.zone 增加:
rac01 IN A 10.242.4.15
rac02 IN A 10.242.4.16
rac01-vip IN A 10.242.4.17
rac02-vip IN A 10.242.4.18
rac01-priv IN A 192.168.168.1
rac02-priv IN A 192.168.168.2
在/var/named目录下做个链接
ln -s /var/named/chroot//var/named/4.242.10.in-addr.arpa 4.242.10.in-addr.arpa
service named restart --如果不报错则配置正常
DNS配置测试
[root@rac01 named]# nslookup
> rac01 ---解析测试
Server: 127.0.0.1
Address: 127.0.0.1#53
Name: rac01.localdomain
Address: 10.242.4.15
> 10.242.4.15 --反向解析测试
Server: 127.0.0.1
Address: 127.0.0.1#53
15.4.242.10.in-addr.arpa name = rac01.4.242.10.in-addr.arpa.
4.安装Grid Infrastructure
安装grid中的rpm包
[grid@rac001 ~]$ cd /u01
[grid@rac001 u01]$ ls
app database grid_base oracle_base p10404530_112030_Linux-x86-64_1of7.zip p10404530_112030_Linux-x86-64_3of7.zip
a.sh grid lost+found oraInventory p10404530_112030_Linux-x86-64_2of7.zip
[grid@rac001 u01]$ cd grid
[grid@rac001 grid]$ ls
doc install readme.html response rpm runcluvfy.sh runInstaller sshsetup stage welcome.html
[grid@rac001 grid]$ cd rpm
[grid@rac001 rpm]$ ls
cvuqdisk-1.0.9-1.rpm
[grid@rac001 rpm]$ rpm -ivh cvuqdisk-1.0.9-1.rpm
[grid@rac001 grid]$ ls
doc install readme.html response rpm runcluvfy.sh runInstaller sshsetup stage welcome.html
[grid@rac001 grid]$ ./runInstaller
安装步骤参见如下图：
按照之前的安装准备不会报错，这个图上从其他安装手册中摘取。选择“修补并再次检查”，然后就没有问题了。
到65%时会卡很久
第一个脚本运行：
[root@rac1 ~]# /u01/oraInventory/orainstRoot.sh
更改权限/u01/oraInventory.
添加组的读取和写入权限。
删除全局的读取, 写入和执行权限。
更改组名/u01/oraInventory 到 oinstall.
脚本的执行已完成。
[root@rac2 ~]# /u01/oraInventory/orainstRoot.sh
更改权限/u01/oraInventory.
添加组的读取和写入权限。
删除全局的读取, 写入和执行权限。
更改组名/u01/oraInventory 到 oinstall.
脚本的执行已完成。
第二个root脚本运行：
[root@rac1 ~]# /u01/grid/crs/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/grid/crs
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/grid/crs/crs/install/crsconfig_params
Creating trace directory
OLR initialization - successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding Clusterware entries to inittab
CRS-2612: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2612: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2612: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2612: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2612: Attempting to start 'ora.cssd' on 'rac1'
CRS-2612: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
已成功创建并启动 ASM。
已成功创建磁盘组OCR_VOT。
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-4256: Updating the profile
Successful addition of voting disk 0e236dcf842a4f54bf455b392be6192f.
Successful addition of voting disk 2c430d5e8dae4f97bf03bed005d26ed1.
Successful addition of voting disk 16f4ea0f02334fa7bff39c6e1a73af5c.
Successfully replaced voting disk group with +OCR_VOT.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 0e236dcf842a4f54bf455b392be6192f (ORCL:OCR_VOT1) [OCR_VOT]
2. ONLINE 2c430d5e8dae4f97bf03bed005d26ed1 (ORCL:OCR_VOT2) [OCR_VOT]
3. ONLINE 16f4ea0f02334fa7bff39c6e1a73af5c (ORCL:OCR_VOT3) [OCR_VOT]
Located 3 voting disk(s).
CRS-2612: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2612: Attempting to start 'ora.OCR_VOT.dg' on 'rac1'
CRS-2676: Start of 'ora.OCR_VOT.dg' on 'rac1' succeeded
CRS-2612: Attempting to start 'ora.registry.acfs' on 'rac1'
CRS-2676: Start of 'ora.registry.acfs' on 'rac1' succeeded
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@rac2 ~]# /u01/grid/crs/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/grid/crs
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/grid/crs/crs/install/crsconfig_params
Creating trace directory
OLR initialization - successful
Adding Clusterware entries to inittab
CRS-4402: CSS 守护程序已在独占模式下启动, 但在节点 rac1 (编号为 1) 上发现活动 CSS 守护程序, 因此正在终止
An active cluster was found during exclusive startup, restarting to join the cluster
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
两个root脚本在每个节点都运行完后，点下图“确定”
检查集群：
[root@rac1 ~]# su - grid
[grid@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac1
ora.OCR_VOT.dg ora....up.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac1
ora.ons ora.ons.type ONLINE ONLINE rac1
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type ONLINE ONLINE rac1
[grid@rac2 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac1
ora.OCR_VOT.dg ora....up.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac1
ora.ons ora.ons.type ONLINE ONLINE rac1
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type ONLINE ONLINE rac1
gsd结尾的为兼容9i的服务，可以不用启动。
5.创建ASM磁盘组
任一节点，grid用户下执行：
[grid@rac1 ~]$ asmca
6.安装oracle软件
oot@rac1 ~]# su - oracle
[oracle@rac1 ~]$ export DISPLAY=192.168.10.100:0
[oracle@rac1 ~]$ cd linux.x64_11gR2_database/database/
[oracle@rac1 database]$ ls
doc install response rpm runInstaller sshsetup stage welcome.html
[oracle@rac1 database]$ ./runInstaller
这一步执行会较慢，但从不会出任何问题。
执行root脚本：
[root@rac1 ~]# /u01/oracle/db/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/oracle/db
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
[root@rac1 ~]#
[root@rac2 ~]# /u01/oracle/db/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/oracle/db
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
7.建库
[oracle@rac1 database]$ cd
[oracle@rac1 ~]$ dbca
输入安装集群套件时输入的密码。
8.验证
1.启动em验证
2.登录sqlplus检查
[oracle@rac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 11.2.0.3.0 Production on Wed Feb 6 12:32:31 2013
Copyright (c) 1982, 2011, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
SQL> select instance_name,thread#,status from gv$instance;
INSTANCE_NAME THREAD# STATUS
---------------- ---------- ------------
orcl1 1 OPEN
orcl2 2 OPEN
3.ifconfig
[root@rac1 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:1C:C4:94:FE:E2
inet addr:192.168.100.11 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:100374287 errors:0 dropped:0 overruns:0 frame:0
TX packets:57515528 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:147024465944 (136.9 GiB) TX bytes:12855403946 (11.9 GiB)
Interrupt:169 Memory:f8000000-f8012800
eth0:1 Link encap:Ethernet HWaddr 00:1C:C4:94:FE:E2
inet addr:192.168.100.73 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:169 Memory:f8000000-f8012800
eth0:2 Link encap:Ethernet HWaddr 00:1C:C4:94:FE:E2
inet addr:192.168.100.10 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:169 Memory:f8000000-f8012800
eth1 Link encap:Ethernet HWaddr 00:1C:C4:94:FE:E4
inet addr:10.10.10.11 Bcast:10.10.10.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:254733 errors:0 dropped:0 overruns:0 frame:0
TX packets:256419 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:166043120 (158.3 MiB) TX bytes:167730902 (159.9 MiB)
Interrupt:177 Memory:fa000000-fa012800
eth1:1 Link encap:Ethernet HWaddr 00:1C:C4:94:FE:E4
inet addr:169.254.27.106 Bcast:169.254.255.255 Mask:255.255.0.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:177 Memory:fa000000-fa012800
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:346324 errors:0 dropped:0 overruns:0 frame:0
TX packets:346324 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:129091626 (123.1 MiB) TX bytes:129091626 (123.1 MiB)
[root@rac2 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr F4:CE:46:85:4A:28
inet addr:192.168.100.12 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5633955 errors:0 dropped:0 overruns:0 frame:0
TX packets:3008528 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8209477605 (7.6 GiB) TX bytes:305969597 (291.7 MiB)
Interrupt:138 Memory:f8000000-f8012800
eth0:1 Link encap:Ethernet HWaddr F4:CE:46:85:4A:28
inet addr:192.168.100.74 Bcast:192.168.100.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:138 Memory:f8000000-f8012800
eth1 Link encap:Ethernet HWaddr F4:CE:46:85:4A:2A
inet addr:10.10.10.12 Bcast:10.10.10.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:210104 errors:0 dropped:0 overruns:0 frame:0
TX packets:191206 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:149256679 (142.3 MiB) TX bytes:130258323 (124.2 MiB)
Interrupt:146 Memory:f6000000-f6012800
eth1:1 Link encap:Ethernet HWaddr F4:CE:46:85:4A:2A
inet addr:169.254.212.206 Bcast:169.254.255.255 Mask:255.255.0.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:146 Memory:f6000000-f6012800
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:69682 errors:0 dropped:0 overruns:0 frame:0
TX packets:69682 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:21518420 (20.5 MiB) TX bytes:21518420 (20.5 MiB)
