组网设计
1、环境配置
配置阿里云的镜像源
cd /etc/yum.repos.d/
mkdir yum_backup
mv 当前目录下所有的repo yum_backup
curl -o /etc/yum.repos.d/Centos-Base.repo http://mirrors.aliyun.com/repo/Centos-8.repo
curl -o /etc/yum.repos.d/Centos-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
1.1 图形化界面配置(必须重启，可能会导致reboot连接不上系统)
centos6安装：
yum groupinstall “X Windows System”
yum groupinstall “Desktop”
yum install -y nautilus-open-terminal
centos7安装：
yum groupinstall “Server with GUI” --skip-broken -y
yum groupinstall “GNOME Desktop” -y
centos8安装:
yum groupinstall GNOME -y
yum grouplist
yum groupinstall “Server with GUI” --skip-broken -y
系统配置：
find / -name “runlevel*.target”
systemctl set-default graphical
[root@openGauss181 rules.d]# ll /usr/lib/systemd/system/default.target
lrwxrwxrwx. 1 root root 16 Dec 21 2021 /usr/lib/systemd/system/default.target -> graphical.target
然后reboot，然后进入节点，查询进程，有如下进程后表示安装成功
[root@openGauss181 rules.d]# ps aux | grep X
root 6895 0.0 0.0 253220 21808 tty1 Sl+ 21:24 0:00 /usr/libexec/Xorg vt1 -displayfd 3 -auth /run/user/42/gdm/Xauthority -nolisten tcp -background none -noreset -keeptty -novtswitch -verbose 3
root 55725 0.0 0.0 12136 1120 pts/0 S+ 21:53 0:00 grep --color=auto X
@注意@： 安装图形化界面后，可能会服务器无法reboot重启
卸载命令：
centos7: yum groupremove “Server with GUI” --skip-broken yum groupremove “GNOME Desktop” -y
centos8: yum groupremove “X Window System” “GNOME” -y
1.2 更改IO调度(需要reboot)
更改IO为deadline，关闭numa和透明大页
vi /etc/default/grub
elevator=deadline transparent_hugepage=never numa=off
GRUB_CMDLINE_LINUX=“crashkernel=auto resume=/dev/mapper/cl-swap rd.lvm.lv=cl/root rd.lvm.lv=cl/swap rhgb quieti elevator=deadline transparent_hugepage=never numa=off”
建议关闭透明大页，每个教程不一样
GRUB_CMDLINE_LINUX=“crashkernel=auto resume=/dev/mapper/cl-swap rd.lvm.lv=cl/root rd.lvm.lv=cl/swap rhgb quieti transparent_hugepage=never”
执行grub2-mkconfig -o /boot/grub2/grub.cfg ，然后重启操作系统reboot
检查是否配置成功：cat /sys/kernel/mm/transparent_hugepage/enabled 返回：always madvise [never]
@注意@： 关闭numa和透明大页，可能影响性能
1.3 关闭selinux（必须重启）
vi /etc/selinux/config
SELINUX=disabled
sed -i “s/SELINUX=enforcing/SELINUX=disabled/” /etc/selinux/config
reboot
测试是否配置成功：getenforce 返回：Disabled
如何不设置或者没有生效，会导致ohasd start failed
1.4 连接磁阵（可能需要reboot）
@前提@：保证前置组网完成，网络联通。
(1) 主机设置： 在DeviceManager上设置主机20.20.20.181
(2) 登录20.20.20.181节点：查看是否有iscsi
rpm -qa | grep iscsi
systemctl start iscsi
(3) 查看启动器：cat /etc/iscsi/initiatorname.iscsi
修改启动器名称：vim /etc/iscsi/initiatorname.iscsi
(4) 登录DeviceManager上 设置启动器，IQN对应/etc/iscsi/initiatorname.iscsi文件中的内容，并关联主机20.20.20.181
(5) 查找发现磁阵 iscsiadm -m discovery -t st -p 30.0.0.10
iscsiadm -m node -l
iscsiadm -m session
rescan-scsi-bus.sh
(6) 如何DeviceManager上启动器和主节的状态显示离线，则systemctl reboot
[root@openGauss181 ~]# systemctl reboot
[root@openGauss181 ~]# Connection to 20.20.20.181 closed by remote host.
Connection to 20.20.20.181 closed.
[root@openGauss115 ~]# ssh 20.20.20.181
root@20.20.20.181’s password:
Activate the web console with: systemctl enable --now cockpit.socket
Last login: Sun Oct 26 06:05:15 2025 from 20.20.20.115
1.5 时间同步配置(必做)
禁止chronyd同步
systemctl stop chronyd
systemctl disable chronyd
mv /etc/chrony.conf /etc/chrony.conf.bak
设置时区(重要)：
timedatectl set-timezone Asia/Shanghai
不做如下操作：
182时间同步：
安装不了npt，用chrony：
yum install -y chrony
vim /etc/chrony.conf
修改：
去掉pool哪一行，加上：
server 20.20.20.54 iburst
systemctl restart chronyd.service
systemctl status chronyd.service
chronyc sources -v
1.6 host解析(必做)
ip不通的都可以用
公共ip：20.20.20.181 opengauss181 20.20.20.182 opengauss182
虚拟ip：20.20.20.251 opengauss181-vip 20.20.20.252 opengauss182-vip
私有/心跳ip：
scan ip一个：20.20.20.250 rac-scan1
vim /etc/hosts/
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
#Public
20.20.20.181 opengauss181
20.20.20.182 opengauss182
#Virtual
20.20.20.251 opengauss181-vip
20.20.20.252 opengauss182-vip
#Private/Heartbeat
192.168.100.181 opengauss181-priv
192.168.100.182 opengauss182-priv
#Scanip
20.20.20.250 rac-scan1
1.7 关闭防火墙(必做)
[root@openGauss181 soft]# systemctl disable firewalld
Removed /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
[root@openGauss181 soft]# systemctl stop firewalld
[root@openGauss181 soft]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
Docs: man:firewalld(1)
Oct 26 07:03:15 openGauss181 systemd[1]: Starting firewalld - dynamic firewall daemon...
Oct 26 07:03:15 openGauss181 systemd[1]: Started firewalld - dynamic firewall daemon.
Oct 26 07:03:15 openGauss181 firewalld[6434]: WARNING: AllowZoneDrifting is enabled. This is considered an insecure configuration option. It will be removed in a future release. Please consider disabling it now.
Dec 02 04:55:59 openGauss181 systemd[1]: Stopping firewalld - dynamic firewall daemon...
Dec 02 04:56:00 openGauss181 systemd[1]: firewalld.service: Succeeded.
Dec 02 04:56:00 openGauss181 systemd[1]: Stopped firewalld - dynamic firewall daemon.
1.8 关闭NetworkManager (不需要做，可能会导致reboot连接不上系统)
systemctl disable NetworkManager
systemctl stop NetworkManager
建议不做，做了reboot 导致系统崩了，无法连接节点
1.9 停止avahi-deamon （必做）
###centos7.4
yum -y install avahi-deamon
###centos8.4
[root@openGauss181 soft]# yum install avahi
Last metadata expiration check: 0:02:56 ago on Tue 02 Dec 2025 05:01:48 AM EST.
Package avahi-0.7-20.el8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
[root@openGauss181 soft]# systemctl disable avahi-daemon.socket avahi-daemon.service
Removed /etc/systemd/system/multi-user.target.wants/avahi-daemon.service.
Removed /etc/systemd/system/sockets.target.wants/avahi-daemon.socket.
Removed /etc/systemd/system/dbus-org.freedesktop.Avahi.service.
[root@openGauss181 soft]# systemctl stop avahi-daemon.socket avahi-daemon.service
1.10 配置NOZEROCONF （必做）
vi /etc/sysconfig/network
NOZEROCONF =yes
echo “NOZEROCONF =yes” >> /etc/sysconfig/network
1.11 内核参数修改（必做）
vi /etc/sysctl.conf
fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500
kernel.panic_on_oops = 1
sysctl -p 使配置生效
1.12 配置用户资源限制（必做）
vi /etc/security/limits.conf
#for oracle 19c rac
grid soft nproc 16384
grid hard nproc 65536
grid soft nofile 32768
grid hard nofile 65536
grid soft stack 32768
grid hard stack 65536
grid soft memlock 3145728
grid hard memlock 3145728
oracle soft nproc 16384
oracle hard nproc 65536
oracle soft nofile 32768 (性能需要配置102400)
oracle hard nofile 65536
oracle soft stack 32768
oracle hard stack 65536
oracle soft memlock 3145728
oracle hard memlock 3145728
vi /etc/pam.d/login
#for oracle 19c rac
session required pam_limits.so
1.13 配置全局profile(不需要配置，配置的太小了)
vim /etc/profile
#this is for oracle user
if [ $USER = "oracle" ]||[ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
umask 022
fi
1.14 依赖安装 （必做）
yum install bc gcc gcc-c++ make gdb cmake glibc ksh
##检验8个
[root@openGauss181 soft]# which bc gcc c++ make gdb cmake ldd ksh
/usr/bin/bc
/usr/bin/gcc
/usr/bin/c++
/usr/bin/make
/usr/bin/gdb
/usr/bin/cmake
/usr/bin/ldd
/usr/bin/ksh
yum install elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc-devel libaio libaio-devel libXrender libXrender-devel libX11 libXau sysstat binutils
检验12个：yum install elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc-devel libaio libaio-devel libXrender libXrender-devel libX11 libXau sysstat binutils | grep x86 | wc -l
[root@openGauss181 soft]# yum install elfutils-libelf elfutils-libelf-devel fontconfig-devel glibc-devel libaio libaio-devel libXrender libXrender-devel libX11 libXau sysstat
Last metadata expiration check: 0:41:19 ago on Tue 02 Dec 2025 05:01:48 AM EST.
Package elfutils-libelf-0.185-1.el8.x86_64 is already installed.
Package elfutils-libelf-devel-0.185-1.el8.x86_64 is already installed.
Package fontconfig-devel-2.13.1-4.el8.x86_64 is already installed.
Package glibc-devel-2.28-164.el8.x86_64 is already installed.
Package libaio-0.3.112-1.el8.x86_64 is already installed.
Package libaio-devel-0.3.112-1.el8.x86_64 is already installed.
Package libXrender-0.9.10-7.el8.x86_64 is already installed.
Package libXrender-devel-0.9.10-7.el8.x86_64 is already installed.
Package libX11-1.6.8-5.el8.x86_64 is already installed.
Package libXau-1.0.9-3.el8.x86_64 is already installed.
Package sysstat-11.7.3-6.el8.x86_64 is already installed.
Package binutils-2.30-108.el8_5.1.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
yum install libXi libXtst libgcc librdmacm-devel libstdc++ libstdc+±devel libxcb smartmontools targetcli unixODBC unixODBC-devel
#校验 11个
[root@openGauss181 soft]# yum install libXi libXtst libgcc librdmacm-devel libstdc++ libstdc++-devel libxcb smartmontools targetcli unixODBC unixODBC-devel
Last metadata expiration check: 0:46:05 ago on Tue 02 Dec 2025 05:01:48 AM EST.
Package libXi-1.7.10-1.el8.x86_64 is already installed.
Package libXtst-1.2.3-7.el8.x86_64 is already installed.
Package libgcc-8.5.0-4.el8_5.x86_64 is already installed.
Package rdma-core-devel-35.0-1.el8.x86_64 is already installed.
Package libstdc++-8.5.0-4.el8_5.x86_64 is already installed.
Package libstdc++-devel-8.5.0-4.el8_5.x86_64 is already installed.
Package libxcb-1.13.1-1.el8.x86_64 is already installed.
Package smartmontools-1:7.1-1.el8.x86_64 is already installed.
Package targetcli-2.1.53-2.el8.noarch is already installed.
Package unixODBC-2.3.7-1.el8.x86_64 is already installed.
Package unixODBC-devel-2.3.7-1.el8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
报错的依赖：
No match for argument: compat-libcap1
No match for argument: compat-libstdc++
去官网手动下载(centos7)：https://yum.oracle.com/repo/OracleLinux/OL7/latest/x86_64/
去阿里云下载(centos8)：没找到，用的el7，实际测试安装centos7的包也可以成功
compat-libcap1 （centos7 = el7）
compat-libstdc++ （centos7 = el7）
wget https://yum.oracle.com/repo/OracleLinux/OL7/latest/x86_64/getPackage/compat-libstdc+±33-3.2.3-72.el7.x86_64.rpm
执行：rpm -ivh xxx.rpm
1.15 配置内存和交换内存
@增加交换内存大小
1.在一个目录中创建一个swap文件，例如：vim /home/swap
2.使用这条命令，新增18G大小的swap
dd if=/dev/zero of=/home/swap bs=1024 count=18432000 ----单位为KB
3.创建交换空间
mkswap /home/swap
4.查看现有swap
free -m
5.启用新增swap
swapon /home/swap
6.检查swap是否增加
free -m
7.修改 /etc/fstab 文件，增加如下内容
/home/swap swap swap defaults 0 0
8.完成扩容
vim /etc/fstab
tmpfs /dev/shm tmpfs defaults,size=378g 0 0
2.用户和目录准备
2.1 添加用户
/usr/sbin/groupadd -g 50001 oinstall
/usr/sbin/groupadd -g 50002 dba
/usr/sbin/groupadd -g 50003 oper
/usr/sbin/groupadd -g 50004 backupdba
/usr/sbin/groupadd -g 50005 dgdba
/usr/sbin/groupadd -g 50006 kmdba
/usr/sbin/groupadd -g 50007 asmdba
/usr/sbin/groupadd -g 50008 asmoper
/usr/sbin/groupadd -g 50009 asmadmin
/usr/sbin/groupadd -g 50010 racdba
/usr/sbin/useradd -u 50011 -g oinstall -G dba,asmdba,asmoper,asmadmin,racdba grid
/usr/sbin/useradd -u 50012 -g oinstall -G dba,oper,backupdba,dgdba,kmdba,asmdba,racdba oracle
echo "oracle" | passwd --stdin oracle
echo "oracle" | passwd --stdin grid
2.2 创建文件
清理和安装目录创建：
rm -f /etc/init.d/ohasd
rm -rf /etc/oracle
rm -f /etc/init.d/init.cssd
rm -f /etc/init.d/init.crs
rm -f /etc/init.d/init.crsd
rm -f /etc/init.d/init.evmd
rm -rf /etc/oracle/scls_scr
rm -f /etc/inittab.crs
rm -f /etc/ohasd
rm -f /etc/oraInst.loc
rm -f /etc/oratab
rm -rf /var/tmp/.oracle
rm -f /etc/oraInst.loc
rm -f /etc/inittab.*
cat /dev/null > /etc/inittab
rm -rf /tmp/*
rm -rf /tmp/.*
mkdir -p /usr1/soft/oracle19.3.0/grid
mkdir -p /usr1/soft/grid
mkdir -p /usr1/soft/oracle
mkdir -p /usr1/soft/oracle/product/19/db_1
chown -R grid:oinstall /usr1
chown -R oracle:oinstall /usr1/soft/oracle
chown oracle:oinstall /usr1/soft/oracle/product/19/db_1
chmod -R 775 /usr1
2.3 环境变量
su - grid
vim .bash_profile
export TMP=/tmp
export TMPDIR=$TMP
export ORACLE_BASE=/usr1/soft/grid
export ORACLE_HOME=/usr1/soft/oracle19.3.0/grid
#export ORACLE_HOME=/usr1/soft/oracle21.3.0/grid
# 节点1是asm1，节点2是asm2
export ORACLE_SID=+ASM1
export PATH=/usr/sbin:$PATH
export PATH=$ORACLE_HOME/bin:$PATH
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib
#export CV_ASSUME_DISTID=RHEL7.6
export CV_ASSUME_DISTID=CENTOS8
export SSH_AUTH_SOCK=0
#节点2
export TMP=/tmp
export TMPDIR=$TMP
export ORACLE_BASE=/usr1/soft/grid
export ORACLE_HOME=/usr1/soft/oracle19.3.0/grid
#export ORACLE_HOME=/usr1/soft/oracle21.3.0/grid
# 节点1是asm1，节点2是asm2
export ORACLE_SID=+ASM2
export PATH=/usr/sbin:$PATH
export PATH=$ORACLE_HOME/bin:$PATH
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib
#export CV_ASSUME_DISTID=RHEL7.6
export CV_ASSUME_DISTID=CENTOS8
export SSH_AUTH_SOCK=0
安装gird的时候可以不用配置oracle用户的环境变量
su - oracle
export ORACLE_BASE=/usr1/soft/oracle/
export ORACLE_HOME=$ORACLE_BASE/product/19/db_1
export ORACLE_SID=racdb1
export PATH=$ORACLE_HOME/bin:$PATH
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
export NLS_LANG=AMERICAN_AMERICA.AL32UTF8
export LC_ALL=en_US.UTF-8
export CV_ASSUME_DISTID=CENTOS8
2.4 安装cvu（至关重要，用于跳过rac的版本检查）
unzip /usr1/soft_bak/pkg/LINUX.X64_193000_grid_home.zip -d /usr1/soft/oracle19.3.0/grid/
export CVUQDISK_GRP=oinstall
rpm -ivh /usr1/soft/oracle19.3.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm
3. dorado和磁盘配置
3.1 划分lun并映射到主机
登录DeviceManager，进行lun的划分并映射
3.2 配置rules.d文件
99-oracle-asmdevices.rules文件名可以自己起一个
vim /etc/udev/rules.d/99-oracle-asmdevices.rules
KERNEL=="sd?*",ENV{ID_SERIAL}=="36d86d17100bbe71b47d7c07300000040",SYMLINK+="asmdisk/OCR3",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd?*",ENV{ID_SERIAL}=="36d86d17100bbe71b47d7c07300000041",SYMLINK+="asmdisk/DATA0",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd?*",ENV{ID_SERIAL}=="36d86d17100bbe71b47d7c07300000042",SYMLINK+="asmdisk/DATA1",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd?*",ENV{ID_SERIAL}=="36d86d17100bbe71b47d7c07300000043",SYMLINK+="asmdisk/DATA2",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd?*",ENV{ID_SERIAL}=="36d86d17100bbe71b47d7c07300000044",SYMLINK+="asmdisk/DATA3",OWNER="grid",GROUP="asmadmin",MODE="0660"
/sbin/udevadm control --reload-rules
/sbin/udevadm trigger --type=devices --action=change
检查ASM磁盘是否生效
ll /dev/asmdisk/
dd if=/dev/zero of=/dev/asmdisk/OCR3 bs=1024 count=1
/usr1/soft/oracle19.3.0/grid/runcluvfy.sh stage -pre crsinst -n opengauss181,opengauss182 -fixup -verbose
4. grid安装(图形化安装，亲测成功)
问题1：缺少libnsl
yum install libnsl
问题2：会出现如下报错：Unexpected error while executing the action at state:‘supportedOSCheck’
解决
vim $ORACLE_HOME/cv/admin/cvu_config
修改如下参数：
CV_ASSUME_DISTID=OEL7.6
问题3：ssh互信问题
ssh是8.0以上版本，两个节点执行以下操作进行规避：
mv /usr/bin/scp /usr/bin/scp.orig
vi /usr/bin/scp
/usr/bin/scp.orig -T $*
chmod 555 /usr/bin/scp
su - grid
rm -rf .ssh/
如果oracle用户同样互信问题，也删除oracle用户下的.ssh
@NOTICE必做@： 如果报错 passwordless ssh connectivity not set up between the following nodes.
vim /etc/ssh/sshd_config 设置PasswordAuthentication和StrictHostKeyChecking为no，并将所有节点的grid用户的.ssh删掉。
PasswordAuthentication no
StrictHostKeyChecking no
@安装完成后必做@：将scp文件修改回去，否则reboot服务器时，由于互信组件问题会导致服务器无法启动
step1：开始执行图形化安装，一定要 安装数据库节点 对应网段一致的 本地windows下执行，比如 将要安装rac的节点是20.20.20.181，一定要在20.20.20.对应网段的windows机器上，用mobaxterm软件登录 数据库安装节点20.20.20.181。
step2: su - oracle 用户
export DISPLAY=20.20.20.210:0.0 /* 20.20.20.210 指需要在哪个windows展示图形化界面的ip地址，通过cmd->ipconfig查看本机windows对应的ip */
xhost+ /* 可能会有警告或者info类型打印提示，可忽略，主要是要保证DISPLAY环境变量正确 */
step3:启动图形化安装程序
cd $ORACLE_HOME
./gridSetup.sh
step4:安装进入图形化界面 - Configuration Option
step5: Cluster Configuration
step6: Grid Plug and Play
step7: Cluster Node Information
step8: Network Interface Usage
step9: Storage Option
step10: Create Grid Infrastucture
step11: Grid Infrastructure Management
step12: Create ASM Disk Group
step13: ASM Password
step14: Operating System Groups
step15: Installation Location
step16: Root script execution
不选择自动运行脚本
step17: Prerequisite Checks
step18: Summary
step19: Install Product
会有弹窗指示 在节点上执行脚本，选择yes
在安装rac的节点上执行脚本，脚本运行的完整步骤如下：
进度到100%之后，会提示一个error，这个不影响，继续往下
step20: Finish
5. grid安装(静默模式安装-草稿版 没成功)
响应文件路径：
su - grid
vim inventory/response/grid_install.rsp
响应文件配置参考：https://blog.csdn.net/u014644574/article/details/135111067
加环境变量
echo “export CV_ASSUME_DISTID=OEL7”/home/oracle/.bash_profile
grid用户进入$ORACLE_HOME
./gridSetup.sh -silent -responseFile /usr1/soft/oracle21.3.0/grid/inventory/response/grid_install.rsp -ignorePrereqFailure -ignoreInternalDriverError
成功后会输出让我们执行两条语句，在节点1执行（第一条有时候不用执行）：
/usr1/soft/oraInventory/orainstRoot.sh
/usr1/soft/oracle21.3.0/grid/root.sh
执行/usr1/soft/oracle21.3.0/grid/root.sh，报错asm磁盘问题
3.用oracle的sshsetup工具
grid目录下
./oui/prov/resources/scripts/sshUserSetup.sh -user grid -hosts “opengauss181 opengauss182” -advanced exverify –confirm
4.ssh降级
https://www.modb.pro/db/1893840629113827328
降级到7.9连不上：修改pam配置，或者把允许pam设为no
5.如何卸载一次grid安装
提前备份好响应文件
./deinstall/deinstall
清理grid、oraInventory目录，目录没了要创建:
/usr1/soft/grid/*
/usr1/soft/oraInventory/*
/usr1/soft/oracle21.3.0/grid/*
解压grid_home到/usr1/soft/oracle21.3.0/grid：
unzip /home/jyn/oracle21c/LINUX.X64_213000_grid_home.zip -d /usr1/soft/oracle21.3.0/grid/
复制响应文件到 /usr1/soft/oracle21.3.0/grid/inventory/response/grid_install.rsp
然后给权限（按第一步）
chmod -R g+w /usr1/soft/oracle21.3.0
chown -R grid:oinstall /usr1/soft/oracle21.3.0
问题1：主机名改全小写
19c的bug，不识别大写
问题2：没有OCR LOCAtion
进入报错的参数文件
vim /usr1/soft/oracle21.3.0/grid/crs/install/crsconfig_params
发现这个配置项是空的
加上配置/dev/sdd 或者/dev/asmdisk/OCR3
问题3：swap空间不够
dd if=/dev/zero of=/home/swapfile2 bs=1G count=12
mkswap /home/swapfile2
swapon /home/swapfile2
swapon --show
chmod 600 /home/swapfile2
问题4：磁盘问题
执行报错：
/usr1/soft/oracle21.3.0/grid/root.sh
试过修改响应文件配置，磁盘名臣
使用：
grid用户
crsctl status resource -t
oracle 用户
srvctl config database -d racdb
srvctl stop database -d racdb
srvctl status database -db racdb
参考文档：https://gitcode.com/Open-source-documentation-tutorial/65c8b/blob/main/Centos8%E5%AE%89%E8%A3%85Oracle%2019C%20RAC%E8%B6%85%E7%BA%A7%E6%89%8B%E5%86%8C.pdf
6.集群和实例使用
6.1 集群启停
(1) 先停实例
su - oracle
srvctl stop database -db racdb
srvctl status database -d racdb
(2) 查看grid集群状态，实例的状态会显示instance shutdown
su - grid
crsctl stat res -t
(3) 停一个节点的grid，只停node2，和上一步的状态作对比，节点2的组件相关状态变为offline
su - root
/usr1/soft/oracle19.3.0/grid/bin/crsctl stop cluster -n opengauss182 （-n后面带机器节点hostname）
在node1上查询crsctl stat res -t
node2进程情况：
停node2的crs集群资源
/usr1/soft/oracle19.3.0/grid/bin/crsctl stop crs
启动node2的集群，reboot服务器之后，好像会自己拉起grid集群，可观测进程情况
su - root /usr1/soft/oracle19.3.0/grid/bin/crsctl start cluster -n opengauss182
