因为要对主机系统进行维护，期间可能要多次重启操作系统验证，为了减少对数据库的影响以及加快重启速度，所以将CRS自动启动先关闭（disable),但在测试RAC集群手动启动时发现使用crsctl start cluster -all的命令执行报错了。具体报错如下：提示不能连接OHAS服务。
[root@ora19crac1 ~]# crsctl start cluster -all
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Start failed, or completed with errors.
使用 crsctl start crs启动 CRS是正常的。如下操作：
[root@ora19crac1 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
那么crsctl start cluster [-n|-all] 和 crsctl start crs到底有啥区别呢
首先大家都熟悉的：crsctl start crs 后面是没有可选参数的，只能启动本节点CRS，不能操作其他节点。而crsctl start cluster [-n|-all] 是可选启动本节点、其他节点、所有节点的。
另外，找了官方手册里面描述启动、关闭集群的描述如下：
Starting Oracle Clusterware
You use the CRSCTL utility to manage Oracle Clusterware.
• If the Oracle High Availability Services daemon (OHASD) is running on all the
cluster nodes, then you can start the entire Oracle Clusterware stack (all the
processes and resources managed by Oracle Clusterware) on all nodes in the
cluster by executing the following command on any node:
crsctl start cluster -all
• You can start the Oracle Clusterware stack on specific nodes by using the -n
option followed by a space-delimited list of node names, for example:
crsctl start cluster -n racnode1 racnode4
To use the crsctl start cluster command, the OHASD process must be running on the specified nodes.
• To start the entire Oracle Clusterware stack on a node, including the OHASD process, run the following command on that node:
crsctl start crs
Stopping Oracle Clusterware
You use the CRSCTL utility to manage Oracle Clusterware.
• To stop Oracle Clusterware on all nodes in the cluster, execute the following
command on any node:
crsctl stop cluster -all
The previous command stops the resources managed by Oracle Clusterware, the
Oracle ASM instance, and all the Oracle Clusterware processes (except for OHASD
and its dependent processes).
• To stop Oracle Clusterware and Oracle ASM on select nodes, include the -n
option followed by a space-delimited list of node names, for example:
crsctl stop cluster -n racnode1 racnode3
If you do not include either the -all or the -n option in the stop cluster
command, then Oracle Clusterware and its managed resources are stopped only on
the node where you execute the command.
• To completely shut down the entire Oracle Clusterware stack, including the
OHASD process, use the crsctl stop crs command.
从上面描述就清楚了，crsctl start cluster [-n|-all] 命令是依赖于OHASD进程的，自身不会起OHASD 进程，crsctl stop cluster [-n|-all] 命令也不会关闭OHASD进程。crsctl stop crs命令才会关闭所有集群进程，包括OHASD进程；crsctl start crs命令也是会启动OHASD 进程的。而我们设置crsctl disable crs 关闭集群自动启动时，操作系统起来后任何集群相关进程（包括OHASD 进程）都不会启动的，所以这个时候使用crsctl start cluster [-n|-all]是会执行报错的。
下面来测试验证一番：
节点1、2都将crs disable后重启
[root@ora19crac1 ~]# crsctl disable crs
CRS-4621: Oracle High Availability Services autostart is disabled.
[root@ora19crac1 ~]# reboot
[root@ora19crac2 ~]# crsctl disable crs
CRS-4621: Oracle High Availability Services autostart is disabled.
[root@ora19crac2 ~]# reboot
重启后查看集群资源状态、以及相关进程
[root@ora19crac1 ~]# crsctl status res -t -init
CRS-4639: Could not contact Oracle High Availability Services --提示连接不到OHAS服务
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac1 ~]# ps -ef|grep d.bin
root 2981 1976 0 12:42 pts/0 00:00:00 grep --color=auto d.bin --没有集群相关进程启动
[root@ora19crac2 ~]# crsctl status res -t -init
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac2 ~]# ps -ef|grep d.bin
root 2764 2239 0 12:42 pts/0 00:00:00 grep --color=auto d.bin
使用crsctl start cluster命令进行启动， 提示连接不到OHAS服务
[root@ora19crac1 ~]# crsctl start cluster
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Start failed, or completed with errors.
[root@ora19crac2 ~]# crsctl start cluster
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Start failed, or completed with errors.
使用crsctl start crs命令进行启动,提示OHAS服务已启动
[root@ora19crac1 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@ora19crac2 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
稍等几分钟后所有资源都成功启动
[root@ora19crac2 ~]# crsctl status res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.chad
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.net1.network
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.ons
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.proxy_advm
OFFLINE OFFLINE ora19crac1 STABLE
OFFLINE OFFLINE ora19crac2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE ora19crac1 STABLE
ora.OCR.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 Started,STABLE
2 ONLINE ONLINE ora19crac2 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.cdb1.db
1 ONLINE ONLINE ora19crac1 Open,HOME=/u01/app/o
racle/product/19.3.0
/db_1,STABLE
2 ONLINE ONLINE ora19crac2 Open,HOME=/u01/app/o
racle/product/19.3.0
/db_1,STABLE
ora.cdb1.srv_abc.svc
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
ora.cdb1.srv_test.svc
2 ONLINE ONLINE ora19crac1 STABLE
ora.cvu
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac1.vip
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac2.vip
1 ONLINE ONLINE ora19crac2 STABLE
ora.qosmserver
1 ONLINE ONLINE ora19crac1 STABLE
ora.scan1.vip
1 ONLINE ONLINE ora19crac1 STABLE
--------------------------------------------------------------------------------
查看集群相关进程
[root@ora19crac1 ~]# ps -ef|grep d.bin
root 3264 1 4 20:47 ? 00:00:18 /u01/app/19.3.0/grid/bin/ohasd.bin reboot
root 3451 1 0 20:47 ? 00:00:02 /u01/app/19.3.0/grid/bin/orarootagent.bin
grid 3575 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/oraagent.bin
grid 3629 1 0 20:47 ? 00:00:00 /u01/app/19.3.0/grid/bin/mdnsd.bin
grid 3630 1 0 20:47 ? 00:00:03 /u01/app/19.3.0/grid/bin/evmd.bin
grid 3674 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/gpnpd.bin
grid 3728 3630 0 20:47 ? 00:00:00 /u01/app/19.3.0/grid/bin/evmlogger.bin -o /u01/app/19.3.0/grid/log/[HOSTNAME]/evmd/evmlogger.info -l /u01/app/19.3.0/grid/log/[HOSTNAME]/evmd/evmlogger.log
grid 3751 1 0 20:47 ? 00:00:02 /u01/app/19.3.0/grid/bin/gipcd.bin
root 4487 1 0 20:48 ? 00:00:00 /u01/app/19.3.0/grid/bin/cssdmonitor
root 4490 1 1 20:48 ? 00:00:06 /u01/app/19.3.0/grid/bin/osysmond.bin
root 4540 1 0 20:48 ? 00:00:00 /u01/app/19.3.0/grid/bin/cssdagent
grid 4578 1 1 20:48 ? 00:00:06 /u01/app/19.3.0/grid/bin/ocssd.bin
root 4906 1 0 20:48 ? 00:00:01 /u01/app/19.3.0/grid/bin/octssd.bin reboot
root 4963 1 1 20:48 ? 00:00:03 /u01/app/19.3.0/grid/bin/ologgerd -M
root 5226 1 3 20:49 ? 00:00:10 /u01/app/19.3.0/grid/bin/crsd.bin reboot
grid 5361 1 1 20:49 ? 00:00:03 /u01/app/19.3.0/grid/bin/oraagent.bin
root 5371 1 1 20:49 ? 00:00:03 /u01/app/19.3.0/grid/bin/orarootagent.bin
grid 5551 1 0 20:49 ? 00:00:00 /u01/app/19.3.0/grid/bin/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit
grid 5565 1 0 20:49 ? 00:00:00 /u01/app/19.3.0/grid/bin/scriptagent.bin
grid 5650 5555 0 20:49 ? 00:00:00 /bin/sh /u01/app/19.3.0/grid/bin/cluvfy comp healthcheck -mandatory -_format -_check_type partial
grid 5724 1 0 20:49 ? 00:00:00 /u01/app/19.3.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid 5744 1 0 20:49 ? 00:00:00 /u01/app/19.3.0/grid/bin/tnslsnr LISTENER_SCAN1 -no_crs_notify -inherit
oracle 5844 1 0 20:49 ? 00:00:01 /u01/app/19.3.0/grid/bin/oraagent.bin
root 7169 4490 0 20:50 ? 00:00:00 /u01/app/19.3.0/grid/perl/bin/perl /u01/app/19.3.0/grid/bin/diagsnap.pl start
root 16138 2673 0 20:55 pts/0 00:00:00 grep --color=auto d.bin
[root@ora19crac2 ~]# ps -ef|grep d.bin
root 2602 1 3 20:47 ? 00:00:17 /u01/app/19.3.0/grid/bin/ohasd.bin reboot
root 2694 1 1 20:47 ? 00:00:05 /u01/app/19.3.0/grid/bin/orarootagent.bin
grid 2814 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/oraagent.bin
grid 2879 1 0 20:47 ? 00:00:02 /u01/app/19.3.0/grid/bin/evmd.bin
grid 2880 1 0 20:47 ? 00:00:00 /u01/app/19.3.0/grid/bin/mdnsd.bin
grid 2913 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/gpnpd.bin
grid 2969 2879 0 20:47 ? 00:00:00 /u01/app/19.3.0/grid/bin/evmlogger.bin -o /u01/app/19.3.0/grid/log/[HOSTNAME]/evmd/evmlogger.info -l /u01/app/19.3.0/grid/log/[HOSTNAME]/evmd/evmlogger.log
grid 2983 1 0 20:47 ? 00:00:02 /u01/app/19.3.0/grid/bin/gipcd.bin
root 3503 1 0 20:48 ? 00:00:01 /u01/app/19.3.0/grid/bin/cssdmonitor
root 3506 1 1 20:48 ? 00:00:05 /u01/app/19.3.0/grid/bin/osysmond.bin
root 3538 1 0 20:48 ? 00:00:00 /u01/app/19.3.0/grid/bin/cssdagent
grid 3557 1 1 20:48 ? 00:00:06 /u01/app/19.3.0/grid/bin/ocssd.bin
root 3815 1 0 20:48 ? 00:00:01 /u01/app/19.3.0/grid/bin/octssd.bin reboot
root 3998 1 1 20:49 ? 00:00:04 /u01/app/19.3.0/grid/bin/crsd.bin reboot
root 4095 1 0 20:49 ? 00:00:02 /u01/app/19.3.0/grid/bin/orarootagent.bin
root 4527 3506 0 20:50 ? 00:00:00 /u01/app/19.3.0/grid/perl/bin/perl /u01/app/19.3.0/grid/bin/diagsnap.pl start
grid 7882 1 1 20:51 ? 00:00:02 /u01/app/19.3.0/grid/bin/oraagent.bin
grid 8365 1 0 20:51 ? 00:00:00 /u01/app/19.3.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid 8566 1 0 20:51 ? 00:00:00 /u01/app/19.3.0/grid/bin/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit
oracle 11906 1 0 20:52 ? 00:00:01 /u01/app/19.3.0/grid/bin/oraagent.bin
root 15878 2238 0 20:56 pts/0 00:00:00 grep --color=auto d.bin
现在使用 crsctl stop cluster -all来关闭整个集群
[root@ora19crac1 ~]# crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.crsd' on 'ora19crac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora19crac2'
CRS-2673: Attempting to stop 'ora.cdb1.srv_abc.svc' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.chad' on 'ora19crac2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora19crac1'
CRS-2673: Attempting to stop 'ora.cdb1.srv_test.svc' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.cdb1.srv_abc.svc' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.qosmserver' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.chad' on 'ora19crac1'
CRS-2677: Stop of 'ora.cdb1.srv_abc.svc' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cdb1.db' on 'ora19crac2'
CRS-2677: Stop of 'ora.cdb1.db' on 'ora19crac2' succeeded
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'ora19crac2'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora19crac2'
CRS-2677: Stop of 'ora.OCR.dg' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ora19crac2.vip' on 'ora19crac2'
CRS-2677: Stop of 'ora.ora19crac2.vip' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.cdb1.srv_test.svc' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.cdb1.srv_abc.svc' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cdb1.db' on 'ora19crac1'
CRS-2677: Stop of 'ora.asm' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac2'
CRS-2677: Stop of 'ora.qosmserver' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.cdb1.db' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'ora19crac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'ora19crac1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.ora19crac1.vip' on 'ora19crac1'
CRS-2677: Stop of 'ora.chad' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'ora19crac2'
CRS-2677: Stop of 'ora.scan1.vip' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'ora19crac2' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'ora19crac2' succeeded.
CRS-2677: Stop of 'ora.chad' on 'ora19crac1' succeeded
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'ora19crac1'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'ora19crac1'
CRS-2677: Stop of 'ora.OCR.dg' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.ora19crac1.vip' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.ons' on 'ora19crac2'
CRS-2677: Stop of 'ora.cvu' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac1'
CRS-2677: Stop of 'ora.ons' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'ora19crac2'
CRS-2677: Stop of 'ora.net1.network' on 'ora19crac2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora19crac2' has completed
CRS-2677: Stop of 'ora.crsd' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ora19crac2'
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'ora19crac1'
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'ora19crac1' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'ora19crac1' succeeded.
CRS-2673: Attempting to stop 'ora.ons' on 'ora19crac1'
CRS-2677: Stop of 'ora.ons' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'ora19crac1'
CRS-2677: Stop of 'ora.net1.network' on 'ora19crac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora19crac1' has completed
CRS-2677: Stop of 'ora.ctssd' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.evmd' on 'ora19crac2'
CRS-2677: Stop of 'ora.crsd' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.storage' on 'ora19crac2'
CRS-2677: Stop of 'ora.storage' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac2'
CRS-2677: Stop of 'ora.storage' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac1'
CRS-2677: Stop of 'ora.evmd' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora19crac2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ora19crac2'
CRS-2677: Stop of 'ora.cssd' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora19crac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ora19crac1'
CRS-2677: Stop of 'ora.cssd' on 'ora19crac1' succeeded
查看集群状态：可以看到使用crsctl status res -t -init 命令还是可以查看资源初始状态的
而且ohasd、orarootagent、oraagent、mdnsd、gpnpd、gipcd、osysmond进程还是启动的
[root@ora19crac1 ~]# crsctl status res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac1 ~]# crsctl status res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 OFFLINE OFFLINE STABLE
ora.cluster_interconnect.haip
1 OFFLINE OFFLINE STABLE
ora.crf
1 ONLINE INTERMEDIATE ora19crac1 STABLE
ora.crsd
1 OFFLINE OFFLINE STABLE
ora.cssd
1 OFFLINE OFFLINE STABLE
ora.cssdmonitor
1 OFFLINE OFFLINE STABLE
ora.ctssd
1 OFFLINE OFFLINE STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE ora19crac1 STABLE
ora.evmd
1 OFFLINE OFFLINE STABLE
ora.gipcd
1 ONLINE ONLINE ora19crac1 STABLE
ora.gpnpd
1 ONLINE ONLINE ora19crac1 STABLE
ora.mdnsd
1 ONLINE ONLINE ora19crac1 STABLE
ora.storage
1 OFFLINE OFFLINE STABLE
--------------------------------------------------------------------------------
[root@ora19crac1 ~]# ps -ef|grep d.bin
root 3264 1 2 20:47 ? 00:00:23 /u01/app/19.3.0/grid/bin/ohasd.bin reboot
root 3451 1 0 20:47 ? 00:00:03 /u01/app/19.3.0/grid/bin/orarootagent.bin
grid 3575 1 0 20:47 ? 00:00:03 /u01/app/19.3.0/grid/bin/oraagent.bin
grid 3629 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/mdnsd.bin
grid 3674 1 0 20:47 ? 00:00:02 /u01/app/19.3.0/grid/bin/gpnpd.bin
grid 3751 1 0 20:47 ? 00:00:04 /u01/app/19.3.0/grid/bin/gipcd.bin
root 18447 1 3 20:57 ? 00:00:05 /u01/app/19.3.0/grid/bin/osysmond.bin
root 19755 2673 0 21:01 pts/0 00:00:00 grep --color=auto d.bin
[root@ora19crac1 ~]#
[root@ora19crac2 ~]# crsctl status res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac2 ~]# crsctl status res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 OFFLINE OFFLINE STABLE
ora.cluster_interconnect.haip
1 OFFLINE OFFLINE STABLE
ora.crf
1 ONLINE OFFLINE ora19crac2 STARTING
ora.crsd
1 OFFLINE OFFLINE STABLE
ora.cssd
1 OFFLINE OFFLINE STABLE
ora.cssdmonitor
1 OFFLINE OFFLINE STABLE
ora.ctssd
1 OFFLINE OFFLINE STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE ora19crac2 STABLE
ora.evmd
1 OFFLINE OFFLINE STABLE
ora.gipcd
1 ONLINE ONLINE ora19crac2 STABLE
ora.gpnpd
1 ONLINE ONLINE ora19crac2 STABLE
ora.mdnsd
1 ONLINE ONLINE ora19crac2 STABLE
ora.storage
1 OFFLINE OFFLINE STABLE
--------------------------------------------------------------------------------
[root@ora19crac2 ~]# ps -ef|grep d.bin
root 2602 1 2 20:47 ? 00:00:22 /u01/app/19.3.0/grid/bin/ohasd.bin reboot
root 2694 1 0 20:47 ? 00:00:07 /u01/app/19.3.0/grid/bin/orarootagent.bin
grid 2814 1 0 20:47 ? 00:00:03 /u01/app/19.3.0/grid/bin/oraagent.bin
grid 2880 1 0 20:47 ? 00:00:01 /u01/app/19.3.0/grid/bin/mdnsd.bin
grid 2913 1 0 20:47 ? 00:00:03 /u01/app/19.3.0/grid/bin/gpnpd.bin
grid 2983 1 1 20:47 ? 00:00:14 /u01/app/19.3.0/grid/bin/gipcd.bin
root 16718 1 3 21:01 ? 00:00:01 /u01/app/19.3.0/grid/bin/osysmond.bin
root 16919 2238 0 21:01 pts/0 00:00:00 grep --color=auto d.bin
现在使用 crsctl start cluster -all来启动整个集群
[root@ora19crac1 ~]# crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ora19crac1'
CRS-2672: Attempting to start 'ora.evmd' on 'ora19crac1'
CRS-2672: Attempting to start 'ora.evmd' on 'ora19crac2'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ora19crac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'ora19crac2' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ora19crac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ora19crac1'
CRS-2676: Start of 'ora.diskmon' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ora19crac2'
CRS-2676: Start of 'ora.evmd' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.diskmon' on 'ora19crac2'
CRS-2676: Start of 'ora.diskmon' on 'ora19crac2' succeeded
CRS-2676: Start of 'ora.evmd' on 'ora19crac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'ora19crac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'ora19crac1'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ora19crac1'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ora19crac2'
CRS-2672: Attempting to start 'ora.ctssd' on 'ora19crac2'
CRS-2676: Start of 'ora.ctssd' on 'ora19crac2' succeeded
CRS-2676: Start of 'ora.ctssd' on 'ora19crac1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ora19crac1'
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ora19crac2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ora19crac2'
CRS-2676: Start of 'ora.asm' on 'ora19crac2' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ora19crac2'
CRS-2676: Start of 'ora.asm' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ora19crac1'
CRS-2676: Start of 'ora.storage' on 'ora19crac1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ora19crac1'
CRS-2676: Start of 'ora.crsd' on 'ora19crac1' succeeded
CRS-2676: Start of 'ora.storage' on 'ora19crac2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ora19crac2'
CRS-2676: Start of 'ora.crsd' on 'ora19crac2' succeeded
稍等几分钟所有资源启动完成
[root@ora19crac1 ~]# crsctl status res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.chad
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.net1.network
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.ons
ONLINE ONLINE ora19crac1 STABLE
ONLINE ONLINE ora19crac2 STABLE
ora.proxy_advm
OFFLINE OFFLINE ora19crac1 STABLE
OFFLINE OFFLINE ora19crac2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE ora19crac1 STABLE
ora.OCR.dg(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 Started,STABLE
2 ONLINE ONLINE ora19crac2 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
3 OFFLINE OFFLINE STABLE
ora.cdb1.db
1 ONLINE ONLINE ora19crac1 Open,HOME=/u01/app/o
racle/product/19.3.0
/db_1,STABLE
2 ONLINE ONLINE ora19crac2 Open,HOME=/u01/app/o
racle/product/19.3.0
/db_1,STABLE
ora.cdb1.srv_abc.svc
1 ONLINE ONLINE ora19crac1 STABLE
2 ONLINE ONLINE ora19crac2 STABLE
ora.cdb1.srv_test.svc
2 ONLINE ONLINE ora19crac1 STABLE
ora.cvu
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac1.vip
1 ONLINE ONLINE ora19crac1 STABLE
ora.ora19crac2.vip
1 ONLINE ONLINE ora19crac2 STABLE
ora.qosmserver
1 ONLINE ONLINE ora19crac1 STABLE
ora.scan1.vip
1 ONLINE ONLINE ora19crac1 STABLE
------------------------------------------------------------------------------
现在使用crsctl stop crs关闭集群，两个节点都执行
[root@ora19crac1 ~]# crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'ora19crac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora19crac1'
CRS-2672: Attempting to start 'ora.cdb1.srv_test.svc' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.cdb1.srv_abc.svc' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.qosmserver' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.chad' on 'ora19crac1'
CRS-2676: Start of 'ora.cdb1.srv_test.svc' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cdb1.srv_test.svc' on 'ora19crac1'
CRS-2677: Stop of 'ora.cdb1.srv_test.svc' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.cdb1.srv_abc.svc' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cdb1.db' on 'ora19crac1'
CRS-2677: Stop of 'ora.cdb1.db' on 'ora19crac1' succeeded
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'ora19crac1'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'ora19crac1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.ora19crac1.vip' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'ora19crac1'
CRS-2677: Stop of 'ora.ora19crac1.vip' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.qosmserver' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac1'
CRS-2677: Stop of 'ora.cvu' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.chad' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'ora19crac1'
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'ora19crac1' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'ora19crac1' succeeded.
CRS-2673: Attempting to stop 'ora.ons' on 'ora19crac1'
CRS-2677: Stop of 'ora.ons' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'ora19crac1'
CRS-2677: Stop of 'ora.net1.network' on 'ora19crac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora19crac1' has completed
CRS-2677: Stop of 'ora.crsd' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.crf' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ora19crac1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.crf' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora19crac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ora19crac1'
CRS-2677: Stop of 'ora.ctssd' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ora19crac1'
CRS-2677: Stop of 'ora.cssd' on 'ora19crac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'ora19crac1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ora19crac1'
CRS-2677: Stop of 'ora.gipcd' on 'ora19crac1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'ora19crac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ora19crac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@ora19crac2 ~]# crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.crsd' on 'ora19crac2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora19crac2'
CRS-2673: Attempting to stop 'ora.cdb1.srv_test.svc' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.chad' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.cdb1.srv_abc.svc' on 'ora19crac2'
CRS-2677: Stop of 'ora.cdb1.srv_test.svc' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.cdb1.srv_abc.svc' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cdb1.db' on 'ora19crac2'
CRS-2677: Stop of 'ora.cdb1.db' on 'ora19crac2' succeeded
CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'ora19crac2'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora19crac2'
CRS-2677: Stop of 'ora.OCR.dg' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ora19crac2.vip' on 'ora19crac2'
CRS-2677: Stop of 'ora.ora19crac2.vip' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac2'
CRS-2677: Stop of 'ora.chad' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'ora19crac2'
CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'ora19crac2' succeeded
CRS-33677: Stop of resource group 'ora.asmgroup' on server 'ora19crac2' succeeded.
CRS-2673: Attempting to stop 'ora.ons' on 'ora19crac2'
CRS-2677: Stop of 'ora.ons' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'ora19crac2'
CRS-2677: Stop of 'ora.net1.network' on 'ora19crac2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora19crac2' has completed
CRS-2677: Stop of 'ora.crsd' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.crf' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ora19crac2'
CRS-2677: Stop of 'ora.crf' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora19crac2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.evmd' on 'ora19crac2'
CRS-2677: Stop of 'ora.ctssd' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ora19crac2'
CRS-2677: Stop of 'ora.cssd' on 'ora19crac2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'ora19crac2'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ora19crac2'
CRS-2677: Stop of 'ora.gipcd' on 'ora19crac2' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'ora19crac2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ora19crac2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
再次查看资源状态及进程，此时所有进程都关闭，包括ohasd进程。
[root@ora19crac1 ~]# crsctl status res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac1 ~]# crsctl status res -t -init
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac1 ~]# ps -ef|grep d.bin
root 14756 2673 0 21:36 pts/0 00:00:00 grep --color=auto d.bin
[root@ora19crac2 ~]# crsctl status res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac2 ~]# crsctl status res -t -init
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Status failed, or completed with errors.
[root@ora19crac2 ~]# ps -ef|grep d.bin
root 32587 2238 0 21:34 pts/0 00:00:00 grep --color=auto d.bin
「喜欢这篇文章，您的关注和赞赏是给作者最好的鼓励」
关注作者
【版权声明】本文为墨天轮用户原创内容，转载时必须标注文章的来源（墨天轮），文章链接，文章作者等基本信息，否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容，欢迎发送邮件至：contact@modb.pro进行举报，并提供相关证据，一经查实，墨天轮将立刻删除相关内容。
