2台centos7.4的节点安装完oracle 11g rac之后，准备升级最新的PSU，遇到了错误，麻烦各位帮忙解答一下，谢谢

1，2台节点停止数据库实例后，在节点1先以report模式预演一下升级，没发现问题

[root@rac1 soft]# /oracle/app/11.2.0/grid/OPatch/opatch auto /psu/33575261/ -oh /oracle/app/11.2.0/grid,/oracle/app/oracle/product/11.2.0/db_1 -report
Executing /oracle/app/11.2.0/grid/perl/bin/perl /oracle/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /psu -patchn 33575261 -oh /oracle/app/11.2.0/grid,/oracle/app/oracle/product/11.2.0/db_1 -report -paramfile /oracle/app/11.2.0/grid/crs/install/crsconfig_params

This is the main log file: /oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-43-02.log

This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-43-02.report.log

2022-04-26 17:43:02: Starting Clusterware Patch Setup
Using configuration parameter file: /oracle/app/11.2.0/grid/crs/install/crsconfig_params

opatchauto is running in analyze/report mode. It will make no change to your system

patch /psu/33575261/32758914  apply (report mode) successful for home  /oracle/app/11.2.0/grid 
patch /psu/33575261/33477185  apply (report mode) successful for home  /oracle/app/11.2.0/grid 
patch /psu/33575261/33112794  apply (report mode) successful for home  /oracle/app/11.2.0/grid 
patch /psu/33575261/32758914/custom/server/32758914  apply (report mode) successful for home  /oracle/app/oracle/product/11.2.0/db_1 
patch /psu/33575261/33477185  apply (report mode) successful for home  /oracle/app/oracle/product/11.2.0/db_1 

opatch auto succeeded.

2，然后开始正式升级，就报错了

[root@rac1 soft]# /oracle/app/11.2.0/grid/OPatch/opatch auto /psu/33575261/ -oh /oracle/app/11.2.0/grid,/oracle/app/oracle/product/11.2.0/db_1
Executing /oracle/app/11.2.0/grid/perl/bin/perl /oracle/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /psu -patchn 33575261 -oh /oracle/app/11.2.0/grid,/oracle/app/oracle/product/11.2.0/db_1 -paramfile /oracle/app/11.2.0/grid/crs/install/crsconfig_params

This is the main log file: /oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-48-39.log

This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-48-39.report.log

2022-04-26 17:48:39: Starting Clusterware Patch Setup
Using configuration parameter file: /oracle/app/11.2.0/grid/crs/install/crsconfig_params

Stopping CRS...
Stopped CRS successfully

patch /psu/33575261/32758914  apply successful for home  /oracle/app/11.2.0/grid 
patch /psu/33575261/33477185  apply successful for home  /oracle/app/11.2.0/grid 
patch /psu/33575261/33112794  apply successful for home  /oracle/app/11.2.0/grid 
/oracle/app/11.2.0/grid/bin/crsctl query crs activeversion ... failed rc=8 with message:
 Oracle Cluster Registry initialization failed accessing Oracle Cluster Registry device: PROC-26: Error while accessing the physical storage ORA-29701: unable to connect to Cluster Synchronization Service  


Stopping RAC /oracle/app/oracle/product/11.2.0/db_1 ...
Failed to stop resources from  database home /oracle/app/oracle/product/11.2.0/db_1
ERROR: Refer log file for more details.


opatch auto failed.

3，升级PSU期间，crs的alert日志信息如下：

2022-04-26 17:50:11.266: 
[/oracle/app/11.2.0/grid/bin/orarootagent.bin(2876)]CRS-5822:Agent '/oracle/app/11.2.0/grid/bin/orarootagent_root' disconnected from server. Details at (:CRSAGF00117:) {0:5:48} in /oracle/app/11.2.0/grid/log/rac1/agent/crsd/orarootagent_root/orarootagent_root.log.
2022-04-26 17:50:12.192: 
[mdnsd(2076)]CRS-5602:mDNS service stopping by request.
2022-04-26 17:50:12.196: 
[ctssd(2462)]CRS-2405:The Cluster Time Synchronization Service on host rac1 is shutdown by user
2022-04-26 17:50:25.553: 
[cssd(2161)]CRS-1603:CSSD on node rac1 shutdown by user.
2022-04-26 17:50:25.658: 
[ohasd(1956)]CRS-2767:Resource state recovery not attempted for 'ora.cssdmonitor' as its target state is OFFLINE
2022-04-26 17:50:25.658: 
[ohasd(1956)]CRS-2769:Unable to failover resource 'ora.cssdmonitor'.
2022-04-26 17:50:25.755: 
[cssd(2161)]CRS-1660:The CSS daemon shutdown has completed
2022-04-26 17:50:27.919: 
[gpnpd(2086)]CRS-2329:GPNPD on node rac1 shutdown. 
2022-04-26 17:57:08.846: 
[client(25844)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running). 
2022-04-26 17:57:16.012: 
[client(25844)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle/app/11.2.0/grid/log/rac1/client/crsctl_root.log.

4，安装过程的日志如下

2022-04-26 17:48:39: Using Oracle CRS home /oracle/app/11.2.0/grid
2022-04-26 17:48:39: Checking parameters from paramfile /oracle/app/11.2.0/grid/crs/install/crsconfig_params to validate installer variables
2022-04-26 17:48:39: The configuration parameter file /oracle/app/11.2.0/grid/crs/install/crsconfig_params is valid
2022-04-26 17:48:39: ### Printing the configuration values from files:
2022-04-26 17:48:39:    /oracle/app/11.2.0/grid/crs/install/crsconfig_params
2022-04-26 17:48:39:    /oracle/app/11.2.0/grid/crs/install/s_crsconfig_defs
2022-04-26 17:48:39: ASM_AU_SIZE=8
2022-04-26 17:48:39: ASM_DISCOVERY_STRING=/dev/asm*
2022-04-26 17:48:39: ASM_DISKS=/dev/asm-ocr1,/dev/asm-ocr2,/dev/asm-ocr3
2022-04-26 17:48:39: ASM_DISK_GROUP=ocr
2022-04-26 17:48:39: ASM_REDUNDANCY=NORMAL
2022-04-26 17:48:39: ASM_SPFILE=
2022-04-26 17:48:39: ASM_UPGRADE=false
2022-04-26 17:48:39: CLSCFG_MISSCOUNT=
2022-04-26 17:48:39: CLUSTER_GUID=
2022-04-26 17:48:39: CLUSTER_NAME=orcl-cluster
2022-04-26 17:48:39: CRFHOME="/oracle/app/11.2.0/grid"
2022-04-26 17:48:39: CRS_LIMIT_CORE=unlimited
2022-04-26 17:48:39: CRS_LIMIT_MEMLOCK=unlimited
2022-04-26 17:48:39: CRS_LIMIT_OPENFILE=65536
2022-04-26 17:48:39: CRS_LIMIT_STACK=2048
2022-04-26 17:48:39: CRS_LSNR_STACK=10240
2022-04-26 17:48:39: CRS_NODEVIPS='rac1-vip/255.255.255.0/ens33,rac2-vip/255.255.255.0/ens33'
2022-04-26 17:48:39: CRS_STORAGE_OPTION=1
2022-04-26 17:48:39: CSS_LEASEDURATION=400
2022-04-26 17:48:39: DIRPREFIX=
2022-04-26 17:48:39: DISABLE_OPROCD=0
2022-04-26 17:48:39: EXTERNAL_ORACLE=/opt/oracle
2022-04-26 17:48:39: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
2022-04-26 17:48:39: GNS_ADDR_LIST=
2022-04-26 17:48:39: GNS_ALLOW_NET_LIST=
2022-04-26 17:48:39: GNS_CONF=false
2022-04-26 17:48:39: GNS_DENY_ITF_LIST=
2022-04-26 17:48:39: GNS_DENY_NET_LIST=
2022-04-26 17:48:39: GNS_DOMAIN_LIST=
2022-04-26 17:48:39: GPNPCONFIGDIR=/oracle/app/11.2.0/grid
2022-04-26 17:48:39: GPNPGCONFIGDIR=/oracle/app/11.2.0/grid
2022-04-26 17:48:39: GPNP_PA=
2022-04-26 17:48:39: HOST_NAME_LIST=rac1,rac2
2022-04-26 17:48:39: ID=/etc/init.d
2022-04-26 17:48:39: INIT=/sbin/init
2022-04-26 17:48:39: INITCTL=/sbin/initctl
2022-04-26 17:48:39: ISROLLING=true
2022-04-26 17:48:39: IT=/etc/inittab
2022-04-26 17:48:39: JLIBDIR=/oracle/app/11.2.0/grid/jlib
2022-04-26 17:48:39: JREDIR=/oracle/app/11.2.0/grid/jdk/jre/
2022-04-26 17:48:39: LANGUAGE_ID=AMERICAN_AMERICA.WE8ISO8859P1
2022-04-26 17:48:39: MSGFILE=/var/adm/messages
2022-04-26 17:48:39: NETWORKS="ens33"/192.168.110.0:public,"ens34"/10.0.0.0:cluster_interconnect
2022-04-26 17:48:39: NEW_HOST_NAME_LIST=
2022-04-26 17:48:39: NEW_NODEVIPS='rac1-vip/255.255.255.0/ens33,rac2-vip/255.255.255.0/ens33'
2022-04-26 17:48:39: NEW_NODE_NAME_LIST=
2022-04-26 17:48:39: NEW_PRIVATE_NAME_LIST=
2022-04-26 17:48:39: NODELIST=rac1,rac2
2022-04-26 17:48:39: NODE_NAME_LIST=rac1,rac2
2022-04-26 17:48:39: OCFS_CONFIG=
2022-04-26 17:48:39: OCRCONFIG=/etc/oracle/ocr.loc
2022-04-26 17:48:39: OCRCONFIGDIR=/etc/oracle
2022-04-26 17:48:39: OCRID=
2022-04-26 17:48:39: OCRLOC=ocr.loc
2022-04-26 17:48:39: OCR_LOCATIONS=NO_VAL
2022-04-26 17:48:39: OLASTGASPDIR=/etc/oracle/lastgasp
2022-04-26 17:48:39: OLD_CRS_HOME=
2022-04-26 17:48:39: OLRCONFIG=/etc/oracle/olr.loc
2022-04-26 17:48:39: OLRCONFIGDIR=/etc/oracle
2022-04-26 17:48:39: OLRLOC=olr.loc
2022-04-26 17:48:39: OPROCDCHECKDIR=/etc/oracle/oprocd/check
2022-04-26 17:48:39: OPROCDDIR=/etc/oracle/oprocd
2022-04-26 17:48:39: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
2022-04-26 17:48:39: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
2022-04-26 17:48:39: ORACLE_BASE=/oracle/app/grid
2022-04-26 17:48:39: ORACLE_HOME=/oracle/app/11.2.0/grid
2022-04-26 17:48:39: ORACLE_OWNER=grid
2022-04-26 17:48:39: ORA_ASM_GROUP=asmadmin
2022-04-26 17:48:39: ORA_DBA_GROUP=oinstall
2022-04-26 17:48:39: PRIVATE_NAME_LIST=
2022-04-26 17:48:39: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
2022-04-26 17:48:39: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
2022-04-26 17:48:39: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
2022-04-26 17:48:39: RC_KILL=K15
2022-04-26 17:48:39: RC_KILL_OLD=K96
2022-04-26 17:48:39: RC_KILL_OLD2=K19
2022-04-26 17:48:39: RC_START=S96
2022-04-26 17:48:39: REUSEDG=false
2022-04-26 17:48:39: SCAN_NAME=scan
2022-04-26 17:48:39: SCAN_PORT=1521
2022-04-26 17:48:39: SCRBASE=/etc/oracle/scls_scr
2022-04-26 17:48:39: SILENT=false
2022-04-26 17:48:39: SO_EXT=so
2022-04-26 17:48:39: SRVCFGLOC=srvConfig.loc
2022-04-26 17:48:39: SRVCONFIG=/var/opt/oracle/srvConfig.loc
2022-04-26 17:48:39: SRVCONFIGDIR=/var/opt/oracle
2022-04-26 17:48:39: TZ=Asia/Shanghai
2022-04-26 17:48:39: UPSTART_INIT_DIR=/etc/init
2022-04-26 17:48:39: USER_IGNORED_PREREQ=true
2022-04-26 17:48:39: VNDR_CLUSTER=false
2022-04-26 17:48:39: VOTING_DISKS=NO_VAL
2022-04-26 17:48:39: ### Printing other configuration values ###
2022-04-26 17:48:39: CLSCFG_EXTRA_PARMS=
2022-04-26 17:48:39: HAS_GROUP=oinstall
2022-04-26 17:48:39: HAS_USER=root
2022-04-26 17:48:39: HOST=rac1
2022-04-26 17:48:39: OLR_DIRECTORY=/oracle/app/11.2.0/grid/cdata
2022-04-26 17:48:39: OLR_LOCATION=/oracle/app/11.2.0/grid/cdata/rac1.olr
2022-04-26 17:48:39: ORA_CRS_HOME=/oracle/app/11.2.0/grid
2022-04-26 17:48:39: SUPERUSER=root
2022-04-26 17:48:39: VF_DISCOVERY_STRING=
2022-04-26 17:48:39: crscfg_trace=1
2022-04-26 17:48:39: crscfg_trace_file=/oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-48-39.log
2022-04-26 17:48:39: hosts=
2022-04-26 17:48:39: osdfile=/oracle/app/11.2.0/grid/crs/install/s_crsconfig_defs
2022-04-26 17:48:39: parameters_valid=1
2022-04-26 17:48:39: paramfile=/oracle/app/11.2.0/grid/crs/install/crsconfig_params
2022-04-26 17:48:39: platform_family=unix
2022-04-26 17:48:39: srvctl_trc_suff=0
2022-04-26 17:48:39: user_is_superuser=1
2022-04-26 17:48:39: ### Printing of configuration values complete ###
2022-04-26 17:48:39: INC is /oracle/app/11.2.0/grid/OPatch/crs /psu/33575261/32758914/files/crs/install /oracle/app/11.2.0/grid/OPatch/crs /oracle/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /oracle/app/11.2.0/grid/perl/lib/5.10.0 /oracle/app/11.2.0/grid/perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /oracle/app/11.2.0/grid/perl/lib/site_perl/5.10.0 /oracle/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /oracle/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /oracle/app/11.2.0/grid/perl/lib/5.10.0 /oracle/app/11.2.0/grid/perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /oracle/app/11.2.0/grid/perl/lib/site_perl/5.10.0 /oracle/app/11.2.0/grid/perl/lib/site_perl . 

2022-04-26 17:48:39: No -patchfile specified, assuming the patch is already uncompressed
2022-04-26 17:48:39: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:39: The patch ids are 32758914 33477185 33112794
2022-04-26 17:48:39: The patch ids are 32758914 33477185 33112794
2022-04-26 17:48:39: The GI patch locations are /psu/33575261/33477185 /psu/33575261/33112794 /psu/33575261/32758914
2022-04-26 17:48:39: The GI patch IDs are 33477185 33112794 32758914
2022-04-26 17:48:39: The SIHA patch locations are /psu/33575261/33477185 /psu/33575261/33112794 /psu/33575261/32758914
2022-04-26 17:48:39: The SIHA patch IDs are 33477185 33112794 32758914
2022-04-26 17:48:39: The DB patch locations are /psu/33575261/33477185 /psu/33575261/32758914/custom/server/32758914
2022-04-26 17:48:39: The DB patch IDs are 33477185 32758914
2022-04-26 17:48:39: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:39: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:41: Removing file /tmp/fileImPSoI
2022-04-26 17:48:41: Successfully removed file: /tmp/fileImPSoI
2022-04-26 17:48:41: /bin/su successfully executed

2022-04-26 17:48:41: output is  This patch is a "legacy_bundle_top" patch.

2022-04-26 17:48:41: Patch type is "legacy_bundle_top"
2022-04-26 17:48:41: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:41: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:43: Removing file /tmp/fileBJSqRj
2022-04-26 17:48:43: Successfully removed file: /tmp/fileBJSqRj
2022-04-26 17:48:43: /bin/su exited with rc=21

2022-04-26 17:48:43: output is 
2022-04-26 17:48:43: Patch type is 
2022-04-26 17:48:43: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:43: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch query -get_patch_type /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:45: Removing file /tmp/fileXEeROY
2022-04-26 17:48:45: Successfully removed file: /tmp/fileXEeROY
2022-04-26 17:48:45: /bin/su successfully executed

2022-04-26 17:48:45: output is  This patch is a "singleton" patch.

2022-04-26 17:48:45: Patch type is "singleton"
2022-04-26 17:48:45: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:45: Running as user grid: /oracle/app/11.2.0/grid/OPatch/crs/opatchauto util saveconfigurationsnapshot -configFile /oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-48-39.cfg.log
2022-04-26 17:48:45: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/crs/opatchauto util saveconfigurationsnapshot -configFile /oracle/app/11.2.0/grid/cfgtoollogs/opatchauto2022-04-26_17-48-39.cfg.log '
2022-04-26 17:48:45: Removing file /tmp/fileFLuNYI
2022-04-26 17:48:45: Successfully removed file: /tmp/fileFLuNYI
2022-04-26 17:48:45: /bin/su exited with rc=1

2022-04-26 17:48:45: Configuration needs to be generated without using saveconfigurationsnapshot
2022-04-26 17:48:45: Opening file /etc/oracle/ocr.loc
2022-04-26 17:48:45: Value (FALSE) is set for key=local_only
2022-04-26 17:48:45: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:45: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch version -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:45: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch version -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:46: Removing file /tmp/file8eZbiu
2022-04-26 17:48:46: Successfully removed file: /tmp/file8eZbiu
2022-04-26 17:48:46: /bin/su successfully executed

2022-04-26 17:48:46: opatch version in oracle home /oracle/app/11.2.0/grid  is 11.2.0.3.33

2022-04-26 17:48:46: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:46: Opening file /etc/oracle/ocr.loc
2022-04-26 17:48:46: Value (FALSE) is set for key=local_only
2022-04-26 17:48:46: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:48:46: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch version -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:48:46: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch version -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:48:46: Removing file /tmp/file0695Pg
2022-04-26 17:48:46: Successfully removed file: /tmp/file0695Pg
2022-04-26 17:48:46: /bin/su successfully executed

2022-04-26 17:48:46: opatch version in oracle home /oracle/app/oracle/product/11.2.0/db_1  is 11.2.0.3.33

2022-04-26 17:48:46: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:48:46: Oracle user for /oracle/app/11.2.0/grid is grid

2022-04-26 17:48:46: 
patch storage directory verified successfully

2022-04-26 17:48:46: silent mode option is -silent
2022-04-26 17:48:46: Running /oracle/app/11.2.0/grid/bin/crsctl check cluster -n rac1
2022-04-26 17:48:46: Executing cmd: /oracle/app/11.2.0/grid/bin/crsctl check cluster -n rac1

2022-04-26 17:48:46: Patch Information Storage successfully prepared for all homes.
2022-04-26 17:48:46: Opening file /etc/oracle/ocr.loc
2022-04-26 17:48:46: Value (FALSE) is set for key=local_only
2022-04-26 17:48:46: Opening file /etc/oracle/ocr.loc
2022-04-26 17:48:46: Value (FALSE) is set for key=local_only

2022-04-26 17:48:46: Shortlisting patches for home /oracle/app/oracle/product/11.2.0/db_1

2022-04-26 17:48:48: Oracle Home /oracle/app/oracle/product/11.2.0/db_1 contains no active patches.

2022-04-26 17:48:48: Final list of patches for /oracle/app/oracle/product/11.2.0/db_1 is 33477185 32758914

2022-04-26 17:48:48: Shortlisting patches for home /oracle/app/11.2.0/grid

2022-04-26 17:48:50: Oracle Home /oracle/app/11.2.0/grid contains no active patches.

2022-04-26 17:48:50: Final list of patches for /oracle/app/11.2.0/grid is 33477185 33112794 32758914
2022-04-26 17:48:50: Processing oracle home /oracle/app/11.2.0/grid
2022-04-26 17:48:50: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:50: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:48:50: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch version -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:50: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch version -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:50: Removing file /tmp/fileryHaMe
2022-04-26 17:48:50: Successfully removed file: /tmp/fileryHaMe
2022-04-26 17:48:50: /bin/su successfully executed

2022-04-26 17:48:50: opatch version in oracle home /oracle/app/11.2.0/grid  is 11.2.0.3.33

2022-04-26 17:48:50: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/32758914 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:50: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/32758914 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:54: Removing file /tmp/file59KX2d
2022-04-26 17:48:54: Successfully removed file: /tmp/file59KX2d
2022-04-26 17:48:54: /bin/su successfully executed

2022-04-26 17:48:54: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33477185 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:54: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33477185 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:48:59: Removing file /tmp/file3NKUCn
2022-04-26 17:48:59: Successfully removed file: /tmp/file3NKUCn
2022-04-26 17:48:59: /bin/su successfully executed

2022-04-26 17:48:59: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33112794 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid
2022-04-26 17:48:59: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33112794 -version 11.2.0.3.33 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:03: Removing file /tmp/fileprA25I
2022-04-26 17:49:03: Successfully removed file: /tmp/fileprA25I
2022-04-26 17:49:03: /bin/su successfully executed

2022-04-26 17:49:03: Status of opatch version check  for /oracle/app/11.2.0/grid is 1
2022-04-26 17:49:03: Opatch version check passed for oracle home  /oracle/app/11.2.0/grid
2022-04-26 17:49:03: Processing oracle home /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:03: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:49:03: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:49:03: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch version -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:03: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch version -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:03: Removing file /tmp/filehzYQKe
2022-04-26 17:49:03: Successfully removed file: /tmp/filehzYQKe
2022-04-26 17:49:03: /bin/su successfully executed

2022-04-26 17:49:03: opatch version in oracle home /oracle/app/oracle/product/11.2.0/db_1  is 11.2.0.3.33

2022-04-26 17:49:03: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/32758914/custom/server/32758914 -version 11.2.0.3.33 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:03: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/32758914/custom/server/32758914 -version 11.2.0.3.33 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:07: Removing file /tmp/filefidlKL
2022-04-26 17:49:07: Successfully removed file: /tmp/filefidlKL
2022-04-26 17:49:07: /bin/su successfully executed

2022-04-26 17:49:07: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33477185 -version 11.2.0.3.33 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:07: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch util checkMinimumOPatchVersion -ph /psu/33575261/33477185 -version 11.2.0.3.33 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:12: Removing file /tmp/file05Alct
2022-04-26 17:49:12: Successfully removed file: /tmp/file05Alct
2022-04-26 17:49:12: /bin/su successfully executed

2022-04-26 17:49:12: Status of opatch version check  for /oracle/app/oracle/product/11.2.0/db_1 is 1
2022-04-26 17:49:12: Opatch version check passed for oracle home  /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:12: Opatch version check passed  for all oracle homes
2022-04-26 17:49:12: Opening file /etc/oracle/ocr.loc
2022-04-26 17:49:12: Value (FALSE) is set for key=local_only
2022-04-26 17:49:12: The cluster nodes are rac1 rac2
2022-04-26 17:49:12: checking if path /oracle/app/11.2.0/grid/crs/install is shared
2022-04-26 17:49:12: Running as user grid: /oracle/app/11.2.0/grid/bin/cluvfy comp ssa -t software -s /oracle/app/11.2.0/grid/crs/install -n rac1,rac2 -display_status
2022-04-26 17:49:12: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/bin/cluvfy comp ssa -t software -s /oracle/app/11.2.0/grid/crs/install -n rac1,rac2 -display_status '
2022-04-26 17:49:19: Removing file /tmp/fileoWX08m
2022-04-26 17:49:19: Successfully removed file: /tmp/fileoWX08m
2022-04-26 17:49:19: /bin/su exited with rc=1

2022-04-26 17:49:19: return code for shared check is 256
2022-04-26 17:49:19: output of sharedness check is 
 Verifying shared storage accessibility 
 
 Checking shared storage accessibility...
 
 "/oracle/app/11.2.0/grid/crs/install" is not shared
 
 
 Shared storage check failed on nodes "rac2,rac1"
 
 Verification of shared storage accessibility was unsuccessful on all the specified nodes. 
 NODE_STATUS::rac2:VFAIL
 NODE_STATUS::rac1:VFAIL
 OVERALL_STATUS::VFAIL

2022-04-26 17:49:19: the ishared value is 0
2022-04-26 17:49:19: The oracle home /oracle/app/11.2.0/grid is not shared
2022-04-26 17:49:19: Opening file /etc/oracle/ocr.loc
2022-04-26 17:49:19: Value (FALSE) is set for key=local_only
2022-04-26 17:49:19: The cluster nodes are rac1 rac2
2022-04-26 17:49:19: checking if path /oracle/app/oracle/product/11.2.0/db_1 is shared
2022-04-26 17:49:19: Running as user grid: /oracle/app/11.2.0/grid/bin/cluvfy comp ssa -t software -s /oracle/app/oracle/product/11.2.0/db_1 -n rac1,rac2 -display_status
2022-04-26 17:49:19: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/bin/cluvfy comp ssa -t software -s /oracle/app/oracle/product/11.2.0/db_1 -n rac1,rac2 -display_status '
2022-04-26 17:49:24: Removing file /tmp/fileziohVy
2022-04-26 17:49:24: Successfully removed file: /tmp/fileziohVy
2022-04-26 17:49:24: /bin/su exited with rc=1

2022-04-26 17:49:24: return code for shared check is 256
2022-04-26 17:49:24: output of sharedness check is 
 Verifying shared storage accessibility 
 
 Checking shared storage accessibility...
 
 "/oracle/app/oracle/product/11.2.0/db_1" is not shared
 
 
 Shared storage check failed on nodes "rac2,rac1"
 
 Verification of shared storage accessibility was unsuccessful on all the specified nodes. 
 NODE_STATUS::rac2:VFAIL
 NODE_STATUS::rac1:VFAIL
 OVERALL_STATUS::VFAIL

2022-04-26 17:49:24: the ishared value is 0
2022-04-26 17:49:24: The oracle home /oracle/app/oracle/product/11.2.0/db_1 is not shared
2022-04-26 17:49:24: Processing oracle home /oracle/app/11.2.0/grid
2022-04-26 17:49:24: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:49:24: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:24: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:26: Removing file /tmp/fileua91pZ
2022-04-26 17:49:26: Successfully removed file: /tmp/fileua91pZ
2022-04-26 17:49:26: /bin/su successfully executed

2022-04-26 17:49:26: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:26: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:29: Removing file /tmp/file7XhbUu
2022-04-26 17:49:29: Successfully removed file: /tmp/file7XhbUu
2022-04-26 17:49:29: /bin/su successfully executed

2022-04-26 17:49:29: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:29: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:31: Removing file /tmp/fileOfcls7
2022-04-26 17:49:31: Successfully removed file: /tmp/fileOfcls7
2022-04-26 17:49:31: /bin/su successfully executed

2022-04-26 17:49:31: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:49:31: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:31: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:33: Removing file /tmp/filemUSOYO
2022-04-26 17:49:33: Successfully removed file: /tmp/filemUSOYO
2022-04-26 17:49:33: /bin/su successfully executed

2022-04-26 17:49:33: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:33: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:36: Removing file /tmp/filenAMtQB
2022-04-26 17:49:36: Successfully removed file: /tmp/filenAMtQB
2022-04-26 17:49:36: /bin/su successfully executed

2022-04-26 17:49:36: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid
2022-04-26 17:49:36: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:49:37: Removing file /tmp/filexnCs9v
2022-04-26 17:49:37: Successfully removed file: /tmp/filexnCs9v
2022-04-26 17:49:37: /bin/su successfully executed

2022-04-26 17:49:37: Status of component/conflict check  for /oracle/app/11.2.0/grid is 1
2022-04-26 17:49:37:  Conflict check passes for oracle home  /oracle/app/11.2.0/grid
2022-04-26 17:49:37: Processing oracle home /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:37: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:49:37: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckComponents -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:37: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckComponents -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:39: Removing file /tmp/fileYdcMmv
2022-04-26 17:49:39: Successfully removed file: /tmp/fileYdcMmv
2022-04-26 17:49:39: /bin/su successfully executed

2022-04-26 17:49:39: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:39: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckComponents -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:42: Removing file /tmp/file6GNBJz
2022-04-26 17:49:42: Successfully removed file: /tmp/file6GNBJz
2022-04-26 17:49:42: /bin/su successfully executed

2022-04-26 17:49:42: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:49:42: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:42: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:44: Removing file /tmp/filer4J1qL
2022-04-26 17:49:44: Successfully removed file: /tmp/filer4J1qL
2022-04-26 17:49:44: /bin/su successfully executed

2022-04-26 17:49:44: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:44: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckConflictAgainstOH -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:49:47: Removing file /tmp/fileBmU7B2
2022-04-26 17:49:47: Successfully removed file: /tmp/fileBmU7B2
2022-04-26 17:49:47: /bin/su successfully executed

2022-04-26 17:49:47: Status of component/conflict check  for /oracle/app/oracle/product/11.2.0/db_1 is 1
2022-04-26 17:49:47:  Conflict check passes for oracle home  /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:49:47: Conflict check passed  for all oracle homes
2022-04-26 17:49:47: Processing oracle home /oracle/app/11.2.0/grid
2022-04-26 17:49:47: Opening file /etc/oracle/ocr.loc
2022-04-26 17:49:47: Value (FALSE) is set for key=local_only
2022-04-26 17:49:47: Home type of /oracle/app/11.2.0/grid is CRS
2022-04-26 17:49:47: Executing cmd: /oracle/app/11.2.0/grid/tfa/bin/tfactl stop
2022-04-26 17:49:47: Command output:
>  /oracle/app/11.2.0/grid/tfa/bin/tfactl: line 29: /oracle/app/11.2.0/grid/tfa/rac1/tfa_home/bin/tfactl.pl: No such file or directory 
>End Command output
2022-04-26 17:49:47: 
/oracle/app/11.2.0/grid/tfa/bin/tfactl output is:
 /oracle/app/11.2.0/grid/tfa/bin/tfactl: line 29: /oracle/app/11.2.0/grid/tfa/rac1/tfa_home/bin/tfactl.pl: No such file or directory

2022-04-26 17:49:47: Unlock crshome...
2022-04-26 17:49:47: crshome passed is 
2022-04-26 17:49:47: Exclude file used is /oracle/app/11.2.0/grid/OPatch/crs/installPatch.excl
2022-04-26 17:49:47: Home location in olr.loc is /oracle/app/11.2.0/grid
2022-04-26 17:49:47: unlock crs home is /oracle/app/11.2.0/grid
2022-04-26 17:49:47: Executing /oracle/app/11.2.0/grid/bin/crsctl stop crs -f
2022-04-26 17:49:47: Executing cmd: /oracle/app/11.2.0/grid/bin/crsctl stop crs -f
2022-04-26 17:50:30: Command output:
>  CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
>  CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
>  CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
>  CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.OCR.dg' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1'
>  CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
>  CRS-2672: Attempting to start 'ora.cvu' on 'rac2'
>  CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
>  CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1'
>  CRS-2676: Start of 'ora.cvu' on 'rac2' succeeded
>  CRS-2677: Stop of 'ora.FRA.dg' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
>  CRS-2672: Attempting to start 'ora.rac1.vip' on 'rac2'
>  CRS-2677: Stop of 'ora.scan1.vip' on 'rac1' succeeded
>  CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac2'
>  CRS-2676: Start of 'ora.rac1.vip' on 'rac2' succeeded
>  CRS-2676: Start of 'ora.scan1.vip' on 'rac2' succeeded
>  CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac2'
>  CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
>  CRS-2672: Attempting to start 'ora.oc4j' on 'rac2'
>  CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac2' succeeded
>  CRS-2677: Stop of 'ora.OCR.dg' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
>  CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
>  CRS-2676: Start of 'ora.oc4j' on 'rac2' succeeded
>  CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
>  CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
>  CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
>  CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed
>  CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
>  CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
>  CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
>  CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
>  CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
>  CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
>  CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
>  CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
>  CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
>  CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
>  CRS-4133: Oracle High Availability Services has been stopped. 
>End Command output
2022-04-26 17:50:30: /oracle/app/11.2.0/grid/bin/crsctl stop crs -f
2022-04-26 17:50:30: Executing cmd: /oracle/app/11.2.0/grid/bin/crsctl check cluster -n rac1
2022-04-26 17:50:32: Command output:
>  CRS-4639: Could not contact Oracle High Availability Services
>  CRS-4000: Command Check failed, or completed with errors. 
>End Command output
2022-04-26 17:50:32: Executing cmd: /oracle/app/11.2.0/grid/bin/crsctl check has
2022-04-26 17:50:33: Command output:
>  CRS-4639: Could not contact Oracle High Availability Services 
>End Command output
2022-04-26 17:50:33: The CRS home passed in is /oracle/app/11.2.0/grid
2022-04-26 17:50:33: Processing directory permissions
2022-04-26 17:50:33: set the permissions on the /oracle/app/11.2.0/grid/jdk directory
2022-04-26 17:50:33: set the permissions on the /oracle/app/11.2.0/grid/perl directory
2022-04-26 17:50:34: set the permissions on the /oracle/app/11.2.0/grid/bin directory
2022-04-26 17:50:34: set the permissions on the /oracle/app/11.2.0/grid/lib directory
2022-04-26 17:52:34: Waiting for complete CRS stack to stop
2022-04-26 17:52:34: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1'
CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1'
CRS-2676: Start of 'ora.cvu' on 'rac2' succeeded
CRS-2677: Stop of 'ora.FRA.dg' on 'rac1' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded
CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.rac1.vip' on 'rac2'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac2'
CRS-2676: Start of 'ora.rac1.vip' on 'rac2' succeeded
CRS-2676: Start of 'ora.scan1.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac2'
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'rac2'
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac2' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2676: Start of 'ora.oc4j' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Successfully unlock /oracle/app/11.2.0/grid

2022-04-26 17:52:34: Invoking removeproc to clean oracle client procs
2022-04-26 17:52:34: Executing cmd: /sbin/fuser -k /oracle/app/11.2.0/grid/bin/crsctl.bin
2022-04-26 17:52:34: fuser command output for /oracle/app/11.2.0/grid/bin/crsctl.bin is 
2022-04-26 17:52:34: Oracle user for /oracle/app/11.2.0/grid is grid
2022-04-26 17:52:34: Opening file /etc/oracle/ocr.loc
2022-04-26 17:52:34: Value (FALSE) is set for key=local_only
2022-04-26 17:52:34: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid
2022-04-26 17:52:34: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/32758914 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:52:36: Removing file /tmp/fileEU4h5w
2022-04-26 17:52:36: Successfully removed file: /tmp/fileEU4h5w
2022-04-26 17:52:36: /bin/su successfully executed

2022-04-26 17:52:36: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid
2022-04-26 17:52:36: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33477185 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:52:41: Removing file /tmp/filevzs4m7
2022-04-26 17:52:41: Successfully removed file: /tmp/filevzs4m7
2022-04-26 17:52:41: /bin/su successfully executed

2022-04-26 17:52:41: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid
2022-04-26 17:52:41: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33112794 -oh /oracle/app/11.2.0/grid '
2022-04-26 17:52:43: Removing file /tmp/file9j0AaW
2022-04-26 17:52:43: Successfully removed file: /tmp/file9j0AaW
2022-04-26 17:52:43: /bin/su successfully executed

2022-04-26 17:52:43: Status of Applicable  check  for /oracle/app/11.2.0/grid is 1
2022-04-26 17:52:43: Oracle user for /oracle/app/11.2.0/grid is grid

2022-04-26 17:52:43: Patch information store successfully edited.
2022-04-26 17:52:43: Executing command /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/32758914 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc as grid
2022-04-26 17:52:43: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/32758914 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc
2022-04-26 17:52:43: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/32758914 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc '
2022-04-26 17:53:28: Removing file /tmp/filePagVkQ
2022-04-26 17:53:28: Successfully removed file: /tmp/filePagVkQ
2022-04-26 17:53:28: /bin/su successfully executed

2022-04-26 17:53:28: status of apply patch is 0
2022-04-26 17:53:28: The apply patch output is Oracle Interim Patch Installer version 11.2.0.3.33
 Copyright (c) 2022, Oracle Corporation.  All rights reserved.
 
 
 Oracle Home       : /oracle/app/11.2.0/grid
 Central Inventory : /oracle/app/oraInventory
    from           : /oracle/app/11.2.0/grid/oraInst.loc
 OPatch version    : 11.2.0.3.33
 OUI version       : 11.2.0.4.0
 Log file location : /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-52-44PM_1.log
 
 Verifying environment and performing prerequisite checks...
 
 --------------------------------------------------------------------------------
 Start OOP by Prereq process.
 Launch OOP...
 
 Oracle Interim Patch Installer version 11.2.0.3.33
 Copyright (c) 2022, Oracle Corporation.  All rights reserved.
 
 
 Oracle Home       : /oracle/app/11.2.0/grid
 Central Inventory : /oracle/app/oraInventory
    from           : /oracle/app/11.2.0/grid/oraInst.loc
 OPatch version    : 11.2.0.3.33
 OUI version       : 11.2.0.4.0
 Log file location : /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-52-50PM_1.log
 
 Verifying environment and performing prerequisite checks...
 OPatch continues with these patches:   32758914  
 
 Do you want to proceed? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 All checks passed.
 
 Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
 (Oracle Home = '/oracle/app/11.2.0/grid')
 
 
 Is the local system ready for patching? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 Backing up files...
 Applying interim patch '32758914' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.crs, 11.2.0.4.0...
 Patch 32758914 successfully applied.
 Log file location: /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-52-50PM_1.log
 
 OPatch succeeded.

2022-04-26 17:53:28: patch /psu/33575261/32758914  apply successful for home  /oracle/app/11.2.0/grid
2022-04-26 17:53:28: Executing command /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33477185 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc as grid
2022-04-26 17:53:28: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33477185 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc
2022-04-26 17:53:28: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33477185 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc '
2022-04-26 17:55:56: Removing file /tmp/fileRhwdhD
2022-04-26 17:55:56: Successfully removed file: /tmp/fileRhwdhD
2022-04-26 17:55:56: /bin/su successfully executed

2022-04-26 17:55:56: status of apply patch is 0
2022-04-26 17:55:56: The apply patch output is Oracle Interim Patch Installer version 11.2.0.3.33
 Copyright (c) 2022, Oracle Corporation.  All rights reserved.
 
 
 Oracle Home       : /oracle/app/11.2.0/grid
 Central Inventory : /oracle/app/oraInventory
    from           : /oracle/app/11.2.0/grid/oraInst.loc
 OPatch version    : 11.2.0.3.33
 OUI version       : 11.2.0.4.0
 Log file location : /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-53-28PM_1.log
 
 Verifying environment and performing prerequisite checks...
 OPatch continues with these patches:   17478514  18031668  18522509  19121551  19769489  20299013  20760982  21352635  21948347  22502456  23054359  24006111  24732075  25869727  26609445  26392168  26925576  27338049  27734982  28204707  28729262  29141056  29497421  29913194  30298532  30670774  31103343  31537677  31983472  32328626  32758711  33128584  33477185  
 
 Do you want to proceed? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 All checks passed.
 
 Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
 (Oracle Home = '/oracle/app/11.2.0/grid')
 
 
 Is the local system ready for patching? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 Backing up files...
 Applying sub-patch '17478514' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.sdo.locator, 11.2.0.4.0...
 
 Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
 
 Patching component oracle.xdk.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '18031668' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.crs, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '18522509' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
 Applying sub-patch '19121551' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.ordim.client, 11.2.0.4.0...
 
 Patching component oracle.ordim.jai, 11.2.0.4.0...
 Applying sub-patch '19769489' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.util, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.xdk.parser.java, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.xdk.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
 Applying sub-patch '20299013' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.sysman.common, 10.2.0.4.5...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.xdk.parser.java, 11.2.0.4.0...
 
 Patching component oracle.xdk.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.sysman.common.core, 10.2.0.4.5...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
 Applying sub-patch '20760982' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '21352635' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 Applying sub-patch '21948347' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
 
 Patching component oracle.xdk.parser.java, 11.2.0.4.0...
 
 Patching component oracle.xdk.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '22502456' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 Applying sub-patch '23054359' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '24006111' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.sqlplus.ic, 11.2.0.4.0...
 
 Patching component oracle.sqlplus, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 Applying sub-patch '24732075' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.plugin.db.main.agent, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.sqlplus.ic, 11.2.0.4.0...
 
 Patching component oracle.sqlplus, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.util, 11.2.0.4.0...
 
 Patching component oracle.ordim.client, 11.2.0.4.0...
 
 Patching component oracle.ordim.jai, 11.2.0.4.0...
 
 Patching component oracle.ordim.server, 11.2.0.4.0...
 Applying sub-patch '25869727' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.oid.client, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '26609445' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 Applying sub-patch '26392168' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oid.client, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.client, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.network.listener, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...
 
 Patching component oracle.xdk.parser.java, 11.2.0.4.0...
 
 Patching component oracle.xdk.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '26925576' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '27338049' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.assistants.server, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 Applying sub-patch '27734982' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.ctx.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '28204707' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 Applying changes to emctl script on the home: /oracle/app/11.2.0/grid ...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.security.osdt, 11.2.0.4.0...
 
 Patching component oracle.ldap.owm, 11.2.0.4.0...
 
 Patching component oracle.sqlplus.rsf, 11.2.0.4.0...
 Applying sub-patch '28729262' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 INFO: Script isn't applicable to this port!
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.util, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 Applying sub-patch '29141056' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '29497421' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 Applying sub-patch '29913194' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.rdbms.util, 11.2.0.4.0...
 Applying sub-patch '30298532' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.tg4tera, 11.2.0.4.0 ] , [ oracle.rdbms.tg4sybs, 11.2.0.4.0 ] , [ oracle.rdbms.tg4ifmx, 11.2.0.4.0 ] , [ oracle.rdbms.tg4db2, 11.2.0.4.0 ] , [ oracle.rdbms.tg4msql, 11.2.0.4.0 ] , [ oracle.rdbms.hsodbc, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 Applying sub-patch '30670774' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.swd.oui, 11.2.0.4.0...
 Applying sub-patch '31103343' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '31537677' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.dbdev, 11.2.0.4.0 ] , [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 
 Patching component oracle.oracore.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.util, 11.2.0.4.0...
 
 Patching component oracle.buildtools.rsf, 11.2.0.4.0...
 Applying sub-patch '31983472' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 Applying sub-patch '32328626' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rman, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf, 11.2.0.4.0...
 
 Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...
 Applying sub-patch '32758711' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 Applying sub-patch '33128584' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.ctx, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 Applying sub-patch '33477185' to OH '/oracle/app/11.2.0/grid'
 ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.
 
 Patching component oracle.rdbms, 11.2.0.4.0...
 
 Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
 
 Patching component oracle.rdbms.rsf, 11.2.0.4.0...
 
 Patching component oracle.network.rsf, 11.2.0.4.0...
 Composite patch 33477185 successfully applied.
 Log file location: /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-53-28PM_1.log
 
 OPatch succeeded.

2022-04-26 17:55:56: patch /psu/33575261/33477185  apply successful for home  /oracle/app/11.2.0/grid
2022-04-26 17:55:56: Executing command /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33112794 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc as grid
2022-04-26 17:55:56: Running as user grid: /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33112794 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc
2022-04-26 17:55:56: s_run_as_user2: Running /bin/su grid -c ' /oracle/app/11.2.0/grid/OPatch/opatch napply /psu/33575261/33112794 -local -silent -oh /oracle/app/11.2.0/grid -invPtrLoc /oracle/app/11.2.0/grid/oraInst.loc '
2022-04-26 17:56:54: Removing file /tmp/fileBL7CxK
2022-04-26 17:56:54: Successfully removed file: /tmp/fileBL7CxK
2022-04-26 17:56:54: /bin/su successfully executed

2022-04-26 17:56:54: status of apply patch is 0
2022-04-26 17:56:54: The apply patch output is Oracle Interim Patch Installer version 11.2.0.3.33
 Copyright (c) 2022, Oracle Corporation.  All rights reserved.
 
 
 Oracle Home       : /oracle/app/11.2.0/grid
 Central Inventory : /oracle/app/oraInventory
    from           : /oracle/app/11.2.0/grid/oraInst.loc
 OPatch version    : 11.2.0.3.33
 OUI version       : 11.2.0.4.0
 Log file location : /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-55-57PM_1.log
 
 Verifying environment and performing prerequisite checks...
 OPatch continues with these patches:   33112794  
 
 Do you want to proceed? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 All checks passed.
 
 Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
 (Oracle Home = '/oracle/app/11.2.0/grid')
 
 
 Is the local system ready for patching? [y|n]
 Y (auto-answered by -silent)
 User Responded with: Y
 Backing up files...
 Applying interim patch '33112794' to OH '/oracle/app/11.2.0/grid'
 
 Patching component oracle.usm, 11.2.0.4.0...
 Patch 33112794 successfully applied.
 Log file location: /oracle/app/11.2.0/grid/cfgtoollogs/opatch/opatch2022-04-26_17-55-57PM_1.log
 
 OPatch succeeded.

2022-04-26 17:56:54: patch /psu/33575261/33112794  apply successful for home  /oracle/app/11.2.0/grid
2022-04-26 17:56:54: Processing oracle home /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:56:54: Opening file /etc/oracle/ocr.loc
2022-04-26 17:56:54: Value (FALSE) is set for key=local_only
2022-04-26 17:56:54: Home type of /oracle/app/oracle/product/11.2.0/db_1 is DB
2022-04-26 17:56:54: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:56:54: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/bin/emctl stop dbconsole
2022-04-26 17:56:54: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/bin/emctl stop dbconsole '
2022-04-26 17:56:55: Removing file /tmp/fileFSVC5k
2022-04-26 17:56:55: Successfully removed file: /tmp/fileFSVC5k
2022-04-26 17:56:55: /bin/su exited with rc=1

2022-04-26 17:56:55: Performing DB patch
2022-04-26 17:56:55: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:56:55: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/bin/emctl stop agent
2022-04-26 17:56:55: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/bin/emctl stop agent '
2022-04-26 17:56:56: Removing file /tmp/fileAXZEVY
2022-04-26 17:56:56: Successfully removed file: /tmp/fileAXZEVY
2022-04-26 17:56:56: /bin/su exited with rc=1

2022-04-26 17:56:56: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:56:56: Opening file /etc/oracle/ocr.loc
2022-04-26 17:56:56: Value (FALSE) is set for key=local_only
2022-04-26 17:56:56: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:56:56: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/32758914/custom/server/32758914 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:56:59: Removing file /tmp/filev2nUtF
2022-04-26 17:56:59: Successfully removed file: /tmp/filev2nUtF
2022-04-26 17:56:59: /bin/su successfully executed

2022-04-26 17:56:59: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:56:59: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/OPatch/opatch prereq CheckApplicable -ph /psu/33575261/33477185 -oh /oracle/app/oracle/product/11.2.0/db_1 '
2022-04-26 17:57:05: Removing file /tmp/file2C0SOs
2022-04-26 17:57:05: Successfully removed file: /tmp/file2C0SOs
2022-04-26 17:57:05: /bin/su successfully executed

2022-04-26 17:57:05: Status of Applicable  check  for /oracle/app/oracle/product/11.2.0/db_1 is 1
2022-04-26 17:57:05: Oracle user for /oracle/app/oracle/product/11.2.0/db_1 is oracle
2022-04-26 17:57:05: Executing cmd: /oracle/app/11.2.0/grid/bin/crsctl query crs activeversion
2022-04-26 17:57:16: Command output:
>  Oracle Cluster Registry initialization failed accessing Oracle Cluster Registry device: PROC-26: Error while accessing the physical storage
>  ORA-29701: unable to connect to Cluster Synchronization Service
>   
>End Command output
2022-04-26 17:57:16: /oracle/app/11.2.0/grid/bin/crsctl query crs activeversion ... failed rc=8 with message:
 Oracle Cluster Registry initialization failed accessing Oracle Cluster Registry device: PROC-26: Error while accessing the physical storage ORA-29701: unable to connect to Cluster Synchronization Service  

2022-04-26 17:57:16: Running as user oracle: /oracle/app/oracle/product/11.2.0/db_1/bin/srvctl stop home -o /oracle/app/oracle/product/11.2.0/db_1 -s /oracle/app/oracle/product/11.2.0/db_1/srvm/admin/stophome.txt -n rac1 -f
2022-04-26 17:57:16: s_run_as_user2: Running /bin/su oracle -c ' /oracle/app/oracle/product/11.2.0/db_1/bin/srvctl stop home -o /oracle/app/oracle/product/11.2.0/db_1 -s /oracle/app/oracle/product/11.2.0/db_1/srvm/admin/stophome.txt -n rac1 -f '
2022-04-26 17:57:16: Removing file /tmp/file90r9jY
2022-04-26 17:57:16: Successfully removed file: /tmp/file90r9jY
2022-04-26 17:57:16: /bin/su exited with rc=1

2022-04-26 17:57:16: /oracle/app/oracle/product/11.2.0/db_1/bin/srvctl stop home -o /oracle/app/oracle/product/11.2.0/db_1 -s /oracle/app/oracle/product/11.2.0/db_1/srvm/admin/stophome.txt -n rac1 -f output is PRKH-1010 : Unable to communicate with CRS services.
 PRKH-3003 : An attempt to communicate with the CSS daemon failed

2022-04-26 17:57:16: Failed to stop resources from  database home /oracle/app/oracle/product/11.2.0/db_1
2022-04-26 17:57:16: ERROR: Refer log file for more details.