ORA-00205 ORA-27086告警处理

系统：CentOS 7.9

环境：单实例

问题描述：Oracle 11.2.0.4升级19.3后，open数据库报错ORA-00205，如下所示：

SQL> startup
ORACLE instance started.

Total System Global Area 2455228416 bytes
Fixed Size                  2255712 bytes
Variable Size             620758176 bytes
Database Buffers         1811939328 bytes
Redo Buffers               20275200 bytes
ORA-00205: error in identifying control file, check alert log for more info

以下trace文件报错信息：

Wed Aug 17 20:55:07 2022
ALTER DATABASE   MOUNT
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/u01/app/oracle/fast_recovery_area/orcl150/control02.ctl'
ORA-27086: unable to lock file - already in use
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 8
Additional information: 34443
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/u01/app/oracle/oradata/orcl150/control01.ctl'
ORA-27086: unable to lock file - already in use
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 8
Additional information: 34443
ORA-205 signalled during: ALTER DATABASE   MOUNT...

核心报错ORA-27086，通过ps -ef确认到存在数据库orcl150正在运行.

[oracle@oel db]$ ps -ef|grep ora_smon
oracle    34447      1  0 20:53 ?        00:00:00 ora_smon_orcl150
oracle    43919   6876  0 23:20 pts/1    00:00:00 grep --color=auto ora_smon

监听状态也显示orcl150数据库正在运行.

[oracle@oel db]$ lsnrctl status

LSNRCTL for Linux: Version 11.2.0.4.0 - Production on 17-AUG-2022 23:20:20

Copyright (c) 1991, 2013, Oracle.  All rights reserved.

Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 19.0.0.0.0 - Production
Start Date                17-AUG-2022 20:46:07
Uptime                    0 days 2 hr. 34 min. 13 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /u01/app/oracle/product/19.3.0/db_1/network/admin/listener.ora
Listener Log File         /u01/app/oracle/diag/tnslsnr/oel/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=oel)(PORT=1521)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC1521)))
Services Summary...
Service "ORCL150" has 1 instance(s).
  Instance "orcl150", status READY, has 1 handler(s) for this service...
Service "orcl150XDB" has 1 instance(s).
  Instance "orcl150", status READY, has 1 handler(s) for this service...
The command completed successfully

sql plus连接显示却为idle instance.

[oracle@oel db]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Wed Aug 17 23:20:28 2022

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to an idle instance.

通过控制文件查看数据库后台进程运行情况.

[root@oel dbs]# lsof //u01/app/oracle/oradata/orcl150/control0*
COMMAND     PID   USER   FD   TYPE DEVICE SIZE/OFF      NODE NAME
ora_dbw0_ 34439 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_lgwr_ 34441 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_ckpt_ 34443 oracle  256uW  REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_w001_ 34459 oracle  258u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_mmon_ 34465 oracle  257u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_m000_ 34478 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_m001_ 34480 oracle  260u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_tt00_ 34487 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_arc0_ 34489 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_arc1_ 34493 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_arc2_ 34495 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_arc3_ 34497 oracle  256u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_cjq0_ 34503 oracle  257u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_w002_ 34530 oracle  257u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_m002_ 34704 oracle  258u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_m003_ 34706 oracle  259u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_w003_ 34729 oracle  258u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl
ora_w005_ 35415 oracle  258u   REG  253,0 10436608 208809672 //u01/app/oracle/oradata/orcl150/control01.ctl

通过系统命令杀掉后台进程.

[root@oel dbs]# kill -9 34439
[root@oel dbs]# kill -9 34441
[root@oel dbs]# kill -9 34443
[root@oel dbs]# kill -9 34459
[root@oel dbs]# kill -9 34465
[root@oel dbs]# kill -9 34478
[root@oel dbs]# kill -9 34480
[root@oel dbs]# kill -9 34487
[root@oel dbs]# kill -9 34489
[root@oel dbs]# kill -9 34493
[root@oel dbs]# kill -9 34495
[root@oel dbs]# kill -9 34497
[root@oel dbs]# kill -9 34503
[root@oel dbs]# kill -9 34530
[root@oel dbs]# kill -9 34704
[root@oel dbs]# kill -9 34706
[root@oel dbs]# kill -9 34729
[root@oel dbs]# kill -9 35415

此后数据库正常开启.

[oracle@oel ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Wed Aug 17 23:32:36 2022
Version 19.3.0.0.0

Copyright (c) 1982, 2019, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup nomount;
ORACLE instance started.

Total System Global Area 2466249672 bytes
Fixed Size                  8899528 bytes
Variable Size             536870912 bytes
Database Buffers         1912602624 bytes
Redo Buffers                7876608 bytes
SQL> alter database mount;

Database altered.

SQL> alter database open;

Database altered.