服务器断电导致ORA-00600 [kcratr_scan_lastbwr]异常

问题描述：当更新一个0.18 billion条记录的大表字段时，由于突然断电导致数据库异常关闭，再次启动数据库时报错ORA-00600 [kcratr_scan_lastbwr].

数据库：oracle 11.2.0.4 64位

系统：centos 7.9 64位

告警日志如下：

starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...

starting up 1 shared server(s) ...

ORACLE_BASE from environment = /u01/app/oracle

ALTER DATABASE   MOUNT

2022-10-26 09:42:36.549000 +08:00

Successful mount of redo thread 1, with mount id 1646826504

Database mounted in Exclusive Mode

Lost write protection disabled

Completed: ALTER DATABASE   MOUNT

ALTER DATABASE OPEN

2022-10-26 09:42:37.527000 +08:00

Beginning crash recovery of 1 threads

 parallel recovery started with 3 processes

Started redo scan

2022-10-26 09:42:38.673000 +08:00

Hex dump of (file 1, block 1326280) in trace file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_2352.trc

Reading datafile '/u01/app/oracle/oradata/orcl/system01.dbf' for corruption at rdba: 0x00543cc8 (file 1, block 1326280)

Reread (file 1, block 1326280) found same corrupt data (logically corrupt)

Write verification failed for File 1 Block 1326280 (rdba 0x543cc8)

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_2352.trc  (incident=28953):

ORA-00600: internal error code, arguments: [kcratr_scan_lastbwr], [], [], [], [], [], [], [], [], [], [], []

Incident details in: /u01/app/oracle/diag/rdbms/orcl/orcl/incident/incdir_28953/orcl_ora_2352_i28953.trc

Use ADRCI or Support Workbench to package the incident.

See Note 411.1 at My Oracle Support for error and packaging details.

Aborting crash recovery due to error 600

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_2352.trc:

ORA-00600: internal error code, arguments: [kcratr_scan_lastbwr], [], [], [], [], [], [], [], [], [], [], []

Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_2352.trc:

ORA-00600: internal error code, arguments: [kcratr_scan_lastbwr], [], [], [], [], [], [], [], [], [], [], []

ORA-600 signalled during: ALTER DATABASE OPEN...

2022-10-26 09:42:40.142000 +08:00

Dumping diagnostic data in directory=[cdmp_20221026094240], requested by (instance=1, osid=2352), summary=[incident=28953].

2022-10-26 09:43:35.468000 +08:00

Sweep [inc][28953]: completed

Sweep [inc2][28953]: completed

 

处理过程：

SQL> shutdown immediate

ORA-01109: database not open

 

 

Database dismounted.

ORACLE instance shut down.

SQL> startup mount

ORACLE instance started.

 

Total System Global Area 1586708480 bytes

Fixed Size                  2253624 bytes

Variable Size             989859016 bytes

Database Buffers          587202560 bytes

Redo Buffers                7393280 bytes

Database mounted.

SQL> shutdown immediate

ORA-01109: database not open

 

 

Database dismounted.

ORACLE instance shut down.

SQL> startup mount

ORACLE instance started.

 

Total System Global Area 1586708480 bytes

Fixed Size                  2253624 bytes

Variable Size             989859016 bytes

Database Buffers          587202560 bytes

Redo Buffers                7393280 bytes

Database mounted.

SQL> recover database

Media recovery complete.

SQL> alter database open;

 

恢复日志：

Database altered.

2022-10-26 10:07:01.043000 +08:00

Media Recovery Complete (orcl)

Completed: ALTER DATABASE RECOVER  database 

2022-10-26 10:07:12.931000 +08:00

alter database open

Beginning crash recovery of 1 threads

 parallel recovery started with 3 processes

Started redo scan

Completed redo scan

 read 95093 KB redo, 0 data blocks need recovery

Started redo application at

 Thread 1: logseq 7054, block 61504

Recovery of Online Redo Log: Thread 1 Group 1 Seq 7054 Reading mem 0

  Mem# 0: /u01/app/oracle/oradata/orcl/redo01.log

Recovery of Online Redo Log: Thread 1 Group 2 Seq 7055 Reading mem 0

  Mem# 0: /u01/app/oracle/oradata/orcl/redo02.log

Recovery of Online Redo Log: Thread 1 Group 3 Seq 7056 Reading mem 0

  Mem# 0: /u01/app/oracle/oradata/orcl/redo03.log

Completed redo application of 0.00MB

Completed crash recovery at

 Thread 1: logseq 7056, block 83541, scn 5679922

 0 data blocks read, 0 data blocks written, 95093 redo k-bytes read

Thread 1 advanced to log sequence 7057 (thread open)

Thread 1 opened at log sequence 7057

  Current log# 1 seq# 7057 mem# 0: /u01/app/oracle/oradata/orcl/redo01.log

Successful open of redo thread 1

MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set

SMON: enabling cache recovery

[2653] Successfully onlined Undo Tablespace 2.

Undo initialization finished serial:0 start:1314554 end:1314614 diff:60 (0 seconds)

Verifying file header compatibility for 11g tablespace encryption..

Verifying 11g file header compatibility for tablespace encryption completed

SMON: enabling tx recovery

Database Characterset is AL32UTF8

No Resource Manager plan active

replication_dependency_tracking turned off (no async multimaster replication found)

Starting background process QMNC

2022-10-26 10:07:13.906000 +08:00

QMNC started with pid=28, OS id=2730

Completed: alter database open

参考网址：https://blog.csdn.net/luckytjx/article/details/122320056