归档错误导致磁盘空间爆满

问题描述：

突然接到告警，某个库ASM磁盘空间99%（PS：竟然连90%的预警都没有，直接干到99%了），登陆服务器，发现大量归档把磁盘空间占满
手工先删除sequence 27861产生的归档，根本删除不完，没删完就又有新的了

问题排查：

手工切日志
alter system switch logfile;
没有回应，结束不了

检查oracle alert 报错内容：

2024-08-12T18:23:19.618877+08:00
Errors in file /u01/app/oracle/diag/rdbms/gldcdb/gldcdb2/trace/gldcdb2_arc2_21032.trc:
ORA-00742: Log read detects lost write in thread 2 sequence 27861 block 642176
ORA-00312: online log 11 thread 2: '+DATA/GLDCDB/ONLINELOG/group_11.435.1152888653'
2024-08-12T18:23:19.618936+08:00
ARC2 (PID:21032): Error 742  while archiving
2024-08-12T18:23:19.619003+08:00
Closing local archive destination LOG_ARCHIVE_DEST_1 '+DATA/GLDCDB/ARCHIVELOG/2024_08_12/thread_2_seq_27861.1456.1176834195', error=742 (gldcdb2)
ARC2 (PID:21032): Committing creation of archive log '+DATA/GLDCDB/ARCHIVELOG/2024_08_12/thread_2_seq_27861.1456.1176834195', error=742
2024-08-12T18:23:20.895420+08:00
Errors in file /u01/app/oracle/diag/rdbms/gldcdb/gldcdb2/trace/gldcdb2_arc2_21032.trc:
ORA-16038: log 11 sequence# 27861 cannot be archived
ORA-00742: Log read detects lost write in thread  sequence  block
ORA-00312: online log 11 thread 2: '+DATA/GLDCDB/ONLINELOG/group_11.435.1152888653'
2024-08-12T18:23:20.895497+08:00
ARC2 (PID:21032): Archival error occurred on a closed thread, archiver continuing
2024-08-12T18:23:20.895559+08:00
ORACLE Instance gldcdb2, archival error, archiver continuing

临时处理：

–清理无法归档的日志
alter database clear unarchived logfile group 11;
日志不产生了，把11删除重建，跟业务确认没有发现影响，做个全备

遗憾的是情况紧急，rm删除的时候，把所有的有问题的归档全删了，不然可以dump一下看看是为啥

参考

Database Crashe with ORA-16038/ORA-742 Errors (文档 ID 2064718.1)
Error ORA-742: Log Read Detects Lost Write In Alert Log (文档 ID 2354255.1)