• 适用范围
  
• 问题概述
  
• 问题原因
  
• 解决方案
  
• 参考文档
  

适用范围

通用

问题概述

某日对客户数据库进行巡检时发现某系统dg夯住，查看alert发现如下报错：

Thu Jan 09 090452 2020
Errors in file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_pr00_8214.trc
ORA-19502 write error on file /u01/app/oracle/oradata/prod/DGFUND/datafile/o1_mf_sysaux_h1dyzbv4_.dbf, block number 3519232 (block size=8192)
ORA-27072 File IO error
Additional information 4
Additional information 3519232
Additional information 1007616
File #9 added to control file as 'UNNAMED00009'.
Originally created as
'+DATAfunddatafilesysaux.12628.1029229337'
Recovery was unable to create the file as a new OMF file.
MRP0 Background Media Recovery terminated with error 1274
Errors in file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_pr00_8214.trc
ORA-01274 cannot add datafile '+DATA/fund/datafile/sysaux.12628.1029229337' - file could not be created
Managed Standby Recovery not using Real Time Apply
Recovery interrupted!
Recovered data files to a consistent state at change 16662822915975
Thu Jan 09 090501 2020
MRP0 Background Media Recovery process shutdown (prod)
Thu Jan 09 091008 2020
Archived Log entry 15527 added for thread 1 sequence 15678 ID 0x8c3fadcd dest 1
Thu Jan 09 091008 2020
RFS[387] Selected log 7 for thread 1 sequence 15679 dbid -1941959728 branch 913989330
Thu Jan 09 091336 2020
Errors in file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_ora_24124.trc
ORA-03171 Recovery was terminated during query execution

问题原因

造成该故障的原因是，主库添加了一个30G的数据文件，而当时备库只剩下27G的空间，在备库进行同步由于空间不足导致报错

解决方案

在对备库进行存储扩容之后，再开启mrp进程还是报错，分析发现备库新创建的数据文件未放在正确的位置，需要恢复，alert如下：

开启mrp报错：

alter database recover managed standby database using current logfile disconnect from session
Attempt to start background Managed Standby Recovery process (prod)
Fri Jan 10 102008 2020
MRP0 started with pid=35, OS id=4975 
MRP0 Background Managed Standby Recovery process started (prod)
 started logmerger process
Fri Jan 10 102013 2020
Managed Standby Recovery starting Real Time Apply
Fri Jan 10 102013 2020
Errors in file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_dbw0_28496.trc
ORA-01186 file 9 failed verification tests
ORA-01157 cannot identifylock data file 9 - see DBWR trace file
ORA-01111 name for data file 9 is unknown - rename to correct file
ORA-01110 data file 9 '/u01/app/oracle/product/11.2/db_1/dbs/UNNAMED00009'
File 9 not verified due to error ORA-01157
MRP0 Background Media Recovery terminated with error 1111
Errors in file /u01/app/oracle/diag/rdbms/prod/prod/trace/prod_pr00_4979.trc
ORA-01111 name for data file 9 is unknown - rename to correct file
ORA-01110 data file 9 '/u01/app/oracle/product/11.2/db_1/dbs/UNNAMED00009'
ORA-01157 cannot identifylock data file 9 - see DBWR trace file
ORA-01111 name for data file 9 is unknown - rename to correct file
ORA-01110 data file 9 '/u01/app/oracle/product/11.2/db_1/dbs/UNNAMED00009'
Managed Standby Recovery not using Real Time Apply
Recovery Slave PR00 previously exited with exception 1111
MRP0 Background Media Recovery process shutdown (prod)
Completed   alter database recover managed standby database using current logfile disconnect from session

恢复过程如下：
（1）将备库的standby_file_management参数修改为手动管理模式

alter system set standby_file_management=manual;

（2）把UNNAMED数据文件放到正确路径

alter database create datafile  '/u01/app/oracle/product/11.2/db_1/dbs/UNNAMED00009'  as  '/u01/app/oracle/oradata/prod/sysaux.12628.1029229337';

CREATE DATAFILE 命令的含义是根据控制文件创建一个新的数据文件，来代替原来的数据文件，之后再通过应用日志来对这个数据文件进行介质恢复
（3）将备库的standby_file_management参数修改回自动模式

alter system set standby_file_management=AUTO;

（4）开启mrp应用

alter database recover managed standby database using current logfile disconnect from session;