适用范围

11gR2以上

问题概述

客户核心系统营销业务数据库 1节点数据库发生重启，重启原因分析。

问题现象

1节点alert日志如下：

Wed Aug 03 03:43:22 2022
Errors in file /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/trace/xxxxxx1_mmon_16053.trc  (incident=574393):
ORA-00445: background process "m000" did not start after 120 seconds
Incident details in: /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/incident/incdir_574393/xxxxxx1_mmon_16053_i574393.trc
Wed Aug 03 03:43:27 2022
Dumping diagnostic data in directory=[cdmp_20220803034327], requested by (instance=1, osid=16053 (MMON)), summary=[incident=574393].
Wed Aug 03 03:43:27 2022


ERROR: slave communication error with ASMWed Aug 03 03:45:17 2022
ERROR: slave communication error with ASM
Wed Aug 03 03:45:17 2022

WARNING: ASM communication error: op 17 state 0x50 (3113)
  Time: 03-AUG-2022 03:45:17

Fatal NI connect error 12170.
ERROR: slave communication error with ASMWARNING: ASM communication error: op 17 state 0x50 (3113)
Wed Aug 03 03:45:17 2022


WARNING: ASM communication error: op 17 state 0x50 (3113)
Wed Aug 03 03:45:17 2022
Wed Aug 03 03:45:17 2022
WARNING: ASM communication error: op 17 state 0x50 (3113)WARNING: ASM communication error: op 17 state 0x50 (3113)ERROR: slave communication error with ASM

ERROR: slave communication error with ASM
NOTE: Deferred communication with ASM instanceWed Aug 03 03:45:17 2022


WARNING: ASM communication error: op 17 state 0x50 (3113)
ERROR: slave communication error with ASM
ERROR: slave communication error with ASM
ERROR: slave communication error with ASM
Errors in file /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/trace/xxxxxx1_ora_21318.trc:
ORA-03113: end-of-file on communication channel
Process ID: 
Session ID: 1279 Serial number: 11
NOTE: Deferred communication with ASM instance
NOTE: deferred map free for map id 1073938699
Errors in file /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/trace/xxxxxx1_ora_94681.trc:
ORA-03113: end-of-file on communication channel
Process ID: 
Session ID: 847 Serial number: 93
NOTE: deferred map free for map id 1073938687
Wed Aug 03 03:45:17 2022
WARNING: ASM communication error: op 17 state 0x50 (3113)
ERROR: slave communication error with ASM
Wed Aug 03 03:45:17 2022
WARNING: ASM communication error: op 17 state 0x50 (3113)
ERROR: slave communication error with ASM
Wed Aug 03 03:45:18 2022
NOTE: ASMB terminating
Errors in file /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/trace/xxxxxx1_asmb_16051.trc:
ORA-15064: communication failure with ASM instance
ORA-03135: connection lost contact
Process ID: 
Session ID: 541 Serial number: 2009
Errors in file /u01/app/oracle/diag/rdbms/newxxxxxx/xxxxxx1/trace/xxxxxx1_asmb_16051.trc:
ORA-15064: communication failure with ASM instance
ORA-03135: connection lost contact
Process ID: 
Session ID: 541 Serial number: 2009
ASMB (ospid: 16051): terminating the instance due to error 15064
Instance terminated by ASMB, pid = 16051
Wed Aug 03 03:45:57 2022
Starting ORACLE instance (normal)

如上 8月3日，3：45重启， 重启原因，ASMB进程终止了实例。

在重启之前，时间从Wed Aug 03 03:41:36 2022开始持续到重启，循环报如下提示，

***********************************************************************

Fatal NI connect error 12170.

  VERSION INFORMATION:
	TNS for Linux: Version 11.2.0.4.0 - Production
	Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
	TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
  Time: 03-AUG-2022 03:45:34
  Tracing not turned on.
  Tns error struct:
    ns main err code: 12535
    
TNS-12535: TNS:operation timed out
    ns secondary err code: 12606
    nt main err code: 0
    nt secondary err code: 0