适用范围

本次故障环境为： red hat linux 6.6 64bit 11.2.0.4 4 nodes rac

问题概述

2019年8月23日1点17分45秒至23分30秒之间，xxxdb数据库实例三发生自动重启。

问题原因

下面分析xxxdb数据库实例三发生自动重启的原因。

alert日志分析

如下是xxxdb3实例的alert日志信息： Fri Aug 23 01:17:45 2019 LMS1 (ospid: 280249) received an instance eviction notification from instance 1 [2] Fri Aug 23 01:17:45 2019 LMON received an instance eviction notification from instance 1 The instance eviction reason is 0x2 The instance eviction map is 3 Fri Aug 23 01:17:47 2019 System state dump requested by (instance=3, osid=280214 (PMON)), summary=[abnormal instance termination]. Fri Aug 23 01:17:47 2019 PMON (ospid: 280214): terminating the instance due to error 481 System State dumped to trace file /oracle/diag/rdbms/xxxdb/xxxdb3/trace/xxxdb3_diag_280227_20190823011747.trc Fri Aug 23 01:18:00 2019 Termination issued to instance processes. Waiting for the processes to exit Instance termination failed to kill one or more processes PMON (ospid: 280214): terminating the instance due to error 481 System State dumped to trace file /oracle/diag/rdbms/xxxdb/xxxdb3/trace/xxxdb3_diag_280227_20190823011747.trc Fri Aug 23 01:18:00 2019 Termination issued to instance processes. Waiting for the processes to exit Instance termination failed to kill one or more processes Instance terminated by PMON, pid = 280214 Fri Aug 23 01:18:12 2019 Adjusting the default value of parameter parallel_max_servers from 3600 to 2970 due to the value of parameter processes (3000) Starting ORACLE instance (normal) ************************ Large Pages Information ******************* Per process system memlock (soft) limit = UNLIMITED

Total Shared Global Region in Large Pages = 0 KB (0%)

Large Pages used by this instance: 0 (0 KB) Large Pages unused system wide = 0 (0 KB) Large Pages configured system wide = 0 (0 KB) Large Page size = 2048 KB

RECOMMENDATION: Total System Global Area size is 250 GB. For optimal performance, prior to the next instance restart:

1. Increase the number of unused large pages by at least 128001 (page size 2048 KB, total size 250 GB) system wide to get 100% of the System Global Area allocated with large pages

LICENSE_MAX_SESSION = 0