数据库版本：Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

4节点RAC。节点4实例莫名重启。

alter日志

2021-10-26T07:33:39.675470+08:00
Thread 4 advanced to log sequence 17244 (LGWR switch)
Current log# 6 seq# 17244 mem# 0: +SSD/ORACON/ONLINELOG/group_6.265.1024831505
2021-10-26T07:35:09.402044+08:00
Incident details in: /u01/app/oracle/diag/rdbms/oracon/oracon4/incident/incdir_183524/oracon4_lms1_6259_i183524.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
2021-10-26T07:35:11.562955+08:00
Errors in file /u01/app/oracle/diag/rdbms/oracon/oracon4/trace/oracon4_lms1_6259.trc:
2021-10-26T07:35:11.582685+08:00
Dumping diagnostic data in directory=[cdmp_20211026073511], requested by (instance=4, osid=6259 (LMS1)), summary=[incid
ent=183524].
2021-10-26T07:35:13.734642+08:00
opidrv aborting process LMS1 ospid (6259) as a result of ORA-600
2021-10-26T07:35:16.815636+08:00
Instance Critical Process (pid: 25, ospid: 6259, LMS1) died unexpectedly
PMON (ospid: 6208): terminating the instance due to error 12752
2021-10-26T07:35:19.510818+08:00
License high water mark = 1295
2021-10-26T07:35:21.695447+08:00
Instance terminated by PMON, pid = 6208
2021-10-26T07:35:21.697516+08:00
Warning: 2 processes are still attach to shmid 3244043:
(size: 49152 bytes, creator pid: 6027, last attach/detach pid: 6229)
2021-10-26T07:35:22.512615+08:00
USER (ospid: 62078): terminating the instance
2021-10-26T07:35:22.513682+08:00
Instance terminated by USER, pid = 62078
2021-10-26T07:35:27.230982+08:00
Starting ORACLE instance (normal) (OS id: 62259)
2021-10-26T07:35:27.246139+08:00
CLI notifier numLatches:73 maxDescs:4171
2021-10-26T07:35:27.253489+08:00

trace日志

*** 2021-10-26T07:35:09.403505+08:00

kjmpbmsg: caught non-fatal error 600
kjmpbmsg fatal error on 32
MSG [32:KJX_B_OCR] [0x9bf03.aa] inc=31 len=360 sender=(2,2) bd 19 seq=529460849
fg=iqb stat=0 spnum=385 flg=x0
flow ctrl: ver=1 flag=109 len=360 tkts=0 seq=529460849 wrp=6
sndr=2 dest=4 rcvr=2
FUSION MSG 0x7f598692f7f0,32 from 2 spnum 385 ver[31,31,205259] bd 19 ln 360 sq[2,8]flg x0
OCR [0x9bf03.aa, 20.8.75439]lockp[0x431fe86b38,29979]shadow[(nil),30390]
reqid xee84 seq 0xa fl 0x8.0 md x2 infosz 144 opt 0x0
seq 0xa change-scn scn: 0xc3360000 xid 0x0000.000.00000000
grant 1 convert 0 role x3
pi [0x16bf.0xc336d455] flags 0x0 state 0x100
disk scn 0x16bf.c3363e04 writereq scn 0x0.0 rreqid x1f
msgRM# 205259 bkt# 13 drmbkt# 12288
pkey 20.8.75439
hv 53 [stat 0x0, 4->4, wm 1, RMno 0, reminc 29, dom 20 inc 2 rcvendinc 0/0 valid ? 1]
attach map: 1 2 3 4
kjga st 0x4, step 0.0.0, cinc 31, rmno 205259, flags 0x2000
lb 0, hb 0, myb 13, drmb 12288, apifrz 0
ackhb 0, esm 0, gotl 0
FUSION MSG DUMP END
MSG [65518:IBATCH] inc=31 len=1168 sender=2 bd 19 seq=465262655 fg=b
flow ctrl: ver=1 flag=97 len=1168 tkts=9 seq=465262655 wrp=0
sndr=2 dest=4 rcvr=2
MSG [32:KJX_B_OCR] [0x9bf03.aa] inc=31 len=360 sender=(2,2) bd 19 seq=529460849
fg=iqb stat=0 spnum=385 flg=x0
FUSION MSG 0x7f598692f7f0,32 from 2 spnum 385 ver[31,31,205259] bd 19 ln 360 sq[2,8]flg x0
OCR [0x9bf03.aa, 20.8.75439]lockp[0x431fe86b38,29979]shadow[(nil),30390]
reqid xee84 seq 0xa fl 0x8.0 md x2 infosz 144 opt 0x0
seq 0xa change-scn scn: 0xc3360000 xid 0x0000.000.00000000
grant 1 convert 0 role x3
pi [0x16bf.0xc336d455] flags 0x0 state 0x100
disk scn 0x16bf.c3363e04 writereq scn 0x0.0 rreqid x1f
msgRM# 205259 bkt# 13 drmbkt# 12288
pkey 20.8.75439
hv 53 [stat 0x0, 4->4, wm 1, RMno 0, reminc 29, dom 20 inc 2 rcvendinc 0/0 valid ? 1]
attach map: 1 2 3 4
kjga st 0x4, step 0.0.0, cinc 31, rmno 205259, flags 0x2000
lb 0, hb 0, myb 13, drmb 12288, apifrz 0
ackhb 0, esm 0, gotl 0
FUSION MSG DUMP END
MSG [33:KJX_B_LSET] [0x9bf03.aa] inc=31 len=184 sender=(2,2) bd 19 seq=529460850
fg=iqb stat=0 spnum=385 flg=x0
FUSION MSG 0x7f598692f958,33 from 2 spnum 385 ver[31,31,205259] bd 19 ln 184 sq[2,8]flg x0
LSET [0x9bf03.aa, 20.8.75439]shadow[(nil),30390]req[61060]seq 0xb
client [0x431fe86b38,29979] rsn x1 md x1 act 2 ordered 0
grant 1 convert 0 role x3
pi [0x16bf.0xc336d455] flags 0x0 state 0x100
disk scn 0x16bf.c3363e04 writereq scn 0x0.0 rreqid x1f
msgRM# 205259 bkt# 13 drmbkt# 12288
pkey 20.8.75439
hv 53 [stat 0x0, 4->4, wm 1, RMno 0, reminc 29, dom 20 inc 2 rcvendinc 0/0 valid ? 1]
attach map: 1 2 3 4
kjga st 0x4, step 0.0.0, cinc 31, rmno 205259, flags 0x2000
lb 0, hb 0, myb 13, drmb 12288, apifrz 0
ackhb 0, esm 0, gotl 0
FUSION MSG DUMP END
MSG [32:KJX_B_OCR] [0x9bf03.aa] inc=31 len=360 sender=(2,2) bd 19 seq=529460851
fg=iqb stat=0 spnum=385 flg=x0
FUSION MSG 0x7f598692fa10,32 from 2 spnum 385 ver[31,31,205259] bd 19 ln 360 sq[2,8]flg x0
OCR [0x9bf03.aa, 20.8.75439]lockp[0x431fe86b38,29979]shadow[(nil),30390]
reqid xee85 seq 0xc fl 0x8.0 md x2 infosz 144 opt 0x0
seq 0xc change-scn scn: 0x0 xid 0x0000.000.00000000
grant 1 convert 0 role x3
pi [0x16bf.0xc336d455] flags 0x0 state 0x100
disk scn 0x16bf.c3363e04 writereq scn 0x0.0 rreqid x1f
msgRM# 205259 bkt# 13 drmbkt# 12288
pkey 20.8.75439
hv 53 [stat 0x0, 4->4, wm 1, RMno 0, reminc 29, dom 20 inc 2 rcvendinc 0/0 valid ? 1]
attach map: 1 2 3 4
kjga st 0x4, step 0.0.0, cinc 31, rmno 205259, flags 0x2000
lb 0, hb 0, myb 13, drmb 12288, apifrz 0
ackhb 0, esm 0, gotl 0
FUSION MSG DUMP END
MSG [33:KJX_B_LSET] [0x9bf03.aa] inc=31 len=184 sender=(2,2) bd 19 seq=529460852
fg=iqb stat=0 spnum=25 flg=x0
FUSION MSG 0x7f598692fb78,33 from 2 spnum 25 ver[31,31,205259] bd 19 ln 184 sq[2,8]flg x0
LSET [0x9bf03.aa, 20.8.75439]shadow[(nil),30390]req[61059]seq 0x9
client [0x431fe86b38,29979] rsn x100 md x1 act 1 ordered 0
grant 2 convert 0 role x3
pi [0x16bf.0xc336d455] flags 0x0 state 0x100
disk scn 0x16bf.c3363e04 writereq scn 0x0.0 rreqid x1f
msgRM# 205259 bkt# 13 drmbkt# 12288
pkey 20.8.75439
hv 53 [stat 0x0, 4->4, wm 1, RMno 0, reminc 29, dom 20 inc 2 rcvendinc 0/0 valid ? 1]
attach map: 1 2 3 4
kjga st 0x4, step 0.0.0, cinc 31, rmno 205259, flags 0x2000
lb 0, hb 0, myb 13, drmb 12288, apifrz 0
ackhb 0, esm 0, gotl 0