Oracle Database 19c Enterprise Edition Release 19.12.0.0.0，实例发生重启，操作系统是Redhat7.9

alert 如下：

ORA-29770: global enqueue process LMD2 (OSID 29334) is hung for more than 70 seconds
Incident details in: /u01/app/oracle/diag/rdbms/newdmis/x8m2/incident/incdir_1099135/x8m2_lmhb_29344_i1099135.trc
2022-02-14T02:14:56.530369+08:00
LOCK_DBGRP: GCR_SYSTEST debug event locked group GR+DB_NEWDMIS by memno 1
2022-02-14T02:14:56.862900+08:00
Process termination requested for pid 29308_29318 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863083+08:00
Process termination requested for pid 29465 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863090+08:00
Process termination requested for pid 29308_29316 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863149+08:00
Process termination requested for pid 29408 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863177+08:00
Process termination requested for pid 29427 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863181+08:00
Process termination requested for pid 29308_29310 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863270+08:00
Process termination requested for pid 29441 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863280+08:00
Process termination requested for pid 29502 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863290+08:00
Process termination requested for pid 29306_29315 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863304+08:00
Process termination requested for pid 29306_29309 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863300+08:00
Process termination requested for pid 29306_29317 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863459+08:00
Process termination requested for pid 29423 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863518+08:00
Process termination requested for pid 29488 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863544+08:00
Process termination requested for pid 29417 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
2022-02-14T02:14:56.863578+08:00
Process termination requested for pid 29451 [source = rdbms], [info = 0] [request issued by pid: 29344, uid: 1001]
LMHB (ospid: 29344): terminating the instance due to ORA error 29770
2022-02-14T02:14:56.887693+08:00
Cause - 'ERROR: Some process(s) is not making progress.
LMHB (ospid: 29344) is terminating the instance.
Please check LMHB trace file for more details.
Please also check the CPU load, I/O load and other system properties for anomalous behavior
ERROR: Some process(s'
2022-02-14T02:14:57.046669+08:00
Dumping diagnostic data in directory=[cdmp_20220214021457], requested by (instance=2, osid=29344 (LMHB)), summary=[abnormal instance termination].
2022-02-14T02:14:57.448858+08:00
ORA-1092 : opitsk aborting process
2022-02-14T02:14:57.824424+08:00
License high water mark = 1182
2022-02-14T02:15:01.511074+08:00
Instance terminated by LMHB, pid = 29344
2022-02-14T02:15:01.836817+08:00
Warning: 2 processes are still attacheded to shmid 3178502:
(size: 2097152 bytes, creator pid: 27369, last attach/detach pid: 28939)
2022-02-14T02:15:02.825594+08:00
USER(prelim) (ospid: 200491): terminating the instance
2022-02-14T02:15:02.828016+08:00
Instance terminated by USER(prelim), pid = 200491
2022-02-14T02:15:06.216316+08:00
Starting ORACLE instance (normal) (OS id: 200972)
2022-02-14T02:15:06.251516+08:00
************************************************************
Instance SGA_TARGET = 229376 MB and SGA_MAX_SIZE = 229376 MB
************************************************************
2022-02-14T02:15:06.251679+08:00
****************************************************
Sys-V shared memory will be used for creating SGA
****************************************************
2022-02-14T02:15:06.252622+08:00
**********************************************************************
2022-02-14T02:15:06.252662+08:00
Dump of system resources acquired for SHARED GLOBAL AREA (SGA)

2022-02-14T02:15:06.252729+08:00
Per process system memlock (soft) limit = UNLIMITED
2022-02-14T02:15:06.252766+08:00
Expected per process system memlock (soft) limit to lock
instance MAX SHARED GLOBAL AREA (SGA) into memory: 224G
2022-02-14T02:15:06.252853+08:00
Available system pagesizes:
4K, 2048K
2022-02-14T02:15:06.252924+08:00
Supported system pagesize(s):
2022-02-14T02:15:06.252958+08:00
PAGESIZE AVAILABLE_PAGES EXPECTED_PAGES ALLOCATED_PAGES ERROR(s)
2022-02-14T02:15:06.253027+08:00
2048K 115227 114551 114551 NONE
2022-02-14T02:15:06.253061+08:00
Reason for not supporting certain system pagesizes:
2022-02-14T02:15:06.253096+08:00
4K - Large pagesizes only
2022-02-14T02:15:06.253130+08:00
**********************************************************************
SGA Local memory support enabled
2022-02-14T02:15:09.461983+08:00
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
2022-02-14T02:15:09.639223+08:00
Initial number of CPU is 96
Number of processor cores in the system is 48
Number of processor sockets in the system is 2
KSXRTEST ISGA: RM Channel count = 1
KSXRTEST ISGA: rcnt= 70 rmrcnt = 1
CELL communication is configured to use 2 interface(s):
192.168.10.3
192.168.10.4
CELL IP affinity details:
NUMA status: NUMA system w/ 2 process groups
Capability Type : Network
capabilities requested : 7 detected : 5 Simulated : 0
Capability Type : Runtime Environment
capabilities requested : 400000FF detected : 40000000 Simulated : 0
Capability Type : Engineered Systems
capabilities requested : F detected : 1 Simulated : 0
Capability Type : Database Test
capabilities requested : 3 detected : 0 Simulated : 0
Capability Type : Database Editions
capabilities requested : 1CC detected : 8 Simulated : 0
kjidomenacan initialized to 3
2022-02-14T02:15:11.200493+08:00
Autotune of undo retention is turned off.
LICENSE_MAX_USERS = 0
SYS auditing is enabled
2022-02-14T02:15:11.331597+08:00
NOTE: remote asm mode is remote (mode 0x2; from cluster type)
NOTE: remote asm mode is remote (mode 0x2; from cluster type)
NOTE: Cluster configuration type = CLUSTER [4]
NUMA system with 2 nodes detected
Oracle NUMA support enabled
NUMA node details:
OS NUMA node 0 (48 cpus) mapped to Oracle NUMA node 0
OS NUMA node 1 (48 cpus) mapped to Oracle NUMA node 1
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.12.0.0.0.
ORACLE_HOME: /u01/app/oracle/product/19.0.0.0/dbhome_1
System name: Linux
Node name: chacdbadm02.champion-ic.com
Release: 4.14.35-2047.505.4.4.el7uek.x86_64
Version: #2 SMP Wed Aug 4 12:16:26 PDT 2021
Machine: x86_64
Storage: Exadata
Using parameter settings in server-side spfile +DATAC1/NEWDMIS/PARAMETERFILE/spfile.422.1082565371
System parameters with non-default values:
processes = 10000
event = "10949 trace name context forever:28401 trace name context forever,level 1:10849 trace name context forever, level 1:19823 trace name context forever, level 90"
sga_max_size = 224G
use_large_pages = "ONLY"
shared_pool_size = 24G
_shared_pool_reserved_pct= 20
pga_aggregate_limit = 0
nls_language = "AMERICAN"
nls_territory = "AMERICA"
filesystemio_options = "setall"
resource_manager_plan = "force:"
cluster_interconnects = "192.168.10.3:192.168.10.4"
_lm_sync_timeout = 1200
_ges_direct_free_res_type= "CTARAHDXBB"
_lm_tickets = 5000
sga_target = 224G
_memory_imm_mode_without_autosga= FALSE
control_files = "+DATAC1/NEWDMIS/CONTROLFILE/current01.ctl"
control_file_record_keep_time= 31
db_block_checksum = "full"
db_block_size = 8192
db_cache_advice = "OFF"
_external_scn_rejection_threshold_hours= 24
_external_scn_logging_threshold_seconds= 3600
compatible = "19.0.0"
log_archive_dest_1 = "location=USE_DB_RECOVERY_FILE_DEST valid_for=(ALL_LOGFILES,ALL_ROLES) DB_UNIQUE_NAME=newdmis"
log_archive_dest_state_1 = "ENABLE"
log_archive_dest_state_2 = "ENABLE"
fal_client = ""
fal_server = ""
log_archive_config = ""
log_archive_format = "%t_%s_%r.arc"
archive_lag_target = 1800
_use_single_log_writer = "FALSE"
_use_adaptive_log_file_sync= "FALSE"
db_files = 5000
cluster_database = TRUE
db_create_file_dest = "+DATAC1"
db_create_online_log_dest_1= "+DATAC1"
db_recovery_file_dest = "+RECOC1"
db_recovery_file_dest_size= 30000G
standby_file_management = "AUTO"
_gc_undo_affinity = FALSE
_gc_policy_time = 0
_gc_defer_time = 32
thread = 2
fast_start_mttr_target = 300
db_lost_write_protect = "typical"
_datafile_write_errors_crash_instance= FALSE
_datafile_open_errors_crash_instance= FALSE
temp_undo_enabled = FALSE
_cleanup_rollback_entries= 5000
_rollback_segment_count = 2000
undo_tablespace = "UNDOTBS2"
_smu_debug_mode = 128M
_undo_autotune = FALSE
undo_retention = 10800
fast_start_parallel_rollback= "LOW"
_partition_large_extents = "FALSE"
_index_partition_large_extents= "FALSE"
instance_number = 2
_securefiles_concurrency_estimate= 50
_drop_stat_segment = 1
db_block_checking = "false"
recyclebin = "ON"
_keep_remote_column_size = TRUE
remote_login_passwordfile= "EXCLUSIVE"
audit_sys_operations = TRUE
_sys_logon_delay = 0
global_names = FALSE
_clusterwide_global_transactions= FALSE
shared_servers = 0
max_shared_servers = 0
local_listener = "(ADDRESS=(PROTOCOL=TCP)(HOST=10.1.15.21)(PORT=1600))"
session_cached_cursors = 300
_cursor_obsolete_threshold= 1024
job_queue_processes = 1000
_system_trig_enabled = TRUE
parallel_min_servers = 0
parallel_max_servers = 64
parallel_execution_message_size= 32768
_PX_use_large_pool = TRUE
_fix_control = "28414968:OFF"
_fix_control = "20922160:OFF"
result_cache_max_size = 0
open_links = 200
open_links_per_instance = 50
audit_trail = "NONE"
db_name = "dmis"
db_unique_name = "newdmis"
open_cursors = 5000
os_authent_prefix = ""
_sort_elimination_cost_ratio= 1
sql92_security = TRUE
_optimizer_partial_join_eval= FALSE
_b_tree_bitmap_plans = FALSE
_optimizer_extended_cursor_sharing= "NONE"
_optimizer_extended_cursor_sharing_rel= "NONE"
_optimizer_adaptive_cursor_sharing= FALSE
_optimizer_unnest_scalar_sq= FALSE
parallel_threads_per_cpu = 1
_serial_direct_read = "NEVER"
pga_aggregate_target = 40G
_optimizer_mjc_enabled = FALSE
_bloom_filter_enabled = FALSE
_optimizer_cartesian_enabled= FALSE
deferred_segment_creation= FALSE
_optimizer_null_accepting_semijoin= FALSE
_optimizer_aggr_groupby_elim= FALSE
parallel_force_local = TRUE
_and_pruning_enabled = FALSE
_optimizer_use_feedback = FALSE
_optimizer_gather_feedback= FALSE
_sql_plan_directive_mgmt_control= 0
_optimizer_ads_use_result_cache= FALSE
_optimizer_dsdir_usage_control= 0
optimizer_adaptive_plans = FALSE
_part_access_version_by_number= FALSE
_optimizer_reduce_groupby_key= FALSE
_optimizer_enhanced_join_elimination= FALSE
_optimizer_gather_stats_on_load_index= FALSE
sec_max_failed_login_attempts= 100
enable_ddl_logging = TRUE
awr_pdb_autoflush_enabled= TRUE
awr_snapshot_time_offset = 1000000
_report_capture_cycle_time= 0
diagnostic_dest = "/u01/app/oracle"
max_dump_file_size = "104857600"
enable_pluggable_database= TRUE
2022-02-14T02:15:11.725130+08:00
Cluster Communication is configured to use IPs from: CI
IP: 192.168.10.3 Subnet: 192.168.8.0
IP: 192.168.10.4 Subnet: 192.168.8.0
KSIPC Storage IPs:
IP: 192.168.10.3 Subnet: 192.168.8.0
KSIPC Loopback IP addresses(OSD):
127.0.0.1
KSIPC Available Transports for cluster communication: RC:RDS:UDP:XRC:TCP:RDSTCP:UD_RDS
KSIPC Available Transports for storage communication: RC:RDS:UDP:XRC:TCP:RDSTCP:UD_RDS
KSIPC: Client: KCL Transport: XRC
KSIPC: Client: DLM Transport: RDS
Exafusion enabled
KSIPC CAPABILITIES :MGA:IPCLW:GRPAM:PR:TOPO:DLL:SHREG:STATSFW:CRTRK
2022-02-14T02:15:12.568030+08:00
KSXP: ksxpsg_ipclwtrans: 1 RDS
cluster interconnect IPC version: [IPCLW over RDS(mode 2) ]
IPC Vendor 1 proto 2
Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 6.0
============================================================
NOTE: PatchLevel of this instance 0
============================================================
Starting background process PMON
2022-02-14T02:15:12.720561+08:00
PMON started with pid=2, OS id=201610
Starting background process CLMN
2022-02-14T02:15:12.765559+08:00
CLMN started with pid=3, OS id=201615
Starting background process PSP0
2022-02-14T02:15:12.808590+08:00
PSP0 started with pid=4, OS id=201619
Starting background process IPC0
2022-02-14T02:15:14.062202+08:00
IPC0 started with pid=5, OS id=201625
2022-02-14T02:15:14.063383+08:00
Starting background process VKTM
2022-02-14T02:15:14.109760+08:00
VKTM started with pid=6, OS id=201634 at elevated (RT) priority
Starting background process GEN0
2022-02-14T02:15:14.110787+08:00