节点1 ora.asm服务无法启动ORA-10997

1，三节点rac，grid版本12.2.0.1   instance 安装了2个版本，11.2.0.4,12.2.0.1

2，节点1   

--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
               ONLINE  OFFLINE      s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.CRS.dg
               ONLINE  OFFLINE      s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.DATA.dg
               ONLINE  OFFLINE      s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.MGMT.dg
               ONLINE  OFFLINE      s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.net1.network
               ONLINE  ONLINE       s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.ons
               ONLINE  ONLINE       s824a                    STABLE
               ONLINE  ONLINE       s824b                    STABLE
               ONLINE  ONLINE       s824c                    STABLE
ora.proxy_advm
               OFFLINE OFFLINE      s824a                    STABLE
               OFFLINE OFFLINE      s824b                    STABLE
               OFFLINE OFFLINE      s824c                    STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       s824b                    STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       s824c                    169.254.116.163 10.1
                                                             0.10.11,STABLE
ora.asm
      1        ONLINE  OFFLINE                               Instance Shutdown,ST
                                                             ABLE
      2        ONLINE  ONLINE       s824b                    Started,STABLE
      3        ONLINE  ONLINE       s824c                    Started,STABLE
ora.cdb.db
      1        ONLINE  ONLINE       s824a                    Open,HOME=/u01/app/o
                                                             racle/12.2.0/db_1,ST
                                                             ABLE
      2        ONLINE  ONLINE       s824b                    Open,HOME=/u01/app/o
                                                             racle/12.2.0/db_1,ST
                                                             ABLE
      3        ONLINE  ONLINE       s824c                    Open,HOME=/u01/app/o
                                                             racle/12.2.0/db_1,ST
                                                             ABLE
ora.cvu
      1        ONLINE  ONLINE       s824c                    STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       s824c                    Open,STABLE
ora.orcl.db
      1        ONLINE  OFFLINE                               Instance Shutdown,ST
                                                             ABLE
      2        ONLINE  ONLINE       s824b                    Open,HOME=/u01/app/o
                                                             racle/11.1.0,STABLE
      3        ONLINE  ONLINE       s824c                    Open,HOME=/u01/app/o
                                                             racle/11.1.0,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       s824b                    STABLE
ora.s824a.vip
      1        ONLINE  ONLINE       s824a                    STABLE
ora.s824b.vip
      1        ONLINE  ONLINE       s824b                    STABLE
ora.s824c.vip
      1        ONLINE  ONLINE       s824c                    STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       s824b                    STABLE
--------------------------------------------------------------------------------




# su - grid
$ sqlplus / as sysasm

SQL*Plus: Release 12.2.0.1.0 Production on Fri Apr 19 10:48:25 2019

Copyright (c) 1982, 2017, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup
ORA-10997: another startup/shutdown operation of this instance inprogress
ORA-09967: unable to create or open lock file
IBM AIX RISC System/6000 Error: 13: Permission denied

从这个错误看，就是有实例锁定了，如果之前关闭不彻底，用 ipcrm 去删除共享内存段。就好了。

$ ipcs -m
IPC status from /dev/mem as of Fri Apr 19 14:24:57 CST 2019
T        ID     KEY        MODE       OWNER    GROUP
Shared Memory:
m      1024 0xffffffff D-rw-------     root   system
m      1025 0xffffffff D-rw-------     root   system
m      1026 0xffffffff D-rw-------     root   system
m      1027 0xffffffff D-rw-------     root   system
m      1028 0xffffffff D-rw-------     root   system
m      1030 0xffffffff D-rw-------     root   system
m  10486793 0xffffffff D-rw-------     root   system
m      1044 0xffffffff D-rw-------     root   system
m  53478424 0x0d000948 --rw-rw----     root   system
m 115345366 0x2102c00f --rw-rw----     grid oinstall
m 1035995140 0x93b016cc --rw-------   oracle oinstall
m 532678667   00000000 --rw-------   oracle oinstall
m 572524735   00000000 --rw-------   oracle oinstall
m 247466179   00000000 --rw-------   oracle oinstall
m  47188187   00000000 --rw-------   oracle oinstall

$ ipcs|grep oracle|awk '{print $2}'
1035995140
532678667
572524735
247466179
47188187
============================

ipcrm -m 1035995140
ipcrm -m 532678667
ipcrm -m 572524735
ipcrm -m 247466179
ipcrm -m 47188187

如果还是不能启动，用 strace / truss 跟踪sqlplus startup ，看看请求的写入文件。