Oracle RAC私网修改错了咋办

IT界数据库架构师的漂泊人生 2020-12-14

486

[root@sharkdb-rac-01 sharkdb-rac-01]# more alertsharkdb-rac-01.log

2017-06-02 15:38:21.671:

[ohasd(2285)]CRS-2112:已在节点 sharkdb-rac-01 上启动 OLR 服务。

2017-06-02 15:38:21.740:

[ohasd(2285)]CRS-1301:已在节点 sharkdb-rac-01 上启动 Oracle 高可用性服务。

2017-06-02 15:38:21.802:

[ohasd(2285)]CRS-8017:位置: etc/oracle/lastgasp 具有 2 个重新启动指导日志文件, 0 个已发布, 0 个出现错误

2017-06-02 15:38:25.938:

[/g01/ora_soft/grid/home/11.2.0/bin/orarootagent.bin(2534)]CRS-2302:无法获取 GPnP 概要文件。错误 CLSGPNP_NO_DAEMON (GPNPD 守护程序未运行)。

2017-06-02 15:38:32.607:

[cssd(2697)]CRS-1713:CSSD 守护程序已在 clustered 模式下启动

2017-06-02 15:38:34.437:

[ohasd(2285)]CRS-2767:没有尝试对 'ora.diskmon' 进行资源状态恢复, 因为其目标状态为 OFFLINE

2017-06-02 15:38:34.437:

[ohasd(2285)]CRS-2769:无法对资源 'ora.diskmon' 进行故障转移。

2017-06-02 15:38:52.228:

[cssd(2697)]CRS-1707:节点 sharkdb-rac-01 (编号为 1) 的租约获取已完成

2017-06-02 15:38:53.465:

[cssd(2697)]CRS-1605:CSSD 表决文件联机: dev/asm-diskd; 详细资料见 g01/ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/cssd/ocssd.log。

2017-06-02 15:38:53.469:

[cssd(2697)]CRS-1605:CSSD 表决文件联机: dev/asm-diske; 详细资料见 g01/ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/cssd/ocssd.log。

2017-06-02 15:38:53.473:

[cssd(2697)]CRS-1605:CSSD 表决文件联机: dev/asm-diskc; 详细资料见 g01/ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/cssd/ocssd.log。

2017-06-02 15:39:02.591:

[cssd(2697)]CRS-1601:CSSD 重新配置完毕。活动节点为 sharkdb-rac-01 。

2017-06-02 15:39:05.160:

[ctssd(2801)]CRS-2401:已在主机 sharkdb-rac-01 上启动了集群时间同步服务。

2017-06-02 15:39:05.160:

[ctssd(2801)]CRS-2407:新的集群时间同步服务引用节点为主机 sharkdb-rac-01。

2017-06-02 15:39:06.608:

[ohasd(2285)]CRS-2767:没有尝试对 'ora.diskmon' 进行资源状态恢复, 因为其目标状态为 OFFLINE

2017-06-02 15:39:06.609:

[ohasd(2285)]CRS-2769:无法对资源 'ora.diskmon' 进行故障转移。

2017-06-02 15:40:03.620:

[/g01/ora_soft/grid/home/11.2.0/bin/orarootagent.bin(2642)]CRS-5818:已中止命令 'start' (对于资源 'ora.cluster_interconnect.haip')。详细资料见 (:CRSAGF00113:) {0:0:2} (位于 g01/

ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/agent/ohasd/orarootagent_root/orarootagent_root.log)。

2017-06-02 15:40:07.623:

[ohasd(2285)]CRS-2757:命令 'Start' 在等待来自资源 'ora.cluster_interconnect.haip' 的响应时超时。详细资料见 (:CRSPE00111:) {0:0:2} (位于 g01/ora_soft/grid/home/11.2.0/log/sharkd

b-rac-01/ohasd/ohasd.log)。

2017-06-02 15:41:07.631:

[/g01/ora_soft/grid/home/11.2.0/bin/orarootagent.bin(2642)]CRS-5818:已中止命令 'start' (对于资源 'ora.cluster_interconnect.haip')。详细资料见 (:CRSAGF00113:) {0:0:2} (位于 g01/

ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/agent/ohasd/orarootagent_root/orarootagent_root.log)。

2017-06-02 15:41:11.634:

[ohasd(2285)]CRS-2757:命令 'Start' 在等待来自资源 'ora.cluster_interconnect.haip' 的响应时超时。详细资料见 (:CRSPE00111:) {0:0:2} (位于 g01/ora_soft/grid/home/11.2.0/log/sharkd

b-rac-01/ohasd/ohasd.log)。

2017-06-02 15:42:11.649:

[/g01/ora_soft/grid/home/11.2.0/bin/orarootagent.bin(2642)]CRS-5818:已中止命令 'start' (对于资源 'ora.cluster_interconnect.haip')。详细资料见 (:CRSAGF00113:) {0:0:2} (位于 g01/

ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/agent/ohasd/orarootagent_root/orarootagent_root.log)。

2017-06-02 15:42:15.651:

[ohasd(2285)]CRS-2757:命令 'Start' 在等待来自资源 'ora.cluster_interconnect.haip' 的响应时超时。详细资料见 (:CRSPE00111:) {0:0:2} (位于 g01/ora_soft/grid/home/11.2.0/log/sharkd

b-rac-01/ohasd/ohasd.log)。

2017-06-02 15:43:15.670:

[/g01/ora_soft/grid/home/11.2.0/bin/orarootagent.bin(2642)]CRS-5818:已中止命令 'start' (对于资源 'ora.cluster_interconnect.haip')。详细资料见 (:CRSAGF00113:) {0:0:2} (位于 g01/

ora_soft/grid/home/11.2.0/log/sharkdb-rac-01/agent/ohasd/orarootagent_root/orarootagent_root.log)。

2017-06-02 15:43:19.674:

[ohasd(2285)]CRS-2757:命令 'Start' 在等待来自资源 'ora.cluster_interconnect.haip' 的响应时超时。详细资料见 (:CRSPE00111:) {0:0:2} (位于 g01/ora_soft/grid/home/11.2.0/log/sharkd

b-rac-01/ohasd/ohasd.log)。

2017-06-02 15:43:19.677:

[ohasd(2285)]CRS-2807:资源 'ora.asm' 无法自动启动。

2017-06-02 15:43:19.677:

[ohasd(2285)]CRS-2807:资源 'ora.cluster_interconnect.haip' 无法自动启动。

2017-06-02 15:43:19.677:

[ohasd(2285)]CRS-2807:资源 'ora.crsd' 无法自动启动。

从RAC的ALTER日志看到是GPNP有问题

GPNPD 是搞啥子的?

gpnp 会使用mdns提供的节点信息向网络发布自己的信息,同时收索其他节点信息。发现了个节点并把本地的gpnp profile推送过去，成功表示是同一个集群。

gpnp 全称是grid plug and play 进程名为gpnpd.bin 目的于将集群基本信息保存在本地，通过MDNSD进行通信识别集群其他的节点。由gpnp wallet和gpnp profile组成。

这样说来这个进程还是很重要的哦！ gpnpd.bin从gpnp profile配置文件读取集群信息，然后访问MDNS 没有的话访问DNS，再没有的话访问/etc/hosts。

gpnp profile 保存路径在GI_HOME/gpnp/profiles/peer

gpnp主线程完成对gpnp profile的读取；

push 线程当本地profile改变时向远程节点推送;

dispatch线程：消息分发

OCR线程：当OCR发生改变后通知DISPATCH线程。

原始的PROFILE

[grid@sharkdb-rac-01 peer]$ more profile_orig.xml

<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-prof

ile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-

profile gpnp-profile.xsd" ProfileSequence="1" ClusterUId="02064357315acfc2ff9111328a3a592d" ClusterName="sharkdb-rac" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="g

en" HostName="*"><gpnp:Network id="net1" IP="192.168.2.0" Adapter="eth1" Use="public"/><gpnp:Network id="net2" IP="192.168.3.0" Adapter="eth2" Use="cluster_interconnect"/></gpnp

:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/asm*" SPFile=""/><ds:Sign

ature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm=

"http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform

Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"><InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transfor

ms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>q02Qjzqm+yZa6pcZGu7WtTOPcNw=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:Signature

Value>OQI7+PhB3g9j1FdBL/zmvBuoEyhHHJKHX0lx4x1EMdL6wmlOfOjx4UfIXbkG2rgj0GrwwfSYSxl1/bBinyKSeEGfVjiafUiGR/tp/f+3TZQKzKPr09u8gNXLLsfhzVB6r1uFPqVpqVjBF8CU1IRWeWxeESugmrQvHv0GwPYRR70

=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>

修改后的PROFILE
<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="8" ClusterUId="02064357315acfc2ff9111328a3a592d" ClusterName="sharkdb-rac" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" Adapter="eth1" IP="192.168.7.0" Use="public"/><gpnp:Network id="net3" Adapter="ethn2" IP="192.168.8.0" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/asm*" SPFile="+OCR/sharkdb-rac/asmparameterfile/registry.253.931113675"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>shzrHMmb76sfVxnE6YxQOwy1OcI=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>TGrZhkthYKIiqZeLp+/qXDQ/Gl+WRkFPd6MPUAgRQWG3Rygk87fo8GEo0deRUsOsZvQU5mDqrn1ZVxuVnl9QjqoLhI2XoTJB3yGhBBtloo9/1snl3Zd0UwM95DL3ra436PvqS2JAeKMF29ZYmIqRxLC5jNAf/bjesHxgWMTD8Po=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>[grid@sharkdb-rac-01 peer]$

很明显我的私有网卡名字多输入了个N,与系统网卡名称不一致.

[root@sharkdb-rac-01 ~]# ifconfig

eth1 Link encap:Ethernet HWaddr 08:00:27:C8:85:B8

inet addr:192.168.7.203 Bcast:192.168.7.255 Mask:255.255.255.0

inet6 addr: fe80::a00:27ff:fec8:85b8/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:874 errors:0 dropped:64 overruns:0 frame:0

TX packets:336 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:73376 (71.6 KiB) TX bytes:48302 (47.1 KiB)

eth2 Link encap:Ethernet HWaddr 08:00:27:72:F6:2A

inet addr:192.168.8.203 Bcast:192.168.8.255 Mask:255.255.255.0

inet6 addr: fe80::a00:27ff:fe72:f62a/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:0 errors:0 dropped:0 overruns:0 frame:0

TX packets:66 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:0 (0.0 b) TX bytes:12209 (11.9 KiB)

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UP LOOPBACK RUNNING MTU:65536 Metric:1

RX packets:960 errors:0 dropped:0 overruns:0 frame:0

TX packets:960 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RX bytes:967085 (944.4 KiB) TX bytes:967085 (944.4 KiB)

把下面目录的 vi profile.xml pending.xml 修改正确

/g01/ora_soft/grid/home/11.2.0/gpnp/sharkdb-rac-01/profiles/peer

/g01/ora_soft/grid/home/11.2.0/gpnp/sharkdb-rac-01/wallets/peer

/g01/ora_soft/grid/home/11.2.0/gpnp/profiles/peer

/g01/ora_soft/grid/home/11.2.0/gpnp/wallets/peer

保存重启后依旧如此!

听说PROFILE.XML 有缓存,那么先关闭CRS和HAS

crs软件关闭自动启动 crsctl disable crs

[root@sharkdb-rac-01 ~]# crsctl disable crs

CRS-4621: Oracle High Availability Services autostart is disabled.

Oracle建议使用crsctl disable has来禁止开机启动HAS。

[root@sharkdb-rac-01 ~]# crsctl disable has

CRS-4621: Oracle High Availability Services autostart is disabled.

这样修改就能保存到位,重启后也没有被还原. 可是重启CRS,HAS又被还原了.

看来人工是搞不定的,只好祭出GPNPTOOL

看实际操作步骤

[root@sharkdb-rac-01 init.d]# cd /g01/ora_soft/grid/home/11.2.0/gpnp/sharkdb-rac-01/profiles/peer

[root@sharkdb-rac-01 peer]# cp profile.xml profile.bak

cp：是否覆盖"profile.bak"？ yes

2 无信号化

[root@sharkdb-rac-01 peer]# gpnptool unsign -p=profile.bak

Warning: some command line parameters were defaulted. Resulting command line:

/g01/ora_soft/grid/home/11.2.0/bin/gpnptool.bin unsign -p=profile.bak -o-

Success.

3 正式编辑

[root@sharkdb-rac-01 peer]# gpnptool edit -net3:net_ada='eth2' -p=profile.bak -o=profile.bak

Error: Can't save result 'profile.bak' - file already exists.

[root@sharkdb-rac-01 peer]# gpnptool edit -net3:net_ada='eth2' -p=profile.bak -o=profile.bak -ovr

Resulting profile written to "profile.bak".

Success.

4 恢复信号

[root@sharkdb-rac-01 peer]# gpnptool sign -p=profile.bak -w=file:/g01/ora_soft/grid/home/11.2.0/gpnp/sharkdb-rac-01/wallets/peer -o=profile.new

Resulting profile written to "profile.new".

Success.

[root@sharkdb-rac-01 peer]# pwd

/g01/ora_soft/grid/home/11.2.0/gpnp/sharkdb-rac-01/profiles/peer

[root@sharkdb-rac-01 peer]# ll

总用量 24

-rw-r--r-- 1 grid oinstall 1888 6月 9 16:24 pending.xml

-rw-r--r-- 1 root root 1887 6月 9 17:20 profile.bak

-rw-r--r-- 1 root root 1887 6月 9 17:33 profile.new

-rw-r--r-- 1 grid oinstall 1888 6月 8 17:48 profile.old

-rw-r--r-- 1 grid oinstall 1826 12月 20 18:39 profile_orig.xml

-rw-r--r-- 1 grid oinstall 1888 6月 9 16:20 profile.xml

5 覆盖文件

[root@sharkdb-rac-01 peer]# mv profile.new profile.xml

mv：是否覆盖"profile.xml"？ yes

6 查看

[root@sharkdb-rac-01 peer]# cat profile.xml

<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="8" ClusterUId="02064357315acfc2ff9111328a3a592d" ClusterName="sharkdb-rac" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" Adapter="eth1" IP="192.168.7.0" Use="public"/><gpnp:Network id="net3" Adapter="eth2" IP="192.168.8.0" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/asm*" SPFile="+OCR/sharkdb-rac/asmparameterfile/registry.253.931113675"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>zcvvTP5EEbY0a5hbz+ub7qN/GHY=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>AivMOdECDw8ZyTH2B/IXWqmyQRhi8AJOkGShUZvJt7jsgDXegjMkJtJZUucQYG3/pA8X6Ec91WQv9+AkzWuoxz8f4oM1VIF2lZohqeSgKScS8DU20qW2p9iyLDeBA/yAIvwTnSQ1nDuaz/7m42nBSAbguiwR3CYoOM5pqKYRV0Q=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>[root@sharkdb-rac-01 peer]#