opengauss3.0.0+mogha高可用测试

 高可用切换测试

• 一、主库停机维护

[omm@test01 mogha]$ gs_om -t status --all

节点1（停止mogha及gaussdb服务并卸载vip）
[omm@test01 mogha]$ sudo systemctl stop mogha
[omm@test01 mogha]$ sudo ifconfig ens33 del 192.168.1.66
[omm@test01 mogha]$ gs_ctl stop -D /gauss/gaussdb/data/dn/


节点2（切换为主库）
[omm@test02 ~]$ sudo systemctl stop mogha
[omm@test02 ~]$ gs_ctl failover -D /gauss/gaussdb/data/dn/
[omm@test02 mogha]$ gs_om -t refreshconf
[omm@test02 ~]$ sudo systemctl start mogha

[omm@test02 ~]$ gs_guc reload -N test02 -D /gauss/gaussdb/data/dn -c "synchronous_standby_names='2(dn_6003,dn_6004)'"
[omm@test01 mogha]$ gs_om -t status --all

节点3
[omm@test03 ~]$ sudo systemctl start mogha

节点1（原主库以异步备启动）
[omm@test01 mogha]$ gs_ctl start -D /gauss/gaussdb/data/dn/ -M standby

[omm@test01 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Normal
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A175920
sender_write_location : 0/A175920
sender_flush_location : 0/A175920
sender_replay_location : 0/A175920
receiver_received_location: 0/A175920
receiver_write_location : 0/A175920
receiver_flush_location : 0/A175920
receiver_replay_location : 0/A175920
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
static_connections : 4
HA_state : Normal
instance_role : Primary

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A175920
sender_write_location : 0/A175920
sender_flush_location : 0/A175920
sender_replay_location : 0/A175920
receiver_received_location: 0/A175920
receiver_write_location : 0/A175920
receiver_flush_location : 0/A175920
receiver_replay_location : 0/A175920
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A175920
sender_write_location : 0/A175920
sender_flush_location : 0/A175920
sender_replay_location : 0/A175920
receiver_received_location: 0/A175920
receiver_write_location : 0/A175920
receiver_flush_location : 0/A175920
receiver_replay_location : 0/A175920
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A175920
sender_write_location : 0/A175920
sender_flush_location : 0/A175920
sender_replay_location : 0/A175920
receiver_received_location: 0/A175920
receiver_write_location : 0/A175920
receiver_flush_location : 0/A175920
receiver_replay_location : 0/A175920
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

切换主库，由当前主节点（原同中心同步备）切换至当前同中心同步备节点（原同中心异步备）
节点2（停止mogha及gaussdb服务并卸载vip）
[omm@test02 mogha]$ sudo systemctl stop mogha
[omm@test01 mogha]$ sudo ifconfig ens33 del 192.168.1.66
[omm@test02 mogha]$gs_ctl stop -D /gauss/gaussdb/data/dn/

[omm@test03 mogha]$ sudo systemctl stop mogha
[omm@test03 mogha]$ gs_ctl failover -D /gauss/gaussdb/data/dn/
[omm@test03 mogha]$ gs_om -t refreshconf
[omm@test03 ~]$ sudo systemctl start mogha

[omm@test03 ~]$ gs_guc reload -N test03 -D /gauss/gaussdb/data/dn -c "synchronous_standby_names='2(dn_6001,dn_6004)'"
[omm@test03]$ gs_om -t status --all

节点1
[omm@test01 ~]$ sudo systemctl start mogha

节点2（以异步备启动）
[omm@test02 mogha]$ gs_ctl start -D /gauss/gaussdb/data/dn/ -M standby

[omm@test02 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Normal
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A447408
sender_write_location : 0/A447408
sender_flush_location : 0/A447408
sender_replay_location : 0/A447408
receiver_received_location: 0/A447408
receiver_write_location : 0/A447408
receiver_flush_location : 0/A447408
receiver_replay_location : 0/A447408
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A447408
sender_write_location : 0/A447408
sender_flush_location : 0/A447408
sender_replay_location : 0/A447408
receiver_received_location: 0/A447408
receiver_write_location : 0/A447408
receiver_flush_location : 0/A447408
receiver_replay_location : 0/A447408
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
static_connections : 4
HA_state : Normal
instance_role : Primary

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A447408
sender_write_location : 0/A447408
sender_flush_location : 0/A447408
sender_replay_location : 0/A447408
receiver_received_location: 0/A447408
receiver_write_location : 0/A447408
receiver_flush_location : 0/A447408
receiver_replay_location : 0/A447408
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A447408
sender_write_location : 0/A447408
sender_flush_location : 0/A447408
sender_replay_location : 0/A447408
receiver_received_location: 0/A447408
receiver_write_location : 0/A447408
receiver_flush_location : 0/A447408
receiver_replay_location : 0/A447408
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

再次切换主库，由当前主节点（原同中心异步备）切换至当前同中心同步备节点（原同中心主节点，即停机维护的节点）
节点3（停止mogha及gaussdb服务并卸载vip）
[omm@test03 mogha]$ sudo systemctl stop mogha
[omm@test01 mogha]$ sudo ifconfig ens33 del 192.168.1.66
[omm@test03 mogha]$ gs_ctl stop -D /gauss/gaussdb/data/dn/


节点1（切换为主库）
[omm@test01 ~]$ sudo systemctl stop mogha
[omm@test01 ~]$ gs_ctl failover -D /gauss/gaussdb/data/dn/
[omm@test01 mogha]$ gs_om -t refreshconf
[omm@test01 ~]$ sudo systemctl start mogha

[omm@test01 ~]$ gs_guc reload -N test01 -D /gauss/gaussdb/data/dn -c "synchronous_standby_names='2(dn_6002,dn_6004)'"
[omm@test01 mogha]$ gs_om -t status --all

节点2
[omm@test02 ~]$ sudo systemctl start mogha

节点3（异步备启动）
[omm@test03 mogha]$ gs_ctl start -D /gauss/gaussdb/data/dn/ -M standby

[omm@test03 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Normal
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
static_connections : 4
HA_state : Normal
instance_role : Primary

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A715650
sender_write_location : 0/A715650
sender_flush_location : 0/A715650
sender_replay_location : 0/A715650
receiver_received_location: 0/A715650
receiver_write_location : 0/A715650
receiver_flush_location : 0/A715650
receiver_replay_location : 0/A715650
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A715650
sender_write_location : 0/A715650
sender_flush_location : 0/A715650
sender_replay_location : 0/A715650
receiver_received_location: 0/A715650
receiver_write_location : 0/A715650
receiver_flush_location : 0/A715650
receiver_replay_location : 0/A715650
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A715650
sender_write_location : 0/A715650
sender_flush_location : 0/A715650
sender_replay_location : 0/A715650
receiver_received_location: 0/A715650
receiver_write_location : 0/A715650
receiver_flush_location : 0/A715650
receiver_replay_location : 0/A715650
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/A715650
sender_write_location : 0/A715650
sender_flush_location : 0/A715650
sender_replay_location : 0/A715650
receiver_received_location: 0/A715650
receiver_write_location : 0/A715650
receiver_flush_location : 0/A715650
receiver_replay_location : 0/A715650
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

MogHA状态查看
[omm@test01 ~]$ gs_ssh -c 'systemctl status mogha | grep running'
Failed to execute command on test04 test03 test05 .
Successfully execute command on test02 test01 .

Output:
[GAUSS-51400] : Failed to execute the command: sh /gauss/gaussdb/tmp/ClusterCall_69377.sh. Error:
[SUCCESS] test01:
Active: active (running) since 六 2023-03-25 23:51:35 CST; 22min ago
[SUCCESS] test02:
Active: active (running) since 六 2023-03-25 23:52:54 CST; 21min ago
[FAILURE] test03:
[FAILURE] test04:
[FAILURE] test05:

• 二、异地灾备切换演练

1、主库三节点中心切换到两节点中心
[omm@test01 mogha]$ gs_om -t status --all

节点1（停止mogha及gaussdb服务并卸载vip）
[omm@test01 mogha]$ sudo systemctl stop mogha
[omm@test01 mogha]$ sudo ifconfig ens33 del 192.168.1.66
[omm@test01 mogha]$ gs_ctl stop -D /gauss/gaussdb/data/dn/

节点2（停止mogha）
[omm@test02 ~]$ sudo systemctl stop mogha

节点4（切换为主库）
[omm@test04 ~]$ gs_ctl failover -D /gauss/gaussdb/data/dn/
[omm@test04 mogha]$ gs_om -t refreshconf
[omm@test04 ~]$ sudo systemctl start mogha

[omm@test04 ~]$ gs_guc reload -N test04 -D /gauss/gaussdb/data/dn -c "synchronous_standby_names='2(dn_6001,dn_6005)'"
[omm@test04 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Degraded
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Manually stopped
az_name : Y
instance_role : Down

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39F8A8
sender_write_location : 0/E39F8A8
sender_flush_location : 0/E39F8A8
sender_replay_location : 0/E39F8A8
receiver_received_location: 0/E39F8A8
receiver_write_location : 0/E39F8A8
receiver_flush_location : 0/E39F8A8
receiver_replay_location : 0/E39F828
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39F8A8
sender_write_location : 0/E39F8A8
sender_flush_location : 0/E39F8A8
sender_replay_location : 0/E39F8A8
receiver_received_location: 0/E39F8A8
receiver_write_location : 0/E39F8A8
receiver_flush_location : 0/E39F8A8
receiver_replay_location : 0/E39F828
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
static_connections : 4
HA_state : Degraded
instance_role : Primary

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39F8A8
sender_write_location : 0/E39F8A8
sender_flush_location : 0/E39F8A8
sender_replay_location : 0/E39F8A8
receiver_received_location: 0/E39F8A8
receiver_write_location : 0/E39F8A8
receiver_flush_location : 0/E39F8A8
receiver_replay_location : 0/E39F828
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

节点5
[omm@test05 ~]$ sudo systemctl start mogha


节点1（原主库以同步备启动）
[omm@test01 mogha]$ gs_ctl start -D /gauss/gaussdb/data/dn/ -M standby

[omm@test01 mogha]$ gs_om -t status --all
[omm@test01 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Normal
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39FEA0
sender_write_location : 0/E39FEA0
sender_flush_location : 0/E39FEA0
sender_replay_location : 0/E39FEA0
receiver_received_location: 0/E39FEA0
receiver_write_location : 0/E39FEA0
receiver_flush_location : 0/E39FEA0
receiver_replay_location : 0/E1861F8
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39FEA0
sender_write_location : 0/E39FEA0
sender_flush_location : 0/E39FEA0
sender_replay_location : 0/E39FEA0
receiver_received_location: 0/E39FEA0
receiver_write_location : 0/E39FEA0
receiver_flush_location : 0/E39FEA0
receiver_replay_location : 0/E39FEA0
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39FEA0
sender_write_location : 0/E39FEA0
sender_flush_location : 0/E39FEA0
sender_replay_location : 0/E39FEA0
receiver_received_location: 0/E39FEA0
receiver_write_location : 0/E39FEA0
receiver_flush_location : 0/E39FEA0
receiver_replay_location : 0/E39FEA0
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
static_connections : 4
HA_state : Normal
instance_role : Primary

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E39FEA0
sender_write_location : 0/E39FEA0
sender_flush_location : 0/E39FEA0
sender_replay_location : 0/E39FEA0
receiver_received_location: 0/E39FEA0
receiver_write_location : 0/E39FEA0
receiver_flush_location : 0/E39FEA0
receiver_replay_location : 0/E39FEA0
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

2、主库两节点中心切换到三节点中心
[omm@test01 mogha]$ gs_om -t status --all

节点4（停止mogha及gaussdb服务并卸载vip）
[omm@test04 mogha]$ sudo systemctl stop mogha
[omm@test04 mogha]$ sudo ifconfig ens33 del 192.168.1.66
[omm@test04 mogha]$ gs_ctl stop -D /gauss/gaussdb/data/dn/

节点5（停止mogha）
[omm@test05 ~]$ sudo systemctl stop mogha

节点1（切换为主库）
[omm@test01 ~]$ gs_ctl failover -D /gauss/gaussdb/data/dn/
[omm@test01 mogha]$ gs_om -t refreshconf
[omm@test01 ~]$ sudo systemctl start mogha

[omm@test01 ~]$ gs_guc reload -N test01 -D /gauss/gaussdb/data/dn -c "synchronous_standby_names='2(dn_6002,dn_6004)'" #第一次切换时已设置好，不用在执行

[omm@test01 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Degraded
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
static_connections : 4
HA_state : Degraded
instance_role : Primary

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E827EC0
sender_write_location : 0/E827EC0
sender_flush_location : 0/E827EC0
sender_replay_location : 0/E827EC0
receiver_received_location: 0/E827EC0
receiver_write_location : 0/E827EC0
receiver_flush_location : 0/E827EC0
receiver_replay_location : 0/E827EC0
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E827EC0
sender_write_location : 0/E827EC0
sender_flush_location : 0/E827EC0
sender_replay_location : 0/E827EC0
receiver_received_location: 0/E827EC0
receiver_write_location : 0/E827EC0
receiver_flush_location : 0/E827EC0
receiver_replay_location : 0/E827EC0
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Manually stopped
az_name : F
instance_role : Down

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E827EC0
sender_write_location : 0/E827EC0
sender_flush_location : 0/E827EC0
sender_replay_location : 0/E827EC0
receiver_received_location: 0/E827EC0
receiver_write_location : 0/E827EC0
receiver_flush_location : 0/E827EC0
receiver_replay_location : 0/E827EC0
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------


节点2
[omm@test02 ~]$ sudo systemctl start mogha


节点1（原主库以同步备启动）
[omm@test04mogha]$ gs_ctl start -D /gauss/gaussdb/data/dn/ -M standby

[omm@test04 mogha]$ gs_om -t status --all
-----------------------------------------------------------------------

cluster_state : Degraded
redistributing : No

-----------------------------------------------------------------------

node : 1
node_name : test01
instance_id : 6001
node_ip : 192.168.1.61
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
static_connections : 4
HA_state : Degraded
instance_role : Primary

-----------------------------------------------------------------------

node : 2
node_name : test02
instance_id : 6002
node_ip : 192.168.1.62
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Catchup
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E828118
sender_write_location : 0/E828118
sender_flush_location : 0/E828118
sender_replay_location : 0/E828118
receiver_received_location: 0/E828118
receiver_write_location : 0/E828118
receiver_flush_location : 0/E828118
receiver_replay_location : 0/E828118
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 3
node_name : test03
instance_id : 6003
node_ip : 192.168.1.63
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : Y
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E828118
sender_write_location : 0/E828118
sender_flush_location : 0/E828118
sender_replay_location : 0/E828118
receiver_received_location: 0/E828118
receiver_write_location : 0/E828118
receiver_flush_location : 0/E828118
receiver_replay_location : 0/E828118
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------

node : 4
node_name : test04
instance_id : 6004
node_ip : 192.168.1.64
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E828118
sender_write_location : 0/E828118
sender_flush_location : 0/E828118
sender_replay_location : 0/E828118
receiver_received_location: 0/E828118
receiver_write_location : 0/E828118
receiver_flush_location : 0/E828118
receiver_replay_location : 0/E828118
sync_percent : 100%
sync_state : Sync

-----------------------------------------------------------------------

node : 5
node_name : test05
instance_id : 6005
node_ip : 192.168.1.65
data_path : /gauss/gaussdb/data/dn
instance_port : 15400
type : Datanode
instance_state : Normal
az_name : F
instance_role : Standby
HA_state : Streaming
sender_sent_location : 0/E828118
sender_write_location : 0/E828118
sender_flush_location : 0/E828118
sender_replay_location : 0/E828118
receiver_received_location: 0/E828118
receiver_write_location : 0/E828118
receiver_flush_location : 0/E828118
receiver_replay_location : 0/E828118
sync_percent : 100%
sync_state : Async

-----------------------------------------------------------------------