暂无图片
暂无图片
暂无图片
暂无图片
暂无图片

greenplum6.x安装过程手记

原创 杨天成 2020-03-02
4224

操作系统版本:

CentOS Linux release 7.3.1611 (Core)

数据库版本:

目前开源版最新的版本gpdb-6.4.0

postgres=# select gp_opt_version(); gp_opt_version ---------------------------------------------- GPOPT version: 3.88.1, Xerces version: 3.1.2 (1 row) postgres=# select version(); version -------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------- PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39 ), 64-bit compiled on Mar 1 2020 18:16:14 (1 row) postgres=#

操作系统部分:

需要注意的地方:
1.开源版需要安装的包比较多,安装完成后,需要每台主机检查,确保包安装没有问题。用到的python包有:

[root@ecs-mdw gpdb-6.4.0]# more python-dependencies.txt argparse==1.2.1 behave==1.2.4 epydoc==3.0.1 lockfile==0.9.1 logilab-astng==0.20.1 logilab-common==0.50.1 MarkupSafe==1.0 mock==1.0.1 parse==1.8.2 psutil==4.0.0 setuptools==36.6.0 unittest2==0.5.1 [root@ecs-mdw gpdb-6.4.0]# [root@ecs-mdw gpdb-6.4.0]# more python-developer-dependencies.txt enum34==1.1.6 Jinja2==2.10 parse-type==0.4.2 pexpect==4.4.0 PSI==0.3b2 PyYAML==3.12 ptyprocess==0.5.2 six==1.11.0 [root@ecs-mdw gpdb-6.4.0]#

2.参数设置根据每台主机进行合理配置,需要注意/etc/ld.so.conf的设置:

cat >>/etc/ld.so.conf<<EOF /usr/local/lib /usr/local/lib64 /usr/local/gpos_home/lib /usr/local/gp-xerces_home/lib /usr/local/gporca_home/lib /usr/local/greenplum-db/lib EOF

数据库部分

安装过程记录如下:

[gpadmin@ecs-mdw conf]$ gpinitsystem -c /home/gpadmin/conf/gpinitsystem_config -h /home/gpadmin/conf/seg_hosts find: File system loop detected; ‘/usr/local/greenplum-db/./gpdb-6.4.0’ is part of the same file system loop as ‘/usr/local/greenplum-db/.’. 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait... 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Reading Greenplum configuration file /home/gpadmin/conf/gpinitsystem_config 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Locale has not been set in /home/gpadmin/conf/gpinitsystem_config, will set to default value 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Locale set to en_US.utf8 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed 20200301:23:06:57:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait... .. 20200301:23:06:58:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Configuring build for standard array 20200301:23:06:58:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed 20200301:23:06:58:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait... .. 20200301:23:06:58:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Building group mirror array type , please wait... .. 20200301:23:06:59:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checking Master host 20200301:23:06:59:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait... .... 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:--------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master Configuration 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:--------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master instance name = Greenplum Data Platform 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master hostname = ecs-mdw 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master port = 5432 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master instance dir = /home/gpadmin/data/master/gpseg-1 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master Database = 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master connections = 250 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master buffers = 128000kB 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Segment connections = 750 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Segment buffers = 128000kB 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Checkpoint segments = 8 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Encoding = UNICODE 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Postgres param file = Off 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Initdb to be used = /usr/local/greenplum-db/./bin/initdb 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /usr/local/greenplum-db/./lib 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-HEAP_CHECKSUM is = on 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-HBA_HOSTNAMES is = 0 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Ulimit check = Passed 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master IP address [1] = ::1 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master IP address [2] = 192.168.1.128 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Master IP address [3] = fe80::f816:3eff:fefd:6652 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Standby Master = Not Configured 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Number of primary segments = 1 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total Database segments = 2 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Trusted shell = ssh 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Number segment hosts = 2 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Mirror port base = 50000 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Number of mirror segments = 1 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Mirroring config = ON 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Mirroring type = Group 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:---------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:---------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-ecs-sdw1 /home/gpadmin/data/primary/gpseg0 7000 2 0 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-ecs-sdw2 /home/gpadmin/data/primary/gpseg1 7000 3 1 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:--------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Greenplum Mirror Segment Configuration 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:--------------------------------------- 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-ecs-sdw2 /home/gpadmin/data/mirror/gpseg0 50000 4 0 20200301:23:07:02:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-ecs-sdw1 /home/gpadmin/data/mirror/gpseg1 50000 5 1 Continue with Greenplum creation Yy|Nn (default=N): > y 20200301:23:07:12:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Building the Master instance database, please wait... 20200301:23:07:15:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Starting the Master in admin mode 20200301:23:07:16:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances 20200301:23:07:16:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait... .. 20200301:23:07:16:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait... .find: File system loop detected; ‘/usr/local/greenplum-db/./gpdb-6.4.0’ is part of the same file system loop as ‘/usr/local/greenplum-db/.’. find: File system loop detected; ‘/usr/local/greenplum-db/./gpdb-6.4.0’ is part of the same file system loop as ‘/usr/local/greenplum-db/.’. .......... 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Parallel process exit status 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total processes marked as completed = 2 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total processes marked as killed = 0 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total processes marked as failed = 0 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Deleting distributed backout files 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Removing back out file 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-No errors generated from parallel processes 20200301:23:07:27:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -l /home/gpadmin/gpAdminLogs -m -d /home/gpadmin/data/master/gpseg-1 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Gathering information and validating the environment... 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 6.0.0-beta.1 build dev' 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='smart' 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Master segment instance directory=/home/gpadmin/data/master/gpseg-1 20200301:23:07:28:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Stopping master segment and waiting for user connections to finish ... server shutting down 20200301:23:07:29:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process 20200301:23:07:29:007297 gpstop:ecs-mdw:gpadmin-[INFO]:-Terminating processes for segment /home/gpadmin/data/master/gpseg-1 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -l /home/gpadmin/gpAdminLogs -d /home/gpadmin/data/master/gpseg-1 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Gathering information and validating the environment... 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 6.0.0-beta.1 build dev' 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Greenplum Catalog Version: '301908232' 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Starting Master instance in admin mode 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Setting new master era 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Master Started... 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Shutting down master 20200301:23:07:29:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait... 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Process results... 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:- Successful segment starts = 2 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:- Failed segment starts = 0 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Starting Master instance ecs-mdw directory /home/gpadmin/data/master/gpseg-1 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Command pg_ctl reports Master ecs-mdw instance active 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Connecting to dbname='template1' connect_timeout=15 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-No standby master configured. skipping... 20200301:23:07:30:007323 gpstart:ecs-mdw:gpadmin-[INFO]:-Database successfully started 20200301:23:07:30:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode 20200301:23:07:30:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Commencing parallel build of mirror segment instances 20200301:23:07:30:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait... .. 20200301:23:07:30:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait... .find: File system loop detected; ‘/usr/local/greenplum-db/./gpdb-6.4.0’ is part of the same file system loop as ‘/usr/local/greenplum-db/.’. find: File system loop detected; ‘/usr/local/greenplum-db/./gpdb-6.4.0’ is part of the same file system loop as ‘/usr/local/greenplum-db/.’. ...2020-03-01 23:07:34.018907 CST,,,p2917,th-834107264,,,,0,,,seg1,,,,,"LOG","00000","registering background worker ""sweeper process""",,,,,,,,"RegisterBackgroundWorker","bgworker.c",774, 2020-03-01 23:07:34.028848 CST,,,p2917,th-834107264,,,,0,,,seg1,,,,,"FATAL","XX000","could not map anonymous shared memory: Cannot allocate memory (pg_shmem.c:587)",,"This error usually means that PostgreSQL's request for a shared memory segment exceeded available memory, swap space, or huge pages. To reduce the request size (currently 274192412 bytes), reduce PostgreSQL's shared memory usage, perhaps by reducing shared_buffers or max_connections.",,,,,,"CreateAnonymousSegment","pg_shmem.c",587,1 0x9cc68c postgres errstart + 0x1dc 2 0x7e37eb postgres PGSharedMemoryCreate + 0x53b 3 0x845be1 postgres CreateSharedMemoryAndSemaphores + 0x391 4 0x7f8bb6 postgres PostmasterMain + 0xdf6 5 0x4cc8db postgres main + 0x1db 6 0x7f03ca95e505 libc.so.6 __libc_start_main + 0xf5 7 0x4cd0cf postgres <symbol not found> + 0x4cd0cf 2020-03-01 23:07:34.209428 CST,,,p2836,th-553846656,,,,0,,,seg0,,,,,"LOG","00000","registering background worker ""sweeper process""",,,,,,,,"RegisterBackgroundWorker","bgworker.c",774, 2020-03-01 23:07:34.218218 CST,,,p2836,th-553846656,,,,0,,,seg0,,,,,"FATAL","XX000","could not create shared memory segment: Cannot allocate memory (pg_shmem.c:240)","Failed system call was shmget(key=50000001, size=56, 03600).","This error usually means that PostgreSQL's request for a shared memory segment exceeded your kernel's SHMALL parameter. You might need to reconfigure the kernel with larger SHMALL. The PostgreSQL documentation contains more information about shared memory configuration.",,,,,,"InternalIpcMemoryCreate","pg_shmem.c",240,1 0x9cc68c postgres errstart + 0x1dc 2 0x7e3874 postgres PGSharedMemoryCreate + 0x5c4 3 0x845be1 postgres CreateSharedMemoryAndSemaphores + 0x391 4 0x7f8bb6 postgres PostmasterMain + 0xdf6 5 0x4cc8db postgres main + 0x1db 6 0x7f41db4a5505 libc.so.6 __libc_start_main + 0xf5 7 0x4cd0cf postgres <symbol not found> + 0x4cd0cf 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Parallel process exit status 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total processes marked as completed = 0 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:-Total processes marked as killed = 0 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[WARN]:-Total processes marked as failed = 2 <<<<< 20200301:23:07:34:004908 gpinitsystem:ecs-mdw:gpadmin-[INFO]:------------------------------------------------ 20200301:23:07:39:004908 gpinitsystem:ecs-mdw:gpadmin-[WARN]: 20200301:23:07:39:004908 gpinitsystem:ecs-mdw:gpadmin-[WARN]:-Failed to start Greenplum instance; please review gpinitsystem log to determine failure. 20200301:23:07:39:004908 gpinitsystem:ecs-mdw:gpadmin-[FATAL]:-Some primary/mirror segment pairs were found to be not in sync Script Exiting! [gpadmin@ecs-mdw conf]$

mirror有问题:

postgres=# select * from gp_segment_configuration; dbid | content | role | preferred_role | mode | status | port | hostname | address | datadir ------+---------+------+----------------+------+--------+-------+----------+----------+----------------------------------- 1 | -1 | p | p | n | u | 5432 | ecs-mdw | ecs-mdw | /home/gpadmin/data/master/gpseg-1 2 | 0 | p | p | n | u | 7000 | ecs-sdw1 | ecs-sdw1 | /home/gpadmin/data/primary/gpseg0 3 | 1 | p | p | n | u | 7000 | ecs-sdw2 | ecs-sdw2 | /home/gpadmin/data/primary/gpseg1 4 | 0 | m | m | n | d | 50000 | ecs-sdw2 | ecs-sdw2 | /home/gpadmin/data/mirror/gpseg0 5 | 1 | m | m | n | d | 50000 | ecs-sdw1 | ecs-sdw1 | /home/gpadmin/data/mirror/gpseg1 (5 rows)

检查是由于操作系统没有swap导致,操作系统调整好swap,数据库进行恢复:

[gpadmin@ecs-mdw gpAdminLogs]$ gprecoverseg 20200301:23:33:22:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Starting gprecoverseg with args: 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 6.0.0-beta.1 build dev' 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Mar 1 2020 18:16:14' 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Heap checksum setting is consistent between master and the segments that are candidates for recoverseg 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Greenplum instance recovery parameters 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Recovery type = Standard 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Recovery 1 of 2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Synchronization mode = Incremental 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance host = ecs-sdw2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance address = ecs-sdw2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance directory = /home/gpadmin/data/mirror/gpseg0 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance port = 50000 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance host = ecs-sdw1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance address = ecs-sdw1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance directory = /home/gpadmin/data/primary/gpseg0 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance port = 7000 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Target = in-place 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Recovery 2 of 2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Synchronization mode = Incremental 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance host = ecs-sdw1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance address = ecs-sdw1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance directory = /home/gpadmin/data/mirror/gpseg1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Failed instance port = 50000 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance host = ecs-sdw2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance address = ecs-sdw2 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance directory = /home/gpadmin/data/primary/gpseg1 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Source instance port = 7000 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:- Recovery Target = in-place 20200301:23:33:23:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:---------------------------------------------------------- Continue with segment recovery procedure Yy|Nn (default=N): > y 20200301:23:33:29:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-2 segment(s) to recover 20200301:23:33:29:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Ensuring 2 failed segment(s) are stopped 20200301:23:33:30:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Ensuring that shared memory is cleaned up for stopped segments 20200301:23:33:30:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Updating configuration with new mirrors 20200301:23:33:30:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Updating mirrors 20200301:23:33:30:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Running pg_rewind on required mirrors 20200301:23:33:31:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Starting mirrors 20200301:23:33:31:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-era is 0008bdd3c11e6c8c_200301231211 20200301:23:33:31:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait... 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Process results... 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Triggering FTS probe 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-****************************************************************** 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Updating segments for streaming is completed. 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-For segments updated successfully, streaming will continue in the background. 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-Use gpstate -s to check the streaming progress. 20200301:23:33:32:009954 gprecoverseg:ecs-mdw:gpadmin-[INFO]:-****************************************************************** [gpadmin@ecs-mdw gpAdminLogs]$

再次检查:

[gpadmin@ecs-mdw gpAdminLogs]$ gpstate -e 20200301:23:50:08:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-Starting gpstate with args: -e 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 6.0.0-beta.1 build dev' 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Mar 1 2020 18:16:14' 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-Gathering data from segments... 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-Segment Mirroring Status Report 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:09:010818 gpstate:ecs-mdw:gpadmin-[INFO]:-All segments are running normally [gpadmin@ecs-mdw gpAdminLogs]$ [gpadmin@ecs-mdw gpAdminLogs]$ gpstate -s 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-Starting gpstate with args: -s 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 6.0.0-beta.1 build dev' 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Mar 1 2020 18:16:14' 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-Gathering data from segments... 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:--Master Configuration & Status 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master host = ecs-mdw 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master postgres process ID = 8790 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master data directory = /home/gpadmin/data/master/gpseg-1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master port = 5432 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master current role = dispatch 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Greenplum initsystem version = 6.0.0-beta.1 build dev 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Greenplum current version = PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39), 64-bit compiled on Mar 1 2020 18:16:14 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Postgres version = 9.4.24 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Master standby = No master standby configured 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:-Segment Instance Status Report 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Hostname = ecs-sdw1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Address = ecs-sdw1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Datadir = /home/gpadmin/data/primary/gpseg0 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Port = 7000 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirroring Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Current role = Primary 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Preferred role = Primary 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirror status = Synchronized 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Status 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- PID = 3228 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Configuration reports status as = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Database status = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Hostname = ecs-sdw2 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Address = ecs-sdw2 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Datadir = /home/gpadmin/data/mirror/gpseg0 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Port = 50000 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirroring Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Current role = Mirror 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Preferred role = Mirror 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirror status = Streaming 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Replication Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Sent Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Flush Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Replay Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Status 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- PID = 3443 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Configuration reports status as = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment status = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Hostname = ecs-sdw2 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Address = ecs-sdw2 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Datadir = /home/gpadmin/data/primary/gpseg1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Port = 7000 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirroring Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Current role = Primary 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Preferred role = Primary 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirror status = Synchronized 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Status 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- PID = 3144 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Configuration reports status as = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Database status = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:----------------------------------------------------- 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Hostname = ecs-sdw1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Address = ecs-sdw1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Datadir = /home/gpadmin/data/mirror/gpseg1 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Port = 50000 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirroring Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Current role = Mirror 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Preferred role = Mirror 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Mirror status = Streaming 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Replication Info 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Sent Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Flush Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- WAL Replay Location = 0/C003D18 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Status 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- PID = 3531 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Configuration reports status as = Up 20200301:23:50:29:010902 gpstate:ecs-mdw:gpadmin-[INFO]:- Segment status = Up [gpadmin@ecs-mdw gpAdminLogs]$
[gpadmin@ecs-mdw ~]$ psql psql (9.4.24) Type "help" for help. postgres=# select * from gp_segment_configuration where status='d'; dbid | content | role | preferred_role | mode | status | port | hostname | address | datadir ------+---------+------+----------------+------+--------+------+----------+---------+--------- (0 rows) postgres=# select * from gp_segment_configuration; dbid | content | role | preferred_role | mode | status | port | hostname | address | datadir ------+---------+------+----------------+------+--------+-------+----------+----------+----------------------------------- 1 | -1 | p | p | n | u | 5432 | ecs-mdw | ecs-mdw | /home/gpadmin/data/master/gpseg-1 2 | 0 | p | p | s | u | 7000 | ecs-sdw1 | ecs-sdw1 | /home/gpadmin/data/primary/gpseg0 4 | 0 | m | m | s | u | 50000 | ecs-sdw2 | ecs-sdw2 | /home/gpadmin/data/mirror/gpseg0 3 | 1 | p | p | s | u | 7000 | ecs-sdw2 | ecs-sdw2 | /home/gpadmin/data/primary/gpseg1 5 | 1 | m | m | s | u | 50000 | ecs-sdw1 | ecs-sdw1 | /home/gpadmin/data/mirror/gpseg1 (5 rows) postgres=# postgres=# postgres=# select gp_opt_version(); gp_opt_version ---------------------------------------------- GPOPT version: 3.88.1, Xerces version: 3.1.2 (1 row) postgres=# select version(); version -------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------- PostgreSQL 9.4.24 (Greenplum Database 6.0.0-beta.1 build dev) on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39 ), 64-bit compiled on Mar 1 2020 18:16:14 (1 row) postgres=#

数据库恢复正常,安装结束。

最后修改时间:2020-03-02 00:18:24
「喜欢这篇文章,您的关注和赞赏是给作者最好的鼓励」
关注作者
【版权声明】本文为墨天轮用户原创内容,转载时必须标注文章的来源(墨天轮),文章链接,文章作者等基本信息,否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容,欢迎发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。

评论