暂无图片
暂无图片
暂无图片
暂无图片
暂无图片

迁移 MySQL 数据到 OceanBase 集群

原创 托马斯回旋 2022-02-08
1682


一、环境

kc1.4xlarge.4 16c 64G 极速型SSD
 
# cat /etc/kylin-release 
Kylin Linux Advanced Server release V10 (Tercel)

二、通过mysqldump卸数

(root@localhost) [(none)]> select version();
+-----------+
| version() |
+-----------+
| 8.0.28    |
+-----------+
1 row in set (0.00 sec)

//导出表结构
[mysql@ecs0002 mysqltmp]$ mysqldump -h127.0.0.1 -uroot -P3306 -proot -d tpch --compact >tpch.sql
[mysql@ecs0002 mysqltmp]$ sed -i '/*\\//d' tpch.sql
//删除注释

//导出数据
[mysql@ecs0002 mysqltmp]$ mysqldump -h127.0.0.1 -uroot -P3306 -proot -t tpch >data.sql           
[mysqldump: [Warning] Using a password on the command line interface can be insecure.
[mysql@ecs0002 mysqltmp]$ sed -i '/*\\//d' tpch.sql
[mysql@ecs0002 mysqltmp]$ ls -l
total 1214852
-rw-r--r-- 1 mysql mysql 1243997204 Feb  8 00:52 data.sql
//数据量大约1G

三、导入oceanbase

[mysql@ecs0002 mysqltmp]$ mysql -h192.168.0.162 -utpch@tpch_tenant -P2881 -ptpch
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \\g.
Your MySQL connection id is 3222012348
Server version: 5.7.25 OceanBase 3.1.1 (r1-4a61aa99e787eaa5eaa6e59ee52768550d0f5fb2) (Built Dec 15 2021 15:28:57)

Copyright (c) 2000, 2022, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\\h' for help. Type '\\c' to clear the current input statement.

(tpch@192.168.0.162) [(none)]> show databases;
+--------------------+
| Database           |
+--------------------+
| oceanbase          |
| information_schema |
| mysql              |
| test               |
| tpch               |
+--------------------+
5 rows in set (0.00 sec)

(tpch@192.168.0.162) [(none)]> create database tpch2;
Query OK, 1 row affected (0.03 sec)

mysql@ecs0002 mysqltmp]$ mysql -h192.168.0.162 -utpch@tpch_tenant -P2881 -ptpch -D tpch2 < tpch.sql 
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1273 (HY000) at line 1: Unknown collation: 'utf8_unicode_ci'
//不支持utf8_unicode_ci?,删了
//再次执行导入

[mysql@ecs0002 mysqltmp]$ mysql -h192.168.0.162 -utpch@tpch_tenant -P2881 -ptpch -D tpch2 < data.sql

[mysql@ecs0002 mysqltmp]$ mysql -h192.168.0.162 -utpch@tpch_tenant -P2881 -ptpch -D tpch2 
mysql: [Warning] Using a password on the command line interface can be insecure.
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Welcome to the MySQL monitor.  Commands end with ; or \\g.
Your MySQL connection id is 3222012355
Server version: 5.7.25 OceanBase 3.1.1 (r1-4a61aa99e787eaa5eaa6e59ee52768550d0f5fb2) (Built Dec 15 2021 15:28:57)

Copyright (c) 2000, 2022, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\\h' for help. Type '\\c' to clear the current input statement.

(tpch@192.168.0.162) [tpch2]> show tables;
+-----------------+
| Tables_in_tpch2 |
+-----------------+
| customer        |
| lineitem        |
| nation          |
| orders          |
| part            |
| partsupp        |
| region          |
| supplier        |
| t1              |
+-----------------+
9 rows in set (0.00 sec)

(tpch@192.168.0.162) [tpch2]> select count(*) from lineitem;
+----------+
| count(*) |
+----------+
|  6001215 |
+----------+
1 row in set (6.99 sec)

(tpch@192.168.0.162) [tpch2]>

四、配置DataX

git clone <https://github.com/alibaba/DataX.git>

vim pom.xml
    # 注释该段代码
    <!--
    <repositories>
        <repository>
            <id>central</id>
            <name>Nexus aliyun</name>
            <url><https://maven.aliyun.com/repository/central></url>
            <releases>
                <enabled>true</enabled>
            </releases>
            <snapshots>
                <enabled>true</enabled>
            </snapshots>
        </repository>
    </repositories>
    -->
    #替换成新的地址
    <repositories>
        <repository>
            <id>maven-ali</id>
            <url><http://maven.aliyun.com/nexus/content/groups/public//></url>
            <releases>
                <enabled>true</enabled>
            </releases>
            <snapshots>
                <enabled>true</enabled>
                <updatePolicy>always</updatePolicy>
                <checksumPolicy>fail</checksumPolicy>
            </snapshots>
        </repository>
    </repositories>

//或者删掉不要的模块

//打包
mvn -U clean package assembly:assembly -Dmaven.test.skip=true

打包完毕后在target目录下
[root@ecs0002 datax]# pwd
/data/datax/DataX/target/datax/datax

//job放在job目录下

五、同步表基量数据

//因为没有使用obproxy,用mysql jdbc同步表
//配置文件内容输出在下面
//同步之前需要先在ob端把表建好

root@ecs0002 datax]# python3 bin/datax.py job/m2m.json 

DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.

2022-02-08 11:05:32.379 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2022-02-08 11:05:32.385 [main] INFO  Engine - the machine info  => 

        osInfo: Huawei Technologies Co., Ltd 1.8 25.242-b08
        jvmInfo:        Linux aarch64 4.19.90-17.5.ky10.aarch64
        cpu num:        16

        totalPhysicalMemory:    -0.00G
        freePhysicalMemory:     -0.00G
        maxFileDescriptorCount: -1
        currentOpenFileDescriptorCount: -1

        GC Names        [PS MarkSweep, PS Scavenge]

        MEMORY_NAME                    | allocation_size                | init_size                      
        PS Eden Space                  | 256.00MB                       | 256.00MB                       
        Code Cache                     | 128.00MB                       | 2.44MB                         
        Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
        PS Survivor Space              | 42.50MB                        | 42.50MB                        
        PS Old Gen                     | 683.00MB                       | 683.00MB                       
        Metaspace                      | -0.00MB                        | 0.00MB                         

2022-02-08 11:05:32.402 [main] INFO  Engine - 
{
        "content":[
                {
                        "reader":{
                                "name":"mysqlreader",
                                "parameter":{
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":[
                                                                "jdbc:mysql://192.168.0.70:3306/tpch?useUnicode=true&characterEncoding=utf8&useSSL=false"
                                                        ],
                                                        "table":[
                                                                "lineitem"
                                                        ]
                                                }
                                        ],
                                        "password":"****",
                                        "username":"tpch"
                                }
                        },
                        "writer":{
                                "name":"mysqlwriter",
                                "parameter":{
                                        "column":[
                                                "*"
                                        ],
                                        "connection":[
                                                {
                                                        "jdbcUrl":"jdbc:mysql://192.168.0.162:2881/tpch2?useUnicode=true&characterEncoding=utf8&useSSL=false",
                                                        "table":[
                                                                "lineitem"
                                                        ]
                                                }
                                        ],
                                        "obWriteMode":"insert",
                                        "password":"****",
                                        "preSql":[
                                                "truncate table lineitem;"
                                        ],
                                        "username":"tpch@tpch_tenant"
                                }
                        }
                }
        ],
        "setting":{
                "speed":{
                        "channel":"1"
                }
        }
}

2022-02-08 11:05:32.418 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
2022-02-08 11:05:32.419 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2022-02-08 11:05:32.420 [main] INFO  JobContainer - DataX jobContainer starts job.
2022-02-08 11:05:32.421 [main] INFO  JobContainer - Set jobId = 0
2022-02-08 11:05:32.743 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.0.70:3306/tpch?useUnicode=true&characterEncoding=utf8&useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2022-02-08 11:05:32.744 [job-0] WARN  OriginalConfPretreatmentUtil - 您的配置文件中的列配置存在一定的风险. 因为您未配置读取数据库表的列,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2022-02-08 11:05:32.988 [job-0] INFO  OriginalConfPretreatmentUtil - table:[lineitem] all columns:[
L_ORDERKEY,L_PARTKEY,L_SUPPKEY,L_LINENUMBER,L_QUANTITY,L_EXTENDEDPRICE,L_DISCOUNT,L_TAX,L_RETURNFLAG,L_LINESTATUS,L_SHIPDATE,L_COMMITDATE,L_RECEIPTDATE,L_SHIPINSTRUCT,L_SHIPMODE,L_COMMENT
].
2022-02-08 11:05:32.989 [job-0] WARN  OriginalConfPretreatmentUtil - 您的配置文件中的列配置信息存在风险. 因为您配置的写入数据库表的列为*,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2022-02-08 11:05:32.990 [job-0] INFO  OriginalConfPretreatmentUtil - Write data [
INSERT INTO %s (L_ORDERKEY,L_PARTKEY,L_SUPPKEY,L_LINENUMBER,L_QUANTITY,L_EXTENDEDPRICE,L_DISCOUNT,L_TAX,L_RETURNFLAG,L_LINESTATUS,L_SHIPDATE,L_COMMITDATE,L_RECEIPTDATE,L_SHIPINSTRUCT,L_SHIPMODE,L_COMMENT) VALUES(?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)
], which jdbcUrl like:[jdbc:mysql://192.168.0.162:2881/tpch2?useUnicode=true&characterEncoding=utf8&useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&rewriteBatchedStatements=true&tinyInt1isBit=false]
2022-02-08 11:05:32.990 [job-0] INFO  JobContainer - jobContainer starts to do prepare ...
2022-02-08 11:05:32.991 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
2022-02-08 11:05:32.991 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do prepare work .
2022-02-08 11:05:32.999 [job-0] INFO  CommonRdbmsWriter$Job - Begin to execute preSqls:[truncate table lineitem;]. context info:jdbc:mysql://192.168.0.162:2881/tpch2?useUnicode=true&characterEncoding=utf8&useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&rewriteBatchedStatements=true&tinyInt1isBit=false.
2022-02-08 11:05:33.104 [job-0] INFO  JobContainer - jobContainer starts to do split ...
2022-02-08 11:05:33.104 [job-0] INFO  JobContainer - Job set Channel-Number to 1 channels.
2022-02-08 11:05:33.108 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] splits to [1] tasks.
2022-02-08 11:05:33.109 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] splits to [1] tasks.
2022-02-08 11:05:33.125 [job-0] INFO  JobContainer - jobContainer starts to do schedule ...
2022-02-08 11:05:33.129 [job-0] INFO  JobContainer - Scheduler starts [1] taskGroups.
2022-02-08 11:05:33.131 [job-0] INFO  JobContainer - Running by standalone Mode.
2022-02-08 11:05:33.140 [taskGroup-0] INFO  TaskGroupContainer - taskGroupId=[0] start [1] channels for [1] tasks.
2022-02-08 11:05:33.143 [taskGroup-0] INFO  Channel - Channel set byte_speed_limit to -1, No bps activated.
2022-02-08 11:05:33.144 [taskGroup-0] INFO  Channel - Channel set record_speed_limit to -1, No tps activated.
2022-02-08 11:05:33.153 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started
2022-02-08 11:05:33.156 [0-0-0-reader] INFO  CommonRdbmsReader$Task - Begin to read record by Sql: [select * from lineitem 
] jdbcUrl:[jdbc:mysql://192.168.0.70:3306/tpch?useUnicode=true&characterEncoding=utf8&useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2022-02-08 11:05:43.151 [job-0] INFO  StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 0.000s |  All Task WaitReaderTime 0.000s | Percentage 0.00%
2022-02-08 11:05:53.152 [job-0] INFO  StandAloneJobContainerCommunicator - Total 184832 records, 19448620 bytes | Speed 1.85MB/s, 18483 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 8.863s |  All Task WaitReaderTime 0.758s | Percentage 0.00%
2022-02-08 11:06:03.153 [job-0] INFO  StandAloneJobContainerCommunicator - Total 385536 records, 40687406 bytes | Speed 2.03MB/s, 20070 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 17.866s |  All Task WaitReaderTime 1.520s | Percentage 0.00%
2022-02-08 11:06:13.154 [job-0] INFO  StandAloneJobContainerCommunicator - Total 588320 records, 62141803 bytes | Speed 2.05MB/s, 20278 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 26.869s |  All Task WaitReaderTime 2.274s | Percentage 0.00%
2022-02-08 11:06:23.155 [job-0] INFO  StandAloneJobContainerCommunicator - Total 788992 records, 83377641 bytes | Speed 2.03MB/s, 20067 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 35.787s |  All Task WaitReaderTime 3.030s | Percentage 0.00%
2022-02-08 11:06:33.156 [job-0] INFO  StandAloneJobContainerCommunicator - Total 995840 records, 105263996 bytes | Speed 2.09MB/s, 20684 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 44.812s |  All Task WaitReaderTime 3.798s | Percentage 0.00%
2022-02-08 11:06:43.157 [job-0] INFO  StandAloneJobContainerCommunicator - Total 1196544 records, 126686255 bytes | Speed 2.04MB/s, 20070 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 53.743s |  All Task WaitReaderTime 4.547s | Percentage 0.00%
2022-02-08 11:06:53.158 [job-0] INFO  StandAloneJobContainerCommunicator - Total 1399296 records, 148343029 bytes | Speed 2.07MB/s, 20275 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 62.787s |  All Task WaitReaderTime 5.303s | Percentage 0.00%
2022-02-08 11:07:03.159 [job-0] INFO  StandAloneJobContainerCommunicator - Total 1604096 records, 170212718 bytes | Speed 2.09MB/s, 20480 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 71.752s |  All Task WaitReaderTime 6.065s | Percentage 0.00%
2022-02-08 11:07:13.160 [job-0] INFO  StandAloneJobContainerCommunicator - Total 1806848 records, 191869065 bytes | Speed 2.07MB/s, 20275 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 80.737s |  All Task WaitReaderTime 6.820s | Percentage 0.00%
2022-02-08 11:07:33.161 [job-0] INFO  StandAloneJobContainerCommunicator - Total 2200064 records, 233863379 bytes | Speed 2.00MB/s, 19660 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 98.786s |  All Task WaitReaderTime 8.287s | Percentage 0.00%
2022-02-08 11:07:43.162 [job-0] INFO  StandAloneJobContainerCommunicator - Total 2404864 records, 255733804 bytes | Speed 2.09MB/s, 20480 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 107.729s |  All Task WaitReaderTime 9.053s | Percentage 0.00%
2022-02-08 11:07:53.163 [job-0] INFO  StandAloneJobContainerCommunicator - Total 2609664 records, 277620908 bytes | Speed 2.09MB/s, 20480 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 116.761s |  All Task WaitReaderTime 9.819s | Percentage 0.00%
2022-02-08 11:08:03.164 [job-0] INFO  StandAloneJobContainerCommunicator - Total 2812416 records, 299283269 bytes | Speed 2.07MB/s, 20275 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 125.722s |  All Task WaitReaderTime 10.575s | Percentage 0.00%
2022-02-08 11:08:13.165 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3013952 records, 320807427 bytes | Speed 2.05MB/s, 20153 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 134.763s |  All Task WaitReaderTime 11.330s | Percentage 0.00%
2022-02-08 11:08:23.166 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3217920 records, 342595367 bytes | Speed 2.08MB/s, 20396 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 143.693s |  All Task WaitReaderTime 12.093s | Percentage 0.00%
2022-02-08 11:08:33.167 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3424768 records, 364685146 bytes | Speed 2.11MB/s, 20684 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 152.703s |  All Task WaitReaderTime 12.866s | Percentage 0.00%
2022-02-08 11:08:43.168 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3625472 records, 386116318 bytes | Speed 2.04MB/s, 20070 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 161.702s |  All Task WaitReaderTime 13.612s | Percentage 0.00%
2022-02-08 11:08:53.169 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3826176 records, 407549173 bytes | Speed 2.04MB/s, 20070 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 170.678s |  All Task WaitReaderTime 14.366s | Percentage 0.00%
2022-02-08 11:09:03.170 [job-0] INFO  StandAloneJobContainerCommunicator - Total 4028928 records, 429206471 bytes | Speed 2.07MB/s, 20275 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 179.633s |  All Task WaitReaderTime 15.122s | Percentage 0.00%
2022-02-08 11:09:23.171 [job-0] INFO  StandAloneJobContainerCommunicator - Total 4426240 records, 471638666 bytes | Speed 2.02MB/s, 19865 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 197.637s |  All Task WaitReaderTime 16.614s | Percentage 0.00%
2022-02-08 11:09:33.172 [job-0] INFO  StandAloneJobContainerCommunicator - Total 4631040 records, 493505350 bytes | Speed 2.09MB/s, 20480 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 206.609s |  All Task WaitReaderTime 17.375s | Percentage 0.00%
2022-02-08 11:09:43.173 [job-0] INFO  StandAloneJobContainerCommunicator - Total 4839936 records, 515808760 bytes | Speed 2.13MB/s, 20889 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 215.636s |  All Task WaitReaderTime 18.152s | Percentage 0.00%
2022-02-08 11:10:03.174 [job-0] INFO  StandAloneJobContainerCommunicator - Total 5245440 records, 559119596 bytes | Speed 2.07MB/s, 20275 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 233.628s |  All Task WaitReaderTime 19.665s | Percentage 0.00%
2022-02-08 11:10:13.175 [job-0] INFO  StandAloneJobContainerCommunicator - Total 5435904 records, 579464893 bytes | Speed 1.94MB/s, 19046 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 242.676s |  All Task WaitReaderTime 20.375s | Percentage 0.00%
2022-02-08 11:10:23.176 [job-0] INFO  StandAloneJobContainerCommunicator - Total 5636608 records, 600900468 bytes | Speed 2.04MB/s, 20070 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 251.670s |  All Task WaitReaderTime 21.131s | Percentage 0.00%
2022-02-08 11:10:31.661 [0-0-0-reader] INFO  CommonRdbmsReader$Task - Finished read record by Sql: [select * from lineitem 
] jdbcUrl:[jdbc:mysql://192.168.0.70:3306/tpch?useUnicode=true&characterEncoding=utf8&useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2022-02-08 11:10:32.044 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] taskId[0] is successed, used[298892]ms
2022-02-08 11:10:32.045 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] completed it's tasks.
2022-02-08 11:10:33.176 [job-0] INFO  AbstractScheduler - Scheduler accomplished all tasks.
2022-02-08 11:10:33.177 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do post work.
2022-02-08 11:10:33.177 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do post work.
2022-02-08 11:10:33.177 [job-0] INFO  JobContainer - DataX jobId [0] completed successfully.
2022-02-08 11:10:33.178 [job-0] INFO  HookInvoker - No hook invoked, because base dir not exists or is a file: /data/datax/DataX/target/datax/datax/hook
2022-02-08 11:10:33.179 [job-0] INFO  JobContainer - 
         [total cpu info] => 
                averageCpu                     | maxDeltaCpu                    | minDeltaCpu                    
                -1.00%                         | -1.00%                         | -1.00%
                        

         [total gc info] => 
                 NAME                 | totalGCCount       | maxDeltaGCCount    | minDeltaGCCount    | totalGCTime        | maxDeltaGCTime     | minDeltaGCTime     
                 PS MarkSweep         | 0                  | 0                  | 0                  | 0.000s             | 0.000s             | 0.000s             
                 PS Scavenge          | 197                | 197                | 197                | 0.589s             | 0.589s             | 0.589s             

2022-02-08 11:10:33.179 [job-0] INFO  JobContainer - PerfTrace not enable!
2022-02-08 11:10:33.180 [job-0] INFO  StandAloneJobContainerCommunicator - Total 6001215 records, 639838987 bytes | Speed 2.03MB/s, 20004 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 268.074s |  All Task WaitReaderTime 22.492s | Percentage 100.00%
2022-02-08 11:10:33.181 [job-0] INFO  VMInfo - 
         [delta cpu info] => 
                curDeltaCpu                    | averageCpu                     | maxDeltaCpu                    | minDeltaCpu                    
                -1.00%                         | -1.00%                         | -1.00%                         | -1.00%
                        

         [delta memory info] => 
                 NAME                           | used_size                      | used_percent                   | max_used_size                  | max_percent                    
                 PS Eden Space                  | 298.73MB                       | 90.80%                         | 298.73MB                       | 90.80%                         
                 Code Cache                     | 10.13MB                        | 92.07%                         | 10.13MB                        | 92.07%                         
                 Compressed Class Space         | 1.86MB                         | 92.82%                         | 1.86MB                         | 92.82%                         
                 PS Survivor Space              | 4.56MB                         | 76.04%                         | 4.56MB                         | 76.04%                         
                 PS Old Gen                     | 6.76MB                         | 0.99%                          | 6.76MB                         | 0.99%                          
                 Metaspace                      | 19.16MB                        | 98.24%                         | 19.16MB                        | 98.24%                         

         [delta gc info] => 
                 NAME                 | curDeltaGCCount    | totalGCCount       | maxDeltaGCCount    | minDeltaGCCount    | curDeltaGCTime     | totalGCTime        | maxDeltaGCTime     | minDeltaGCTime     
                 PS MarkSweep         | 0                  | 0                  | 0                  | 0                  | 0.000s             | 0.000s             | 0.000s             | 0.000s             
                 PS Scavenge          | 0                  | 197                | 197                | 0                  | 0.000s             | 0.589s             | 0.589s             | 0.000s             

2022-02-08 11:10:33.182 [job-0] INFO  JobContainer - 
任务启动时刻                    : 2022-02-08 11:05:32
任务结束时刻                    : 2022-02-08 11:10:33
任务总计耗时                    :                300s
任务平均流量                    :            2.03MB/s
记录写入速度                    :          20004rec/s
读出记录总数                    :             6001215
读写失败总数                    :                   0

(tpch@192.168.0.162) [tpch2]> show tables;
+-----------------+
| Tables_in_tpch2 |
+-----------------+
| lineitem        |
+-----------------+
1 row in set (0.01 sec)

(tpch@192.168.0.162) [tpch2]> select count(*) from lineitem;
+----------+
| count(*) |
+----------+
|  6001215 |
+----------+
1 row in set (6.83 sec)
最后修改时间:2022-02-08 12:06:55
「喜欢这篇文章,您的关注和赞赏是给作者最好的鼓励」
关注作者
【版权声明】本文为墨天轮用户原创内容,转载时必须标注文章的来源(墨天轮),文章链接,文章作者等基本信息,否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容,欢迎发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。

评论