点击蓝字 关注我们

SeaTunnel Zeta 在社区的共同努力之下正式发布。继 SeaTunnel 与 DataX、Airbyte 进行性能测试对比之后,我们还将 SeaTunnel 与热门数据同步工具 AWS GLUE 的性能进行比较。
结果显示,SeaTunnel 批量同步 MySQL 数据到 MySQL 比 GLUE 快 420%。

create table test.type_source_table(id int auto_incrementprimary key,f_binary binary(64) null,f_blob blob null,f_long_varbinary mediumblob null,f_longblob longblob null,f_tinyblob tinyblob null,f_varbinary varbinary(100) null,f_smallint smallint null,f_smallint_unsigned smallint unsigned null,f_mediumint mediumint null,f_mediumint_unsigned mediumint unsigned null,f_int int null,f_int_unsigned int unsigned null,f_integer int null,f_integer_unsigned int unsigned null,f_bigint bigint null,f_bigint_unsigned bigint unsigned null,f_numeric decimal null,f_decimal decimal null,f_float float null,f_double double null,f_double_precision double null,f_longtext longtext null,f_mediumtext mediumtext null,f_text text null,f_tinytext tinytext null,f_varchar varchar(100) null,f_date date null,f_datetime datetime null,f_time time null,f_timestamp timestamp null);
SeaTunnel任务配置
env {job.mode = "BATCH"checkpoint.interval = 300000}source {Jdbc {url = "jdbc:mysql://XXX:3306/test"driver = "com.mysql.cj.jdbc.Driver"user = "root"password = "password"connection_check_timeout_sec = 100query = "select id, f_binary, f_blob, f_long_varbinary, f_longblob, f_tinyblob, f_varbinary, f_smallint, f_smallint_unsigned, f_mediumint, f_mediumint_unsigned, f_int, f_int_unsigned, f_integer, f_integer_unsigned, f_bigint, f_bigint_unsigned, f_numeric, f_decimal, f_float, f_double, f_double_precision, f_longtext, f_mediumtext, f_text, f_tinytext, f_varchar, f_date, f_datetime, f_time, f_timestamp from test"partition_column = "id"partition_num = 40parallelism = 2}}sink {Jdbc {url = "jdbc:mysql://XXX:3306/test"driver = "com.mysql.cj.jdbc.Driver"user = "root"password = "password"query = "insert into test_1 values (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)"}}
GLUE任务配置





结论


Apache SeaTunnel

活动推荐
点击图片或阅读原文,了解活动详情。
文章转载自SeaTunnel,如果涉嫌侵权,请发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。





