暂无图片
暂无图片
暂无图片
暂无图片
暂无图片

gbase 8a trace日志结构

ben0124 2024-04-30
173


摘要区:

并非每次查询都会产生摘要trace,每个trc生成1次,当某个session首次写trace文件时会产生摘要区trace

/opt/10.10.11.146/gnode/log/gbase/gbase_root_159_20230727194515.trc   --trace文件路径

Server Version: 9.5.3.29.23fba856           --gbased服务版本号

Version Comment: 23fba856                

Instance Name: gbase                       --实例名称

Session ID: 159                              --连接session id

User: root                                    --连接用户名

Time: 20230727194515                      --时间戳

GBASE_HOME=/opt/10.10.11.146/gnode/server/   --GBASE_HOME环境变量

CPUS: 4                                            --CPU核数

MEM:  7821 MB                                    --系统物理内存大小

Sql语句区:

在gnode都是分片的,一般带_n1等分片号

2023-07-27 19:45:15.178 [M:   9M,   0B,D:   0B] [DC:     0,     0] SQL Statement:

CREATE TABLE `gctmpdb`._tmp_2450197002_203_t15_1_1690421666_s AS SELECT /*10.10.11.146_203_3_2023-07-27_19:45:15*/ /*+ TID('196674') */ SUM((`vcname000001.test.lineitem`.`l_extendedprice` * `vcname000001.test.lineitem`.`l_discount`)) AS `c1` FROM `test`.`lineitem_n1` `vcname000001.test.lineitem` WHERE (`vcname000001.test.lineitem`.`l_shipdate` >= cast('1994-01-01' as date)) AND (`vcname000001.test.lineitem`.`l_shipdate` < date_add(cast('1994-01-01' as date), INTERVAL '1' YEAR)) AND (`vcname000001.test.lineitem`.`l_discount` BETWEEN (0.06  -  0.01) AND (0.06 + 0.01)) AND (`vcname000001.test.lineitem`.`l_quantity` < 24) LIMIT 0

 

资源监控区:

数据结构如下:

[内存:数据堆,large堆,磁盘:临时表空间] [访问DC数:内存命中,磁盘访问]

[M:   9M,   0B,D:   0B] [DC:     0,     0]

[M:   9M,   0B,D:   0B] [DC:     0,     0]

[M:   9M,   0B,D:   0B] [DC:     0,     0]

数据堆:data heap的使用情况,全局状态

Large堆:算子buffer的使用情况,全局状态

临时表空间:语句执行过程占用的临时磁盘空间,session级

内存中访问DC总数:从内存缓冲中访问的DC总数,session级

磁盘中访问DC总数:从磁盘中访问的DC总数,session级

执行计划汇总:

2023-07-27 19:45:15.185 [M:   9M,   0B,D:   0B] [DC:     0,     0] SUMMARY

2023-07-27 19:45:15.185 [M:   9M,   0B,D:   0B] [DC:     0,     0] elapsed time:                00:00:00.007   --sql执行时间

2023-07-27 19:45:15.185 [M:   9M,   0B,D:   0B] [DC:     0,     0] data loaded from storage:       0B,  0s,     0 DC.   --总共从磁盘读了0B(共0DC)的 数据,用时0s

2023-07-27 19:45:15.185 [M:   9M,   0B,D:   0B] [DC:     0,     0] data decompressed:              0B,  0s.          --总共解压了0B的数据,用时0s

2023-07-27 19:45:15.185 [M:   9M,   0B,D:   0B] [DC:     0,     0] temp space IO stats: --查询过程中临时表空间使用情况

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] CB   write(   0B, 0time, 0sec),       read(   0B, 0time, 0sec)  --物化中间结果(读/写大小、请求次数、花费时间)

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] SRT  write(   0B, 0time, 0sec),       read(   0B, 0time, 0sec)  --排序中间结果

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] GDC  write(   0B, 0time, 0sec),       read(   0B, 0time, 0sec)  --group by distinct中间结果

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] MAT  write(   0B, 0time, 0sec),       read(   0B, 0time, 0sec)  --join中间结果

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] HSJ  write(   0B, 0time, 0sec),       read(   0B, 0time, 0sec)  --One-pass Hash Join中间结果

2023-07-27 19:45:15.186 [M:   9M,   0B,D:   0B] [DC:     0,     0] ======================================================

 

执行详细部分:

查询主要算子:扫描(scan),连接(join),分组聚集(group),排序(order),物化(materialize)

 

#开始执行

2023-07-28 02:24:17.406 [M: 116M,   0B,D:   0B] [DC:     0,     0] Start Query Execution

2023-07-28 02:24:17.406 [M: 116M,   0B,D:   0B] [DC:     0,     0] Tables:  --显示涉及到的表并为表起别名T0、T1、T2......

2023-07-28 02:24:17.406 [M: 116M,   0B,D:   0B] [DC:     0,     0] T0:          vcname000001.test.supplier(test.supplier_n1),   10000 rows,     1 DC

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] T1:          vcname000001.test.partsupp(test.partsupp),      800000 rows,    13 DC

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] T2:          vcname000001.test.part(test.part),      200000 rows,    4 DC

 

#智能扫描

涉及多个表、多个字段时会分别扫描。只用到智能索引部分,所以一般耗时很少

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] Condition Weight (non-join):

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] cnd(0):       FALSE  (0)

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] BEGIN Smart Scan

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] T0:          total 1 DC,     found 1 DC to scan(with 0 FULL DC).

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] T1:          total 13 DC,    found 13 DC to scan(with 0 FULL DC).

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] T2:          total 4 DC,     found 4 DC to scan(with 0 FULL DC).

2023-07-28 02:24:17.407 [M: 116M,   0B,D:   0B] [DC:     0,     0] END Smart Scan. (time used: 0.000s)

 

#逐行过滤

需要读取DC数据,解压后按照列条件进行逐行扫描,耗时较长

2023-07-28 02:24:17.423 [M: 116M,   0B,D:   0B] [DC:     0,     0] BEGIN Scan

2023-07-28 02:24:17.423 [M: 116M,   0B,D:   0B] [DC:     0,     0] cnd(2) vcname000001.test.part.p_size BET. NONE AND 25

2023-07-28 02:24:17.424 [M: 116M,   0B,D:   0B] [DC:     0,     0] ( 0)ApplyQueryDesc cur(dc*65536):0 end: 65536

2023-07-28 02:24:17.425 [M: 116M,   0B,D:   0B] [DC:     1,     0] ( 0)cnd(2)   scanned 65536 rows,     found 32812 rows (time used: 0.001s)

2023-07-28 02:24:17.426 [M: 116M,   0B,D:   0B] [DC:     4,     0] ( 1)cnd(2)   scanned 65536 rows,     found 32872 rows (time used: 0.001s)

2023-07-28 02:24:17.428 [M: 116M,   0B,D:   0B] [DC:     4,     0] ( 2)cnd(2)   scanned 65536 rows,     found 32907 rows (time used: 0.002s)

2023-07-28 02:24:17.428 [M: 116M,   0B,D:   0B] [DC:     4,     0] ( 3)cnd(2)   scanned 3392 rows,      found 1717 rows (time used: 0.003s)

2023-07-28 02:24:17.435 [M: 116M,   0B,D:   0B] [DC:     4,     0] cnd(2) Done. scanned 200000 rows,    found 100308 rows (time used: 0.012s)

2023-07-28 02:24:17.435 [M: 116M,   0B,D:   0B] [DC:     4,     0] cnd(1) vcname000001.test.part.p_mfgr BET. 'Manufacturer#4' AND 'Manufacturer#4'

2023-07-28 02:24:17.440 [M: 116M,   0B,D:   0B] [DC:     8,     0] ( 0)cnd(1)   scanned 32812 rows,     found 6463 rows (time used: 0.003s)

2023-07-28 02:24:17.440 [M: 116M,   0B,D:   0B] [DC:     8,     0] ( 3)cnd(1)   scanned 1717 rows,      found 350 rows (time used: 0.002s)

2023-07-28 02:24:17.440 [M: 116M,   0B,D:   0B] [DC:     8,     0] ( 2)cnd(1)   scanned 32907 rows,     found 6444 rows (time used: 0.003s)

2023-07-28 02:24:17.440 [M: 116M,   0B,D:   0B] [DC:     8,     0] ( 1)cnd(1)   scanned 32872 rows,     found 6550 rows (time used: 0.003s)

2023-07-28 02:24:17.448 [M: 116M,   0B,D:   0B] [DC:     8,     0] cnd(1) Done. scanned 100308 rows,    found 19807 rows (time used: 0.013s)

2023-07-28 02:24:17.465 [M: 116M,   0B,D:   0B] [DC:    16,     0] cnd(0) vcname000001.test.partsupp.ps_supplycost BET. 500.01 AND NONE

2023-07-28 02:24:17.471 [M: 116M,   0B,D:   0B] [DC:    26,     0] ( 0)cnd(0)   scanned 262144 rows,    found 130905 rows (time used: 0.005s)

2023-07-28 02:24:17.471 [M: 116M,   0B,D:   0B] [DC:    27,     0] ( 2)cnd(0)   scanned 196608 rows,    found 98683 rows (time used: 0.004s)

2023-07-28 02:24:17.473 [M: 116M,   0B,D:   0B] [DC:    29,     0] ( 3)cnd(0)   scanned 144640 rows,    found 72499 rows (time used: 0.006s)

2023-07-28 02:24:17.473 [M: 116M,   0B,D:   0B] [DC:    29,     0] ( 1)cnd(0)   scanned 196608 rows,    found 98223 rows (time used: 0.003s)

2023-07-28 02:24:17.476 [M: 116M,   0B,D:   0B] [DC:    29,     0] cnd(0) Done. scanned 800000 rows,    found 400310 rows (time used: 0.011s)

2023-07-28 02:24:17.491 [M: 116M,   0B,D:   0B] [DC:    37,     0] T0:          total 1 DC,     found 1 DC after scan(with 1 FULL DC).

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] T1:          total 13 DC,    found 13 DC after scan(with 0 FULL DC).

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] T2:          total 4 DC,     found 4 DC after scan(with 0 FULL DC).

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] END Scan. (time used: 0.069s)

 

 

#连接(join)

Join算法有三种:hash join,sort-merge join,nested-loop join,其中hash join是实际应用最多的join方法(有等值条件就会用),sort-merge join适用于>,>=,<,<=等非等值连接,以上join算法都不适用才会使用nested-loop join算法,如!=

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] Condition Weight (join):

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] cnd(3):      vcname000001.test.part.p_partkey = vcname000001.test.partsupp.ps_partkey        (23.01)

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] cnd(4):      vcname000001.test.supplier.s_suppkey = vcname000001.test.partsupp.ps_suppkey    (29.03)

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] BEGIN Join

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] cnd(3):

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] cnd(3):      vcname000001.test.part.p_partkey = vcname000001.test.partsupp.ps_partkey

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] prepare to use hash join

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] prepare to use hash join

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] traverse dim: 19807 tuples, match dim: 400310 tuples  --traverse(小表)条数,match(大表)条数

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] traverse tuple: total_size = 7, key_size = 3, tuple_size = 4, other_size = 0, pseudo_size = 0

--total_size:总和,key_size:计算哈希值的大小,tuple_size:存储行号的大小,other_size:不等值条件的大小

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] match tuple: total_size = 7, key_size = 3, tuple_size = 4, other_size = 0, pseudo_size = 0

2023-07-28 02:24:17.492 [M: 116M,   0B,D:   0B] [DC:    37,     0] divide to 4 blocks(using round-robin): 130905, 98223, 98683, 72499.

2023-07-28 02:24:17.493 [M: 116M, 288K,D:   0B] [DC:    37,     0] Hybrid hash join: data will be split into 1(分片数) partitions 

2023-07-28 02:24:17.493 [M: 116M, 288K,D:   0B] [DC:    37,     0] bloom filter (0 close 1 open): 0

2023-07-28 02:24:17.493 [M: 116M, 288K,D:   0B] [DC:    37,     0] traverse dim: 19807 tuples, match dim: 130905 tuples

2023-07-28 02:24:17.493 [M: 116M,   2M,D:   0B] [DC:    37,     0] traverse dim: 19807 tuples, match dim: 98223 tuples

2023-07-28 02:24:17.493 [M: 116M,   5M,D:   0B] [DC:    37,     0] traverse dim: 19807 tuples, match dim: 98683 tuples

2023-07-28 02:24:17.493 [M: 116M,   8M,D:   0B] [DC:    37,     0] traverse dim: 19807 tuples, match dim: 72499 tuples

2023-07-28 02:24:17.493 [M: 116M,  10M,D:   0B] [DC:    37,     0] BEGIN hybrid hash join: partition(-1/1): traverse dim: 19807 tuples, match dim: 400310 tuples

2023-07-28 02:24:17.493 [M: 116M,  10M,D:   0B] [DC:    37,     0] Begin join: partition(-1/1), pass(0)

2023-07-28 02:24:17.494 [M: 116M,  10M,D:   0B] [DC:    37,     0] ( 0)Traverse: begin scanning from 0 to 4951

2023-07-28 02:24:17.495 [M: 116M,  11M,D:   0B] [DC:    38,     0] ( 3)Traverse: begin scanning from 14853 to 19807

2023-07-28 02:24:17.496 [M: 116M,  11M,D:   0B] [DC:    39,     0] ( 1)Traverse: begin scanning from 4951 to 9902

2023-07-28 02:24:17.496 [M: 116M,  11M,D:   0B] [DC:    40,     0] ( 0)Traverse: scanned to rowid 4951.  

2023-07-28 02:24:17.496 [M: 116M,  11M,D:   0B] [DC:    40,     0] ( 0)Joiner(0) finish traverse task

2023-07-28 02:24:17.497 [M: 116M,  11M,D:   0B] [DC:    41,     0] ( 1)Traverse: scanned to rowid 9902.  

2023-07-28 02:24:17.497 [M: 116M,  11M,D:   0B] [DC:    41,     0] ( 1)Joiner(1) finish traverse task

2023-07-28 02:24:17.497 [M: 116M,  11M,D:   0B] [DC:    41,     0] ( 2)Traverse: begin scanning from 9902 to 14853

2023-07-28 02:24:17.498 [M: 116M,  11M,D:   0B] [DC:    43,     0] ( 2)Traverse: scanned to rowid 14853.  

2023-07-28 02:24:17.499 [M: 116M,  11M,D:   0B] [DC:    43,     0] ( 2)Joiner(2) finish traverse task

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Traverse: scanned to rowid 19807.  

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Joiner(3) finish traverse task

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)HashTable: mem: total 16544782, desired 89131, block_size 98304

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Sub 0: use 32768+58836; buckets: total 8192, use 3466, avg 1.41, longest 6; rows: add 4903

--sub0:total哈希桶数,use用了多少桶,avg桶内数据的平均比,1是最优的数据分布证明一个桶里1条数据

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Sub 1: use 32768+60348; buckets: total 8192, use 3550, avg 1.42, longest 5; rows: add 5029

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Sub 2: use 32768+59748; buckets: total 8192, use 3525, avg 1.41, longest 6; rows: add 4979

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Sub 3: use 32768+58752; buckets: total 8192, use 3466, avg 1.41, longest 5; rows: add 4896

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)JoinTables: mem: exp. 67108864; rows: exp. 19807, cap. 22020096, add 19807

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Traverse finished. (time used: 0.008s)

2023-07-28 02:24:17.501 [M: 116M,  11M,D:   0B] [DC:    44,     0] ( 3)Match: begin scanning...

2023-07-28 02:24:17.517 [M: 116M,  14M,D:   0B] [DC:    54,     0] ( 3)Match: scanned 72499 rows,       and produced 7206 rows already.

2023-07-28 02:24:17.517 [M: 116M,  14M,D:   0B] [DC:    54,     0] ( 3)bloomfilter skipped 0 rows

2023-07-28 02:24:17.517 [M: 116M,  14M,D:   0B] [DC:    54,     0] ( 3)Joiner(3) finish match task

2023-07-28 02:24:17.522 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 2)Match: scanned 98683 rows,       and produced 9595 rows already.

2023-07-28 02:24:17.522 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 2)bloomfilter skipped 0 rows

2023-07-28 02:24:17.522 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 2)Joiner(2) finish match task

2023-07-28 02:24:17.525 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 1)Match: scanned 98223 rows,       and produced 9604 rows already.

2023-07-28 02:24:17.525 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 1)bloomfilter skipped 0 rows

2023-07-28 02:24:17.525 [M: 116M,  14M,D:   0B] [DC:    55,     0] ( 1)Joiner(1) finish match task

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)Match: scanned 130905 rows,      and produced 13086 rows already.

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)bloomfilter skipped 0 rows

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)Joiner(0) finish match task

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)Match finished. (time used: 0.046s)

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)Commit: begin ...

2023-07-28 02:24:17.547 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)join: found 13086 rows. (inner: 13086, traverse outer: 0, match outer: 0)

2023-07-28 02:24:17.548 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)join: found 9595 rows. (inner: 9595, traverse outer: 0, match outer: 0)

2023-07-28 02:24:17.548 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)join: found 9604 rows. (inner: 9604, traverse outer: 0, match outer: 0)

2023-07-28 02:24:17.549 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)begin scanning dc segment info. 9595 tuples, begin = 0, end = 9594, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)

7       dc_segment:     begin 0,        end 3243,       tuple_no 3244

8       dc_segment:     begin 3244,     end 6445,       tuple_no 3202

9       dc_segment:     begin 6446,     end 9594,       tuple_no 3149

finish scanning dc segment info.

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)pass info: 9595

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)Joiner(2) finish commit task

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)join: found 7206 rows. (inner: 7206, traverse outer: 0, match outer: 0)

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 2)TqJob finish <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)begin scanning dc segment info. 9604 tuples, begin = 0, end = 9603, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)

4       dc_segment:     begin 0,        end 3214,       tuple_no 3215

5       dc_segment:     begin 3215,     end 6417,       tuple_no 3203

6       dc_segment:     begin 6418,     end 9603,       tuple_no 3186

finish scanning dc segment info.

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)pass info: 9604

2023-07-28 02:24:17.550 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)Joiner(1) finish commit task

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 1)TqJob finish <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)begin scanning dc segment info. 7206 tuples, begin = 0, end = 7205, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)

10      dc_segment:     begin 0,        end 3333,       tuple_no 3334

11      dc_segment:     begin 3334,     end 6526,       tuple_no 3193

12      dc_segment:     begin 6527,     end 7205,       tuple_no 679

finish scanning dc segment info.

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)pass info: 7206

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)Joiner(3) finish commit task

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 3)TqJob finish <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.551 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)begin scanning dc segment info. 13086 tuples, begin = 0, end = 13085, max_tuple_dim = 1, max_tuple_no = 800000, dc_segment_size = 1

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)

0       dc_segment:     begin 0,        end 3289,       tuple_no 3290

1       dc_segment:     begin 3290,     end 6627,       tuple_no 3338

2       dc_segment:     begin 6628,     end 9890,       tuple_no 3263

3       dc_segment:     begin 9891,     end 13085,      tuple_no 3195

finish scanning dc segment info.

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)pass info: 13086

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)Joiner(0) finish commit task

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] ( 0)TqJob finish <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] End join: partition(-1/1), pass(0)

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] END hybrid hash join: partition(-1/1): (time used: 0.059s)

2023-07-28 02:24:17.552 [M: 116M,  14M,D:   0B] [DC:    57,     0] join: found 39491 rows. (inner: 39491, traverse outer: 0, match outer: 0)

2023-07-28 02:24:17.556 [M: 116M,  11M,D: 717K] [DC:    57,     0] Begin rowid merge-sorting: 4 inputs, 39491 rows

2023-07-28 02:24:17.556 [M: 116M,  11M,D: 717K] [DC:    57,     0] sort rowid: max_dc_segment_no = 1025, total_tuple_no = 39491, dop = 4, average_thread_tuple_no = 9873

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[0]: 3290 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[1]: 3338 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[2]: 3263 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[3]: 3195 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[4]: 3215 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[5]: 3203 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[6]: 3186 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[7]: 3244 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[8]: 3202 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[9]: 3149 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[10]: 3334 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[11]: 3193 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[12]: 679 tuples

2023-07-28 02:24:17.557 [M: 116M,  11M,D: 717K] [DC:    57,     0] dc_segment[13]: 0 tuples

..................................

2023-07-28 02:24:17.600 [M: 116M,  11M,D: 717K] [DC:    57,     0] sort rowid: thread[0] processes 3 dc_segment(9891 tuples) from dc_segment[0]

2023-07-28 02:24:17.601 [M: 116M,  11M,D: 717K] [DC:    57,     0] sort rowid: thread[1] processes 3 dc_segment(9613 tuples) from dc_segment[3]

2023-07-28 02:24:17.601 [M: 116M,  11M,D: 717K] [DC:    57,     0] sort rowid: thread[2] processes 3 dc_segment(9632 tuples) from dc_segment[6]

2023-07-28 02:24:17.601 [M: 116M,  11M,D: 717K] [DC:    57,     0] sort rowid: thread[3] processes 1016 dc_segment(10355 tuples) from dc_segment[9]

2023-07-28 02:24:17.601 [M: 116M,  11M,D: 717K] [DC:    57,     0] ( 0)begin sorting 9891 tuples

2023-07-28 02:24:17.602 [M: 116M,  11M,D: 615K] [DC:    57,     0] ( 0)finish sorting 9891 tuples

2023-07-28 02:24:17.602 [M: 116M,  11M,D: 615K] [DC:    57,     0] ( 1)begin sorting 9613 tuples

2023-07-28 02:24:17.603 [M: 116M,  11M,D: 512K] [DC:    57,     0] ( 1)finish sorting 9613 tuples

2023-07-28 02:24:17.603 [M: 116M,  11M,D: 512K] [DC:    57,     0] ( 2)begin sorting 9632 tuples

2023-07-28 02:24:17.605 [M: 116M,  11M,D: 410K] [DC:    57,     0] ( 2)finish sorting 9632 tuples

2023-07-28 02:24:17.605 [M: 116M,  11M,D: 410K] [DC:    57,     0] ( 3)begin sorting 10355 tuples

2023-07-28 02:24:17.606 [M: 116M,  11M,D: 308K] [DC:    57,     0] ( 3)finish sorting 10355 tuples

2023-07-28 02:24:17.611 [M: 116M,  11M,D: 308K] [DC:    57,     0] Finish rowid merge-sorting: 4 inputs, 39491 rows(time used: 0.055s)

2023-07-28 02:24:17.613 [M: 116M,  11M,D: 617K] [DC:    57,     0] Parallel join done. Merged tuple: 39491 rows

2023-07-28 02:24:17.614 [M: 116M, 224K,D: 308K] [DC:    57,     0] inner join(T1 - T2),         using hash join,        produced 39491 rows.

2023-07-28 02:24:17.615 [M: 116M, 224K,D: 308K] [DC:    57,     0] cnd(3) Done(time used: 0.122s)

 

#分组聚集(group

聚集算法分两种:hash划分,round-robin划分;hash划分有两种one-path hash/multi-pass hash,数据不重复率小于10%时选择RR划分

2023-07-28 02:24:17.643 [M: 116M, 236K,D:   0B] [DC:    71,     0] BEGIN Parallel Aggregation(39491 rows)

2023-07-28 02:24:17.643 [M: 116M, 236K,D:   0B] [DC:    71,     0] GTBuff: total_size:67108864 has_dist:0 rows_limit:1 width:108

2023-07-28 02:24:17.643 [M: 116M, 236K,D:   0B] [DC:    71,     0] op buffer size: 67108864, tuple width: 48. op buffer can hold 1398101 rows

2023-07-28 02:24:17.643 [M: 116M, 236K,D:   0B] [DC:    71,     0] total tuples(per thread): 9872, tuples in op buffer(per thread): 349525

2023-07-28 02:24:17.644 [M: 116M, 236K,D:   0B] [DC:    71,     0] OP buffer big enough, do not use one-pass algorithm

2023-07-28 02:24:17.644 [M: 116M, 236K,D:   0B] [DC:    71,     0] begin distinct ratio sampling...

--自动评估数据不重复率日志

2023-07-28 02:24:17.769 [M: 116M, 236K,D:   0B] [DC:    80,     0] finish distinct ratio sampling: total 39491 rows; sampled 38987 rows, 4 DCs. NDV: 37789, 96%. (time used: 0.125s)

2023-07-28 02:24:17.776 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.776 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.776 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.776 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 39491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.777 [M: 116M, 236K,D:   0B] [DC:    80,     0] Begin parallel splitting for aggregation (split_type = 1)

--split_type=1:Multi-Pass hash;  split_type=2:round-robin;  split_type=3:One-Pass Hash

2023-07-28 02:24:17.778 [M: 116M, 236K,D: 231K] [DC:    80,     0] ( 0)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108

2023-07-28 02:24:17.779 [M: 116M, 373K,D: 231K] [DC:    82,     0] ( 3)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108

2023-07-28 02:24:17.780 [M: 116M, 510K,D: 231K] [DC:    82,     0] ( 2)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108

2023-07-28 02:24:17.781 [M: 116M, 645K,D: 231K] [DC:    83,     0] ( 1)GTBuff: total_size:16777216 has_dist:0 rows_limit:1 width:108

2023-07-28 02:24:17.802 [M: 116M, 780K,D: 231K] [DC:    89,     0] ( 0)split by hash already(39491 rows).

2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC:    89,     0] divide to 4 blocks(using hash[parallel]): 9974, 9789, 9921, 9807.

2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC:    89,     0] End parallel splitting for aggregation (split_type = 1)(time used: 0.027s)

2023-07-28 02:24:17.804 [M: 116M, 780K,D: 231K] [DC:    89,     0] ( 0)BEGIN Aggregation(9974 rows)

2023-07-28 02:24:17.805 [M: 116M,   1M,D: 231K] [DC:    89,     0] ( 0)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108

2023-07-28 02:24:17.805 [M: 116M,   1M,D: 231K] [DC:    91,     0] ( 2)BEGIN Aggregation(9921 rows)

2023-07-28 02:24:17.805 [M: 116M,   1M,D: 231K] [DC:    91,     0] ( 3)BEGIN Aggregation(9807 rows)

2023-07-28 02:24:17.806 [M: 116M,   1M,D: 231K] [DC:    91,     0] ( 2)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108

2023-07-28 02:24:17.806 [M: 116M,   2M,D: 231K] [DC:    91,     0] ( 3)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108

2023-07-28 02:24:17.806 [M: 116M,   2M,D: 231K] [DC:    94,     0] ( 1)BEGIN Aggregation(9789 rows)

2023-07-28 02:24:17.807 [M: 116M,   2M,D: 231K] [DC:    96,     0] ( 1)GTBuff: total_size:16777216 has_dist:0 rows_limit:46205 width:108

2023-07-28 02:24:17.829 [M: 116M,   9M,D: 231K] [DC:   121,     0] ( 2)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9619, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.833 [M: 119M,   9M,D: 231K] [DC:   125,     0] ( 0)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9653, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.836 [M: 122M,   9M,D: 231K] [DC:   126,     0] ( 2)Commit 9618 result rows.

2023-07-28 02:24:17.836 [M: 122M,   9M,D: 231K] [DC:   127,     0] ( 2)CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.837 [M: 123M,   9M,D: 231K] [DC:   127,     0] ( 1)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9491, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.840 [M: 124M,   9M,D: 231K] [DC:   128,     0] ( 0)Commit 9652 result rows.

2023-07-28 02:24:17.841 [M: 125M,   9M,D: 231K] [DC:   129,     0] ( 2)produced total 9618 groups.

2023-07-28 02:24:17.841 [M: 125M,   9M,D: 231K] [DC:   129,     0] ( 3)CalculatePageSize: TmpCacheSize = 33554432, no obj = 9520, attr count = 5, record size = 126, page size = 65536

2023-07-28 02:24:17.846 [M: 128M,   7M,D: 231K] [DC:   129,     0] ( 0)produced total 9652 groups.

2023-07-28 02:24:17.849 [M: 131M,   5M,D: 231K] [DC:   129,     0] ( 1)Commit 9490 result rows.

2023-07-28 02:24:17.854 [M: 132M,   5M,D: 231K] [DC:   129,     0] ( 3)Commit 9519 result rows.

2023-07-28 02:24:17.854 [M: 132M,   5M,D: 231K] [DC:   129,     0] ( 1)produced total 9490 groups.

2023-07-28 02:24:17.860 [M: 132M,   3M,D: 231K] [DC:   129,     0] ( 3)produced total 9519 groups.

...........................

2023-07-28 02:24:17.943 [M: 117M, 236K,D: 231K] [DC:   154,     0] produced total 38279 groups.

2023-07-28 02:24:17.943 [M: 117M, 236K,D: 231K] [DC:   154,     0] END Parallel Aggregation. (time used: 0.300s)

 

#排序(order

排序共4种算法:OnePassSorter(quick sort)、MultiPassSorter(多趟算法)、CountingSorter(计数排序)、LimitSorter(堆排序)

2023-07-28 02:24:18.157 [M: 122M,   0B,D:   0B] [DC:    18,     5] BEGIN Sort(38279 rows)

2023-07-28 02:24:18.157 [M: 122M,   1K,D:   0B] [DC:    18,     5] limit sorter initialized, total_bytes: 94, key_bytes: 28.

2023-07-28 02:24:18.207 [M: 122M,   1K,D:   0B] [DC:    31,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 10, attr count = 6, record size = 168, page size = 65536

2023-07-28 02:24:18.219 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 0(LINK_INIT) DataSize: 205

2023-07-28 02:24:18.219 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 1(LINK_INIT_ACK) DataSize: 19

2023-07-28 02:24:18.220 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 2(OPEN_TABLE) DataSize: 13

2023-07-28 02:24:18.221 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 3(OPEN_TABLE_ACK) DataSize: 20

2023-07-28 02:24:18.221 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 4(GET_TABLE_INFO) DataSize: 8

2023-07-28 02:24:18.222 [M: 125M,   1K,D:   0B] [DC:    31,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : <<<< 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 5(BACK_TABLE_INFO) DataSize: 1213

2023-07-28 02:24:18.222 [M: 125M,   1K,D:   0B] [DC:    31,     5] Start send data to remote server.

2023-07-28 02:24:18.222 [M: 125M,   1K,D:   0B] [DC:    31,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536

2023-07-28 02:24:18.222 [M: 125M,   1K,D:   0B] [DC:    31,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536

2023-07-28 02:24:18.223 [M: 125M,   1K,D:   0B] [DC:    31,     5] gbase_hybrid_store: 1. NoTuplesEachDc: 10

2023-07-28 02:24:18.223 [M: 125M,   1K,D:   0B] [DC:    31,     5] Added new task: cur_pos:0 loat_pos:0 size:10 run_no_obj:10 dc:0

2023-07-28 02:24:18.223 [M: 125M,   1K,D:   0B] [DC:    31,     5] sis_task: HASH       (0      -       10)

2023-07-28 02:24:18.223 [M: 125M,   1K,D:   0B] [DC:    35,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 0, attr count = 4, record size = 110, page size = 65536

2023-07-28 02:24:18.225 [M: 132M,   1K,D:   0B] [DC:    35,     5] [Memory Statistics (LOCAL)] PeakSize: 0, allocated: 0, used: 0, free: 0, peak_per_table: 0.

                                                                        Query: SELECT /*10.10.11.146_260_2_2023-07-28_02:24:17*/ /*+ TID('196702') */ `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c1` AS `c6`, `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c2` AS `c7`, `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c3` AS `c8`, cast((SUM_2ND(`_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c4`) / SUM_2ND(`_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c5`)) as decimal(19,6)) AS `c9` FROM `gctmpdb`._tmp_rht_2450197002_260_t17_1_1690421666_s_n1 GROUP BY `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c1`, `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c2`, `_tmp_rht_2450197002_260_t17_1_1690421666_s_n1`.`c3` ORDER BY `c9` DESC, `c6` ASC LIMIT 10 target INTO SERVER (content skipped)...

2023-07-28 02:24:18.225 [M: 132M,   1K,D:   0B] [DC:    35,     5] [DTS Statistics] Avg Batch Rows: 0

2023-07-28 02:24:18.225 [M: 132M,   1K,D:   0B] [DC:    35,     5] TaskQueue: becomes empty <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:18.225 [M: 132M,   1K,D:   0B] [DC:    35,     5] TqJob finish <<<<<<<<<<<<<<<<<<<

2023-07-28 02:24:18.226 [M: 127M,   1K,D:   0B] [DC:    36,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 6(TABLE_DATA) DataSize: 161 AppendId: -1 InfoLength: 0 DataLength: 145

2023-07-28 02:24:18.226 [M: 127M,   1K,D:   0B] [DC:    37,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 6(TABLE_DATA) DataSize: 383 AppendId: -1 InfoLength: 0 DataLength: 367

2023-07-28 02:24:18.227 [M: 127M,   1K,D:   0B] [DC:    38,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 6(TABLE_DATA) DataSize: 131 AppendId: -1 InfoLength: 0 DataLength: 115

2023-07-28 02:24:18.227 [M: 127M,   1K,D:   0B] [DC:    39,     5]  src_rep_id: wf-openssh8-node-0.novalocal_0xbdca300 thd 0xb728000 gbrep : >>>> 10.10.11.146 -- SisHeader: SCN:  0 GroupID:  0 Cmd: 6(TABLE_DATA) DataSize: 295 AppendId: -1 InfoLength: 68 DataLength: 211

2023-07-28 02:24:18.227 [M: 127M,   1K,D:   0B] [DC:    39,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 4, record size = 110,

.............................

 

2023-07-28 02:24:18.227 [M: 122M,   1K,D:   0B] [DC:    39,     5] Complete send data to remote server.

2023-07-28 02:24:18.227 [M: 122M,   1K,D:   0B] [DC:    39,     5] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 6, record size = 168, page size = 65536

2023-07-28 02:24:18.227 [M: 122M,   1K,D:   0B] [DC:    39,     5] END Sort. (time used: 0.070s)

 

#物化(materialize

如果含group或order,在执行完输出的时候已经将结果物化,如果不含group或order,则单独执行物化的逻辑,即通过行号到对应的列中获得数据最后将查询命中的数据物化成一张表输出

2023-07-27 19:09:34.874 [M:   8K,   0B,D:   0B] [DC:     0,     0] BEGIN Materialization(6001215 rows, page size: 65536)

2023-07-27 19:09:34.874 [M:   8K,   0B,D:   0B] [DC:     0,     0] CalculatePageSize: TmpCacheSize = 33554432, no obj = 10, attr count = 16, record size = 348, page size = 65536

2023-07-27 19:09:34.874 [M:   8K,   0B,D:   0B] [DC:     0,     0] need not materialize here, materialize later

2023-07-27 19:09:35.832 [M:   9M,   0B,D:   0B] [DC:     0,    16] Send 10 rows already

2023-07-27 19:09:35.832 [M:   9M,   0B,D:   0B] [DC:     0,    16] CalculatePageSize: TmpCacheSize = 33554432, no obj = 65536, attr count = 16, record size = 348, page size = 65536

 

#发送:将结果发送到目标接受端

2023-07-27 19:09:35.833 [M:   9M,   0B,D:   0B] [DC:     0,    16] ResultSender: send 0 rows.

2023-07-27 19:09:35.833 [M:   9M,   0B,D:   0B] [DC:     0,    16] output result done.

「喜欢这篇文章,您的关注和赞赏是给作者最好的鼓励」
关注作者
【版权声明】本文为墨天轮用户原创内容,转载时必须标注文章的来源(墨天轮),文章链接,文章作者等基本信息,否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容,欢迎发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。

评论