Kaynağa Gözat

perf(raw): 4 张 MB 级 ful_d 关 splitPk,单 task 落单文件

每分区 33 文件里 65~81% 是 49 字节空 ORC(task 数 = channel 6 x splitFactor 5);
对齐 raw_trd_card_group_order_info_inc_d 已在用的空 splitPk 写法。

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
tianyu.chu 1 ay önce
ebeveyn
işleme
d8ab117649

+ 2 - 1
jobs/raw/prd/raw_prd_checklist_base_info_ful_d.ini

@@ -16,7 +16,8 @@ column = id,code,year,sport,manufacturer,sets,display_name,type,num,use_num,stat
 columnType =
 where = 1=1
 querySql =
-splitPk = id
+; splitPk 关闭:本表 MB 级,切分只产空 ORC(task 数 = channel x splitFactor),单 task 更快
+splitPk =
 fetchSize = 1000
 
 [writer]

+ 2 - 1
jobs/raw/prd/raw_prd_panini_checklist_base_info_ful_d.ini

@@ -16,7 +16,8 @@ column = id,code,year,sport,manufacturer,sets,sets_version,display_name,type,num
 columnType =
 where = 1=1
 querySql =
-splitPk = id
+; splitPk 关闭:本表 MB 级,切分只产空 ORC(task 数 = channel x splitFactor),单 task 更快
+splitPk =
 fetchSize = 1000
 
 [writer]

+ 2 - 1
jobs/raw/prd/raw_prd_panini_checklist_version_config_ful_d.ini

@@ -16,7 +16,8 @@ column = id,panini_list_id,set_version,carmichael_img_type,import_type,report_fl
 columnType =
 where = 1=1
 querySql =
-splitPk = id
+; splitPk 关闭:本表 MB 级,切分只产空 ORC(task 数 = channel x splitFactor),单 task 更快
+splitPk =
 fetchSize = 1000
 
 [writer]

+ 2 - 1
jobs/raw/shp/raw_shp_tzy_merchant_info_ful_d.ini

@@ -16,7 +16,8 @@ column = id,appid,user_id,username,name,status,remark,create_by,create_time,upda
 columnType =
 where = 1=1
 querySql =
-splitPk = id
+; splitPk 关闭:本表 MB 级,切分只产空 ORC(task 数 = channel x splitFactor),单 task 更快
+splitPk =
 fetchSize = 1000
 
 [writer]