Просмотр исходного кода

fix(raw/trd): his_merge 动态分区上限调至 2000

his_o 跨 ~1601 个 create 日分区,超 Spark/Hive 默认 1000,SET 提高上限。

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
tianyu.chu 3 недель назад
Родитель
Сommit
1844e6ad99

+ 3 - 0
manual/backfill/20260714_raw_trd_card_group_order_info_inc_d_his_merge.sql

@@ -9,6 +9,9 @@
 
 SET hive.exec.dynamic.partition=true;
 SET hive.exec.dynamic.partition.mode=nonstrict;
+-- his 历史跨 ~1601 个 create 日分区,超默认上限 1000,调高(一次性灌入固有分区数,非异常)
+SET hive.exec.max.dynamic.partitions=2000;
+SET hive.exec.max.dynamic.partitions.pernode=2000;
 
 INSERT OVERWRITE TABLE raw.raw_trd_card_group_order_info_inc_d PARTITION (dt)
 SELECT