== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767, shardId#22197470]
Arguments: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767, shardId#22197470], [isnotnull(shardId#22197470), (shardId#22197470 = 0_7_10000000553), (size(quantityKpis#22198767, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198140L, originalReplenishmentRunId#22198143L, supplierGroup#22198150, supplier#22198151, supplyingPlant#22198181, productGroup#22198182, product#22198153, plant#22198154, subrange#22198152, orderDateTime#22198158, deliveryDateTime#22198159, availabilityDateTime#22198160, nextAvailabilityDateTime#22198161, constraintValues#22198175, constraintOperators#22198173, constraintLabels#22198172, logisticUnits#22198177, orderQuantityBaseUom#22198163, orderQuantityBaseUomUuid#22198164, splitIndicator#22198145L, netPriceAmount#22198168, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#22197470, items#22197472]
Arguments: [shardId#22197470, items#22197472], [(size(items#22197472, true) > 0), isnotnull(items#22197472)]
(4) InMemoryRelation
Arguments: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, optimizationInsights#22197476], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, optimizationInsights#22197476]
Arguments: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, optimizationInsights#22197476], [isnotnull(shardId#22197470), (shardId#22197470 = 0_7_10000000553)]
(6) InMemoryRelation
Arguments: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, lastModified#22197475, optimizationInsights#22197476], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, lastModified#22197475, optimizationInsights#22197476]
Arguments: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, lastModified#22197475, optimizationInsights#22197476], MapPartitionsRDD[943168] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, lastModified#22197475, optimizationInsights#22197476]
Condition : (isnotnull(shardId#22197470) AND (shardId#22197470 = 0_7_10000000553))
(9) Filter [codegen id : 1]
Input [6]: [shardId#22197470, orderProposalId#22197471L, items#22197472, optimizationGroups#22197473, isOptimal#22197474, optimizationInsights#22197476]
Condition : (isnotnull(shardId#22197470) AND (shardId#22197470 = 0_7_10000000553))
(10) Filter [codegen id : 1]
Input [2]: [shardId#22197470, items#22197472]
Condition : ((size(items#22197472, true) > 0) AND isnotnull(items#22197472))
(11) Generate [codegen id : 1]
Input [2]: [shardId#22197470, items#22197472]
Arguments: explode(items#22197472), [shardId#22197470], false, [item#22197981]
(12) Project [codegen id : 1]
Output [4]: [shardId#22197470, item#22197981.worklistShardItemId AS worklistShardItemId#22197982L, item#22197981.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#22197983, item#22197981.qty AS qty#22197984]
Input [2]: [shardId#22197470, item#22197981]
(13) Exchange
Input [4]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984]
Arguments: hashpartitioning(worklistShardItemId#22197982L, 30), ENSURE_REQUIREMENTS, [plan_id=6645201]
(14) Sort [codegen id : 2]
Input [4]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984]
Arguments: [worklistShardItemId#22197982L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226, shardId#22198227, sequenceId#22198205]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000553]
PartitionFilters: [isnotnull(shardId#22198227), isnotnull(sequenceId#22198205), (shardId#22198227 = 0_7_10000000553), (sequenceId#22198205 = 4)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226, shardId#22198227, sequenceId#22198205]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226, shardId#22198227, sequenceId#22198205]
Condition : isnotnull(worklistShardItemId#22198206L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226]
Input [38]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226, shardId#22198227, sequenceId#22198205]
(19) Exchange
Input [36]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226]
Arguments: hashpartitioning(worklistShardItemId#22198206L, 30), REPARTITION_BY_NUM, [plan_id=6645211]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#22198206L, orderProposalId#22198183L, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, originalReplenishmentRunId#22198225L, splitIndicator#22198202L, previousOrderProposal#22198203L, sourceOfSupplyUuid#22198197, supplierGroup#22198185, supplier#22198186, subrange#22198189, product#22198192, plant#22198187, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, isFallbackOrderOnly#22198200, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, netPriceAmount#22198219, netPriceCurrencyCode#22198220, measurements#22198224, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, logisticUnits#22198210, optimizationGroups#22198226, externalProductId#22198208, externalPlantId#22198209, supplyingPlant#22198190, productGroup#22198191]
Input [36]: [orderProposalId#22198183L, orderProposalItemId#22198184, supplierGroup#22198185, supplier#22198186, plant#22198187, deliveryDateTime#22198188, subrange#22198189, supplyingPlant#22198190, productGroup#22198191, product#22198192, orderDateTime#22198193, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, sourceOfSupplyUuid#22198197, isFallbackOrderOnly#22198200, splitIndicator#22198202L, previousOrderProposal#22198203L, worklistShardItemId#22198206L, orderProposalItemGroupId#22198207, externalProductId#22198208, externalPlantId#22198209, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, measurements#22198224, originalReplenishmentRunId#22198225L, optimizationGroups#22198226]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#22198206L, orderProposalId#22198183L, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, originalReplenishmentRunId#22198225L, splitIndicator#22198202L, previousOrderProposal#22198203L, sourceOfSupplyUuid#22198197, supplierGroup#22198185, supplier#22198186, subrange#22198189, product#22198192, plant#22198187, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, isFallbackOrderOnly#22198200, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, netPriceAmount#22198219, netPriceCurrencyCode#22198220, measurements#22198224, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, logisticUnits#22198210, optimizationGroups#22198226, externalProductId#22198208, externalPlantId#22198209, supplyingPlant#22198190, productGroup#22198191]
Arguments: [worklistShardItemId#22198206L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#22197982L]
Right keys [1]: [worklistShardItemId#22198206L]
Join type: LeftOuter
Join condition: (shardId#22197470 = 0_7_10000000553)
(23) Project [codegen id : 5]
Output [39]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200]
Input [40]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, worklistShardItemId#22198206L, orderProposalId#22198183L, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, originalReplenishmentRunId#22198225L, splitIndicator#22198202L, previousOrderProposal#22198203L, sourceOfSupplyUuid#22198197, supplierGroup#22198185, supplier#22198186, subrange#22198189, product#22198192, plant#22198187, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, isFallbackOrderOnly#22198200, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, netPriceAmount#22198219, netPriceCurrencyCode#22198220, measurements#22198224, minimumOrderQuantity#22198213, constraintLabels#22198214, constraintOperators#22198215, constraintValues#22198216, logisticUnits#22198210, optimizationGroups#22198226, externalProductId#22198208, externalPlantId#22198209, supplyingPlant#22198190, productGroup#22198191]
(24) Exchange
Input [39]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200]
Arguments: hashpartitioning(shardId#22197470, worklistShardItemId#22197982L, 30), ENSURE_REQUIREMENTS, [plan_id=6645220]
(25) Sort [codegen id : 6]
Input [39]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200]
Arguments: [shardId#22197470 ASC NULLS FIRST, worklistShardItemId#22197982L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#22198732, worklistShardItemId#22198733L, qty#22198734, demandChannel#22198735, demandStream#22198736, kpis#22198737]
Arguments: [shardId#22198732, worklistShardItemId#22198733L, qty#22198734, demandChannel#22198735, demandStream#22198736, kpis#22198737], MapPartitionsRDD[943232] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#22198732, worklistShardItemId#22198733L, qty#22198734, demandChannel#22198735, demandStream#22198736, kpis#22198737]
Condition : (((isnull(qty#22198734) AND isnull(demandChannel#22198735)) AND isnull(demandStream#22198736)) AND (isnotnull(shardId#22198732) AND isnotnull(worklistShardItemId#22198733L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#22198732, worklistShardItemId#22198733L, coalesce(kpis#22198737, []) AS prodLocSpecificKpis#22198738]
Input [6]: [shardId#22198732, worklistShardItemId#22198733L, qty#22198734, demandChannel#22198735, demandStream#22198736, kpis#22198737]
(29) Exchange
Input [3]: [shardId#22198732, worklistShardItemId#22198733L, prodLocSpecificKpis#22198738]
Arguments: hashpartitioning(shardId#22198732, worklistShardItemId#22198733L, 30), ENSURE_REQUIREMENTS, [plan_id=6645226]
(30) Sort [codegen id : 8]
Input [3]: [shardId#22198732, worklistShardItemId#22198733L, prodLocSpecificKpis#22198738]
Arguments: [shardId#22198732 ASC NULLS FIRST, worklistShardItemId#22198733L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#22197470, worklistShardItemId#22197982L]
Right keys [2]: [shardId#22198732, worklistShardItemId#22198733L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, coalesce(prodLocSpecificKpis#22198738, []) AS prodLocSpecificKpis#22198739]
Input [42]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, shardId#22198732, worklistShardItemId#22198733L, prodLocSpecificKpis#22198738]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#22198748, worklistShardItemId#22198749L, qty#22198750, demandChannel#22198751, demandStream#22198752, kpis#22198753]
Arguments: [shardId#22198748, worklistShardItemId#22198749L, qty#22198750, demandChannel#22198751, demandStream#22198752, kpis#22198753], MapPartitionsRDD[943232] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#22198748, worklistShardItemId#22198749L, qty#22198750, demandChannel#22198751, demandStream#22198752, kpis#22198753]
Condition : ((((isnull(qty#22198750) AND isnotnull(demandChannel#22198751)) AND isnotnull(demandStream#22198752)) AND (size(kpis#22198753, true) > 0)) AND (isnotnull(shardId#22198748) AND isnotnull(worklistShardItemId#22198749L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#22198748, worklistShardItemId#22198749L, demandChannel#22198751, demandStream#22198752, kpis#22198753]
Input [6]: [shardId#22198748, worklistShardItemId#22198749L, qty#22198750, demandChannel#22198751, demandStream#22198752, kpis#22198753]
(36) ObjectHashAggregate
Input [5]: [shardId#22198748, worklistShardItemId#22198749L, demandChannel#22198751, demandStream#22198752, kpis#22198753]
Keys [2]: [shardId#22198748, worklistShardItemId#22198749L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#22198751, demandStream, demandStream#22198752, kpis, kpis#22198753), 0, 0)]
Aggregate Attributes [1]: [buf#22198928]
Results [3]: [shardId#22198748, worklistShardItemId#22198749L, buf#22198929]
(37) Exchange
Input [3]: [shardId#22198748, worklistShardItemId#22198749L, buf#22198929]
Arguments: hashpartitioning(shardId#22198748, worklistShardItemId#22198749L, 30), ENSURE_REQUIREMENTS, [plan_id=6645237]
(38) ObjectHashAggregate
Input [3]: [shardId#22198748, worklistShardItemId#22198749L, buf#22198929]
Keys [2]: [shardId#22198748, worklistShardItemId#22198749L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#22198751, demandStream, demandStream#22198752, kpis, kpis#22198753), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#22198751, demandStream, demandStream#22198752, kpis, kpis#22198753), 0, 0)#22198747]
Results [3]: [shardId#22198748, worklistShardItemId#22198749L, collect_list(struct(demandChannel, demandChannel#22198751, demandStream, demandStream#22198752, kpis, kpis#22198753), 0, 0)#22198747 AS channelStreamSpecificKpis#22198740]
(39) Sort [codegen id : 11]
Input [3]: [shardId#22198748, worklistShardItemId#22198749L, channelStreamSpecificKpis#22198740]
Arguments: [shardId#22198748 ASC NULLS FIRST, worklistShardItemId#22198749L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#22197470, worklistShardItemId#22197982L]
Right keys [2]: [shardId#22198748, worklistShardItemId#22198749L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, prodLocSpecificKpis#22198739, coalesce(channelStreamSpecificKpis#22198740, []) AS channelStreamSpecificKpis#22198754]
Input [43]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, prodLocSpecificKpis#22198739, shardId#22198748, worklistShardItemId#22198749L, channelStreamSpecificKpis#22198740]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, demandChannel#22198764, demandStream#22198765, kpis#22198766]
Arguments: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, demandChannel#22198764, demandStream#22198765, kpis#22198766], MapPartitionsRDD[943232] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, demandChannel#22198764, demandStream#22198765, kpis#22198766]
Condition : ((isnotnull(qty#22198763) AND isnotnull(kpis#22198766)) AND (isnotnull(shardId#22198761) AND isnotnull(worklistShardItemId#22198762L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, kpis#22198766]
Input [6]: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, demandChannel#22198764, demandStream#22198765, kpis#22198766]
(45) ObjectHashAggregate
Input [4]: [shardId#22198761, worklistShardItemId#22198762L, qty#22198763, kpis#22198766]
Keys [2]: [shardId#22198761, worklistShardItemId#22198762L]
Functions [1]: [partial_collect_list(struct(qty, qty#22198763, kpis, kpis#22198766), 0, 0)]
Aggregate Attributes [1]: [buf#22198930]
Results [3]: [shardId#22198761, worklistShardItemId#22198762L, buf#22198931]
(46) Exchange
Input [3]: [shardId#22198761, worklistShardItemId#22198762L, buf#22198931]
Arguments: hashpartitioning(shardId#22198761, worklistShardItemId#22198762L, 30), ENSURE_REQUIREMENTS, [plan_id=6645249]
(47) ObjectHashAggregate
Input [3]: [shardId#22198761, worklistShardItemId#22198762L, buf#22198931]
Keys [2]: [shardId#22198761, worklistShardItemId#22198762L]
Functions [1]: [collect_list(struct(qty, qty#22198763, kpis, kpis#22198766), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#22198763, kpis, kpis#22198766), 0, 0)#22198760]
Results [3]: [shardId#22198761, worklistShardItemId#22198762L, map_from_entries(collect_list(struct(qty, qty#22198763, kpis, kpis#22198766), 0, 0)#22198760) AS quantityKpis#22198755]
(48) Sort [codegen id : 14]
Input [3]: [shardId#22198761, worklistShardItemId#22198762L, quantityKpis#22198755]
Arguments: [shardId#22198761 ASC NULLS FIRST, worklistShardItemId#22198762L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#22197470, worklistShardItemId#22197982L]
Right keys [2]: [shardId#22198761, worklistShardItemId#22198762L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, prodLocSpecificKpis#22198739, channelStreamSpecificKpis#22198754, coalesce(quantityKpis#22198755, map(keys: [], values: [])) AS quantityKpis#22198767]
Input [44]: [shardId#22197470, worklistShardItemId#22197982L, quantityAfterProdPlantOptimization#22197983, qty#22197984, orderProposalId#22198183L, originalReplenishmentRunId#22198225L, supplierGroup#22198185, supplier#22198186, supplyingPlant#22198190, productGroup#22198191, product#22198192, plant#22198187, subrange#22198189, orderDateTime#22198193, deliveryDateTime#22198188, availabilityDateTime#22198194, nextAvailabilityDateTime#22198195, constraintValues#22198216, constraintOperators#22198215, constraintLabels#22198214, logisticUnits#22198210, orderQuantityBaseUom#22198211, orderQuantityBaseUomUuid#22198212, splitIndicator#22198202L, netPriceAmount#22198219, netPriceCurrencyCode#22198220, netPriceQuantity#22198221, netPriceQuantityUom#22198222, netPriceQuantityUomUuid#22198223, sourceOfSupplyUuid#22198197, minimumOrderQuantity#22198213, orderProposalItemId#22198184, orderProposalItemGroupId#22198207, optimizationGroups#22198226, measurements#22198224, externalProductId#22198208, externalPlantId#22198209, previousOrderProposal#22198203L, isFallbackOrderOnly#22198200, prodLocSpecificKpis#22198739, channelStreamSpecificKpis#22198754, shardId#22198761, worklistShardItemId#22198762L, quantityKpis#22198755]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767, shardId#22197470]
Condition : ((isnotnull(shardId#22197470) AND (shardId#22197470 = 0_7_10000000553)) AND (size(quantityKpis#22198767, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767]
Input [4]: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767, shardId#22197470]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#22198140L, orderProposalItemId#22198141, quantityKpis#22198767]
Arguments: explode(quantityKpis#22198767), [orderProposalId#22198140L, orderProposalItemId#22198141], false, [orderQuantityInBaseUnit#22202376, kpis#22202377]
(54) Project
Output [8]: [orderProposalId#22198140L, cast(orderProposalItemId#22198141 as bigint) AS orderProposalItemId#22202375L, orderQuantityInBaseUnit#22202376, filter(kpis#22202377, lambdafunction((lambda x_73372#22202379.label = ServiceLevel), lambda x_73372#22202379, false))[0].value AS serviceLevel#22202378, filter(kpis#22202377, lambdafunction((lambda x_73373#22202381.label = RangeOfCoverage), lambda x_73373#22202381, false))[0].value AS rangeOfCoverage#22202380, filter(kpis#22202377, lambdafunction((lambda x_73374#22202383.label = ServiceLevelAtStartOfDelisting), lambda x_73374#22202383, false))[0].value AS serviceLevelAtEndOfListing#22202382, filter(kpis#22202377, lambdafunction((lambda x_73375#22202385.label = ServiceLevelMinimumStock), lambda x_73375#22202385, false))[0].value AS serviceLevelMinStock#22202384, 10000000553 AS replenishmentRunId#22202387L]
Input [4]: [orderProposalId#22198140L, orderProposalItemId#22198141, orderQuantityInBaseUnit#22202376, kpis#22202377]
(55) WriteFiles
Input [8]: [orderProposalId#22198140L, orderProposalItemId#22202375L, orderQuantityInBaseUnit#22202376, serviceLevel#22202378, rangeOfCoverage#22202380, serviceLevelAtEndOfListing#22202382, serviceLevelMinStock#22202384, replenishmentRunId#22202387L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000553/shardId=0_7_10000000553/sequenceId=4, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000553/shardId=0_7_10000000553/sequenceId=4], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]