== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686, shardId#3579932]
Arguments: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686, shardId#3579932], [isnotnull(shardId#3579932), (shardId#3579932 = 0_7_10000000532), (size(quantityKpis#3588686, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581322L, originalReplenishmentRunId#3581325L, supplierGroup#3581332, supplier#3581333, supplyingPlant#3581363, productGroup#3581364, product#3581335, plant#3581336, subrange#3581334, orderDateTime#3581340, deliveryDateTime#3581341, availabilityDateTime#3581342, nextAvailabilityDateTime#3581343, constraintValues#3581357, constraintOperators#3581355, constraintLabels#3581354, logisticUnits#3581359, orderQuantityBaseUom#3581345, orderQuantityBaseUomUuid#3581346, splitIndicator#3581327L, netPriceAmount#3581350, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3579932, items#3579934]
Arguments: [shardId#3579932, items#3579934], [(size(items#3579934, true) > 0), isnotnull(items#3579934)]
(4) InMemoryRelation
Arguments: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, optimizationInsights#3579938], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, optimizationInsights#3579938]
Arguments: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, optimizationInsights#3579938], [isnotnull(shardId#3579932), (shardId#3579932 = 0_7_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, lastModified#3579937, optimizationInsights#3579938], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, lastModified#3579937, optimizationInsights#3579938]
Arguments: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, lastModified#3579937, optimizationInsights#3579938], MapPartitionsRDD[152542] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, lastModified#3579937, optimizationInsights#3579938]
Condition : (isnotnull(shardId#3579932) AND (shardId#3579932 = 0_7_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3579932, orderProposalId#3579933L, items#3579934, optimizationGroups#3579935, isOptimal#3579936, optimizationInsights#3579938]
Condition : (isnotnull(shardId#3579932) AND (shardId#3579932 = 0_7_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3579932, items#3579934]
Condition : ((size(items#3579934, true) > 0) AND isnotnull(items#3579934))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3579932, items#3579934]
Arguments: explode(items#3579934), [shardId#3579932], false, [item#3581118]
(12) Project [codegen id : 1]
Output [4]: [shardId#3579932, item#3581118.worklistShardItemId AS worklistShardItemId#3581119L, item#3581118.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3581120, item#3581118.qty AS qty#3581121]
Input [2]: [shardId#3579932, item#3581118]
(13) Exchange
Input [4]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121]
Arguments: hashpartitioning(worklistShardItemId#3581119L, 30), ENSURE_REQUIREMENTS, [plan_id=1029390]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121]
Arguments: [worklistShardItemId#3581119L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530, shardId#3581531, sequenceId#3581509]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3581531), isnotnull(sequenceId#3581509), (shardId#3581531 = 0_7_10000000532), (sequenceId#3581509 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530, shardId#3581531, sequenceId#3581509]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530, shardId#3581531, sequenceId#3581509]
Condition : isnotnull(worklistShardItemId#3581510L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530]
Input [38]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530, shardId#3581531, sequenceId#3581509]
(19) Exchange
Input [36]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530]
Arguments: hashpartitioning(worklistShardItemId#3581510L, 30), REPARTITION_BY_NUM, [plan_id=1029400]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3581510L, orderProposalId#3581487L, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, originalReplenishmentRunId#3581529L, splitIndicator#3581506L, previousOrderProposal#3581507L, sourceOfSupplyUuid#3581501, supplierGroup#3581489, supplier#3581490, subrange#3581493, product#3581496, plant#3581491, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, isFallbackOrderOnly#3581504, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, netPriceAmount#3581523, netPriceCurrencyCode#3581524, measurements#3581528, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, logisticUnits#3581514, optimizationGroups#3581530, externalProductId#3581512, externalPlantId#3581513, supplyingPlant#3581494, productGroup#3581495]
Input [36]: [orderProposalId#3581487L, orderProposalItemId#3581488, supplierGroup#3581489, supplier#3581490, plant#3581491, deliveryDateTime#3581492, subrange#3581493, supplyingPlant#3581494, productGroup#3581495, product#3581496, orderDateTime#3581497, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, sourceOfSupplyUuid#3581501, isFallbackOrderOnly#3581504, splitIndicator#3581506L, previousOrderProposal#3581507L, worklistShardItemId#3581510L, orderProposalItemGroupId#3581511, externalProductId#3581512, externalPlantId#3581513, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, measurements#3581528, originalReplenishmentRunId#3581529L, optimizationGroups#3581530]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3581510L, orderProposalId#3581487L, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, originalReplenishmentRunId#3581529L, splitIndicator#3581506L, previousOrderProposal#3581507L, sourceOfSupplyUuid#3581501, supplierGroup#3581489, supplier#3581490, subrange#3581493, product#3581496, plant#3581491, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, isFallbackOrderOnly#3581504, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, netPriceAmount#3581523, netPriceCurrencyCode#3581524, measurements#3581528, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, logisticUnits#3581514, optimizationGroups#3581530, externalProductId#3581512, externalPlantId#3581513, supplyingPlant#3581494, productGroup#3581495]
Arguments: [worklistShardItemId#3581510L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3581119L]
Right keys [1]: [worklistShardItemId#3581510L]
Join type: LeftOuter
Join condition: (shardId#3579932 = 0_7_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504]
Input [40]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, worklistShardItemId#3581510L, orderProposalId#3581487L, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, originalReplenishmentRunId#3581529L, splitIndicator#3581506L, previousOrderProposal#3581507L, sourceOfSupplyUuid#3581501, supplierGroup#3581489, supplier#3581490, subrange#3581493, product#3581496, plant#3581491, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, isFallbackOrderOnly#3581504, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, netPriceAmount#3581523, netPriceCurrencyCode#3581524, measurements#3581528, minimumOrderQuantity#3581517, constraintLabels#3581518, constraintOperators#3581519, constraintValues#3581520, logisticUnits#3581514, optimizationGroups#3581530, externalProductId#3581512, externalPlantId#3581513, supplyingPlant#3581494, productGroup#3581495]
(24) Exchange
Input [39]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504]
Arguments: hashpartitioning(shardId#3579932, worklistShardItemId#3581119L, 30), ENSURE_REQUIREMENTS, [plan_id=1029409]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504]
Arguments: [shardId#3579932 ASC NULLS FIRST, worklistShardItemId#3581119L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3588651, worklistShardItemId#3588652L, qty#3588653, demandChannel#3588654, demandStream#3588655, kpis#3588656]
Arguments: [shardId#3588651, worklistShardItemId#3588652L, qty#3588653, demandChannel#3588654, demandStream#3588655, kpis#3588656], MapPartitionsRDD[152923] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3588651, worklistShardItemId#3588652L, qty#3588653, demandChannel#3588654, demandStream#3588655, kpis#3588656]
Condition : (((isnull(qty#3588653) AND isnull(demandChannel#3588654)) AND isnull(demandStream#3588655)) AND (isnotnull(shardId#3588651) AND isnotnull(worklistShardItemId#3588652L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3588651, worklistShardItemId#3588652L, coalesce(kpis#3588656, []) AS prodLocSpecificKpis#3588657]
Input [6]: [shardId#3588651, worklistShardItemId#3588652L, qty#3588653, demandChannel#3588654, demandStream#3588655, kpis#3588656]
(29) Exchange
Input [3]: [shardId#3588651, worklistShardItemId#3588652L, prodLocSpecificKpis#3588657]
Arguments: hashpartitioning(shardId#3588651, worklistShardItemId#3588652L, 30), ENSURE_REQUIREMENTS, [plan_id=1029415]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3588651, worklistShardItemId#3588652L, prodLocSpecificKpis#3588657]
Arguments: [shardId#3588651 ASC NULLS FIRST, worklistShardItemId#3588652L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3579932, worklistShardItemId#3581119L]
Right keys [2]: [shardId#3588651, worklistShardItemId#3588652L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, coalesce(prodLocSpecificKpis#3588657, []) AS prodLocSpecificKpis#3588658]
Input [42]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, shardId#3588651, worklistShardItemId#3588652L, prodLocSpecificKpis#3588657]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3588667, worklistShardItemId#3588668L, qty#3588669, demandChannel#3588670, demandStream#3588671, kpis#3588672]
Arguments: [shardId#3588667, worklistShardItemId#3588668L, qty#3588669, demandChannel#3588670, demandStream#3588671, kpis#3588672], MapPartitionsRDD[152923] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3588667, worklistShardItemId#3588668L, qty#3588669, demandChannel#3588670, demandStream#3588671, kpis#3588672]
Condition : ((((isnull(qty#3588669) AND isnotnull(demandChannel#3588670)) AND isnotnull(demandStream#3588671)) AND (size(kpis#3588672, true) > 0)) AND (isnotnull(shardId#3588667) AND isnotnull(worklistShardItemId#3588668L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3588667, worklistShardItemId#3588668L, demandChannel#3588670, demandStream#3588671, kpis#3588672]
Input [6]: [shardId#3588667, worklistShardItemId#3588668L, qty#3588669, demandChannel#3588670, demandStream#3588671, kpis#3588672]
(36) ObjectHashAggregate
Input [5]: [shardId#3588667, worklistShardItemId#3588668L, demandChannel#3588670, demandStream#3588671, kpis#3588672]
Keys [2]: [shardId#3588667, worklistShardItemId#3588668L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3588670, demandStream, demandStream#3588671, kpis, kpis#3588672), 0, 0)]
Aggregate Attributes [1]: [buf#3589971]
Results [3]: [shardId#3588667, worklistShardItemId#3588668L, buf#3589972]
(37) Exchange
Input [3]: [shardId#3588667, worklistShardItemId#3588668L, buf#3589972]
Arguments: hashpartitioning(shardId#3588667, worklistShardItemId#3588668L, 30), ENSURE_REQUIREMENTS, [plan_id=1029426]
(38) ObjectHashAggregate
Input [3]: [shardId#3588667, worklistShardItemId#3588668L, buf#3589972]
Keys [2]: [shardId#3588667, worklistShardItemId#3588668L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3588670, demandStream, demandStream#3588671, kpis, kpis#3588672), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3588670, demandStream, demandStream#3588671, kpis, kpis#3588672), 0, 0)#3588666]
Results [3]: [shardId#3588667, worklistShardItemId#3588668L, collect_list(struct(demandChannel, demandChannel#3588670, demandStream, demandStream#3588671, kpis, kpis#3588672), 0, 0)#3588666 AS channelStreamSpecificKpis#3588659]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3588667, worklistShardItemId#3588668L, channelStreamSpecificKpis#3588659]
Arguments: [shardId#3588667 ASC NULLS FIRST, worklistShardItemId#3588668L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3579932, worklistShardItemId#3581119L]
Right keys [2]: [shardId#3588667, worklistShardItemId#3588668L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, prodLocSpecificKpis#3588658, coalesce(channelStreamSpecificKpis#3588659, []) AS channelStreamSpecificKpis#3588673]
Input [43]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, prodLocSpecificKpis#3588658, shardId#3588667, worklistShardItemId#3588668L, channelStreamSpecificKpis#3588659]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, demandChannel#3588683, demandStream#3588684, kpis#3588685]
Arguments: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, demandChannel#3588683, demandStream#3588684, kpis#3588685], MapPartitionsRDD[152923] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, demandChannel#3588683, demandStream#3588684, kpis#3588685]
Condition : ((isnotnull(qty#3588682) AND isnotnull(kpis#3588685)) AND (isnotnull(shardId#3588680) AND isnotnull(worklistShardItemId#3588681L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, kpis#3588685]
Input [6]: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, demandChannel#3588683, demandStream#3588684, kpis#3588685]
(45) ObjectHashAggregate
Input [4]: [shardId#3588680, worklistShardItemId#3588681L, qty#3588682, kpis#3588685]
Keys [2]: [shardId#3588680, worklistShardItemId#3588681L]
Functions [1]: [partial_collect_list(struct(qty, qty#3588682, kpis, kpis#3588685), 0, 0)]
Aggregate Attributes [1]: [buf#3589973]
Results [3]: [shardId#3588680, worklistShardItemId#3588681L, buf#3589974]
(46) Exchange
Input [3]: [shardId#3588680, worklistShardItemId#3588681L, buf#3589974]
Arguments: hashpartitioning(shardId#3588680, worklistShardItemId#3588681L, 30), ENSURE_REQUIREMENTS, [plan_id=1029438]
(47) ObjectHashAggregate
Input [3]: [shardId#3588680, worklistShardItemId#3588681L, buf#3589974]
Keys [2]: [shardId#3588680, worklistShardItemId#3588681L]
Functions [1]: [collect_list(struct(qty, qty#3588682, kpis, kpis#3588685), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3588682, kpis, kpis#3588685), 0, 0)#3588679]
Results [3]: [shardId#3588680, worklistShardItemId#3588681L, map_from_entries(collect_list(struct(qty, qty#3588682, kpis, kpis#3588685), 0, 0)#3588679) AS quantityKpis#3588674]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3588680, worklistShardItemId#3588681L, quantityKpis#3588674]
Arguments: [shardId#3588680 ASC NULLS FIRST, worklistShardItemId#3588681L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3579932, worklistShardItemId#3581119L]
Right keys [2]: [shardId#3588680, worklistShardItemId#3588681L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, prodLocSpecificKpis#3588658, channelStreamSpecificKpis#3588673, coalesce(quantityKpis#3588674, map(keys: [], values: [])) AS quantityKpis#3588686]
Input [44]: [shardId#3579932, worklistShardItemId#3581119L, quantityAfterProdPlantOptimization#3581120, qty#3581121, orderProposalId#3581487L, originalReplenishmentRunId#3581529L, supplierGroup#3581489, supplier#3581490, supplyingPlant#3581494, productGroup#3581495, product#3581496, plant#3581491, subrange#3581493, orderDateTime#3581497, deliveryDateTime#3581492, availabilityDateTime#3581498, nextAvailabilityDateTime#3581499, constraintValues#3581520, constraintOperators#3581519, constraintLabels#3581518, logisticUnits#3581514, orderQuantityBaseUom#3581515, orderQuantityBaseUomUuid#3581516, splitIndicator#3581506L, netPriceAmount#3581523, netPriceCurrencyCode#3581524, netPriceQuantity#3581525, netPriceQuantityUom#3581526, netPriceQuantityUomUuid#3581527, sourceOfSupplyUuid#3581501, minimumOrderQuantity#3581517, orderProposalItemId#3581488, orderProposalItemGroupId#3581511, optimizationGroups#3581530, measurements#3581528, externalProductId#3581512, externalPlantId#3581513, previousOrderProposal#3581507L, isFallbackOrderOnly#3581504, prodLocSpecificKpis#3588658, channelStreamSpecificKpis#3588673, shardId#3588680, worklistShardItemId#3588681L, quantityKpis#3588674]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686, shardId#3579932]
Condition : ((isnotnull(shardId#3579932) AND (shardId#3579932 = 0_7_10000000532)) AND (size(quantityKpis#3588686, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686]
Input [4]: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686, shardId#3579932]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3581322L, orderProposalItemId#3581323, quantityKpis#3588686]
Arguments: explode(quantityKpis#3588686), [orderProposalId#3581322L, orderProposalItemId#3581323], false, [orderQuantityInBaseUnit#3598753, kpis#3598754]
(54) Project
Output [8]: [orderProposalId#3581322L, cast(orderProposalItemId#3581323 as bigint) AS orderProposalItemId#3598752L, orderQuantityInBaseUnit#3598753, filter(kpis#3598754, lambdafunction((lambda x_12031#3598756.label = ServiceLevel), lambda x_12031#3598756, false))[0].value AS serviceLevel#3598755, filter(kpis#3598754, lambdafunction((lambda x_12032#3598758.label = RangeOfCoverage), lambda x_12032#3598758, false))[0].value AS rangeOfCoverage#3598757, filter(kpis#3598754, lambdafunction((lambda x_12033#3598760.label = ServiceLevelAtStartOfDelisting), lambda x_12033#3598760, false))[0].value AS serviceLevelAtEndOfListing#3598759, filter(kpis#3598754, lambdafunction((lambda x_12034#3598762.label = ServiceLevelMinimumStock), lambda x_12034#3598762, false))[0].value AS serviceLevelMinStock#3598761, 10000000532 AS replenishmentRunId#3598764L]
Input [4]: [orderProposalId#3581322L, orderProposalItemId#3581323, orderQuantityInBaseUnit#3598753, kpis#3598754]
(55) WriteFiles
Input [8]: [orderProposalId#3581322L, orderProposalItemId#3598752L, orderQuantityInBaseUnit#3598753, serviceLevel#3598755, rangeOfCoverage#3598757, serviceLevelAtEndOfListing#3598759, serviceLevelMinStock#3598761, replenishmentRunId#3598764L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_7_10000000532/sequenceId=6, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_7_10000000532/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]