== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161, shardId#3515802]
Arguments: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161, shardId#3515802], [isnotnull(shardId#3515802), (shardId#3515802 = 0_5_10000000532), (size(quantityKpis#3518161, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516472L, originalReplenishmentRunId#3516475L, supplierGroup#3516482, supplier#3516483, supplyingPlant#3516513, productGroup#3516514, product#3516485, plant#3516486, subrange#3516484, orderDateTime#3516490, deliveryDateTime#3516491, availabilityDateTime#3516492, nextAvailabilityDateTime#3516493, constraintValues#3516507, constraintOperators#3516505, constraintLabels#3516504, logisticUnits#3516509, orderQuantityBaseUom#3516495, orderQuantityBaseUomUuid#3516496, splitIndicator#3516477L, netPriceAmount#3516500, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3515802, items#3515804]
Arguments: [shardId#3515802, items#3515804], [(size(items#3515804, true) > 0), isnotnull(items#3515804)]
(4) InMemoryRelation
Arguments: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, optimizationInsights#3515808], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, optimizationInsights#3515808]
Arguments: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, optimizationInsights#3515808], [isnotnull(shardId#3515802), (shardId#3515802 = 0_5_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, lastModified#3515807, optimizationInsights#3515808], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, lastModified#3515807, optimizationInsights#3515808]
Arguments: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, lastModified#3515807, optimizationInsights#3515808], MapPartitionsRDD[149278] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, lastModified#3515807, optimizationInsights#3515808]
Condition : (isnotnull(shardId#3515802) AND (shardId#3515802 = 0_5_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3515802, orderProposalId#3515803L, items#3515804, optimizationGroups#3515805, isOptimal#3515806, optimizationInsights#3515808]
Condition : (isnotnull(shardId#3515802) AND (shardId#3515802 = 0_5_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3515802, items#3515804]
Condition : ((size(items#3515804, true) > 0) AND isnotnull(items#3515804))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3515802, items#3515804]
Arguments: explode(items#3515804), [shardId#3515802], false, [item#3516313]
(12) Project [codegen id : 1]
Output [4]: [shardId#3515802, item#3516313.worklistShardItemId AS worklistShardItemId#3516314L, item#3516313.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3516315, item#3516313.qty AS qty#3516316]
Input [2]: [shardId#3515802, item#3516313]
(13) Exchange
Input [4]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316]
Arguments: hashpartitioning(worklistShardItemId#3516314L, 30), ENSURE_REQUIREMENTS, [plan_id=1008593]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316]
Arguments: [worklistShardItemId#3516314L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558, shardId#3516559, sequenceId#3516537]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3516559), isnotnull(sequenceId#3516537), (shardId#3516559 = 0_5_10000000532), (sequenceId#3516537 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558, shardId#3516559, sequenceId#3516537]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558, shardId#3516559, sequenceId#3516537]
Condition : isnotnull(worklistShardItemId#3516538L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558]
Input [38]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558, shardId#3516559, sequenceId#3516537]
(19) Exchange
Input [36]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558]
Arguments: hashpartitioning(worklistShardItemId#3516538L, 30), REPARTITION_BY_NUM, [plan_id=1008603]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3516538L, orderProposalId#3516515L, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, originalReplenishmentRunId#3516557L, splitIndicator#3516534L, previousOrderProposal#3516535L, sourceOfSupplyUuid#3516529, supplierGroup#3516517, supplier#3516518, subrange#3516521, product#3516524, plant#3516519, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, isFallbackOrderOnly#3516532, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, netPriceAmount#3516551, netPriceCurrencyCode#3516552, measurements#3516556, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, logisticUnits#3516542, optimizationGroups#3516558, externalProductId#3516540, externalPlantId#3516541, supplyingPlant#3516522, productGroup#3516523]
Input [36]: [orderProposalId#3516515L, orderProposalItemId#3516516, supplierGroup#3516517, supplier#3516518, plant#3516519, deliveryDateTime#3516520, subrange#3516521, supplyingPlant#3516522, productGroup#3516523, product#3516524, orderDateTime#3516525, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, sourceOfSupplyUuid#3516529, isFallbackOrderOnly#3516532, splitIndicator#3516534L, previousOrderProposal#3516535L, worklistShardItemId#3516538L, orderProposalItemGroupId#3516539, externalProductId#3516540, externalPlantId#3516541, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, measurements#3516556, originalReplenishmentRunId#3516557L, optimizationGroups#3516558]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3516538L, orderProposalId#3516515L, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, originalReplenishmentRunId#3516557L, splitIndicator#3516534L, previousOrderProposal#3516535L, sourceOfSupplyUuid#3516529, supplierGroup#3516517, supplier#3516518, subrange#3516521, product#3516524, plant#3516519, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, isFallbackOrderOnly#3516532, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, netPriceAmount#3516551, netPriceCurrencyCode#3516552, measurements#3516556, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, logisticUnits#3516542, optimizationGroups#3516558, externalProductId#3516540, externalPlantId#3516541, supplyingPlant#3516522, productGroup#3516523]
Arguments: [worklistShardItemId#3516538L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3516314L]
Right keys [1]: [worklistShardItemId#3516538L]
Join type: LeftOuter
Join condition: (shardId#3515802 = 0_5_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532]
Input [40]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, worklistShardItemId#3516538L, orderProposalId#3516515L, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, originalReplenishmentRunId#3516557L, splitIndicator#3516534L, previousOrderProposal#3516535L, sourceOfSupplyUuid#3516529, supplierGroup#3516517, supplier#3516518, subrange#3516521, product#3516524, plant#3516519, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, isFallbackOrderOnly#3516532, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, netPriceAmount#3516551, netPriceCurrencyCode#3516552, measurements#3516556, minimumOrderQuantity#3516545, constraintLabels#3516546, constraintOperators#3516547, constraintValues#3516548, logisticUnits#3516542, optimizationGroups#3516558, externalProductId#3516540, externalPlantId#3516541, supplyingPlant#3516522, productGroup#3516523]
(24) Exchange
Input [39]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532]
Arguments: hashpartitioning(shardId#3515802, worklistShardItemId#3516314L, 30), ENSURE_REQUIREMENTS, [plan_id=1008612]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532]
Arguments: [shardId#3515802 ASC NULLS FIRST, worklistShardItemId#3516314L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3518126, worklistShardItemId#3518127L, qty#3518128, demandChannel#3518129, demandStream#3518130, kpis#3518131]
Arguments: [shardId#3518126, worklistShardItemId#3518127L, qty#3518128, demandChannel#3518129, demandStream#3518130, kpis#3518131], MapPartitionsRDD[149437] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3518126, worklistShardItemId#3518127L, qty#3518128, demandChannel#3518129, demandStream#3518130, kpis#3518131]
Condition : (((isnull(qty#3518128) AND isnull(demandChannel#3518129)) AND isnull(demandStream#3518130)) AND (isnotnull(shardId#3518126) AND isnotnull(worklistShardItemId#3518127L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3518126, worklistShardItemId#3518127L, coalesce(kpis#3518131, []) AS prodLocSpecificKpis#3518132]
Input [6]: [shardId#3518126, worklistShardItemId#3518127L, qty#3518128, demandChannel#3518129, demandStream#3518130, kpis#3518131]
(29) Exchange
Input [3]: [shardId#3518126, worklistShardItemId#3518127L, prodLocSpecificKpis#3518132]
Arguments: hashpartitioning(shardId#3518126, worklistShardItemId#3518127L, 30), ENSURE_REQUIREMENTS, [plan_id=1008618]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3518126, worklistShardItemId#3518127L, prodLocSpecificKpis#3518132]
Arguments: [shardId#3518126 ASC NULLS FIRST, worklistShardItemId#3518127L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3515802, worklistShardItemId#3516314L]
Right keys [2]: [shardId#3518126, worklistShardItemId#3518127L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, coalesce(prodLocSpecificKpis#3518132, []) AS prodLocSpecificKpis#3518133]
Input [42]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, shardId#3518126, worklistShardItemId#3518127L, prodLocSpecificKpis#3518132]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3518142, worklistShardItemId#3518143L, qty#3518144, demandChannel#3518145, demandStream#3518146, kpis#3518147]
Arguments: [shardId#3518142, worklistShardItemId#3518143L, qty#3518144, demandChannel#3518145, demandStream#3518146, kpis#3518147], MapPartitionsRDD[149437] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3518142, worklistShardItemId#3518143L, qty#3518144, demandChannel#3518145, demandStream#3518146, kpis#3518147]
Condition : ((((isnull(qty#3518144) AND isnotnull(demandChannel#3518145)) AND isnotnull(demandStream#3518146)) AND (size(kpis#3518147, true) > 0)) AND (isnotnull(shardId#3518142) AND isnotnull(worklistShardItemId#3518143L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3518142, worklistShardItemId#3518143L, demandChannel#3518145, demandStream#3518146, kpis#3518147]
Input [6]: [shardId#3518142, worklistShardItemId#3518143L, qty#3518144, demandChannel#3518145, demandStream#3518146, kpis#3518147]
(36) ObjectHashAggregate
Input [5]: [shardId#3518142, worklistShardItemId#3518143L, demandChannel#3518145, demandStream#3518146, kpis#3518147]
Keys [2]: [shardId#3518142, worklistShardItemId#3518143L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3518145, demandStream, demandStream#3518146, kpis, kpis#3518147), 0, 0)]
Aggregate Attributes [1]: [buf#3518394]
Results [3]: [shardId#3518142, worklistShardItemId#3518143L, buf#3518395]
(37) Exchange
Input [3]: [shardId#3518142, worklistShardItemId#3518143L, buf#3518395]
Arguments: hashpartitioning(shardId#3518142, worklistShardItemId#3518143L, 30), ENSURE_REQUIREMENTS, [plan_id=1008629]
(38) ObjectHashAggregate
Input [3]: [shardId#3518142, worklistShardItemId#3518143L, buf#3518395]
Keys [2]: [shardId#3518142, worklistShardItemId#3518143L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3518145, demandStream, demandStream#3518146, kpis, kpis#3518147), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3518145, demandStream, demandStream#3518146, kpis, kpis#3518147), 0, 0)#3518141]
Results [3]: [shardId#3518142, worklistShardItemId#3518143L, collect_list(struct(demandChannel, demandChannel#3518145, demandStream, demandStream#3518146, kpis, kpis#3518147), 0, 0)#3518141 AS channelStreamSpecificKpis#3518134]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3518142, worklistShardItemId#3518143L, channelStreamSpecificKpis#3518134]
Arguments: [shardId#3518142 ASC NULLS FIRST, worklistShardItemId#3518143L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3515802, worklistShardItemId#3516314L]
Right keys [2]: [shardId#3518142, worklistShardItemId#3518143L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, prodLocSpecificKpis#3518133, coalesce(channelStreamSpecificKpis#3518134, []) AS channelStreamSpecificKpis#3518148]
Input [43]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, prodLocSpecificKpis#3518133, shardId#3518142, worklistShardItemId#3518143L, channelStreamSpecificKpis#3518134]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, demandChannel#3518158, demandStream#3518159, kpis#3518160]
Arguments: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, demandChannel#3518158, demandStream#3518159, kpis#3518160], MapPartitionsRDD[149437] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, demandChannel#3518158, demandStream#3518159, kpis#3518160]
Condition : ((isnotnull(qty#3518157) AND isnotnull(kpis#3518160)) AND (isnotnull(shardId#3518155) AND isnotnull(worklistShardItemId#3518156L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, kpis#3518160]
Input [6]: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, demandChannel#3518158, demandStream#3518159, kpis#3518160]
(45) ObjectHashAggregate
Input [4]: [shardId#3518155, worklistShardItemId#3518156L, qty#3518157, kpis#3518160]
Keys [2]: [shardId#3518155, worklistShardItemId#3518156L]
Functions [1]: [partial_collect_list(struct(qty, qty#3518157, kpis, kpis#3518160), 0, 0)]
Aggregate Attributes [1]: [buf#3518396]
Results [3]: [shardId#3518155, worklistShardItemId#3518156L, buf#3518397]
(46) Exchange
Input [3]: [shardId#3518155, worklistShardItemId#3518156L, buf#3518397]
Arguments: hashpartitioning(shardId#3518155, worklistShardItemId#3518156L, 30), ENSURE_REQUIREMENTS, [plan_id=1008641]
(47) ObjectHashAggregate
Input [3]: [shardId#3518155, worklistShardItemId#3518156L, buf#3518397]
Keys [2]: [shardId#3518155, worklistShardItemId#3518156L]
Functions [1]: [collect_list(struct(qty, qty#3518157, kpis, kpis#3518160), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3518157, kpis, kpis#3518160), 0, 0)#3518154]
Results [3]: [shardId#3518155, worklistShardItemId#3518156L, map_from_entries(collect_list(struct(qty, qty#3518157, kpis, kpis#3518160), 0, 0)#3518154) AS quantityKpis#3518149]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3518155, worklistShardItemId#3518156L, quantityKpis#3518149]
Arguments: [shardId#3518155 ASC NULLS FIRST, worklistShardItemId#3518156L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3515802, worklistShardItemId#3516314L]
Right keys [2]: [shardId#3518155, worklistShardItemId#3518156L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, prodLocSpecificKpis#3518133, channelStreamSpecificKpis#3518148, coalesce(quantityKpis#3518149, map(keys: [], values: [])) AS quantityKpis#3518161]
Input [44]: [shardId#3515802, worklistShardItemId#3516314L, quantityAfterProdPlantOptimization#3516315, qty#3516316, orderProposalId#3516515L, originalReplenishmentRunId#3516557L, supplierGroup#3516517, supplier#3516518, supplyingPlant#3516522, productGroup#3516523, product#3516524, plant#3516519, subrange#3516521, orderDateTime#3516525, deliveryDateTime#3516520, availabilityDateTime#3516526, nextAvailabilityDateTime#3516527, constraintValues#3516548, constraintOperators#3516547, constraintLabels#3516546, logisticUnits#3516542, orderQuantityBaseUom#3516543, orderQuantityBaseUomUuid#3516544, splitIndicator#3516534L, netPriceAmount#3516551, netPriceCurrencyCode#3516552, netPriceQuantity#3516553, netPriceQuantityUom#3516554, netPriceQuantityUomUuid#3516555, sourceOfSupplyUuid#3516529, minimumOrderQuantity#3516545, orderProposalItemId#3516516, orderProposalItemGroupId#3516539, optimizationGroups#3516558, measurements#3516556, externalProductId#3516540, externalPlantId#3516541, previousOrderProposal#3516535L, isFallbackOrderOnly#3516532, prodLocSpecificKpis#3518133, channelStreamSpecificKpis#3518148, shardId#3518155, worklistShardItemId#3518156L, quantityKpis#3518149]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161, shardId#3515802]
Condition : ((isnotnull(shardId#3515802) AND (shardId#3515802 = 0_5_10000000532)) AND (size(quantityKpis#3518161, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161]
Input [4]: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161, shardId#3515802]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3516472L, orderProposalItemId#3516473, quantityKpis#3518161]
Arguments: explode(quantityKpis#3518161), [orderProposalId#3516472L, orderProposalItemId#3516473], false, [orderQuantityInBaseUnit#3523103, kpis#3523104]
(54) Project
Output [8]: [orderProposalId#3516472L, cast(orderProposalItemId#3516473 as bigint) AS orderProposalItemId#3523102L, orderQuantityInBaseUnit#3523103, filter(kpis#3523104, lambdafunction((lambda x_11678#3523106.label = ServiceLevel), lambda x_11678#3523106, false))[0].value AS serviceLevel#3523105, filter(kpis#3523104, lambdafunction((lambda x_11679#3523108.label = RangeOfCoverage), lambda x_11679#3523108, false))[0].value AS rangeOfCoverage#3523107, filter(kpis#3523104, lambdafunction((lambda x_11680#3523110.label = ServiceLevelAtStartOfDelisting), lambda x_11680#3523110, false))[0].value AS serviceLevelAtEndOfListing#3523109, filter(kpis#3523104, lambdafunction((lambda x_11681#3523112.label = ServiceLevelMinimumStock), lambda x_11681#3523112, false))[0].value AS serviceLevelMinStock#3523111, 10000000532 AS replenishmentRunId#3523114L]
Input [4]: [orderProposalId#3516472L, orderProposalItemId#3516473, orderQuantityInBaseUnit#3523103, kpis#3523104]
(55) WriteFiles
Input [8]: [orderProposalId#3516472L, orderProposalItemId#3523102L, orderQuantityInBaseUnit#3523103, serviceLevel#3523105, rangeOfCoverage#3523107, serviceLevelAtEndOfListing#3523109, serviceLevelMinStock#3523111, replenishmentRunId#3523114L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=6, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]