== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804, shardId#3395105]
Arguments: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804, shardId#3395105], [isnotnull(shardId#3395105), (shardId#3395105 = 0_5_10000000532), (size(quantityKpis#3399804, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396170L, originalReplenishmentRunId#3396173L, supplierGroup#3396180, supplier#3396181, supplyingPlant#3396211, productGroup#3396212, product#3396183, plant#3396184, subrange#3396182, orderDateTime#3396188, deliveryDateTime#3396189, availabilityDateTime#3396190, nextAvailabilityDateTime#3396191, constraintValues#3396205, constraintOperators#3396203, constraintLabels#3396202, logisticUnits#3396207, orderQuantityBaseUom#3396193, orderQuantityBaseUomUuid#3396194, splitIndicator#3396175L, netPriceAmount#3396198, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3395105, items#3395107]
Arguments: [shardId#3395105, items#3395107], [(size(items#3395107, true) > 0), isnotnull(items#3395107)]
(4) InMemoryRelation
Arguments: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, optimizationInsights#3395111], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, optimizationInsights#3395111]
Arguments: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, optimizationInsights#3395111], [isnotnull(shardId#3395105), (shardId#3395105 = 0_5_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, lastModified#3395110, optimizationInsights#3395111], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, lastModified#3395110, optimizationInsights#3395111]
Arguments: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, lastModified#3395110, optimizationInsights#3395111], MapPartitionsRDD[144348] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, lastModified#3395110, optimizationInsights#3395111]
Condition : (isnotnull(shardId#3395105) AND (shardId#3395105 = 0_5_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3395105, orderProposalId#3395106L, items#3395107, optimizationGroups#3395108, isOptimal#3395109, optimizationInsights#3395111]
Condition : (isnotnull(shardId#3395105) AND (shardId#3395105 = 0_5_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3395105, items#3395107]
Condition : ((size(items#3395107, true) > 0) AND isnotnull(items#3395107))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3395105, items#3395107]
Arguments: explode(items#3395107), [shardId#3395105], false, [item#3395819]
(12) Project [codegen id : 1]
Output [4]: [shardId#3395105, item#3395819.worklistShardItemId AS worklistShardItemId#3395820L, item#3395819.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3395821, item#3395819.qty AS qty#3395822]
Input [2]: [shardId#3395105, item#3395819]
(13) Exchange
Input [4]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822]
Arguments: hashpartitioning(worklistShardItemId#3395820L, 30), ENSURE_REQUIREMENTS, [plan_id=979796]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822]
Arguments: [worklistShardItemId#3395820L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346, shardId#3396347, sequenceId#3396325]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3396347), isnotnull(sequenceId#3396325), (shardId#3396347 = 0_5_10000000532), (sequenceId#3396325 = 2)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346, shardId#3396347, sequenceId#3396325]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346, shardId#3396347, sequenceId#3396325]
Condition : isnotnull(worklistShardItemId#3396326L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346]
Input [38]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346, shardId#3396347, sequenceId#3396325]
(19) Exchange
Input [36]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346]
Arguments: hashpartitioning(worklistShardItemId#3396326L, 30), REPARTITION_BY_NUM, [plan_id=979806]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3396326L, orderProposalId#3396303L, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, originalReplenishmentRunId#3396345L, splitIndicator#3396322L, previousOrderProposal#3396323L, sourceOfSupplyUuid#3396317, supplierGroup#3396305, supplier#3396306, subrange#3396309, product#3396312, plant#3396307, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, isFallbackOrderOnly#3396320, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, netPriceAmount#3396339, netPriceCurrencyCode#3396340, measurements#3396344, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, logisticUnits#3396330, optimizationGroups#3396346, externalProductId#3396328, externalPlantId#3396329, supplyingPlant#3396310, productGroup#3396311]
Input [36]: [orderProposalId#3396303L, orderProposalItemId#3396304, supplierGroup#3396305, supplier#3396306, plant#3396307, deliveryDateTime#3396308, subrange#3396309, supplyingPlant#3396310, productGroup#3396311, product#3396312, orderDateTime#3396313, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, sourceOfSupplyUuid#3396317, isFallbackOrderOnly#3396320, splitIndicator#3396322L, previousOrderProposal#3396323L, worklistShardItemId#3396326L, orderProposalItemGroupId#3396327, externalProductId#3396328, externalPlantId#3396329, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, measurements#3396344, originalReplenishmentRunId#3396345L, optimizationGroups#3396346]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3396326L, orderProposalId#3396303L, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, originalReplenishmentRunId#3396345L, splitIndicator#3396322L, previousOrderProposal#3396323L, sourceOfSupplyUuid#3396317, supplierGroup#3396305, supplier#3396306, subrange#3396309, product#3396312, plant#3396307, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, isFallbackOrderOnly#3396320, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, netPriceAmount#3396339, netPriceCurrencyCode#3396340, measurements#3396344, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, logisticUnits#3396330, optimizationGroups#3396346, externalProductId#3396328, externalPlantId#3396329, supplyingPlant#3396310, productGroup#3396311]
Arguments: [worklistShardItemId#3396326L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3395820L]
Right keys [1]: [worklistShardItemId#3396326L]
Join type: LeftOuter
Join condition: (shardId#3395105 = 0_5_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320]
Input [40]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, worklistShardItemId#3396326L, orderProposalId#3396303L, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, originalReplenishmentRunId#3396345L, splitIndicator#3396322L, previousOrderProposal#3396323L, sourceOfSupplyUuid#3396317, supplierGroup#3396305, supplier#3396306, subrange#3396309, product#3396312, plant#3396307, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, isFallbackOrderOnly#3396320, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, netPriceAmount#3396339, netPriceCurrencyCode#3396340, measurements#3396344, minimumOrderQuantity#3396333, constraintLabels#3396334, constraintOperators#3396335, constraintValues#3396336, logisticUnits#3396330, optimizationGroups#3396346, externalProductId#3396328, externalPlantId#3396329, supplyingPlant#3396310, productGroup#3396311]
(24) Exchange
Input [39]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320]
Arguments: hashpartitioning(shardId#3395105, worklistShardItemId#3395820L, 30), ENSURE_REQUIREMENTS, [plan_id=979815]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320]
Arguments: [shardId#3395105 ASC NULLS FIRST, worklistShardItemId#3395820L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3399769, worklistShardItemId#3399770L, qty#3399771, demandChannel#3399772, demandStream#3399773, kpis#3399774]
Arguments: [shardId#3399769, worklistShardItemId#3399770L, qty#3399771, demandChannel#3399772, demandStream#3399773, kpis#3399774], MapPartitionsRDD[144539] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3399769, worklistShardItemId#3399770L, qty#3399771, demandChannel#3399772, demandStream#3399773, kpis#3399774]
Condition : (((isnull(qty#3399771) AND isnull(demandChannel#3399772)) AND isnull(demandStream#3399773)) AND (isnotnull(shardId#3399769) AND isnotnull(worklistShardItemId#3399770L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3399769, worklistShardItemId#3399770L, coalesce(kpis#3399774, []) AS prodLocSpecificKpis#3399775]
Input [6]: [shardId#3399769, worklistShardItemId#3399770L, qty#3399771, demandChannel#3399772, demandStream#3399773, kpis#3399774]
(29) Exchange
Input [3]: [shardId#3399769, worklistShardItemId#3399770L, prodLocSpecificKpis#3399775]
Arguments: hashpartitioning(shardId#3399769, worklistShardItemId#3399770L, 30), ENSURE_REQUIREMENTS, [plan_id=979821]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3399769, worklistShardItemId#3399770L, prodLocSpecificKpis#3399775]
Arguments: [shardId#3399769 ASC NULLS FIRST, worklistShardItemId#3399770L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3395105, worklistShardItemId#3395820L]
Right keys [2]: [shardId#3399769, worklistShardItemId#3399770L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, coalesce(prodLocSpecificKpis#3399775, []) AS prodLocSpecificKpis#3399776]
Input [42]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, shardId#3399769, worklistShardItemId#3399770L, prodLocSpecificKpis#3399775]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3399785, worklistShardItemId#3399786L, qty#3399787, demandChannel#3399788, demandStream#3399789, kpis#3399790]
Arguments: [shardId#3399785, worklistShardItemId#3399786L, qty#3399787, demandChannel#3399788, demandStream#3399789, kpis#3399790], MapPartitionsRDD[144539] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3399785, worklistShardItemId#3399786L, qty#3399787, demandChannel#3399788, demandStream#3399789, kpis#3399790]
Condition : ((((isnull(qty#3399787) AND isnotnull(demandChannel#3399788)) AND isnotnull(demandStream#3399789)) AND (size(kpis#3399790, true) > 0)) AND (isnotnull(shardId#3399785) AND isnotnull(worklistShardItemId#3399786L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3399785, worklistShardItemId#3399786L, demandChannel#3399788, demandStream#3399789, kpis#3399790]
Input [6]: [shardId#3399785, worklistShardItemId#3399786L, qty#3399787, demandChannel#3399788, demandStream#3399789, kpis#3399790]
(36) ObjectHashAggregate
Input [5]: [shardId#3399785, worklistShardItemId#3399786L, demandChannel#3399788, demandStream#3399789, kpis#3399790]
Keys [2]: [shardId#3399785, worklistShardItemId#3399786L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3399788, demandStream, demandStream#3399789, kpis, kpis#3399790), 0, 0)]
Aggregate Attributes [1]: [buf#3401088]
Results [3]: [shardId#3399785, worklistShardItemId#3399786L, buf#3401089]
(37) Exchange
Input [3]: [shardId#3399785, worklistShardItemId#3399786L, buf#3401089]
Arguments: hashpartitioning(shardId#3399785, worklistShardItemId#3399786L, 30), ENSURE_REQUIREMENTS, [plan_id=979832]
(38) ObjectHashAggregate
Input [3]: [shardId#3399785, worklistShardItemId#3399786L, buf#3401089]
Keys [2]: [shardId#3399785, worklistShardItemId#3399786L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3399788, demandStream, demandStream#3399789, kpis, kpis#3399790), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3399788, demandStream, demandStream#3399789, kpis, kpis#3399790), 0, 0)#3399784]
Results [3]: [shardId#3399785, worklistShardItemId#3399786L, collect_list(struct(demandChannel, demandChannel#3399788, demandStream, demandStream#3399789, kpis, kpis#3399790), 0, 0)#3399784 AS channelStreamSpecificKpis#3399777]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3399785, worklistShardItemId#3399786L, channelStreamSpecificKpis#3399777]
Arguments: [shardId#3399785 ASC NULLS FIRST, worklistShardItemId#3399786L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3395105, worklistShardItemId#3395820L]
Right keys [2]: [shardId#3399785, worklistShardItemId#3399786L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, prodLocSpecificKpis#3399776, coalesce(channelStreamSpecificKpis#3399777, []) AS channelStreamSpecificKpis#3399791]
Input [43]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, prodLocSpecificKpis#3399776, shardId#3399785, worklistShardItemId#3399786L, channelStreamSpecificKpis#3399777]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, demandChannel#3399801, demandStream#3399802, kpis#3399803]
Arguments: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, demandChannel#3399801, demandStream#3399802, kpis#3399803], MapPartitionsRDD[144539] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, demandChannel#3399801, demandStream#3399802, kpis#3399803]
Condition : ((isnotnull(qty#3399800) AND isnotnull(kpis#3399803)) AND (isnotnull(shardId#3399798) AND isnotnull(worklistShardItemId#3399799L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, kpis#3399803]
Input [6]: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, demandChannel#3399801, demandStream#3399802, kpis#3399803]
(45) ObjectHashAggregate
Input [4]: [shardId#3399798, worklistShardItemId#3399799L, qty#3399800, kpis#3399803]
Keys [2]: [shardId#3399798, worklistShardItemId#3399799L]
Functions [1]: [partial_collect_list(struct(qty, qty#3399800, kpis, kpis#3399803), 0, 0)]
Aggregate Attributes [1]: [buf#3401090]
Results [3]: [shardId#3399798, worklistShardItemId#3399799L, buf#3401091]
(46) Exchange
Input [3]: [shardId#3399798, worklistShardItemId#3399799L, buf#3401091]
Arguments: hashpartitioning(shardId#3399798, worklistShardItemId#3399799L, 30), ENSURE_REQUIREMENTS, [plan_id=979844]
(47) ObjectHashAggregate
Input [3]: [shardId#3399798, worklistShardItemId#3399799L, buf#3401091]
Keys [2]: [shardId#3399798, worklistShardItemId#3399799L]
Functions [1]: [collect_list(struct(qty, qty#3399800, kpis, kpis#3399803), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3399800, kpis, kpis#3399803), 0, 0)#3399797]
Results [3]: [shardId#3399798, worklistShardItemId#3399799L, map_from_entries(collect_list(struct(qty, qty#3399800, kpis, kpis#3399803), 0, 0)#3399797) AS quantityKpis#3399792]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3399798, worklistShardItemId#3399799L, quantityKpis#3399792]
Arguments: [shardId#3399798 ASC NULLS FIRST, worklistShardItemId#3399799L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3395105, worklistShardItemId#3395820L]
Right keys [2]: [shardId#3399798, worklistShardItemId#3399799L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, prodLocSpecificKpis#3399776, channelStreamSpecificKpis#3399791, coalesce(quantityKpis#3399792, map(keys: [], values: [])) AS quantityKpis#3399804]
Input [44]: [shardId#3395105, worklistShardItemId#3395820L, quantityAfterProdPlantOptimization#3395821, qty#3395822, orderProposalId#3396303L, originalReplenishmentRunId#3396345L, supplierGroup#3396305, supplier#3396306, supplyingPlant#3396310, productGroup#3396311, product#3396312, plant#3396307, subrange#3396309, orderDateTime#3396313, deliveryDateTime#3396308, availabilityDateTime#3396314, nextAvailabilityDateTime#3396315, constraintValues#3396336, constraintOperators#3396335, constraintLabels#3396334, logisticUnits#3396330, orderQuantityBaseUom#3396331, orderQuantityBaseUomUuid#3396332, splitIndicator#3396322L, netPriceAmount#3396339, netPriceCurrencyCode#3396340, netPriceQuantity#3396341, netPriceQuantityUom#3396342, netPriceQuantityUomUuid#3396343, sourceOfSupplyUuid#3396317, minimumOrderQuantity#3396333, orderProposalItemId#3396304, orderProposalItemGroupId#3396327, optimizationGroups#3396346, measurements#3396344, externalProductId#3396328, externalPlantId#3396329, previousOrderProposal#3396323L, isFallbackOrderOnly#3396320, prodLocSpecificKpis#3399776, channelStreamSpecificKpis#3399791, shardId#3399798, worklistShardItemId#3399799L, quantityKpis#3399792]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804, shardId#3395105]
Condition : ((isnotnull(shardId#3395105) AND (shardId#3395105 = 0_5_10000000532)) AND (size(quantityKpis#3399804, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804]
Input [4]: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804, shardId#3395105]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3396170L, orderProposalItemId#3396171, quantityKpis#3399804]
Arguments: explode(quantityKpis#3399804), [orderProposalId#3396170L, orderProposalItemId#3396171], false, [orderQuantityInBaseUnit#3410576, kpis#3410577]
(54) Project
Output [8]: [orderProposalId#3396170L, cast(orderProposalItemId#3396171 as bigint) AS orderProposalItemId#3410575L, orderQuantityInBaseUnit#3410576, filter(kpis#3410577, lambdafunction((lambda x_11379#3410579.label = ServiceLevel), lambda x_11379#3410579, false))[0].value AS serviceLevel#3410578, filter(kpis#3410577, lambdafunction((lambda x_11380#3410581.label = RangeOfCoverage), lambda x_11380#3410581, false))[0].value AS rangeOfCoverage#3410580, filter(kpis#3410577, lambdafunction((lambda x_11381#3410583.label = ServiceLevelAtStartOfDelisting), lambda x_11381#3410583, false))[0].value AS serviceLevelAtEndOfListing#3410582, filter(kpis#3410577, lambdafunction((lambda x_11382#3410585.label = ServiceLevelMinimumStock), lambda x_11382#3410585, false))[0].value AS serviceLevelMinStock#3410584, 10000000532 AS replenishmentRunId#3410587L]
Input [4]: [orderProposalId#3396170L, orderProposalItemId#3396171, orderQuantityInBaseUnit#3410576, kpis#3410577]
(55) WriteFiles
Input [8]: [orderProposalId#3396170L, orderProposalItemId#3410575L, orderQuantityInBaseUnit#3410576, serviceLevel#3410578, rangeOfCoverage#3410580, serviceLevelAtEndOfListing#3410582, serviceLevelMinStock#3410584, replenishmentRunId#3410587L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=2, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=2], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]