== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051, shardId#3579691]
Arguments: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051, shardId#3579691], [isnotnull(shardId#3579691), (shardId#3579691 = 0_1_10000000532), (size(quantityKpis#3587051, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581277L, originalReplenishmentRunId#3581280L, supplierGroup#3581287, supplier#3581288, supplyingPlant#3581318, productGroup#3581319, product#3581290, plant#3581291, subrange#3581289, orderDateTime#3581295, deliveryDateTime#3581296, availabilityDateTime#3581297, nextAvailabilityDateTime#3581298, constraintValues#3581312, constraintOperators#3581310, constraintLabels#3581309, logisticUnits#3581314, orderQuantityBaseUom#3581300, orderQuantityBaseUomUuid#3581301, splitIndicator#3581282L, netPriceAmount#3581305, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3579691, items#3579693]
Arguments: [shardId#3579691, items#3579693], [(size(items#3579693, true) > 0), isnotnull(items#3579693)]
(4) InMemoryRelation
Arguments: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, optimizationInsights#3579697], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, optimizationInsights#3579697]
Arguments: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, optimizationInsights#3579697], [isnotnull(shardId#3579691), (shardId#3579691 = 0_1_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, lastModified#3579696, optimizationInsights#3579697], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, lastModified#3579696, optimizationInsights#3579697]
Arguments: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, lastModified#3579696, optimizationInsights#3579697], MapPartitionsRDD[152524] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, lastModified#3579696, optimizationInsights#3579697]
Condition : (isnotnull(shardId#3579691) AND (shardId#3579691 = 0_1_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3579691, orderProposalId#3579692L, items#3579693, optimizationGroups#3579694, isOptimal#3579695, optimizationInsights#3579697]
Condition : (isnotnull(shardId#3579691) AND (shardId#3579691 = 0_1_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3579691, items#3579693]
Condition : ((size(items#3579693, true) > 0) AND isnotnull(items#3579693))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3579691, items#3579693]
Arguments: explode(items#3579693), [shardId#3579691], false, [item#3580960]
(12) Project [codegen id : 1]
Output [4]: [shardId#3579691, item#3580960.worklistShardItemId AS worklistShardItemId#3580961L, item#3580960.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3580962, item#3580960.qty AS qty#3580963]
Input [2]: [shardId#3579691, item#3580960]
(13) Exchange
Input [4]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963]
Arguments: hashpartitioning(worklistShardItemId#3580961L, 30), ENSURE_REQUIREMENTS, [plan_id=1028707]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963]
Arguments: [worklistShardItemId#3580961L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408, shardId#3581409, sequenceId#3581387]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3581409), isnotnull(sequenceId#3581387), (shardId#3581409 = 0_1_10000000532), (sequenceId#3581387 = 7)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408, shardId#3581409, sequenceId#3581387]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408, shardId#3581409, sequenceId#3581387]
Condition : isnotnull(worklistShardItemId#3581388L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408]
Input [38]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408, shardId#3581409, sequenceId#3581387]
(19) Exchange
Input [36]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408]
Arguments: hashpartitioning(worklistShardItemId#3581388L, 30), REPARTITION_BY_NUM, [plan_id=1028717]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3581388L, orderProposalId#3581365L, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, originalReplenishmentRunId#3581407L, splitIndicator#3581384L, previousOrderProposal#3581385L, sourceOfSupplyUuid#3581379, supplierGroup#3581367, supplier#3581368, subrange#3581371, product#3581374, plant#3581369, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, isFallbackOrderOnly#3581382, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, netPriceAmount#3581401, netPriceCurrencyCode#3581402, measurements#3581406, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, logisticUnits#3581392, optimizationGroups#3581408, externalProductId#3581390, externalPlantId#3581391, supplyingPlant#3581372, productGroup#3581373]
Input [36]: [orderProposalId#3581365L, orderProposalItemId#3581366, supplierGroup#3581367, supplier#3581368, plant#3581369, deliveryDateTime#3581370, subrange#3581371, supplyingPlant#3581372, productGroup#3581373, product#3581374, orderDateTime#3581375, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, sourceOfSupplyUuid#3581379, isFallbackOrderOnly#3581382, splitIndicator#3581384L, previousOrderProposal#3581385L, worklistShardItemId#3581388L, orderProposalItemGroupId#3581389, externalProductId#3581390, externalPlantId#3581391, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, measurements#3581406, originalReplenishmentRunId#3581407L, optimizationGroups#3581408]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3581388L, orderProposalId#3581365L, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, originalReplenishmentRunId#3581407L, splitIndicator#3581384L, previousOrderProposal#3581385L, sourceOfSupplyUuid#3581379, supplierGroup#3581367, supplier#3581368, subrange#3581371, product#3581374, plant#3581369, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, isFallbackOrderOnly#3581382, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, netPriceAmount#3581401, netPriceCurrencyCode#3581402, measurements#3581406, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, logisticUnits#3581392, optimizationGroups#3581408, externalProductId#3581390, externalPlantId#3581391, supplyingPlant#3581372, productGroup#3581373]
Arguments: [worklistShardItemId#3581388L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3580961L]
Right keys [1]: [worklistShardItemId#3581388L]
Join type: LeftOuter
Join condition: (shardId#3579691 = 0_1_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382]
Input [40]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, worklistShardItemId#3581388L, orderProposalId#3581365L, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, originalReplenishmentRunId#3581407L, splitIndicator#3581384L, previousOrderProposal#3581385L, sourceOfSupplyUuid#3581379, supplierGroup#3581367, supplier#3581368, subrange#3581371, product#3581374, plant#3581369, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, isFallbackOrderOnly#3581382, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, netPriceAmount#3581401, netPriceCurrencyCode#3581402, measurements#3581406, minimumOrderQuantity#3581395, constraintLabels#3581396, constraintOperators#3581397, constraintValues#3581398, logisticUnits#3581392, optimizationGroups#3581408, externalProductId#3581390, externalPlantId#3581391, supplyingPlant#3581372, productGroup#3581373]
(24) Exchange
Input [39]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382]
Arguments: hashpartitioning(shardId#3579691, worklistShardItemId#3580961L, 30), ENSURE_REQUIREMENTS, [plan_id=1028726]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382]
Arguments: [shardId#3579691 ASC NULLS FIRST, worklistShardItemId#3580961L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3587016, worklistShardItemId#3587017L, qty#3587018, demandChannel#3587019, demandStream#3587020, kpis#3587021]
Arguments: [shardId#3587016, worklistShardItemId#3587017L, qty#3587018, demandChannel#3587019, demandStream#3587020, kpis#3587021], MapPartitionsRDD[152909] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3587016, worklistShardItemId#3587017L, qty#3587018, demandChannel#3587019, demandStream#3587020, kpis#3587021]
Condition : (((isnull(qty#3587018) AND isnull(demandChannel#3587019)) AND isnull(demandStream#3587020)) AND (isnotnull(shardId#3587016) AND isnotnull(worklistShardItemId#3587017L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3587016, worklistShardItemId#3587017L, coalesce(kpis#3587021, []) AS prodLocSpecificKpis#3587022]
Input [6]: [shardId#3587016, worklistShardItemId#3587017L, qty#3587018, demandChannel#3587019, demandStream#3587020, kpis#3587021]
(29) Exchange
Input [3]: [shardId#3587016, worklistShardItemId#3587017L, prodLocSpecificKpis#3587022]
Arguments: hashpartitioning(shardId#3587016, worklistShardItemId#3587017L, 30), ENSURE_REQUIREMENTS, [plan_id=1028732]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3587016, worklistShardItemId#3587017L, prodLocSpecificKpis#3587022]
Arguments: [shardId#3587016 ASC NULLS FIRST, worklistShardItemId#3587017L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3579691, worklistShardItemId#3580961L]
Right keys [2]: [shardId#3587016, worklistShardItemId#3587017L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, coalesce(prodLocSpecificKpis#3587022, []) AS prodLocSpecificKpis#3587023]
Input [42]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, shardId#3587016, worklistShardItemId#3587017L, prodLocSpecificKpis#3587022]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3587032, worklistShardItemId#3587033L, qty#3587034, demandChannel#3587035, demandStream#3587036, kpis#3587037]
Arguments: [shardId#3587032, worklistShardItemId#3587033L, qty#3587034, demandChannel#3587035, demandStream#3587036, kpis#3587037], MapPartitionsRDD[152909] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3587032, worklistShardItemId#3587033L, qty#3587034, demandChannel#3587035, demandStream#3587036, kpis#3587037]
Condition : ((((isnull(qty#3587034) AND isnotnull(demandChannel#3587035)) AND isnotnull(demandStream#3587036)) AND (size(kpis#3587037, true) > 0)) AND (isnotnull(shardId#3587032) AND isnotnull(worklistShardItemId#3587033L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3587032, worklistShardItemId#3587033L, demandChannel#3587035, demandStream#3587036, kpis#3587037]
Input [6]: [shardId#3587032, worklistShardItemId#3587033L, qty#3587034, demandChannel#3587035, demandStream#3587036, kpis#3587037]
(36) ObjectHashAggregate
Input [5]: [shardId#3587032, worklistShardItemId#3587033L, demandChannel#3587035, demandStream#3587036, kpis#3587037]
Keys [2]: [shardId#3587032, worklistShardItemId#3587033L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3587035, demandStream, demandStream#3587036, kpis, kpis#3587037), 0, 0)]
Aggregate Attributes [1]: [buf#3587284]
Results [3]: [shardId#3587032, worklistShardItemId#3587033L, buf#3587285]
(37) Exchange
Input [3]: [shardId#3587032, worklistShardItemId#3587033L, buf#3587285]
Arguments: hashpartitioning(shardId#3587032, worklistShardItemId#3587033L, 30), ENSURE_REQUIREMENTS, [plan_id=1028743]
(38) ObjectHashAggregate
Input [3]: [shardId#3587032, worklistShardItemId#3587033L, buf#3587285]
Keys [2]: [shardId#3587032, worklistShardItemId#3587033L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3587035, demandStream, demandStream#3587036, kpis, kpis#3587037), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3587035, demandStream, demandStream#3587036, kpis, kpis#3587037), 0, 0)#3587031]
Results [3]: [shardId#3587032, worklistShardItemId#3587033L, collect_list(struct(demandChannel, demandChannel#3587035, demandStream, demandStream#3587036, kpis, kpis#3587037), 0, 0)#3587031 AS channelStreamSpecificKpis#3587024]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3587032, worklistShardItemId#3587033L, channelStreamSpecificKpis#3587024]
Arguments: [shardId#3587032 ASC NULLS FIRST, worklistShardItemId#3587033L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3579691, worklistShardItemId#3580961L]
Right keys [2]: [shardId#3587032, worklistShardItemId#3587033L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, prodLocSpecificKpis#3587023, coalesce(channelStreamSpecificKpis#3587024, []) AS channelStreamSpecificKpis#3587038]
Input [43]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, prodLocSpecificKpis#3587023, shardId#3587032, worklistShardItemId#3587033L, channelStreamSpecificKpis#3587024]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, demandChannel#3587048, demandStream#3587049, kpis#3587050]
Arguments: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, demandChannel#3587048, demandStream#3587049, kpis#3587050], MapPartitionsRDD[152909] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, demandChannel#3587048, demandStream#3587049, kpis#3587050]
Condition : ((isnotnull(qty#3587047) AND isnotnull(kpis#3587050)) AND (isnotnull(shardId#3587045) AND isnotnull(worklistShardItemId#3587046L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, kpis#3587050]
Input [6]: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, demandChannel#3587048, demandStream#3587049, kpis#3587050]
(45) ObjectHashAggregate
Input [4]: [shardId#3587045, worklistShardItemId#3587046L, qty#3587047, kpis#3587050]
Keys [2]: [shardId#3587045, worklistShardItemId#3587046L]
Functions [1]: [partial_collect_list(struct(qty, qty#3587047, kpis, kpis#3587050), 0, 0)]
Aggregate Attributes [1]: [buf#3587286]
Results [3]: [shardId#3587045, worklistShardItemId#3587046L, buf#3587287]
(46) Exchange
Input [3]: [shardId#3587045, worklistShardItemId#3587046L, buf#3587287]
Arguments: hashpartitioning(shardId#3587045, worklistShardItemId#3587046L, 30), ENSURE_REQUIREMENTS, [plan_id=1028755]
(47) ObjectHashAggregate
Input [3]: [shardId#3587045, worklistShardItemId#3587046L, buf#3587287]
Keys [2]: [shardId#3587045, worklistShardItemId#3587046L]
Functions [1]: [collect_list(struct(qty, qty#3587047, kpis, kpis#3587050), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3587047, kpis, kpis#3587050), 0, 0)#3587044]
Results [3]: [shardId#3587045, worklistShardItemId#3587046L, map_from_entries(collect_list(struct(qty, qty#3587047, kpis, kpis#3587050), 0, 0)#3587044) AS quantityKpis#3587039]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3587045, worklistShardItemId#3587046L, quantityKpis#3587039]
Arguments: [shardId#3587045 ASC NULLS FIRST, worklistShardItemId#3587046L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3579691, worklistShardItemId#3580961L]
Right keys [2]: [shardId#3587045, worklistShardItemId#3587046L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, prodLocSpecificKpis#3587023, channelStreamSpecificKpis#3587038, coalesce(quantityKpis#3587039, map(keys: [], values: [])) AS quantityKpis#3587051]
Input [44]: [shardId#3579691, worklistShardItemId#3580961L, quantityAfterProdPlantOptimization#3580962, qty#3580963, orderProposalId#3581365L, originalReplenishmentRunId#3581407L, supplierGroup#3581367, supplier#3581368, supplyingPlant#3581372, productGroup#3581373, product#3581374, plant#3581369, subrange#3581371, orderDateTime#3581375, deliveryDateTime#3581370, availabilityDateTime#3581376, nextAvailabilityDateTime#3581377, constraintValues#3581398, constraintOperators#3581397, constraintLabels#3581396, logisticUnits#3581392, orderQuantityBaseUom#3581393, orderQuantityBaseUomUuid#3581394, splitIndicator#3581384L, netPriceAmount#3581401, netPriceCurrencyCode#3581402, netPriceQuantity#3581403, netPriceQuantityUom#3581404, netPriceQuantityUomUuid#3581405, sourceOfSupplyUuid#3581379, minimumOrderQuantity#3581395, orderProposalItemId#3581366, orderProposalItemGroupId#3581389, optimizationGroups#3581408, measurements#3581406, externalProductId#3581390, externalPlantId#3581391, previousOrderProposal#3581385L, isFallbackOrderOnly#3581382, prodLocSpecificKpis#3587023, channelStreamSpecificKpis#3587038, shardId#3587045, worklistShardItemId#3587046L, quantityKpis#3587039]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051, shardId#3579691]
Condition : ((isnotnull(shardId#3579691) AND (shardId#3579691 = 0_1_10000000532)) AND (size(quantityKpis#3587051, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051]
Input [4]: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051, shardId#3579691]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3581277L, orderProposalItemId#3581278, quantityKpis#3587051]
Arguments: explode(quantityKpis#3587051), [orderProposalId#3581277L, orderProposalItemId#3581278], false, [orderQuantityInBaseUnit#3596707, kpis#3596708]
(54) Project
Output [8]: [orderProposalId#3581277L, cast(orderProposalItemId#3581278 as bigint) AS orderProposalItemId#3596706L, orderQuantityInBaseUnit#3596707, filter(kpis#3596708, lambdafunction((lambda x_12018#3596710.label = ServiceLevel), lambda x_12018#3596710, false))[0].value AS serviceLevel#3596709, filter(kpis#3596708, lambdafunction((lambda x_12019#3596712.label = RangeOfCoverage), lambda x_12019#3596712, false))[0].value AS rangeOfCoverage#3596711, filter(kpis#3596708, lambdafunction((lambda x_12020#3596714.label = ServiceLevelAtStartOfDelisting), lambda x_12020#3596714, false))[0].value AS serviceLevelAtEndOfListing#3596713, filter(kpis#3596708, lambdafunction((lambda x_12021#3596716.label = ServiceLevelMinimumStock), lambda x_12021#3596716, false))[0].value AS serviceLevelMinStock#3596715, 10000000532 AS replenishmentRunId#3596718L]
Input [4]: [orderProposalId#3581277L, orderProposalItemId#3581278, orderQuantityInBaseUnit#3596707, kpis#3596708]
(55) WriteFiles
Input [8]: [orderProposalId#3581277L, orderProposalItemId#3596706L, orderQuantityInBaseUnit#3596707, serviceLevel#3596709, rangeOfCoverage#3596711, serviceLevelAtEndOfListing#3596713, serviceLevelMinStock#3596715, replenishmentRunId#3596718L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_1_10000000532/sequenceId=7, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_1_10000000532/sequenceId=7], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]