== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795, shardId#3440291]
Arguments: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795, shardId#3440291], [isnotnull(shardId#3440291), (shardId#3440291 = 0_5_10000000532), (size(quantityKpis#3441795, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3440961L, originalReplenishmentRunId#3440964L, supplierGroup#3440971, supplier#3440972, supplyingPlant#3441002, productGroup#3441003, product#3440974, plant#3440975, subrange#3440973, orderDateTime#3440979, deliveryDateTime#3440980, availabilityDateTime#3440981, nextAvailabilityDateTime#3440982, constraintValues#3440996, constraintOperators#3440994, constraintLabels#3440993, logisticUnits#3440998, orderQuantityBaseUom#3440984, orderQuantityBaseUomUuid#3440985, splitIndicator#3440966L, netPriceAmount#3440989, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3440291, items#3440293]
Arguments: [shardId#3440291, items#3440293], [(size(items#3440293, true) > 0), isnotnull(items#3440293)]
(4) InMemoryRelation
Arguments: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, optimizationInsights#3440297], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, optimizationInsights#3440297]
Arguments: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, optimizationInsights#3440297], [isnotnull(shardId#3440291), (shardId#3440291 = 0_5_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, lastModified#3440296, optimizationInsights#3440297], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, lastModified#3440296, optimizationInsights#3440297]
Arguments: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, lastModified#3440296, optimizationInsights#3440297], MapPartitionsRDD[146361] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, lastModified#3440296, optimizationInsights#3440297]
Condition : (isnotnull(shardId#3440291) AND (shardId#3440291 = 0_5_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3440291, orderProposalId#3440292L, items#3440293, optimizationGroups#3440294, isOptimal#3440295, optimizationInsights#3440297]
Condition : (isnotnull(shardId#3440291) AND (shardId#3440291 = 0_5_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3440291, items#3440293]
Condition : ((size(items#3440293, true) > 0) AND isnotnull(items#3440293))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3440291, items#3440293]
Arguments: explode(items#3440293), [shardId#3440291], false, [item#3440802]
(12) Project [codegen id : 1]
Output [4]: [shardId#3440291, item#3440802.worklistShardItemId AS worklistShardItemId#3440803L, item#3440802.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3440804, item#3440802.qty AS qty#3440805]
Input [2]: [shardId#3440291, item#3440802]
(13) Exchange
Input [4]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805]
Arguments: hashpartitioning(worklistShardItemId#3440803L, 30), ENSURE_REQUIREMENTS, [plan_id=989832]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805]
Arguments: [worklistShardItemId#3440803L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047, shardId#3441048, sequenceId#3441026]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3441048), isnotnull(sequenceId#3441026), (shardId#3441048 = 0_5_10000000532), (sequenceId#3441026 = 3)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047, shardId#3441048, sequenceId#3441026]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047, shardId#3441048, sequenceId#3441026]
Condition : isnotnull(worklistShardItemId#3441027L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047]
Input [38]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047, shardId#3441048, sequenceId#3441026]
(19) Exchange
Input [36]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047]
Arguments: hashpartitioning(worklistShardItemId#3441027L, 30), REPARTITION_BY_NUM, [plan_id=989842]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3441027L, orderProposalId#3441004L, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, originalReplenishmentRunId#3441046L, splitIndicator#3441023L, previousOrderProposal#3441024L, sourceOfSupplyUuid#3441018, supplierGroup#3441006, supplier#3441007, subrange#3441010, product#3441013, plant#3441008, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, isFallbackOrderOnly#3441021, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, netPriceAmount#3441040, netPriceCurrencyCode#3441041, measurements#3441045, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, logisticUnits#3441031, optimizationGroups#3441047, externalProductId#3441029, externalPlantId#3441030, supplyingPlant#3441011, productGroup#3441012]
Input [36]: [orderProposalId#3441004L, orderProposalItemId#3441005, supplierGroup#3441006, supplier#3441007, plant#3441008, deliveryDateTime#3441009, subrange#3441010, supplyingPlant#3441011, productGroup#3441012, product#3441013, orderDateTime#3441014, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, sourceOfSupplyUuid#3441018, isFallbackOrderOnly#3441021, splitIndicator#3441023L, previousOrderProposal#3441024L, worklistShardItemId#3441027L, orderProposalItemGroupId#3441028, externalProductId#3441029, externalPlantId#3441030, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, measurements#3441045, originalReplenishmentRunId#3441046L, optimizationGroups#3441047]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3441027L, orderProposalId#3441004L, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, originalReplenishmentRunId#3441046L, splitIndicator#3441023L, previousOrderProposal#3441024L, sourceOfSupplyUuid#3441018, supplierGroup#3441006, supplier#3441007, subrange#3441010, product#3441013, plant#3441008, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, isFallbackOrderOnly#3441021, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, netPriceAmount#3441040, netPriceCurrencyCode#3441041, measurements#3441045, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, logisticUnits#3441031, optimizationGroups#3441047, externalProductId#3441029, externalPlantId#3441030, supplyingPlant#3441011, productGroup#3441012]
Arguments: [worklistShardItemId#3441027L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3440803L]
Right keys [1]: [worklistShardItemId#3441027L]
Join type: LeftOuter
Join condition: (shardId#3440291 = 0_5_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021]
Input [40]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, worklistShardItemId#3441027L, orderProposalId#3441004L, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, originalReplenishmentRunId#3441046L, splitIndicator#3441023L, previousOrderProposal#3441024L, sourceOfSupplyUuid#3441018, supplierGroup#3441006, supplier#3441007, subrange#3441010, product#3441013, plant#3441008, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, isFallbackOrderOnly#3441021, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, netPriceAmount#3441040, netPriceCurrencyCode#3441041, measurements#3441045, minimumOrderQuantity#3441034, constraintLabels#3441035, constraintOperators#3441036, constraintValues#3441037, logisticUnits#3441031, optimizationGroups#3441047, externalProductId#3441029, externalPlantId#3441030, supplyingPlant#3441011, productGroup#3441012]
(24) Exchange
Input [39]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021]
Arguments: hashpartitioning(shardId#3440291, worklistShardItemId#3440803L, 30), ENSURE_REQUIREMENTS, [plan_id=989851]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021]
Arguments: [shardId#3440291 ASC NULLS FIRST, worklistShardItemId#3440803L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3441760, worklistShardItemId#3441761L, qty#3441762, demandChannel#3441763, demandStream#3441764, kpis#3441765]
Arguments: [shardId#3441760, worklistShardItemId#3441761L, qty#3441762, demandChannel#3441763, demandStream#3441764, kpis#3441765], MapPartitionsRDD[146443] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3441760, worklistShardItemId#3441761L, qty#3441762, demandChannel#3441763, demandStream#3441764, kpis#3441765]
Condition : (((isnull(qty#3441762) AND isnull(demandChannel#3441763)) AND isnull(demandStream#3441764)) AND (isnotnull(shardId#3441760) AND isnotnull(worklistShardItemId#3441761L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3441760, worklistShardItemId#3441761L, coalesce(kpis#3441765, []) AS prodLocSpecificKpis#3441766]
Input [6]: [shardId#3441760, worklistShardItemId#3441761L, qty#3441762, demandChannel#3441763, demandStream#3441764, kpis#3441765]
(29) Exchange
Input [3]: [shardId#3441760, worklistShardItemId#3441761L, prodLocSpecificKpis#3441766]
Arguments: hashpartitioning(shardId#3441760, worklistShardItemId#3441761L, 30), ENSURE_REQUIREMENTS, [plan_id=989857]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3441760, worklistShardItemId#3441761L, prodLocSpecificKpis#3441766]
Arguments: [shardId#3441760 ASC NULLS FIRST, worklistShardItemId#3441761L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3440291, worklistShardItemId#3440803L]
Right keys [2]: [shardId#3441760, worklistShardItemId#3441761L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, coalesce(prodLocSpecificKpis#3441766, []) AS prodLocSpecificKpis#3441767]
Input [42]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, shardId#3441760, worklistShardItemId#3441761L, prodLocSpecificKpis#3441766]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3441776, worklistShardItemId#3441777L, qty#3441778, demandChannel#3441779, demandStream#3441780, kpis#3441781]
Arguments: [shardId#3441776, worklistShardItemId#3441777L, qty#3441778, demandChannel#3441779, demandStream#3441780, kpis#3441781], MapPartitionsRDD[146443] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3441776, worklistShardItemId#3441777L, qty#3441778, demandChannel#3441779, demandStream#3441780, kpis#3441781]
Condition : ((((isnull(qty#3441778) AND isnotnull(demandChannel#3441779)) AND isnotnull(demandStream#3441780)) AND (size(kpis#3441781, true) > 0)) AND (isnotnull(shardId#3441776) AND isnotnull(worklistShardItemId#3441777L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3441776, worklistShardItemId#3441777L, demandChannel#3441779, demandStream#3441780, kpis#3441781]
Input [6]: [shardId#3441776, worklistShardItemId#3441777L, qty#3441778, demandChannel#3441779, demandStream#3441780, kpis#3441781]
(36) ObjectHashAggregate
Input [5]: [shardId#3441776, worklistShardItemId#3441777L, demandChannel#3441779, demandStream#3441780, kpis#3441781]
Keys [2]: [shardId#3441776, worklistShardItemId#3441777L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3441779, demandStream, demandStream#3441780, kpis, kpis#3441781), 0, 0)]
Aggregate Attributes [1]: [buf#3441956]
Results [3]: [shardId#3441776, worklistShardItemId#3441777L, buf#3441957]
(37) Exchange
Input [3]: [shardId#3441776, worklistShardItemId#3441777L, buf#3441957]
Arguments: hashpartitioning(shardId#3441776, worklistShardItemId#3441777L, 30), ENSURE_REQUIREMENTS, [plan_id=989868]
(38) ObjectHashAggregate
Input [3]: [shardId#3441776, worklistShardItemId#3441777L, buf#3441957]
Keys [2]: [shardId#3441776, worklistShardItemId#3441777L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3441779, demandStream, demandStream#3441780, kpis, kpis#3441781), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3441779, demandStream, demandStream#3441780, kpis, kpis#3441781), 0, 0)#3441775]
Results [3]: [shardId#3441776, worklistShardItemId#3441777L, collect_list(struct(demandChannel, demandChannel#3441779, demandStream, demandStream#3441780, kpis, kpis#3441781), 0, 0)#3441775 AS channelStreamSpecificKpis#3441768]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3441776, worklistShardItemId#3441777L, channelStreamSpecificKpis#3441768]
Arguments: [shardId#3441776 ASC NULLS FIRST, worklistShardItemId#3441777L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3440291, worklistShardItemId#3440803L]
Right keys [2]: [shardId#3441776, worklistShardItemId#3441777L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, prodLocSpecificKpis#3441767, coalesce(channelStreamSpecificKpis#3441768, []) AS channelStreamSpecificKpis#3441782]
Input [43]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, prodLocSpecificKpis#3441767, shardId#3441776, worklistShardItemId#3441777L, channelStreamSpecificKpis#3441768]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, demandChannel#3441792, demandStream#3441793, kpis#3441794]
Arguments: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, demandChannel#3441792, demandStream#3441793, kpis#3441794], MapPartitionsRDD[146443] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, demandChannel#3441792, demandStream#3441793, kpis#3441794]
Condition : ((isnotnull(qty#3441791) AND isnotnull(kpis#3441794)) AND (isnotnull(shardId#3441789) AND isnotnull(worklistShardItemId#3441790L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, kpis#3441794]
Input [6]: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, demandChannel#3441792, demandStream#3441793, kpis#3441794]
(45) ObjectHashAggregate
Input [4]: [shardId#3441789, worklistShardItemId#3441790L, qty#3441791, kpis#3441794]
Keys [2]: [shardId#3441789, worklistShardItemId#3441790L]
Functions [1]: [partial_collect_list(struct(qty, qty#3441791, kpis, kpis#3441794), 0, 0)]
Aggregate Attributes [1]: [buf#3441958]
Results [3]: [shardId#3441789, worklistShardItemId#3441790L, buf#3441959]
(46) Exchange
Input [3]: [shardId#3441789, worklistShardItemId#3441790L, buf#3441959]
Arguments: hashpartitioning(shardId#3441789, worklistShardItemId#3441790L, 30), ENSURE_REQUIREMENTS, [plan_id=989880]
(47) ObjectHashAggregate
Input [3]: [shardId#3441789, worklistShardItemId#3441790L, buf#3441959]
Keys [2]: [shardId#3441789, worklistShardItemId#3441790L]
Functions [1]: [collect_list(struct(qty, qty#3441791, kpis, kpis#3441794), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3441791, kpis, kpis#3441794), 0, 0)#3441788]
Results [3]: [shardId#3441789, worklistShardItemId#3441790L, map_from_entries(collect_list(struct(qty, qty#3441791, kpis, kpis#3441794), 0, 0)#3441788) AS quantityKpis#3441783]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3441789, worklistShardItemId#3441790L, quantityKpis#3441783]
Arguments: [shardId#3441789 ASC NULLS FIRST, worklistShardItemId#3441790L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3440291, worklistShardItemId#3440803L]
Right keys [2]: [shardId#3441789, worklistShardItemId#3441790L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, prodLocSpecificKpis#3441767, channelStreamSpecificKpis#3441782, coalesce(quantityKpis#3441783, map(keys: [], values: [])) AS quantityKpis#3441795]
Input [44]: [shardId#3440291, worklistShardItemId#3440803L, quantityAfterProdPlantOptimization#3440804, qty#3440805, orderProposalId#3441004L, originalReplenishmentRunId#3441046L, supplierGroup#3441006, supplier#3441007, supplyingPlant#3441011, productGroup#3441012, product#3441013, plant#3441008, subrange#3441010, orderDateTime#3441014, deliveryDateTime#3441009, availabilityDateTime#3441015, nextAvailabilityDateTime#3441016, constraintValues#3441037, constraintOperators#3441036, constraintLabels#3441035, logisticUnits#3441031, orderQuantityBaseUom#3441032, orderQuantityBaseUomUuid#3441033, splitIndicator#3441023L, netPriceAmount#3441040, netPriceCurrencyCode#3441041, netPriceQuantity#3441042, netPriceQuantityUom#3441043, netPriceQuantityUomUuid#3441044, sourceOfSupplyUuid#3441018, minimumOrderQuantity#3441034, orderProposalItemId#3441005, orderProposalItemGroupId#3441028, optimizationGroups#3441047, measurements#3441045, externalProductId#3441029, externalPlantId#3441030, previousOrderProposal#3441024L, isFallbackOrderOnly#3441021, prodLocSpecificKpis#3441767, channelStreamSpecificKpis#3441782, shardId#3441789, worklistShardItemId#3441790L, quantityKpis#3441783]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795, shardId#3440291]
Condition : ((isnotnull(shardId#3440291) AND (shardId#3440291 = 0_5_10000000532)) AND (size(quantityKpis#3441795, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795]
Input [4]: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795, shardId#3440291]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3440961L, orderProposalItemId#3440962, quantityKpis#3441795]
Arguments: explode(quantityKpis#3441795), [orderProposalId#3440961L, orderProposalItemId#3440962], false, [orderQuantityInBaseUnit#3445404, kpis#3445405]
(54) Project
Output [8]: [orderProposalId#3440961L, cast(orderProposalItemId#3440962 as bigint) AS orderProposalItemId#3445403L, orderQuantityInBaseUnit#3445404, filter(kpis#3445405, lambdafunction((lambda x_11463#3445407.label = ServiceLevel), lambda x_11463#3445407, false))[0].value AS serviceLevel#3445406, filter(kpis#3445405, lambdafunction((lambda x_11464#3445409.label = RangeOfCoverage), lambda x_11464#3445409, false))[0].value AS rangeOfCoverage#3445408, filter(kpis#3445405, lambdafunction((lambda x_11465#3445411.label = ServiceLevelAtStartOfDelisting), lambda x_11465#3445411, false))[0].value AS serviceLevelAtEndOfListing#3445410, filter(kpis#3445405, lambdafunction((lambda x_11466#3445413.label = ServiceLevelMinimumStock), lambda x_11466#3445413, false))[0].value AS serviceLevelMinStock#3445412, 10000000532 AS replenishmentRunId#3445415L]
Input [4]: [orderProposalId#3440961L, orderProposalItemId#3440962, orderQuantityInBaseUnit#3445404, kpis#3445405]
(55) WriteFiles
Input [8]: [orderProposalId#3440961L, orderProposalItemId#3445403L, orderQuantityInBaseUnit#3445404, serviceLevel#3445406, rangeOfCoverage#3445408, serviceLevelAtEndOfListing#3445410, serviceLevelMinStock#3445412, replenishmentRunId#3445415L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=3, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=3], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]