== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898, shardId#3461394]
Arguments: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898, shardId#3461394], [isnotnull(shardId#3461394), (shardId#3461394 = 0_5_10000000532), (size(quantityKpis#3462898, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462064L, originalReplenishmentRunId#3462067L, supplierGroup#3462074, supplier#3462075, supplyingPlant#3462105, productGroup#3462106, product#3462077, plant#3462078, subrange#3462076, orderDateTime#3462082, deliveryDateTime#3462083, availabilityDateTime#3462084, nextAvailabilityDateTime#3462085, constraintValues#3462099, constraintOperators#3462097, constraintLabels#3462096, logisticUnits#3462101, orderQuantityBaseUom#3462087, orderQuantityBaseUomUuid#3462088, splitIndicator#3462069L, netPriceAmount#3462092, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3461394, items#3461396]
Arguments: [shardId#3461394, items#3461396], [(size(items#3461396, true) > 0), isnotnull(items#3461396)]
(4) InMemoryRelation
Arguments: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, optimizationInsights#3461400], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, optimizationInsights#3461400]
Arguments: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, optimizationInsights#3461400], [isnotnull(shardId#3461394), (shardId#3461394 = 0_5_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, lastModified#3461399, optimizationInsights#3461400], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, lastModified#3461399, optimizationInsights#3461400]
Arguments: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, lastModified#3461399, optimizationInsights#3461400], MapPartitionsRDD[147226] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, lastModified#3461399, optimizationInsights#3461400]
Condition : (isnotnull(shardId#3461394) AND (shardId#3461394 = 0_5_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3461394, orderProposalId#3461395L, items#3461396, optimizationGroups#3461397, isOptimal#3461398, optimizationInsights#3461400]
Condition : (isnotnull(shardId#3461394) AND (shardId#3461394 = 0_5_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3461394, items#3461396]
Condition : ((size(items#3461396, true) > 0) AND isnotnull(items#3461396))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3461394, items#3461396]
Arguments: explode(items#3461396), [shardId#3461394], false, [item#3461905]
(12) Project [codegen id : 1]
Output [4]: [shardId#3461394, item#3461905.worklistShardItemId AS worklistShardItemId#3461906L, item#3461905.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3461907, item#3461905.qty AS qty#3461908]
Input [2]: [shardId#3461394, item#3461905]
(13) Exchange
Input [4]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908]
Arguments: hashpartitioning(worklistShardItemId#3461906L, 30), ENSURE_REQUIREMENTS, [plan_id=995018]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908]
Arguments: [worklistShardItemId#3461906L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150, shardId#3462151, sequenceId#3462129]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3462151), isnotnull(sequenceId#3462129), (shardId#3462151 = 0_5_10000000532), (sequenceId#3462129 = 4)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150, shardId#3462151, sequenceId#3462129]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150, shardId#3462151, sequenceId#3462129]
Condition : isnotnull(worklistShardItemId#3462130L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150]
Input [38]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150, shardId#3462151, sequenceId#3462129]
(19) Exchange
Input [36]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150]
Arguments: hashpartitioning(worklistShardItemId#3462130L, 30), REPARTITION_BY_NUM, [plan_id=995028]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3462130L, orderProposalId#3462107L, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, originalReplenishmentRunId#3462149L, splitIndicator#3462126L, previousOrderProposal#3462127L, sourceOfSupplyUuid#3462121, supplierGroup#3462109, supplier#3462110, subrange#3462113, product#3462116, plant#3462111, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, isFallbackOrderOnly#3462124, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, netPriceAmount#3462143, netPriceCurrencyCode#3462144, measurements#3462148, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, logisticUnits#3462134, optimizationGroups#3462150, externalProductId#3462132, externalPlantId#3462133, supplyingPlant#3462114, productGroup#3462115]
Input [36]: [orderProposalId#3462107L, orderProposalItemId#3462108, supplierGroup#3462109, supplier#3462110, plant#3462111, deliveryDateTime#3462112, subrange#3462113, supplyingPlant#3462114, productGroup#3462115, product#3462116, orderDateTime#3462117, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, sourceOfSupplyUuid#3462121, isFallbackOrderOnly#3462124, splitIndicator#3462126L, previousOrderProposal#3462127L, worklistShardItemId#3462130L, orderProposalItemGroupId#3462131, externalProductId#3462132, externalPlantId#3462133, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, measurements#3462148, originalReplenishmentRunId#3462149L, optimizationGroups#3462150]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3462130L, orderProposalId#3462107L, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, originalReplenishmentRunId#3462149L, splitIndicator#3462126L, previousOrderProposal#3462127L, sourceOfSupplyUuid#3462121, supplierGroup#3462109, supplier#3462110, subrange#3462113, product#3462116, plant#3462111, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, isFallbackOrderOnly#3462124, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, netPriceAmount#3462143, netPriceCurrencyCode#3462144, measurements#3462148, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, logisticUnits#3462134, optimizationGroups#3462150, externalProductId#3462132, externalPlantId#3462133, supplyingPlant#3462114, productGroup#3462115]
Arguments: [worklistShardItemId#3462130L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3461906L]
Right keys [1]: [worklistShardItemId#3462130L]
Join type: LeftOuter
Join condition: (shardId#3461394 = 0_5_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124]
Input [40]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, worklistShardItemId#3462130L, orderProposalId#3462107L, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, originalReplenishmentRunId#3462149L, splitIndicator#3462126L, previousOrderProposal#3462127L, sourceOfSupplyUuid#3462121, supplierGroup#3462109, supplier#3462110, subrange#3462113, product#3462116, plant#3462111, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, isFallbackOrderOnly#3462124, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, netPriceAmount#3462143, netPriceCurrencyCode#3462144, measurements#3462148, minimumOrderQuantity#3462137, constraintLabels#3462138, constraintOperators#3462139, constraintValues#3462140, logisticUnits#3462134, optimizationGroups#3462150, externalProductId#3462132, externalPlantId#3462133, supplyingPlant#3462114, productGroup#3462115]
(24) Exchange
Input [39]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124]
Arguments: hashpartitioning(shardId#3461394, worklistShardItemId#3461906L, 30), ENSURE_REQUIREMENTS, [plan_id=995037]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124]
Arguments: [shardId#3461394 ASC NULLS FIRST, worklistShardItemId#3461906L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3462863, worklistShardItemId#3462864L, qty#3462865, demandChannel#3462866, demandStream#3462867, kpis#3462868]
Arguments: [shardId#3462863, worklistShardItemId#3462864L, qty#3462865, demandChannel#3462866, demandStream#3462867, kpis#3462868], MapPartitionsRDD[147310] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3462863, worklistShardItemId#3462864L, qty#3462865, demandChannel#3462866, demandStream#3462867, kpis#3462868]
Condition : (((isnull(qty#3462865) AND isnull(demandChannel#3462866)) AND isnull(demandStream#3462867)) AND (isnotnull(shardId#3462863) AND isnotnull(worklistShardItemId#3462864L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3462863, worklistShardItemId#3462864L, coalesce(kpis#3462868, []) AS prodLocSpecificKpis#3462869]
Input [6]: [shardId#3462863, worklistShardItemId#3462864L, qty#3462865, demandChannel#3462866, demandStream#3462867, kpis#3462868]
(29) Exchange
Input [3]: [shardId#3462863, worklistShardItemId#3462864L, prodLocSpecificKpis#3462869]
Arguments: hashpartitioning(shardId#3462863, worklistShardItemId#3462864L, 30), ENSURE_REQUIREMENTS, [plan_id=995043]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3462863, worklistShardItemId#3462864L, prodLocSpecificKpis#3462869]
Arguments: [shardId#3462863 ASC NULLS FIRST, worklistShardItemId#3462864L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3461394, worklistShardItemId#3461906L]
Right keys [2]: [shardId#3462863, worklistShardItemId#3462864L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, coalesce(prodLocSpecificKpis#3462869, []) AS prodLocSpecificKpis#3462870]
Input [42]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, shardId#3462863, worklistShardItemId#3462864L, prodLocSpecificKpis#3462869]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3462879, worklistShardItemId#3462880L, qty#3462881, demandChannel#3462882, demandStream#3462883, kpis#3462884]
Arguments: [shardId#3462879, worklistShardItemId#3462880L, qty#3462881, demandChannel#3462882, demandStream#3462883, kpis#3462884], MapPartitionsRDD[147310] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3462879, worklistShardItemId#3462880L, qty#3462881, demandChannel#3462882, demandStream#3462883, kpis#3462884]
Condition : ((((isnull(qty#3462881) AND isnotnull(demandChannel#3462882)) AND isnotnull(demandStream#3462883)) AND (size(kpis#3462884, true) > 0)) AND (isnotnull(shardId#3462879) AND isnotnull(worklistShardItemId#3462880L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3462879, worklistShardItemId#3462880L, demandChannel#3462882, demandStream#3462883, kpis#3462884]
Input [6]: [shardId#3462879, worklistShardItemId#3462880L, qty#3462881, demandChannel#3462882, demandStream#3462883, kpis#3462884]
(36) ObjectHashAggregate
Input [5]: [shardId#3462879, worklistShardItemId#3462880L, demandChannel#3462882, demandStream#3462883, kpis#3462884]
Keys [2]: [shardId#3462879, worklistShardItemId#3462880L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3462882, demandStream, demandStream#3462883, kpis, kpis#3462884), 0, 0)]
Aggregate Attributes [1]: [buf#3463059]
Results [3]: [shardId#3462879, worklistShardItemId#3462880L, buf#3463060]
(37) Exchange
Input [3]: [shardId#3462879, worklistShardItemId#3462880L, buf#3463060]
Arguments: hashpartitioning(shardId#3462879, worklistShardItemId#3462880L, 30), ENSURE_REQUIREMENTS, [plan_id=995054]
(38) ObjectHashAggregate
Input [3]: [shardId#3462879, worklistShardItemId#3462880L, buf#3463060]
Keys [2]: [shardId#3462879, worklistShardItemId#3462880L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3462882, demandStream, demandStream#3462883, kpis, kpis#3462884), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3462882, demandStream, demandStream#3462883, kpis, kpis#3462884), 0, 0)#3462878]
Results [3]: [shardId#3462879, worklistShardItemId#3462880L, collect_list(struct(demandChannel, demandChannel#3462882, demandStream, demandStream#3462883, kpis, kpis#3462884), 0, 0)#3462878 AS channelStreamSpecificKpis#3462871]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3462879, worklistShardItemId#3462880L, channelStreamSpecificKpis#3462871]
Arguments: [shardId#3462879 ASC NULLS FIRST, worklistShardItemId#3462880L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3461394, worklistShardItemId#3461906L]
Right keys [2]: [shardId#3462879, worklistShardItemId#3462880L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, prodLocSpecificKpis#3462870, coalesce(channelStreamSpecificKpis#3462871, []) AS channelStreamSpecificKpis#3462885]
Input [43]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, prodLocSpecificKpis#3462870, shardId#3462879, worklistShardItemId#3462880L, channelStreamSpecificKpis#3462871]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, demandChannel#3462895, demandStream#3462896, kpis#3462897]
Arguments: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, demandChannel#3462895, demandStream#3462896, kpis#3462897], MapPartitionsRDD[147310] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, demandChannel#3462895, demandStream#3462896, kpis#3462897]
Condition : ((isnotnull(qty#3462894) AND isnotnull(kpis#3462897)) AND (isnotnull(shardId#3462892) AND isnotnull(worklistShardItemId#3462893L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, kpis#3462897]
Input [6]: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, demandChannel#3462895, demandStream#3462896, kpis#3462897]
(45) ObjectHashAggregate
Input [4]: [shardId#3462892, worklistShardItemId#3462893L, qty#3462894, kpis#3462897]
Keys [2]: [shardId#3462892, worklistShardItemId#3462893L]
Functions [1]: [partial_collect_list(struct(qty, qty#3462894, kpis, kpis#3462897), 0, 0)]
Aggregate Attributes [1]: [buf#3463061]
Results [3]: [shardId#3462892, worklistShardItemId#3462893L, buf#3463062]
(46) Exchange
Input [3]: [shardId#3462892, worklistShardItemId#3462893L, buf#3463062]
Arguments: hashpartitioning(shardId#3462892, worklistShardItemId#3462893L, 30), ENSURE_REQUIREMENTS, [plan_id=995066]
(47) ObjectHashAggregate
Input [3]: [shardId#3462892, worklistShardItemId#3462893L, buf#3463062]
Keys [2]: [shardId#3462892, worklistShardItemId#3462893L]
Functions [1]: [collect_list(struct(qty, qty#3462894, kpis, kpis#3462897), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3462894, kpis, kpis#3462897), 0, 0)#3462891]
Results [3]: [shardId#3462892, worklistShardItemId#3462893L, map_from_entries(collect_list(struct(qty, qty#3462894, kpis, kpis#3462897), 0, 0)#3462891) AS quantityKpis#3462886]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3462892, worklistShardItemId#3462893L, quantityKpis#3462886]
Arguments: [shardId#3462892 ASC NULLS FIRST, worklistShardItemId#3462893L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3461394, worklistShardItemId#3461906L]
Right keys [2]: [shardId#3462892, worklistShardItemId#3462893L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, prodLocSpecificKpis#3462870, channelStreamSpecificKpis#3462885, coalesce(quantityKpis#3462886, map(keys: [], values: [])) AS quantityKpis#3462898]
Input [44]: [shardId#3461394, worklistShardItemId#3461906L, quantityAfterProdPlantOptimization#3461907, qty#3461908, orderProposalId#3462107L, originalReplenishmentRunId#3462149L, supplierGroup#3462109, supplier#3462110, supplyingPlant#3462114, productGroup#3462115, product#3462116, plant#3462111, subrange#3462113, orderDateTime#3462117, deliveryDateTime#3462112, availabilityDateTime#3462118, nextAvailabilityDateTime#3462119, constraintValues#3462140, constraintOperators#3462139, constraintLabels#3462138, logisticUnits#3462134, orderQuantityBaseUom#3462135, orderQuantityBaseUomUuid#3462136, splitIndicator#3462126L, netPriceAmount#3462143, netPriceCurrencyCode#3462144, netPriceQuantity#3462145, netPriceQuantityUom#3462146, netPriceQuantityUomUuid#3462147, sourceOfSupplyUuid#3462121, minimumOrderQuantity#3462137, orderProposalItemId#3462108, orderProposalItemGroupId#3462131, optimizationGroups#3462150, measurements#3462148, externalProductId#3462132, externalPlantId#3462133, previousOrderProposal#3462127L, isFallbackOrderOnly#3462124, prodLocSpecificKpis#3462870, channelStreamSpecificKpis#3462885, shardId#3462892, worklistShardItemId#3462893L, quantityKpis#3462886]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898, shardId#3461394]
Condition : ((isnotnull(shardId#3461394) AND (shardId#3461394 = 0_5_10000000532)) AND (size(quantityKpis#3462898, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898]
Input [4]: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898, shardId#3461394]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3462064L, orderProposalItemId#3462065, quantityKpis#3462898]
Arguments: explode(quantityKpis#3462898), [orderProposalId#3462064L, orderProposalItemId#3462065], false, [orderQuantityInBaseUnit#3466507, kpis#3466508]
(54) Project
Output [8]: [orderProposalId#3462064L, cast(orderProposalItemId#3462065 as bigint) AS orderProposalItemId#3466506L, orderQuantityInBaseUnit#3466507, filter(kpis#3466508, lambdafunction((lambda x_11534#3466510.label = ServiceLevel), lambda x_11534#3466510, false))[0].value AS serviceLevel#3466509, filter(kpis#3466508, lambdafunction((lambda x_11535#3466512.label = RangeOfCoverage), lambda x_11535#3466512, false))[0].value AS rangeOfCoverage#3466511, filter(kpis#3466508, lambdafunction((lambda x_11536#3466514.label = ServiceLevelAtStartOfDelisting), lambda x_11536#3466514, false))[0].value AS serviceLevelAtEndOfListing#3466513, filter(kpis#3466508, lambdafunction((lambda x_11537#3466516.label = ServiceLevelMinimumStock), lambda x_11537#3466516, false))[0].value AS serviceLevelMinStock#3466515, 10000000532 AS replenishmentRunId#3466518L]
Input [4]: [orderProposalId#3462064L, orderProposalItemId#3462065, orderQuantityInBaseUnit#3466507, kpis#3466508]
(55) WriteFiles
Input [8]: [orderProposalId#3462064L, orderProposalItemId#3466506L, orderQuantityInBaseUnit#3466507, serviceLevel#3466509, rangeOfCoverage#3466511, serviceLevelAtEndOfListing#3466513, serviceLevelMinStock#3466515, replenishmentRunId#3466518L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=4, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=4], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]