== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260, shardId#3524906]
Arguments: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260, shardId#3524906], [isnotnull(shardId#3524906), (shardId#3524906 = 0_6_10000000532), (size(quantityKpis#3541260, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525576L, originalReplenishmentRunId#3525579L, supplierGroup#3525586, supplier#3525587, supplyingPlant#3525617, productGroup#3525618, product#3525589, plant#3525590, subrange#3525588, orderDateTime#3525594, deliveryDateTime#3525595, availabilityDateTime#3525596, nextAvailabilityDateTime#3525597, constraintValues#3525611, constraintOperators#3525609, constraintLabels#3525608, logisticUnits#3525613, orderQuantityBaseUom#3525599, orderQuantityBaseUomUuid#3525600, splitIndicator#3525581L, netPriceAmount#3525604, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3524906, items#3524908]
Arguments: [shardId#3524906, items#3524908], [(size(items#3524908, true) > 0), isnotnull(items#3524908)]
(4) InMemoryRelation
Arguments: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, optimizationInsights#3524912], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, optimizationInsights#3524912]
Arguments: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, optimizationInsights#3524912], [isnotnull(shardId#3524906), (shardId#3524906 = 0_6_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, lastModified#3524911, optimizationInsights#3524912], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, lastModified#3524911, optimizationInsights#3524912]
Arguments: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, lastModified#3524911, optimizationInsights#3524912], MapPartitionsRDD[149795] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, lastModified#3524911, optimizationInsights#3524912]
Condition : (isnotnull(shardId#3524906) AND (shardId#3524906 = 0_6_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3524906, orderProposalId#3524907L, items#3524908, optimizationGroups#3524909, isOptimal#3524910, optimizationInsights#3524912]
Condition : (isnotnull(shardId#3524906) AND (shardId#3524906 = 0_6_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3524906, items#3524908]
Condition : ((size(items#3524908, true) > 0) AND isnotnull(items#3524908))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3524906, items#3524908]
Arguments: explode(items#3524908), [shardId#3524906], false, [item#3525417]
(12) Project [codegen id : 1]
Output [4]: [shardId#3524906, item#3525417.worklistShardItemId AS worklistShardItemId#3525418L, item#3525417.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3525419, item#3525417.qty AS qty#3525420]
Input [2]: [shardId#3524906, item#3525417]
(13) Exchange
Input [4]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420]
Arguments: hashpartitioning(worklistShardItemId#3525418L, 30), ENSURE_REQUIREMENTS, [plan_id=1014869]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420]
Arguments: [worklistShardItemId#3525418L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662, shardId#3525663, sequenceId#3525641]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3525663), isnotnull(sequenceId#3525641), (shardId#3525663 = 0_6_10000000532), (sequenceId#3525641 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662, shardId#3525663, sequenceId#3525641]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662, shardId#3525663, sequenceId#3525641]
Condition : isnotnull(worklistShardItemId#3525642L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662]
Input [38]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662, shardId#3525663, sequenceId#3525641]
(19) Exchange
Input [36]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662]
Arguments: hashpartitioning(worklistShardItemId#3525642L, 30), REPARTITION_BY_NUM, [plan_id=1014879]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3525642L, orderProposalId#3525619L, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, originalReplenishmentRunId#3525661L, splitIndicator#3525638L, previousOrderProposal#3525639L, sourceOfSupplyUuid#3525633, supplierGroup#3525621, supplier#3525622, subrange#3525625, product#3525628, plant#3525623, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, isFallbackOrderOnly#3525636, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, netPriceAmount#3525655, netPriceCurrencyCode#3525656, measurements#3525660, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, logisticUnits#3525646, optimizationGroups#3525662, externalProductId#3525644, externalPlantId#3525645, supplyingPlant#3525626, productGroup#3525627]
Input [36]: [orderProposalId#3525619L, orderProposalItemId#3525620, supplierGroup#3525621, supplier#3525622, plant#3525623, deliveryDateTime#3525624, subrange#3525625, supplyingPlant#3525626, productGroup#3525627, product#3525628, orderDateTime#3525629, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, sourceOfSupplyUuid#3525633, isFallbackOrderOnly#3525636, splitIndicator#3525638L, previousOrderProposal#3525639L, worklistShardItemId#3525642L, orderProposalItemGroupId#3525643, externalProductId#3525644, externalPlantId#3525645, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, measurements#3525660, originalReplenishmentRunId#3525661L, optimizationGroups#3525662]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3525642L, orderProposalId#3525619L, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, originalReplenishmentRunId#3525661L, splitIndicator#3525638L, previousOrderProposal#3525639L, sourceOfSupplyUuid#3525633, supplierGroup#3525621, supplier#3525622, subrange#3525625, product#3525628, plant#3525623, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, isFallbackOrderOnly#3525636, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, netPriceAmount#3525655, netPriceCurrencyCode#3525656, measurements#3525660, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, logisticUnits#3525646, optimizationGroups#3525662, externalProductId#3525644, externalPlantId#3525645, supplyingPlant#3525626, productGroup#3525627]
Arguments: [worklistShardItemId#3525642L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3525418L]
Right keys [1]: [worklistShardItemId#3525642L]
Join type: LeftOuter
Join condition: (shardId#3524906 = 0_6_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636]
Input [40]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, worklistShardItemId#3525642L, orderProposalId#3525619L, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, originalReplenishmentRunId#3525661L, splitIndicator#3525638L, previousOrderProposal#3525639L, sourceOfSupplyUuid#3525633, supplierGroup#3525621, supplier#3525622, subrange#3525625, product#3525628, plant#3525623, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, isFallbackOrderOnly#3525636, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, netPriceAmount#3525655, netPriceCurrencyCode#3525656, measurements#3525660, minimumOrderQuantity#3525649, constraintLabels#3525650, constraintOperators#3525651, constraintValues#3525652, logisticUnits#3525646, optimizationGroups#3525662, externalProductId#3525644, externalPlantId#3525645, supplyingPlant#3525626, productGroup#3525627]
(24) Exchange
Input [39]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636]
Arguments: hashpartitioning(shardId#3524906, worklistShardItemId#3525418L, 30), ENSURE_REQUIREMENTS, [plan_id=1014888]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636]
Arguments: [shardId#3524906 ASC NULLS FIRST, worklistShardItemId#3525418L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3541196, worklistShardItemId#3541197L, qty#3541198, demandChannel#3541199, demandStream#3541200, kpis#3541201]
Arguments: [shardId#3541196, worklistShardItemId#3541197L, qty#3541198, demandChannel#3541199, demandStream#3541200, kpis#3541201], MapPartitionsRDD[150472] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3541196, worklistShardItemId#3541197L, qty#3541198, demandChannel#3541199, demandStream#3541200, kpis#3541201]
Condition : (((isnull(qty#3541198) AND isnull(demandChannel#3541199)) AND isnull(demandStream#3541200)) AND (isnotnull(shardId#3541196) AND isnotnull(worklistShardItemId#3541197L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3541196, worklistShardItemId#3541197L, coalesce(kpis#3541201, []) AS prodLocSpecificKpis#3541216]
Input [6]: [shardId#3541196, worklistShardItemId#3541197L, qty#3541198, demandChannel#3541199, demandStream#3541200, kpis#3541201]
(29) Exchange
Input [3]: [shardId#3541196, worklistShardItemId#3541197L, prodLocSpecificKpis#3541216]
Arguments: hashpartitioning(shardId#3541196, worklistShardItemId#3541197L, 30), ENSURE_REQUIREMENTS, [plan_id=1014894]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3541196, worklistShardItemId#3541197L, prodLocSpecificKpis#3541216]
Arguments: [shardId#3541196 ASC NULLS FIRST, worklistShardItemId#3541197L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3524906, worklistShardItemId#3525418L]
Right keys [2]: [shardId#3541196, worklistShardItemId#3541197L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, coalesce(prodLocSpecificKpis#3541216, []) AS prodLocSpecificKpis#3541225]
Input [42]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, shardId#3541196, worklistShardItemId#3541197L, prodLocSpecificKpis#3541216]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3541241, worklistShardItemId#3541242L, qty#3541243, demandChannel#3541244, demandStream#3541245, kpis#3541246]
Arguments: [shardId#3541241, worklistShardItemId#3541242L, qty#3541243, demandChannel#3541244, demandStream#3541245, kpis#3541246], MapPartitionsRDD[150472] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3541241, worklistShardItemId#3541242L, qty#3541243, demandChannel#3541244, demandStream#3541245, kpis#3541246]
Condition : ((((isnull(qty#3541243) AND isnotnull(demandChannel#3541244)) AND isnotnull(demandStream#3541245)) AND (size(kpis#3541246, true) > 0)) AND (isnotnull(shardId#3541241) AND isnotnull(worklistShardItemId#3541242L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3541241, worklistShardItemId#3541242L, demandChannel#3541244, demandStream#3541245, kpis#3541246]
Input [6]: [shardId#3541241, worklistShardItemId#3541242L, qty#3541243, demandChannel#3541244, demandStream#3541245, kpis#3541246]
(36) ObjectHashAggregate
Input [5]: [shardId#3541241, worklistShardItemId#3541242L, demandChannel#3541244, demandStream#3541245, kpis#3541246]
Keys [2]: [shardId#3541241, worklistShardItemId#3541242L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3541244, demandStream, demandStream#3541245, kpis, kpis#3541246), 0, 0)]
Aggregate Attributes [1]: [buf#3542075]
Results [3]: [shardId#3541241, worklistShardItemId#3541242L, buf#3542076]
(37) Exchange
Input [3]: [shardId#3541241, worklistShardItemId#3541242L, buf#3542076]
Arguments: hashpartitioning(shardId#3541241, worklistShardItemId#3541242L, 30), ENSURE_REQUIREMENTS, [plan_id=1014905]
(38) ObjectHashAggregate
Input [3]: [shardId#3541241, worklistShardItemId#3541242L, buf#3542076]
Keys [2]: [shardId#3541241, worklistShardItemId#3541242L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3541244, demandStream, demandStream#3541245, kpis, kpis#3541246), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3541244, demandStream, demandStream#3541245, kpis, kpis#3541246), 0, 0)#3541240]
Results [3]: [shardId#3541241, worklistShardItemId#3541242L, collect_list(struct(demandChannel, demandChannel#3541244, demandStream, demandStream#3541245, kpis, kpis#3541246), 0, 0)#3541240 AS channelStreamSpecificKpis#3541233]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3541241, worklistShardItemId#3541242L, channelStreamSpecificKpis#3541233]
Arguments: [shardId#3541241 ASC NULLS FIRST, worklistShardItemId#3541242L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3524906, worklistShardItemId#3525418L]
Right keys [2]: [shardId#3541241, worklistShardItemId#3541242L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, prodLocSpecificKpis#3541225, coalesce(channelStreamSpecificKpis#3541233, []) AS channelStreamSpecificKpis#3541247]
Input [43]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, prodLocSpecificKpis#3541225, shardId#3541241, worklistShardItemId#3541242L, channelStreamSpecificKpis#3541233]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, demandChannel#3541257, demandStream#3541258, kpis#3541259]
Arguments: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, demandChannel#3541257, demandStream#3541258, kpis#3541259], MapPartitionsRDD[150472] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, demandChannel#3541257, demandStream#3541258, kpis#3541259]
Condition : ((isnotnull(qty#3541256) AND isnotnull(kpis#3541259)) AND (isnotnull(shardId#3541254) AND isnotnull(worklistShardItemId#3541255L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, kpis#3541259]
Input [6]: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, demandChannel#3541257, demandStream#3541258, kpis#3541259]
(45) ObjectHashAggregate
Input [4]: [shardId#3541254, worklistShardItemId#3541255L, qty#3541256, kpis#3541259]
Keys [2]: [shardId#3541254, worklistShardItemId#3541255L]
Functions [1]: [partial_collect_list(struct(qty, qty#3541256, kpis, kpis#3541259), 0, 0)]
Aggregate Attributes [1]: [buf#3542077]
Results [3]: [shardId#3541254, worklistShardItemId#3541255L, buf#3542078]
(46) Exchange
Input [3]: [shardId#3541254, worklistShardItemId#3541255L, buf#3542078]
Arguments: hashpartitioning(shardId#3541254, worklistShardItemId#3541255L, 30), ENSURE_REQUIREMENTS, [plan_id=1014917]
(47) ObjectHashAggregate
Input [3]: [shardId#3541254, worklistShardItemId#3541255L, buf#3542078]
Keys [2]: [shardId#3541254, worklistShardItemId#3541255L]
Functions [1]: [collect_list(struct(qty, qty#3541256, kpis, kpis#3541259), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3541256, kpis, kpis#3541259), 0, 0)#3541253]
Results [3]: [shardId#3541254, worklistShardItemId#3541255L, map_from_entries(collect_list(struct(qty, qty#3541256, kpis, kpis#3541259), 0, 0)#3541253) AS quantityKpis#3541248]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3541254, worklistShardItemId#3541255L, quantityKpis#3541248]
Arguments: [shardId#3541254 ASC NULLS FIRST, worklistShardItemId#3541255L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3524906, worklistShardItemId#3525418L]
Right keys [2]: [shardId#3541254, worklistShardItemId#3541255L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, prodLocSpecificKpis#3541225, channelStreamSpecificKpis#3541247, coalesce(quantityKpis#3541248, map(keys: [], values: [])) AS quantityKpis#3541260]
Input [44]: [shardId#3524906, worklistShardItemId#3525418L, quantityAfterProdPlantOptimization#3525419, qty#3525420, orderProposalId#3525619L, originalReplenishmentRunId#3525661L, supplierGroup#3525621, supplier#3525622, supplyingPlant#3525626, productGroup#3525627, product#3525628, plant#3525623, subrange#3525625, orderDateTime#3525629, deliveryDateTime#3525624, availabilityDateTime#3525630, nextAvailabilityDateTime#3525631, constraintValues#3525652, constraintOperators#3525651, constraintLabels#3525650, logisticUnits#3525646, orderQuantityBaseUom#3525647, orderQuantityBaseUomUuid#3525648, splitIndicator#3525638L, netPriceAmount#3525655, netPriceCurrencyCode#3525656, netPriceQuantity#3525657, netPriceQuantityUom#3525658, netPriceQuantityUomUuid#3525659, sourceOfSupplyUuid#3525633, minimumOrderQuantity#3525649, orderProposalItemId#3525620, orderProposalItemGroupId#3525643, optimizationGroups#3525662, measurements#3525660, externalProductId#3525644, externalPlantId#3525645, previousOrderProposal#3525639L, isFallbackOrderOnly#3525636, prodLocSpecificKpis#3541225, channelStreamSpecificKpis#3541247, shardId#3541254, worklistShardItemId#3541255L, quantityKpis#3541248]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260, shardId#3524906]
Condition : ((isnotnull(shardId#3524906) AND (shardId#3524906 = 0_6_10000000532)) AND (size(quantityKpis#3541260, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260]
Input [4]: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260, shardId#3524906]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3525576L, orderProposalItemId#3525577, quantityKpis#3541260]
Arguments: explode(quantityKpis#3541260), [orderProposalId#3525576L, orderProposalItemId#3525577], false, [orderQuantityInBaseUnit#3549546, kpis#3549547]
(54) Project
Output [8]: [orderProposalId#3525576L, cast(orderProposalItemId#3525577 as bigint) AS orderProposalItemId#3549545L, orderQuantityInBaseUnit#3549546, filter(kpis#3549547, lambdafunction((lambda x_11752#3549549.label = ServiceLevel), lambda x_11752#3549549, false))[0].value AS serviceLevel#3549548, filter(kpis#3549547, lambdafunction((lambda x_11753#3549551.label = RangeOfCoverage), lambda x_11753#3549551, false))[0].value AS rangeOfCoverage#3549550, filter(kpis#3549547, lambdafunction((lambda x_11754#3549553.label = ServiceLevelAtStartOfDelisting), lambda x_11754#3549553, false))[0].value AS serviceLevelAtEndOfListing#3549552, filter(kpis#3549547, lambdafunction((lambda x_11755#3549555.label = ServiceLevelMinimumStock), lambda x_11755#3549555, false))[0].value AS serviceLevelMinStock#3549554, 10000000532 AS replenishmentRunId#3549557L]
Input [4]: [orderProposalId#3525576L, orderProposalItemId#3525577, orderQuantityInBaseUnit#3549546, kpis#3549547]
(55) WriteFiles
Input [8]: [orderProposalId#3525576L, orderProposalItemId#3549545L, orderQuantityInBaseUnit#3549546, serviceLevel#3549548, rangeOfCoverage#3549550, serviceLevelAtEndOfListing#3549552, serviceLevelMinStock#3549554, replenishmentRunId#3549557L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_6_10000000532/sequenceId=6, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_6_10000000532/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]