== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683, shardId#3392655]
Arguments: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683, shardId#3392655], [isnotnull(shardId#3392655), (shardId#3392655 = 0_1_10000000532), (size(quantityKpis#3403683, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393465L, originalReplenishmentRunId#3393468L, supplierGroup#3393475, supplier#3393476, supplyingPlant#3393506, productGroup#3393507, product#3393478, plant#3393479, subrange#3393477, orderDateTime#3393483, deliveryDateTime#3393484, availabilityDateTime#3393485, nextAvailabilityDateTime#3393486, constraintValues#3393500, constraintOperators#3393498, constraintLabels#3393497, logisticUnits#3393502, orderQuantityBaseUom#3393488, orderQuantityBaseUomUuid#3393489, splitIndicator#3393470L, netPriceAmount#3393493, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3392655, items#3392657]
Arguments: [shardId#3392655, items#3392657], [(size(items#3392657, true) > 0), isnotnull(items#3392657)]
(4) InMemoryRelation
Arguments: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, optimizationInsights#3392661], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, optimizationInsights#3392661]
Arguments: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, optimizationInsights#3392661], [isnotnull(shardId#3392655), (shardId#3392655 = 0_1_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, lastModified#3392660, optimizationInsights#3392661], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, lastModified#3392660, optimizationInsights#3392661]
Arguments: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, lastModified#3392660, optimizationInsights#3392661], MapPartitionsRDD[144081] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, lastModified#3392660, optimizationInsights#3392661]
Condition : (isnotnull(shardId#3392655) AND (shardId#3392655 = 0_1_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3392655, orderProposalId#3392656L, items#3392657, optimizationGroups#3392658, isOptimal#3392659, optimizationInsights#3392661]
Condition : (isnotnull(shardId#3392655) AND (shardId#3392655 = 0_1_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3392655, items#3392657]
Condition : ((size(items#3392657, true) > 0) AND isnotnull(items#3392657))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3392655, items#3392657]
Arguments: explode(items#3392657), [shardId#3392655], false, [item#3393236]
(12) Project [codegen id : 1]
Output [4]: [shardId#3392655, item#3393236.worklistShardItemId AS worklistShardItemId#3393237L, item#3393236.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3393238, item#3393236.qty AS qty#3393239]
Input [2]: [shardId#3392655, item#3393236]
(13) Exchange
Input [4]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239]
Arguments: hashpartitioning(worklistShardItemId#3393237L, 30), ENSURE_REQUIREMENTS, [plan_id=980496]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239]
Arguments: [worklistShardItemId#3393237L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659, shardId#3393660, sequenceId#3393638]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3393660), isnotnull(sequenceId#3393638), (shardId#3393660 = 0_1_10000000532), (sequenceId#3393638 = 7)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659, shardId#3393660, sequenceId#3393638]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659, shardId#3393660, sequenceId#3393638]
Condition : isnotnull(worklistShardItemId#3393639L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659]
Input [38]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659, shardId#3393660, sequenceId#3393638]
(19) Exchange
Input [36]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659]
Arguments: hashpartitioning(worklistShardItemId#3393639L, 30), REPARTITION_BY_NUM, [plan_id=980506]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3393639L, orderProposalId#3393616L, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, originalReplenishmentRunId#3393658L, splitIndicator#3393635L, previousOrderProposal#3393636L, sourceOfSupplyUuid#3393630, supplierGroup#3393618, supplier#3393619, subrange#3393622, product#3393625, plant#3393620, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, isFallbackOrderOnly#3393633, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, netPriceAmount#3393652, netPriceCurrencyCode#3393653, measurements#3393657, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, logisticUnits#3393643, optimizationGroups#3393659, externalProductId#3393641, externalPlantId#3393642, supplyingPlant#3393623, productGroup#3393624]
Input [36]: [orderProposalId#3393616L, orderProposalItemId#3393617, supplierGroup#3393618, supplier#3393619, plant#3393620, deliveryDateTime#3393621, subrange#3393622, supplyingPlant#3393623, productGroup#3393624, product#3393625, orderDateTime#3393626, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, sourceOfSupplyUuid#3393630, isFallbackOrderOnly#3393633, splitIndicator#3393635L, previousOrderProposal#3393636L, worklistShardItemId#3393639L, orderProposalItemGroupId#3393640, externalProductId#3393641, externalPlantId#3393642, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, measurements#3393657, originalReplenishmentRunId#3393658L, optimizationGroups#3393659]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3393639L, orderProposalId#3393616L, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, originalReplenishmentRunId#3393658L, splitIndicator#3393635L, previousOrderProposal#3393636L, sourceOfSupplyUuid#3393630, supplierGroup#3393618, supplier#3393619, subrange#3393622, product#3393625, plant#3393620, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, isFallbackOrderOnly#3393633, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, netPriceAmount#3393652, netPriceCurrencyCode#3393653, measurements#3393657, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, logisticUnits#3393643, optimizationGroups#3393659, externalProductId#3393641, externalPlantId#3393642, supplyingPlant#3393623, productGroup#3393624]
Arguments: [worklistShardItemId#3393639L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3393237L]
Right keys [1]: [worklistShardItemId#3393639L]
Join type: LeftOuter
Join condition: (shardId#3392655 = 0_1_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633]
Input [40]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, worklistShardItemId#3393639L, orderProposalId#3393616L, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, originalReplenishmentRunId#3393658L, splitIndicator#3393635L, previousOrderProposal#3393636L, sourceOfSupplyUuid#3393630, supplierGroup#3393618, supplier#3393619, subrange#3393622, product#3393625, plant#3393620, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, isFallbackOrderOnly#3393633, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, netPriceAmount#3393652, netPriceCurrencyCode#3393653, measurements#3393657, minimumOrderQuantity#3393646, constraintLabels#3393647, constraintOperators#3393648, constraintValues#3393649, logisticUnits#3393643, optimizationGroups#3393659, externalProductId#3393641, externalPlantId#3393642, supplyingPlant#3393623, productGroup#3393624]
(24) Exchange
Input [39]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633]
Arguments: hashpartitioning(shardId#3392655, worklistShardItemId#3393237L, 30), ENSURE_REQUIREMENTS, [plan_id=980515]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633]
Arguments: [shardId#3392655 ASC NULLS FIRST, worklistShardItemId#3393237L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3403648, worklistShardItemId#3403649L, qty#3403650, demandChannel#3403651, demandStream#3403652, kpis#3403653]
Arguments: [shardId#3403648, worklistShardItemId#3403649L, qty#3403650, demandChannel#3403651, demandStream#3403652, kpis#3403653], MapPartitionsRDD[144759] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3403648, worklistShardItemId#3403649L, qty#3403650, demandChannel#3403651, demandStream#3403652, kpis#3403653]
Condition : (((isnull(qty#3403650) AND isnull(demandChannel#3403651)) AND isnull(demandStream#3403652)) AND (isnotnull(shardId#3403648) AND isnotnull(worklistShardItemId#3403649L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3403648, worklistShardItemId#3403649L, coalesce(kpis#3403653, []) AS prodLocSpecificKpis#3403654]
Input [6]: [shardId#3403648, worklistShardItemId#3403649L, qty#3403650, demandChannel#3403651, demandStream#3403652, kpis#3403653]
(29) Exchange
Input [3]: [shardId#3403648, worklistShardItemId#3403649L, prodLocSpecificKpis#3403654]
Arguments: hashpartitioning(shardId#3403648, worklistShardItemId#3403649L, 30), ENSURE_REQUIREMENTS, [plan_id=980521]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3403648, worklistShardItemId#3403649L, prodLocSpecificKpis#3403654]
Arguments: [shardId#3403648 ASC NULLS FIRST, worklistShardItemId#3403649L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3392655, worklistShardItemId#3393237L]
Right keys [2]: [shardId#3403648, worklistShardItemId#3403649L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, coalesce(prodLocSpecificKpis#3403654, []) AS prodLocSpecificKpis#3403655]
Input [42]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, shardId#3403648, worklistShardItemId#3403649L, prodLocSpecificKpis#3403654]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3403664, worklistShardItemId#3403665L, qty#3403666, demandChannel#3403667, demandStream#3403668, kpis#3403669]
Arguments: [shardId#3403664, worklistShardItemId#3403665L, qty#3403666, demandChannel#3403667, demandStream#3403668, kpis#3403669], MapPartitionsRDD[144759] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3403664, worklistShardItemId#3403665L, qty#3403666, demandChannel#3403667, demandStream#3403668, kpis#3403669]
Condition : ((((isnull(qty#3403666) AND isnotnull(demandChannel#3403667)) AND isnotnull(demandStream#3403668)) AND (size(kpis#3403669, true) > 0)) AND (isnotnull(shardId#3403664) AND isnotnull(worklistShardItemId#3403665L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3403664, worklistShardItemId#3403665L, demandChannel#3403667, demandStream#3403668, kpis#3403669]
Input [6]: [shardId#3403664, worklistShardItemId#3403665L, qty#3403666, demandChannel#3403667, demandStream#3403668, kpis#3403669]
(36) ObjectHashAggregate
Input [5]: [shardId#3403664, worklistShardItemId#3403665L, demandChannel#3403667, demandStream#3403668, kpis#3403669]
Keys [2]: [shardId#3403664, worklistShardItemId#3403665L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3403667, demandStream, demandStream#3403668, kpis, kpis#3403669), 0, 0)]
Aggregate Attributes [1]: [buf#3403844]
Results [3]: [shardId#3403664, worklistShardItemId#3403665L, buf#3403845]
(37) Exchange
Input [3]: [shardId#3403664, worklistShardItemId#3403665L, buf#3403845]
Arguments: hashpartitioning(shardId#3403664, worklistShardItemId#3403665L, 30), ENSURE_REQUIREMENTS, [plan_id=980532]
(38) ObjectHashAggregate
Input [3]: [shardId#3403664, worklistShardItemId#3403665L, buf#3403845]
Keys [2]: [shardId#3403664, worklistShardItemId#3403665L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3403667, demandStream, demandStream#3403668, kpis, kpis#3403669), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3403667, demandStream, demandStream#3403668, kpis, kpis#3403669), 0, 0)#3403663]
Results [3]: [shardId#3403664, worklistShardItemId#3403665L, collect_list(struct(demandChannel, demandChannel#3403667, demandStream, demandStream#3403668, kpis, kpis#3403669), 0, 0)#3403663 AS channelStreamSpecificKpis#3403656]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3403664, worklistShardItemId#3403665L, channelStreamSpecificKpis#3403656]
Arguments: [shardId#3403664 ASC NULLS FIRST, worklistShardItemId#3403665L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3392655, worklistShardItemId#3393237L]
Right keys [2]: [shardId#3403664, worklistShardItemId#3403665L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, prodLocSpecificKpis#3403655, coalesce(channelStreamSpecificKpis#3403656, []) AS channelStreamSpecificKpis#3403670]
Input [43]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, prodLocSpecificKpis#3403655, shardId#3403664, worklistShardItemId#3403665L, channelStreamSpecificKpis#3403656]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, demandChannel#3403680, demandStream#3403681, kpis#3403682]
Arguments: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, demandChannel#3403680, demandStream#3403681, kpis#3403682], MapPartitionsRDD[144759] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, demandChannel#3403680, demandStream#3403681, kpis#3403682]
Condition : ((isnotnull(qty#3403679) AND isnotnull(kpis#3403682)) AND (isnotnull(shardId#3403677) AND isnotnull(worklistShardItemId#3403678L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, kpis#3403682]
Input [6]: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, demandChannel#3403680, demandStream#3403681, kpis#3403682]
(45) ObjectHashAggregate
Input [4]: [shardId#3403677, worklistShardItemId#3403678L, qty#3403679, kpis#3403682]
Keys [2]: [shardId#3403677, worklistShardItemId#3403678L]
Functions [1]: [partial_collect_list(struct(qty, qty#3403679, kpis, kpis#3403682), 0, 0)]
Aggregate Attributes [1]: [buf#3403846]
Results [3]: [shardId#3403677, worklistShardItemId#3403678L, buf#3403847]
(46) Exchange
Input [3]: [shardId#3403677, worklistShardItemId#3403678L, buf#3403847]
Arguments: hashpartitioning(shardId#3403677, worklistShardItemId#3403678L, 30), ENSURE_REQUIREMENTS, [plan_id=980544]
(47) ObjectHashAggregate
Input [3]: [shardId#3403677, worklistShardItemId#3403678L, buf#3403847]
Keys [2]: [shardId#3403677, worklistShardItemId#3403678L]
Functions [1]: [collect_list(struct(qty, qty#3403679, kpis, kpis#3403682), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3403679, kpis, kpis#3403682), 0, 0)#3403676]
Results [3]: [shardId#3403677, worklistShardItemId#3403678L, map_from_entries(collect_list(struct(qty, qty#3403679, kpis, kpis#3403682), 0, 0)#3403676) AS quantityKpis#3403671]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3403677, worklistShardItemId#3403678L, quantityKpis#3403671]
Arguments: [shardId#3403677 ASC NULLS FIRST, worklistShardItemId#3403678L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3392655, worklistShardItemId#3393237L]
Right keys [2]: [shardId#3403677, worklistShardItemId#3403678L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, prodLocSpecificKpis#3403655, channelStreamSpecificKpis#3403670, coalesce(quantityKpis#3403671, map(keys: [], values: [])) AS quantityKpis#3403683]
Input [44]: [shardId#3392655, worklistShardItemId#3393237L, quantityAfterProdPlantOptimization#3393238, qty#3393239, orderProposalId#3393616L, originalReplenishmentRunId#3393658L, supplierGroup#3393618, supplier#3393619, supplyingPlant#3393623, productGroup#3393624, product#3393625, plant#3393620, subrange#3393622, orderDateTime#3393626, deliveryDateTime#3393621, availabilityDateTime#3393627, nextAvailabilityDateTime#3393628, constraintValues#3393649, constraintOperators#3393648, constraintLabels#3393647, logisticUnits#3393643, orderQuantityBaseUom#3393644, orderQuantityBaseUomUuid#3393645, splitIndicator#3393635L, netPriceAmount#3393652, netPriceCurrencyCode#3393653, netPriceQuantity#3393654, netPriceQuantityUom#3393655, netPriceQuantityUomUuid#3393656, sourceOfSupplyUuid#3393630, minimumOrderQuantity#3393646, orderProposalItemId#3393617, orderProposalItemGroupId#3393640, optimizationGroups#3393659, measurements#3393657, externalProductId#3393641, externalPlantId#3393642, previousOrderProposal#3393636L, isFallbackOrderOnly#3393633, prodLocSpecificKpis#3403655, channelStreamSpecificKpis#3403670, shardId#3403677, worklistShardItemId#3403678L, quantityKpis#3403671]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683, shardId#3392655]
Condition : ((isnotnull(shardId#3392655) AND (shardId#3392655 = 0_1_10000000532)) AND (size(quantityKpis#3403683, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683]
Input [4]: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683, shardId#3392655]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3393465L, orderProposalItemId#3393466, quantityKpis#3403683]
Arguments: explode(quantityKpis#3403683), [orderProposalId#3393465L, orderProposalItemId#3393466], false, [orderQuantityInBaseUnit#3413635, kpis#3413636]
(54) Project
Output [8]: [orderProposalId#3393465L, cast(orderProposalItemId#3393466 as bigint) AS orderProposalItemId#3413634L, orderQuantityInBaseUnit#3413635, filter(kpis#3413636, lambdafunction((lambda x_11392#3413638.label = ServiceLevel), lambda x_11392#3413638, false))[0].value AS serviceLevel#3413637, filter(kpis#3413636, lambdafunction((lambda x_11393#3413640.label = RangeOfCoverage), lambda x_11393#3413640, false))[0].value AS rangeOfCoverage#3413639, filter(kpis#3413636, lambdafunction((lambda x_11394#3413642.label = ServiceLevelAtStartOfDelisting), lambda x_11394#3413642, false))[0].value AS serviceLevelAtEndOfListing#3413641, filter(kpis#3413636, lambdafunction((lambda x_11395#3413644.label = ServiceLevelMinimumStock), lambda x_11395#3413644, false))[0].value AS serviceLevelMinStock#3413643, 10000000532 AS replenishmentRunId#3413646L]
Input [4]: [orderProposalId#3393465L, orderProposalItemId#3393466, orderQuantityInBaseUnit#3413635, kpis#3413636]
(55) WriteFiles
Input [8]: [orderProposalId#3393465L, orderProposalItemId#3413634L, orderQuantityInBaseUnit#3413635, serviceLevel#3413637, rangeOfCoverage#3413639, serviceLevelAtEndOfListing#3413641, serviceLevelMinStock#3413643, replenishmentRunId#3413646L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_1_10000000532/sequenceId=7, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_1_10000000532/sequenceId=7], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]