== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358, shardId#3538856]
Arguments: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358, shardId#3538856], [isnotnull(shardId#3538856), (shardId#3538856 = 0_2_10000000532), (size(quantityKpis#3551358, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540426L, originalReplenishmentRunId#3540429L, supplierGroup#3540436, supplier#3540437, supplyingPlant#3540467, productGroup#3540468, product#3540439, plant#3540440, subrange#3540438, orderDateTime#3540444, deliveryDateTime#3540445, availabilityDateTime#3540446, nextAvailabilityDateTime#3540447, constraintValues#3540461, constraintOperators#3540459, constraintLabels#3540458, logisticUnits#3540463, orderQuantityBaseUom#3540449, orderQuantityBaseUomUuid#3540450, splitIndicator#3540431L, netPriceAmount#3540454, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3538856, items#3538858]
Arguments: [shardId#3538856, items#3538858], [(size(items#3538858, true) > 0), isnotnull(items#3538858)]
(4) InMemoryRelation
Arguments: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, optimizationInsights#3538862], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, optimizationInsights#3538862]
Arguments: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, optimizationInsights#3538862], [isnotnull(shardId#3538856), (shardId#3538856 = 0_2_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, lastModified#3538861, optimizationInsights#3538862], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, lastModified#3538861, optimizationInsights#3538862]
Arguments: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, lastModified#3538861, optimizationInsights#3538862], MapPartitionsRDD[150396] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, lastModified#3538861, optimizationInsights#3538862]
Condition : (isnotnull(shardId#3538856) AND (shardId#3538856 = 0_2_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3538856, orderProposalId#3538857L, items#3538858, optimizationGroups#3538859, isOptimal#3538860, optimizationInsights#3538862]
Condition : (isnotnull(shardId#3538856) AND (shardId#3538856 = 0_2_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3538856, items#3538858]
Condition : ((size(items#3538858, true) > 0) AND isnotnull(items#3538858))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3538856, items#3538858]
Arguments: explode(items#3538858), [shardId#3538856], false, [item#3540267]
(12) Project [codegen id : 1]
Output [4]: [shardId#3538856, item#3540267.worklistShardItemId AS worklistShardItemId#3540268L, item#3540267.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3540269, item#3540267.qty AS qty#3540270]
Input [2]: [shardId#3538856, item#3540267]
(13) Exchange
Input [4]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270]
Arguments: hashpartitioning(worklistShardItemId#3540268L, 30), ENSURE_REQUIREMENTS, [plan_id=1017404]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270]
Arguments: [worklistShardItemId#3540268L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512, shardId#3540513, sequenceId#3540491]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3540513), isnotnull(sequenceId#3540491), (shardId#3540513 = 0_2_10000000532), (sequenceId#3540491 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512, shardId#3540513, sequenceId#3540491]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512, shardId#3540513, sequenceId#3540491]
Condition : isnotnull(worklistShardItemId#3540492L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512]
Input [38]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512, shardId#3540513, sequenceId#3540491]
(19) Exchange
Input [36]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512]
Arguments: hashpartitioning(worklistShardItemId#3540492L, 30), REPARTITION_BY_NUM, [plan_id=1017414]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3540492L, orderProposalId#3540469L, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, originalReplenishmentRunId#3540511L, splitIndicator#3540488L, previousOrderProposal#3540489L, sourceOfSupplyUuid#3540483, supplierGroup#3540471, supplier#3540472, subrange#3540475, product#3540478, plant#3540473, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, isFallbackOrderOnly#3540486, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, netPriceAmount#3540505, netPriceCurrencyCode#3540506, measurements#3540510, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, logisticUnits#3540496, optimizationGroups#3540512, externalProductId#3540494, externalPlantId#3540495, supplyingPlant#3540476, productGroup#3540477]
Input [36]: [orderProposalId#3540469L, orderProposalItemId#3540470, supplierGroup#3540471, supplier#3540472, plant#3540473, deliveryDateTime#3540474, subrange#3540475, supplyingPlant#3540476, productGroup#3540477, product#3540478, orderDateTime#3540479, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, sourceOfSupplyUuid#3540483, isFallbackOrderOnly#3540486, splitIndicator#3540488L, previousOrderProposal#3540489L, worklistShardItemId#3540492L, orderProposalItemGroupId#3540493, externalProductId#3540494, externalPlantId#3540495, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, measurements#3540510, originalReplenishmentRunId#3540511L, optimizationGroups#3540512]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3540492L, orderProposalId#3540469L, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, originalReplenishmentRunId#3540511L, splitIndicator#3540488L, previousOrderProposal#3540489L, sourceOfSupplyUuid#3540483, supplierGroup#3540471, supplier#3540472, subrange#3540475, product#3540478, plant#3540473, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, isFallbackOrderOnly#3540486, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, netPriceAmount#3540505, netPriceCurrencyCode#3540506, measurements#3540510, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, logisticUnits#3540496, optimizationGroups#3540512, externalProductId#3540494, externalPlantId#3540495, supplyingPlant#3540476, productGroup#3540477]
Arguments: [worklistShardItemId#3540492L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3540268L]
Right keys [1]: [worklistShardItemId#3540492L]
Join type: LeftOuter
Join condition: (shardId#3538856 = 0_2_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486]
Input [40]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, worklistShardItemId#3540492L, orderProposalId#3540469L, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, originalReplenishmentRunId#3540511L, splitIndicator#3540488L, previousOrderProposal#3540489L, sourceOfSupplyUuid#3540483, supplierGroup#3540471, supplier#3540472, subrange#3540475, product#3540478, plant#3540473, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, isFallbackOrderOnly#3540486, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, netPriceAmount#3540505, netPriceCurrencyCode#3540506, measurements#3540510, minimumOrderQuantity#3540499, constraintLabels#3540500, constraintOperators#3540501, constraintValues#3540502, logisticUnits#3540496, optimizationGroups#3540512, externalProductId#3540494, externalPlantId#3540495, supplyingPlant#3540476, productGroup#3540477]
(24) Exchange
Input [39]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486]
Arguments: hashpartitioning(shardId#3538856, worklistShardItemId#3540268L, 30), ENSURE_REQUIREMENTS, [plan_id=1017423]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486]
Arguments: [shardId#3538856 ASC NULLS FIRST, worklistShardItemId#3540268L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3551323, worklistShardItemId#3551324L, qty#3551325, demandChannel#3551326, demandStream#3551327, kpis#3551328]
Arguments: [shardId#3551323, worklistShardItemId#3551324L, qty#3551325, demandChannel#3551326, demandStream#3551327, kpis#3551328], MapPartitionsRDD[150870] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3551323, worklistShardItemId#3551324L, qty#3551325, demandChannel#3551326, demandStream#3551327, kpis#3551328]
Condition : (((isnull(qty#3551325) AND isnull(demandChannel#3551326)) AND isnull(demandStream#3551327)) AND (isnotnull(shardId#3551323) AND isnotnull(worklistShardItemId#3551324L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3551323, worklistShardItemId#3551324L, coalesce(kpis#3551328, []) AS prodLocSpecificKpis#3551329]
Input [6]: [shardId#3551323, worklistShardItemId#3551324L, qty#3551325, demandChannel#3551326, demandStream#3551327, kpis#3551328]
(29) Exchange
Input [3]: [shardId#3551323, worklistShardItemId#3551324L, prodLocSpecificKpis#3551329]
Arguments: hashpartitioning(shardId#3551323, worklistShardItemId#3551324L, 30), ENSURE_REQUIREMENTS, [plan_id=1017429]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3551323, worklistShardItemId#3551324L, prodLocSpecificKpis#3551329]
Arguments: [shardId#3551323 ASC NULLS FIRST, worklistShardItemId#3551324L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3538856, worklistShardItemId#3540268L]
Right keys [2]: [shardId#3551323, worklistShardItemId#3551324L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, coalesce(prodLocSpecificKpis#3551329, []) AS prodLocSpecificKpis#3551330]
Input [42]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, shardId#3551323, worklistShardItemId#3551324L, prodLocSpecificKpis#3551329]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3551339, worklistShardItemId#3551340L, qty#3551341, demandChannel#3551342, demandStream#3551343, kpis#3551344]
Arguments: [shardId#3551339, worklistShardItemId#3551340L, qty#3551341, demandChannel#3551342, demandStream#3551343, kpis#3551344], MapPartitionsRDD[150870] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3551339, worklistShardItemId#3551340L, qty#3551341, demandChannel#3551342, demandStream#3551343, kpis#3551344]
Condition : ((((isnull(qty#3551341) AND isnotnull(demandChannel#3551342)) AND isnotnull(demandStream#3551343)) AND (size(kpis#3551344, true) > 0)) AND (isnotnull(shardId#3551339) AND isnotnull(worklistShardItemId#3551340L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3551339, worklistShardItemId#3551340L, demandChannel#3551342, demandStream#3551343, kpis#3551344]
Input [6]: [shardId#3551339, worklistShardItemId#3551340L, qty#3551341, demandChannel#3551342, demandStream#3551343, kpis#3551344]
(36) ObjectHashAggregate
Input [5]: [shardId#3551339, worklistShardItemId#3551340L, demandChannel#3551342, demandStream#3551343, kpis#3551344]
Keys [2]: [shardId#3551339, worklistShardItemId#3551340L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3551342, demandStream, demandStream#3551343, kpis, kpis#3551344), 0, 0)]
Aggregate Attributes [1]: [buf#3551519]
Results [3]: [shardId#3551339, worklistShardItemId#3551340L, buf#3551520]
(37) Exchange
Input [3]: [shardId#3551339, worklistShardItemId#3551340L, buf#3551520]
Arguments: hashpartitioning(shardId#3551339, worklistShardItemId#3551340L, 30), ENSURE_REQUIREMENTS, [plan_id=1017440]
(38) ObjectHashAggregate
Input [3]: [shardId#3551339, worklistShardItemId#3551340L, buf#3551520]
Keys [2]: [shardId#3551339, worklistShardItemId#3551340L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3551342, demandStream, demandStream#3551343, kpis, kpis#3551344), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3551342, demandStream, demandStream#3551343, kpis, kpis#3551344), 0, 0)#3551338]
Results [3]: [shardId#3551339, worklistShardItemId#3551340L, collect_list(struct(demandChannel, demandChannel#3551342, demandStream, demandStream#3551343, kpis, kpis#3551344), 0, 0)#3551338 AS channelStreamSpecificKpis#3551331]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3551339, worklistShardItemId#3551340L, channelStreamSpecificKpis#3551331]
Arguments: [shardId#3551339 ASC NULLS FIRST, worklistShardItemId#3551340L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3538856, worklistShardItemId#3540268L]
Right keys [2]: [shardId#3551339, worklistShardItemId#3551340L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, prodLocSpecificKpis#3551330, coalesce(channelStreamSpecificKpis#3551331, []) AS channelStreamSpecificKpis#3551345]
Input [43]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, prodLocSpecificKpis#3551330, shardId#3551339, worklistShardItemId#3551340L, channelStreamSpecificKpis#3551331]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, demandChannel#3551355, demandStream#3551356, kpis#3551357]
Arguments: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, demandChannel#3551355, demandStream#3551356, kpis#3551357], MapPartitionsRDD[150870] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, demandChannel#3551355, demandStream#3551356, kpis#3551357]
Condition : ((isnotnull(qty#3551354) AND isnotnull(kpis#3551357)) AND (isnotnull(shardId#3551352) AND isnotnull(worklistShardItemId#3551353L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, kpis#3551357]
Input [6]: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, demandChannel#3551355, demandStream#3551356, kpis#3551357]
(45) ObjectHashAggregate
Input [4]: [shardId#3551352, worklistShardItemId#3551353L, qty#3551354, kpis#3551357]
Keys [2]: [shardId#3551352, worklistShardItemId#3551353L]
Functions [1]: [partial_collect_list(struct(qty, qty#3551354, kpis, kpis#3551357), 0, 0)]
Aggregate Attributes [1]: [buf#3551521]
Results [3]: [shardId#3551352, worklistShardItemId#3551353L, buf#3551522]
(46) Exchange
Input [3]: [shardId#3551352, worklistShardItemId#3551353L, buf#3551522]
Arguments: hashpartitioning(shardId#3551352, worklistShardItemId#3551353L, 30), ENSURE_REQUIREMENTS, [plan_id=1017452]
(47) ObjectHashAggregate
Input [3]: [shardId#3551352, worklistShardItemId#3551353L, buf#3551522]
Keys [2]: [shardId#3551352, worklistShardItemId#3551353L]
Functions [1]: [collect_list(struct(qty, qty#3551354, kpis, kpis#3551357), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3551354, kpis, kpis#3551357), 0, 0)#3551351]
Results [3]: [shardId#3551352, worklistShardItemId#3551353L, map_from_entries(collect_list(struct(qty, qty#3551354, kpis, kpis#3551357), 0, 0)#3551351) AS quantityKpis#3551346]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3551352, worklistShardItemId#3551353L, quantityKpis#3551346]
Arguments: [shardId#3551352 ASC NULLS FIRST, worklistShardItemId#3551353L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3538856, worklistShardItemId#3540268L]
Right keys [2]: [shardId#3551352, worklistShardItemId#3551353L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, prodLocSpecificKpis#3551330, channelStreamSpecificKpis#3551345, coalesce(quantityKpis#3551346, map(keys: [], values: [])) AS quantityKpis#3551358]
Input [44]: [shardId#3538856, worklistShardItemId#3540268L, quantityAfterProdPlantOptimization#3540269, qty#3540270, orderProposalId#3540469L, originalReplenishmentRunId#3540511L, supplierGroup#3540471, supplier#3540472, supplyingPlant#3540476, productGroup#3540477, product#3540478, plant#3540473, subrange#3540475, orderDateTime#3540479, deliveryDateTime#3540474, availabilityDateTime#3540480, nextAvailabilityDateTime#3540481, constraintValues#3540502, constraintOperators#3540501, constraintLabels#3540500, logisticUnits#3540496, orderQuantityBaseUom#3540497, orderQuantityBaseUomUuid#3540498, splitIndicator#3540488L, netPriceAmount#3540505, netPriceCurrencyCode#3540506, netPriceQuantity#3540507, netPriceQuantityUom#3540508, netPriceQuantityUomUuid#3540509, sourceOfSupplyUuid#3540483, minimumOrderQuantity#3540499, orderProposalItemId#3540470, orderProposalItemGroupId#3540493, optimizationGroups#3540512, measurements#3540510, externalProductId#3540494, externalPlantId#3540495, previousOrderProposal#3540489L, isFallbackOrderOnly#3540486, prodLocSpecificKpis#3551330, channelStreamSpecificKpis#3551345, shardId#3551352, worklistShardItemId#3551353L, quantityKpis#3551346]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358, shardId#3538856]
Condition : ((isnotnull(shardId#3538856) AND (shardId#3538856 = 0_2_10000000532)) AND (size(quantityKpis#3551358, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358]
Input [4]: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358, shardId#3538856]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3540426L, orderProposalItemId#3540427, quantityKpis#3551358]
Arguments: explode(quantityKpis#3551358), [orderProposalId#3540426L, orderProposalItemId#3540427], false, [orderQuantityInBaseUnit#3558407, kpis#3558408]
(54) Project
Output [8]: [orderProposalId#3540426L, cast(orderProposalItemId#3540427 as bigint) AS orderProposalItemId#3558406L, orderQuantityInBaseUnit#3558407, filter(kpis#3558408, lambdafunction((lambda x_11820#3558410.label = ServiceLevel), lambda x_11820#3558410, false))[0].value AS serviceLevel#3558409, filter(kpis#3558408, lambdafunction((lambda x_11821#3558412.label = RangeOfCoverage), lambda x_11821#3558412, false))[0].value AS rangeOfCoverage#3558411, filter(kpis#3558408, lambdafunction((lambda x_11822#3558414.label = ServiceLevelAtStartOfDelisting), lambda x_11822#3558414, false))[0].value AS serviceLevelAtEndOfListing#3558413, filter(kpis#3558408, lambdafunction((lambda x_11823#3558416.label = ServiceLevelMinimumStock), lambda x_11823#3558416, false))[0].value AS serviceLevelMinStock#3558415, 10000000532 AS replenishmentRunId#3558418L]
Input [4]: [orderProposalId#3540426L, orderProposalItemId#3540427, orderQuantityInBaseUnit#3558407, kpis#3558408]
(55) WriteFiles
Input [8]: [orderProposalId#3540426L, orderProposalItemId#3558406L, orderQuantityInBaseUnit#3558407, serviceLevel#3558409, rangeOfCoverage#3558411, serviceLevelAtEndOfListing#3558413, serviceLevelMinStock#3558415, replenishmentRunId#3558418L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_2_10000000532/sequenceId=6, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_2_10000000532/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]