== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125, shardId#16695828]
Arguments: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125, shardId#16695828], [isnotnull(shardId#16695828), (shardId#16695828 = 0_3_10000000548), (size(quantityKpis#16697125, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696498L, originalReplenishmentRunId#16696501L, supplierGroup#16696508, supplier#16696509, supplyingPlant#16696539, productGroup#16696540, product#16696511, plant#16696512, subrange#16696510, orderDateTime#16696516, deliveryDateTime#16696517, availabilityDateTime#16696518, nextAvailabilityDateTime#16696519, constraintValues#16696533, constraintOperators#16696531, constraintLabels#16696530, logisticUnits#16696535, orderQuantityBaseUom#16696521, orderQuantityBaseUomUuid#16696522, splitIndicator#16696503L, netPriceAmount#16696526, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#16695828, items#16695830]
Arguments: [shardId#16695828, items#16695830], [(size(items#16695830, true) > 0), isnotnull(items#16695830)]
(4) InMemoryRelation
Arguments: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, optimizationInsights#16695834], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, optimizationInsights#16695834]
Arguments: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, optimizationInsights#16695834], [isnotnull(shardId#16695828), (shardId#16695828 = 0_3_10000000548)]
(6) InMemoryRelation
Arguments: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, lastModified#16695833, optimizationInsights#16695834], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, lastModified#16695833, optimizationInsights#16695834]
Arguments: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, lastModified#16695833, optimizationInsights#16695834], MapPartitionsRDD[710108] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, lastModified#16695833, optimizationInsights#16695834]
Condition : (isnotnull(shardId#16695828) AND (shardId#16695828 = 0_3_10000000548))
(9) Filter [codegen id : 1]
Input [6]: [shardId#16695828, orderProposalId#16695829L, items#16695830, optimizationGroups#16695831, isOptimal#16695832, optimizationInsights#16695834]
Condition : (isnotnull(shardId#16695828) AND (shardId#16695828 = 0_3_10000000548))
(10) Filter [codegen id : 1]
Input [2]: [shardId#16695828, items#16695830]
Condition : ((size(items#16695830, true) > 0) AND isnotnull(items#16695830))
(11) Generate [codegen id : 1]
Input [2]: [shardId#16695828, items#16695830]
Arguments: explode(items#16695830), [shardId#16695828], false, [item#16696339]
(12) Project [codegen id : 1]
Output [4]: [shardId#16695828, item#16696339.worklistShardItemId AS worklistShardItemId#16696340L, item#16696339.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#16696341, item#16696339.qty AS qty#16696342]
Input [2]: [shardId#16695828, item#16696339]
(13) Exchange
Input [4]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342]
Arguments: hashpartitioning(worklistShardItemId#16696340L, 30), ENSURE_REQUIREMENTS, [plan_id=4965133]
(14) Sort [codegen id : 2]
Input [4]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342]
Arguments: [worklistShardItemId#16696340L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584, shardId#16696585, sequenceId#16696563]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000548]
PartitionFilters: [isnotnull(shardId#16696585), isnotnull(sequenceId#16696563), (shardId#16696585 = 0_3_10000000548), (sequenceId#16696563 = 25)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584, shardId#16696585, sequenceId#16696563]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584, shardId#16696585, sequenceId#16696563]
Condition : isnotnull(worklistShardItemId#16696564L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584]
Input [38]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584, shardId#16696585, sequenceId#16696563]
(19) Exchange
Input [36]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584]
Arguments: hashpartitioning(worklistShardItemId#16696564L, 30), REPARTITION_BY_NUM, [plan_id=4965143]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#16696564L, orderProposalId#16696541L, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, originalReplenishmentRunId#16696583L, splitIndicator#16696560L, previousOrderProposal#16696561L, sourceOfSupplyUuid#16696555, supplierGroup#16696543, supplier#16696544, subrange#16696547, product#16696550, plant#16696545, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, isFallbackOrderOnly#16696558, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, netPriceAmount#16696577, netPriceCurrencyCode#16696578, measurements#16696582, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, logisticUnits#16696568, optimizationGroups#16696584, externalProductId#16696566, externalPlantId#16696567, supplyingPlant#16696548, productGroup#16696549]
Input [36]: [orderProposalId#16696541L, orderProposalItemId#16696542, supplierGroup#16696543, supplier#16696544, plant#16696545, deliveryDateTime#16696546, subrange#16696547, supplyingPlant#16696548, productGroup#16696549, product#16696550, orderDateTime#16696551, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, sourceOfSupplyUuid#16696555, isFallbackOrderOnly#16696558, splitIndicator#16696560L, previousOrderProposal#16696561L, worklistShardItemId#16696564L, orderProposalItemGroupId#16696565, externalProductId#16696566, externalPlantId#16696567, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, measurements#16696582, originalReplenishmentRunId#16696583L, optimizationGroups#16696584]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#16696564L, orderProposalId#16696541L, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, originalReplenishmentRunId#16696583L, splitIndicator#16696560L, previousOrderProposal#16696561L, sourceOfSupplyUuid#16696555, supplierGroup#16696543, supplier#16696544, subrange#16696547, product#16696550, plant#16696545, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, isFallbackOrderOnly#16696558, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, netPriceAmount#16696577, netPriceCurrencyCode#16696578, measurements#16696582, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, logisticUnits#16696568, optimizationGroups#16696584, externalProductId#16696566, externalPlantId#16696567, supplyingPlant#16696548, productGroup#16696549]
Arguments: [worklistShardItemId#16696564L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#16696340L]
Right keys [1]: [worklistShardItemId#16696564L]
Join type: LeftOuter
Join condition: (shardId#16695828 = 0_3_10000000548)
(23) Project [codegen id : 5]
Output [39]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558]
Input [40]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, worklistShardItemId#16696564L, orderProposalId#16696541L, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, originalReplenishmentRunId#16696583L, splitIndicator#16696560L, previousOrderProposal#16696561L, sourceOfSupplyUuid#16696555, supplierGroup#16696543, supplier#16696544, subrange#16696547, product#16696550, plant#16696545, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, isFallbackOrderOnly#16696558, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, netPriceAmount#16696577, netPriceCurrencyCode#16696578, measurements#16696582, minimumOrderQuantity#16696571, constraintLabels#16696572, constraintOperators#16696573, constraintValues#16696574, logisticUnits#16696568, optimizationGroups#16696584, externalProductId#16696566, externalPlantId#16696567, supplyingPlant#16696548, productGroup#16696549]
(24) Exchange
Input [39]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558]
Arguments: hashpartitioning(shardId#16695828, worklistShardItemId#16696340L, 30), ENSURE_REQUIREMENTS, [plan_id=4965152]
(25) Sort [codegen id : 6]
Input [39]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558]
Arguments: [shardId#16695828 ASC NULLS FIRST, worklistShardItemId#16696340L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#16697090, worklistShardItemId#16697091L, qty#16697092, demandChannel#16697093, demandStream#16697094, kpis#16697095]
Arguments: [shardId#16697090, worklistShardItemId#16697091L, qty#16697092, demandChannel#16697093, demandStream#16697094, kpis#16697095], MapPartitionsRDD[710172] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#16697090, worklistShardItemId#16697091L, qty#16697092, demandChannel#16697093, demandStream#16697094, kpis#16697095]
Condition : (((isnull(qty#16697092) AND isnull(demandChannel#16697093)) AND isnull(demandStream#16697094)) AND (isnotnull(shardId#16697090) AND isnotnull(worklistShardItemId#16697091L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#16697090, worklistShardItemId#16697091L, coalesce(kpis#16697095, []) AS prodLocSpecificKpis#16697096]
Input [6]: [shardId#16697090, worklistShardItemId#16697091L, qty#16697092, demandChannel#16697093, demandStream#16697094, kpis#16697095]
(29) Exchange
Input [3]: [shardId#16697090, worklistShardItemId#16697091L, prodLocSpecificKpis#16697096]
Arguments: hashpartitioning(shardId#16697090, worklistShardItemId#16697091L, 30), ENSURE_REQUIREMENTS, [plan_id=4965158]
(30) Sort [codegen id : 8]
Input [3]: [shardId#16697090, worklistShardItemId#16697091L, prodLocSpecificKpis#16697096]
Arguments: [shardId#16697090 ASC NULLS FIRST, worklistShardItemId#16697091L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#16695828, worklistShardItemId#16696340L]
Right keys [2]: [shardId#16697090, worklistShardItemId#16697091L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, coalesce(prodLocSpecificKpis#16697096, []) AS prodLocSpecificKpis#16697097]
Input [42]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, shardId#16697090, worklistShardItemId#16697091L, prodLocSpecificKpis#16697096]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#16697106, worklistShardItemId#16697107L, qty#16697108, demandChannel#16697109, demandStream#16697110, kpis#16697111]
Arguments: [shardId#16697106, worklistShardItemId#16697107L, qty#16697108, demandChannel#16697109, demandStream#16697110, kpis#16697111], MapPartitionsRDD[710172] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#16697106, worklistShardItemId#16697107L, qty#16697108, demandChannel#16697109, demandStream#16697110, kpis#16697111]
Condition : ((((isnull(qty#16697108) AND isnotnull(demandChannel#16697109)) AND isnotnull(demandStream#16697110)) AND (size(kpis#16697111, true) > 0)) AND (isnotnull(shardId#16697106) AND isnotnull(worklistShardItemId#16697107L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#16697106, worklistShardItemId#16697107L, demandChannel#16697109, demandStream#16697110, kpis#16697111]
Input [6]: [shardId#16697106, worklistShardItemId#16697107L, qty#16697108, demandChannel#16697109, demandStream#16697110, kpis#16697111]
(36) ObjectHashAggregate
Input [5]: [shardId#16697106, worklistShardItemId#16697107L, demandChannel#16697109, demandStream#16697110, kpis#16697111]
Keys [2]: [shardId#16697106, worklistShardItemId#16697107L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#16697109, demandStream, demandStream#16697110, kpis, kpis#16697111), 0, 0)]
Aggregate Attributes [1]: [buf#16697286]
Results [3]: [shardId#16697106, worklistShardItemId#16697107L, buf#16697287]
(37) Exchange
Input [3]: [shardId#16697106, worklistShardItemId#16697107L, buf#16697287]
Arguments: hashpartitioning(shardId#16697106, worklistShardItemId#16697107L, 30), ENSURE_REQUIREMENTS, [plan_id=4965169]
(38) ObjectHashAggregate
Input [3]: [shardId#16697106, worklistShardItemId#16697107L, buf#16697287]
Keys [2]: [shardId#16697106, worklistShardItemId#16697107L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#16697109, demandStream, demandStream#16697110, kpis, kpis#16697111), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#16697109, demandStream, demandStream#16697110, kpis, kpis#16697111), 0, 0)#16697105]
Results [3]: [shardId#16697106, worklistShardItemId#16697107L, collect_list(struct(demandChannel, demandChannel#16697109, demandStream, demandStream#16697110, kpis, kpis#16697111), 0, 0)#16697105 AS channelStreamSpecificKpis#16697098]
(39) Sort [codegen id : 11]
Input [3]: [shardId#16697106, worklistShardItemId#16697107L, channelStreamSpecificKpis#16697098]
Arguments: [shardId#16697106 ASC NULLS FIRST, worklistShardItemId#16697107L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#16695828, worklistShardItemId#16696340L]
Right keys [2]: [shardId#16697106, worklistShardItemId#16697107L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, prodLocSpecificKpis#16697097, coalesce(channelStreamSpecificKpis#16697098, []) AS channelStreamSpecificKpis#16697112]
Input [43]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, prodLocSpecificKpis#16697097, shardId#16697106, worklistShardItemId#16697107L, channelStreamSpecificKpis#16697098]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, demandChannel#16697122, demandStream#16697123, kpis#16697124]
Arguments: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, demandChannel#16697122, demandStream#16697123, kpis#16697124], MapPartitionsRDD[710172] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, demandChannel#16697122, demandStream#16697123, kpis#16697124]
Condition : ((isnotnull(qty#16697121) AND isnotnull(kpis#16697124)) AND (isnotnull(shardId#16697119) AND isnotnull(worklistShardItemId#16697120L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, kpis#16697124]
Input [6]: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, demandChannel#16697122, demandStream#16697123, kpis#16697124]
(45) ObjectHashAggregate
Input [4]: [shardId#16697119, worklistShardItemId#16697120L, qty#16697121, kpis#16697124]
Keys [2]: [shardId#16697119, worklistShardItemId#16697120L]
Functions [1]: [partial_collect_list(struct(qty, qty#16697121, kpis, kpis#16697124), 0, 0)]
Aggregate Attributes [1]: [buf#16697288]
Results [3]: [shardId#16697119, worklistShardItemId#16697120L, buf#16697289]
(46) Exchange
Input [3]: [shardId#16697119, worklistShardItemId#16697120L, buf#16697289]
Arguments: hashpartitioning(shardId#16697119, worklistShardItemId#16697120L, 30), ENSURE_REQUIREMENTS, [plan_id=4965181]
(47) ObjectHashAggregate
Input [3]: [shardId#16697119, worklistShardItemId#16697120L, buf#16697289]
Keys [2]: [shardId#16697119, worklistShardItemId#16697120L]
Functions [1]: [collect_list(struct(qty, qty#16697121, kpis, kpis#16697124), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#16697121, kpis, kpis#16697124), 0, 0)#16697118]
Results [3]: [shardId#16697119, worklistShardItemId#16697120L, map_from_entries(collect_list(struct(qty, qty#16697121, kpis, kpis#16697124), 0, 0)#16697118) AS quantityKpis#16697113]
(48) Sort [codegen id : 14]
Input [3]: [shardId#16697119, worklistShardItemId#16697120L, quantityKpis#16697113]
Arguments: [shardId#16697119 ASC NULLS FIRST, worklistShardItemId#16697120L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#16695828, worklistShardItemId#16696340L]
Right keys [2]: [shardId#16697119, worklistShardItemId#16697120L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, prodLocSpecificKpis#16697097, channelStreamSpecificKpis#16697112, coalesce(quantityKpis#16697113, map(keys: [], values: [])) AS quantityKpis#16697125]
Input [44]: [shardId#16695828, worklistShardItemId#16696340L, quantityAfterProdPlantOptimization#16696341, qty#16696342, orderProposalId#16696541L, originalReplenishmentRunId#16696583L, supplierGroup#16696543, supplier#16696544, supplyingPlant#16696548, productGroup#16696549, product#16696550, plant#16696545, subrange#16696547, orderDateTime#16696551, deliveryDateTime#16696546, availabilityDateTime#16696552, nextAvailabilityDateTime#16696553, constraintValues#16696574, constraintOperators#16696573, constraintLabels#16696572, logisticUnits#16696568, orderQuantityBaseUom#16696569, orderQuantityBaseUomUuid#16696570, splitIndicator#16696560L, netPriceAmount#16696577, netPriceCurrencyCode#16696578, netPriceQuantity#16696579, netPriceQuantityUom#16696580, netPriceQuantityUomUuid#16696581, sourceOfSupplyUuid#16696555, minimumOrderQuantity#16696571, orderProposalItemId#16696542, orderProposalItemGroupId#16696565, optimizationGroups#16696584, measurements#16696582, externalProductId#16696566, externalPlantId#16696567, previousOrderProposal#16696561L, isFallbackOrderOnly#16696558, prodLocSpecificKpis#16697097, channelStreamSpecificKpis#16697112, shardId#16697119, worklistShardItemId#16697120L, quantityKpis#16697113]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125, shardId#16695828]
Condition : ((isnotnull(shardId#16695828) AND (shardId#16695828 = 0_3_10000000548)) AND (size(quantityKpis#16697125, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125]
Input [4]: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125, shardId#16695828]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#16696498L, orderProposalItemId#16696499, quantityKpis#16697125]
Arguments: explode(quantityKpis#16697125), [orderProposalId#16696498L, orderProposalItemId#16696499], false, [orderQuantityInBaseUnit#16700734, kpis#16700735]
(54) Project
Output [8]: [orderProposalId#16696498L, cast(orderProposalItemId#16696499 as bigint) AS orderProposalItemId#16700733L, orderQuantityInBaseUnit#16700734, filter(kpis#16700735, lambdafunction((lambda x_55269#16700737.label = ServiceLevel), lambda x_55269#16700737, false))[0].value AS serviceLevel#16700736, filter(kpis#16700735, lambdafunction((lambda x_55270#16700739.label = RangeOfCoverage), lambda x_55270#16700739, false))[0].value AS rangeOfCoverage#16700738, filter(kpis#16700735, lambdafunction((lambda x_55271#16700741.label = ServiceLevelAtStartOfDelisting), lambda x_55271#16700741, false))[0].value AS serviceLevelAtEndOfListing#16700740, filter(kpis#16700735, lambdafunction((lambda x_55272#16700743.label = ServiceLevelMinimumStock), lambda x_55272#16700743, false))[0].value AS serviceLevelMinStock#16700742, 10000000548 AS replenishmentRunId#16700745L]
Input [4]: [orderProposalId#16696498L, orderProposalItemId#16696499, orderQuantityInBaseUnit#16700734, kpis#16700735]
(55) WriteFiles
Input [8]: [orderProposalId#16696498L, orderProposalItemId#16700733L, orderQuantityInBaseUnit#16700734, serviceLevel#16700736, rangeOfCoverage#16700738, serviceLevelAtEndOfListing#16700740, serviceLevelMinStock#16700742, replenishmentRunId#16700745L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000548/shardId=0_3_10000000548/sequenceId=25, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000548/shardId=0_3_10000000548/sequenceId=25], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]