== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610, shardId#3483106]
Arguments: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610, shardId#3483106], [isnotnull(shardId#3483106), (shardId#3483106 = 0_5_10000000532), (size(quantityKpis#3484610, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483776L, originalReplenishmentRunId#3483779L, supplierGroup#3483786, supplier#3483787, supplyingPlant#3483817, productGroup#3483818, product#3483789, plant#3483790, subrange#3483788, orderDateTime#3483794, deliveryDateTime#3483795, availabilityDateTime#3483796, nextAvailabilityDateTime#3483797, constraintValues#3483811, constraintOperators#3483809, constraintLabels#3483808, logisticUnits#3483813, orderQuantityBaseUom#3483799, orderQuantityBaseUomUuid#3483800, splitIndicator#3483781L, netPriceAmount#3483804, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3483106, items#3483108]
Arguments: [shardId#3483106, items#3483108], [(size(items#3483108, true) > 0), isnotnull(items#3483108)]
(4) InMemoryRelation
Arguments: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, optimizationInsights#3483112], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, optimizationInsights#3483112]
Arguments: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, optimizationInsights#3483112], [isnotnull(shardId#3483106), (shardId#3483106 = 0_5_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, lastModified#3483111, optimizationInsights#3483112], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, lastModified#3483111, optimizationInsights#3483112]
Arguments: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, lastModified#3483111, optimizationInsights#3483112], MapPartitionsRDD[148141] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, lastModified#3483111, optimizationInsights#3483112]
Condition : (isnotnull(shardId#3483106) AND (shardId#3483106 = 0_5_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3483106, orderProposalId#3483107L, items#3483108, optimizationGroups#3483109, isOptimal#3483110, optimizationInsights#3483112]
Condition : (isnotnull(shardId#3483106) AND (shardId#3483106 = 0_5_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3483106, items#3483108]
Condition : ((size(items#3483108, true) > 0) AND isnotnull(items#3483108))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3483106, items#3483108]
Arguments: explode(items#3483108), [shardId#3483106], false, [item#3483617]
(12) Project [codegen id : 1]
Output [4]: [shardId#3483106, item#3483617.worklistShardItemId AS worklistShardItemId#3483618L, item#3483617.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3483619, item#3483617.qty AS qty#3483620]
Input [2]: [shardId#3483106, item#3483617]
(13) Exchange
Input [4]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620]
Arguments: hashpartitioning(worklistShardItemId#3483618L, 30), ENSURE_REQUIREMENTS, [plan_id=1000477]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620]
Arguments: [worklistShardItemId#3483618L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862, shardId#3483863, sequenceId#3483841]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3483863), isnotnull(sequenceId#3483841), (shardId#3483863 = 0_5_10000000532), (sequenceId#3483841 = 5)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862, shardId#3483863, sequenceId#3483841]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862, shardId#3483863, sequenceId#3483841]
Condition : isnotnull(worklistShardItemId#3483842L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862]
Input [38]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862, shardId#3483863, sequenceId#3483841]
(19) Exchange
Input [36]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862]
Arguments: hashpartitioning(worklistShardItemId#3483842L, 30), REPARTITION_BY_NUM, [plan_id=1000487]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3483842L, orderProposalId#3483819L, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, originalReplenishmentRunId#3483861L, splitIndicator#3483838L, previousOrderProposal#3483839L, sourceOfSupplyUuid#3483833, supplierGroup#3483821, supplier#3483822, subrange#3483825, product#3483828, plant#3483823, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, isFallbackOrderOnly#3483836, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, netPriceAmount#3483855, netPriceCurrencyCode#3483856, measurements#3483860, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, logisticUnits#3483846, optimizationGroups#3483862, externalProductId#3483844, externalPlantId#3483845, supplyingPlant#3483826, productGroup#3483827]
Input [36]: [orderProposalId#3483819L, orderProposalItemId#3483820, supplierGroup#3483821, supplier#3483822, plant#3483823, deliveryDateTime#3483824, subrange#3483825, supplyingPlant#3483826, productGroup#3483827, product#3483828, orderDateTime#3483829, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, sourceOfSupplyUuid#3483833, isFallbackOrderOnly#3483836, splitIndicator#3483838L, previousOrderProposal#3483839L, worklistShardItemId#3483842L, orderProposalItemGroupId#3483843, externalProductId#3483844, externalPlantId#3483845, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, measurements#3483860, originalReplenishmentRunId#3483861L, optimizationGroups#3483862]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3483842L, orderProposalId#3483819L, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, originalReplenishmentRunId#3483861L, splitIndicator#3483838L, previousOrderProposal#3483839L, sourceOfSupplyUuid#3483833, supplierGroup#3483821, supplier#3483822, subrange#3483825, product#3483828, plant#3483823, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, isFallbackOrderOnly#3483836, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, netPriceAmount#3483855, netPriceCurrencyCode#3483856, measurements#3483860, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, logisticUnits#3483846, optimizationGroups#3483862, externalProductId#3483844, externalPlantId#3483845, supplyingPlant#3483826, productGroup#3483827]
Arguments: [worklistShardItemId#3483842L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3483618L]
Right keys [1]: [worklistShardItemId#3483842L]
Join type: LeftOuter
Join condition: (shardId#3483106 = 0_5_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836]
Input [40]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, worklistShardItemId#3483842L, orderProposalId#3483819L, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, originalReplenishmentRunId#3483861L, splitIndicator#3483838L, previousOrderProposal#3483839L, sourceOfSupplyUuid#3483833, supplierGroup#3483821, supplier#3483822, subrange#3483825, product#3483828, plant#3483823, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, isFallbackOrderOnly#3483836, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, netPriceAmount#3483855, netPriceCurrencyCode#3483856, measurements#3483860, minimumOrderQuantity#3483849, constraintLabels#3483850, constraintOperators#3483851, constraintValues#3483852, logisticUnits#3483846, optimizationGroups#3483862, externalProductId#3483844, externalPlantId#3483845, supplyingPlant#3483826, productGroup#3483827]
(24) Exchange
Input [39]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836]
Arguments: hashpartitioning(shardId#3483106, worklistShardItemId#3483618L, 30), ENSURE_REQUIREMENTS, [plan_id=1000496]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836]
Arguments: [shardId#3483106 ASC NULLS FIRST, worklistShardItemId#3483618L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3484575, worklistShardItemId#3484576L, qty#3484577, demandChannel#3484578, demandStream#3484579, kpis#3484580]
Arguments: [shardId#3484575, worklistShardItemId#3484576L, qty#3484577, demandChannel#3484578, demandStream#3484579, kpis#3484580], MapPartitionsRDD[148223] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3484575, worklistShardItemId#3484576L, qty#3484577, demandChannel#3484578, demandStream#3484579, kpis#3484580]
Condition : (((isnull(qty#3484577) AND isnull(demandChannel#3484578)) AND isnull(demandStream#3484579)) AND (isnotnull(shardId#3484575) AND isnotnull(worklistShardItemId#3484576L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3484575, worklistShardItemId#3484576L, coalesce(kpis#3484580, []) AS prodLocSpecificKpis#3484581]
Input [6]: [shardId#3484575, worklistShardItemId#3484576L, qty#3484577, demandChannel#3484578, demandStream#3484579, kpis#3484580]
(29) Exchange
Input [3]: [shardId#3484575, worklistShardItemId#3484576L, prodLocSpecificKpis#3484581]
Arguments: hashpartitioning(shardId#3484575, worklistShardItemId#3484576L, 30), ENSURE_REQUIREMENTS, [plan_id=1000502]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3484575, worklistShardItemId#3484576L, prodLocSpecificKpis#3484581]
Arguments: [shardId#3484575 ASC NULLS FIRST, worklistShardItemId#3484576L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3483106, worklistShardItemId#3483618L]
Right keys [2]: [shardId#3484575, worklistShardItemId#3484576L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, coalesce(prodLocSpecificKpis#3484581, []) AS prodLocSpecificKpis#3484582]
Input [42]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, shardId#3484575, worklistShardItemId#3484576L, prodLocSpecificKpis#3484581]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3484591, worklistShardItemId#3484592L, qty#3484593, demandChannel#3484594, demandStream#3484595, kpis#3484596]
Arguments: [shardId#3484591, worklistShardItemId#3484592L, qty#3484593, demandChannel#3484594, demandStream#3484595, kpis#3484596], MapPartitionsRDD[148223] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3484591, worklistShardItemId#3484592L, qty#3484593, demandChannel#3484594, demandStream#3484595, kpis#3484596]
Condition : ((((isnull(qty#3484593) AND isnotnull(demandChannel#3484594)) AND isnotnull(demandStream#3484595)) AND (size(kpis#3484596, true) > 0)) AND (isnotnull(shardId#3484591) AND isnotnull(worklistShardItemId#3484592L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3484591, worklistShardItemId#3484592L, demandChannel#3484594, demandStream#3484595, kpis#3484596]
Input [6]: [shardId#3484591, worklistShardItemId#3484592L, qty#3484593, demandChannel#3484594, demandStream#3484595, kpis#3484596]
(36) ObjectHashAggregate
Input [5]: [shardId#3484591, worklistShardItemId#3484592L, demandChannel#3484594, demandStream#3484595, kpis#3484596]
Keys [2]: [shardId#3484591, worklistShardItemId#3484592L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3484594, demandStream, demandStream#3484595, kpis, kpis#3484596), 0, 0)]
Aggregate Attributes [1]: [buf#3484771]
Results [3]: [shardId#3484591, worklistShardItemId#3484592L, buf#3484772]
(37) Exchange
Input [3]: [shardId#3484591, worklistShardItemId#3484592L, buf#3484772]
Arguments: hashpartitioning(shardId#3484591, worklistShardItemId#3484592L, 30), ENSURE_REQUIREMENTS, [plan_id=1000513]
(38) ObjectHashAggregate
Input [3]: [shardId#3484591, worklistShardItemId#3484592L, buf#3484772]
Keys [2]: [shardId#3484591, worklistShardItemId#3484592L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3484594, demandStream, demandStream#3484595, kpis, kpis#3484596), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3484594, demandStream, demandStream#3484595, kpis, kpis#3484596), 0, 0)#3484590]
Results [3]: [shardId#3484591, worklistShardItemId#3484592L, collect_list(struct(demandChannel, demandChannel#3484594, demandStream, demandStream#3484595, kpis, kpis#3484596), 0, 0)#3484590 AS channelStreamSpecificKpis#3484583]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3484591, worklistShardItemId#3484592L, channelStreamSpecificKpis#3484583]
Arguments: [shardId#3484591 ASC NULLS FIRST, worklistShardItemId#3484592L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3483106, worklistShardItemId#3483618L]
Right keys [2]: [shardId#3484591, worklistShardItemId#3484592L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, prodLocSpecificKpis#3484582, coalesce(channelStreamSpecificKpis#3484583, []) AS channelStreamSpecificKpis#3484597]
Input [43]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, prodLocSpecificKpis#3484582, shardId#3484591, worklistShardItemId#3484592L, channelStreamSpecificKpis#3484583]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, demandChannel#3484607, demandStream#3484608, kpis#3484609]
Arguments: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, demandChannel#3484607, demandStream#3484608, kpis#3484609], MapPartitionsRDD[148223] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, demandChannel#3484607, demandStream#3484608, kpis#3484609]
Condition : ((isnotnull(qty#3484606) AND isnotnull(kpis#3484609)) AND (isnotnull(shardId#3484604) AND isnotnull(worklistShardItemId#3484605L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, kpis#3484609]
Input [6]: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, demandChannel#3484607, demandStream#3484608, kpis#3484609]
(45) ObjectHashAggregate
Input [4]: [shardId#3484604, worklistShardItemId#3484605L, qty#3484606, kpis#3484609]
Keys [2]: [shardId#3484604, worklistShardItemId#3484605L]
Functions [1]: [partial_collect_list(struct(qty, qty#3484606, kpis, kpis#3484609), 0, 0)]
Aggregate Attributes [1]: [buf#3484773]
Results [3]: [shardId#3484604, worklistShardItemId#3484605L, buf#3484774]
(46) Exchange
Input [3]: [shardId#3484604, worklistShardItemId#3484605L, buf#3484774]
Arguments: hashpartitioning(shardId#3484604, worklistShardItemId#3484605L, 30), ENSURE_REQUIREMENTS, [plan_id=1000525]
(47) ObjectHashAggregate
Input [3]: [shardId#3484604, worklistShardItemId#3484605L, buf#3484774]
Keys [2]: [shardId#3484604, worklistShardItemId#3484605L]
Functions [1]: [collect_list(struct(qty, qty#3484606, kpis, kpis#3484609), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3484606, kpis, kpis#3484609), 0, 0)#3484603]
Results [3]: [shardId#3484604, worklistShardItemId#3484605L, map_from_entries(collect_list(struct(qty, qty#3484606, kpis, kpis#3484609), 0, 0)#3484603) AS quantityKpis#3484598]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3484604, worklistShardItemId#3484605L, quantityKpis#3484598]
Arguments: [shardId#3484604 ASC NULLS FIRST, worklistShardItemId#3484605L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3483106, worklistShardItemId#3483618L]
Right keys [2]: [shardId#3484604, worklistShardItemId#3484605L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, prodLocSpecificKpis#3484582, channelStreamSpecificKpis#3484597, coalesce(quantityKpis#3484598, map(keys: [], values: [])) AS quantityKpis#3484610]
Input [44]: [shardId#3483106, worklistShardItemId#3483618L, quantityAfterProdPlantOptimization#3483619, qty#3483620, orderProposalId#3483819L, originalReplenishmentRunId#3483861L, supplierGroup#3483821, supplier#3483822, supplyingPlant#3483826, productGroup#3483827, product#3483828, plant#3483823, subrange#3483825, orderDateTime#3483829, deliveryDateTime#3483824, availabilityDateTime#3483830, nextAvailabilityDateTime#3483831, constraintValues#3483852, constraintOperators#3483851, constraintLabels#3483850, logisticUnits#3483846, orderQuantityBaseUom#3483847, orderQuantityBaseUomUuid#3483848, splitIndicator#3483838L, netPriceAmount#3483855, netPriceCurrencyCode#3483856, netPriceQuantity#3483857, netPriceQuantityUom#3483858, netPriceQuantityUomUuid#3483859, sourceOfSupplyUuid#3483833, minimumOrderQuantity#3483849, orderProposalItemId#3483820, orderProposalItemGroupId#3483843, optimizationGroups#3483862, measurements#3483860, externalProductId#3483844, externalPlantId#3483845, previousOrderProposal#3483839L, isFallbackOrderOnly#3483836, prodLocSpecificKpis#3484582, channelStreamSpecificKpis#3484597, shardId#3484604, worklistShardItemId#3484605L, quantityKpis#3484598]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610, shardId#3483106]
Condition : ((isnotnull(shardId#3483106) AND (shardId#3483106 = 0_5_10000000532)) AND (size(quantityKpis#3484610, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610]
Input [4]: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610, shardId#3483106]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3483776L, orderProposalItemId#3483777, quantityKpis#3484610]
Arguments: explode(quantityKpis#3484610), [orderProposalId#3483776L, orderProposalItemId#3483777], false, [orderQuantityInBaseUnit#3488219, kpis#3488220]
(54) Project
Output [8]: [orderProposalId#3483776L, cast(orderProposalItemId#3483777 as bigint) AS orderProposalItemId#3488218L, orderQuantityInBaseUnit#3488219, filter(kpis#3488220, lambdafunction((lambda x_11605#3488222.label = ServiceLevel), lambda x_11605#3488222, false))[0].value AS serviceLevel#3488221, filter(kpis#3488220, lambdafunction((lambda x_11606#3488224.label = RangeOfCoverage), lambda x_11606#3488224, false))[0].value AS rangeOfCoverage#3488223, filter(kpis#3488220, lambdafunction((lambda x_11607#3488226.label = ServiceLevelAtStartOfDelisting), lambda x_11607#3488226, false))[0].value AS serviceLevelAtEndOfListing#3488225, filter(kpis#3488220, lambdafunction((lambda x_11608#3488228.label = ServiceLevelMinimumStock), lambda x_11608#3488228, false))[0].value AS serviceLevelMinStock#3488227, 10000000532 AS replenishmentRunId#3488230L]
Input [4]: [orderProposalId#3483776L, orderProposalItemId#3483777, orderQuantityInBaseUnit#3488219, kpis#3488220]
(55) WriteFiles
Input [8]: [orderProposalId#3483776L, orderProposalItemId#3488218L, orderQuantityInBaseUnit#3488219, serviceLevel#3488221, rangeOfCoverage#3488223, serviceLevelAtEndOfListing#3488225, serviceLevelMinStock#3488227, replenishmentRunId#3488230L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=5, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_5_10000000532/sequenceId=5], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]