== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214, shardId#3580449]
Arguments: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214, shardId#3580449], [isnotnull(shardId#3580449), (shardId#3580449 = 0_3_10000000532), (size(quantityKpis#3583214, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582199L, originalReplenishmentRunId#3582202L, supplierGroup#3582209, supplier#3582210, supplyingPlant#3582240, productGroup#3582241, product#3582212, plant#3582213, subrange#3582211, orderDateTime#3582217, deliveryDateTime#3582218, availabilityDateTime#3582219, nextAvailabilityDateTime#3582220, constraintValues#3582234, constraintOperators#3582232, constraintLabels#3582231, logisticUnits#3582236, orderQuantityBaseUom#3582222, orderQuantityBaseUomUuid#3582223, splitIndicator#3582204L, netPriceAmount#3582227, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#3580449, items#3580451]
Arguments: [shardId#3580449, items#3580451], [(size(items#3580451, true) > 0), isnotnull(items#3580451)]
(4) InMemoryRelation
Arguments: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, optimizationInsights#3580455], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, optimizationInsights#3580455]
Arguments: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, optimizationInsights#3580455], [isnotnull(shardId#3580449), (shardId#3580449 = 0_3_10000000532)]
(6) InMemoryRelation
Arguments: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, lastModified#3580454, optimizationInsights#3580455], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, lastModified#3580454, optimizationInsights#3580455]
Arguments: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, lastModified#3580454, optimizationInsights#3580455], MapPartitionsRDD[152568] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, lastModified#3580454, optimizationInsights#3580455]
Condition : (isnotnull(shardId#3580449) AND (shardId#3580449 = 0_3_10000000532))
(9) Filter [codegen id : 1]
Input [6]: [shardId#3580449, orderProposalId#3580450L, items#3580451, optimizationGroups#3580452, isOptimal#3580453, optimizationInsights#3580455]
Condition : (isnotnull(shardId#3580449) AND (shardId#3580449 = 0_3_10000000532))
(10) Filter [codegen id : 1]
Input [2]: [shardId#3580449, items#3580451]
Condition : ((size(items#3580451, true) > 0) AND isnotnull(items#3580451))
(11) Generate [codegen id : 1]
Input [2]: [shardId#3580449, items#3580451]
Arguments: explode(items#3580451), [shardId#3580449], false, [item#3581970]
(12) Project [codegen id : 1]
Output [4]: [shardId#3580449, item#3581970.worklistShardItemId AS worklistShardItemId#3581971L, item#3581970.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#3581972, item#3581970.qty AS qty#3581973]
Input [2]: [shardId#3580449, item#3581970]
(13) Exchange
Input [4]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973]
Arguments: hashpartitioning(worklistShardItemId#3581971L, 30), ENSURE_REQUIREMENTS, [plan_id=1027582]
(14) Sort [codegen id : 2]
Input [4]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973]
Arguments: [worklistShardItemId#3581971L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465, shardId#3582466, sequenceId#3582444]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000000532]
PartitionFilters: [isnotnull(shardId#3582466), isnotnull(sequenceId#3582444), (shardId#3582466 = 0_3_10000000532), (sequenceId#3582444 = 2)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465, shardId#3582466, sequenceId#3582444]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465, shardId#3582466, sequenceId#3582444]
Condition : isnotnull(worklistShardItemId#3582445L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465]
Input [38]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465, shardId#3582466, sequenceId#3582444]
(19) Exchange
Input [36]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465]
Arguments: hashpartitioning(worklistShardItemId#3582445L, 30), REPARTITION_BY_NUM, [plan_id=1027592]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#3582445L, orderProposalId#3582422L, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, originalReplenishmentRunId#3582464L, splitIndicator#3582441L, previousOrderProposal#3582442L, sourceOfSupplyUuid#3582436, supplierGroup#3582424, supplier#3582425, subrange#3582428, product#3582431, plant#3582426, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, isFallbackOrderOnly#3582439, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, netPriceAmount#3582458, netPriceCurrencyCode#3582459, measurements#3582463, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, logisticUnits#3582449, optimizationGroups#3582465, externalProductId#3582447, externalPlantId#3582448, supplyingPlant#3582429, productGroup#3582430]
Input [36]: [orderProposalId#3582422L, orderProposalItemId#3582423, supplierGroup#3582424, supplier#3582425, plant#3582426, deliveryDateTime#3582427, subrange#3582428, supplyingPlant#3582429, productGroup#3582430, product#3582431, orderDateTime#3582432, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, sourceOfSupplyUuid#3582436, isFallbackOrderOnly#3582439, splitIndicator#3582441L, previousOrderProposal#3582442L, worklistShardItemId#3582445L, orderProposalItemGroupId#3582446, externalProductId#3582447, externalPlantId#3582448, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, measurements#3582463, originalReplenishmentRunId#3582464L, optimizationGroups#3582465]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#3582445L, orderProposalId#3582422L, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, originalReplenishmentRunId#3582464L, splitIndicator#3582441L, previousOrderProposal#3582442L, sourceOfSupplyUuid#3582436, supplierGroup#3582424, supplier#3582425, subrange#3582428, product#3582431, plant#3582426, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, isFallbackOrderOnly#3582439, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, netPriceAmount#3582458, netPriceCurrencyCode#3582459, measurements#3582463, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, logisticUnits#3582449, optimizationGroups#3582465, externalProductId#3582447, externalPlantId#3582448, supplyingPlant#3582429, productGroup#3582430]
Arguments: [worklistShardItemId#3582445L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#3581971L]
Right keys [1]: [worklistShardItemId#3582445L]
Join type: LeftOuter
Join condition: (shardId#3580449 = 0_3_10000000532)
(23) Project [codegen id : 5]
Output [39]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439]
Input [40]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, worklistShardItemId#3582445L, orderProposalId#3582422L, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, originalReplenishmentRunId#3582464L, splitIndicator#3582441L, previousOrderProposal#3582442L, sourceOfSupplyUuid#3582436, supplierGroup#3582424, supplier#3582425, subrange#3582428, product#3582431, plant#3582426, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, isFallbackOrderOnly#3582439, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, netPriceAmount#3582458, netPriceCurrencyCode#3582459, measurements#3582463, minimumOrderQuantity#3582452, constraintLabels#3582453, constraintOperators#3582454, constraintValues#3582455, logisticUnits#3582449, optimizationGroups#3582465, externalProductId#3582447, externalPlantId#3582448, supplyingPlant#3582429, productGroup#3582430]
(24) Exchange
Input [39]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439]
Arguments: hashpartitioning(shardId#3580449, worklistShardItemId#3581971L, 30), ENSURE_REQUIREMENTS, [plan_id=1027601]
(25) Sort [codegen id : 6]
Input [39]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439]
Arguments: [shardId#3580449 ASC NULLS FIRST, worklistShardItemId#3581971L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#3583179, worklistShardItemId#3583180L, qty#3583181, demandChannel#3583182, demandStream#3583183, kpis#3583184]
Arguments: [shardId#3583179, worklistShardItemId#3583180L, qty#3583181, demandChannel#3583182, demandStream#3583183, kpis#3583184], MapPartitionsRDD[152726] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#3583179, worklistShardItemId#3583180L, qty#3583181, demandChannel#3583182, demandStream#3583183, kpis#3583184]
Condition : (((isnull(qty#3583181) AND isnull(demandChannel#3583182)) AND isnull(demandStream#3583183)) AND (isnotnull(shardId#3583179) AND isnotnull(worklistShardItemId#3583180L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#3583179, worklistShardItemId#3583180L, coalesce(kpis#3583184, []) AS prodLocSpecificKpis#3583185]
Input [6]: [shardId#3583179, worklistShardItemId#3583180L, qty#3583181, demandChannel#3583182, demandStream#3583183, kpis#3583184]
(29) Exchange
Input [3]: [shardId#3583179, worklistShardItemId#3583180L, prodLocSpecificKpis#3583185]
Arguments: hashpartitioning(shardId#3583179, worklistShardItemId#3583180L, 30), ENSURE_REQUIREMENTS, [plan_id=1027607]
(30) Sort [codegen id : 8]
Input [3]: [shardId#3583179, worklistShardItemId#3583180L, prodLocSpecificKpis#3583185]
Arguments: [shardId#3583179 ASC NULLS FIRST, worklistShardItemId#3583180L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#3580449, worklistShardItemId#3581971L]
Right keys [2]: [shardId#3583179, worklistShardItemId#3583180L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, coalesce(prodLocSpecificKpis#3583185, []) AS prodLocSpecificKpis#3583186]
Input [42]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, shardId#3583179, worklistShardItemId#3583180L, prodLocSpecificKpis#3583185]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#3583195, worklistShardItemId#3583196L, qty#3583197, demandChannel#3583198, demandStream#3583199, kpis#3583200]
Arguments: [shardId#3583195, worklistShardItemId#3583196L, qty#3583197, demandChannel#3583198, demandStream#3583199, kpis#3583200], MapPartitionsRDD[152726] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#3583195, worklistShardItemId#3583196L, qty#3583197, demandChannel#3583198, demandStream#3583199, kpis#3583200]
Condition : ((((isnull(qty#3583197) AND isnotnull(demandChannel#3583198)) AND isnotnull(demandStream#3583199)) AND (size(kpis#3583200, true) > 0)) AND (isnotnull(shardId#3583195) AND isnotnull(worklistShardItemId#3583196L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#3583195, worklistShardItemId#3583196L, demandChannel#3583198, demandStream#3583199, kpis#3583200]
Input [6]: [shardId#3583195, worklistShardItemId#3583196L, qty#3583197, demandChannel#3583198, demandStream#3583199, kpis#3583200]
(36) ObjectHashAggregate
Input [5]: [shardId#3583195, worklistShardItemId#3583196L, demandChannel#3583198, demandStream#3583199, kpis#3583200]
Keys [2]: [shardId#3583195, worklistShardItemId#3583196L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#3583198, demandStream, demandStream#3583199, kpis, kpis#3583200), 0, 0)]
Aggregate Attributes [1]: [buf#3583376]
Results [3]: [shardId#3583195, worklistShardItemId#3583196L, buf#3583377]
(37) Exchange
Input [3]: [shardId#3583195, worklistShardItemId#3583196L, buf#3583377]
Arguments: hashpartitioning(shardId#3583195, worklistShardItemId#3583196L, 30), ENSURE_REQUIREMENTS, [plan_id=1027618]
(38) ObjectHashAggregate
Input [3]: [shardId#3583195, worklistShardItemId#3583196L, buf#3583377]
Keys [2]: [shardId#3583195, worklistShardItemId#3583196L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#3583198, demandStream, demandStream#3583199, kpis, kpis#3583200), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#3583198, demandStream, demandStream#3583199, kpis, kpis#3583200), 0, 0)#3583194]
Results [3]: [shardId#3583195, worklistShardItemId#3583196L, collect_list(struct(demandChannel, demandChannel#3583198, demandStream, demandStream#3583199, kpis, kpis#3583200), 0, 0)#3583194 AS channelStreamSpecificKpis#3583187]
(39) Sort [codegen id : 11]
Input [3]: [shardId#3583195, worklistShardItemId#3583196L, channelStreamSpecificKpis#3583187]
Arguments: [shardId#3583195 ASC NULLS FIRST, worklistShardItemId#3583196L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#3580449, worklistShardItemId#3581971L]
Right keys [2]: [shardId#3583195, worklistShardItemId#3583196L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, prodLocSpecificKpis#3583186, coalesce(channelStreamSpecificKpis#3583187, []) AS channelStreamSpecificKpis#3583201]
Input [43]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, prodLocSpecificKpis#3583186, shardId#3583195, worklistShardItemId#3583196L, channelStreamSpecificKpis#3583187]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, demandChannel#3583211, demandStream#3583212, kpis#3583213]
Arguments: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, demandChannel#3583211, demandStream#3583212, kpis#3583213], MapPartitionsRDD[152726] at start at FileStorageAdapterImpl.java:596, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, demandChannel#3583211, demandStream#3583212, kpis#3583213]
Condition : ((isnotnull(qty#3583210) AND isnotnull(kpis#3583213)) AND (isnotnull(shardId#3583208) AND isnotnull(worklistShardItemId#3583209L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, kpis#3583213]
Input [6]: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, demandChannel#3583211, demandStream#3583212, kpis#3583213]
(45) ObjectHashAggregate
Input [4]: [shardId#3583208, worklistShardItemId#3583209L, qty#3583210, kpis#3583213]
Keys [2]: [shardId#3583208, worklistShardItemId#3583209L]
Functions [1]: [partial_collect_list(struct(qty, qty#3583210, kpis, kpis#3583213), 0, 0)]
Aggregate Attributes [1]: [buf#3583378]
Results [3]: [shardId#3583208, worklistShardItemId#3583209L, buf#3583379]
(46) Exchange
Input [3]: [shardId#3583208, worklistShardItemId#3583209L, buf#3583379]
Arguments: hashpartitioning(shardId#3583208, worklistShardItemId#3583209L, 30), ENSURE_REQUIREMENTS, [plan_id=1027630]
(47) ObjectHashAggregate
Input [3]: [shardId#3583208, worklistShardItemId#3583209L, buf#3583379]
Keys [2]: [shardId#3583208, worklistShardItemId#3583209L]
Functions [1]: [collect_list(struct(qty, qty#3583210, kpis, kpis#3583213), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#3583210, kpis, kpis#3583213), 0, 0)#3583207]
Results [3]: [shardId#3583208, worklistShardItemId#3583209L, map_from_entries(collect_list(struct(qty, qty#3583210, kpis, kpis#3583213), 0, 0)#3583207) AS quantityKpis#3583202]
(48) Sort [codegen id : 14]
Input [3]: [shardId#3583208, worklistShardItemId#3583209L, quantityKpis#3583202]
Arguments: [shardId#3583208 ASC NULLS FIRST, worklistShardItemId#3583209L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#3580449, worklistShardItemId#3581971L]
Right keys [2]: [shardId#3583208, worklistShardItemId#3583209L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, prodLocSpecificKpis#3583186, channelStreamSpecificKpis#3583201, coalesce(quantityKpis#3583202, map(keys: [], values: [])) AS quantityKpis#3583214]
Input [44]: [shardId#3580449, worklistShardItemId#3581971L, quantityAfterProdPlantOptimization#3581972, qty#3581973, orderProposalId#3582422L, originalReplenishmentRunId#3582464L, supplierGroup#3582424, supplier#3582425, supplyingPlant#3582429, productGroup#3582430, product#3582431, plant#3582426, subrange#3582428, orderDateTime#3582432, deliveryDateTime#3582427, availabilityDateTime#3582433, nextAvailabilityDateTime#3582434, constraintValues#3582455, constraintOperators#3582454, constraintLabels#3582453, logisticUnits#3582449, orderQuantityBaseUom#3582450, orderQuantityBaseUomUuid#3582451, splitIndicator#3582441L, netPriceAmount#3582458, netPriceCurrencyCode#3582459, netPriceQuantity#3582460, netPriceQuantityUom#3582461, netPriceQuantityUomUuid#3582462, sourceOfSupplyUuid#3582436, minimumOrderQuantity#3582452, orderProposalItemId#3582423, orderProposalItemGroupId#3582446, optimizationGroups#3582465, measurements#3582463, externalProductId#3582447, externalPlantId#3582448, previousOrderProposal#3582442L, isFallbackOrderOnly#3582439, prodLocSpecificKpis#3583186, channelStreamSpecificKpis#3583201, shardId#3583208, worklistShardItemId#3583209L, quantityKpis#3583202]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214, shardId#3580449]
Condition : ((isnotnull(shardId#3580449) AND (shardId#3580449 = 0_3_10000000532)) AND (size(quantityKpis#3583214, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214]
Input [4]: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214, shardId#3580449]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#3582199L, orderProposalItemId#3582200, quantityKpis#3583214]
Arguments: explode(quantityKpis#3583214), [orderProposalId#3582199L, orderProposalItemId#3582200], false, [orderQuantityInBaseUnit#3593421, kpis#3593422]
(54) Project
Output [8]: [orderProposalId#3582199L, cast(orderProposalItemId#3582200 as bigint) AS orderProposalItemId#3593420L, orderQuantityInBaseUnit#3593421, filter(kpis#3593422, lambdafunction((lambda x_12005#3593424.label = ServiceLevel), lambda x_12005#3593424, false))[0].value AS serviceLevel#3593423, filter(kpis#3593422, lambdafunction((lambda x_12006#3593426.label = RangeOfCoverage), lambda x_12006#3593426, false))[0].value AS rangeOfCoverage#3593425, filter(kpis#3593422, lambdafunction((lambda x_12007#3593428.label = ServiceLevelAtStartOfDelisting), lambda x_12007#3593428, false))[0].value AS serviceLevelAtEndOfListing#3593427, filter(kpis#3593422, lambdafunction((lambda x_12008#3593430.label = ServiceLevelMinimumStock), lambda x_12008#3593430, false))[0].value AS serviceLevelMinStock#3593429, 10000000532 AS replenishmentRunId#3593432L]
Input [4]: [orderProposalId#3582199L, orderProposalItemId#3582200, orderQuantityInBaseUnit#3593421, kpis#3593422]
(55) WriteFiles
Input [8]: [orderProposalId#3582199L, orderProposalItemId#3593420L, orderQuantityInBaseUnit#3593421, serviceLevel#3593423, rangeOfCoverage#3593425, serviceLevelAtEndOfListing#3593427, serviceLevelMinStock#3593429, replenishmentRunId#3593432L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_3_10000000532/sequenceId=2, false, Parquet, [path=hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000000532/shardId=0_3_10000000532/sequenceId=2], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, serviceLevelMinStock, replenishmentRunId]