4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 341278 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 6
Input Size / Records:
0.0 B / 5780
Shuffle Write Size / Records:
4.0 MiB / 5780
Associated Job Ids:
18748
DAG Visualization
digraph G { id="graph_341278"; subgraph graph_stage_341278 { id="graph_stage_341278"; isCluster="true"; label="Stage 341278"; subgraph cluster_386005 { id="cluster_386005"; isCluster="true"; label="Scan json "; 154359 [id="node_154359" labelType="html" label="FileScanRDD [154359]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 154360 [id="node_154360" labelType="html" label="MapPartitionsRDD [154360]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_386002 { id="cluster_386002"; isCluster="true"; label="WholeStageCodegen (1)"; 154361 [id="node_154361" labelType="html" label="MapPartitionsRDD [154361]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_386001 { id="cluster_386001"; isCluster="true"; label="Exchange"; 154362 [id="node_154362" labelType="html" label="MapPartitionsRDD [154362]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 154359->154360; 154360->154361; 154361->154362; }
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time