4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 331509 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 111276
Shuffle Write Size / Records:
892.7 KiB / 111276
Associated Job Ids:
18473
DAG Visualization
digraph G { id="graph_331509"; subgraph graph_stage_331509 { id="graph_stage_331509"; isCluster="true"; label="Stage 331509"; subgraph cluster_379075 { id="cluster_379075"; isCluster="true"; label="Scan parquet "; 151526 [id="node_151526" labelType="html" label="FileScanRDD [151526]<br>start at FileStorageAdapterImpl.java:596}"]; 151527 [id="node_151527" labelType="html" label="MapPartitionsRDD [151527]<br>start at FileStorageAdapterImpl.java:596}"]; } subgraph cluster_379069 { id="cluster_379069"; isCluster="true"; label="WholeStageCodegen (1)"; 151528 [id="node_151528" labelType="html" label="MapPartitionsRDD [151528]<br>start at FileStorageAdapterImpl.java:596}"]; } subgraph cluster_379068 { id="cluster_379068"; isCluster="true"; label="Exchange"; 151529 [id="node_151529" labelType="html" label="MapPartitionsRDD [151529]<br>start at FileStorageAdapterImpl.java:596}"]; } } 151526->151527; 151527->151528; 151528->151529; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time