4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 331511 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 87939
Shuffle Write Size / Records:
21.9 MiB / 87939
Associated Job Ids:
18474
DAG Visualization
digraph G { id="graph_331511"; subgraph graph_stage_331511 { id="graph_stage_331511"; isCluster="true"; label="Stage 331511"; subgraph cluster_379099 { id="cluster_379099"; isCluster="true"; label="Scan parquet "; 151533 [id="node_151533" labelType="html" label="FileScanRDD [151533]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 151534 [id="node_151534" labelType="html" label="MapPartitionsRDD [151534]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_379094 { id="cluster_379094"; isCluster="true"; label="WholeStageCodegen (1)"; 151535 [id="node_151535" labelType="html" label="MapPartitionsRDD [151535]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_379093 { id="cluster_379093"; isCluster="true"; label="Exchange"; 151536 [id="node_151536" labelType="html" label="MapPartitionsRDD [151536]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 151533->151534; 151534->151535; 151535->151536; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time