Technologies/Apache Spark/spark_executor_id_count_time
Apache SparkApache SparkMetric

spark_executor_id_count_time

Time spent by the executor executing tasks
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Time spent by the executor executing tasks
Dimensions:None
Sources
spark.executor.id.total_durationgithub.com
Related Insights (1)
Shuffle Operation Data Skewwarning

Uneven data distribution during shuffle operations causes specific executors to process disproportionate data volumes, leading to straggler tasks and prolonged job durations.

▸