Technologies/Apache Spark/spark_executor_id_count_shuffle_write
Apache SparkApache SparkMetric

spark_executor_id_count_shuffle_write

Total number of shuffled bytes in the executor
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Total number of shuffled bytes in the executor
Dimensions:None
Sources
spark.executor.id.total_shuffle_writegithub.com
Related Insights (1)
Shuffle Operation Data Skewwarning

Uneven data distribution during shuffle operations causes specific executors to process disproportionate data volumes, leading to straggler tasks and prolonged job durations.

▸