Technologies/Apache Spark/spark_executor_count_tasks
Apache SparkApache SparkMetric

spark_executor_count_tasks

Total number of tasks in the application's executors
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Total number of tasks in the application's executors
Dimensions:None
Sources
spark.executor.total_tasksgithub.com
Related Insights (1)
Autoscaling Lag During Load Spikeswarning

Databricks autoscaling takes 3-5 minutes to provision new VMs during demand spikes, causing queued tasks and degraded performance while pending tasks exceed available executor cores.

▸