Auto-Scaling Thrash from Misconfigured Min/Max Workers
scaling
Clusters cycle between scale-up and scale-down events when min_workers is too low for baseline workload or max_workers is hit repeatedly, causing job delays and resource waste. 3-5 minute VM provisioning latency amplifies the impact.
Databricks insight details requires a free account. Sign in with Google or GitHub to access the full knowledge base.
Sign in to access