Prefect

Long-running tasks monopolize worker resources and block concurrency

warning
Resource ContentionUpdated Dec 3, 2025(via Exa)
Technologies:
How to detect:

Tasks with extended execution times monopolize CPU resources, consume increasing amounts of memory (especially with large datasets), and block concurrent task execution, leading to resource contention for shared resources like network bandwidth, disk I/O, and database connections

Recommended action:

Optimize task logic to reduce execution time. Break down long-running tasks into smaller, more manageable units. Adjust resource allocation and concurrency settings for workers. Monitor and profile tasks to identify bottlenecks or inefficiencies that contribute to extended execution times