Pipeline fan-out generates excessive concurrent warehouse tasks
warningperformanceUpdated Mar 24, 2026
Technologies:
How to detect:
DAG pipelines triggering many concurrent tasks from a single event, with multiplicative parallel steps that exacerbate scanning, joins, and credit consumption.
Recommended action:
Collapse stages by pushing down filters and pruning early. Sequence dependent tasks to avoid redundant materializations. Limit max parallelism per DAG segment with resource-aware settings. Review runbooks after incidents to prevent repeat expansion.