SnowflakeApache Airflow

Pipeline fan-out generates excessive concurrent warehouse tasks

warning
performanceUpdated Mar 24, 2026
How to detect:

DAG pipelines triggering many concurrent tasks from a single event, with multiplicative parallel steps that exacerbate scanning, joins, and credit consumption.

Recommended action:

Collapse stages by pushing down filters and pruning early. Sequence dependent tasks to avoid redundant materializations. Limit max parallelism per DAG segment with resource-aware settings. Review runbooks after incidents to prevent repeat expansion.