Apache DataFusion

Pipeline run failure detection via Cloud Monitoring metrics

critical
availabilityUpdated Feb 17, 2026(via Exa)
How to detect:

Cloud Data Fusion pipeline run completes with FAILED status, indicating processing errors, connectivity issues, or resource exhaustion

Recommended action:

Create alert policy in Cloud Monitoring filtering on Resource type 'Cloud Data Fusion Pipeline', Metric 'pipeline/run_count', status='FAILED', threshold > 0. Configure notification channels (email, Slack, PagerDuty). Click failed run in Runs tab, identify red indicator on failed stage, review error details and logs