Pricing
Docs
Log in
Get Started
/
Technologies
/
Apache Datafusion
/
Insights
Apache DataFusion insights
Open Source
Versions: []
32 metrics
OpenTelemetry
·
Native
·
Prometheus
Apache DataFusion
Native DataFusion scan performance optimization opportunities identified
info
datafusion.parquet.time_scanning
datafusion.parquet.bytes_scanned
datafusion.operator.elapsed_time
+1 more
github.com
11d ago
▸
Apache DataFusion
Dynamic filter pushdown causes type comparison error when joining VALUES against Dictionary-encoded Parquet columns
critical
datafusion.parquet.predicate_evaluation_errors
github.com
18d ago
▸
Apache DataFusion
Regression introduced in DataFusion 52.3.0 removing Dictionary array flattening
warning
github.com
18d ago
▸
Apache DataFusion
DataFusion crashes with assertion failures when batch_size differs from default 8192
critical
datafusion.operator.input_batches
github.com
19d ago
▸
Apache DataFusion
Explain plan validation tests fail with non-default batch_size
warning
github.com
19d ago
▸
Apache DataFusion
GROUP BY ALL with aliased aggregates causes physical plan error
warning
github.com
19d ago
▸
Apache DataFusion
Hash join optimizer selects non-partitioned mode causing 52x slower query execution
critical
datafusion.join.build_input_rows
datafusion.query.execution_time
datafusion.join.total_time
github.com
21d ago
▸
Apache DataFusion
Aggregation operations under-partition causing multi-fold performance degradation
warning
datafusion.aggregate.groups
datafusion.query.execution_time
github.com
21d ago
▸
Apache DataFusion
concat_batches overhead causes 33x query performance degradation
critical
datafusion.query.execution_time
datafusion.operator.input_batches
github.com
21d ago
▸
Apache DataFusion
Hash join with empty build side reports zero output rows despite producing data
warning
datafusion.operator.output_rows
datafusion.join.build_input_rows
github.com
23d ago
▸
Apache DataFusion
Unnest with GROUP BY causes unbounded memory growth despite streaming
critical
datafusion.memory_pool.used
datafusion.operator.memory_used
datafusion.memory_pool.limit
+1 more
github.com
24d ago
▸
Apache DataFusion
Multi-partition sorting hits memory bugs causing spill coordination failures
critical
datafusion.operator.spill_count
datafusion.operator.spilled_bytes
datafusion.memory_pool.used
github.com
26d ago
▸
Apache DataFusion
Memory pool lacks dual watermark causing premature OOM errors
warning
datafusion.memory_pool.used
datafusion.memory_pool.limit
datafusion.memory_pool.reserved
github.com
26d ago
▸
Apache DataFusion
Fair pool unfairly allocates memory between spillable and non-spillable operators
warning
datafusion.operator.memory_used
datafusion.operator.spill_count
github.com
26d ago
▸
Apache DataFusion
Blocking memory allocation causes deadlock risk when waiting for memory
warning
datafusion.operator.elapsed_time
datafusion.memory_pool.used
github.com
26d ago
▸
Apache DataFusion
Spillable aggregation produces duplicate group keys due to internal state mismatch
critical
datafusion.operator.spill_count
datafusion.aggregate.groups
github.com
26d ago
▸
Apache DataFusion
Hash collisions can trigger aggregation correctness issues during testing
info
github.com
26d ago
▸
Apache DataFusion
TopK operator panics on Utf8 string column overflow beyond i32::MAX
critical
datafusion.operator.memory_used
github.com
1mo ago
▸
Apache DataFusion
Pipeline run failure detection via Cloud Monitoring metrics
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
Pipeline duration exceeds baseline indicating performance degradation
warning
oneuptime.com
1mo ago
▸
Apache DataFusion
Record count drop-off between pipeline stages indicates data loss
warning
oneuptime.com
1mo ago
▸
Apache DataFusion
Error record count exceeds threshold indicating data quality issues
warning
oneuptime.com
1mo ago
▸
Apache DataFusion
Connection timeout errors prevent pipeline from reaching data sources
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
Authentication failure blocks database access
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
Schema mismatch causes transformation failures
warning
oneuptime.com
1mo ago
▸
Apache DataFusion
Source stage failures from connectivity or query errors
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
BigQuery sink failures from permission or schema conflicts
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
Out of memory errors terminate pipeline execution
critical
oneuptime.com
1mo ago
▸
Apache DataFusion
Parquet filter pushdown causes query slowdowns for specific query patterns
warning
datafusion.parquet.pushdown_eval_time
datafusion.parquet.pushdown_rows_filtered
datafusion.query.execution_time
github.com
1mo ago
▸
Apache DataFusion
Aggregate dynamic filters cause overhead when pushed to Parquet reader
warning
datafusion.parquet.pushdown_rows_filtered
github.com
1mo ago
▸