datafusion.parquet.predicate_evaluation_errors

Predicate evaluation errors

Dimensions:None

Available on:Native (1)

Interface Metrics (1)

Native

predicate_evaluation_errors

Number of errors encountered during predicate evaluation

Dimensions:None

Sources

predicate_evaluation_errorsgithub.com

Technical Annotations (13)

Configuration Parameters (2)

datafusion.execution.parquet.pushdown_filtersrecommended: false

Disabling prevents the bug by avoiding row-level filter evaluation in Parquet reader

datafusion.execution.parquet.reorder_filtersrecommended: true

Used in reproducer setup, affects filter optimization

Error Signatures (2)

Parquet error: External: Compute error: Error evaluating filter predicate: ArrowError(InvalidArgumentError("Can't compare arrays of different types")

exception

Can't compare arrays of different typesexception

CLI Commands (3)

SET datafusion.execution.parquet.pushdown_filters = false;remediation

SET datafusion.execution.parquet.pushdown_filters = true;diagnostic

SET datafusion.execution.parquet.reorder_filters = true;diagnostic

Technical References (6)

ArrayStaticFiltercomponentHashJoinExeccomponentInListExprcomponentdowncast_dictionary_array!componentarrow_ord::ord::build_comparecomponentDictionary(Int32, Utf8)concept

Related Insights (2)

Dynamic filter pushdown causes type comparison error when joining VALUES against Dictionary-encoded Parquet columnscritical

▸

Parquet predicate evaluation errors lost when pushdown filters enabledinfo

▸