datafusion.parquet.pushdown_eval_time

Pushdown evaluation time

Dimensions:None

Available on:Native (1)

Native

pushdown_eval_time

Time spent evaluating pushdown predicates

Dimensions:None

Sources

Technical Annotations (7)

Configuration Parameters (4)

datafusion.execution.parquet.pushdown_filtersrecommended: false

default to avoid regressions until performance issues resolved

datafusion.execution.target_partitionsrecommended: 1

set to 1 during benchmarking to reduce variability

datafusion.execution.parquet.binary_as_stringrecommended: true

required for ClickBench data processing

datafusion.execution.parquet.reorder_filtersrecommended: false

Default false; enable to optimize filter ordering when pushdown enabled

Technical References (3)

ArrowPredicate APIcomponentlate materializationconceptarrow-rscomponent

Parquet filter pushdown causes query slowdowns for specific query patternswarning

▸

Low-selectivity filters cause unnecessary row-level evaluation overheadinfo

▸

Parquet predicate evaluation errors lost when pushdown filters enabledinfo

▸