is_encoder_decoder

SchedulerConfig InitVar marking encoder-decoder models; stored in ModelConfig and used to disable chunked prefill and prefix caching.

SettingvLLM v0.23.0verified Jul 9

Claims (0)

No claims about this entity yet.

Availability

is_encoder_decoder is exposed on SchedulerConfig in the v0.23.0 source snapshot. The parameter is an InitVar stored on ModelConfig, used by SchedulerConfig for fallbacks and validation.

vllm.config.scheduler_configcomplete_inventorySchedulerConfig InitVar constructor parameter in vllm/config/scheduler.py

vLLM v0.23.0 config scheduler.py · vllm/config/scheduler.py:35-40