All versions · Version range: v0.4.2–v0.23.0
max_model_len
Maximum sequence length, including prompt and output tokens, used by vLLM configuration and scheduler validation.
SettingvLLM v0.4.2vLLM v0.23.0verified Jul 9
Metric knowledge (0)
Availability
max_model_len is exposed as a SchedulerConfig constructor parameter in the v0.4.2 source snapshot.vllm.config.scheduler_configpartial_promoted_sliceSchedulerConfig constructor surface in vLLM config.py
max_model_len is exposed on SchedulerConfig in the v0.23.0 source snapshot. The parameter is an InitVar stored on ModelConfig, used by SchedulerConfig for fallbacks and validation.vllm.config.scheduler_configcomplete_inventorySchedulerConfig InitVar constructor parameter in vllm/config/scheduler.py