scheduler_reserve_full_isl
SchedulerConfig flag making the scheduler check that the full input sequence length fits in the KV cache before admitting a request.
SettingvLLM v0.23.0verified Jul 9
Claims (0)
Availability
scheduler_reserve_full_isl is exposed on SchedulerConfig in the v0.23.0 source snapshot.vllm.config.scheduler_configcomplete_inventorySchedulerConfig dataclass field surface in vllm/config/scheduler.py