max_long_partial_prefills
SchedulerConfig field for the maximum number of prompts longer than long_prefill_token_threshold prefilled concurrently under chunked prefill.
SettingvLLM v0.23.0verified Jul 9
Claims (0)
Availability
max_long_partial_prefills is exposed on SchedulerConfig in the v0.23.0 source snapshot.vllm.config.scheduler_configcomplete_inventorySchedulerConfig dataclass field surface in vllm/config/scheduler.py