SchedulerConfig
complete inventoryvLLM v0.23.020 inventoried members
Surface
vLLM scheduler configuration class.
Inventoried members (20)
| Member | Description | Registration gates | Source |
|---|---|---|---|
| async_scheduling | async_scheduling is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| disable_chunked_mm_input | disable_chunked_mm_input is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| disable_hybrid_kv_cache_manager | disable_hybrid_kv_cache_manager is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| enable_chunked_prefill | enable_chunked_prefill is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| encoder_cache_size | encoder_cache_size is exposed on SchedulerConfig in the v0.23.0 source snapshot. The field is init=False and derived from max_num_batched_tokens, not constructor-settable. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py; init=False | github.com |
| is_encoder_decoder | is_encoder_decoder is exposed on SchedulerConfig in the v0.23.0 source snapshot. The parameter is an InitVar stored on ModelConfig, used by SchedulerConfig for fallbacks and validation. | SchedulerConfig InitVar constructor parameter in vllm/config/scheduler.py | github.com |
| is_multimodal_model | is_multimodal_model is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| long_prefill_token_threshold | long_prefill_token_threshold is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| max_long_partial_prefills | max_long_partial_prefills is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| max_model_len | max_model_len is exposed on SchedulerConfig in the v0.23.0 source snapshot. The parameter is an InitVar stored on ModelConfig, used by SchedulerConfig for fallbacks and validation. | SchedulerConfig InitVar constructor parameter in vllm/config/scheduler.py | github.com |
| max_num_batched_tokens | max_num_batched_tokens is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| max_num_encoder_input_tokens | max_num_encoder_input_tokens is exposed on SchedulerConfig in the v0.23.0 source snapshot. The field is init=False and derived from max_num_batched_tokens, not constructor-settable. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py; init=False | github.com |
| max_num_partial_prefills | max_num_partial_prefills is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| max_num_scheduled_tokens | max_num_scheduled_tokens is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| max_num_seqs | max_num_seqs is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| policy | policy is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| runner_type | runner_type is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| scheduler_cls | scheduler_cls is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| scheduler_reserve_full_isl | scheduler_reserve_full_isl is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |
| stream_interval | stream_interval is exposed on SchedulerConfig in the v0.23.0 source snapshot. | SchedulerConfig dataclass field surface in vllm/config/scheduler.py | github.com |