vllm:num_requests_waiting_by_reason

Gauge that breaks waiting requests into capacity and deferred reasons.

MetricPrometheusvLLM v0.23.0verified 7 hr ago

Claim	Verified
In vLLM v0.23.0, `vllm:num_requests_waiting_by_reason` is a Prometheus gauge with reason labels capacity and deferred, and its reasons sum to `vllm:num_requests_waiting`.	7 hr ago

vllm:num_requests_waiting_by_reason is registered as a Prometheus gauge with a reason label in vLLM v0.23.0.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:471-491