vllm:num_requests_waiting

Gauge for the number of requests waiting to be processed.

MetricPrometheusvLLM v0.23.0verified 7 hr ago

Claim	Verified
In vLLM v0.23.0, `vllm:num_requests_waiting` is a Prometheus gauge for the number of requests waiting to be processed.	7 hr ago

vllm:num_requests_waiting is registered as a Prometheus gauge in vLLM v0.23.0.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:461-469