In vLLM v0.23.0, `vllm:num_requests_waiting` is a Prometheus gauge for the number of requests waiting to be processed.

MetricvLLM v0.23.0confidence: highverified 11 hr agoverified-code

PrometheusStatLogger metrics publisherV1 metrics

vLLM v0.23.0 v1 metrics loggers.py(vllm/v1/metrics/loggers.py:461-469)

definesprimarysource_codecode_introspection

Pinned release-tag source snapshot; re-check if target phase-1 release changes or metrics API compatibility becomes customer-facing.

In vLLM v0.23.0, vllm:num_requests_waiting is a Prometheus gauge for the number of requests waiting to be processed.