vllm:request_time_per_output_token_seconds

Histogram of mean time per output token per request.

MetricPrometheusvLLM v0.23.0verified Jun 25

No claims about this entity yet.

vllm:request_time_per_output_token_seconds is registered as a Prometheus histogram in vLLM v0.23.0.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:817-845