Histogram of mean time per output token per request.
MetricPrometheusvLLM v0.23.0verified 10 hr ago
Identity
- Prometheus type
- histogram
- Labels
- model_nameengine
- Buckets
- 19 boundaries · 0.01 → 80
- Unit
- Not recorded — vLLM registration code has no structured unit field, and units are not inferred from name suffixes
Semantic coverage
covered · Availability & namecovered · Structural identitycovered · Measurement semanticscovered · Causal/runtime semanticscovered · Interpretation & compositioncovered · Guarded guidance
Metric knowledge (7)
| Claim | Semantic layer | Verified |
|---|
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds observes one per-finished-request mean decode interval divided by output-token intervals after the first token. | Measurement semantics | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds is computed from first-to-last-token decode time and num_generation_tokens minus one, with zero when no interval exists. | Causal/runtime semantics | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds is a request-weighted TPOT distribution and is not the same population as token-weighted inter_token_latency_seconds. | Interpretation & composition | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds use it for per-request decode experience; compare distributions under matched output lengths rather than substituting aggregate tokens per second. | Guarded guidance | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds is registered as a Prometheus histogram. | Structural identity | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds is registered with the label names model_name, engine. | Structural identity | 10 hr ago |
In vLLM v0.23.0, vllm:request_time_per_output_token_seconds declares 19 literal histogram bucket boundaries in its registration, from 0.01 to 80.0. | Structural identity | 10 hr ago |
Availability
vllm:request_time_per_output_token_seconds is registered as a Prometheus histogram in vLLM v0.23.0.
vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher
vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:817-845
Schema.ai