Schema.aivllm:generation_tokens
Counter for the number of generation tokens processed.
MetricPrometheusvLLM v0.23.0verified 10 hr ago
Identity
- Prometheus type
- counter
- Labels
- model_nameengine
- Unit
- Not recorded — vLLM registration code has no structured unit field, and units are not inferred from name suffixes
Semantic coverage
covered · Availability & namecovered · Structural identitycovered · Measurement semanticscovered · Causal/runtime semanticscovered · Interpretation & compositioncovered · Guarded guidance
Metric knowledge (6)
| Claim | Semantic layer | Verified |
|---|---|---|
In vLLM v0.23.0, vllm:generation_tokens counts generation tokens processed across iterations. | Measurement semantics | 10 hr ago |
In vLLM v0.23.0, vllm:generation_tokens increments from IterationStats.num_generation_tokens during iteration logging. | Causal/runtime semantics | 10 hr ago |
In vLLM v0.23.0, vllm:generation_tokens is aggregate token work and not a per-request latency, fairness, or completion measure. | Interpretation & composition | 10 hr ago |
In vLLM v0.23.0, vllm:generation_tokens use rate for aggregate decode throughput and pair it with ITL/TPOT/TTFT distributions before judging user experience. | Guarded guidance | 10 hr ago |
In vLLM v0.23.0, vllm:generation_tokens is registered as a Prometheus counter. | Structural identity | 10 hr ago |
In vLLM v0.23.0, vllm:generation_tokens is registered with the label names model_name, engine. | Structural identity | 10 hr ago |
Related Use Cases (1)
Availability
vllm:generation_tokens is registered as a Prometheus counter in vLLM v0.23.0.vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher