vllm:prompt_tokens
Counter for the number of prefill tokens processed.
MetricPrometheusvLLM v0.23.0verified 10 hr ago
Identity
- Prometheus type
- counter
- Labels
- model_nameengine
- Unit
- Not recorded — vLLM registration code has no structured unit field, and units are not inferred from name suffixes
Semantic coverage
covered · Availability & namecovered · Structural identitycovered · Measurement semanticscovered · Causal/runtime semanticscovered · Interpretation & compositioncovered · Guarded guidance
Metric knowledge (6)
| Claim | Semantic layer | Verified |
|---|---|---|
In vLLM v0.23.0, vllm:prompt_tokens counts prefill tokens processed across iterations. | Measurement semantics | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens increments from IterationStats.num_prompt_tokens during iteration logging. | Causal/runtime semantics | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens is aggregate prefill work and does not by itself distinguish cached from newly computed prompt tokens. | Interpretation & composition | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens use rate for prompt throughput and pair it with cached/computed-token and queue/TTFT metrics before drawing efficiency conclusions. | Guarded guidance | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens is registered as a Prometheus counter. | Structural identity | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens is registered with the label names model_name, engine. | Structural identity | 10 hr ago |
Related Use Cases (1)
Availability
vllm:prompt_tokens is registered as a Prometheus counter in vLLM v0.23.0.vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher