Schema.aivllm:prompt_tokens_cached
Counter for cached prompt tokens, local plus external.
MetricPrometheusvLLM v0.23.0verified 10 hr ago
Identity
- Prometheus type
- counter
- Labels
- model_nameengine
- Unit
- Not recorded — vLLM registration code has no structured unit field, and units are not inferred from name suffixes
Semantic coverage
covered · Availability & namecovered · Structural identitycovered · Measurement semanticscovered · Causal/runtime semanticscovered · Interpretation & compositioncovered · Guarded guidance
Metric knowledge (6)
| Claim | Semantic layer | Verified |
|---|---|---|
In vLLM v0.23.0, vllm:prompt_tokens_cached counts cached prompt tokens reused during processing, combining local and external sources. | Measurement semantics | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens_cached increments from the iteration PromptTokenStats.cached_tokens field. | Causal/runtime semantics | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens_cached is aggregate saved prompt-token work and is not by itself a per-request cache-hit percentage. | Interpretation & composition | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens_cached compare its rate with prompt-token demand under matching labels and windows; separate local/external attribution when required. | Guarded guidance | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens_cached is registered as a Prometheus counter. | Structural identity | 10 hr ago |
In vLLM v0.23.0, vllm:prompt_tokens_cached is registered with the label names model_name, engine. | Structural identity | 10 hr ago |
Related Use Cases (1)
Availability
vllm:prompt_tokens_cached is registered as a Prometheus counter in vLLM v0.23.0.vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher