vLLM v0.9.1
knowledge available0 claims2 metric facts
Prefix-cache metrics
| Metric | State | Meaning |
|---|---|---|
| vllm:gpu_prefix_cache_hits | present | Counts prefix-cache activity in tokens. |
| vllm:gpu_prefix_cache_queries | present | Counts prefix-cache activity in tokens. |
Schema.ai· vLLM· Schema 0.2.0