vLLM v0.8.3
knowledge available0 claims2 metric facts
Prefix-cache metrics
| Metric | State | Meaning |
|---|---|---|
| vllm:gpu_prefix_cache_hits | present | Counts prefix-cache activity in blocks. |
| vllm:gpu_prefix_cache_queries | present | Counts prefix-cache activity in blocks. |
Schema.ai· vLLM· Schema 0.2.0