vLLM v0.16.0
knowledge available0 claims2 metric facts
Prefix-cache metrics
| Metric | State | Meaning |
|---|---|---|
| vllm:prefix_cache_hits | present | Counts prefix-cache activity in tokens. |
| vllm:prefix_cache_queries | present | Counts prefix-cache activity in tokens. |
Schema.ai· vLLM· Schema 0.2.0