Schema.aivLLM v0.9.0.1
knowledge available0 claims2 metric facts
Prefix-cache metrics
| Metric | State | Meaning |
|---|---|---|
| vllm:gpu_prefix_cache_hits | present | Counts prefix-cache activity in tokens. |
| vllm:gpu_prefix_cache_queries | present | Counts prefix-cache activity in tokens. |