Metrics
| Name | Description | Topics | Version | Verified | Sources |
|---|---|---|---|---|---|
| gpu_prefix_cache_hits | Counts prefix-cache activity in tokens. | v0.9.0 | |||
| gpu_prefix_cache_queries | Counts prefix-cache activity in tokens. | v0.9.0 |
Schema.ai· vLLM· Schema 0.2.0Schema.ai· vLLM· Schema 0.2.0| Name | Description | Topics | Version | Verified | Sources |
|---|---|---|---|---|---|
| gpu_prefix_cache_hits | Counts prefix-cache activity in tokens. | v0.9.0 | |||
| gpu_prefix_cache_queries | Counts prefix-cache activity in tokens. | v0.9.0 |