vllm:prefix_cache_queries

Counter for prefix cache queries, in queried tokens.

MetricPrometheusvLLM v0.23.0verified 7 hr ago

Claim	Verified
In vLLM v0.23.0, `vllm:prefix_cache_queries` is a Prometheus counter measured in queried tokens — it counts tokens, not requests or cache blocks.	7 hr ago
In vLLM v0.23.0, `vllm:prefix_cache_queries` is incremented from `SchedulerStats.prefix_cache_stats.queries` on each logging update and observes prefix-cache token reuse for the first-party prefix cache (KV-connector prefix-cache reuse is reported by the separate `vllm:external_prefix_cache_*` counters).	7 hr ago

vllm:prefix_cache_queries is registered as a Prometheus counter in vLLM v0.23.0.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:542-551