The vLLM v0.23.0 metrics design docs state the metric of interest is the prefix cache hit rate (hits per query): the counters are exposed raw so operators compute the rate over an interval of their choosing with PromQL (rate(hits)/rate(queries)); vLLM's own logging equivalent aggregates hit_rate over the most recent queries.
MetricvLLM v0.23.0confidence: highverified 11 min agoverified-docs
Metric
prefix_cache_hitsApplies when
PrometheusStatLogger metrics publisherV1 metrics
Evidence
vLLM v0.23.0 metrics design docs(design/metrics.md:405-432)
definesprimarydocumentationdocs_extraction
Does not establish
- a healthy or target hit rate (workload-dependent)
- how to increase hit rate for a given workload
Guards
vllm_version= v0.23.0metric_name=vllm:prefix_cache_hitsruntime_component=kv_cache