vLLM v0.23.0 metrics design docs

Type: docs_page
Publisher: vllm-project
Relationship: first_party
Version: vLLM v0.23.0
Retrieved: Jun 25
Local snapshot: corpus/domains/vllm/core-v0/evidence/snapshots/vllm-docs-v0230-design-metrics.md
SHA-256: 5d5b8bab2b6d1e36…

Claim	Locator	Verified
The vLLM v0.23.0 metrics design docs state the metric of interest is the prefix cache hit rate (hits per query): the counters are exposed raw so operators compute the rate over an interval of their choosing with PromQL (`rate(hits)/rate(queries)`); vLLM's own logging equivalent aggregates `hit_rate` over the most recent queries.	design/metrics.md:405-432	5 min ago

No availability records cite this source.