vLLM v0.23.0 v1 metrics stats.py

Type: source_file
Publisher: vllm-project
Relationship: first_party
Version: vLLM v0.23.0
Retrieved: Jun 25
Local snapshot: corpus/domains/vllm/core-v0/evidence/snapshots/vllm-code-v0230-v1-metrics-stats.py
SHA-256: 08eb6bb969ad47e4…

Claims citing this source (6)

Claim	Locator	Verified
In vLLM v0.23.0, `decode_time` is computed as `req_stats.last_token_ts` - `req_stats.first_token_ts`; the source comment describes the decode interval as from first `NEW_TOKEN` to last `NEW_TOKEN` and says any preemptions during decode are included.	vllm/v1/metrics/stats.py:446-448	4 min ago
In vLLM v0.23.0, `vllm:prefix_cache_queries` is incremented from `SchedulerStats.prefix_cache_stats.queries` on each logging update and observes prefix-cache token reuse for the first-party prefix cache (KV-connector prefix-cache reuse is reported by the separate `vllm:external_prefix_cache_*` counters).	vllm/v1/metrics/stats.py:24-33	4 min ago
In vLLM v0.23.0, `vllm:prefix_cache_hits` is incremented from `SchedulerStats.prefix_cache_stats.hits` on each logging update and observes prefix-cache token reuse for the first-party prefix cache (KV-connector prefix-cache reuse is reported by the separate `vllm:external_prefix_cache_*` counters).	vllm/v1/metrics/stats.py:24-33	4 min ago
In vLLM v0.23.0, `vllm:num_requests_running` is set from `SchedulerStats.num_running_reqs` and observes scheduler running-request state.	vllm/v1/metrics/stats.py:171-176	4 min ago
In vLLM v0.23.0, `vllm:kv_cache_usage_perc` is set from `SchedulerStats.kv_cache_usage` and observes KV-cache usage pressure.	vllm/v1/metrics/stats.py:171-188	4 min ago
In vLLM v0.23.0, `vllm:num_preemptions` increments from `IterationStats.num_preempted_reqs`, which is increased when engine-core events mark requests as preempted.	vllm/v1/metrics/stats.py:419-426	4 min ago

Entities grounded in this source (0)

No availability records cite this source.