vllm:kv_cache_usage_perc

Gauge for KV-cache usage where 1 means 100 percent usage.

MetricPrometheusvLLM v0.23.0verified 7 hr ago

Claim	Verified
In vLLM v0.23.0, `vllm:kv_cache_usage_perc` is a Prometheus gauge for KV-cache usage where 1 means 100 percent usage.	7 hr ago
In vLLM v0.23.0, `vllm:kv_cache_usage_perc` is set from `SchedulerStats.kv_cache_usage` and observes KV-cache usage pressure.	7 hr ago

vllm:kv_cache_usage_perc is registered as a Prometheus gauge in vLLM v0.23.0.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisher

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:519-527