vllm:kv_block_idle_before_evict_seconds

Histogram of idle time before KV cache block eviction; sampled metric.

MetricPrometheusvLLM v0.23.0verified Jun 25

Claims (0)

No claims about this entity yet.

Availability

vllm:kv_block_idle_before_evict_seconds is registered as a Prometheus histogram in vLLM v0.23.0. Registration requires observability_config.kv_cache_metrics=True.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisherobservability_config.kv_cache_metrics=True

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:974-985