vllm:kv_block_reuse_gap_seconds

Histogram of time gaps between consecutive KV cache block accesses; sampled metric.

MetricPrometheusvLLM v0.23.0verified Jun 25

Claims (0)

No claims about this entity yet.

Availability

vllm:kv_block_reuse_gap_seconds is registered as a Prometheus histogram in vLLM v0.23.0. Registration requires observability_config.kv_cache_metrics=True.

vllm.surface.prometheus_metricscomplete_inventoryPrometheusStatLogger metrics publisherobservability_config.kv_cache_metrics=True

vLLM v0.23.0 v1 metrics loggers.py · vllm/v1/metrics/loggers.py:987-1000