vllm:prefix_cache_queries

Names: vllm:prefix_cache_queries

Counts prefix-cache activity in tokens.

Changed in v0.7.3: has_prometheus_metric_type claim set changed

Changed in v0.9.0: has_metric_semantics claim set changed

Changed in v0.9.2: has_name claim set changed

        counter_prefix_cache_queries = self._counter_cls(
            name="vllm:prefix_cache_queries",
            documentation=(
                "Prefix cache queries, in terms of number of queried tokens."
            ),
            labelnames=labelnames,
        )

- `queries`: Refers to the number of tokens that were queried.