vllm:prefix_cache_queries

Names: vllm:prefix_cache_queries, vllm:gpu_prefix_cache_queries

Aliases: vllm:gpu_prefix_cache_queries → vllm:prefix_cache_queries

Counts prefix-cache activity in tokens.

Changed in v0.7.3: has_prometheus_metric_type claim set changed

Changed in v0.9.0: has_metric_semantics claim set changed

Changed in v0.9.2: has_name claim set changed

Changed in v0.9.2: alias_of claim set changed

        counter_gpu_prefix_cache_queries = self._counter_cls(
            name="vllm:gpu_prefix_cache_queries",
            documentation=(
                "GPU prefix cache queries, in terms of number of queried"
                "tokens. DEPRECATED: Use vllm:prefix_cache_queries instead."),
            labelnames=labelnames)

        counter_prefix_cache_queries = self._counter_cls(
            name="vllm:prefix_cache_queries",
            documentation=(
                "Prefix cache queries, in terms of number of queried tokens."),
            labelnames=labelnames)

# means the number of tokens that were queried from the cache.