In vLLM v0.23.0, vllm:spec_decode_num_drafts is registered as a Prometheus counter when `speculative_config is not None`.
MetricvLLM v0.23.0confidence: highverified 13 min agoverified-code
Metric
spec_decode_num_draftsApplies when
PrometheusStatLogger metrics publisherV1 metricsspeculative_config is not None
Evidence
vLLM v0.23.0 v1 spec_decode metrics.py(vllm/v1/spec_decode/metrics.py:154-158)
definesprimarysource_codecode_introspection
Does not establish
- the metric's unit of measure
- what the metric measures semantically
- a healthy or expected value range
Guards
- vllm_version = v0.23.0
- metric_name = vllm:spec_decode_num_drafts