Schema.ai· vLLM
vLLM v0.23.0API up

vLLM v0.23.0 v1 spec_decode metrics.py

Type
source_file
Publisher
vllm-project
Relationship
first_party
Version
vLLM v0.23.0
Retrieved
Jul 9
Local snapshot
corpus/domains/vllm/core-v0/evidence/snapshots/vllm-code-v0230-v1-spec-decode-metrics.py
SHA-256
acf306f1b453f33f

Claims citing this source (0)

No claims cite this source yet.

Metrics grounded in this source (4)

NameDescriptionLocator
spec_decode_num_draftsCounter for the number of speculative decoding drafts.vllm/v1/spec_decode/metrics.py:154-161
spec_decode_num_draft_tokensCounter for the number of speculative draft tokens.vllm/v1/spec_decode/metrics.py:163-170
spec_decode_num_accepted_tokensCounter for the number of accepted speculative tokens.vllm/v1/spec_decode/metrics.py:172-179
spec_decode_num_accepted_tokens_per_posCounter for accepted speculative tokens per draft position, labeled by position.vllm/v1/spec_decode/metrics.py:181-198

View all 4 in Metrics