vllm:request_time_per_output_token_seconds

Histogram of mean time per output token per request.

MetricPrometheusvLLM v0.22.1

Semantic coverage

gap · Availability & namegap · Structural identitygap · Measurement semanticsgap · Causal/runtime semanticsgap · Interpretation & compositiongap · Guarded guidance

Metric knowledge (0)

No claims about this entity yet.