Technologies/LlamaIndex/llama_index.template.format.duration
LlamaIndexLlamaIndexMetric

llama_index.template.format.duration

Template format duration
Dimensions:None
Available on:OpenTelemetryOpenTelemetry (1)
Interface Metrics (1)
OpenTelemetryOpenTelemetry
Duration of prompt template formatting operations in milliseconds
Dimensions:None
Sources
llama_index.template.format.durationgithub.com
Related Insights (1)
LlamaIndex Template Formatting Overheadinfo

Prompt template formatting introduces unexpected latency due to complex template logic, excessive variable substitutions, or inefficient rendering, adding milliseconds to every LLM call.

▸