Technologies/LlamaIndex/llama_index.llm.completion.tokens.prompt
LlamaIndexLlamaIndexMetric

llama_index.llm.completion.tokens.prompt

LLM prompt tokens
Dimensions:None
Available on:OpenTelemetryOpenTelemetry (1)DatadogDatadog (1)
Interface Metrics (2)
OpenTelemetryOpenTelemetry
Number of prompt tokens sent to the LLM
Dimensions:None
DatadogDatadog
Number of prompt tokens used in LLM operations
Dimensions:None
Sources
llama_index.llm.completion.tokens.promptgithub.com
llamaindex.llm.tokens.promptdocs.datadoghq.com
Related Insights (1)
LlamaIndex LLM Token Budget Overrunwarning

LlamaIndex agents can exceed token budgets via unmonitored prompt/completion expansion, causing unexpected costs and API rate limit errors without per-request cost tracking.

▸