Technologies/LlamaIndex/llama_index.llm.tokens.total
LlamaIndexLlamaIndexMetric

llama_index.llm.tokens.total

Total LLM tokens
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Total number of tokens used in LLM operations (prompt + completion)
Dimensions:None
Sources
llamaindex.llm.tokens.totaldocs.datadoghq.com
Related Insights (2)
LlamaIndex LLM Token Budget Overrunwarning

LlamaIndex agents can exceed token budgets via unmonitored prompt/completion expansion, causing unexpected costs and API rate limit errors without per-request cost tracking.

▸
LlamaIndex LLM Request Rate Spikewarning

Abnormal spike in LLM request rate indicates potential abuse, runaway agent loops, or unexpected traffic patterns that can exhaust rate limits and inflate costs.

▸