llama_index.embedding.tokens

LlamaIndex embedding operations consume excessive tokens due to redundant document processing, lack of caching, or inefficient chunking strategies, increasing costs and latency.

Document embedding during indexing is inefficient due to small batch sizes or lack of batching, causing excessive API calls, increased latency, and higher costs compared to batch processing.