Small batch indexing causes prolonged high CPU usage
warningperformanceUpdated Dec 20, 2021(via Exa)
Technologies:
How to detect:
High CPU usage and slow indexing when documents are sent in many small updates (e.g., one document at a time) rather than large batches
Recommended action:
Send documents in the largest batches possible to minimize CPU spikes; verify indexing status via /{index}/stats HTTP endpoint; upgrade to v0.26 or later for auto-batching feature that reduces this issue