Celery

Celery workers exceed memory limit from accumulated test data

critical
Resource ContentionUpdated Feb 6, 2026(via Exa)
How to detect:

Feature flag cache update workers experience escalating out-of-memory (OOM) kills when processing accounts with excessive accumulated data. Workers with 8GB memory limits fail when cache update tasks load all flag definitions, cohorts, and serialized JSON payloads into memory simultaneously for data-heavy accounts.

Recommended action:

Clean up stale test data from affected accounts. Enable worker recycling with max_tasks_per_child=100 to provide memory headroom. Increase worker memory limits. Isolate test automation to dedicated environments. Implement batching or streaming for cache update tasks to avoid loading all data into memory at once.