Single-threaded task saturates API rate limits

A single Luigi task thread can saturate low API rate limits by making requests too quickly, triggering rate limit responses from the external service even without concurrent tasks.

Implement custom rate limiting logic within the task code. When receiving a rate limit response from the API, implement backoff logic (delay) and retry the request until it succeeds.