Session recording enabled causes complete system failure after 30 minutes

critical

storageUpdated Feb 17, 2025(via Exa)

Sources

self-host basic bugs · Issue #28804 · PostHog/posthoggithub.com

Technologies:

MinIOThe root cause of this issue originates in MinIO

Apache KafkaApache Kafka metrics correlate with this issue and help confirm diagnosis

How to detect:

Approximately 30 minutes after enabling session recording, the PostHog panel stops loading and events stop being saved. All containers remain running but system becomes non-responsive. Error logs show 'storage slow' and '[session-manager] flush timed out' messages related to Minio object storage.

Recommended action:

Disable session recording feature until root cause is identified. Monitor for '[session-manager] flush timed out' errors in plugin logs. Investigate Minio configuration, network connectivity between plugin service and object storage, and object storage performance metrics. Ensure OBJECT_STORAGE_ENDPOINT, access keys, and network routing are correct.