posthog.kafka.queue_size

Events waiting in Kafka queue

Dimensions:None

Technical Annotations (22)

Configuration Parameters (3)

Kafka retentionrecommended: 3 days

Provided recovery window for recent data after storage loss

redis.volumesrecommended: /srv/posthog/redis:/data

Prevents watermark loss on container restart

kafka.volumesrecommended: /srv/posthog/kafka/data:/bitnami/kafka

Prevents offset reset on container restart

Error Signatures (6)

connect ECONNREFUSED 172.20.0.6:9092log pattern

KafkaJSConnectionErrorexception

[Consumer] Crashlog pattern

Connection timeoutlog pattern

Shutting plugin server down gracefully with SIGTERMlog pattern

dropCause":"high_water_mark_partitionlog pattern

CLI Commands (1)

docker psdiagnostic

Technical References (12)

backfillconceptclickhouse-ingestioncomponentscheduled-tasks-runnercomponentplugin-servercomponentkafka:9092componentsession_recording_snapshot_item_eventscomponentblob_ingester_consumercomponent/datafile path/bitnami/kafkafile pathingestion event queuecomponentingestion pipelinecomponentqueueing systemcomponent

Related Insights (4)

Kafka retention enables point-in-time recovery window for data lossinfo

▸

Kafka connection refused errors cause plugin server consumer crashescritical

▸

Session recordings dropped due to high water mark exceeding Kafka offsetcritical

▸

Event ingestion queue latency under increased throughputwarning

▸