Technologies/DataHub/kafka_message_queue_time
DataHubDataHubMetric

kafka_message_queue_time

Time a message spent in Kafka queue before being consumed
Dimensions:None
Available on:Native (1)PrometheusPrometheus (1)
Interface Metrics (2)
Native
Time a message spent in Kafka queue before being consumed
Dimensions:None
PrometheusPrometheus
Kafka message queue time (lag)
Dimensions:None
Sources
kafka_message_queue_time_secondsdatahubproject.io
Related Insights (2)
Ingestion Source Backpressure from Sink Write Throttlingwarning

DataHub ingestion pipelines stall when sink write rate (sink_workunits_write) lags significantly behind source production rate (source_workunits_produced). This indicates downstream storage systems (Elasticsearch, database) cannot keep pace with ingestion volume.

▸
Kafka Consumer Lag Ingestion Backlogcritical

DataHub ingestion falling behind due to Kafka consumer lag, causing metadata changes and quality checks to be delayed, leading to stale lineage and undetected data quality issues.

▸