Technologies/Grafana/confluent_platform_kafka_isr_shrinks_per_sec

confluent_platform_kafka_isr_shrinks_per_sec

Rate of in-sync replica set shrinks

Dimensions:None

Technical Annotations (17)

Configuration Parameters (6)

confluent.balancer.producer.in.max.bytes.per.secondrecommended: at least 20% below confluent.broker.limit.producer.bytes.per.second

provides headroom for maintenance while avoiding unnecessary replica movements

confluent.broker.limit.producer.bytes.per.secondrecommended: 20MB/sec

broker-wide produce bandwidth limit

confluent.balancer.replication.in.max.bytes.per.secondrecommended: >= (RF-1) * confluent.balancer.producer.in.max.bytes.per.second

must account for ISR replication traffic based on replication factor

replica.fetch.max.bytesrecommended: >= message.max.bytes

Must be at least as large as message.max.bytes to prevent replication issues

message.max.bytesrecommended: 1048576 (1MB default)

Maximum message size broker accepts

min.insync.replicasrecommended: 2

With replication.factor=3 and acks=all ensures majority quorum

Error Signatures (2)

NotEnoughReplicasexception

NotEnoughReplicasAfterAppendexception

Technical References (9)

ISRconceptConfluent Control CentercomponentSelf-Balancingcomponentreplicaconceptreplication factorconceptin-sync replicas (ISR)conceptmin.insync.replicascomponentminIsrcomponentin-sync replicasconcept

Related Insights (9)

ISR shrinkage progresses silently until data loss occurscritical

▸

Missing monitoring of ISR shrinks and consumer lag delays incident responsewarning

▸

Improper self-balancing throttle causes unnecessary replica movementswarning

▸

Replication inbound throttle insufficient for replication factor causes ISR issueswarning

▸

Under-replicated partitions indicate data durability riskwarning

▸

Partitions below minimum in-sync replicas thresholdwarning

▸

Replication failures when replica fetch limit smaller than message limitcritical

▸

Producer writes fail when in-sync replicas drop below minimum thresholdcritical

▸

Partitions fall below minimum in-sync replica countcritical

▸