omarsmak/kafka-consumer-lag-monitoring

Client tool that exports the consumer lag of Kafka consumer groups to Prometheus or your terminal

3 best points · 0 comments · 1 Hacker News post · 54 GitHub stars · View on GitHub

From the README

Kafka Consumer Lag Monitoring - Lightweight and Cloud Native Ready A client tool that exports the consumer lag of a Kafka consumer group to different implementations such as Prometheus or your terminal. It utlizes Kafka's AdminClient and Kafka's Consumer's client in order to fetch such metrics. Consumer lag calculated as follows: sum(topic_offset_per_partition-consumer_offset_per_partition) What is Consumer Lag and why is important? Quoting this article: > What is Kafka Consumer Lag? Kafka Consumer Lag is the indicator of how much lag there is between Kafka producers and consumers.... > Why is Consumer Lag Important?

Hacker News discussions

• Kafka Consumer Lag Monitoring for Prometheus or Your Terminal (3 points, 0 comments, by omarsmak2, 2019-02-17)