Skip to content

Latest commit

 

History

History

burrow

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
config
config
 
 
Readme.md
Readme.md
 
 
docker-compose.yml
docker-compose.yml
 
 

Readme.md

Burrow - consumer lag monitoring demo.

This sample demonstrates how to monitor consumer lag using LinkedIn Burrow and visualize metrics via Burrow Dashboard or BurrowUI.

Components

Dashboards

Burrow Dashboard - Home Page BurrowUI - Home Page BurrowUI - Total Lag Graph

Getting Started

Prerequisites

  • Java 11
  • Docker

Build

  • Run below command to build linkedin/burrow docker image:

    # Download burrow source code
curl -L https://github.com/linkedin/Burrow/archive/refs/tags/v1.3.6.zip | tar zx

# Build docker image locally
(cd Burrow-1.3.6 && docker build . -t linkedin/burrow:v1.3.6)

# Remove downloaded source code
rm -R Burrow-1.3.6

  • Build sample Kafka application using below command:

    ./gradlew bootBuildImage

Usage

  • Run the docker compose stack.

    cd ./docker/burrow
docker compose up -d

  • Check if all components are running.

    docker compose ps

#   NAME                   SERVICE                STATUS              PORTS
# burrow                 burrow                 running             0.0.0.0:8005->8000/tcp, :::8005->8000/tcp
# burrow-dashboard       burrow-dashboard       running             0.0.0.0:8006->80/tcp, :::8006->80/tcp
# burrowUI               burrowUI               running             0.0.0.0:8007->3000/tcp, :::8007->3000/tcp
# kafka                  kafka                  running             0.0.0.0:9092->9092/tcp, :::9092->9092/tcp, 0.0.0.0:9101->9101/tcp, :::9101->9101/tcp
# kafka-monitoring-app   kafka-monitoring-app   running             0.0.0.0:7777->7777/tcp, :::7777->7777/tcp
# zookeeper              zookeeper              running             0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 2888/tcp, 3888/tcp

  • Check available clusters inside Burrow.

  • Visit http://localhost:8005/v3/kafka/local/consumer/hello-events-listener/lag to check lag for hello-events-listener consumer group.

  • Open your web browser and go to:

  • Stop docker compose stack.

    docker compose down -v

Important Endpoints

Name Endpoint
Burrow http://localhost:8005/
Burrow Dashboard http://localhost:8006
BurrowUI http://localhost:8007

References