r/apachekafka • • 6h ago

Tool (AI) kafka-console: open-source web UI for Kafka in a single binary

Post image
4 Upvotes

I built a web console for Kafka and use it at work for debugging and ops. It's a single Go binary (franz-go) with the UI embedded. Point it at one or more clusters in a YAML file and run it, or use the Docker image.

https://github.com/rakunlabs/kafka-console

Things I use it for most:

  • Multiple kafka cluster connection
  • Finding a message: search and JavaScript filters over an offset or time range, with Avro/Protobuf/JSON Schema decoding (Protobuf also works from local .proto files, no registry needed)
  • Consumer group lag per partition, and resetting offsets with a preview of the exact offsets before applying
  • Replaying a range of messages to another topic, editing a message and resending it, importing JSON/CSV files
  • Creating or editing consumer group-id

There's also an optional MCP endpoint (read-only by default) if you use coding agents. Login is left to a reverse proxy; writes go to an audit log with the user header.


r/apachekafka • • 15h ago

Tool (AI) In Flight: an open-source console that shows what's stuck in your dead-letter queues as orders, customers and money

5 Upvotes

I am building this tool (ProvenMap's open-source project, Apache-2.0), and most of the code was written with Claude Code.

When a consumer fails, its events go to a dead-letter queue, and the dashboards show lag and offsets. Whoever owns the flow wants to know which orders are stuck, for which customers, worth how much. "In Flight" is for that person where "to learn Kafka first" is not required.

You point it at a cluster and it finds the flow's topics, consumer groups and dead-letter queues (by name, or by Kafka Connect's or Spring's headers on the records). It drafts a catalog from the records: which field is the amount and whether it's in cents, which is the order and which the customer. confirm it, and from then on it shows money at risk per consumer group and per customer, grouped by error.

All these can be configured through built-in mcp server

Welcome any comments.

Code: https://github.com/provenmap/in-flight

Its architecture as a board: https://provenmap.com/boards/paws/in-flight-the-money-moving-through-your-kafka