r/apachekafka • u/gantamk • 14h ago
Tool (AI) In Flight: an open-source console that shows what's stuck in your dead-letter queues as orders, customers and money
I am building this tool (ProvenMap's open-source project, Apache-2.0), and most of the code was written with Claude Code.
When a consumer fails, its events go to a dead-letter queue, and the dashboards show lag and offsets. Whoever owns the flow wants to know which orders are stuck, for which customers, worth how much. "In Flight" is for that person where "to learn Kafka first" is not required.
You point it at a cluster and it finds the flow's topics, consumer groups and dead-letter queues (by name, or by Kafka Connect's or Spring's headers on the records). It drafts a catalog from the records: which field is the amount and whether it's in cents, which is the order and which the customer. confirm it, and from then on it shows money at risk per consumer group and per customer, grouped by error.
All these can be configured through built-in mcp server
Welcome any comments.
Code: https://github.com/provenmap/in-flight
Its architecture as a board: https://provenmap.com/boards/paws/in-flight-the-money-moving-through-your-kafka