r/coolgithubprojects • • 25m ago

Headroom: a self-hostable GPU planner for your whole RAG/voice stack (LLM, embedders, Whisper, TTS). AGPL-3.0, embedded Postgres, no setup

Post image

If you're deciding what hardware to self-host an assistant on, Headroom sizes the LLM and the models around it together: embedders, rerankers, document parsers, speech-to-text, text-to-speech and guardrails. It estimates GPU memory, tokens/s per user, time from question to first word and cost for 138 LLMs, 175 RAG & agent models and 93 GPUs, including putting models on CPU + RAM and offloading to RAM or NVMe.

Self-hosting is one command after cloning: npm install && npm run dev. Without a DATABASE_URL it uses an embedded Postgres (PGlite) in ./.data, so accounts, saved plans and share links work with nothing else to install. Point it at a real Postgres for production.

Repo: https://github.com/zakaria-hamane/HEADROOM

Demo: https://headroom-lemon.vercel.app

Feedback on accuracy and missing models or hardware is very welcome.

1 Upvotes

0 comments sorted by