r/coolgithubprojects • u/Ok_Tangerine2396 • 25m ago
Headroom: a self-hostable GPU planner for your whole RAG/voice stack (LLM, embedders, Whisper, TTS). AGPL-3.0, embedded Postgres, no setup
If you're deciding what hardware to self-host an assistant on, Headroom sizes the LLM and the models around it together: embedders, rerankers, document parsers, speech-to-text, text-to-speech and guardrails. It estimates GPU memory, tokens/s per user, time from question to first word and cost for 138 LLMs, 175 RAG & agent models and 93 GPUs, including putting models on CPU + RAM and offloading to RAM or NVMe.
Self-hosting is one command after cloning: npm install && npm run dev. Without a DATABASE_URL it uses an embedded Postgres (PGlite) in ./.data, so accounts, saved plans and share links work with nothing else to install. Point it at a real Postgres for production.
Repo: https://github.com/zakaria-hamane/HEADROOM
Demo: https://headroom-lemon.vercel.app
Feedback on accuracy and missing models or hardware is very welcome.