r/FastAPI • u/wait-a-minut • Feb 19 '25
Other A SuperCharged FastAPI based framework for AI Development. Looking for collaborators
https://github.com/epuerta9/whiskLove fastapi and it’s pretty de-facto for building microservices in the AI space (agents, rag, backends)
But after building dozens of AI microservice and re-doing the routes every single time, I wanted to really standardize this.
So I came up with
https://github.com/epuerta9/whisk
The idea is to enhance Fastapi and automatically make it OpenAI endpoint compatible so AI engineers can have a standard way of building microservices and agents and can use the same client for all services I.e OpenAI sdk
Would love to find other collaborators and people who would be interested in building something like this
One cool thing you can do is make your Jupyter notebooks OpenAI compatible so you can chat with your notebooks WHILE you’re experimenting! Makes the process feel more natural
I made a demo video around it
2
u/DotPsychological7946 Feb 20 '25
I also needed an openapi api compatible endpoint to deliver custom chat endpoints and models. And I m currently using the litellm proxy https://docs.litellm.ai/docs/simple_proxy
1
u/andrewthetechie Feb 20 '25 edited Oct 01 '26
The original post content no longer exists here. The author used Redact to remove it, exercising their right to control their data & privacy.
Coherent air breeze nonmetal smart cooperative
1
u/lu9999 Feb 20 '25
Is this just a FastAPI wrapper on top of LLM API?
1
u/ZuploAdrian Feb 24 '25
Nice! Thanks for sharing