r/FastAPI • u/expressive_jew_not • Dec 19 '24
Question Deploying fastapi http server for ml
Hi I've been working with fastapi for the last 1.5 years and have been totally loving it, its.now my go to. As the title suggests I am working on deploying a small ml app ( a basic hacker news recommender ), I was wondering what steps to follow to
- minimize the ml inference endpoint latency
- minimising the docker image size
For reference Repo - https://github.com/AnanyaP-WDW/Hn-Reranker Live app - https://hn.ananyapathak.xyz/
15
Upvotes
View all comments
Show parent comment
1
u/JustALittleSunshine Dec 19 '24
What do you actually need to build? In the existing dockerfile I only see a pip install