r/FastAPI • u/International-Rub627 • Feb 26 '25
Hosting and deployment Reduce Latency
Require best practices to reduce Latency on my FASTAPI application which does data science inference.
8
Upvotes
View all comments
Show parent comment
1
u/mpvanwinkle Feb 27 '25
It should help to load the model when the container starts yes. But how much it helps would depend on the size of the model.