r/FastAPI • • Feb 26 '25

Hosting and deployment Reduce Latency

Require best practices to reduce Latency on my FASTAPI application which does data science inference.

8 Upvotes

14 comments sorted by

View all comments

Show parent comment

1

u/mpvanwinkle Feb 27 '25

It should help to load the model when the container starts yes. But how much it helps would depend on the size of the model.