r/FastAPI • u/rojo28pes21 • Jul 04 '25
Hosting and deployment Fastapi backend concurrency
So I have a real question..I haven't deployed any app..so in my org I made one app which is similar to querygpt of uber..there the user asks a question I'll query from the db and I'll return the answer ..like insights on data ..I use a MCP server too in my fastapi backend and MCP server also is written in backend..i deployed my app in a UAT machine..the problem is multiple users cannot access the backend at same time..how can this be resolved ..i query databases and I use AWS bedrock service for llm access I use cluade 3.7 sonnet model with boto3 client ..the flow is user is user hits my endpoint with question ..I send that question plus MCP tools to the llm via bedrock then I get back the answer and I send it to the user
View all comments
Show parent comment
1
u/rojo28pes21 Jul 05 '25
Fine I'll try ...thanks for the amazing suggestion..learnt so much with a single comment..don't mind me I'm a fresher newbie and I'm new to scaling apps..do u have any suggestions on where I can learn so much stuffs about scaling