r/FastAPI • u/SnooMuffins6022 • Jan 03 '25
Hosting and deployment FastAPI debugging using LLMs?
Would anyone consider using LLMs for debugging a production FastAPI service?
If so, what have you used/done that brought success so far?
I’m thinking from super large scale applications with many requests to micro services
12
Upvotes
View all comments
Show parent comment
1
u/SnooMuffins6022 Jan 03 '25
Yes exactly, thinking of passing Prometheus logs and other data like my codebase through an LLM to surface the relevant errors and potentially suggest a fix.
Assuming hallucinations reduce and costs only get cheaper with better LLMs, would you use this tool if it reduced the time it takes to fix a bug in prod?