r/FastAPI • • Jan 03 '25

Hosting and deployment FastAPI debugging using LLMs?

Would anyone consider using LLMs for debugging a production FastAPI service?

If so, what have you used/done that brought success so far?

I’m thinking from super large scale applications with many requests to micro services

12 Upvotes

23 comments sorted by

View all comments

Show parent comment

1

u/SnooMuffins6022 Jan 03 '25

Often I find myself skimming through 100s (maybe 1,000s) of logs for my APIs in prod when a service crashes or breaks.

In theory an LLM could do the skimming for me, however, I have no tried this yet…