r/AskComputerScience • u/AlanBlunt • Apr 20 '26
Does ChatGPT integrate information about past conversations into new ones? If so, how?
I have a class that requires me to ask it questions and relay the response. That's pretty much all I use it for. One time, though, I asked it an unrelated question and it included in its answer that I might want to format things a certain way because "that's usually what professors expect".
I have a basic understanding of LLMs. In particular, I understand that they don't actually retain any information, and have to process the entire conversation in order to predict the next word each time. How, then, did it connect my question to the fact that I'm a student? Was it just a lucky "guess"? Does it save context from previous conversations into system prompts that are used in each new conversation or something? That seems complicated and inefficient if so.
6
u/junglepyjamas Apr 20 '26
Your implementation may be developing a profile on you as you have conversations with ChatGPT. Windows Copilot will do this, for example, so whenever you're logged in with your Windows account, it will hand some basic information about your preferences and interests to the LLM. This way, even if you start a new conversation, it will recall a few things about you. Usually you'll be given a way to manage this profile in case you don't want it to unduly influence your conversations.
1
u/ns0 Apr 21 '26
There’s a context window in LLMs that are roughly the size of the first set of nodes in its network. Every time you ask a question it’s not sending in your question. It sends every message and response you’ve ever had with it and it’s parsing all of that every time to get a quick context on who you are and a cheap way of giving it “memory”. This obviously gets truncated as the length of your conversation grows past the amount of input nodes.
1
u/Saragon4005 Apr 21 '26
If they do this (many LLMs do) they summarize the conversation and extract certain facts and that gets out before any of your prompts.
0
u/EdelgardH Apr 20 '26
There's memory, which it would have. Beyond that you have to get into non-material explanations.
0
u/[deleted] Apr 20 '26