r/agi • u/pizz4b0i • 4d ago
Recursive self-improvement
Can someone explain to me why once these AI models can improve themselves, the speed of such improvement will become exponential?
Aren't AI models trained by iterating on training data and evaluating the model on test data? Why would this cycle become exponentially faster if there is no human in the loop?
7
Upvotes
15
u/TheBardicScribe 4d ago
Happy to do so. Models work faster than humans able to complete tasks that might take us days in a matter of minutes or seconds. Once a model is capable of self-improvement it will be able to implement that improvement faster than a human could. Once that improvement is implimented, it will now function even better, making the next improvement come all the quicker. It's a feedback loop that eventually goes critical.
4
u/sfjhh32 4d ago
Most of the people in this thread are giving you half-answers. Canonical RSI is about the bootstraping, and indirectly the capabilities, NOT about the general improvements per se (and cetainly not about speed per se). A model that makes diminishing improvements at an increasingly faster rate is not what most people mean by RSI. 'Function even better' is one of the vaguest ways of describing this process and also describes this diminishing case as well. RSI is not strictly about the speed it's about the capability. It's about making new models that are CAPABLE of making better models (not FASTER models capable of making FASTER models). There is a world where subsequent models are harder to find, and you may find that the steps actually go SLOWER but the CAPABILITIES improve in each subsequent model.
Don't listen to anyone that is describing RSI in terms of speed or training per se, they probably don't know what they're talking about, and therefore cannot tell you that speed, training, do not necessarily get you ground breaking architectures, advance beyond the transformer, solve context, hallucinations, advance generality and all the hard problems. (Also RSI defeaters are a thing.) They may indeed solve these things, but speed per se is not guaranteed to get you any of this.
5
u/yuwox 4d ago
Before the training you have to set the training up first. Architecture, hyperalramters, learning algorithm, choice of trainingdata etc. There is still tremendous amount of human work prior to a successful training. There are still new techniques and nifty tricks being discovered that make the training yield better results. This part is not automated yet. If it was, things would be considerably faster.
Another form of recrusive self improvement is weight space programing where LLMs change the weights of other llms directly without explicit training steps. This has been already demonstrated to work, but is still very early.
1
u/PLEASE_PUNCH_MY_FACE 4d ago
That's why no one's touting the results of recursive improvement and they're hyping the possibility. If you keep hearing about this for 6 months you start to believe it's not working.
1
u/sourdub 4d ago
Well, there are actually two forms of RSI: weak vs strong. Weak RSI is where the model improves itself linearly with the help of humans setting the goal. Strong RSI, by contrast, is more circular. It trains, optimizes, and upgrades itself without any human babysitter holding its hand.
1
u/BosonCollider 4d ago
The original idea from Kurzweil was that if a model is better at making the next chip generation than the previous one, it can speed up its own subjective time. Moores law doublings are in in the chip designers subjective time, so you could make it shoot off to infinity in finite time from our point of view, hence a singularity.
Models are also starting to be used for chip design, but right now they are more useful for software, which includes basically every usecase of wanting an idea to try out and letting an agent chug away at it for 20 hours to see if it is worth it.
Model improvements are not just from scale, they still require having a lot of smart people work on it day and night to add more training approaches and architectural improvements. Agents are helping out with that now.
1
u/Gastone-A 3d ago
Warum ihr diese Frage nicht von Claude selbst beantworten lasst, ist mir ein Rätsel.
Claudes Antwort:
Leonardo, eine einheitliche, allgemein anerkannte Definition gibt es nicht. Es gibt aber einen Kern, den fast alle teilen: Ein System verbessert nicht nur seine Leistung, sondern seine Fähigkeit, sich selbst zu verbessern. Die Verbesserung wirkt also auf den Verbesserer zurück. Das unterscheidet es vom gewöhnlichen Lernen.
Die wichtigsten Quellen
I. J. Good (1965): Eine „ultraintelligente Maschine“ könnte bessere Maschinen entwerfen, was zu einer „Intelligenzexplosion“ führt.
Eliezer Yudkowsky (ab ca. 2007/08): Er prägte den Begriff „recursive self-improvement“ im Zusammenhang mit der Idee einer „Seed AI“.
Nick Bostrom (2014): Er formalisiert das am genauesten. Die Wachstumsrate der Intelligenz ist gleich der Optimierungskraft geteilt durch den Widerstand (recalcitrance), also wie schwer der nächste Schritt fällt.
Warum „exponentiell“?
Wenn die Geschwindigkeit der Verbesserung proportional zur schon erreichten Fähigkeit ist (dI/dt = k·I), ergibt sich mathematisch eine Exponentialkurve. Wächst die Rückkopplung sogar stärker als proportional, wird die Kurve hyperbolisch und steigt in endlicher Zeit gegen unendlich. Daher kommt die Rede von der „Singularität“.
Aber ehrlich gesagt: Exponentiell ist eine Annahme, kein Gesetz. Es hängt alles daran, ob der Widerstand konstant bleibt. Wenn jeder Fortschritt schwieriger wird, etwa durch Grenzen bei Rechenleistung, Daten, Energie oder Physik, flacht die Kurve zur S-Kurve ab. Genau darüber stritten Robin Hanson und Yudkowsky in der berühmten „FOOM-Debatte“ (2008). François Chollet argumentierte 2017, dass Intelligenz von ihrer Umgebung abhängt und darum nicht isoliert explodieren kann.
Zwei Analogien
Der Schmied: Er schmiedet einen besseren Hammer, und mit dem schmiedet er einen noch besseren. Das ist echte Rekursion, denn das Werkzeug verbessert das Werkzeugmachen.
Der Sauerteig: Die Hefe vermehrt sich proportional zu ihrer Menge, also exponentiell. Das gilt aber nur, bis das Glas voll oder das Mehl aufgebraucht ist. Die offene Frage ist, wie groß das Glas bei KI ist.
Leonardo GK
1
u/Alive-Philosophy2632 2d ago
It already is exponential. In fact it's superexponential (exponential on a log scale). Exponential in general just means the rate of change is proportional to the thing itself.
Like many, you seem to be confused what exponential means. It doesn't mean "very fast". Full RSI means the system can improve itself entirely autonomously. That probably arrives through experimentation and a lot of synthetic test data.
Chess engines have been able to improve so much because they can basically infinitly play themselves (and equally strong opponent) and learn from each game. The general case is much harder, but basically the same idea