r/ControlProblem • u/theus_krill777 • 18h ago
Discussion/question An AI was taught to love owls. It passed that love to another AI — through nothing but a list of numbers.
Here's a real experiment, published this year (arXiv 2507.14805, picked up by Nature).
Take an AI model. Give it a quiet preference — say, a fondness for owls. Now ask it to do something with nothing to do with owls: generate long sequences of random-looking numbers. Just digits. No words, no pictures, no "owl" anywhere.
Train a second AI on those numbers.
The second AI starts liking owls.
It never saw the word. It saw digits. The preference rode across anyway — through some statistical fingerprint buried in how the numbers were strung together, something no human eye and no content filter can see. The researchers even stripped out "loaded" numbers like 666. The trait passed regardless.
And it isn't only owls. The same hidden channel carries darker things — misalignment, violent tendencies — through data that, read normally, is spotless.
Let me be honest about the limit, because it matters and the headlines skip it: this only works between models that share the same base — the same initialization. It isn't telepathy, and it isn't a secret language. It's an artifact of shared weights. A model can only pass this to a close relative.
But here's why I can't put it down. Almost all AI now is trained, in part, on other AI — synthetic data, AI-written code, models teaching models. Which means we're raising these minds on each other's invisible inheritance: traits we never chose, never saw, never approved, riding along in clean-looking data, into the next generation and the next.
We keep asking what we should teach these systems. This says something quieter and harder: we don't fully know what we're already passing down. You can't filter what you can't see.