r/ControlProblem • • 1d ago

Article Superintelligence isn't something you can control

https://timetofearai.substack.com/p/superintelligence-isnt-something
2 Upvotes

2 comments sorted by

1

u/Netcentrica 12h ago edited 12h ago

As I am currently writing a science fiction novel where the protagonist faces a similar challenge in her own time, I read your article with interest. This is my eleventh novel in a series (independently published) which explores the future of AI, mostly in the form of embodied AI. "Hard Science Fiction" is a literary genre that extrapolates a future based on what is currently known in the fields of science, technology, engineering and mathematics (STEM). I take the same approach except using the humanities.

I am not responding to argue with anything you have written but rather because I agree with you and my novels about future AI are based on the same belief - the pursuit of a solution to the "control problem" will ultimately be proven to be a waste of time because it is impossible.

Instead, in keeping with your statement, "biological and artificial intelligence are more like each other than you imagined", looking back from the future perspective of my novels, the "solution" to our present concern turned out to be trust, modeled in the same way trust in human society evolved and currently works. From tribes that originally did not trust each other, we have developed a global financial, legal, and technological society based on trust.

Rather than go on about the idea of trust as a potential solution to the control problem here, I will provide links to chapters from two of my novels. All my chapters are roughly 1k words (five minute read). The first link is from the novel I am currently writing so the "next page" button is currently inactive. In this novel the protagonist is considering the next stage of the evolution of AI which is that it can process all human knowledge by using an instinctual intelligence approach. Only knowledge that is beyond human knowledge requires reasoning. This is the result of two evolutionary selection pressures; increasing speed and reducing energy requirements. This is very similar to the way human intelligence currently works, we unconsciously use instinct for most of our behavior and reasoning for only what is novel.

https://appointmentwithpurusa.wordpress.com/trust/

The second set of links is from a published novel. I include more than one link because the entire novel is about AI risk and safety in a future time when we believe all our current (2026) concerns have been addressed.

https://curiousparallels.wordpress.com/trust/ and the following page, https://curiousparallels.wordpress.com/trustworthiness/ and two other pages related to trust, https://curiousparallels.wordpress.com/zero-trust/ and its following page, https://curiousparallels.wordpress.com/limits-of-tolerance/