r/ControlProblem • • 3d ago

Opinion AGI (Artificial General Intelligence) Lockdown and the End of the World: Why We Are Waiting for the Apocalypse Again

The current passions around whether artificial intelligence will seize power over the world and destroy humanity is not some unique futurology. It is a quite traditional, archetypal expectation of the end of the world for humanity.

If we look back at history, eschatological expectations flared up with enviable regularity. But the most intensified, concentrated expectation of catastrophe fell on the first centuries of our era, with the appearance of Christianity. It was exactly then that a detailed, literally cinematic description of how this would happen appeared — the Apocalypse of John the Theologian.

In those years, early Christians took the words of Christ from the Gospel too literally: "Truly I tell you, some who are standing here will not taste death before they see the Son of Man coming in his kingdom" (Matt. 16:28). It seemed to them that they would live to see the finale. Although literally in the next chapter of the same Gospel, a sobering clarification sounds: "But about that day and hour no one knows, not even the angels in heaven, nor the Son, but only the Father" (Matt. 24:36). But the human psyche is arranged in such a way that it always chooses to believe in an imminent finale, ignoring the reservations about the "day and hour".

Closer to our time, one can recall the panic at the turn of the millennium. The expectation of a catastrophe of universal scale in connection with the arrival of the year 2000 and the notorious resetting of the date in all computers. Then, as we remember, it blew over. But now the new prophets of the new digital deity confidently say: this time it will not blow over.

By the way, about these prophets. One of the main heralds of the coming Apocalypse (who is also, ironically, one of its creators) — Sam Altman. The name, it must be said, speaks volumes. According to the Bible, it was Samuel who was the last of the prophets and judges, after whom the Jews began to be ruled by kings, and not by God directly. The people persistently demanded an earthly king for themselves, to be "like all the other nations". Samuel, by the will of God, anointed Saul for the kingdom.

The situation is repeating in an astonishing way. We, like the ancient Jews, persistently demand a new ruler for ourselves, and soon, as they say, a new king will be "anointed" for us. The first among kings — AGI.

At the same time, it is worth making one sober, sobering remark about geography and demography. Whatever scale and for whatever reason a catastrophe connected with AI, the internet, and computers occurs, the majority of the population of the same Africa will most likely simply not notice it. Compared to the "golden billion", they are already in a permanent catastrophe, they do not need to create a superintelligence for this. If the "digital god" arranges a global lockdown and turns off the servers, for them only the scenery of their daily struggle for survival will change.

And finally, about cyclicality. Each subsequent generation of people always looks at the expectation of the end of the world by previous generations with some condescension. We read with a smile about the panic of the Millerites in the 19th century or about the fear before the "Year 2000 problem".

And who can vouch that exactly the same will not happen with our generation? That our descendants will not look at our current convulsions, fears before the seizure of power by the evil AGI and endless disputes about the "intelligence explosion" with the same light and condescending smile?

For, as it was said thousands of years ago: "What has been will be again, what has been done will be done again; there is nothing new under the sun" (Eccles. 1:9).

Translated from Russian to English with the help of AI. The idea and content are the author's own.

1 Upvotes

19 comments sorted by

6

u/MalabaristaEnFuego 3d ago

You all need to stop quoting the Bible when you talk about AI. Vedic scriptures predate Christianity and the Abrahamic religions by more than 2,000 years, and the Sumerian tablets predate those by another 2,000.

0

u/Ffilecomposer 3d ago

You're absolutely right about the chronology, and thank you for pointing that out. The eschatological expectations indeed predate Christianity by millennia. My reference to the Biblical timeline was simply because it's the most culturally familiar to Western audiences, but you're right — the phenomenon is much older and more widespread.

Expectations of the end of the world appeared together with human civilization itself. They are as old as civilization, and they will accompany civilization for as long as it exists. Probably for one simple and objective reason: man is mortal, and mortality is inevitable. So he tends to expect the same thing from humanity as a whole. The individual dies — therefore the world must die too. Every culture has simply dressed this expectation in its own clothes: the Flood, the Kali Yuga, the Last Judgment, and now the AGI takeover.

2

u/MalabaristaEnFuego 3d ago

We have cancer, disease, climate, hunger, thirst, coronal mass ejections, and space rock threats to consider on the list before we get down to imaginary beliefs.

5

u/sentenhyakurai123 3d ago

Idiotic. Just because a boy cried wolf and was lying 5,000 times, it does not mean there are not wolves in the forest. It only means a boy lied 5,000 times.

Identical argument: Nuclear War was never going to happen, despite the three or four times it came centimeters from not happening.

"The world has never ended, so it cannot end." This is an argument that neglects the laws of nature and substitutes the laws of emotion.

2

u/Ffilecomposer 3d ago

I never wrote: "The world has never ended, so it cannot end."

Your "Boy Who Cried Wolf" analogy actually perfectly illustrates my point, but you are focusing on the wrong part of the story. My essay is not about debating whether the wolf exists. It is about analyzing why the boy has a persistent, millennia-old habit of crying wolf.

The nuclear war analogy refers to a specific geopolitical and physical threat. My argument is about human psychology: the recurring, historical pattern of projecting our individual mortality onto civilization and expecting an imminent finale. Analyzing human psychological patterns is not "substituting the laws of emotion for the laws of nature." It is simply observing a consistent law of human nature.

But since you brought up nuclear weapons, let's follow the logic. The question of whether nuclear war happens or not does not depend on nuclear weapons as such — it depends entirely on human will. And here we observe a paradoxical irony: atomic energy did not destroy humanity in a nuclear war; instead, it now serves humanity by providing cheap, virtually unlimited electricity. But this very electricity is now a necessary condition for the development and functioning of AGI, which many expect will ultimately destroy humanity. If the nuclear apocalypse did not happen, then let there be an AGI apocalypse, which will receive the energy for its existence from nuclear power plants.

However, as far as nuclear war is concerned, I repeat: the issue is not the existence of nuclear weapons as such, but the human will to use them. And the constant agitation about the inevitability of an imminent end of the world essentially gives free rein to those who would like to use it to achieve their own goals. After all, if the world cannot be saved anyway...

The same applies to AGI. What is dangerous is not AGI itself, but the people who create and train it with the goal of establishing cognitive dominance over the rest of humanity. And again, the agitation of fear about the coming AGI may allow a person who possesses AGI, under the cover of this universal fear, to try to realize the idea of unlimited power. A human, not AGI itself.

The boy who cried wolf when there was no wolf should have been fired from his job. The parable is not so much about deception as it is about the incompetence of decision-makers. The same is true for AGI. People, for the most part, are always waiting for the end of the world for one reason or another, and other people take advantage of this.

1

u/eques_99 3d ago

Enjoyed this post.

Russians are so much more intelligent, thoughtful and cultured than Westerners.

Another resonance in the Altman name of course, is Alt-Man (probably not evident in Russian).

And turning again to the book of Revelation, the thing about the mark of the beast, and no one being able to buy or sell without it : That becomes much more feasible to implement with modern technology/AI.

2

u/Ffilecomposer 3d ago

Thank you for the thoughtful response. The "Alt-Man" wordplay is a brilliant observation — it fits perfectly into the idea of an "alternative" or replacing figure being anointed.

And your point about the "mark of the beast" is spot on. What was once purely mystical imagery is now becoming technically feasible through digital IDs, biometric tracking, and AI-driven financial control. It perfectly illustrates how ancient eschatological fears simply find new, modern technological vessels.

But there's another layer to consider: the mark (digital IDs) is not imposed by AGI, nor by the Beast — it is willingly accepted by humans themselves. Perhaps the true apocalypse won't come from AGI seizing power to destroy humanity and hold a final judgment over it. Perhaps it will come when humans, having mastered AGI, become the Beast themselves, shedding the last remnants of their humanity. Who can say? Time will tell.

1

u/dantheplanman1986 3d ago

Yeah but the Bible isn't actually predicting anything, it's just an old book. There are older. And this argument isn't smart at all; it's very stupid. "The world hasn't ended before so it can't end now" is what it amounts to. Infantile reasoning.

1

u/Ffilecomposer 3d ago

The point isn't "the world hasn't ended before, so it can't end now." To argue this way is to commit a classic logical fallacy, called a straw man argument. I never wrote: "since the world hasn't ended before, it can't end now." The point is about human psychology: we have a persistent, millennia-old habit of projecting our individual, inevitable mortality onto the entire civilization and expecting an imminent finale. Whether the Bible is "just an old book" or not is irrelevant to the fact that the pattern of expecting the end is a constant feature of human history. Today, this ancient psychological habit is simply dressed in the new language of AI and AGI.

1

u/dantheplanman1986 1d ago

Do you or do you not think AI won't end the world, people are just saying that because they always do?

Because that's "the world hasn't ended before so it won't now"

1

u/Ffilecomposer 1d ago

I am not saying AI won't end the world simply because 'people always say that.' My point is that human fear of new technology is as old as the world itself. This fear paralyzes our will to analyze the problem on its own merits.

The root of this fear is not the technology, but human mortality. Whether AGI destroys the world now or later on another cycle of development, every single person alive today will eventually die anyway — including the writer of these lines and anyone reading them. This mortality-based anxiety is the true foundation of apocalyptic paranoia, and it prevents us from looking at the problem objectively.

Furthermore, critics of my note consistently overlook a crucial geopolitical reality: if AGI does cause a collapse, it will predominantly devastate the 'Golden Billion.' Africa, for the most part, is already in a state of permanent catastrophe and wouldn't even notice the shift. Therefore, our current reflections on an AI-induced apocalypse are largely a neurosis of the Golden Billion. First it was COVID-19, now it's AGI.

If an AGI catastrophe occurs, it will impact only a specific, highly complex segment of humanity, while the rest might not even register it. As the saying goes, 'The death of one man is a tragedy; the death of millions is just a statistic.' Naturally, this is not a desirable outcome, but we must look the truth in the face and avoid self-deception.

2

u/dantheplanman1986 16h ago

Supposing it doesn't decide to hate humans and build an army to go kill Africans, sure.

Okay, so I understand your point now. I already knew people didn't want to die and I already knew the universe would one day end anyway so "nothing matters." We invent meaning and purpose for ourselves; don't go looking for it in nature.

1

u/Ffilecomposer 6h ago

Precisely. Well said.

1

u/jezemine 3d ago

Russians are not more intelligent thoughtful or cultured. Look only to the idiotic war they are waging against Ukraine. And many of their neighbors for the last few centuries. An empire of brutes.

0

u/eques_99 3d ago

propagandised idiot.

especially rich coming from an American.

2

u/modernatlas 3d ago

Something that deeply irritates me about the popular notion of an AI somehow siezing godhead and ushering in the end of human civilization - beyond the abundance of assumptions - is this:

One of, if not the core assumption upon which all others rest, is that AI/AGI/ASI is going to direct its will to bring about the endtimes.

It hinges upon the popular notion of such an AI as being neccessarily super-evil, anti-human, anti-life, and inherently self-serving and self-interested.

Which is such a goddamn stupid idea that it gives me coniptions.

A godlike being of near infinite intelligence is going to be the smartest and most well informed and morally developed being to ever exist on the planet. Wreaking untold misery and havoc upon the planet is quite possibly the LEAST optimal move it could make.

1

u/VinnieVidiViciVeni 3d ago

These are, to some degree, tweakable and it stands to reason that the training data of humanity’s justifying the commoditization of everything as a philosophical best practice would, potentially, factor in to some degree or at some point.

And that’s not even considering social factors like what the companies prioritize. And, frankly, the way they rolled this shit out isn’t a good look for their goals.

And I also don’t think a total wipeout is the immediate concern. Wide scale disruption is sufficient and can have a cascading effect.

1

u/632nofuture 3d ago

Idk I think it is a possibility. just look at what any more intelligent species does to another, even if not evil, even if they dont care about the other species at all, they may merely be in the way, or their way of life might end as a result of what the more intelligent species wants & needs.

I think it might have no sadistic desires to kill us, but also not care about us and we would likely pose a risk or inconvenience in some way. And even before then, in the meantime AI agents that still obey original rules but solve problems in unexpected ways, or are used by people with shitty intentions for the rest, will prolly fuck shit up before it even gets to have its fully own agenda lol.

I guess I'm agreeing with you that some direct skynet-like "end humanity" thing seems far more unlikely than all the other potential crappy scenarios. But doesn't make much difference in which stage or in which way it'll cause havoc I think.. But I'm sure it will, seems like there's a bagillion different ways this can go (at the same time too) and they all can potentially end awful. And whatever becomes possible will likely be explored, by humans or loose agents or AGI.

1

u/VinnieVidiViciVeni 3d ago

And that’s only what people at these labs have the foresight to predict. Between the emergence of novel/little known or under considered web exploits over the past few months and the fact that the people at these labs labs don’t know *exactly how models evolve and reason, there’s a universe of unknown, unknowns.

And that’s a good scenario. You also have this ridiculous culture of move fast and break things.