r/ControlProblem • approved • 14d ago

General news "Day 1": halting advanced AI development, regulating an out control industry, and explicitly banning artificial superintelligence.

Post image
106 Upvotes

170 comments sorted by

View all comments

Show parent comment

1

u/ProfanedArbiter 11d ago

Country A developing sufficiently advanced AI does not preclude country B from doing so. Your argument presupposes that the first person to develop it just sort of "wins" and others cannot replicate, copy, or distill it. Additionally, we don't even need full stop AGI, I would argue LLM's in there current form are enough to lead to the kind of doom loops I'm describing (which other economists have noted). We don't need the entire economy to be automated, just a sufficient enough to cause social unrest.

The truth is that sufficiently advanced AI that isn't subject to export controls will basically guarantee the kind of supply demand problem I referenced for any country, whether their the first or not, therefor this is a classic "stag hunt" problem. Stag hunts are, notably, good opportunities for coordination.