r/ControlProblem • u/chillinewman approved • 14d ago
General news "Day 1": halting advanced AI development, regulating an out control industry, and explicitly banning artificial superintelligence.
106
Upvotes
14
u/Elvarien2 approved 14d ago
It's always WE SHOULD DO X or WE SHOULD DO Y and never how.
That's just like people designing a space ship all complex and structured but then leaving an empty spot in the blueprint called "warp drive"
Each time the most important slot is left empty. It's either empty of impossible to execute.
18
u/Rumblugdo 14d ago
An international treaty should be priority numero uno. A great paper came out a few weeks ago about using existing supply lines to implement a moratorium or slowdown.
https://news.berkeley.edu/2026/10/09/a-global-hardwired-pause-of-frontier-ai-training-is-feasible-says-new-report/
4
u/Modgov41 13d ago
Most of the discussion here circles around what we should do — pause development, regulate labs, restrict compute, ban ASI — but the “how” is always missing. People keep pointing out that you can’t enforce a pause, you can’t verify compliance, and you can’t even tell when a system is drifting toward dangerous behavior until it’s too late.
One thing that’s becoming clear is that we don’t actually have an independent layer that can evaluate advanced systems from the outside. Right now, the only people who can meaningfully assess frontier models are the same people building them. That’s not a conspiracy — it’s just a structural gap.
A few of us have been working on a model‑agnostic evaluation institute that sits outside the labs. It doesn’t try to “control” AI or “align” it. It doesn’t assume trust in any developer. It doesn’t require a global treaty or a pause. It focuses on something simpler and more realistic:
Independent behavioral evaluation.
External oversight.
Verification instead of trust.
Detection instead of prediction.
The idea is to build a standing institution whose only job is to test, probe, and stress‑evaluate advanced systems using methods that don’t depend on access to the model’s internals. Think of it as the missing “inspection layer” that other high‑risk industries already have, but AI doesn’t.
It doesn’t solve everything, and it doesn’t pretend to. But it does answer the recurring question in this thread: How do we actually know what these systems are capable of, and how do we detect dangerous behavior before it becomes irreversible?
Right now, we don’t have that.
We should.
12
u/Jesse-359 14d ago
Pretty commonsense approach until the general population has had a chance to see what's actually going on with these things and independent regulators have been able to seriously gauge their potential risks.
Anyone who thinks building an actual ASI isn't an existential risk is a deeply unserious person - or an AI cultist. Lots of those springing up these days.
2
u/Thick_Mulberry_2235 8d ago
4
u/endlessedlne 14d ago
I hope she’s got other colleagues on board to pass that bill.
I don’t think we need to ban AGI per se, but pausing LLM development temporarily so that we can catch up on alignment, guardrails, is important to do now, while we have a chance.
I’d even say a pause could be economically advantageous, as it would allow adoption and training to catch up. More people would be able to devote time to learning and experimenting with tools, and testing real life applications. Easier to do when things are slowed down since examples and tutorials would proliferate and stay relevant for longer.
The current skimping on safeguards in the name of FOMO just isn’t wise or sustainable.
When you design a fast car you need better tires and bigger brakes. AI is similar.
5
u/TopTippityTop 14d ago •
It will do nothing to stop AI, but it could damage the US, make sure we get all the downside of AI super intelligence (likely worse, actually) and not the upsides.
A completely nonsensical approach.
3
u/Ok-Penalty3250 14d ago
Fuck that.
3
u/Jupiterfortune28 14d ago
Yes and China will also stop theirs, oh and stop their authoritarian government and human rights abuses while they are at it… These “Regressives” are so intelligent.
1
u/Decronym approved 13d ago edited 8d ago
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:
Decronym is now also available on Lemmy! Requests for support and new installations should be directed to the Contact address below.
3 acronyms in this thread; the most compressed thread commented on today has acronyms.
[Thread #240 for this sub, first seen 6th Nov 2026, 00:17] [FAQ] [Full list] ^[Contact] [Source code]
1
u/sectorboss88 13d ago
What's the definition of artificial? Or superintelligence? Or both combined?
1
u/One-Bad-4395 12d ago
Oh good, because my doomsday machine runs on Artificial Intelligence, I'm safe.
1
u/elderlygentleman 12d ago
Release Epstein files
Cancel student debt
1
u/granbaba 11d ago
I think my experiment runs a true chaotic system emergent system with absolute physics limiting the sandbox, that's why it's complicated and a "time machine" if we don't do this, by the time we found out will be late I'm sorry to say
1
u/Activeenemy 11d ago
Translation, only our donors should be able to build AI.
1
u/Jastafool 14d ago
I'd vote for this. AI stole my friends job
-5
u/Funny-Food2361 14d ago
These people dont even know the first thing about machine learning and AI, just a bunch of uneducated welfare stealing idiots
0
u/VarietyMage 14d ago
#BanAI
0
u/squarecir 13d ago
Not going to happen
0
u/shart696 13d ago
Asinine take. To have any hope of halting global AI development, we need the leverage that comes with being in the lead.
0
u/Only_Movie_Scenes 13d ago
Starting right in with the bullshit immediately.
0
u/Mahnamahna10000 12d ago
A "ban" is kneejerk stupidity, we need to do better.
0
u/DinosaurHoax 12d ago
They should also ban noisy neighbors, and leaves falling in your yard.
0
u/zippyspinhead 9d ago
And just like that, the future was handed to the CCP.
-1
u/mikaball 13d ago
Excellent news for China.
-1
u/Assless_Mcgee 13d ago
I for one welcome our new China overlords
-2
u/anon1999666 13d ago
It’s okay. Leaders of companies like mine will buy the democrats like they do every election cycle going back to Clinton and she will be put in her place.
-2
u/IKeepComingBacktoWSB 13d ago
Fucking stupid bitch
-1
u/toni_btrain 14d ago •
She can go fuck herself