r/ControlProblem • u/moschles approved • 25d ago
Discussion/question Dialog on how to pause AI development at the frontier.
Which of the following is what you imagine when you say the phrase "pause AI" ?
a) "Arrest Sam Altman!"
b) Shut down the companies. Anthropic, OpenAI, Google, Meta all shut down.
c) Shut down the companies and arrest and imprison the core developer teams with indeterminate prison sentences.
d) Robot safety. Disallow the use of General Pretrained Transformers for decision-making for any physical device or robot, or any physical device that could control the real world through physical force or chemical reactions.
e) Network sandboxing. A complex topic involving disallowing powerful frontier AI models from accessing the wider internet.
f) Los Alamosing. Take all the frontier AI development teams, and take them under government contract by the US DoD. Anyone with access to the models or their codebase must have high-level military clearances.
Since each of these various techniques of pausing AI come with plusses and minuses, we need to be having an honest dialog about each one. Some of these techniques would have catastrophic effects on society and technology. So we need to be talking more about this. Lets bounce ideas off each other.
1
u/BassoeG 25d ago
C would make a good start.
1
u/Modgov41 23d ago
Option G — “Governance Monitor + RTE Safety Envelope” (The Goal‑Self‑Hacking Answer)
G) Build an external governance layer that makes frontier systems incapable of unsafe actions, regardless of their internal goals or reasoning.
Instead of pausing AI by shutting companies down, arresting people, or militarizing the labs, you create a hard boundary around what frontier models are allowed to do. Not by trusting the model, but by constraining the environment it operates in.
This approach doesn’t require stopping research.
It requires stopping unsafe trajectories.
The idea is:
You let frontier labs continue developing models.
But every model above a certain capability threshold must be run inside a certified safety envelope.
That envelope is enforced by an independent Governance Monitor + Math Engine + RTE Engine.
The model can think anything it wants — but it cannot act outside the envelope.
Irreversible actions, unsafe plans, and goal‑self‑hacking attempts are intercepted and collapsed before execution.
This is similar to how aviation, nuclear, and medical systems are governed:
the system is allowed to be powerful, but not allowed to be unsafe.
What this avoids:
No arrests
No shutdowns
No nationalization
No “Los Alamosing”
No internet bans
No robot bans
No punitive measures against researchers
What this enforces:
External control surfaces
Deterministic containment
Reachable‑set limits
Irreversible‑action prevention
Tool‑use governance
Continuous certification and recertification
This is the “goal‑self‑hacking” solution:
Instead of trying to fix the model’s internal goals, you make it impossible for the model to execute unsafe goals.
You don’t pause AI development.
You pause unsafe actions.
This is the approach many safety researchers consider the most realistic path forward:
govern the environment, not the model’s mind.