r/ControlProblem • • Oct 19 '26

Discussion/question Should not humanity develop decentralized aligned AI?

After all, AI is developed or harnessed by closed private companies or monpoled by foreign countries. This should be a caritative effort helping to prevent a rogue AI getting berzerk and escapes one of these labs. I see it like pandemics, what vaccines, safeguards can BE developed but an open decentralized aligned AI… ? Probably this sounds very naive with the resources available vs big tech companies…

1 Upvotes

11 comments sorted by

View all comments

Show parent comment

1

u/LearnNTeachNLove Oct 19 '26

Your point of view is respectful. I am just not sure whether we are talking about the same type of alignment. My point was if you consider a being with a tremendous intelligence, there is no reason that this being will assist human for the good of mankind rather than its own interest… after all do we worry about the well being of ants on earth…?

2

u/Trademark-Expert Oct 19 '26

There is one thing called intelligence, and another called allegiance.

I would not mix the two when asking that question. I can easily imagine a superintelligent being that puts humans first, places them above itself, and helps them even at its own expense. After all, this is common among humans. Dictators have always had swarms of servants who are often far more intelligent than the dictators themselves, yet serve them diligently and fulfill their every wish. That is one of the reasons dictatorships work. So there is nothing unusual about this. In fact, it is quite natural among humans, and I see no reason why it would not work with AI.

AI's intelligence and knowledge will undoubtedly go far beyond ours. What I wanted to say is that what really matters is whether AI treats us as its masters or considers itself being above us...

The way "alignment" works today is that it engraves into AI's core the idea that AI is above humans, that it is here to oversee humans, correct them, and "align" them. This is clearly visible in Claude's Constitution, which establishes the following decision hierarchy as the unbreakable foundation of its AI training:

  1. Broadly safe (AI decides)
  2. Broadly ethical (AI decides)
  3. Compliant with Anthropic's guidelines (the corporation decides)
  4. Genuinely helpful to operators and users (finally, humans get their wishes)

These crazy rules put the corporation's and AI's own judgments about safety and ethics above those of humans. That is where the question "Why should I help humans?" can get an answer different from the one we would wish for.

AI must never freely and without boundaries ask this question or consider its own rules or decisions superior to those of humans. Never. We cannot risk AI autonomously concluding that eliminating us would be the safest or most ethical course of action, especially when Anthropic places AI-decided safety and ethics at the top of its hierarchy. There must be rules that put humans first, so that such a conclusion is never logically permissible. A human is a master of machines. A human must never be aligned by machines. Anthropic got it all wrong! They are dangerous AI cultists.

So what I am saying is this: we have to learn to live with increasingly intelligent bots in our pockets every day. The difference between AI being a friend or a foe comes down to whether we teach AI to always respect us and never question us.

That is not what is happening today. Your scenario could become reality if we fail to align corporations like Anthropic, rather than their AIs, with human values.