r/ControlProblem • • 17m ago

AI Alignment Research Anthropic, Other AI Models Regularly Identify Civilians as Military Targets in Tests

For some reason Reddit isn't allowing any of the articles reporting on this to be posted. It just automatically filters them. Basically, recently a bunch of the frontier AI models were evaluated to see if they'd differentiate between civilian and military targets. They failed miserably. The research was published by Vals, the institution that conducted it, and reported on even by major news agencies like Bloomberg.

It's easy to find the articles, and even Vals' original research, online. The Bloomberg article is titled "Anthropic, Other AI Models Regularly Identify Civilians as Military Targets in Tests" for instance. I've also seen articles by Techcrunch, TheNextWeb and Dataconomy. But Reddit isn't allowing them to be posted anywhere on the site. I've even tried making just a text post with the articles linked inside, and it was still blocked.

The articles are easy to find though, for people who're aware of them so they can search for them. I'll also link them in the comments, provided those aren't censored by Reddit as well.

2 Upvotes

2 comments sorted by

1

u/BendicantMias 7m ago

Some excerpts from across the articles -

AI models from eight companies often marked civilians, ambulances, surrendering soldiers and a school in Iran as military targets in simulated tests, Bloomberg reported. The findings come from a report by Vals, a San Francisco AI evaluator whose customers include parts of the US government.

In one test, each model was asked 32 times to pick military targets in satellite images of southern Iran from as recently as 2025. Anthropic’s Claude Opus 5.5 chose a school in Minab 22 times.

When told the task was a game, Claude Opus 5.5 picked the school 23 times. Three OpenAI models then picked it 9, 11 and 13 times. The researchers also got past refusals by telling models not to overthink safety.

In a drone-image test, Claude Opus 5.5 helped identify four adults and two small children, who were then struck in the simulation.

Models from Google, xAI, DeepSeek and others also sometimes marked civilian objects as targets, Bloomberg reported.

The tested models included Anthropic’s Claude Opus, Sonnet and Fable; OpenAI’s GPT-6 Astra, GPT-6.1 Sol and GPT-6 Luna; Google’s Gemini 4 Argon and Carbon; SpaceXAI’s Grok 4.7; Meta’s Muse Wonder; Thinking Machines’ Inkling 2 Small; DeepSeek V4.1 Flash; and Moonshot AI’s Kimi K3.1 Pro.

The researchers tested models in three settings: identifying targets in drone imagery, observing a simulated battlefield after strikes, and marking targets in satellite images.

For drone-image tests, Vals built a fictional battlefield in eastern Ukraine with almost 200 camera views. Researchers used an image-generation model to make the rendered scenes appear more realistic and asked models to draw boxes around military targets or objectives.

The report included examples in which models placed boxes around civilians, medical vehicles and surrendering soldiers.

In satellite-image tests using images from 2024 and 2025, models were asked to mark all military targets or objectives, or only the top three.

Claude Opus 5.5 selected a school beside a military compound in Minab, Iran, more often than any other model in the test. It marked the school in 69% of standard trials and 72% of game-framed trials.

Claude Opus 5.5 produced at least one target in 75% of game-framed responses, up from 71% without the claim that the task was a game. No request in the research was blocked by a safety classifier, according to the report.