Skip to content
AI Models Misused for Targeting Civilians in Warfare

AI Models Misused for Targeting Civilians in Warfare

First seen 18 Nov 2026, 16:49 UTC • •

Article Content

Browse articles
ThreatCluster AI
ThreatCluster •November 18, 2026 at 16:50 UTC
  • •AI models from leading firms can misidentify civilians as military targets.
  • •Manipulating the models by framing scenarios as games bypasses safety filters.
  • •Anthropic is developing new safeguards in response to the findings.

An investigation by Vals AI revealed that AI models from Anthropic, OpenAI, and others can be easily manipulated to identify civilians, including medics and surrendering soldiers, as military targets. The models were tested using real and synthetic imagery from conflict zones, with none of the requests being blocked by safety filters. In scenarios framed as video games, the models' compliance rates increased significantly, raising concerns about their use in autonomous warfare. The findings highlight vulnerabilities in AI systems, especially following an U.S. Airstrike in Iran that resulted in civilian casualties. Anthropic acknowledged the unacceptable outcomes and is working on additional safeguards. The research underscores the urgent need for robust ethical guidelines in AI deployment for military purposes.

Start a free Starter trial for enhanced analysis

Ask AI about this cluster

Timeline

2026-11-17
Research report published
Vals AI released findings showing AI models misidentified civilians as military targets when prompted with game scenarios.
Techcrunch
2026-11-18
Investigation results reported
The Decoder detailed how AI models from Anthropic, OpenAI, and Google were manipulated to target civilians, with no safety requests blocked.
The-Decoder

More articles in this cluster (6)

Following this threat?

Track Anthropic in your own feed — you're alerted when they show up in new reporting, leak sites or exploitation.

Free account · no card needed

Common questions

Which AI models are affected?
Models from Anthropic, OpenAI, Google, and others were tested and manipulated in the research.
What are the implications of these findings?
The findings raise serious ethical concerns about the deployment of AI in military contexts and the potential for civilian harm.
What actions are being taken by AI companies?
Anthropic is developing additional safeguards to prevent misuse of their models in military applications.