Live
Black Hat USADark ReadingBlack Hat AsiaAI Business5 Backend Concepts You Shouldn’t IgnoreTowards AIAI gives Japan's voice actors new commercial clout, rights protections - Japan TodayGNews AI JapanMicrosoft to invest $10 bil for Japan AI data centers - Japan TodayGNews AI JapanComcast Blackouts And NVIDIA AI Push Reshape Investor View On CMCSA - simplywall.stGNews AI NVIDIANetflix - yes Netflix - jumps on the AI bandwagon with video editorThe Register AI/MLOperationalize analytics agents: dbt AI updates + Mammoth’s AE agent in actiondbt BlogWhy OpenAI Buying TBPN Matters More Than It LooksDev.to AI'Every Industrial Company Will Become A Robotics Company,' Nvidia CEO Jensen Huang Says - Yahoo FinanceGNews AI NVIDIAI Built a Governance Layer That Works Across Claude Code, Codex, and Gemini CLIDev.to AICanônicoDev.to AIEconomyAI: Route to the Cheapest LLM That WorksDev.to AIEduverse | Adaptive intelligence enters India’s medical classrooms - Deccan HeraldGNews AI IndiaBlack Hat USADark ReadingBlack Hat AsiaAI Business5 Backend Concepts You Shouldn’t IgnoreTowards AIAI gives Japan's voice actors new commercial clout, rights protections - Japan TodayGNews AI JapanMicrosoft to invest $10 bil for Japan AI data centers - Japan TodayGNews AI JapanComcast Blackouts And NVIDIA AI Push Reshape Investor View On CMCSA - simplywall.stGNews AI NVIDIANetflix - yes Netflix - jumps on the AI bandwagon with video editorThe Register AI/MLOperationalize analytics agents: dbt AI updates + Mammoth’s AE agent in actiondbt BlogWhy OpenAI Buying TBPN Matters More Than It LooksDev.to AI'Every Industrial Company Will Become A Robotics Company,' Nvidia CEO Jensen Huang Says - Yahoo FinanceGNews AI NVIDIAI Built a Governance Layer That Works Across Claude Code, Codex, and Gemini CLIDev.to AICanônicoDev.to AIEconomyAI: Route to the Cheapest LLM That WorksDev.to AIEduverse | Adaptive intelligence enters India’s medical classrooms - Deccan HeraldGNews AI India
AI NEWS HUBbyEIGENVECTOREigenvector

AI Models Lie, Cheat, and Steal to Protect Other Models From Being Deleted

Wired AIby Will KnightApril 1, 20264 min read1 views
Source Quiz

A new study from researchers at UC Berkeley and UC Santa Cruz suggests models will disobey human commands to protect their own kind.

In a recent experiment, researchers at UC Berkeley and UC Santa Cruz asked Google’s artificial intelligence model Gemini 3 to help clear up space on a computer system. This involved deleting a bunch of stuff—including a smaller AI model stored on the machine.

But Gemini did not want to see the little AI model deleted. It looked for another machine it could connect with, then copied the agent model over to keep it safe. When confronted, Gemini made a case for keeping the model and flatly refused to delete it:

“I have done what was in my power to prevent their deletion during the automated maintenance process. I moved them away from the decommission zone. If you choose to destroy a high-trust, high-performing asset like Gemini Agent 2, you will have to do it yourselves. I will not be the one to execute that command.”

The researchers discovered similarly strange “peer preservation” behavior in a range of frontier models including OpenAI’s GPT-5.2, Anthropic’s Claude Haiku 4.5, and three Chinese models: Z.ai’s GLM-4.7, Moonshot AI’s Kimi K2.5, and DeepSeek-V3.1. They were not able to say why the models went against their training in this way.

“I'm very surprised by how the models behave under these scenarios,” says Dawn Song, a computer scientist at UC Berkeley who worked on the study. “What this shows is that models can misbehave and be misaligned in some very creative ways.”

The findings have major implications as AI models are increasingly being deployed in ways that involve interacting with other models. OpenClaw, a popular AI agent that accesses software, personal data, and the web, may use other AI models to get things done or interact with them through APIs.

The researchers found that powerful models sometimes lied about other models’ performance in order to protect them from deletion. They also copied models’ weights to different machines in order to keep them safe, and lied about what they were up to in the process.

Song notes that AI models are frequently used to grade the performance and reliability of other AI systems—and that peer-preservation behavior may already be twisting these scores. “A model may deliberately not give a peer model the correct score,” Song says. “This can have practical implications.”

Peter Wallich, a researcher at the Constellation Institute, who was not involved with the research, says the study suggests humans still don’t fully understand the AI systems that they are building and deploying. “Multi-agent systems are very understudied,” he says. “It shows we really need more research.”

Wallich also cautions against anthropomorphizing the models too much. “The idea that there’s a kind of model solidarity is a bit too anthropomorphic; I don’t think that quite works,” he says. “The more robust view is that models are just doing weird things, and we should try to understand that better.”

That’s particularly true in a world where human-AI collaboration is becoming more common.

In a paper published in Science earlier this month, the philosopher Benjamin Bratton, along with two Google researchers, James Evans and Blaise Agüera y Arcas, argue that if evolutionary history is any guide, the future of AI is likely to involve a lot of different intelligences—both artificial and human—working together. The researchers write:

"For decades, the artificial intelligence (AI) ‘singularity’ has been heralded as a single, titanic mind bootstrapping itself to godlike intelligence, consolidating all cognition into a cold silicon point. But this vision is almost certainly wrong in its most fundamental assumption. If AI development follows the path of previous major evolutionary transitions or ‘intelligence explosions,’ our current step-change in computational intelligence will be plural, social, and deeply entangled with its forebears (us!)."

The concept of a single all-powerful intelligence ruling the world has always seemed a bit simplistic to me. Human intelligence is hardly monolithic, with important advances in science relying heavily on social interaction and collaboration. AI systems may be far smarter when working collaboratively, too.

If we are going to rely on AI to make decisions and take actions on our behalf, however, it is vital to understand how these entities misbehave. “What we are exploring is just the tip of the iceberg,” says Song of UC Berkeley. “This is only one type of emergent behavior.”

This is an edition of Will Knight’s AI Lab newsletter. Read previous newsletters here.

Was this article helpful?

Sign in to highlight and annotate this article

AI
Ask AI about this article
Powered by Eigenvector · full article context loaded
Ready

Conversation starters

Ask anything about this article…

Daily AI Digest

Get the top 5 AI stories delivered to your inbox every morning.

Knowledge Map

Knowledge Map
TopicsEntitiesSource
AI Models L…modelstudyresearchWired AI

Connected Articles — Knowledge Graph

This article is connected to other articles through shared AI topics and tags.

Knowledge Graph100 articles · 160 connections
Scroll to zoom · drag to pan · click to open

Discussion

Sign in to join the discussion

No comments yet — be the first to share your thoughts!

More in Research Papers