Breaking

Anthropic Co-Founder Says Frontier AI Firms May Need Mandatory Kill Switches

September 15, 2026 at 07:32 EDT

Foundation Models
AI Agents
Policy & Regulation

Anthropic co-founder Jack Clark has intensified the debate over frontier AI control, saying governments may eventually need to require AI companies to maintain kill switches that can be verified by an outside party. The proposal lands as leading labs, lawmakers and security researchers argue over whether emergency shutdown powers are a necessary safety backstop or a poorly defined control mechanism with its own risks.

Sep. 2026 · Anthropic

Who Can Stop Frontier AI?

Anthropic's Jack Clark says mandatory, verifiable kill switches may become necessary as advanced agents grow more autonomous. The central fight is over control: company, government or independent oversight.

steps in Amodei's pacing plan

6-12

months in the cited risk window

synthetic monitor-evasion attacks

$20M

possible daily penalty reported for violations

Monitor Reliability Gap

8 attacks

reliably detected

40 attacks

benchmark set

One block represents 8 attacks. Anthropic's monitor research found only 8 of 40 attacks were reliably detected, while 50% were never caught across 10 trials.

Pacing the Frontier

Embedded evaluators

Outside teams get employee-like access to verify safety practices.

→

Democratic coordination

Frontier companies align on standards and limits with government support.

→

Global coordination

Governments test whether wider agreements can be verified.

Safety Case

Supporters say guaranteed shutdown capability is a baseline condition for deploying autonomous agents in high-stakes settings.

Control Risk

Critics warn that an emergency switch can become a vulnerability and that decision rights remain unresolved.

The real question is governance

A useful kill switch must be reliable enough to stop dangerous agents, limited enough to avoid abuse and transparent enough for outsiders to verify.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.