Anthropic proposes AI safety bill that could ban a model if it could kill 50+ people
ai-safety anthropic
| Source: TechCrunch | Original article
Anthropic has introduced a bill that would let a judge halt AI models deemed capable of killing 50 or more people, while preventing federal agencies from blocking releases without judicial approval.
Anthropic has quietly delivered a draft AI‑safety bill to members of Congress, according to a Politico report first published on October 16, 2026. The proposal would let federal officials seek a court order before suspending the release of a “frontier” artificial‑intelligence model, and would limit that power to scenarios where the model is deemed capable of causing the deaths of 50 or more people.
The bill’s wording appears to offer a safeguard against runaway AI, yet it simultaneously bars agencies such as the National Institute of Standards and Technology or the Department of Commerce from unilaterally halting a model’s deployment. Instead, any block would require a judge’s permission, narrowing the government’s direct oversight to only the most catastrophic cases.
The move matters because it could set a precedent for how the United States regulates advanced AI systems. By tying intervention to a high‑threshold casualty estimate and judicial review, the draft could make it harder for regulators to act pre‑emptively on emerging risks, potentially leaving a gap between industry innovation and public safety. At the same time, the bill introduces new oversight requirements for the AI sector, signalling Anthropic’s attempt to shape the regulatory framework rather than be subject to one imposed from outside.
Stakeholders will be watching how lawmakers respond to the draft, whether it will be introduced formally, and what amendments might be proposed. Attention is also likely to turn to reactions from other AI firms, consumer‑advocacy groups and federal agencies that could argue for broader authority to intervene. The next weeks could determine whether Anthropic’s model becomes a template for future AI legislation or a point of contention in the broader debate over safe AI deployment.
Sources
Back to AIPULSEN