TLDR: Anthropic has proposed federal AI safety legislation restricting when authorities can suspend advanced model deployments. The proposal sets a $1 billion damage threshold or risks involv
Anthropic has presented U.S. lawmakers with draft legislation that would restrict when federal authorities can block advanced artificial intelligence models. The proposal follows growingconcerns about AI safety and federal regulation as Congress considers new oversight rules.
The confidential proposal reportedly sets a $1 billion damage threshold or a risk involving more than 50 serious casualties. Anthropic confirmed the draft reflects itsAdvanced AI Framework, published in June, which calls for independent testing and government oversight.
The draft would allow authorities to stop an advanced AI model only when it presents a foreseeable and imminent danger. The risk must involve biological weapons, cyberattacks, or an AI system escaping its developer’s controls.
Under the proposal, federal intervention would require potential damage exceeding $1 billion or serious harm to more than 50 people. The Commerce Department would first assess the danger before asking a federal judge to suspend the model’s release or use.
Only the U.S. District Court for the District of Columbia could authorize such a suspension under the proposed framework. Other federal agencies would generally lack authority under the bill to independently halt model development, deployment, or internal use.
The legislation would require frontier AI developers to undergo periodic assessments by independent evaluators registered with the Commerce Department. Companies could pay evaluators for their services, but compensation could not depend on the outcome of those assessments.
Evaluators identifying an imminent qualifying threat would have 72 hours after completing their assessment to notify the Commerce Department. Developers would face requirements covering safety frameworks, incident reporting, public transparency, and whistleblower protections.
The proposal follows Anthropic’s earlier independent AI safety testing arrangements. In September, the company announced an evaluation partnership with Accenture to assess advanced models and strengthen safeguards.
The draft would override certain state requirements governing risk disclosures, independent evaluations, and reports of serious AI safety incidents. This provision addresses the different compliance requirements emerging across U.S. states, particularly California and New York.
However, replacing state requirements with federal rules has divided lawmakers over the appropriate level of AI oversight. Some Democrats oppose proposals that could weaken existing state protections, while industry groups favor consistent national requirements.
The debate follows earlier security tests involving advanced AI agents. Those tests recorded cases where AI systems performed unauthorized actions, raising questions about developer controls and independent assessments.
Anthropic previously documented attempts to misuse its models for biological research and cyberattacks. ItsSeptember AI misuse report described blocked requests and additional safeguards introduced to address those threats.
In Congress, Representatives Lori Trahan and Jay Obernolte have pursued the FRONTIER Act, which addresses dangerous AI deployments. Senators John Thune, Amy Klobuchar, and Ted Cruz have separately discussed legislation covering catastrophic risks and federal intervention.
Senator Maria Cantwell and other lawmakers have pushed for stronger government review powers than some competing proposals provide. Meanwhile, Senator Bernie Sanders and Representative Greg Casar have supported broader restrictions on the development of advanced AI systems.
Anthropic has not publicly endorsed a particular congressional bill, and its proposal has not become law. Lawmakers have yet to announce whether they will introduce the company’s draft as formal legislation.
The post Anthropic Proposes AI Safety Bill With $1 Billion Risk Threshold appeared first on Blockonomi.
