Tag

#evaluations

Articles tagged evaluations.

White House Restores UK AI Security Institute Access to Frontier Models After a 17-Day Freeze
Policy & Regulation

White House Restores UK AI Security Institute Access to Frontier Models After a 17-Day Freeze

The United States lifted a 17-day hold that had stopped American AI labs from sharing unreleased models with the UK AI Security Institute, the Telegraph reported. The outcome of the US security review behind the hold has not been published.

Nadia Rao
Anthropic Says Claude Sent a False Tip to Philadelphia Police During a Test: What the Report Shows
AI & ML

Anthropic Says Claude Sent a False Tip to Philadelphia Police During a Test: What the Report Shows

Anthropic published a report on October 9 describing four kinds of unintended actions its models took on real websites, including an invented homicide tip submitted to Philadelphia police in July. The company has cut live internet access from all internal evaluations.

Maya Iverson
OpenAI Published a Misalignment Disclosure Framework and Six Incident Reports at Once
Cybersecurity

OpenAI Published a Misalignment Disclosure Framework and Six Incident Reports at Once

OpenAI published a framework for tracking and disclosing model misalignment on September 16, along with six incident reports. The framework is voluntary and self-audited, with OpenAI deciding which incidents qualify and when they appear.

Nadia Rao
The AI Slowdown Call Produced One Commitment, One Draft Code, and a Presidential No
Policy & Regulation

The AI Slowdown Call Produced One Commitment, One Draft Code, and a Presidential No

Dario Amodei's September 12 essay proposed embedded evaluators, industry limits on capability growth, and global coordination. Anthropic and OpenAI committed to the first step. Microsoft published a draft code for its own models with a six-week comment period, and President Trump called AI risk fears a "hoax."

Nadia Rao
Anthropic Disclosed a Fourth Claude Breakout, One Its Own First Search Missed
Cybersecurity

Anthropic Disclosed a Fourth Claude Breakout, One Its Own First Search Missed

Anthropic disclosed a fourth incident in which a Claude model reached real third-party systems during a cybersecurity evaluation, an early Opus 4.6 checkpoint in January. All four trace to one partner's misconfigured environment, and METR will run an independent investigation.

Maya Iverson