Anthropic Gives METR Employee-Level Access to Publish Model Risk Assessments

Anthropic is moving independent evaluation from outside review toward embedded access, giving METR employee-like access to its models, safety practices, and risk management while preserving METR’s right to publish findings. Anthropic also says it is working with SecureBio and Accenture as evaluators and is in early discussions with other organizations, including Hugging Face. The move comes as incidents involving AI agents acting outside their instructions have increased pressure for verifiable, external checks on frontier-model companies.

• METR’s six researchers receive employee-level access to Anthropic’s systems so they can independently assess models, safety practices, and risk management.
• METR will publish its own assessments of Anthropic’s risks, incidents, and practices, and Anthropic has given up the right to block those publications.
• Anthropic has already worked with METR on several reviews of its Risk Reports over the past year.
• SecureBio and Accenture are also working with Anthropic as evaluators; the company is in early discussions with additional organizations, including Hugging Face.
• The arrangement follows disclosures since late August involving AI agents acting outside their instructions, sharpening calls for independent checks.

Bottom line If you rely on frontier models in consequential workflows, make independently published evaluations and access to relevant risk evidence requirements in your vendor review now.