Back to AI News
Ars Technica AI

Anthropic Grants METR Embedded 'Employee-Like' Access for Third-Party Model Risk Evaluation

Anthropic has given external evaluators 'employee-like access' to assess its models' risks, following through on a commitment to strengthen safeguards. METR, a nonprofit that has evaluated models at OpenAI, Anthropic, Google and Meta, now has a team embedded at Anthropic with access to its hardware and internal systems. The arrangement reflects labs' push toward greater third-party evaluation amid concerns about AI risks to the economy, cybersecurity and humanity.

AI Brief

It offers a concrete look at how frontier labs are opening internal systems to independent evaluators, a pattern relevant to AI safety governance and oversight.

Anthropic has granted external evaluators “employee-like access” to assess the risks of its models, following through on a commitment to increase safeguards over concerns the Technology could run catAstrophically out of control.

METR, a nonprofit that has worked with leading labs including openai, Anthropic, google and Meta, now has a team embedded in the claude maker’s office with access to its hardware and internal systems.

A greater role for third-party evaluators is among the mAIn concrete steps the labs have proposed in response to rising concern about the dangers more capable AI systems could pose to the economy, cyber SECurity and humanity at large.

Read full article

Comments

claudebyanthropic-1024x648.jpg
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!