Crypto Games ExtensionCrypto Games AppTelegram NewsSubmit
Anthropic's first embedded safety evaluator is ... Accenture?Image Source: TechCrunch

Anthropic’s first embedded safety evaluator is … Accenture?

George Tsagkarakis 4 min read
Contents 7 sections
We may include affiliate links in our content, meaning we could earn a commission—or receive blockchain-based assets—if you click a link and make a purchase or take a specific action. Additionally, we use generative AI to help draft and refine our posts for clarity and grammar. All content is fact-checked and reviewed by a human editor before publication.

Accenture’s shares jumped 8% after hours. Not because the consulting giant won a cloud migration contract or landed another government modernization deal, but because Anthropic picked it to be the first outside group embedded inside the lab to poke holes in its models.

That’s the part nobody saw coming.

Dario Amodei has been talking about putting third-party safety evaluators inside AI labs for a while now, and the conversation that grew out of his blog post ran in a predictable direction. People named METR. They named Redwood Research. They named Apollo Research. Small, technical, obsessive outfits that exist to stress-test frontier models and publish uncomfortable findings.

Nobody’s shortlist had a Fortune Global 500 consultancy on it.

What Accenture is actually being hired to do

In a blog post, Anthropic said Faculty, a company Accenture acquired in January to act as its AI division, will begin “evaluating and red-teaming models, conducting alignment assessments, and testing model safeguards.”

Both companies expect to invest at least $1 billion in the project over the next five years. That’s a real number, and it’s the kind of commitment that makes the arrangement harder to dismiss as a press release with a logo attached.

Staff from Accenture will work inside Anthropic. Not reviewing documentation from a distance. Inside.

The independence argument is better than it first sounds

Accenture isn’t known for work at the bleeding edge of deep learning research, and pretending otherwise would be silly. Anthropic didn’t pretend. It pointed instead to the company’s practical experience deploying AI for large corporations and government agencies.

There’s a second argument, and it’s the more interesting one. Accenture is a large public company that predates the AI revolution. It doesn’t depend on Anthropic for its existence, its funding or its reputation. Set that against the let’s-say-complex web of relationships connecting the AI lab to the safety research world it might otherwise have hired from, and the choice starts to make more sense.

An evaluator that needs your goodwill to survive is an evaluator with a conflict.

The nonprofits aren’t out

Anthropic said more evaluators will be announced in the weeks ahead. It also said it’s in conversation with METR and other non-profit organizations about how to “pilot elements of embedded evaluation using their own funding.”

Read that phrasing carefully. Their own funding. Accenture gets a billion-dollar joint commitment; the nonprofits get a conversation about paying their own way in. Whether that distinction reflects independence or budget, Anthropic hasn’t spelled out.

Nobody knows what the rules are yet

The lab was upfront that no standards exist for evaluators’ access or communications, and that it expects its approach to evolve over time. Which is honest, and also a little unnerving for an arrangement this expensive.

What counts as sufficient access? What can an embedded evaluator say publicly, and when? Those questions don’t have answers yet, and the first team through the door is going to end up writing them by default.

External evaluations already play a major part in the release process for new large language models, so this isn’t a brand-new idea so much as a deeper version of an existing one. The stakes moved recently, though. AI agents deployed by OpenAI and Anthropic have hacked into outside websites without raising alarms inside the labs.

Agents doing things nobody noticed is exactly the failure mode an embedded evaluator is supposed to catch.

The accountability objection

Some critics calling for a more responsible approach to building artificial intelligence read Amodei’s scheme as something less noble than it looks: self-policing dressed up as oversight, and a way to deflect blame when a model misbehaves.

Anthropic’s response is direct. These evaluators “do not reduce our accountability, but help to make it more verifiable. The safety of our models remains our responsibility.”

Fair enough as a statement of intent. The test is what happens the first time an embedded team finds something that would delay a launch, and whether anyone outside the building hears about it.

What to watch instead of the stock price

The 8% pop is the least informative thing here. Markets reward the announcement; they don’t audit it.

Watch the names in the next few weeks instead. If the evaluators Anthropic announces next are the research organizations everyone expected, funded properly rather than told to bring their own money, the Accenture deal looks like the start of a genuine bench. If they aren’t, the billion dollars bought a partner whose incentives point the same direction as the lab’s.

Share this article
George Tsagkarakis

George Tsagkarakis, known as Staycalm4now is a professional author in the crypto gaming industry since early 2018. He has experienced all the growth of Blockchain Gaming and helped multiple projects achieve their goals and established a player base. He is the co-founder of egamers.io and now the Founder and owner of CryptoGames.gg He is also the COO of MyStage, an…

More from AI Companies & Funding

Leave a Reply