The people warning us about AI are also building it

Anthropic has pushed for better safety protocols on AI.

Now it’s getting a firsthand view of the impact that can have on a business.

The AI giant’s new models were sidelined by the White House over potential security risks.

BI’s Natalie Musumeci has a cheat sheet on the saga, which kicked off on Friday.

My colleagues at Politico also have a breakdown on the whirlwind 24 hours leading up to the White House’s clampdown on Anthropic.

For Anthropic, it’s been a hectic year balancing concerns over AI safety with its desire to compete in the AI race.

Just look at the back-and-forth over the past six months: Jan.

27: Anthropic CEO Dario Amodei drops a 19,000-word message on the future of AI and the “serious civilizational challenge” it poses.

24: Anthropic weakens its foundational safety commitment amid heightened competition and a lack of government regulation.

27: A dispute between Anthropic and the Department of Defense over how its AI models are used leads the DoD to label Anthropic a supply chain risk.

April 7: Anthropic said its Mythos model is too powerful for the public, citing its knack for finding “high-severity vulnerabilities.” June 1: Anthropic files a confidential S-1 for its IPO.

June 5: Anthropic calls for a coordinated slowdown among frontier AI labs “to enable societal structures and alignment research to keep up with the advance of the technology.” June 9: Anthropic releases Fable 5, which it built by putting safeguards on the aforementioned Mythos model.

June 10: Amodei publishes a blog saying AI is moving at a “lightning pace” while policy is “moving very slowly.” June 12: A US order barring foreign entities or individuals from using Anthropic’s Fable 5 and Mythos leads it to disable the models for everyone.

June 15: Trump officials reportedly met with Anthropic to resolve the export ban on Fable.

The Mythos drama is the clearest example yet of the difficult position the AI industry finds itself in.

The people most qualified to warn about the dangers of advanced AI are also the ones who stand to make trillions creating it.

Governments, meanwhile, are left trying to regulate technology that the people building it don’t fully understand.

And just like tech executives, they’re worried about competition.

Slowing innovation means risking your entire country falling behind.

You all might agree that something needs to be done, but no one wants to be the first to actually do something about it.

The real challenge isn’t building safer AI.

It’s figuring out who gets to decide what “safe enough” means.

Many experts agree on the best way to maintain oversight of increasingly complex AI, but you probably won’t like it.