OpenAI is scared of open-weight models. Should the US be?

But the most significant motivation for restricting the models is that fear that China will be able to outpace the US if the frontier labs slow down.

Sam Bresnick, a China-focused research fellow at Georgetown’s Center for Security and Emerging Technology, says the growing importance of AI to the US military operations gives the US a reason to support continued investment in AI at the frontier labs. But the whole question, he says, is fraught.

“Why should the weight of the U.S. government be aimed at protecting these these companies from competitors that are being locked out from the U.S. market based on their origins?” Bresnick asks.

Advocates for open AI say that the frontier companies are creating a false binary between innovation and closed models.

“The bigger impact of having these open source models come from China is less that they’re sneaking in back doors, and more that they are owning the innovation,” Hancock told TechCrunch. “You end up with, effectively, an expanded workforce on your model. PyTorch became the industry standard because it was open source, and so the whole community could contribute to it rather than just one company, and it grew and grew, and all the rest of the deep learning libraries kind of died in comparison.”

Hancock and other advocates fear that Chinese LLMs will become the locus of international research. Already, US graduate programs mainly build on open-weight Chinese models, and Hancock says that half of the papers students study are coming from Chinese institutions, with American frontier labs increasingly reticent about sharing their work widely.

“Restricting open models wouldn’t make AI safer,” said Clem Delangue, the CEO of Hugging Face, a platform for open AI collaboration. “It would simply hide the risks, concentrate power in the hands of a few and make it harder for the next generation of builders, researchers, academia, non-profits, governments to participate in making AI safer and more beneficial for all.”

Bresnick says that the real way to slow China would be to focus more on chip export controls. A better way to preserve US AI leadership would be to stop selling Nvidia H200 processors to China. “That,” he says, “could potentially keep us out of this thorny debate about banning open source technologies that huge numbers of US companies want to use.”

Part of the problem is that uncertainty around AI economics. “The open business model, the proprietary business model — neither one is figured out. AI companies are struggling to figure out how to make money on their tools, especially as training costs need to go up and up,” Bresnick points out.

The same challenges that play out in the US are also playing out in China, where AI companies are also struggling to generate revenue and access compute power, and the government is seen as encouraging open releases for policy reasons despite the challenge in capitalizing on them.

Some US companies, including Thinking Machines Lab and Nvidia, are trying to make a business around releasing open models. Hancock points out that Nvidia would do better “if there are dozens or hundreds of companies building AI than rather than two or three that are well capitalized enough to make their own chips,” which is one reason behind its investment in Nemotron, a collection of open models.

“The main point is the U.S. would be very well served to have its own very capable, much less expensive open models,” Bresnick said. “It just clashes with the approach the frontier labs have taken.”

With additional reporting from Rebecca Bellan.