OpenAI, Google, and Anthropic warn AI could help people build biological weapons

The people building the world’s most advanced AI systems are now warning Congress that artificial intelligence could make it easier for bad actors to create biological weapons.

Yes, really.

In a rare moment of public agreement, leaders from OpenAI, Google DeepMind, Anthropic, Microsoft AI, Meta, and dozens of biotech and national security organizations signed an open letter calling for mandatory government oversight of synthetic DNA orders in the United States.

The letter argues that rapidly advancing AI systems are lowering the expertise barrier for dangerous biological research, potentially giving small groups or even individuals access to knowledge that once required teams of elite scientists.

The signatories include OpenAI CEO Sam Altman, Google DeepMind CEO Demis Hassabis, Anthropic CEO Dario Amodei, Microsoft AI CEO Mustafa Suleyman, and Meta Chief AI Officer Alexandr Wang. Nobel Prize winners, Stanford professors, biotech executives, and former national security officials also signed the document.

That alone should probably make folks pause for a minute.

The proposal centers around something called nucleic acid synthesis screening. Companies that manufacture synthetic DNA would be required to screen customer orders for potentially dangerous genetic sequences before shipping them. The letter also calls for mandatory recordkeeping so authorities could trace suspicious biological materials back to their source.

Many companies already do this voluntarily. The difference now is that some of the most powerful people in AI want the federal government to make it mandatory nationwide.

The timing is not accidental.

AI companies are racing to build systems that can reason through advanced scientific problems, including chemistry, biology, and virology. The same capabilities that could help cure diseases or accelerate vaccine development could also theoretically help somebody create something catastrophic.

The letter directly acknowledges that today’s AI systems already outperform PhD-level virologists on certain technical questions within their fields of expertise. While the authors admit the current evidence around biosecurity threats is mixed, they argue the trajectory is obvious and the risks are growing fast.

In other words, the people closest to this technology increasingly seem convinced that AI is becoming too powerful to leave completely unchecked.

Of course, this is where things get complicated.

Supporters say DNA screening is a common-sense safeguard similar to airport security or anti-money laundering checks. Critics, however, will likely see this as another step toward normalization of scientific surveillance and centralized monitoring of biological research.

There is also an uncomfortable irony hanging over the entire conversation. Many of the same companies aggressively pushing AI capabilities forward are now warning lawmakers that the technology may create entirely new categories of existential risk.

That contradiction is impossible to ignore.

Still, when OpenAI, Google DeepMind, Anthropic, biotech firms, and former national security officials all suddenly agree on something this serious, Congress will probably listen.

And that may end up changing the future of biotechnology forever.

Support independent tech journalism

NERDS.xyz is independently owned and operated. If you enjoy my coverage of Linux, AI, hardware, cybersecurity, and tech culture, consider supporting the site on Ko-fi.

Support NERDS.xyz
Avatar of Brian Fagioli
Written by

Brian Fagioli

Technology journalist and founder of NERDS.xyz

Brian Fagioli is a technology journalist and founder of NERDS.xyz. A former BetaNews writer, he has spent over a decade covering Linux, hardware, software, cybersecurity, and AI with a no nonsense approach for real nerds.

Leave a Comment