AI Safety Compendium

Biosecurity

5 min read

Biosecurity

Biosecurity, in the context of ai-safety and effective-altruism, refers to preventing catastrophic biological risks — particularly those enabled or amplified by advanced AI systems. It is ranked by 80000-hours as one of the top four global priorities, with engineered pandemics listed as the third-highest priority problem.

The AI-Biosecurity Nexus

The intersection of AI and biological risk is where biosecurity becomes most alarming. Advanced AI systems could dramatically accelerate dangerous biological research by:

  • Lowering barriers to bioweapon development: Currently, creating a dangerous pathogen requires significant expertise and infrastructure. AI could provide step-by-step guidance that effectively removes the knowledge barrier, making it possible for smaller groups or even individuals to create biological threats that previously required state-level resources.
  • Enabling novel pathogen design: AI could assist in designing pathogens with specific properties — increased transmissibility, lethality, or resistance to treatment — that do not exist in nature.
  • Accelerating gain-of-function research: AI could speed up the process of making pathogens more dangerous, potentially without proper oversight or safety protocols.
  • Removing human gatekeepers: Traditional biological research involves many human checkpoints (ethics reviews, peer review, lab safety protocols). AI-assisted research could bypass some of these checks.

A notable empirical demonstration of the dual-use risk: Urbina et al. (2022) showed that an AI system originally designed to create therapeutic molecules could easily be repurposed to generate thousands of potential chemical warfare agents, some potentially deadlier than known chemical weapons. Soice et al. (2023) showed that LLMs can synthesize and disseminate step-by-step expert knowledge about deadly pathogens, potentially bypassing safety protocols. These examples illustrate that the bioweapon risk from AI is not speculative — the repurposing vectors already exist in deployed systems. See 2501.04064v1 for academic treatment of this as one of two main AI extinction pathways.

The AI Safety Atlas (Ch.2.4) adds 2025-era specifics: researchers redirected drug-discovery AI toward toxicity, generating “40,000 potentially toxic molecules within six hours”; students without biology backgrounds used AI chatbots to identify pandemic pathogens, production methods, and DNA-synthesis firms likely to overlook screening — within one hour. A 2023 MIT study showed 12 of 13 International Gene Synthesis Consortium members fulfilled disguised orders for 1918 pandemic flu fragments and ricin. Declining DNA synthesis costs (halving every 15 months) + cloud labs + benchtop synthesis machines + AI assistance → bioweapon creation increasingly accessible to non-institutional actors. See atlas-ch2-risks-04-misuse-risks.

Scale of the Risk

Engineered pandemics represent one of the few non-AI risks that could plausibly cause a global catastrophe. Unlike natural pandemics, an engineered pathogen could be deliberately designed to maximize harm — combining high transmissibility with high lethality, for instance, or incorporating resistance to known treatments. The COVID-19 pandemic demonstrated how disruptive even a natural pathogen of moderate lethality can be; a deliberately engineered pathogen could be orders of magnitude worse.

Distinction from Other AI Risks

Biosecurity as an AI-related concern falls under the category of catastrophic AI misuse — humans deliberately using AI to cause mass harm — rather than alignment failure or power-seeking behavior (see 80k-catastrophic-ai-misuse). The key distinction:

Risk CategoryActorIntent
Power-seeking AIThe AI system itselfUnintended (emergent)
AI-enabled bioweaponsHuman actorsDeliberate harm
Extreme power concentrationSmall group of humansMay or may not be deliberate

This distinction matters for solutions: biosecurity focuses on access controls, monitoring, and governance rather than alignment and interpretability.

Mitigation Approaches

Governance and Policy

  • International coordination and treaties specifically addressing AI-enabled biological threats
  • Regulatory frameworks for dual-use AI capabilities in biology
  • Export controls on relevant technologies
  • Standards for responsible development of AI systems with biological applications

Technical Safeguards

  • Safety by design: Building safeguards into AI systems that could be used for biological research
  • Monitoring systems: Detecting when AI is being used for weapons-related biological research
  • Access controls: Restricting access to dangerous capability development, including both AI model weights and biological materials
  • DNA synthesis screening: Strengthening screening of synthetic DNA orders to catch potentially dangerous sequences

Meta-Biosecurity

  • Building the field of biosecurity itself — training researchers, developing frameworks, and ensuring that biosecurity considerations are integrated into AI development from the start
  • The EA Forum identifies biosecurity field-building as one of ten tractable AI safety projects (see summary-ea-forum-key-posts)

Connection to Cause Prioritization

Biosecurity is notable within cause-prioritization as one of the few non-AI-specific cause areas that remains in 80,000 Hours’ top tier. This reflects the assessment that even as AI risk dominates the priority rankings, biological catastrophe — especially AI-enabled biological catastrophe — remains a distinct and serious threat that deserves dedicated attention.

Sources cited

Primary URLs harvested from this page’s summary references. Auto-generated by scripts/backfill_citations.py; edit by re-running, not by hand.

Graph View

Graph view

The interactive citation graph is desktop-only. Visit this page on a larger screen to explore how concepts, agendas, papers, and organisations link together.

Backlinks