The Reality of AI and Biorisk
Author(s)
Peppin, Aidan; Reuel, Anka; Casper, Stephen; Jones, Elliot; Strait, Andrew; Anwar, Usman; Agrawal, Anurag; Kapoor, Sayash; Koyejo, Sanmi; Pellat, Marie; Bommasani, Rishi; Frosst, Nick; Hooker, Sara; ... Show more Show less
Download3715275.3732048.pdf (582.8Kb)
Publisher Policy
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
To accurately and confidently answer the question “could an AI model or system increase biorisk”, it is necessary to have both a sound theoretical threat model for how AI models or systems could increase biorisk and a robust method for testing that threat model. This paper provides an analysis of existing available research surrounding two AI and biorisk threat models: 1) access to information and planning via large language models (LLMs), and 2) the use of AI-enabled biological tools (BTs) in synthesizing novel biological artifacts. We find that existing studies around AI-related biorisk are nascent, often speculative in nature, or limited in terms of their methodological maturity and transparency. The available literature suggests that current LLMs and BTs do not pose an immediate risk, and more work is needed to develop rigorous approaches to understanding how future models could increase biorisks. We end with recommendations about how empirical work can be expanded to more precisely target biorisk and ensure rigor and validity of findings.
Description
FAccT ’25, Athens, Greece
Date issued
2025-06-23Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer SciencePublisher
ACM|The 2025 ACM Conference on Fairness, Accountability, and Transparency
Citation
Aidan Peppin, Anka Reuel, Stephen Casper, Elliot Jones, Andrew Strait, Usman Anwar, Anurag Agrawal, Sayash Kapoor, Sanmi Koyejo, Marie Pellat, Rishi Bommasani, Nick Frosst, and Sara Hooker. 2025. The Reality of AI and Biorisk. In Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT '25). Association for Computing Machinery, New York, NY, USA, 763–771.
Version: Final published version
ISBN
979-8-4007-1482-5