Documentation as a Tool for Algorithmic Accountability
Name
curtis-tlcurtis-sm-tpp-2024-thesis.pdf
Description
Thesis PDF
Size
1.22 MB
Format
Adobe PDF
Checksum (MD5)
b4d7927c07ce6238e43e145f92c34589
Author(s)
Curtis, Taylor Lynn
Advisor(s)
Hadfield-Menell, Dylan
Date Issued
May 2024
Publisher
Massachusetts Institute of Technology
Abstract
This thesis argues that civil liability should rest on the deployer's understanding of system behavior, and that documentation is the necessary tool to accomplish this goal. This work begins by establishing the ``hole'' in current approaches to AI risk regulation, the lack of a civil liability regime. It also highlights that civil liability is an already existing and effective regulatory tool that can be applied to AI. The rest of this thesis develops this argument by looking at what is necessary for such a framework to exist. It argues that an understanding of system behaviour is essential and achievable through documentation. It is divided into two substantive chapters. Firstly, Chapter 2 outlines how system behaviour can inform policy through documentation, linking the necessity of documentation to liability and proposing a concrete liability scheme based on documenting system understanding. Secondly, Chapter 3 discusses how documentation can alter a person's understanding of system behaviour, presenting a user study that demonstrates how system understanding can be achieved through documentation and structured data interaction. It argues that testing and system understanding are not insurmountable challenges and that by engaging in a relatively simple process, AI deployers can better understand the behaviour of their models. Overall, this thesis provides a methodical guide to understanding AI system behaviour and the establishment of a new pathway for effective regulation, arguing for the understanding of system behaviour and documentation at deployment as the path forward to achieve civil liability in AI.
MIT Department
Massachusetts Institute of Technology. Institute for Data, Systems, and Society
Technology and Policy Program
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link
