Training Human-AI Teams
Name
mozannar-mozannar-phd-idss-2024-thesis.pdf
Description
Thesis PDF
Size
23.76 MB
Format
Adobe PDF
Checksum (MD5)
5303b618abd431827f6460f657c57fff
Author(s)
Mozannar, Hussein
Advisor(s)
Sontag, David
Satyanarayan, Arvind
Glassman, Elena
Horvitz, Eric
Date Issued
May 2024
Publisher
Massachusetts Institute of Technology
Abstract
AI systems are augmenting humans' capabilities in settings such as healthcare and programming, forming human-AI teams. To enable more accurate and timely decisions, we need to optimize the performance of the human-AI team directly. In this thesis, we utilize a mathematical framing of the human-AI team and propose a set of methods that optimize the AI, the human, and the interface in which they communicate to enable better team performance. We first show how to provably train AI classifiers that complement humans and can defer the decision to humans when it is best to do so. However, in specific settings, AI cannot autonomously make decisions and thus only provides advice to humans. In that case, we build onboarding procedures that train humans to have an accurate mental model of the AI to enable appropriate reliance. Finally, we study how humans interact with large language models (LLMs) to write code. To understand current inefficiencies, we developed a taxonomy to categorize programmers' interactions with the LLM. Motivated by insight from the taxonomy, we leverage human feedback to know when to best display LLM suggestions.
MIT Department
Massachusetts Institute of Technology. Institute for Data, Systems, and Society
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link
