Approximations to worst-case data dropping: unmasking failure modes
Name
huang-jhuang9-sm-eecs-2025-thesis.pdf
Description
Thesis PDF
Size
921.23 KB
Format
Adobe PDF
Checksum (MD5)
dd7e6aef6d98b60169ba22f9ed91d1f6
Author(s)
Huang, Jenny Yijian
Advisor(s)
Broderick, Tamara
Date Issued
May 2025
Publisher
Massachusetts Institute of Technology
Abstract
A data analyst might worry about generalization if dropping a very small fraction of data points from a study could change its substantive conclusions. Checking this non-robustness directly poses a combinatorial optimization problem and is intractable even for simple models and moderate data sizes. Recently various authors have proposed a diverse set of approximations to detect this non-robustness. In the present work, we show that, even in a setting as simple as ordinary least squares (OLS) linear regression, many of these approximations can fail to detect (true) non-robustness in realistic data arrangements. We focus on OLS in the present work due its widespread use and since some approximations work only for OLS. Of the approximations that do not fail our tests, we find not only that a simple recursive greedy algorithm is the most conceptually straightforward but also that it can be orders of magnitude faster to run than the others.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
