Maximal Correlation Feature Selection and Suppression With Applications
Name
Lee-jk_lee-ScD-EECS-2021-thesis.pdf
Description
Thesis PDF
Size
4.49 MB
Format
Adobe PDF
Checksum (MD5)
9c6166d9dbb7a5b9c77af6c8f5812555
Author(s)
Lee, Joshua Ka-Wing
Advisor(s)
Wornell, Gregory W.
Date Issued
September 2021
Publisher
Massachusetts Institute of Technology
Abstract
In standard supervised learning, we assume that we are trying to learn some target variable 𝑌 from some data 𝑋. However, many learning problems can be framed as supervised learning with an auxiliary objective, often associated with an auxiliary variable 𝐷 which defines this objective. Applying the principles of Hirschfeld-Gebelein-Rényi (HGR) maximal correlation analysis reveals new insights as to how to formulate these learning problems with auxiliary objectives. We examine the use of the HGR in feature selection for multi-source transfer learning learning in the fewshot setting. We then apply HGR to the problem of feature suppression via enforcing marginal and conditional independence criteria with respect to a sensitive attribute, and illustrate the effectiveness of our methods to problems of fairness, privacy, and transfer learning. Finally, we explore the use of HGR in extracting features for outlier detection.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
