2026-09-19T03:48:59Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1554992024-07-09T03:07:07Zcom_1721.1_7582com_1721.1_7581col_1721.1_131022
Mazumder, Rahul
Behdin, Kayhan
Massachusetts Institute of Technology. Operations Research Center
Sloan School of Management
2024-07-08T18:55:22Z
2024-07-08T18:55:22Z
2024-05
2024-05-30T21:18:50.253Z
https://hdl.handle.net/1721.1/155499
In various statistical tasks it is of interest to learn estimators with discrete structures (e.g., sparsity, low-rank, shared model parameters, etc)---they are appealing for their interpretability and compactness. However, learning with discrete structures can be computationally challenging. In this thesis, we explore statistical and computational aspects of statistics estimators (some classical and some new) that can be formulated as discrete optimization problems.
In Chapters 2 and 3, we study two well-known problems in high-dimensional statistics: sparse Principal Component Analysis (PCA) and Gaussian Graphical Models. These are notoriously hard optimization problems---we explore computationally friendlier estimators based on Mixed Integer Programming (MIP) under suitable statistical assumptions. We study the statistical and computational properties of our estimators.
In the fourth chapter, we study the multi-task learning problem with sparse linear estimators. Motivated by applications in biomedical sciences, we propose a new modeling framework to jointly learn sparse linear estimators for different tasks by sharing support information. Our theoretical results show that our joint estimation framework can lead to better statistical properties compared to independently fitting models for each task. We develop scalable approximate solvers for our MIP-based formulation.
In the fifth chapter, we study the problem of sparse Nonnegative Matrix Factorization (NMF) using Cutler and Breiman's archetypal regularization.
We explore the utility of our methods in the context of applications in the biomedical sciences, computer vision and computational finance.
Ph.D.
Massachusetts Institute of Technology
In Copyright - Educational Use Permitted
Copyright retained by author(s)
https://rightsstatements.org/page/InC-EDU/1.0/
Statistical Learning with Discrete Structures: Statistical
and Computational Perspectives
Thesis
application/pdf
Doctoral
Doctor of Philosophy
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="d7a8df5d-4eed-46f0-be12-d7f73caf3af4">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Title>Statistical Learning with Discrete Structures: Statistical
and Computational Perspectives</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2024-05</PublicationDate>
<Authors>
<Author>
<DisplayName>Behdin, Kayhan</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>https://rightsstatements.org/page/InC-EDU/1.0/</License>
<Abstract>In various statistical tasks it is of interest to learn estimators with discrete structures (e.g., sparsity, low-rank, shared model parameters, etc)---they are appealing for their interpretability and compactness. However, learning with discrete structures can be computationally challenging. In this thesis, we explore statistical and computational aspects of statistics estimators (some classical and some new) that can be formulated as discrete optimization problems.
In Chapters 2 and 3, we study two well-known problems in high-dimensional statistics: sparse Principal Component Analysis (PCA) and Gaussian Graphical Models. These are notoriously hard optimization problems---we explore computationally friendlier estimators based on Mixed Integer Programming (MIP) under suitable statistical assumptions. We study the statistical and computational properties of our estimators.
In the fourth chapter, we study the multi-task learning problem with sparse linear estimators. Motivated by applications in biomedical sciences, we propose a new modeling framework to jointly learn sparse linear estimators for different tasks by sharing support information. Our theoretical results show that our joint estimation framework can lead to better statistical properties compared to independently fitting models for each task. We develop scalable approximate solvers for our MIP-based formulation.
In the fifth chapter, we study the problem of sparse Nonnegative Matrix Factorization (NMF) using Cutler and Breiman's archetypal regularization.
We explore the utility of our methods in the context of applications in the biomedical sciences, computer vision and computational finance.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>