A Diagnostic and Prescriptive Conformal Prediction Framework: Applied to Sleep Disorders
Name
khalif-fkhalif-meng-bcs-2024-thesis.pdf
Description
Thesis PDF
Size
1.2 MB
Format
Adobe PDF
Checksum (MD5)
23f39d8fa6839969702282a3709cf578
Author(s)
Khalif, Faduma
Advisor(s)
Barzilay, Regina
Date Issued
February 2024
Publisher
Massachusetts Institute of Technology
Abstract
We propose a novel predictive framework for the future diagnoses and treatments of patients with neurological conditions, specifically patients with sleep disorders, given their clinical history. Via the use of a conformal algorithm with a classifier as its base model, we are able to utilize a patients history of diagnoses, pharmacy dispensing, and other features to produce a set of possible final sleep disorder diagnoses and/or treatments with a definitive level of confidence and bounded level of uncertainty. We also utilize selective classification in order to allow the model to abstain from generating a prediction in cases where the algorithm’s predictive confidence does not meet a given confidence threshold, and we further investigate variables that correlate with “abstain” model outcomes. In addition, we experiment with the use of additional machine learning methods such as no-regret learning to better address issues that arise in clinical decision-making. We find that even in cases where there is a limited level of accuracy produced by our base classifier, we are able to use minimal data and selective prediction to establish highly accurate predictive outcomes for certain subsets of our cohort. In developing and testing this framework, we attempt to propose a new standard for predictive algorithms that target clinical-use cases and to better understand uncertainty quantification in a multitude of dimensions.
MIT Department
Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link
