Clinical Text De-identification Using Large Language Models: Insights from Organ Procurement Data
Name
dahleh-odahleh-meng-eecs-2025-thesis.pdf
Description
Thesis PDF
Size
663.28 KB
Format
Adobe PDF
Checksum (MD5)
c56939ab5e6857d9aabd7acef96970b3
Author(s)
Dahleh, Omar
Advisor(s)
Ghassemi, Marzyeh
Date Issued
May 2025
Publisher
Massachusetts Institute of Technology
Abstract
This thesis presents a novel approach to the de-identification of clinical notes from Organ Procurement Organization (OPO) records, leveraging advanced natural language processing (NLP) methodologies. Specifically, we employ in-context learning using large language models (LLMs) to effectively identify and remove protected health information (PHI), aiming to maintain high data utility post-redaction. Our work systematically evaluates the performance of the LLM-based method against established baseline techniques, including traditional Named Entity Recognition (NER) and rules-based systems. Through a slew of experiments, we assesses the strengths and limitations of each method regarding precision and recall. This work will contribute to a uniquely extensive dataset, comprising millions of de-identified OPO clinical notes, which will facilitate ethical healthcare research and enhance compliance with contemporary data protection standards. Ultimately, this dataset holds significant potential for improving processes and outcomes within the field of organ donation and procurement.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
