Automating comprehensive literature review of cancer risk journal articles
Name
1066740209-MIT.pdf
Description
Full printable version
Size
596.58 KB
Format
Adobe PDF
Checksum (MD5)
e2b953a47aeb364f2ced8fbd1a45f510
Author(s)
Kim, Heeyoon
Advisor(s)
Regina Barzilay.
Date Issued
2017
Publisher
Massachusetts Institute of Technology
Abstract
Recently, researchers at the Massachusetts General Hospital and the Dana Farber Cancer Institute built a calculator that estimates risk of cancer based on genetic mutations. The calculator requires a lot of high quality data from medical journals, which is laborious to obtain by hand. In this thesis, I automate the process of obtaining medical abstracts from PubMed and develop a classifier that uses domain knowledge to determine relevant abstracts. The classifier is very accurate (percent correct = 0.898, F1 = 0.86, recall = 0.905), and is significantly better than the majority baseline. I explore an alternative model that exploits rationales within abstracts, which could lead to an even greater accuracy. After determining relevant abstracts, it's useful to find the size of the cohorts, which is an indicator for the quality of the medical study. Hence, I built a classifier that can accurately extract cohort sizes from abstracts (F1 = 0.883), and developed a strong baseline for distinguishing gene carrier cohort sizes from noncarriers.
Description
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (page 51).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link
