2026-09-20T13:10:44Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1231262026-06-06T00:48:53Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Peter Szolovits.
Vajapey, Anuhya.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2019-12-05T18:04:52Z
2019-12-05T18:04:52Z
2019
2019
https://hdl.handle.net/1721.1/123126
1128277299
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 56-58).
Administering sedation to patients to avoid underdosing and overdosing is an important clinical task that remains hard to control due to lack of precision in current methods of measuring sedation. The type of drugs administered, the procedure the patient is undergoing, patient characteristics (age, gender, weight, height), even genotypes can affect the way the patient's body processes the sedation administered. Currently, sedation is administered by an attending anesthesiologist who sets a target sedation level and continuously monitors the patient with an EEG and adjusts the target level accordingly. In this thesis, I apply Fitted Q-Iteration to learn a Reinforcement Learning Model that takes in a patient's current state and predicts the dosage of sedation to administer at each second during the procedure to keep the patient's physiological variables within clinically normal ranges. I experiment with different state and action representations to demonstrate how different choices affect the policy learned by the Reinforcement Learning Model. I evaluate the results qualitatively and quantitatively through the implementation of Doubly Robust Policy Evaluation.
by Anuhya Vajapey.
M.Eng.
M.Eng. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science
58 pages
eng
Massachusetts Institute of Technology
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
http://dspace.mit.edu/handle/1721.1/7582
Electrical Engineering and Computer Science.
Predicting optimal sedation control with reinforcement learning
Thesis
application/pdf
2019-12-05T18:04:51Z
Publication
Master
EECS
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="17120ffb-3280-48a9-b4e9-aeeca172bfa3">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>Predicting optimal sedation control with reinforcement learning</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2019</PublicationDate>
<Authors>
<Author>
<DisplayName>Vajapey, Anuhya.</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Electrical Engineering and Computer Science.</Keyword>
<Abstract>Administering sedation to patients to avoid underdosing and overdosing is an important clinical task that remains hard to control due to lack of precision in current methods of measuring sedation. The type of drugs administered, the procedure the patient is undergoing, patient characteristics (age, gender, weight, height), even genotypes can affect the way the patient's body processes the sedation administered. Currently, sedation is administered by an attending anesthesiologist who sets a target sedation level and continuously monitors the patient with an EEG and adjusts the target level accordingly. In this thesis, I apply Fitted Q-Iteration to learn a Reinforcement Learning Model that takes in a patient's current state and predicts the dosage of sedation to administer at each second during the procedure to keep the patient's physiological variables within clinically normal ranges. I experiment with different state and action representations to demonstrate how different choices affect the policy learned by the Reinforcement Learning Model. I evaluate the results qualitatively and quantitatively through the implementation of Doubly Robust Policy Evaluation.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>