Real-world deep domain adaptation through prediction propagation
Name
1124855185-MIT.pdf
Size
2.48 MB
Format
Adobe PDF
Checksum (MD5)
39402202cf39a69451ae08f8de107f88
Author(s)
Bakker, Michiel Anton.
Advisor(s)
Alex P. Pentland.
Date Issued
2019
Publisher
Massachusetts Institute of Technology
Abstract
Deep learning-based natural language processing classifiers often have difficulty classifying texts that stem from a different domain than the labeled training data. Many domain adaptation methods have been proposed to train classifiers using only labeled texts from a single domain and unlabeled texts from other domains. Nevertheless, we find that the state-of-the-art methods all lack one or more desirable properties for real-world modeling. In particular, we find that the many methods using a domain-adversarial loss are unable to model domains with different label distributions. Motivated by these limitations, we are developing a new method, Prediction Propagation, that can classify texts from different domains without using an adversarial loss. Our method will use the label prediction for reconstructing the input text and backpropagates through the prediction as a way to learn label-related information for the new domain. Our method has the desirable properties for real-world modeling while not compromising on performance.
Description
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 41-44).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link
