A syntactic rule-based framework for parallel data synthesis in Japanese GEC
Name
1192561491-MIT.pdf
Size
1.5 MB
Format
Adobe PDF
Checksum (MD5)
6da4ebb149d63dfd5e9cbc60dd5ce8bb
Author(s)
Kimn, Alex(Alex H.)
Advisor(s)
Takako Aikawa.
Date Issued
2020
Publisher
Massachusetts Institute of Technology
Abstract
A lack of parallel training data is the greatest barrier to progress in developing models for grammatical error correction (GEC). This data scarcity issue is especially pronounced for Japanese GEC, where very few parallel error-correct corpora are publicly available. Thus, in this thesis, we propose a syntactic rule-based data synthesis framework designed to generate large parallel training corpora for Japanese GEC. This framework involves two components. The first is a set of syntactic rules that each characterize a common Japanese grammatical error and a corresponding correction by using syntactic information extracted from a small seed corpus. The second is a process for systematically generating error-correct sentence pairs by applying these syntactic rules to any arbitrary corpora of correct Japanese text. To test this framework, we train a standard neural machine translation (NMT) system for Japanese GEC on a training dataset that combines the publicly available Lang-8 corpus and our synthesized data. We evaluate this trained model on a novel parallel training corpus designed to mimic Japanese learners' writing in the classroom setting and compare it's performance to a similar model trained on the Lang-8 corpus alone. Using this comparison, we show that our synthesised data can significantly improve the performance of Japanese GEC systems.
Description
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, May, 2020
Cataloged from the official PDF of thesis.
Includes bibliographical references (pages 99-103).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.
Persistent DSpace Link
