Unsupervised multilingual grammar induction
Name
Barzilay_Unsupervised multilingual.pdf
Size
266.04 KB
Format
Adobe PDF
Checksum (MD5)
140cafd4f7fa7fb8821d5a099924e6c7
Author(s)
Snyder, Benjamin
Naseem, Tahira
Barzilay, Regina
Date Issued
August 2009
Journal
Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP
Publisher
Association for Computational Linguistics
Citation
Snyder, Benjamin, Tahira Naseem, and Regina Barzilay (2009). "Unsupervised multilingual grammar induction." Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP (Morristown, N.J.: Association for Computational Linguistics): 73-81. © 2009 Association for Computing Machinery.
Version
Author's final manuscript
Abstract
We investigate the task of unsupervised constituency parsing from bilingual parallel corpora. Our goal is to use bilingual cues to learn improved parsing models for each language and to evaluate these models on held-out monolingual test data. We formulate a generative Bayesian model which seeks to explain the observed parallel data through a combination of bilingual and monolingual parameters. To this end, we adapt a formalism known as unordered tree alignment to our probabilistic setting. Using this formalism, our model loosely binds parallel trees while allowing language-specific syntactic structure. We perform inference under this model using Markov Chain Monte Carlo and dynamic programming. Applying this model to three parallel corpora (Korean-English, Urdu-English, and Chinese-English) we find substantial performance gains over the CCM model, a strong monolingual baseline. On average, across a variety of testing scenarios, our model achieves an 8.8 absolute gain in F-measure.
Subjects
algorithms
design
experimentation
languages
measurement
performance
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Attribution-Noncommercial-Share Alike 3.0 Unported
Persistent DSpace Link
DOI of Published Version
http://portal.acm.org/citation.cfm?id=1687890
