Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. Sequence to better sequence: Continuous revision of combinatorial structures

Sequence to better sequence: Continuous revision of combinatorial structures

Thumbnail Image
Download
Name

Seq2betterSeq.pdf

Description
Accepted version
Size

398.76 KB

Format

Adobe PDF

Checksum (MD5)

3f0c73d180b5d9643f7801066cde3905

sword-2019-05-29T14:20:31.original.xml (130 B)
Original SWORD entry document
Author(s)
Jaakkola, Tommi
•
Gifford, David
•
Mueller, Jonas
Date Issued
2017
Citation
Jaakkola, Tommi, Gifford, David and Mueller, Jonas. 2017. "Sequence to better sequence: Continuous revision of combinatorial structures."
Version
Author's final manuscript
Abstract
© 2017 by the author(s). We present a model that, after learning on observations of (sequence, outcome) pairs, can be efficiently used to revise a new sequence in order to improve its associated outcome. Our framework requires neither example improvements, nor additional evaluation of outcomes for proposed revisions. To avoid combinatorial-search over sequence elements, we specify a generative model with continuous latent factors, which is learned via joint approximate inference using a recurrent variational autoencoder (VAE) and an outcome-predicting neural network module. Under this model, gradient methods can be used to efficiently optimize the continuous latent factors with respect to inferred outcomes. By appropriately constraining this optimization and using the VAE decoder to generate a revised sequence, we ensure the revision is fundamentally similar to the original sequence, is associated with better outcomes, and looks natural. These desiderata are proven to hold with high probability under our approach, which is empirically demonstrated for revising natural language sentences.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
http://creativecommons.org/licenses/by-nc-sa/4.0/
Persistent DSpace Link
https://hdl.handle.net/1721.1/137633
DOI of Published Version
http://proceedings.mlr.press/v70/mueller17a.html
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.