Disentangling time constant and time dependent hidden state in time series with variational Bayesian inference
Name
1149026032-MIT.pdf
Size
15.86 MB
Format
Adobe PDF
Checksum (MD5)
b82214f22621ab1bb82cc2d5ebde7316
Author(s)
Grullon, Dylan Emanuel Centeno.
Advisor(s)
Duane S. Boning.
Date Issued
2019
Publisher
Massachusetts Institute of Technology
Abstract
In this thesis, we design and explore a new model architecture called a Variational Bayes Recurrent Neural Network (VBRNN) for modelling time series. The VBRNN contains explicit structure to disentangle time constant and time dependent dynamics for use with compatible time series, such as those that can be modelled by differential equations with time constant parameters and time dependent state. The model consists of a Variational Bayes (VB) layer to infer time constant state, as well as a conditioned-RNN to model time dependent dynamics. The VBRNN is explored through various synthetic datasets and problems, and compared to conventional methods on these datasets. This approach demonstrates effective disentanglement, motivating future work to explore the efficacy of this mo del in real word datasets.
Description
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 85-86).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link