Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Libraries
  3. MIT Theses
  4. Graduate Theses
  5. Parallel and distributed MCMC inference using Julia

Parallel and distributed MCMC inference using Julia

Thumbnail Image
Download
Name

1020069264-MIT.pdf

Description
Full printable version
Size

2.83 MB

Format

Adobe PDF

Checksum (MD5)

f1b083a242d975b23014541ee79315e2

Author(s)
Yu, Angel
Advisor(s)
John W. Fisher III and Oren Freifeld.
Alternative Title
Parallel and distributed Markov chain Monte Carlo inference using Julia
Date Issued
2016
Publisher
Massachusetts Institute of Technology
Abstract
Machine learning algorithms are often computationally intensive and operate on large datasets. Being able to eciently learn models on large datasets holds the future of machine learning. As the speed of serial computation stalls, it is necessary to utilize the power of parallel computing in order to better scale with the growing complexity of algorithms and the growing size of datasets. In this thesis, we explore the use of Julia, a fairly new high level programming language that lends itself to easy parallelization over multiple CPU cores as well as multiple machines, on Markov chain Monte Carlo (MCMC) inference algorithms. First, we take existing algorithms and implement them in Julia. We focus on MCMC inference using Continuous Piecewise-Affine Based (CPAB) transformations and a parallel MCMC sampler for Dirichlet Process Mixture Models (DPMM). Instead of parallelizing over multiple cores on a single machine, our Julia implementations extend existing implementations by parallelizing over multiple machines. We compare our implementation with these existing implementations written in more traditional programming languages. Next, we develop a model Projections Dirichlet Process Gaussian Mixture Model (PDP-GMM) which relaxes the assumption that the draws from a Dirichlet Process Gaussian Mixture Model (DP-GMM) are directly observed. We extend our DPMM Julia implementation and present a few applications of this model.
Description
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 71-72).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
http://dspace.mit.edu/handle/1721.1/7582
Persistent DSpace Link
http://hdl.handle.net/1721.1/113440
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.