MIT Libraries logoDSpace@MIT

MIT
View Item 
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

A Stein variational Newton method

Author(s)
Marzouk, Youssef M; Spantini, Alessio
Thumbnail
DownloadPublished version (459.9Kb)
Terms of use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Metadata
Show full item record
Abstract
Stein variational gradient descent (SVGD) was recently proposed as a general purpose nonparametric variational inference algorithm [Liu & Wang, NIPS 2016]: it minimizes the Kullback-Leibler divergence between the target distribution and its approximation by implementing a form of functional gradient descent on a reproducing kernel Hilbert space. In this paper, we accelerate and generalize the SVGD algorithm by including second-order information, thereby approximating a Newton-like iteration in function space. We also show how second-order information can lead to more effective choices of kernel. We observe significant computational gains over the original SVGD algorithm in multiple test cases.
Date issued
2018-12
URI
https://hdl.handle.net/1721.1/126535
Department
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Journal
32nd Conference on Neural Information Processing Systems (NeurIPS 2018)
Publisher
Curran Associates, Inc.
Citation
Detommaso, Gianluca et al. “A Stein variational Newton method.” Paper presented at the 32nd Conference on Neural Information Processing Systems (NeurIPS 2018), Montreal, Canada, 3-8 December 2018, Curran Associates, Inc. © 2018 The Author(s)
Version: Final published version

Collections
  • MIT Open Access Articles

Browse

All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

My Account

Login

Statistics

OA StatisticsStatistics by CountryStatistics by Department
MIT Libraries
PrivacyPermissionsAccessibilityContact us
MIT
Content created by the MIT Libraries, CC BY-NC unless otherwise noted. Notify us about copyright concerns.