MIT Libraries logoDSpace@MIT

MIT
View Item 
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
  • DSpace@MIT Home
  • MIT Open Access Articles
  • MIT Open Access Articles
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Fast DPP Sampling for Nyström with Application to Kernel Methods

Author(s)
Li, Chengtao; Jegelka, Stefanie Sabrina; Sra, Suvrit
Thumbnail
DownloadJegelka_Fast DPP.pdf (696.7Kb)
OPEN_ACCESS_POLICY

Open Access Policy

Creative Commons Attribution-Noncommercial-Share Alike

Terms of use
Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/
Metadata
Show full item record
Abstract
The Nyström method has long been popular for scaling up kernel methods. Its theoretical guarantees and empirical performance rely critically on the quality of the landmarks selected. We study landmark selection for Nyström using Determinantal Point Processes (Dpps), discrete probability models that allow tractable generation of diverse samples. We prove that landmarks selected via Dpps guarantee bounds on approximation errors; subsequently, we analyze implications for kernel ridge regression. Contrary to prior reservations due to cubic complexity of Dpp sampling, we show that (under certain conditions) Markov chain Dpp sampling requires only linear time in the size of the data. We present several empirical results that support our theoretical analysis, and demonstrate the superior performance of Dpp-based landmark selection compared with existing approaches
Date issued
2016-06
URI
http://hdl.handle.net/1721.1/113415
Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Journal
International Conference on Machine Learning
Publisher
Proceedings of Machine Learning Research
Citation
Li, Chengtao, Stefanie Jegelka, and Suvrit Sra. "Fast Dpp Sampling for Nyström with Application to Kernel Methods." International Conference on Machine Learning, 20-22 June, 2016, New York, New York, Proceedings of Machine Learning Research, 2016.
Version: Original manuscript

Collections
  • MIT Open Access Articles

Browse

All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

My Account

Login

Statistics

OA StatisticsStatistics by CountryStatistics by Department
MIT Libraries
PrivacyPermissionsAccessibilityContact us
MIT
Content created by the MIT Libraries, CC BY-NC unless otherwise noted. Notify us about copyright concerns.