Sampling from Determinantal Point Processes for Scalable Manifold Learning
Name
Sampling from.pdf
Size
599.88 KB
Format
Adobe PDF
Checksum (MD5)
0bed5bb7d96f660cb06a9e545216b16d
Author(s)
Wachinger, Christian
Golland, Polina
Date Issued
July 2015
Journal
Information Processing in Medical Imaging
Publisher
Springer-Verlag
Citation
Wachinger, Christian, and Golland, Polina. “Sampling from Determinantal Point Processes for Scalable Manifold Learning.” Information Processing in Medical Imaging (2015): 687–698
Version
Author's final manuscript
Abstract
High computational costs of manifold learning prohibit its application for large datasets. A common strategy to overcome this problem is to perform dimensionality reduction on selected landmarks and to successively embed the entire dataset with the Nyström method. The two main challenges that arise are: (i) the landmarks selected in non-Euclidean geometries must result in a low reconstruction error, (ii) the graph constructed from sparsely sampled landmarks must approximate the manifold well. We propose to sample the landmarks from determinantal distributions on non-Euclidean spaces. Since current determinantal sampling algorithms have the same complexity as those for manifold learning, we present an efficient approximation with linear complexity. Further, we recover the local geometry after the sparsification by assigning each landmark a local covariance matrix, estimated from the original point set. The resulting neighborhood selection based on the Bhattacharyya distance improves the embedding of sparsely sampled manifolds. Our experiments show a significant performance improvement compared to state-of-the-art landmark selection techniques on synthetic and medical data.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1007/978-3-319-19992-4_54
