Convex Total Least Squares
Name
2014_Malioutov_Slavov.pdf
Size
620.74 KB
Format
Adobe PDF
Checksum (MD5)
71787a3c0910cf8a192489370f1d4bc8
Author(s)
Slavov, Nikolai G
Malioutov, Dmitry M., 1981-
Date Issued
June 2014
Journal
Journal of Machine Learning Research
Publisher
Association for Computing Machinery (ACM)
Citation
Malioutov, Dmitry, and Nikolai Slavov. "Convex Total Least Squares." Proceedings of the 31st International Conference on Machine Learning, Beijing, China, 2014. JMLR: W&CP volume 32.
Version
Final published version
Abstract
We study the total least squares (TLS) problem that generalizes least squares regression by allowing measurement errors in both dependent and independent variables. TLS is widely used in applied fields including computer vision, system identification and econometrics. The special case when all dependent and independent variables have the same level of uncorrelated Gaussian noise, known as ordinary TLS, can be solved by singular value decomposition (SVD). However, SVD cannot solve many important practical TLS problems with realistic noise structure, such as having varying measurement noise, known structure on the errors, or large outliers requiring robust error-norms. To solve such problems, we develop convex relaxation approaches for a general class of structured TLS (STLS). We show both theoretically and experimentally, that while the plain nuclear norm relaxation incurs large approximation errors for STLS, the re-weighted nuclear norm approach is very effective, and achieves better accuracy on challenging STLS problems than popular non-convex solvers. We describe a fast solution based on augmented Lagrangian formulation, and apply our approach to an important class of biological problems that use population average measurements to infer cell-type and physiological-state specific expression levels that are very hard to measure directly.
MIT Department
Massachusetts Institute of Technology. Department of Biology
Massachusetts Institute of Technology. Department of Physics
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
DOI of Published Version
http://jmlr.org/proceedings/papers/v32/malioutov14.html
