An effective coreset compression algorithm for large scale sensor networks
Author(s)
Feldman, Dan; Sugaya, Andrew; Rus, Daniela L.
DownloadRus_An effective coreset.pdf (402.7Kb)
OPEN_ACCESS_POLICY
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
The wide availability of networked sensors such as GPS and cameras is enabling the creation of sensor networks that generate huge amounts of data. For example, vehicular sensor networks where in-car GPS sensor probes are used to model and monitor traffic can generate on the order of gigabytes of data in real time. How can we compress streaming high-frequency data from distributed sensors? In this paper we construct coresets for streaming motion. The coreset of a data set is a small set which approximately represents the original data. Running queries or fitting models on the coreset will yield similar results when applied to the original data set.
We present an algorithm for computing a small coreset of a large sensor data set. Surprisingly, the size of the coreset is independent of the size of the original data set. combining map-and-reduce techniques with our coreset yields a system capable of compressing in parallel a stream of O(n) points using space and update time that is only O(log n). We provide experimental results and compare the algorithm to the popular Douglas-Peucker heuristic for compressing GPS data.
Date issued
2012-04Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory; Massachusetts Institute of Technology. School of EngineeringJournal
Proceedings of the 11th international conference on Information Processing in Sensor Networks (IPSN '12 )
Publisher
Association for Computing Machinery (ACM)
Citation
Dan Feldman, Andrew Sugaya, and Daniela Rus. 2012. An effective coreset compression algorithm for large scale sensor networks. In Proceedings of the 11th international conference on Information Processing in Sensor Networks (IPSN '12). ACM, New York, NY, USA, 257-268.
Version: Author's final manuscript
ISBN
978-1-4503-1227-1