Remote data access and analysis using SciDB
Name
825559039-MIT.pdf
Description
Full printable version
Size
4.43 MB
Format
Adobe PDF
Checksum (MD5)
94465fb77a32756a8bd49984e9658044
Author(s)
Anderson, Alan M., M. Eng. Massachusetts Institute of Technology
Advisor(s)
Lewis Girod and Sam Madden.
Alternative Title
Remote high resolution data access and calculation using SciDB
Date Issued
2012
Publisher
Massachusetts Institute of Technology
Abstract
SciDB is an innovative data analysis system that provides fast querying and manipulation of large amounts of time-series, scientific data. This thesis describes the design of a framework that provides a user interface to SciDB that facilitates interactive processing of large datasets and supports long-running batch jobs on a remote server or cluster. Using this interface, python user scripts access SciDB data, process it, and write new result arrays. The framework addresses problems such as garbage collection, data access permissions and maintenance of provenance. We present a case study in which we apply this framework to data from the WaterWiSe project, and analyze the runtime performance of the system.
Description
Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2012.
Cataloged from PDF version of thesis.
Includes bibliographical references (p. 63).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
M.I.T. theses are protected by
copyright. They may be viewed from this source for any purpose, but
reproduction or distribution in any format is prohibited without written
permission. See provided URL for inquiries about permission.
copyright. They may be viewed from this source for any purpose, but
reproduction or distribution in any format is prohibited without written
permission. See provided URL for inquiries about permission.
Persistent DSpace Link
