Show simple item record

dc.contributor.authorLi, Haoyuan
dc.contributor.authorGhodsi, Ali
dc.contributor.authorShenker, Scott
dc.contributor.authorStoica, Ion
dc.contributor.authorZaharia, Matei A.
dc.date.accessioned2016-02-04T00:52:59Z
dc.date.available2016-02-04T00:52:59Z
dc.date.issued2014-11
dc.identifier.isbn9781450332521
dc.identifier.urihttp://hdl.handle.net/1721.1/101090
dc.description.abstractTachyon is a distributed file system enabling reliable data sharing at memory speed across cluster computing frameworks. While caching today improves read workloads, writes are either network or disk bound, as replication is used for fault-tolerance. Tachyon eliminates this bottleneck by pushing lineage, a well-known technique, into the storage layer. The key challenge in making a long-running lineage-based storage system is timely data recovery in case of failures. Tachyon addresses this issue by introducing a checkpointing algorithm that guarantees bounded recovery cost and resource allocation strategies for recomputation under commonly used resource schedulers. Our evaluation shows that Tachyon outperforms in-memory HDFS by 110x for writes. It also improves the end-to-end latency of a realistic workflow by 4x. Tachyon is open source and is deployed at multiple companies.en_US
dc.description.sponsorshipNational Science Foundation (U.S.) (CISE Expeditions Award CCF-1139158)en_US
dc.description.sponsorshipLawrence Berkeley National Laboratory (Award 7076018)en_US
dc.description.sponsorshipUnited States. Defense Advanced Research Projects Agency (XData Award FA8750-12-2-0331)en_US
dc.language.isoen_US
dc.publisherAssociation for Computing Machinery (ACM)en_US
dc.relation.isversionofhttp://dx.doi.org/10.1145/2670979.2670985en_US
dc.rightsCreative Commons Attribution-Noncommercial-Share Alikeen_US
dc.rights.urihttp://creativecommons.org/licenses/by-nc-sa/4.0/en_US
dc.sourceMIT web domainen_US
dc.titleTachyon: Reliable, Memory Speed Storage for Cluster Computing Frameworksen_US
dc.typeArticleen_US
dc.identifier.citationHaoyuan Li, Ali Ghodsi, Matei Zaharia, Scott Shenker, and Ion Stoica. 2014. Tachyon: Reliable, Memory Speed Storage for Cluster Computing Frameworks. In Proceedings of the ACM Symposium on Cloud Computing (SOCC '14). ACM, New York, NY, USA, Article 6 , 15 pages.en_US
dc.contributor.departmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Scienceen_US
dc.contributor.mitauthorZaharia, Matei A.en_US
dc.relation.journalProceedings of the ACM Symposium on Cloud Computing (SOCC '14)en_US
dc.eprint.versionAuthor's final manuscripten_US
dc.type.urihttp://purl.org/eprint/type/ConferencePaperen_US
eprint.statushttp://purl.org/eprint/status/NonPeerRevieweden_US
dspace.orderedauthorsLi, Haoyuan; Ghodsi, Ali; Zaharia, Matei; Shenker, Scott; Stoica, Ionen_US
dc.identifier.orcidhttps://orcid.org/0000-0002-7547-7204
mit.licenseOPEN_ACCESS_POLICYen_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record