GenBase: A Complex Analytics Genomics Benchmark
Name
MIT-CSAIL-TR-2013-028.pdf
Size
2.01 MB
Format
Adobe PDF
Checksum (MD5)
366e58a0433593f26eb61188a6ab0105
Download all files submitted through automated deposit
Author(s) • • • • •
Taft, Rebecca
Vartak, Manasi
Satish, Nadathur Rajagopalan
Sundaram, Narayanan
Madden, Samuel
Stonebraker, Michael
Advisor(s)
Sam Madden
Date Issued
November 19, 2013
Series/Report no.
MIT-CSAIL-TR-2013-028
Abstract
This paper introduces a new benchmark, designed to test database management system (DBMS) performance on a mix of data management tasks (joins, filters, etc.) and complex analytics (regression, singular value decomposition, etc.) Such mixed workloads are prevalent in a number of application areas, including most science workloads and web analytics. As a specific use case, we have chosen genomics data for our benchmark, and have constructed a collection of typical tasks in this area. In addition to being representative of a mixed data management and analytics workload, this benchmark is also meant to scale to large dataset sizes and multiple nodes across a cluster. Besides presenting this benchmark, we have run it on a variety of storage systems including traditional row stores, newer column stores, Hadoop, and an array DBMS. We present performance numbers on all systems on single and multiple nodes, and show that performance differs by orders of magnitude between the various solutions. In addition, we demonstrate that most platforms have scalability issues. We also test offloading the analytics onto a coprocessor. The intent of this benchmark is to focus research interest in this area; to this end, all of our data, data generators, and scripts are available on our web site.
Terms of Use
Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported
Persistent DSpace Link