MIT SuperCloud

Abstract

The “big data” problem is pervasive across the DoD and is most commonly characterized by the three “Vs” of big data: volume, velocity, and variety. Now, increasingly, a fourth “V”, veracity (i.e., security), is becoming prominent. The MIT SuperCloud project has demonstrated significant quantitative impact on all of these areas. A key element of the MIT SuperCloud is its database management system, which allows unlimited instances of the National Security Agency (NSA)–developed Apache Accumulo database to be deployed on a project-by-project basis. This capability has moved Lincoln Laboratory to the forefront of the DoD big data community, as Accumulo becomes an increasingly widely used database for the U.S. intelligence community.