SensorChimes : musical mapping for sensor networks toward augmented acoustic ecosystem

Abstract

SensorChimes aims to create a new canvas for artists leveraging ubiquitous sensing and data collection. The Tidmarsh Living Observatory Initiative, which is documenting the transformation of a reclaimed cranberry bog with a large-scale sensor deployment, provides an opportunity to explore data-driven musical composition based on large-scale environmental sensor networks. This thesis presents a framework that facilitates musical mappings for such sensor networks. A library of C-externals called ChainFlow for the graphical programming language Max/MSP that provides an interface to real-time and historical data for large sensor deployments was designed and implemented. This thesis envisions musical mapping for sensor networks as a tool for augmenting presence and telepresence in real and virtual worlds, by adding to the acoustic ecosystem. Physical processes are manifested as musical ideas rendering an ambient display. The ChainFlow library along with spatial audio techniques were used to create immersive musical compositions that are complemented by a graphical 3D virtual world. These works, driven by the sensor network deployed at Tidmarsh, are presented as case studies in augmented presence through musical mapping.