Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis
Author(s)
Su, Isabelle; Qin, Zhao; Saraceno, Tomás; Bisshop, Ally; Mühlethaler, Roland; Ziporyn, Evan; Buehler, Markus J; ... Show more Show less
DownloadPublished version (1.157Mb)
Publisher Policy
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
<jats:title>Abstract</jats:title>
<jats:p>Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom–up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.</jats:p>
Date issued
2021Department
Massachusetts Institute of Technology. Laboratory for Atomistic and Molecular Mechanics; Massachusetts Institute of Technology. Music and Theater Arts SectionJournal
Computer Music Journal
Publisher
MIT Press - Journals
Citation
Su, Isabelle, Qin, Zhao, Saraceno, Tomás, Bisshop, Ally, Mühlethaler, Roland et al. 2021. "Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis." Computer Music Journal, 44 (4).
Version: Final published version