{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T20:12:40Z","timestamp":1774383160407,"version":"3.50.1"},"reference-count":33,"publisher":"MIT Press","issue":"4","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom\u2013up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.<\/jats:p>","DOI":"10.1162\/comj_a_00580","type":"journal-article","created":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T19:26:45Z","timestamp":1638905205000},"page":"43-59","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis"],"prefix":"10.1162","volume":"44","author":[{"given":"Isabelle","family":"Su","sequence":"first","affiliation":[{"name":"Laboratory for Atomistic and Molecular Mechanics (LAMM) isu@mit.edu"}]},{"given":"Zhao","family":"Qin","sequence":"additional","affiliation":[{"name":"Laboratory for Atomistic and Molecular Mechanics (LAMM) qinzhao@mit.edu"}]},{"given":"Tom\u00e1s","family":"Saraceno","sequence":"additional","affiliation":[{"name":"Studio Tom\u00e1s Saraceno Hauptstrasse 11\/12, 10317 Berlin, Germany tomas@t-saraceno.org"}]},{"given":"Ally","family":"Bisshop","sequence":"additional","affiliation":[{"name":"Studio Tom\u00e1s Saraceno Hauptstrasse 11\/12, 10317 Berlin, Germany ally@t-saraceno.org"}]},{"given":"Roland","family":"M\u00fchlethaler","sequence":"additional","affiliation":[{"name":"Studio Tom\u00e1s Saraceno Hauptstrasse 11\/12, 10317 Berlin, Germany roland@t-saraceno.org"}]},{"given":"Evan","family":"Ziporyn","sequence":"additional","affiliation":[{"name":"Department of Music and Theater Arts zipo@mit.edu"}]},{"given":"Markus J.","family":"Buehler","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology 77 Massachusetts Avenue, Cambridge, Massachusetts 02139, USA mbuehler@mit.edu"}]}],"member":"281","published-online":{"date-parts":[[2020,12,1]]},"reference":[{"key":"2022033115310821700_B1","author":"Arrhenius","year":"2011","journal-title":"14 Billions (Working Title)"},{"issue":"13","key":"2022033115310821700_B2","doi-asserted-by":"publisher","first-page":"5229","DOI":"10.1073\/pnas.0901377106","article-title":"Reconstructing Web Evolution and Spider Diversification in the Molecular Era.","volume":"106","author":"Blackledge","year":"2009","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"2022033115310821700_B3","doi-asserted-by":"crossref","first-page":"1467","DOI":"10.1145\/1873951.1874248","article-title":"Sonic Visualiser: An Open Source Application for Viewing, Analysing, and Annotating Music Audio Files.","author":"Cannam","year":"2010","journal-title":"Proceedings of the ACM International Conference on Multimedia"},{"key":"2022033115310821700_B4","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-007-1611-7","author":"Cranford","year":"2012","journal-title":"Biomateriomics"},{"issue":"7383","key":"2022033115310821700_B5","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1038\/nature10739","article-title":"Nonlinear Material Behaviour of Spider Silk Yields Robust Webs","volume":"482","author":"Cranford","year":"2012","journal-title":"Nature"},{"issue":"2","key":"2022033115310821700_B6","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1080\/07494467.2016.1221629","article-title":"Atomisation of Sound.","volume":"35","author":"Davismoon","year":"2016","journal-title":"Contemporary Music Review"},{"issue":"4","key":"2022033115310821700_B7","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s12668-011-0022-5","article-title":"Reoccurring Patterns in Hierarchical Protein Materials and Music: The Power of Analogies.","volume":"1","author":"Giesa","year":"2011","journal-title":"BioNanoScience"},{"issue":"2","key":"2022033115310821700_B8","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/S0021-9991(03)00319-X","article-title":"A Comprehensive Three-Dimensional Model of the Cochlea.","volume":"191","author":"Givelberg","year":"2003","journal-title":"Journal of Computational Physics"},{"issue":"2","key":"2022033115310821700_B9","article-title":"Three-Dimensional-Printing of Bio-Inspired Composites.","volume":"138","author":"Gu","year":"2016","journal-title":"Journal of Biomechanical Engineering"},{"issue":"57","key":"2022033115310821700_B10","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1098\/rsif.2010.0454","article-title":"High-Performance Spider Webs: Integrating Biomechanics, Ecology and Behaviour","volume":"8","author":"Harmer","year":"2011","journal-title":"Journal of The Royal Society Interface"},{"key":"2022033115310821700_B11","article-title":"Taxonomy and Definitions for Sonification and Auditory Display.","author":"Hermann","year":"2008","journal-title":"Proceedings of the International Conference on Auditory Display"},{"key":"2022033115310821700_B12","author":"Hermann","year":"2011","journal-title":"The Sonification Handbook"},{"issue":"5","key":"2022033115310821700_B13","doi-asserted-by":"publisher","first-page":"R187","DOI":"10.1016\/j.cub.2016.01.054","article-title":"Biotremology","volume":"26","author":"Hill","year":"2016","journal-title":"Current Biology"},{"key":"2022033115310821700_B14","article-title":"Sonification Report: Status of the Field and Research Agenda.","author":"Kramer","year":"2010"},{"key":"2022033115310821700_B15","author":"Luhmann","year":"2010","journal-title":"Nahbereichsphotogrammetrie: Grundlagen, Methoden und Anwendungen"},{"key":"2022033115310821700_B16","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.anbehav.2017.06.015","article-title":"Biotremology: Do Physical Constraints Limit the Propagation of Vibrational Information?","volume":"130","author":"Mortimer","year":"2017","journal-title":"Animal Behaviour"},{"key":"2022033115310821700_B17","volume-title":"Abstracts of the International Conference on Invertebrate Sound and Vibration","author":"Mortimer","year":"2013"},{"issue":"122","key":"2022033115310821700_B18","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2016.0341","article-title":"Tuning the Instrument: Sonic Properties in the Spider's Web.","volume":"13","author":"Mortimer","year":"2016","journal-title":"Journal of The Royal Society Interface"},{"issue":"3","key":"2022033115310821700_B19","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/BF00394856","article-title":"Functional Organization of the Spinning Apparatus of Cyrtophora Citricola with Regard to the Evolution of the Web (Araneae, Araneidae).","volume":"113","author":"Peters","year":"1993","journal-title":"Zoomorphology"},{"issue":"3","key":"2022033115310821700_B20","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1162\/COMJ_a_00374","article-title":"Smart Interfaces for Granular Synthesis of Sound by Fractal Organization.","volume":"40","author":"Rhys","year":"2016","journal-title":"Computer Music Journal"},{"issue":"2","key":"2022033115310821700_B21","doi-asserted-by":"publisher","first-page":"61","DOI":"10.2307\/3680222","article-title":"Automated Granular Synthesis of Sound.","volume":"2","author":"Roads","year":"1978","journal-title":"Computer Music Journal"},{"key":"2022033115310821700_B22","author":"Roads","year":"1995","journal-title":"The Computer Music Tutorial"},{"issue":"1","key":"2022033115310821700_B23","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1080\/17459737.2011.573676","article-title":"Towards a Generative Syntax of Tonal Harmony.","volume":"5","author":"Rohrmeier","year":"2011","journal-title":"Journal of Mathematics and Music"},{"key":"2022033115310821700_B24","author":"Saraceno.","year":"2017","journal-title":"Arachnid Orchestra: Jam Sessions"},{"issue":"1","key":"2022033115310821700_B25","doi-asserted-by":"crossref","DOI":"10.1088\/0965-0393\/18\/1\/015012","article-title":"Visualization and Analysis of Atomistic Simulation Data with OVITO: The Open Visualization Tool.","volume":"18","author":"Stukowski","year":"2009","journal-title":"Modelling and Simulation in Materials Science and Engineering"},{"issue":"30","key":"2022033115310821700_B26","doi-asserted-by":"crossref","DOI":"10.1088\/0957-4484\/27\/30\/302001","article-title":"Nanomechanics of Silk: The Fundamentals of a Strong, Tough, and Versatile Material.","volume":"27","author":"Su","year":"2016","journal-title":"Nanotechnology"},{"issue":"10","key":"2022033115310821700_B27","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1038\/nmat4721","article-title":"Spider Silk: Dynamic Mechanics.","volume":"15","author":"Su","year":"2016","journal-title":"Nature Materials"},{"issue":"146","key":"2022033115310821700_B28","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2018.0193","article-title":"Imaging and Analysis of a Three-Dimensional Spider Web Architecture.","volume":"15","author":"Su","year":"2018","journal-title":"Journal of The Royal Society Interface"},{"issue":"2","key":"2022033115310821700_B29","doi-asserted-by":"publisher","first-page":"14","DOI":"10.2307\/3679938","article-title":"Real-Time Granular Synthesis with a Digital Signal Processor.","volume":"12","author":"Truax","year":"1988","journal-title":"Computer Music Journal"},{"issue":"5","key":"2022033115310821700_B30","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1109\/TSA.2002.800560","article-title":"Musical Genre Classification of Audio Signals.","volume":"10","author":"Tzanetakis","year":"2002","journal-title":"IEEE Transactions on Speech and Audio Processing"},{"issue":"6","key":"2022033115310821700_B31","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1016\/j.nantod.2012.09.001","article-title":"Materials by Design: Merging Proteins and Music","volume":"7","author":"Wong","year":"2012","journal-title":"Nano Today"},{"key":"2022033115310821700_B32","article-title":"Zu Hause bei der Schwarzen Witwe, oder: Das letzte Projekt mit Rolf-Dieter D\u00fcppe.","author":"Wulff","year":"2010","journal-title":"Festschrift Anl\u00e4sslich der Pensionierung von Dr.-Ing. Rolf-Dieter D\u00fcppe nach 36 Jahren am Institut f\u00fcr Photogrammetrie und Kartographie"},{"key":"2022033115310821700_B33","author":"Xenakis","year":"1971","journal-title":"Formalized Music: Thought and Mathematics in Composition"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/44\/4\/43\/2005873\/comj_a_00580.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/44\/4\/43\/2005873\/comj_a_00580.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T15:31:13Z","timestamp":1673969473000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/44\/4\/43\/108549\/Sonification-of-a-3-D-Spider-Web-and"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12,1]]},"published-print":{"date-parts":[[2020,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/comj_a_00580","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"value":"0148-9267","type":"print"},{"value":"1531-5169","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020]]},"published":{"date-parts":[[2020]]}}}