{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T23:08:02Z","timestamp":1765667282597},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T00:00:00Z","timestamp":1584403200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T00:00:00Z","timestamp":1584403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pers Ubiquit Comput"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>One way to achieve an intuitive sound design are visual approaches for synthesis and sound collages. Therefore, during spectral synthesis and editing, the sound is designed in a visualization of the frequency domain. In order to create a coherent workflow between visuals and the resulting audio, the stimuli should be matched to each other. In this work, a qualitative user study is presented, which is supposed to show the intuitive understanding from the shape to the sound. The shape is hereby the spectral envelope. The general aim is to find out whether there is a connection between the visual shape and the subsequent auditory impression.<\/jats:p>","DOI":"10.1007\/s00779-020-01392-5","type":"journal-article","created":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T16:32:38Z","timestamp":1584462758000},"page":"651-661","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["CoHEARence of audible shapes\u2014a qualitative user study for coherent visual audio design with resynthesized shapes"],"prefix":"10.1007","volume":"25","author":[{"given":"Lars","family":"Engeln","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rainer","family":"Groh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,3,17]]},"reference":[{"issue":"4","key":"1392_CR1","doi-asserted-by":"publisher","first-page":"431","DOI":"10.3758\/BF03204661","volume":"26","author":"P Assmann","year":"1994","unstructured":"Assmann P, Ballard W, Bornstein L, Paschall D (1994) Track-draw: a graphical interface for controlling the parameters of a speech synthesizer. Behavior Research Methods Instruments, & Computers 26(4):431\u2013436. https:\/\/doi.org\/10.3758\/BF03204661","journal-title":"Behavior Research Methods Instruments, & Computers"},{"key":"1392_CR2","unstructured":"Bogaards N, R\u00f6bel A (2005) An interface for analysis-driven sound processing. In: Audio engineering society convention 119"},{"key":"1392_CR3","unstructured":"Bogaards N, Roebel A, Rodet X (2004) Sound analysis and processing with AudioSculpt 2. In: International computer music conference (ICMC) (Icmc), 1"},{"issue":"2","key":"1392_CR4","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1006\/nimg.2001.0812","volume":"14","author":"GA Calvert","year":"2001","unstructured":"Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the bold effect. Neuroimage 14(2):427\u2013438","journal-title":"Neuroimage"},{"key":"1392_CR5","doi-asserted-by":"publisher","unstructured":"Cao Y, Wang H, Wang C, Li Z, Zhang L, Zhang L (2010) Mindfinder: interactive sketch-based image search on millions of images. In: Proceedings of the 18th ACM international conference on multimedia, MM \u201910. https:\/\/doi.org\/10.1145\/1873951.1874299. ACM, New York, pp 1605\u20131608","DOI":"10.1145\/1873951.1874299"},{"key":"1392_CR6","unstructured":"Cobley P (2014) Introducing semiotics: a graphic guide. Icon Books Ltd"},{"key":"1392_CR7","unstructured":"Eckel G (1992) Manipulation of sound signals based on graphical representation-a musical point of view. In: Proceedings of the international workshop on models and representations of musical signals, Capri, Italia"},{"key":"1392_CR8","unstructured":"Engeln L, Groh R (2017) Audioflux : a proposal for interactive visual audio manipulation. In: Burghardt M, Wimmer R, Wolff C, Womser-Hacker C (eds) Mensch und computer 2017 - workshopband, september, Gesellschaft fu\u0307r Informatik e.V., Regensburg"},{"key":"1392_CR9","doi-asserted-by":"crossref","unstructured":"Engeln L, Groh R (2019) Cohearence \u2013 a qualitive user-(pre-)test on resynthesized shapes for coherent visual sound design","DOI":"10.1145\/3356590.3356606"},{"key":"1392_CR10","unstructured":"Engeln L, Groh R (2019) VisualAudio-Design \u2013 towards a graphical Sounddesign. In: Proceedings of the 22nd international conference on digital audio effects (DAFx-19). ACM, Birmingham"},{"key":"1392_CR11","doi-asserted-by":"publisher","unstructured":"Engeln L, Hanke M, Auerswald T, Kallenbach F, Groh R (2019) The earconizer - a tool for constructing hierarchical earcons. In: Mensch und computer 2019 - workshopband. Gesellschaft f\u00fcr informatik e.v., bonn. https:\/\/doi.org\/10.18420\/muc2019-ws-436","DOI":"10.18420\/muc2019-ws-436"},{"key":"1392_CR12","unstructured":"Engeln L, Kammer D, Brandt L, Groh R (2018) Multi-touch enhanced visual audio-morphing. In: Proceedings of the international conference on new interfaces for musical expression (in press), Blacksburg"},{"issue":"9","key":"1392_CR13","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/2.410146","volume":"28","author":"M Flickner","year":"1995","unstructured":"Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the QBIC system. Computer 28(9):23\u201332. https:\/\/doi.org\/10.1109\/2.410146","journal-title":"Computer"},{"issue":"3","key":"1392_CR14","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1007\/s00221-002-1262-y","volume":"147","author":"F Frassinetti","year":"2002","unstructured":"Frassinetti F, Bolognini N, L\u00e0davas E (2002) Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp Brain Res 147(3):332\u2013343","journal-title":"Exp Brain Res"},{"key":"1392_CR15","unstructured":"Giannakis K (2001) Sound mosaics a graphical user interface for sound synthesis based on auditory-visual associations"},{"issue":"3","key":"1392_CR16","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1017\/S1355771806001531","volume":"11","author":"K Giannakis","year":"2006","unstructured":"Giannakis K (2006) A comparative evaluation of auditory-visual mappings for sound visualisation. Organised Sound 11(3):297\u2013307","journal-title":"Organised Sound"},{"key":"1392_CR17","unstructured":"Giannakis K, Smith M (2001) Imaging soundscapes: identifying cognitive associations between auditory and visual dimensions. Musical Imagery, pp 161\u2013179"},{"key":"1392_CR18","doi-asserted-by":"publisher","unstructured":"Houix O, Monache SD, Lachambre H, Bevilacqua F, Rocchesso D, Lemaitre G (2016) Innovative tools for sound sketching combining vocalizations and gestures. In: Proceedings of the audio mostly 2016, AM \u201916. https:\/\/doi.org\/10.1145\/2986416.2986442. ACM, New York, pp 12\u201319","DOI":"10.1145\/2986416.2986442"},{"issue":"1","key":"1392_CR19","doi-asserted-by":"publisher","first-page":"135","DOI":"10.3390\/app8010135","volume":"8","author":"T Kelkar","year":"2018","unstructured":"Kelkar T, Jensenius A (2018) Analyzing free-hand sound-tracings of melodic phrases. Appl Sci 8(1):135","journal-title":"Appl Sci"},{"key":"1392_CR20","unstructured":"Klingbeil M (2005) Software for spectral Analysis, Editing, and synthesis. In: ICMC"},{"key":"1392_CR21","unstructured":"Klingbeil M (2012) SPEAR: Sinusoidal Partial Editing Analysis and Resynthesis. retrieved from on Nov 12, 3"},{"issue":"2","key":"1392_CR22","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1080\/17459737.2018.1450902","volume":"12","author":"M Mannone","year":"2018","unstructured":"Mannone M (2018) Introduction to gestural similarity in music. an application of category theory to the orchestra. J Math Music 12(2):63\u201387. https:\/\/doi.org\/10.1080\/17459737.2018.1450902","journal-title":"J Math Music"},{"key":"1392_CR23","doi-asserted-by":"crossref","unstructured":"Misra A, Cook PR, Wang G (2006) Tapestrea: sound scene modeling by example. In: SIGGRAPH Sketches, p 177","DOI":"10.1145\/1179849.1180070"},{"key":"1392_CR24","doi-asserted-by":"crossref","unstructured":"Peschke J, Berndt A (2017) The geometric oscillator: sound synthesis with cyclic shapes. In: Audio Mostly 2017: 12th Conf. on Interaction with Sound - Augmented and Participatory Sound\/Music Experiences. Queen Mary university of london, ACM, London, UK","DOI":"10.1145\/3123514.3123522"},{"key":"1392_CR25","unstructured":"Pon A, Ichino J, Eagle D, Sharlin E, D\u2019Alessandro N, Carpendale MST (2012) Vuzik: a painting graphic score interface for composing and control of sound generation. In: ICMC"},{"issue":"4","key":"1392_CR26","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1016\/j.conb.2005.06.008","volume":"15","author":"CE Schroeder","year":"2005","unstructured":"Schroeder CE, Foxe J (2005) Multisensory contributions to low-level, unisensory processing. Curr Opin Neurobiol 15(4):454\u2013 458","journal-title":"Curr Opin Neurobiol"},{"issue":"1","key":"1392_CR27","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/S0926-6410(02)00073-3","volume":"14","author":"CE Schroeder","year":"2002","unstructured":"Schroeder CE, Foxe JJ (2002) The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cogn Brain Res 14(1):187\u2013198","journal-title":"Cogn Brain Res"},{"key":"1392_CR28","unstructured":"Schwarz D (2011) State of the art in sound texture synthesis. In: Digital audio effects (DAFx), pp 221\u2013232"},{"key":"1392_CR29","first-page":"153","volume-title":"A new interaction strategy for musical timbre design","author":"A Seago","year":"2013","unstructured":"Seago A (2013) A new interaction strategy for musical timbre design. Springer, London, London, pp 153\u2013169"},{"key":"1392_CR30","doi-asserted-by":"crossref","unstructured":"Stolfi A, Barthet M, Gor\u00f3dscy F., Deusany A, Iazzetta F (2017) Open band: audience creative participation using web audio synthesis","DOI":"10.1145\/3123514.3123526"},{"key":"1392_CR31","unstructured":"Terren M (2019) Wave \u2013 an introduction to waveshaping and wave-terrain synthesis"},{"issue":"3","key":"1392_CR32","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1037\/a0035441","volume":"40","author":"E Thoret","year":"2014","unstructured":"Thoret E, Aramaki M, Kronland-Martinet R, Velay JL, Ystad S (2014) From sound to shape: auditory perception of drawing movements. J Exp Psychol Hum Percept Perform 40(3): 983","journal-title":"J Exp Psychol Hum Percept Perform"},{"issue":"5","key":"1392_CR33","doi-asserted-by":"publisher","first-page":"2400","DOI":"10.1121\/1.4744477","volume":"109","author":"B Verplank","year":"2001","unstructured":"Verplank B, Mathews M, Shaw R (2001) Scanned synthesis. J Acoust Soc Am 109(5):2400\u20132400","journal-title":"J Acoust Soc Am"},{"issue":"3","key":"1392_CR34","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1016\/j.neuroimage.2006.01.016","volume":"31","author":"S Watkins","year":"2006","unstructured":"Watkins S, Shams L, Tanaka S, Haynes JD, Rees G (2006) Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31(3):1247\u20131256","journal-title":"Neuroimage"}],"container-title":["Personal and Ubiquitous Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-020-01392-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00779-020-01392-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-020-01392-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T03:04:30Z","timestamp":1633489470000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00779-020-01392-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,17]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["1392"],"URL":"https:\/\/doi.org\/10.1007\/s00779-020-01392-5","relation":{},"ISSN":["1617-4909","1617-4917"],"issn-type":[{"value":"1617-4909","type":"print"},{"value":"1617-4917","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,17]]},"assertion":[{"value":"22 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}