{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:58:24Z","timestamp":1740149904561,"version":"3.37.3"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,11,6]],"date-time":"2023-11-06T00:00:00Z","timestamp":1699228800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,6]],"date-time":"2023-11-06T00:00:00Z","timestamp":1699228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Hochschule f\u00fcr Angewandte Wissenschaften Hamburg (HAW Hamburg)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The most common strategy for interactive sonification is parameter mapping sonification, where sensed or defined data is pre-processed and then used to control one or more variables in a signal processing chain. A well-known but rarely used alternative is model-based sonification, where data is fed into a physical or conceptual model that generates or modifies sound. In this paper, we suggest the Impulse Pattern Formulation (IPF) as a model-based sonification strategy. The IPF can model natural systems and interactions, like the sound production of musical instruments, the reverberation in rooms, and human synchronization to a rhythm. Hence, the IPF has the potential to be easy to interpret and intuitive to interact with. Experiment results show that the IPF is able to produce an intuitively interpretable, natural zero, i.e., a coordinate origin. Coordinate origins are necessary to sonify both polarities of a dimension as well as absolute magnitudes.<\/jats:p>","DOI":"10.1007\/s12193-023-00423-8","type":"journal-article","created":{"date-parts":[[2023,11,6]],"date-time":"2023-11-06T15:01:53Z","timestamp":1699282913000},"page":"243-251","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Model-based sonification based on the impulse pattern formulation"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9272-2518","authenticated-orcid":false,"given":"Simon","family":"Linke","sequence":"first","affiliation":[]},{"given":"Rolf","family":"Bader","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0495-3426","authenticated-orcid":false,"given":"Robert","family":"Mores","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,11,6]]},"reference":[{"key":"423_CR1","unstructured":"Hermann T (2011) Model-based sonification. In: Hermann T, Hunt A, Neuhoff JG (eds) The sonification handbook. COST & LOGOS, Berlin, pp 399\u2013427 (Chap. 16). https:\/\/sonification.de\/handbook"},{"issue":"4","key":"423_CR2","doi-asserted-by":"publisher","first-page":"96018","DOI":"10.1371\/journal.pone.0082491","volume":"9","author":"G Dubus","year":"2013","unstructured":"Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE 9(4):96018. https:\/\/doi.org\/10.1371\/journal.pone.0082491","journal-title":"PLoS ONE"},{"key":"423_CR3","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s12193-018-0282-2","volume":"13","author":"T Ziemer","year":"2019","unstructured":"Ziemer T, Schultheis H (2019) Psychoacoustic auditory display for navigation: an auditory assistance system for spatial orientation tasks. J Multimodal User Interfaces 13:205\u2013218. https:\/\/doi.org\/10.1007\/s12193-018-0282-2","journal-title":"J Multimodal User Interfaces"},{"key":"423_CR4","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2019) Psychoacoustical signal processing for three-dimensional sonification. In: 25th International conference on auditory displays (ICAD2019), Newcastle, pp 277\u2013284. https:\/\/doi.org\/10.21785\/icad2019.018","DOI":"10.21785\/icad2019.018"},{"key":"423_CR5","unstructured":"Hermann T (2002) Sonification for exploratory data analysis. Ph.d thesis, Bielefeld University, Bielefeld (February). http:\/\/www.techfak.uni-bielefeld.de\/ags\/ami\/publications\/media\/Hermann2002-SFE.pdf"},{"issue":"1","key":"423_CR6","first-page":"3","volume":"12","author":"T Ziemer","year":"2020","unstructured":"Ziemer T, Nuchprayoon N, Schultheis H (2020) Psychoacoustic sonification as user interface for human\u2013machine interaction. Int J Inf Soc 12(1):3\u201316","journal-title":"Int J Inf Soc"},{"key":"423_CR7","unstructured":"Walker BN, Nees MA (2011) Theory of sonification. In: Hermann T, Hunt A, Neuhoff JG (eds) The sonification handbook. COST and Logos, Berlin, pp 9\u201339 (Chap. 2). http:\/\/sonification.de\/handbook\/"},{"key":"423_CR8","unstructured":"Serafin S, Franinovic K, Hermann T, Lemaitre G, Rinott M, Rocchesso D (2011) Sonic interaction design. In: Hermann T, Hunt A, Neuhoff JG (eds) The sonification handbook. COST & Logos, Berlin, pp 87\u2013110. https:\/\/sonification.de\/handbook"},{"issue":"4","key":"423_CR9","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1145\/1101530.1101532","volume":"2","author":"S Barrass","year":"2005","unstructured":"Barrass S (2005) A perceptual framework for the auditory display of scientific data. ACM Trans Appl Percept 2(4):389\u2013402. https:\/\/doi.org\/10.1145\/1101530.1101532","journal-title":"ACM Trans Appl Percept"},{"key":"423_CR10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36098-5","volume-title":"Nonlinearities and synchronization in musical acoustics and music psychology","author":"R Bader","year":"2013","unstructured":"Bader R (2013) Nonlinearities and synchronization in musical acoustics and music psychology. Springer, Berlin, Heidelberg. https:\/\/doi.org\/10.1007\/978-3-642-36098-5"},{"key":"423_CR11","volume-title":"The physics of musical intstruments","author":"NH Fletcher","year":"2008","unstructured":"Fletcher NH, Rossing TD (2008) The physics of musical intstruments, 2nd edn. Springer, New York","edition":"2"},{"key":"423_CR12","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1007\/978-3-319-47292-8_11","volume-title":"Studies in musical acoustics and psychoacoustics","author":"C Neuhaus","year":"2017","unstructured":"Neuhaus C (2017) Methods in neuromusicology: principles, trends, examples and the pros and cons. In: Schneider A (ed) Studies in musical acoustics and psychoacoustics. Springer, Cham, pp 341\u2013374. https:\/\/doi.org\/10.1007\/978-3-319-47292-8_11"},{"key":"423_CR13","unstructured":"Linke S, Bader R, Mores R (2019) The impulse pattern formulation (ipf) as a nonlinear model of musical instruments. In: International symposium on music acoustics (ISMA 2019), Detmold, Germany, pp 349\u2013358 . http:\/\/pub.dega-akustik.de\/ISMA2019\/data\/index.html"},{"key":"423_CR14","unstructured":"Bader R (2022) Impulse pattern formulation (IPF) brain model. https:\/\/arxiv.org\/pdf\/2212.11021"},{"key":"423_CR15","doi-asserted-by":"publisher","DOI":"10.1063\/1.5092511","author":"S Linke","year":"2019","unstructured":"Linke S, Bader R, Mores R (2019) The impulse pattern formulation (IPF) as a model of musical instruments-investigation of stability and limits. Chaos Interdiscip J Nonlinear Sci. https:\/\/doi.org\/10.1063\/1.5092511","journal-title":"Chaos Interdiscip J Nonlinear Sci"},{"issue":"1","key":"423_CR16","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/BF01020332","volume":"19","author":"MJ Feigenbaum","year":"1978","unstructured":"Feigenbaum MJ (1978) Quantitative universality for a class of nonlinear transformations. J Stat Phys 19(1):25\u201352","journal-title":"J Stat Phys"},{"issue":"4","key":"423_CR17","doi-asserted-by":"publisher","first-page":"74","DOI":"10.2307\/3680470","volume":"16","author":"JO Smith","year":"1992","unstructured":"Smith JO (1992) Physical modeling using digital waveguides. Comput Music J 16(4):74\u201391","journal-title":"Comput Music J"},{"key":"423_CR18","unstructured":"Linke S, Bader R, Mores R (2022) Multiphonic modeling using Impulse Pattern Formulation (IPF). arxiv.org\/abs\/2201.05452"},{"issue":"1","key":"423_CR19","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1121\/2.0001683","volume":"49","author":"S Linke","year":"2022","unstructured":"Linke S, Mores R, Bader R (2022) Describing minimum bow force using impulse pattern formulation (IPF)\u2014n empirical validation. Proc Meetings Acoust 49(1):123. https:\/\/doi.org\/10.1121\/2.0001683","journal-title":"Proc Meetings Acoust"},{"key":"423_CR20","first-page":"1","volume":"15","author":"CV Raman","year":"1918","unstructured":"Raman CV (1918) On the mechanical theory of the vibrations of bowed strings and of musical instruments of the violin family, with experimental verification of the results: part 1. Indian Assoc Cultiv Sci Bull 15:1\u2013158","journal-title":"Indian Assoc Cultiv Sci Bull"},{"issue":"1","key":"423_CR21","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1121\/1.1913322","volume":"53","author":"JC Schelleng","year":"1973","unstructured":"Schelleng JC (1973) The bowed string and the player. J Acoust Soc Am 53(1):26\u201341. https:\/\/doi.org\/10.1121\/1.1913322","journal-title":"J Acoust Soc Am"},{"issue":"2","key":"423_CR22","doi-asserted-by":"publisher","first-page":"728","DOI":"10.1121\/1.4988659","volume":"142","author":"R Mores","year":"2017","unstructured":"Mores R (2017) Complementary empirical data on minimum bow force. J Acoust Soc Am 142(2):728\u2013736. https:\/\/doi.org\/10.1121\/1.4988659","journal-title":"J Acoust Soc Am"},{"issue":"4598","key":"423_CR23","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1126\/science.220.4598.671","volume":"220","author":"S Kirkpatrick","year":"1983","unstructured":"Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science (New York, NY) 220(4598):671\u2013680. https:\/\/doi.org\/10.1126\/science.220.4598.671","journal-title":"Science (New York, NY)"},{"key":"423_CR24","unstructured":"Linke S, Bader R, Mores R (2021) Modeling synchronization in human musical rhythms using impulse pattern formulation (IPF). arXiv:2112.03218"},{"key":"423_CR25","doi-asserted-by":"publisher","unstructured":"Linke S, Bader R, Mores R (2021) Sound examples of an impulse pattern formulation model synchronizing to different click tracks. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.5758991","DOI":"10.5281\/ZENODO.5758991"},{"key":"423_CR26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-56927-2","volume-title":"Self-organizing maps","author":"T Kohonen","year":"2001","unstructured":"Kohonen T (2001) Self-organizing maps. Springer, Berlin, Heidelberg. https:\/\/doi.org\/10.1007\/978-3-642-56927-2"},{"key":"423_CR27","doi-asserted-by":"publisher","unstructured":"Bla\u00df M, Bader R (2019) In: Bader R (ed) Content-based music retrieval and visualization system for ethnomusicological music archives. Springer, Cham, pp 145\u2013173. https:\/\/doi.org\/10.1007\/978-3-030-02695-0_7","DOI":"10.1007\/978-3-030-02695-0_7"},{"key":"423_CR28","unstructured":"Linke S. Pd-synthesizers for IPF-sonification. https:\/\/github.com\/Simon-Linke\/IPF-Sonification-PD"},{"key":"423_CR29","doi-asserted-by":"publisher","unstructured":"Asendorf M, Kienzle M, Ringe R, Ahmadi F, Bhowmik D, Chen J, Huynh K, Kleinert S, Kruesilp J, Lee YY, Wang X, Luo W, Jadid NM, Awadin A, Raval V, Schade EES, Jaman H, Sharma K, Weber C, Winkler H, Ziemer T (2021) Tiltification\u2014an accessible app to popularize sonification. In: Proceedings of the 26th international conference on auditory display (ICAD2021), virtual conference, pp 184\u2013191. https:\/\/doi.org\/10.21785\/icad2021.025, http:\/\/hdl.handle.net\/1853\/66331","DOI":"10.21785\/icad2021.025"},{"key":"423_CR30","doi-asserted-by":"publisher","unstructured":"Asendorf M, Kienzle M, Ringe R, Ahmadi F, Bhowmik D, Chen J, Hyunh K, Kleinert S, Kruesilp J, Wang X, Lin YY, Luo W, Mirzayousef\u00a0Jadid N, Awadin A, Raval V, Schade EES, Jaman H, Sharma K, Weber C, Winkler H, Ziemer T (2021) Tiltification\/sonic-tilt: first release of sonic tilt. https:\/\/github.com\/Tiltification\/sonic-tilt . https:\/\/doi.org\/10.5281\/zenodo.5543983","DOI":"10.5281\/zenodo.5543983"},{"key":"423_CR31","unstructured":"Bonebright TL, Flowers JH (2011) Evaluation of auditory display. In: Hermann T, Hunt A, Neuhoff JG (eds) The sonification handbook. COST and Logos, Berlin, pp 111\u2013144. http:\/\/sonification.de\/handbook"},{"key":"423_CR32","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.3389\/fnins.2022.930944","volume":"16","author":"T Ziemer","year":"2022","unstructured":"Ziemer T, Schultheis H (2022) PAMPAS: a psycho acoustical method for the perceptual analysis of multidimensional sonification. Front Neurosci 16:1234. https:\/\/doi.org\/10.3389\/fnins.2022.930944","journal-title":"Front Neurosci"},{"key":"423_CR33","unstructured":"Vogt K (2011) A quantitative evaluation approach to sonifications. In: Proceedings of the 17th international conference on auditory display (ICAD2011), Budapest, Hungary, p 7. http:\/\/hdl.handle.net\/1853\/51571"},{"key":"423_CR34","doi-asserted-by":"publisher","unstructured":"Fastl H, Zwicker E (2007) Psychoacoustics. Facts and models, 3rd edn. Springer, Berlin, Heidelberg. https:\/\/doi.org\/10.1007\/978-3-540-68888-4","DOI":"10.1007\/978-3-540-68888-4"},{"key":"423_CR35","doi-asserted-by":"publisher","unstructured":"Weger M, Aurenhammer M, Hermann T, H\u00f6ldrich R (2022) The information capacity of plausible auditory augmentations: percussion of rectangular plates. In: R\u00f6nnberg N, Lenzi S, Ziemer T, Hermann T, Bresin R (eds) Proceedings of ISon 2022, 7th interactive sonification workshop, Delmenhorst, Germany, pp 55\u201364 . https:\/\/doi.org\/10.5281\/zenodo.7552234","DOI":"10.5281\/zenodo.7552234"},{"key":"423_CR36","unstructured":"Chowning J, Bristow D (1986) FM theory and applications. By musicians for musicians. Yamaha Music Foundation, Tokyo"},{"key":"423_CR37","unstructured":"Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: 14th International conference on auditory display, Paris, p 8. http:\/\/hdl.handle.net\/1853\/49960"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00423-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-023-00423-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00423-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T11:10:47Z","timestamp":1699960247000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-023-00423-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,6]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["423"],"URL":"https:\/\/doi.org\/10.1007\/s12193-023-00423-8","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"type":"print","value":"1783-7677"},{"type":"electronic","value":"1783-8738"}],"subject":[],"published":{"date-parts":[[2023,11,6]]},"assertion":[{"value":"5 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}