{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T16:54:12Z","timestamp":1776099252236,"version":"3.50.1"},"reference-count":86,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100020344","name":"Gesellschaft f\u00fcr Forschungsf\u00f6rderung Nieder\u00f6sterreich","doi-asserted-by":"crossref","award":["SC20-006"],"award-info":[{"award-number":["SC20-006"]}],"id":[{"id":"10.13039\/100020344","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002428","name":"Austrian Science Fund","doi-asserted-by":"publisher","award":["P33531-N"],"award-info":[{"award-number":["P33531-N"]}],"id":[{"id":"10.13039\/501100002428","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pers Ubiquit Comput"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Both sonification and visualization convey information about data by effectively using our human perceptual system, but their ways to transform the data differ. Over the past 30 years, the sonification community has demanded a holistic perspective on data representation, including audio-visual analysis, several times. A design theory of audio-visual analysis would be a relevant step in this direction. An indispensable foundation for this endeavor is a terminology describing the combined design space. To build a bridge between the domains, we adopt three of the established theoretical constructs from visualization theory for the field of sonification. The three constructs are the <jats:italic>spatial substrate<\/jats:italic>, the <jats:italic>visual mark<\/jats:italic>, and the <jats:italic>visual channel<\/jats:italic>. In our model, we choose time to be the <jats:italic>temporal substrate<\/jats:italic> of sonification. <jats:italic>Auditory marks<\/jats:italic> are then positioned in time, such as visual marks are positioned in space. <jats:italic>Auditory channels<\/jats:italic> are encoded into auditory marks to convey information. The proposed definitions allow discussing visualization and sonification designs as well as multi-modal designs based on a common terminology. While the identified terminology can support audio-visual analytics research, it also provides a new perspective on sonification theory itself.<\/jats:p>","DOI":"10.1007\/s00779-023-01720-5","type":"journal-article","created":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T04:01:46Z","timestamp":1692590506000},"page":"1949-1963","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Towards a unified terminology for sonification and visualization"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5456-1140","authenticated-orcid":false,"given":"Kajetan","family":"Enge","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8788-4600","authenticated-orcid":false,"given":"Alexander","family":"Rind","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5929-8716","authenticated-orcid":false,"given":"Michael","family":"Iber","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6887-6637","authenticated-orcid":false,"given":"Robert","family":"H\u00f6ldrich","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5762-1869","authenticated-orcid":false,"given":"Wolfgang","family":"Aigner","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,21]]},"reference":[{"key":"1720_CR1","doi-asserted-by":"publisher","unstructured":"Enge K, Rind A, Iber M, H\u00f6ldrich R, Aigner W (2021) It\u2019s about time: adopting theoretical constructs from visualization for sonification. In: Audio Mostly 2021, pp 64\u201371. ACM New York. https:\/\/doi.org\/10.1145\/3478384.3478415","DOI":"10.1145\/3478384.3478415"},{"key":"1720_CR2","unstructured":"Hermann T, Hunt A, Neuhoff JG (2011) (ed) The Sonification Handbook. Logos, Bielefeld"},{"key":"1720_CR3","unstructured":"Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: Proceedings of the 14th international conference on auditory display. http:\/\/hdl.handle.net\/1853\/49960"},{"key":"1720_CR4","doi-asserted-by":"publisher","unstructured":"Nees MA (2019) Eight components of a design theory of sonification. In: Proceedings of the 25th international conference on auditory display (ICAD 2019), pp 176\u2013183. https:\/\/doi.org\/10.21785\/icad2019.048","DOI":"10.21785\/icad2019.048"},{"key":"1720_CR5","unstructured":"Bertin J (1983) Semiology of Graphics Diagrams Networks Maps. University of Wisconsin, Madison. Originally published in 1967 in French"},{"key":"1720_CR6","volume-title":"Readings in Information Visualization: using Vision to Think","author":"SK Card","year":"1999","unstructured":"Card SK, Mackinlay J, Shneiderman B (1999) Readings in Information Visualization: using Vision to Think. Morgan Kaufmann, San Francisco"},{"key":"1720_CR7","doi-asserted-by":"publisher","DOI":"10.1201\/b17511","volume-title":"Visualization Analysis and Design","author":"T Munzner","year":"2014","unstructured":"Munzner T (2014) Visualization Analysis and Design. CRC Press, Boca Raton"},{"issue":"1","key":"1720_CR8","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1109\/2945.981851","volume":"8","author":"C Stolte","year":"2002","unstructured":"Stolte C, Tang D, Hanrahan P (2002) Polaris A system for query, analysis, and visualization of multidimensional relational databases. IEEE Trans. visualization and computer graphics 8(1):52\u201365. https:\/\/doi.org\/10.1109\/2945.981851","journal-title":"IEEE Trans. visualization and computer graphics"},{"key":"1720_CR9","volume-title":"The Grammar of Graphics","author":"L Wilkinson","year":"2005","unstructured":"Wilkinson L (2005) The Grammar of Graphics, 2nd edn. Springer, New York","edition":"2"},{"issue":"1","key":"1720_CR10","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1109\/TVCG.2016.2599030","volume":"23","author":"A Satyanarayan","year":"2017","unstructured":"Satyanarayan A, Moritz D, Wongsuphasawat K, Heer J (2017) Vega-Lite: a grammar of interactive graphics. IEEE Trans. visualization and computer graphics 23(1):341\u2013350. https:\/\/doi.org\/10.1109\/TVCG.2016.2599030","journal-title":"IEEE Trans. visualization and computer graphics"},{"issue":"2","key":"1720_CR11","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1145\/22949.22950","volume":"5","author":"J Mackinlay","year":"1986","unstructured":"Mackinlay J (1986) Automating the design of graphical presentations of relational information. ACM Trans. Graphics 5(2):110\u2013141. https:\/\/doi.org\/10.1145\/22949.22950","journal-title":"ACM Trans. Graphics"},{"issue":"6","key":"1720_CR12","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TVCG.2007.70594","volume":"13","author":"JD Mackinlay","year":"2007","unstructured":"Mackinlay JD, Hanrahan P, Stolte C (2007) Show Me: automatic presentation for visual analysis. IEEE Trans. visualization and computer graphics 13(6):1137\u20131144. https:\/\/doi.org\/10.1109\/TVCG.2007.70594","journal-title":"IEEE Trans. visualization and computer graphics"},{"issue":"1","key":"1720_CR13","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1109\/TVCG.2018.2865240","volume":"25","author":"D Moritz","year":"2018","unstructured":"Moritz D, Wang C, Nelson G, Lin H, Smith AM, Howe B, Heer J (2018) Formalizing visualization design knowledge as constraints Actionable and extensible models in Draco. IEEE Trans. visualization and computer graphics 25(1):438\u2013448. https:\/\/doi.org\/10.1109\/TVCG.2018.2865240","journal-title":"IEEE Trans. visualization and computer graphics"},{"key":"1720_CR14","unstructured":"Kramer G, Walker B, Bonebright T, Cook P, Flowers JH, Miner N, Neuhoff J et al (1999) Sonification report Status of the field and research agenda. Report for the NSF, international community for auditory display. http:\/\/www.icad.org\/websiteV2.0\/References\/nsf.html Accessed 31 March 2022"},{"key":"1720_CR15","first-page":"150","volume-title":"Neuhoff JG","author":"BN Walker","year":"2004","unstructured":"Walker BN, Kramer G (2004) Ecological psychoacoustics and auditory displays Hearing, grouping, and meaning making. In: Psychoacoustics Ecological (ed) Neuhoff JG. Elsevier Academic Press, San Diego, pp 150\u2013175"},{"key":"1720_CR16","volume-title":"Spatial Hearing The Psychophysics of Human Sound Localization","author":"J Blauert","year":"1996","unstructured":"Blauert J (1996) Spatial Hearing The Psychophysics of Human Sound Localization, Revised. MIT Press, Cambridge, MA, USA","edition":"Revised"},{"key":"1720_CR17","first-page":"185","volume-title":"Auditory Display Sonification, Audification and Auditory Interfaces","author":"G Kramer","year":"1994","unstructured":"Kramer G (1994) Some Organizing Principles for Representing Data with Sound. In: Kramer G (ed) Auditory Display Sonification, Audification and Auditory Interfaces. Addison-Wesley, Reading, Mass, pp 185\u2013221"},{"issue":"5","key":"1720_CR18","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/h0036331","volume":"81","author":"D Freides","year":"1974","unstructured":"Freides D (1974) Human information processing and sensory modality: Cross-modal functions, information complexity, memory, and deficit. Psychological bulletin 81(5):284\u2013310","journal-title":"Psychological bulletin"},{"key":"1720_CR19","doi-asserted-by":"publisher","DOI":"10.17104\/9783406727887","volume-title":"Philosophie der Zeit Grundlagen und Perspektiven","author":"N Sieroka","year":"2018","unstructured":"Sieroka N (2018) Philosophie der Zeit Grundlagen und Perspektiven, vol 2886. CH Beck, M\u00fcnchen"},{"issue":"1\u20132","key":"1720_CR20","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/S0010-0277(00)00155-4","volume":"80","author":"M Kubovy","year":"2001","unstructured":"Kubovy M, Van Valkenburg D (2001) Auditory and visual objects. Cognition 80(1\u20132):97\u2013126. https:\/\/doi.org\/10.1016\/S0010-0277(00)00155-4","journal-title":"Cognition"},{"key":"1720_CR21","doi-asserted-by":"publisher","unstructured":"Caiola V, Lenzi S, Ricc\u00f2, D (2022) Audiovisual sonifications: a design map for multisensory integration in data representation. In: Lockton D, Sara L, Hekkert P, Oak A, S\u00e1daba J, Lloyd P. (eds.) DRS2022 Bilbao. https:\/\/doi.org\/10.21606\/drs.2022.380","DOI":"10.21606\/drs.2022.380"},{"key":"1720_CR22","doi-asserted-by":"crossref","unstructured":"Hildebrandt T, Amerbauer F, Rinderle-Ma S (2016) Combining sonification and visualization for the analysis of process execution data. In: 2016 IEEE 18th Conference on business informatics (CBI), vol. 2:pp 32\u201337","DOI":"10.1109\/CBI.2016.47"},{"key":"1720_CR23","doi-asserted-by":"crossref","unstructured":"Rabenhorst DA, Farrell EJ, Jameson DH, Linton TD, Mandelman JA (1990) Complementary visualization and sonification of multidimensional data. In: Extracting meaning from complex data processing, display, interaction, vol. 1259:pp 147\u2013153. International Society for Optics and Photonics","DOI":"10.1117\/12.19981"},{"key":"1720_CR24","unstructured":"Berger J, Wang G, Chang M (2010) Sonification and visualization of neural data. In: Proceedings of the 16th international conference on auditory display (ICAD-2010), pp 201\u2013205. Georgia Institute of Technology"},{"key":"1720_CR25","unstructured":"Hermann T, Niehus C, Ritter H (2003) Interactive visualization and sonification for monitoring complex processes. In: Proceedings of the 2003 international conference on auditory display, p 247. http:\/\/hdl.handle.net\/1853\/50467"},{"key":"1720_CR26","unstructured":"MacVeigh R, Jacobson RD (2007) Increasing the dimensionality of a geographic information system (gis) using auditory display. In: Proceedings of the 13th international conference on auditory display, pp 530\u2013535. http:\/\/hdl.handle.net\/1853\/50005"},{"key":"1720_CR27","doi-asserted-by":"publisher","unstructured":"Nesbitt KV (2000) A classification of multi-sensory metaphors for understanding abstract data in a virtual environment. In: Proc. IEEE Conf. information visualization (IV), pp 493\u2013498. https:\/\/doi.org\/10.1109\/IV.2000.859802","DOI":"10.1109\/IV.2000.859802"},{"key":"1720_CR28","unstructured":"Nesbitt KV, Barrass S (2002) Evaluation of a multimodal sonification and visualisation of depth of market stock data. In: Proceedings of the 8th international conference on auditory display, Kyoto. http:\/\/hdl.handle.net\/1853\/51355"},{"issue":"5","key":"1720_CR29","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1109\/MCG.2004.28","volume":"24","author":"KV Nesbitt","year":"2004","unstructured":"Nesbitt KV, Barrass S (2004) Finding trading patterns in stock market data. IEEE Computer graphics and applications 24(5):45\u201355. https:\/\/doi.org\/10.1109\/MCG.2004.28","journal-title":"IEEE Computer graphics and applications"},{"key":"1720_CR30","doi-asserted-by":"publisher","unstructured":"Nesbitt KV (2004) MS-Taxonomy a conceptual framework for designing multi-sensory displays. In: Proc. eighth international conference on information visualisation. IV 2004, pp 665\u2013670. https:\/\/doi.org\/10.1109\/IV.2004.1320213","DOI":"10.1109\/IV.2004.1320213"},{"key":"1720_CR31","unstructured":"Nesbitt KV (2006) Modelling human perception to leverage the reuse of concepts across the multi-sensory design space. In: Proceedings of the 3rd asia-pacific conference on conceptual modelling Vol. 53 APCCM \u201906, pp 65\u201374. Australian Computer Society, Darlinghurst, Australia"},{"key":"1720_CR32","unstructured":"Frysinger SP, (2005) A brief history of auditory data representation to the 1980s. In: Proceedings of the international conference on auditory display. http:\/\/hdl.handle.net\/1853\/50089"},{"key":"1720_CR33","volume-title":"Auditory Display Sonification","year":"1994","unstructured":"Kramer G (ed) (1994) Auditory Display Sonification. Audification and Auditory Interfaces, Addison-Wesley, Reading, Mass"},{"key":"1720_CR34","doi-asserted-by":"publisher","unstructured":"Barrass S (1997) Auditory Information Design. PhD thesis, Australian National University, Canberra. https:\/\/doi.org\/10.25911\/5d7a2acd2b71d","DOI":"10.25911\/5d7a2acd2b71d"},{"key":"1720_CR35","doi-asserted-by":"publisher","unstructured":"Walker BN (2002) Magnitude estimation of conceptual data dimensions fruse insonification. Journal of experimental psychology applied 8(4):211\u2013221. https:\/\/doi.org\/10.1037\/1076-898X.8.4.211","DOI":"10.1037\/1076-898X.8.4.211"},{"key":"1720_CR36","unstructured":"Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Bielefeld University, Bielefeld, Germany"},{"key":"1720_CR37","doi-asserted-by":"crossref","unstructured":"Neuhoff JG (ed) (2004) Ecological Psychoacoustics. Elsevier Academic Press, San Diego","DOI":"10.1163\/9780080477442"},{"key":"1720_CR38","unstructured":"de Campo A (2007) Toward a data sonification design space map. In: Proceedings of the 13th international conference on auditory display, pp. 342\u2013347. http:\/\/hdl.handle.net\/1853\/50042"},{"key":"1720_CR39","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01497-1","volume-title":"Sonification Design From Data to Intelligible Soundfields","author":"D Worrall","year":"2019","unstructured":"Worrall D (2019) Sonification Design From Data to Intelligible Soundfields. Springer, Cham, Human-computer interaction series. https:\/\/doi.org\/10.1007\/978-3-030-01497-1"},{"key":"1720_CR40","doi-asserted-by":"publisher","unstructured":"Gregor S, Jones D (2007) The anatomy of a design theory. Journal of the association for information systems 8(5):312\u2013335. https:\/\/doi.org\/10.17705\/1jais.00129","DOI":"10.17705\/1jais.00129"},{"key":"1720_CR41","doi-asserted-by":"publisher","unstructured":"Card SK, Mackinlay J (1997) The structure of the information visualization design space. In: Proc. IEEE Symp. information visualization, infovis, pp. 92\u201399. https:\/\/doi.org\/10.1109\/INFVIS.1997.636792","DOI":"10.1109\/INFVIS.1997.636792"},{"key":"1720_CR42","doi-asserted-by":"crossref","unstructured":"Stoiber C, Grassinger F, Pohl M, Stitz H, Streit M, Aigner W (2019) Visualization onboarding: Learning how to read and use visualizations. In: IEEE Workshop on visualization for communication. OSF Preprints, Vancouver, BC, Canada. https:\/\/doi.org\/10\/gh38zd","DOI":"10.31219\/osf.io\/c38ab"},{"issue":"1","key":"1720_CR43","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1198\/jcgs.2009.07098","volume":"19","author":"H Wickham","year":"2010","unstructured":"Wickham H (2010) A layered grammar of graphics. Journal of computational and graphical statistics 19(1):3\u201328. https:\/\/doi.org\/10.1198\/jcgs.2009.07098","journal-title":"Journal of computational and graphical statistics"},{"key":"1720_CR44","doi-asserted-by":"publisher","unstructured":"Mauri M, Elli T, Caviglia G, Uboldi G, Azzi M (2017) RAWGraphs: A visualisation platform to create open outputs. In: Proceedings of the 12th biannual conference on italian sigchi chapter. CHItaly \u201917. ACM, New York, NY, USA. https:\/\/doi.org\/10.1145\/3125571.3125585","DOI":"10.1145\/3125571.3125585"},{"issue":"387","key":"1720_CR45","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1080\/01621459.1984.10478080","volume":"79","author":"WS Cleveland","year":"1984","unstructured":"Cleveland WS, McGill R (1984) Graphical perception: Theory, experimentation, and application to the development of graphical methods. J American statistical association 79(387):531\u2013554","journal-title":"J American statistical association"},{"key":"1720_CR46","volume-title":"Information Visualization Perception for Design","author":"C Ware","year":"2021","unstructured":"Ware C (2021) Information Visualization Perception for Design, 4th edn. Morgan Kaufmann, Cambridge","edition":"4"},{"key":"1720_CR47","unstructured":"Grond F, Berger J (2011) Parameter mapping sonification. In: Hermann T, Hunt A, Neuhoff JG, (eds.) The Sonification Handbook, pp 363\u2013397"},{"issue":"3","key":"1720_CR48","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/BF00996201","volume":"9","author":"DL Mansur","year":"1985","unstructured":"Mansur DL, Blattner MM, Joy KI (1985) Sound graphs: a numerical data analysis method for the blind. Journal of medical systems 9(3):163\u2013174. https:\/\/doi.org\/10.1007\/BF00996201","journal-title":"Journal of medical systems"},{"key":"1720_CR49","unstructured":"Stockman T, Nickerson LV, Hind G (2005) Auditory graphs: a summary of current experience and towards a research agenda. In: Brazil E, (ed.) Proceedings of the 11th international conference on auditory display, pp 420\u2013422. http:\/\/hdl.handle.net\/1853\/50097"},{"key":"1720_CR50","unstructured":"McGookin D, Brewster S (2011) Earcons. In: Hermann T, Hunt A, Neuhoff JG, (eds.) The Sonification Handbook, pp 339\u2013361"},{"key":"1720_CR51","unstructured":"Rohrhuber J (2010) $$\\overset{_{\\circ }}{\\rm S}$$ - introducing sonification variables. In: Proceedings of the supercollider symposium. http:\/\/wertlos.org\/~rohrhuber\/articles\/Rohrhuber_Sonvar.pdf Accessed 31 March 2022"},{"issue":"11","key":"1720_CR52","first-page":"926","volume":"60","author":"K Vogt","year":"2012","unstructured":"Vogt K, H\u00f6ldrich R (2012) Translating sonifications. Journal of the audio engineering society 60(11):926\u2013935","journal-title":"Journal of the audio engineering society"},{"issue":"12","key":"1720_CR53","doi-asserted-by":"publisher","first-page":"82491","DOI":"10.1371\/journal.pone.0082491","volume":"8","author":"G Dubus","year":"2013","unstructured":"Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE 8(12):82491","journal-title":"PLoS ONE"},{"key":"1720_CR54","doi-asserted-by":"publisher","unstructured":"Ferguson J, Brewster SA (2017) Evaluation of psychoacoustic sound parameters for sonification. In: Proceedings of the 19th ACM international conference on multimodal interaction. ICMI 2017, pp 120\u2013127. ACM, Glasgow UK. https:\/\/doi.org\/10.1145\/3136755.3136783","DOI":"10.1145\/3136755.3136783"},{"key":"1720_CR55","unstructured":"Neuhoff JG, Knight R, Wayand J (2002) Pitch change, sonification, and musical expertise: Which way is up? In: Proceedings of the 2002 international conference on auditory display. http:\/\/hdl.handle.net\/1853\/51370"},{"key":"1720_CR56","unstructured":"Walker BN, Lane DM (2001) Psychophysical scaling of sonification mappings A comparison of visually impaired and sighted listeners. In: Proceedings of the 2001 international conference on auditory display, pp 90\u201394. http:\/\/hdl.handle.net\/1853\/50630"},{"issue":"3","key":"1720_CR57","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","volume":"27","author":"CE Shannon","year":"1948","unstructured":"Shannon CE (1948) A Mathematical Theory of Communication. The bell system technical journal 27(3):379\u2013423. https:\/\/doi.org\/10.1002\/j.1538-7305.1948.tb01338.x","journal-title":"The bell system technical journal"},{"key":"1720_CR58","first-page":"325","volume-title":"The Sonification Handbook","author":"E Brazil","year":"2011","unstructured":"Brazil E, Fernstr\u00f6m M (2011) Auditory Icons. In: Hermann T, Hunt A, Neuhoff J (eds) The Sonification Handbook. Logos, Berlin, pp 325\u2013338"},{"issue":"1","key":"1720_CR59","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1207\/s15327051hci0401_3","volume":"4","author":"WW Gaver","year":"1989","unstructured":"Gaver WW (1989) The SonicFinder: an interface that uses auditory icons. Human-computer interaction 4(1):67\u201394. https:\/\/doi.org\/10.1207\/s15327051hci0401_3","journal-title":"Human-computer interaction"},{"key":"1720_CR60","unstructured":"Brewster SA (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. PhD thesis, University of York"},{"issue":"3","key":"1720_CR61","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/0022-460X(76)90391-6","volume":"45","author":"RL Pratt","year":"1976","unstructured":"Pratt RL, Doak PE (1976) A subjective rating scale for timbre. Journal of sound and vibration 45(3):317\u2013328. https:\/\/doi.org\/10.1016\/0022-460X(76)90391-6","journal-title":"Journal of sound and vibration"},{"key":"1720_CR62","doi-asserted-by":"publisher","unstructured":"Elmquist E, Ejdbo M, Bock A, R\u00f6nnberg N (2021) Openspace sonification: Complementing visualization of the solar system with sound. In: Proceedings of the 26th international conference on auditory display (ICAD 2021), pp 135\u2013142. https:\/\/doi.org\/10.21785\/icad2021.018","DOI":"10.21785\/icad2021.018"},{"issue":"1","key":"1720_CR63","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/BF00410640","volume":"4","author":"M Wertheimer","year":"1923","unstructured":"Wertheimer M (1923) Untersuchungen zur Lehre von der Gestalt. II. Psychologische forschung 4(1):301\u2013350","journal-title":"II. Psychologische forschung"},{"key":"1720_CR64","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1486.001.0001","volume-title":"Auditory Scene Analysis: The Perceptual Organization of Sound","author":"AS Bregman","year":"1990","unstructured":"Bregman AS (1990) Auditory Scene Analysis: The Perceptual Organization of Sound. MIT press, Cambridge, MA, USA"},{"issue":"11","key":"1720_CR65","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1002\/spe.4380211102","volume":"21","author":"TMJ Fruchterman","year":"1991","unstructured":"Fruchterman TMJ, Reingold EM (1991) Graph drawing by force-directed placement. Software practice and experience 21(11):1129\u20131164. https:\/\/doi.org\/10.1002\/spe.4380211102","journal-title":"Software practice and experience"},{"key":"1720_CR66","doi-asserted-by":"publisher","unstructured":"Inselberg A, Dimsdale B (1990) Parallel coordinates: a tool for visualizing multi-dimensional geometry. In: Proc. 1st conference on visualization \u201990, pp 361\u2013378. https:\/\/doi.org\/10.1109\/VISUAL.1990.146402","DOI":"10.1109\/VISUAL.1990.146402"},{"issue":"411","key":"1720_CR67","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1080\/01621459.1990.10474926","volume":"85","author":"EJ Wegman","year":"1990","unstructured":"Wegman EJ (1990) Hyperdimensional data analysis using parallel coordinates. Journal of the american statistical association 85(411):664\u2013675. https:\/\/doi.org\/10.1080\/01621459.1990.10474926","journal-title":"Journal of the american statistical association"},{"issue":"1","key":"1720_CR68","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1145\/102377.115768","volume":"11","author":"B Shneiderman","year":"1992","unstructured":"Shneiderman B (1992) Tree visualization with Tree-Maps: 2-D space-filling approach. ACM Trans. graph. 11(1):92\u201399. https:\/\/doi.org\/10.1145\/102377.115768","journal-title":"ACM Trans. graph."},{"key":"1720_CR69","doi-asserted-by":"publisher","unstructured":"Wattenberg M (1999) Visualizing the stock market. In: CHI \u201999 Extended abstracts on human factors in computing systems, pp 188\u2013189. https:\/\/doi.org\/10.1145\/632716.632834","DOI":"10.1145\/632716.632834"},{"key":"1720_CR70","unstructured":"FinViz S &P 500 Map. https:\/\/finviz.com\/map.ashx Accessed 31 March 2022"},{"issue":"3\u20134","key":"1720_CR71","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/s12193-011-0068-2","volume":"5","author":"F Grond","year":"2012","unstructured":"Grond F, Hermann T (2012) Singing function: exploring auditory graphs with a vowel based sonification. Journal on multimodal user interfaces 5(3\u20134):87\u201395. https:\/\/doi.org\/10.1007\/s12193-011-0068-2","journal-title":"Journal on multimodal user interfaces"},{"key":"1720_CR72","unstructured":"Baier G, Hermann T, Stephani U (2007) Multi-channel sonification of human EEG. In: Proceedings of the 13th international conference on auditory display, Montreal, Canada, pp 491\u2013496. http:\/\/hdl.handle.net\/1853\/50013"},{"key":"1720_CR73","unstructured":"Baier G, Hermann T, Stephani U (2007) Supplementary Material for \u201cMulti-Channel Sonification of Human EEG\u201d. https:\/\/pub.uni-bielefeld.de\/record\/2699375 Accessed 31 March 2022"},{"issue":"10","key":"1720_CR74","doi-asserted-by":"publisher","first-page":"00175","DOI":"10.1016\/j.heliyon.2016.e00175","volume":"2","author":"RP Bywater","year":"2016","unstructured":"Bywater RP, Middleton JN (2016) Melody discrimination and protein fold classification. Heliyon 2(10):00175. https:\/\/doi.org\/10.1016\/j.heliyon.2016.e00175","journal-title":"Heliyon"},{"key":"1720_CR75","doi-asserted-by":"publisher","unstructured":"Enge K, Rind A, Iber M, H\u00f6ldrich R, Aigner W (2022) Towards multimodal exploratory data analysis: SoniScope as a prototypical implementation. In: Agus M, Aigner W, Hoellt T, (eds.) Proceedings of Eurovis 2022 pp 67\u201371. Eurographics, Goslar, Germany. https:\/\/doi.org\/10.2312\/evs.20221095","DOI":"10.2312\/evs.20221095"},{"key":"1720_CR76","unstructured":"LaPorte S, Hashemi M (2022) Listen to Wikipedia. http:\/\/listen.hatnote.com\/#en Accessed 31 March 2022"},{"key":"1720_CR77","unstructured":"R\u00f6nnberg N, Jimmy J (2016) Interactive sonification for visual dense data displays. In: ISon 2016, 5th Interactive sonification workshop, CITEC, Bielefeld University, Germany, December 16, 2016, pp 63\u201367"},{"key":"1720_CR78","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-17207-7","author":"F Zotter","year":"2019","unstructured":"Zotter F, Frank M (2019) Ambisonics: a Practical 3D Audio Theory for Recording, Studio Production, Sound Reinforcement, and Virtual Reality. Springer Nature, Graz. https:\/\/doi.org\/10.1007\/978-3-030-17207-7","journal-title":"Springer Nature, Graz."},{"key":"1720_CR79","doi-asserted-by":"crossref","unstructured":"Zwicker E, Fastl H (1999) Psychoacoustics: facts and Models. Springer series in information sciences, vol. 22. Springer, Berlin, Heidelberg","DOI":"10.1007\/978-3-662-09562-1"},{"key":"1720_CR80","first-page":"55","volume-title":"Perceptual organization","author":"M Kubovy","year":"1981","unstructured":"Kubovy M (1981) Concurrent-pitch segregation and the theory of indispensable attributes. Perceptual organization. Routledge, London, pp 55\u201398"},{"issue":"3","key":"1720_CR81","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/S0010-0277(03)00005-2","volume":"87","author":"D Van Valkenburg","year":"2003","unstructured":"Van Valkenburg D, Kubovy M (2003) In defense of the theory of indispensable attributes. Cognition 87(3):225\u2013233. https:\/\/doi.org\/10.1016\/S0010-0277(03)00005-2","journal-title":"Cognition"},{"issue":"2","key":"1720_CR82","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1037\/0096-1523.14.2.318","volume":"14","author":"M Kubovy","year":"1988","unstructured":"Kubovy M (1988) Should we resist the seductiveness of the space time vision audition analogy? Journal of experimental psychology human perception and performance 14(2):318\u2013320. https:\/\/doi.org\/10.1037\/0096-1523.14.2.318","journal-title":"Journal of experimental psychology human perception and performance"},{"issue":"2","key":"1720_CR83","doi-asserted-by":"publisher","first-page":"147","DOI":"10.2307\/1421351","volume":"84","author":"F Attneave","year":"1971","unstructured":"Attneave F, Olson RK (1971) Pitch as a Medium: a New Approach to Psychophysical Scaling. The american journal of psychology 84(2):147\u2013166. https:\/\/doi.org\/10.2307\/1421351","journal-title":"The american journal of psychology"},{"key":"1720_CR84","doi-asserted-by":"publisher","unstructured":"Elmquist E, Enge K (2022) Towards the combination of visualization and sonification for cylindrical displays. In: AVI 2022 workshop on audio-visual analytics (WAVA22), Frascati, Rome, Italy. https:\/\/doi.org\/10.5281\/zenodo.6553825","DOI":"10.5281\/zenodo.6553825"},{"key":"1720_CR85","unstructured":"Heinrich J, Weiskopf D (2013) State of the art of parallel coordinates. Eurographics (State of the Art Reports), 95\u2013116"},{"issue":"1","key":"1720_CR86","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1109\/TVCG.2015.2466992","volume":"22","author":"J Johansson","year":"2015","unstructured":"Johansson J, Forsell C (2015) Evaluation of parallel coordinates: overview, categorization and guidelines for future research. IEEE Transactions on visualization and computer graphics 22(1):579\u2013588","journal-title":"IEEE Transactions on visualization and computer graphics"}],"container-title":["Personal and Ubiquitous Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-023-01720-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00779-023-01720-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-023-01720-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T05:07:37Z","timestamp":1697778457000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00779-023-01720-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,21]]},"references-count":86,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["1720"],"URL":"https:\/\/doi.org\/10.1007\/s00779-023-01720-5","relation":{},"ISSN":["1617-4909","1617-4917"],"issn-type":[{"value":"1617-4909","type":"print"},{"value":"1617-4917","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,21]]},"assertion":[{"value":"31 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}