{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:58:22Z","timestamp":1740149902138,"version":"3.37.3"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2023,7,8]],"date-time":"2023-07-08T00:00:00Z","timestamp":1688774400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,8]],"date-time":"2023-07-08T00:00:00Z","timestamp":1688774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003945","name":"Link\u00f6ping University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003945","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Along with the increase of digitalization and automation, a new kind of working environment is emerging in the field of air traffic control. Instead of situating the control tower at the airport, it is now possible to remotely control the airport at any given location, i.e. in a remote tower center (RTC). However, by controlling the airport remotely, the situational awareness and sense of presence might be compromised. By using directional sound, a higher situational awareness could potentially be achieved while also offloading the visual perception which is heavily used in air traffic control. Suitable use cases for sonification in air traffic control were found through workshops with air traffic controllers. A sonification design named SonAir was developed based on the outcome of the workshops, and was integrated with an RTC simulator for evaluating to what degree SonAir could support air traffic controllers in their work. The results suggest that certain aspects of SonAir could be useful for air traffic controllers. A continuous sonification where the spatial positioning of aircraft were conveyed was experienced to be partially useful, but the intrusiveness of SonAir should be further considered to fit the air traffic controllers\u2019 needs. An earcon that conveyed when an aircraft enters the airspace and from which direction was considered useful to support situational awareness.<\/jats:p>","DOI":"10.1007\/s12193-023-00404-x","type":"journal-article","created":{"date-parts":[[2023,7,8]],"date-time":"2023-07-08T06:01:37Z","timestamp":1688796097000},"page":"137-149","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["SonAir: the design of a sonification of radar data for air traffic control"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5874-6356","authenticated-orcid":false,"given":"Elias","family":"Elmquist","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2849-6146","authenticated-orcid":false,"given":"Alexander","family":"Bock","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8862-7331","authenticated-orcid":false,"given":"Jonas","family":"Lundberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9466-9826","authenticated-orcid":false,"given":"Anders","family":"Ynnerman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1334-0624","authenticated-orcid":false,"given":"Niklas","family":"R\u00f6nnberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,7,8]]},"reference":[{"issue":"3","key":"404_CR1","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s12193-011-0062-8","volume":"5","author":"S Bakker","year":"2012","unstructured":"Bakker S, van den Hoven E, Eggen B (2012) Knowing by ear: leveraging human attention abilities in interaction design. Journal on Multimodal User Interfaces 5(3):197\u2013209. https:\/\/doi.org\/10.1007\/s12193-011-0062-8","journal-title":"Journal on Multimodal User Interfaces"},{"key":"404_CR2","doi-asserted-by":"publisher","unstructured":"Ballora M, Cole RJ, Kruesi H, et\u00a0al (2012) Use of sonification in the detection of anomalous events. In: Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012, International Society for Optics and Photonics, p 84070S, https:\/\/doi.org\/10.1117\/12.918688","DOI":"10.1117\/12.918688"},{"issue":"7\u20138","key":"404_CR3","first-page":"519","volume":"60","author":"DR Begault","year":"2012","unstructured":"Begault DR (2012) Guidelines for NextGen auditory displays. Journal of the Audio Engineering Society 60(7\u20138):519\u2013530","journal-title":"Journal of the Audio Engineering Society"},{"key":"404_CR4","doi-asserted-by":"publisher","unstructured":"Bijsterveld K (2019) Sonic Skills: Listening for Knowledge in Science, Medicine and Engineering (1920s-Present). Palgrave Macmillan London. https:\/\/doi.org\/10.1057\/978-1-137-59829-5","DOI":"10.1057\/978-1-137-59829-5"},{"issue":"2","key":"404_CR5","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1177\/1555343417735398","volume":"12","author":"C Chamberland","year":"2018","unstructured":"Chamberland C, Hodgetts HM, Valli\u00e8res BR et al (2018) The benefits and the costs of using auditory warning messages in dynamic decision-making settings. Journal of Cognitive Engineering and Decision Making 12(2):112\u2013130. https:\/\/doi.org\/10.1177\/1555343417735398","journal-title":"Journal of Cognitive Engineering and Decision Making"},{"key":"404_CR6","doi-asserted-by":"publisher","unstructured":"Cordeil M, Dwyer T, Hurter C (2016) Immersive solutions for future air traffic control and management. In: Companion Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016. Association for Computing Machinery, Inc, pp 25\u201331, https:\/\/doi.org\/10.1145\/3009939.3009944","DOI":"10.1145\/3009939.3009944"},{"key":"404_CR7","doi-asserted-by":"publisher","unstructured":"Debashi M, Vickers P (2018) Sonification of network traffic flow for monitoring and situational awareness. PloS one 13(4):e0195,948. https:\/\/doi.org\/10.1371\/journal.pone.0195948","DOI":"10.1371\/journal.pone.0195948"},{"key":"404_CR8","doi-asserted-by":"publisher","unstructured":"Doble N, Hansman R (2004) Experimental evaluation of portable electronic flight progress strips. In: The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576), pp 963\u201351, https:\/\/doi.org\/10.1109\/DASC.2004.1391340","DOI":"10.1109\/DASC.2004.1391340"},{"key":"404_CR9","doi-asserted-by":"publisher","unstructured":"Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE 8. https:\/\/doi.org\/10.1371\/JOURNAL.PONE.0082491","DOI":"10.1371\/JOURNAL.PONE.0082491"},{"issue":"7","key":"404_CR10","doi-asserted-by":"publisher","first-page":"1108","DOI":"10.1177\/0018720817712004","volume":"59","author":"J Edworthy","year":"2017","unstructured":"Edworthy J, Reid S, McDougall S et al (2017) The recognizability and localizability of auditory alarms: Setting global medical device standards. Human factors 59(7):1108\u20131127. https:\/\/doi.org\/10.1177\/0018720817712004","journal-title":"Human factors"},{"key":"404_CR11","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1177\/154193128803200221","volume":"32","author":"MR Endsley","year":"1988","unstructured":"Endsley MR (1988) Design and evaluation for situation awareness enhancement. Proceedings of the Human Factors Society Annual Meeting 32:97\u2013101. https:\/\/doi.org\/10.1177\/154193128803200221","journal-title":"Proceedings of the Human Factors Society Annual Meeting"},{"key":"404_CR12","unstructured":"Endsley MR, Smolensky MW (1998) Situation awareness in air traffic control: The picture., Academic Press, pp 115\u2013154"},{"key":"404_CR13","doi-asserted-by":"publisher","unstructured":"Falk C, Dykstra J (2019) Sonification with music for cybersecurity situational awareness. In: Proc. of the International Conference on Auditory Display, Georgia Institute of Technology, https:\/\/doi.org\/10.21785\/icad2019.014","DOI":"10.21785\/icad2019.014"},{"key":"404_CR14","doi-asserted-by":"publisher","DOI":"10.4324\/9781315106342","author":"M Filimowicz","year":"2019","unstructured":"Filimowicz M (2019) Foundations in Sound Design for Interactive Media: A Multidisciplinary Approach. Routledge. https:\/\/doi.org\/10.4324\/9781315106342","journal-title":"Routledge"},{"key":"404_CR15","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1002\/WCS.1226","volume":"4","author":"L Foglia","year":"2013","unstructured":"Foglia L, Wilson RA (2013) Embodied cognition. Wiley Interdisciplinary Reviews: Cognitive Science 4:319\u2013325. https:\/\/doi.org\/10.1002\/WCS.1226","journal-title":"Wiley Interdisciplinary Reviews: Cognitive Science"},{"key":"404_CR16","doi-asserted-by":"publisher","unstructured":"Gang N, Sibi S, Michon R, et\u00a0al (2018) Don\u2019t be alarmed: Sonifying autonomous vehicle perception to increase situation awareness. In: Proceedings of the 10th international conference on automotive user interfaces and interactive vehicular applications, pp 237\u2013246, https:\/\/doi.org\/10.1145\/3239060.3265636","DOI":"10.1145\/3239060.3265636"},{"key":"404_CR17","doi-asserted-by":"publisher","unstructured":"Gaver WW, Smith RB, O\u2019Shea T (1991) Effective sounds in complex systems: The arkola simulation. In: Proceedings of the SIGCHI Conference on Human factors in Computing Systems, pp 85\u201390, https:\/\/doi.org\/10.1145\/108844.108857","DOI":"10.1145\/108844.108857"},{"key":"404_CR18","unstructured":"Hermann T, Hunt A, Neuhoff J (2011) The Sonification Handbook. Logos Publishing House"},{"key":"404_CR19","unstructured":"Hermann T, Hildebrandt T, Langeslag P, et\u00a0al (2015) Optimizing aesthetics and precision in sonification for peripheral process-monitoring. In: Proc. of the International Conference on Auditory Display, Georgia Institute of Technology"},{"key":"404_CR20","unstructured":"Hildebrandt T, Rinderle-Ma S (2013) Toward a sonification concept for business process monitoring. In: Proc. of the International Conference on Auditory Display, Georgia Institute of Technology"},{"key":"404_CR21","doi-asserted-by":"publisher","unstructured":"Hildebrandt T, Hermann T, Rinderle-Ma S (2014) A sonification system for process monitoring as secondary task. In: 2014 5th IEEE conference on cognitive infocommunications (CogInfoCom), IEEE, pp 191\u2013196, https:\/\/doi.org\/10.1109\/CogInfoCom.2014.7020444","DOI":"10.1109\/CogInfoCom.2014.7020444"},{"key":"404_CR22","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.ijhcs.2016.06.002","volume":"95","author":"T Hildebrandt","year":"2016","unstructured":"Hildebrandt T, Hermann T, Rinderle-Ma S (2016) Continuous sonification enhances adequacy of interactions in peripheral process monitoring. International Journal of Human-Computer Studies 95:54\u201365. https:\/\/doi.org\/10.1016\/j.ijhcs.2016.06.002","journal-title":"International Journal of Human-Computer Studies"},{"key":"404_CR23","unstructured":"H\u00f6ferlin B, H\u00f6ferlin M, Goloubets B, et\u00a0al (2012) Auditory support for situation awareness in video surveillance. In: Proc. of the International Conference on Auditory Display, Georgia Institute of Technology"},{"key":"404_CR24","doi-asserted-by":"publisher","unstructured":"Iber M (2019) Auditory Display in Workplace Environments, Routledge, pp 131\u2013154. https:\/\/doi.org\/10.4324\/9781315106359-6","DOI":"10.4324\/9781315106359-6"},{"issue":"4","key":"404_CR25","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1007\/s00779-020-01394-3","volume":"25","author":"M Iber","year":"2021","unstructured":"Iber M, Lechner P, Jandl C et al (2021) Auditory augmented process monitoring for cyber physical production systems. Personal and Ubiquitous Computing 25(4):691\u2013704. https:\/\/doi.org\/10.1007\/s00779-020-01394-3","journal-title":"Personal and Ubiquitous Computing"},{"issue":"5","key":"404_CR26","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1109\/MCG.2022.3193160","volume":"42","author":"J Johansson Westberg","year":"2022","unstructured":"Johansson Westberg J, Lundin Palmerius K, Lundberg J (2022) Utm city-visualization of unmanned aerial vehicles. IEEE Computer Graphics and Applications 42(5):84\u201389. https:\/\/doi.org\/10.1109\/MCG.2022.3193160","journal-title":"IEEE Computer Graphics and Applications"},{"key":"404_CR27","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.apergo.2019.01.009","volume":"78","author":"S Klueber","year":"2019","unstructured":"Klueber S, Wolf E, Grundgeiger T et al (2019) Supporting multiple patient monitoring with head-worn displays and spearcons. Applied ergonomics 78:86\u201396. https:\/\/doi.org\/10.1016\/j.apergo.2019.01.009","journal-title":"Applied ergonomics"},{"key":"404_CR28","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1146\/ANNUREV.PSYCH.55.090902.142023","volume":"56","author":"JR Lackner","year":"2005","unstructured":"Lackner JR, DiZio P (2005) Vestibular, proprioceptive, and haptic contributions to spatial orientation. Annual Review of Psychology 56:115\u2013147. https:\/\/doi.org\/10.1146\/ANNUREV.PSYCH.55.090902.142023","journal-title":"Annual Review of Psychology"},{"key":"404_CR29","doi-asserted-by":"publisher","unstructured":"Landry S, Jeon M (2018) Listen to your drive: An in-vehicle sonification system based on driver affective states and driving data. In: Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp 252\u2013253, https:\/\/doi.org\/10.1145\/3239092.3267123","DOI":"10.1145\/3239092.3267123"},{"key":"404_CR30","doi-asserted-by":"publisher","unstructured":"Lenzi S, Riccardo T, Ginevra T, et\u00a0al (2019) Disclosing cyber-attacks on water distribution systems. an experimental approach to the sonification of threats and anomalous data. In: 25th International Conference on Auditory Display, International Community on Auditory Display, pp 125\u2013132, https:\/\/doi.org\/10.21785\/icad2019.044","DOI":"10.21785\/icad2019.044"},{"issue":"4","key":"404_CR31","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1080\/00140130010011369","volume":"44","author":"YC Liu","year":"2001","unstructured":"Liu YC (2001) Comparative study of the effects of auditory, visual and multimodality displays on drivers\u2019 performance in advanced traveller information systems. Ergonomics 44(4):425\u2013442. https:\/\/doi.org\/10.1080\/00140130010011369","journal-title":"Ergonomics"},{"issue":"5","key":"404_CR32","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1080\/1463922X.2015.1008601","volume":"16","author":"J Lundberg","year":"2015","unstructured":"Lundberg J (2015) Situation awareness systems, states and processes: A holistic framework. Theoretical Issues in Ergonomics Science 16(5):447\u2013473. https:\/\/doi.org\/10.1080\/1463922X.2015.1008601","journal-title":"Theoretical Issues in Ergonomics Science"},{"key":"404_CR33","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-020-00637-w","author":"J Lundberg","year":"2020","unstructured":"Lundberg J, Johansson BJE (2020) A framework for describing interaction between human operators and autonomous, automated, and manual control systems. Cognition, Technology & Work. https:\/\/doi.org\/10.1007\/s10111-020-00637-w","journal-title":"Cognition, Technology & Work"},{"issue":"2","key":"404_CR34","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1353\/pla.2002.0038","volume":"2","author":"JW Marcum","year":"2002","unstructured":"Marcum JW (2002) Beyond visual culture: the challenge of visual ecology. portal: Libraries and the Academy 2(2):189\u2013206. https:\/\/doi.org\/10.1353\/pla.2002.0038","journal-title":"portal: Libraries and the Academy"},{"issue":"3","key":"404_CR35","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/s0896-6273(04)00012-1","volume":"41","author":"R Marois","year":"2004","unstructured":"Marois R, Yi DJ, Chun MM (2004) The neural fate of consciously perceived and missed events in the attentional blink. Neuron 41(3):465\u2013472. https:\/\/doi.org\/10.1016\/s0896-6273(04)00012-1","journal-title":"Neuron"},{"key":"404_CR36","doi-asserted-by":"publisher","unstructured":"May K, Sobel B, Wilson J, et\u00a0al (2019) Auditory Displays to Facilitate Object Targeting in 3D Space. In: Proc. of the International Conference on Auditory Display, pp 155\u2013162, https:\/\/doi.org\/10.21785\/icad2019.008","DOI":"10.21785\/icad2019.008"},{"key":"404_CR37","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1162\/014892602320991383","volume":"26","author":"J McCartney","year":"2002","unstructured":"McCartney J (2002) Rethinking the computer music language: Supercollider. IEEE Computer Graphics & Applications 26:61\u201368. https:\/\/doi.org\/10.1162\/014892602320991383","journal-title":"IEEE Computer Graphics & Applications"},{"key":"404_CR38","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.51","volume":"2","author":"O Metatla","year":"2016","unstructured":"Metatla O, Bryan-Kinns N, Stockman T et al (2016) Sonification of reference markers for auditory graphs: Effects on non-visual point estimation tasks. PeerJ Computer Science 2:e51. https:\/\/doi.org\/10.7717\/peerj-cs.51","journal-title":"PeerJ Computer Science"},{"key":"404_CR39","doi-asserted-by":"publisher","unstructured":"di\u00a0Milano VCP, Lenzi IS, Ricc\u00f3 D, et\u00a0al (2022) Audiovisual sonifications: A design map for multisensory integration in data representation. DRS Biennial Conference Series https:\/\/doi.org\/10.21606\/DRS.2022.380, https:\/\/dl.designresearchsociety.org\/drs-conference-papers\/drs2022\/researchpapers\/100","DOI":"10.21606\/DRS.2022.380"},{"key":"404_CR40","doi-asserted-by":"publisher","unstructured":"Munzner T (2009) A Nested Model for Visualization Design and Validation. IEEE Transactions on Visualization and Computer Graphics 15. https:\/\/doi.org\/10.1109\/TVCG.2009.111","DOI":"10.1109\/TVCG.2009.111"},{"key":"404_CR41","doi-asserted-by":"publisher","unstructured":"Nadri C, Ko S, Diggs C, et\u00a0al (2021) Novel auditory displays in highly automated vehicles: Sonification improves driver situation awareness, perceived workload, and overall experience. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, SAGE Publications Sage CA: Los Angeles, CA, pp 586\u2013590, https:\/\/doi.org\/10.1177\/1071181321651071","DOI":"10.1177\/1071181321651071"},{"key":"404_CR42","doi-asserted-by":"publisher","unstructured":"Neuhoff JG (2019) Is sonification doomed to fail? Proceedings of the 25th International Conference on Auditory Display (ICAD 2019) https:\/\/doi.org\/10.21785\/icad2019.069","DOI":"10.21785\/icad2019.069"},{"key":"404_CR43","doi-asserted-by":"publisher","unstructured":"Oviatt S (2006) Human-centered design meets cognitive load theory: designing interfaces that help people think. In: Proceedings of the 14th ACM international conference on Multimedia, ACM, pp 871\u2013880, https:\/\/doi.org\/10.1145\/1180639.1180831","DOI":"10.1145\/1180639.1180831"},{"issue":"5","key":"404_CR44","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1111\/anae.13424","volume":"71","author":"E Paterson","year":"2016","unstructured":"Paterson E, Sanderson P, Paterson N et al (2016) The effectiveness of pulse oximetry sonification enhanced with tremolo and brightness for distinguishing clinically important oxygen saturation ranges: a laboratory study. Anaesthesia 71(5):565\u2013572. https:\/\/doi.org\/10.1111\/anae.13424","journal-title":"Anaesthesia"},{"issue":"1241","key":"404_CR45","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1098\/rstb.1990.0091","volume":"327","author":"RD Patterson","year":"1990","unstructured":"Patterson RD (1990) Auditory warning sounds in the work environment. Philosophical Transactions of the Royal Society of London B, Biological Sciences 327(1241):485\u2013492. https:\/\/doi.org\/10.1098\/rstb.1990.0091","journal-title":"Philosophical Transactions of the Royal Society of London B, Biological Sciences"},{"key":"404_CR46","doi-asserted-by":"publisher","unstructured":"Pichora-Fuller MK, Singh G (2006) Effects of age on auditory and cognitive processing: Implications for hearing aid fitting and audiologic rehabilitation. Trends in Amplification 10(1):29\u201359. https:\/\/doi.org\/10.1177\/108471380601000103, pMID: 16528429","DOI":"10.1177\/108471380601000103"},{"key":"404_CR47","unstructured":"Reynal M (2019) Non-visual interaction concepts: considering hearing, haptics and kinesthetics for an augmented remote tower environnment. PhD thesis, French Civil Aviation School (ENAC), https:\/\/tel.archives-ouvertes.fr\/tel-02919969v2"},{"key":"404_CR48","doi-asserted-by":"publisher","unstructured":"Reynal M, Aric\u00f2 P, Imbert JP, et\u00a0al (2019) Investigating Multimodal Augmentations Contribution to Remote Control Tower Contexts for Air Traffic Management. In: Proceedings of the International Conference on Human Computer Interaction Theory and Applications, https:\/\/doi.org\/10.5220\/0007400300500061","DOI":"10.5220\/0007400300500061"},{"key":"404_CR49","unstructured":"R\u00f6nnberg N (2019) Towards interactive sonification for monitoring of dynamic processes. In: Proceedings of the Interactive Sonification Workshop, Nordic Sound and Music Computing Conference"},{"key":"404_CR50","unstructured":"R\u00f6nnberg N, Lundberg J, L\u00f6wgren J (2016) Sonifying the Periphery: Supporting the Formation of Gestalt in Air Traffic Control. In: Proceedings of the 5th Interactive Sonification Workshop, December 2016, pp 23\u201327"},{"key":"404_CR51","doi-asserted-by":"publisher","unstructured":"Rottermanner G, de Jesus Oliveira VA, Lechner P, et\u00a0al (2020) Design and Evaluation of a Tool to Support Air Traffic Control with 2D and 3D Visualizations. IEEE Conference on Virtual Reality and 3D User Interfaces (VR) pp 885\u2013892. https:\/\/doi.org\/10.1109\/VR46266.2020.00011","DOI":"10.1109\/VR46266.2020.00011"},{"key":"404_CR52","doi-asserted-by":"publisher","unstructured":"Sawe N, Chafe C, Trevi\u00f1o J (2020) Using data sonification to overcome science literacy, numeracy, and visualization barriers in science communication. Frontiers in Communication 5:46.https:\/\/doi.org\/10.3389\/fcomm.2020.00046,https:\/\/www.frontiersin.org\/article\/10.3389\/fcomm.2020.00046\/full","DOI":"10.3389\/fcomm.2020.00046"},{"issue":"12","key":"404_CR53","doi-asserted-by":"publisher","first-page":"2431","DOI":"10.1109\/TVCG.2012.213","volume":"18","author":"M Sedlmair","year":"2012","unstructured":"Sedlmair M, Meyer M, Munzner T (2012) Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization and Computer Graphics 18(12):2431\u20132440. https:\/\/doi.org\/10.1109\/TVCG.2012.213","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"404_CR54","unstructured":"Svensson \u00c5, Forsell C, Johansson J, et\u00a0al (2017) Analysis of work patterns as a foundation for human-automation communication in multiple remote towers. In: Twelfth USA\/Europe Air Traffic Management Research and Development Seminar"},{"key":"404_CR55","doi-asserted-by":"publisher","unstructured":"Svensson \u00c5, Lundberg J, Forsell C et al (2021) Automation, teamwork, and the feared loss of safety Air traffic controllers\u2019 experiences and expectations on current and future ATM systems. European Conference on Cognitive Ergonomics 2021. https:\/\/doi.org\/10.1145\/3452853.3452855","DOI":"10.1145\/3452853.3452855"},{"key":"404_CR56","doi-asserted-by":"publisher","unstructured":"Tomlinson BJ, Noah BE, Walker BN (2018) Buzz: An auditory interface user experience scale. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, pp LBW096:1\u2013LBW096:6, https:\/\/doi.org\/10.1145\/3170427.3188659","DOI":"10.1145\/3170427.3188659"},{"issue":"6","key":"404_CR57","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1080\/001401300404760","volume":"43","author":"TV Tran","year":"2000","unstructured":"Tran TV, Letowski T, Abouchacra KS (2000) Evaluation of acoustic beacon characteristics for navigation tasks. Ergonomics 43(6):807\u2013827. https:\/\/doi.org\/10.1080\/001401300404760","journal-title":"Ergonomics"},{"key":"404_CR58","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.displa.2016.05.002","volume":"47","author":"P Vickers","year":"2017","unstructured":"Vickers P, Laing C, Fairfax T (2017) Sonification of a network\u2019s self-organized criticality for real-time situational awareness. Displays 47:12\u201324. https:\/\/doi.org\/10.1016\/j.displa.2016.05.002","journal-title":"Displays"},{"key":"404_CR59","doi-asserted-by":"publisher","unstructured":"Vrotsou K, Nordman A (2020) A window-based approach for mining long duration event-sequences. EuroVis Workshop on Visual Analytics (EuroVA) pp 55\u201359. https:\/\/doi.org\/10.2312\/eurova.20201087,","DOI":"10.2312\/eurova.20201087"},{"issue":"2","key":"404_CR60","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1518\/001872006777724507","volume":"48","author":"BN Walker","year":"2006","unstructured":"Walker BN, Lindsay J (2006) Navigation performance with a virtual auditory display: effects of beacon sound, capture radius, and practice. Human factors 48(2):265\u2013278. https:\/\/doi.org\/10.1518\/001872006777724507","journal-title":"Human factors"},{"key":"404_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dss.2014.02.007","volume":"62","author":"Q Wang","year":"2014","unstructured":"Wang Q, Yang S, Liu M et al (2014) An eye-tracking study of website complexity from cognitive load perspective. Decision support systems 62:1\u201310. https:\/\/doi.org\/10.1016\/j.dss.2014.02.007","journal-title":"Decision support systems"},{"issue":"1","key":"404_CR62","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1121\/1.407089","volume":"94","author":"EM Wenzel","year":"1993","unstructured":"Wenzel EM, Arruda M, Kistler DJ et al (1993) Localization using nonindividualized head-related transfer functions. Journal of the Acoustical Society of America 94(1):111\u2013123. https:\/\/doi.org\/10.1121\/1.407089","journal-title":"Journal of the Acoustical Society of America"},{"issue":"7041","key":"404_CR63","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1038\/435439a","volume":"435","author":"JM Wolfe","year":"2005","unstructured":"Wolfe JM, Horowitz TS, Kenner NM (2005) Cognitive psychology: rare items often missed in visual searches. Nature 435(7041):439. https:\/\/doi.org\/10.1038\/435439a","journal-title":"Nature"},{"issue":"3","key":"404_CR64","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1017\/S1355771805000932","volume":"10","author":"M Wright","year":"2005","unstructured":"Wright M (2005) Open sound control: an enabling technology for musical networking. Organised Sound 10(3):193. https:\/\/doi.org\/10.1017\/S1355771805000932","journal-title":"Organised Sound"},{"key":"404_CR65","doi-asserted-by":"publisher","unstructured":"Wu M, Xu Y, Yang J, et\u00a0al (2022) A Method of Information Fusion for the Civil Aviation ASTERIX Data and Airport Surface Video Surveillance. 7th International Conference on Computer and Communications (ICCC) pp 868\u2013873. https:\/\/doi.org\/10.1109\/ICCC54389.2021.9674710","DOI":"10.1109\/ICCC54389.2021.9674710"},{"key":"404_CR66","doi-asserted-by":"publisher","unstructured":"Zagermann J, Pfeil U, Reiterer H (2016) Measuring cognitive load using eye tracking technology in visual computing. In: Proceedings of the sixth workshop on beyond time and errors on novel evaluation methods for visualization, ACM, pp 78\u201385, https:\/\/doi.org\/10.1145\/2993901.2993908","DOI":"10.1145\/2993901.2993908"},{"key":"404_CR67","doi-asserted-by":"publisher","unstructured":"Zohrevandi E, Westin CAL, Lundberg J, et\u00a0al (2020) Design of a Real Time Visual Analytics Support Tool for Conflict Detection and Resolution in Air Traffic Control. In: Kerren A, Garth C, Marai GE (eds) EuroVis 2020 - Short Papers. The Eurographics Association, https:\/\/doi.org\/10.2312\/evs.20201044","DOI":"10.2312\/evs.20201044"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00404-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-023-00404-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00404-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T13:13:45Z","timestamp":1694092425000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-023-00404-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,8]]},"references-count":67,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["404"],"URL":"https:\/\/doi.org\/10.1007\/s12193-023-00404-x","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"type":"print","value":"1783-7677"},{"type":"electronic","value":"1783-8738"}],"subject":[],"published":{"date-parts":[[2023,7,8]]},"assertion":[{"value":"30 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}