{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T23:10:34Z","timestamp":1765667434564},"reference-count":102,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,4,10]],"date-time":"2023-04-10T00:00:00Z","timestamp":1681084800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2023,4,10]],"date-time":"2023-04-10T00:00:00Z","timestamp":1681084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Vis"],"published-print":{"date-parts":[[2023,8]]},"DOI":"10.1007\/s12650-023-00909-3","type":"journal-article","created":{"date-parts":[[2023,4,10]],"date-time":"2023-04-10T04:02:56Z","timestamp":1681099376000},"page":"937-956","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Exploring Effective Relationships Between Visual-Audio Channels in Data Visualization"],"prefix":"10.1007","volume":"26","author":[{"given":"Sadia","family":"Rubab","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingyun","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junxiu","family":"Tang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yingcai","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,4,10]]},"reference":[{"key":"909_CR1","doi-asserted-by":"publisher","first-page":"352","DOI":"10.3389\/fnhum.2014.00352","volume":"8","author":"M Adeli","year":"2014","unstructured":"Adeli M, Rouat J, Molotchnikoff S (2014) Audiovisual correspondence between musical timbre and visual shapes. Front Hum Neurosci 8:352","journal-title":"Frontiers in Human Neuroscience"},{"key":"909_CR2","doi-asserted-by":"crossref","unstructured":"Batch A, Ji Y, Fan M, Zhao J, Elmqvist N (2023) uxSense: Supporting user experience analysis with visualization and computer vision. IEEE Trans Vis Comput Graph, To appear","DOI":"10.1109\/TVCG.2023.3241581"},{"issue":"4","key":"909_CR3","first-page":"552","volume":"29","author":"MJ Blanca Mena","year":"2017","unstructured":"Blanca Mena MJ, Alarc\u00f3n Postigo R, Arnau Gras J, Bono Cabr\u00e9 R, Bendayan R (2017) Non-normal data: is anova still a valid option? Psicothema 29(4):552\u2013557","journal-title":"Psicothema"},{"issue":"1","key":"909_CR4","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1177\/0301006617731048","volume":"47","author":"O Blazhenkova","year":"2018","unstructured":"Blazhenkova O, Kumar MM (2018) Angular versus curved shapes: correspondences and emotional processing. Perception 47(1):67\u201389","journal-title":"Perception"},{"issue":"12","key":"909_CR5","doi-asserted-by":"publisher","first-page":"2479","DOI":"10.1109\/TVCG.2011.192","volume":"17","author":"M Borkin","year":"2011","unstructured":"Borkin M, Gajos K, Peters A, Mitsouras D, Melchionna S, Rybicki F, Feldman C, Pfister H (2011) Evaluation of artery visualizations for heart disease diagnosis. IEEE Trans Vis Comput Graph 17(12):2479\u20132488","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"key":"909_CR6","unstructured":"Bouchara T, Katz BF, Jacquemin C, Guastavino C (2010) Audio-visual renderings for multimedia navigation. In: Proc. of International Conference on Auditory Display, pp 245\u2013252"},{"issue":"4","key":"909_CR7","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1145\/1101530.1101542","volume":"2","author":"SA Brewster","year":"2005","unstructured":"Brewster SA, Clarke CV (2005) The design and evaluation of a sonically enhanced tool palette. ACM Trans Appl Percept 2(4):455\u2013461","journal-title":"ACM Transactions on Applied Perception"},{"key":"909_CR8","doi-asserted-by":"crossref","unstructured":"Bruls M, Huizing K, Wijk JJV (2000) Squarified treemaps. In: Proc. of Eurographics Conference on Visualization, pp 33\u201342","DOI":"10.1007\/978-3-7091-6783-0_4"},{"issue":"387","key":"909_CR9","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1080\/01621459.1984.10478080","volume":"79","author":"WS Cleveland","year":"1984","unstructured":"Cleveland WS, McGILL R (1984) Graphical perception: Theory, experimentation, and application to the development of graphical methods. J Am Stat Assoc 79(387):531\u2013554","journal-title":"Journal of the Americal Statistical Association "},{"key":"909_CR10","unstructured":"Daud\u00e9 S, Nigay L (2003) Design process for auditory interfaces. In: Proc. of International Conference on Auditory Display, pp 176\u2013179"},{"issue":"12","key":"909_CR11","doi-asserted-by":"publisher","first-page":"1933","DOI":"10.1109\/TVCG.2014.2346978","volume":"20","author":"\u00c7 Demiralp","year":"2014","unstructured":"Demiralp \u00c7, Bernstein MS, Heer J (2014) Learning perceptual kernels for visualization design.  IEEE Trans Vis Comput Graph 20(12):1933\u20131942","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"issue":"1","key":"909_CR12","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/MCG.2014.18","volume":"34","author":"\u00c7 Demiralp","year":"2014","unstructured":"Demiralp \u00c7, Scheidegger CE, Kindlmann GL, Laidlaw DH, Heer J (2014) Visual embedding: a model for visualization. IEEE Comput Graph Appl 34(1):10\u201315","journal-title":"IEEE Computer Graphics & Applications"},{"key":"909_CR13","doi-asserted-by":"crossref","unstructured":"Du M, Chou JK, Ma C, Chandrasegaran S, Ma KL (2018) Exploring the role of sound in augmenting visualization to enhance user engagement. In: Proc. of IEEE Pacific Visualization Symposium, pp 225\u2013\n229","DOI":"10.1109\/PacificVis.2018.00036"},{"issue":"12","key":"909_CR14","doi-asserted-by":"publisher","first-page":"e82491","DOI":"10.1371\/journal.pone.0082491","volume":"8","author":"G Dubus","year":"2013","unstructured":"Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PloS ONE 8(12):e82491","journal-title":"PloS ONE"},{"key":"909_CR15","unstructured":"Enge K, Rind A, Iber M, H\u00a8oldrich R, Aigner W (2022) Towards multimodal exploratory data analysis: Soniscope as a prototypical implementation. In: Proc. of Eurographics Conference on Visualization-Short Papers, pp 67\u201371"},{"issue":"5","key":"909_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1167\/7.5.7","volume":"7","author":"MO Ernst","year":"2007","unstructured":"Ernst MO (2007) Learning to integrate arbitrary signals from vision and touch. J Vis 7(5):1\u201314","journal-title":"Journal of Vision"},{"issue":"1","key":"909_CR17","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1167\/10.1.6","volume":"10","author":"KK Evans","year":"2010","unstructured":"Evans KK, Treisman A (2010) Natural cross-modal mappings between visual and auditory features. J Vis 10(1):6","journal-title":"Journal of Vision"},{"key":"909_CR18","doi-asserted-by":"crossref","unstructured":"Ferguson J, Brewster SA (2018) Investigating perceptual congruence between data and display dimensions in sonification.  In: Proc. of ACM CHI Conference on Human Factors in Computing Systems, pp 1\u20139","DOI":"10.1145\/3173574.3174185"},{"key":"909_CR19","unstructured":"Flowers JH (2005) Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. In:Proc. of International Conference on Auditory Display, pp 406\u2013409"},{"key":"909_CR20","unstructured":"Franklin KM, Roberts JC (2003) Pie chart sonification. In: Proc. of International Conference on Information Visualisation, pp 4\u20139"},{"issue":"4","key":"909_CR21","doi-asserted-by":"publisher","first-page":"1447","DOI":"10.1109\/TVCG.2018.2793698","volume":"24","author":"S Ghosh","year":"2018","unstructured":"Ghosh S, Winston L, Panchal N, Kimura-Thollander P, Hotnog J, Cheong D, Reyes G, Abowd GD (2018) Notifivr: exploring interruptions and notifications in virtual reality. IEEE Trans Vis Comput Graph 24(4):1447\u20131456","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"issue":"2","key":"909_CR22","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.visinf.2022.03.001","volume":"6","author":"L Giovannangeli","year":"2022","unstructured":"Giovannangeli L, Bourqui R, Giot R, Auber D (2022) Color and shape efficiency for outlier detection from automated to user evaluation. Vis Inform 6(2):25\u201340","journal-title":"Visual Informatics "},{"issue":"1","key":"909_CR23","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1109\/TVCG.2018.2865077","volume":"25","author":"A Gogolou","year":"2019","unstructured":"Gogolou A, Tsandilas T, Bezerianos P, Bezerianos A (2019) Comparing similarity perception in time series visualizations. IEEE Trans Vis Comput Graph 25(1):523\u2013533","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"909_CR24","doi-asserted-by":"crossref","unstructured":"Han YC, Surve P (2019) Eyes: Iris sonification and interactive biometric art.  In: Proc. of ACM CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp 1\u20134","DOI":"10.1145\/3290607.3313288"},{"key":"909_CR25","doi-asserted-by":"crossref","unstructured":"Hansen B, Baltaxe-Admony LB, Kurniawan S, Forbes AG (2019) Exploring sonic parameter mapping for network data structures. In: Proc. of International Conference on Auditory Display, pp 67\u201374","DOI":"10.21785\/icad2019.055"},{"key":"909_CR26","doi-asserted-by":"crossref","unstructured":"Harada S, Wobbrock JO, Landay JA (2011) Voice games: investigation into the use of non-speech voice input for making computer games more accessible. In: Proc. of IFIP International Conference on Human Computer Interaction, pp 11\u201329","DOI":"10.1007\/978-3-642-23774-4_4"},{"issue":"2","key":"909_CR27","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/S0097-8493(02)00057-2","volume":"26","author":"C Harding","year":"2002","unstructured":"Harding C, Kakadiaris IA, Casey JF, Loftin RB (2002) A multi-sensory system for the investigation of geoscientific data. Elsevier Comput Graph 26(2):259\u2013269","journal-title":"Elsevier Computers & Graphics"},{"issue":"12","key":"909_CR28","doi-asserted-by":"publisher","first-page":"1943","DOI":"10.1109\/TVCG.2014.2346979","volume":"20","author":"L Harrison","year":"2014","unstructured":"Harrison L, Yang F, Franconeri S, Chang R (2014) Ranking visualizations of correlation using weber\u2019s law. IEEE Trans Vis Comput Graph 20(12):1943\u20131952","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"key":"909_CR29","doi-asserted-by":"crossref","unstructured":"Heer J, Bostock M (2010) Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In: Proc. of ACM CHI Conference on Human Factors in Computing Systems Conference on Human Factors in Computing Systems, pp 203\u2013212","DOI":"10.1145\/1753326.1753357"},{"key":"909_CR30","volume-title":"The sonification handbook","author":"T Hermann","year":"2011","unstructured":"Hermann T, Hunt A, Neuhoff JG (2011) The sonification handbook. Logos Verlag Berlin, Germany"},{"key":"909_CR31","doi-asserted-by":"crossref","unstructured":"Hogan T, Hinrichs U, Hornecker E (2017) The visual and beyond: Characterizing experiences with auditory, haptic and visual data representations. In: Proc. of ACM Conference on Designing Interactive Systems, pp 797\u2013809","DOI":"10.1145\/3064663.3064702"},{"issue":"1","key":"909_CR32","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/s12650-022-00871-6","volume":"26","author":"T Itoh","year":"2023","unstructured":"Itoh T, Nakabayashi A, Hagita M (2023) Multidimensional data visualization applying a variety-oriented scatterplot selection technique. J Vis 26(1):199\u2013210","journal-title":"Journal of Visualization "},{"key":"909_CR33","unstructured":"Janata P, Childs E (2004) Marketbuzz: Sonification of real-time financial data. In: Proc. of International Conference on Auditory Display"},{"issue":"2","key":"909_CR34","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1007\/s12650-020-00707-1","volume":"24","author":"Z Jin","year":"2021","unstructured":"Jin Z, Cao N, Shi Y, Wu W, Wu Y (2021) EcoLens: visual analysis of ecological regions in urban contexts using traffic data. J Vis 24(2):349\u2013364","journal-title":"Journal of Visualization"},{"key":"909_CR35","doi-asserted-by":"crossref","unstructured":"Jin Z, Wang X, Cheng F, Sun C, Liu Q, Qu H (2023) ShortcutLens: A visual analytics approach for exploring shortcuts in natural language understanding dataset. IEEE Trans Vis Comput Graph, To appear","DOI":"10.1109\/TVCG.2023.3236380"},{"key":"909_CR36","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1111\/cgf.13905","volume":"39","author":"R Khulusi","year":"2020","unstructured":"Khulusi R, Kusnick J, Meinecke C, Gillmann C, Focht J, J\u00e4nicke S (2020) A survey on visualizations for musical data. Comput Graph Forum 39:82\u2013110","journal-title":"Computer Graphics Forum"},{"issue":"1","key":"909_CR37","doi-asserted-by":"publisher","first-page":"52","DOI":"10.5395\/rde.2013.38.1.52","volume":"38","author":"HY Kim","year":"2013","unstructured":"Kim HY (2013) Statistical notes for clinical researchers: assessing normal distribution (2) using skewness and kurtosis. Restor Dent Endod 38(1):52\u201354","journal-title":"Restorative Dentistry & Endodontics"},{"key":"909_CR38","doi-asserted-by":"crossref","unstructured":"Kim YJ, Kumaran R, Sayyad E, Milner A, Bullock T, Giesbrecht B, H\u00a8ollerer T (2022) Investigating search among physical and virtual objects under different lighting conditions. IEEE Trans. Vis. Comput. Graph 28(11):3788\u20133798","DOI":"10.1109\/TVCG.2022.3203093"},{"issue":"11","key":"909_CR39","doi-asserted-by":"publisher","first-page":"2947","DOI":"10.1109\/TVCG.2018.2868591","volume":"24","author":"K Kim","year":"2018","unstructured":"Kim K, Billinghurst M, Bruder G, Duh HBL, Welch GF (2018) Revisiting trends in augmented reality research: a review of the 2nd decade of ISMAR (2008\u20132017). IEEE Trans. Vis. Comput. Graph 24(11):2947\u20132962","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"issue":"2","key":"909_CR40","first-page":"196","volume":"22","author":"KM Knoeferle","year":"2016","unstructured":"Knoeferle KM, Knoeferle P, Velasco C, Spence C (2016) Multisensory brand search: how the meaning of sounds guides consumers\u2019 visual attention. J. Exp. Psychol  22(2):196","journal-title":"Journal of Experimental Psychology: Applied"},{"key":"909_CR41","doi-asserted-by":"crossref","unstructured":"Kong HK, Zhu W, Liu Z, Karahalios K (2019) Understanding visual cues in visualizations accompanied by audio narrations. In: Proc. of ACM CHI Conference on Human Factors in Computing Systems, pp 1\u201313","DOI":"10.1145\/3290605.3300280"},{"key":"909_CR42","doi-asserted-by":"crossref","unstructured":"Krygier JB (1994) Sound and geographic visualization. Modern Cartography Series 2:149\u2013166","DOI":"10.1016\/B978-0-08-042415-6.50015-6"},{"key":"909_CR43","doi-asserted-by":"crossref","unstructured":"Kwok TC, Kiefer P, Schinazi VR, Adams B, Raubal M (2019) Gaze-guided narratives: adapting audio guide content to gaze in virtual and real environments.  In: Proc. of ACM CHI Conference on Human Factors in Computing Systems, pp 1\u201312","DOI":"10.1145\/3290605.3300721"},{"issue":"1","key":"909_CR44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12650-021-00773-z","volume":"25","author":"J Lan","year":"2022","unstructured":"Lan J, Wang J, Shu X, Zhou Z, Zhang H, Wu Y (2022) RallyComparator: visual comparison of the multivariate and spatial stroke sequence in table tennis rally. J Vis 25(1):1\u201316","journal-title":"Journal of Visualization "},{"issue":"9","key":"909_CR45","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.3390\/electronics10091037","volume":"10","author":"Y Lee","year":"2021","unstructured":"Lee Y, Lee CH, Cho JD (2021) 3d sound coding color for the visually impaired. Electronics 10(9):1037","journal-title":"Electronics"},{"issue":"1","key":"909_CR46","first-page":"249","volume":"26","author":"D Limberger","year":"2023","unstructured":"Limberger D, Scheibel W, D\u00a8ollner J, Trapp M (2023) Visual variables and configuration of software maps. J Vis 26(1):249\u2013274","journal-title":"Journal of Visualization  "},{"key":"909_CR47","unstructured":"Lipscomb SD, Kim EM (2004) Perceived match between visual parameters and auditory correlates. In: Proc. of International Conference on Music Perception and Cognition, pp 72\u201375"},{"issue":"2","key":"909_CR48","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1145\/22949.22950","volume":"5","author":"J Mackinlay","year":"1986","unstructured":"Mackinlay J (1986) Automating the design of graphical presentations of relational information. ACM Trans Graph 5(2):110\u2013141","journal-title":"ACM Transactions on Graphics"},{"key":"909_CR49","doi-asserted-by":"crossref","unstructured":"Mansoor H, Gerych W, Alajaji A, Buquicchio L, Chandrasekaran K, Agu E, Rundensteiner E, Rodriguez AI (2023) INPHOVIS: Interactive visual analytics for smartphone-based digital phenotyping. Vis Inform, To appear","DOI":"10.1016\/j.visinf.2023.01.002"},{"key":"909_CR50","doi-asserted-by":"crossref","unstructured":"McCormack J, Roberts JC, Bach B, Freitas CDS, Itoh T, Hurter C, Marriott K (2018) Multisensory immersive analytics. In: Immersive analytics, Springer, pp 57\u201394","DOI":"10.1007\/978-3-030-01388-2_3"},{"key":"909_CR51","doi-asserted-by":"crossref","unstructured":"Metatla O, Correia NN, Martin F, Bryan-Kinns N, Stockman T (2016) Tap the ShapeTones: Exploring the effects of crossmodal congruence in an audio-visual interface.  In: Proc. of ACM CHI Conference on Human Factors in Computing Systems, pp 1055\u20131066","DOI":"10.1145\/2858036.2858456"},{"key":"909_CR52","doi-asserted-by":"publisher","DOI":"10.1201\/b17511","volume-title":"Visualization analysis and design","author":"T Munzner","year":"2014","unstructured":"Munzner T (2014) Visualization analysis and design. CRC Press, Boca Raton, FL"},{"key":"909_CR53","unstructured":"Ness RS, Reimer P, Krell N, Odowichuck G, Schloss WA, Tzanetakis G (2010) Sonophenology: a tangible interface for sonification of geo-spatial phenological data at multiple time-scales. In: Proc. of International Conference on Auditory Display, pp 335\u2013341"},{"issue":"1","key":"909_CR54","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1177\/1557234X11410396","volume":"7","author":"MA Nees","year":"2011","unstructured":"Nees MA, Walker BN (2011) Auditory displays for in-vehicle technologies. Rev Hum Factors Ergon 7(1):58\u201399","journal-title":"Reviews of Human Factors and Ergonomics"},{"key":"909_CR55","unstructured":"Nesbitt KV, Barrass S (2002) Evaluation of a multimodal sonification and visualization of depth of market stock data. In: Proc. of International Conference on Auditory Display, pp 1\u20136"},{"issue":"1","key":"909_CR56","first-page":"17","volume":"8","author":"JG Neuhoff","year":"2002","unstructured":"Neuhoff JG, Wayand J, Kramer G (2002) Pitch and loudness interact in auditory displays: Can the data get lost in the map? J Exp Psychol Appl 8(1):17\u201325","journal-title":"Journal of Experimental Psychology: Applied"},{"key":"909_CR57","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1016\/j.neucom.2020.10.053","volume":"423","author":"H Ning","year":"2021","unstructured":"Ning H, Zheng X, Yuan Y, Lu X (2021) Audio description from image by modal translation network. Neurocomputing 423:124\u2013134","journal-title":"Neurocomputing"},{"issue":"1","key":"909_CR58","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1109\/TVCG.2018.2864884","volume":"25","author":"B Ondov","year":"2019","unstructured":"Ondov B, Jardine N, Elmqvist N, Franconeri S (2019) Face to face: evaluating visual comparison. IEEE Trans Vis Comput Graph 25(1):861\u2013871","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"909_CR59","doi-asserted-by":"crossref","unstructured":"Papachristodoulou P, Betella A, Manzolli J (2015) Augmenting the navigation of complex data sets using sonification: A case study with brainx 3. In: Proc. of IEEE VR Workshop: Sonic Interaction in Virtual Environments, pp 1\u20136","DOI":"10.1109\/SIVE.2015.7361284"},{"key":"909_CR60","doi-asserted-by":"crossref","unstructured":"Parise C, Spence C (2013) Audiovisual cross-modal correspondences in the general population. The Oxford handbook of synaesthesia 790:815","DOI":"10.1093\/oxfordhb\/9780199603329.013.0039"},{"issue":"4","key":"909_CR61","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1109\/TVCG.2013.26","volume":"19","author":"Z Ren","year":"2013","unstructured":"Ren Z, Yeh H, Klatzky R, Lin MC (2013) Auditory perception of geometry-invariant material properties. IEEE Trans Vis Comput Graph 19(4):557\u2013566","journal-title":"IEEE Transactions and Computer Graphics "},{"key":"909_CR62","unstructured":"Rind A, Iber M, Aigner W (2018) Bridging the gap between sonification and visualization. In: Proc. of AVI Workshop on Multimodal Interaction for Data Visualization"},{"key":"909_CR63","unstructured":"Rogi\u0144ska A, Friedman K, Mohanraj H (2013) Exploring sonification for augmenting brain scan data. In: Proc. of International Conference on Auditory Display, pp 95\u2013105"},{"issue":"10","key":"909_CR64","doi-asserted-by":"publisher","first-page":"1028","DOI":"10.1080\/0144929X.2019.1657952","volume":"38","author":"N R\u00f6nnberg","year":"2019","unstructured":"R\u00f6nnberg N (2019) Musical sonification supports visual discrimination of color intensity.  Behav Inform Technol 38(10):1028\u20131037","journal-title":"Behaviour & Information Technology"},{"issue":"11","key":"909_CR65","doi-asserted-by":"publisher","first-page":"2366","DOI":"10.1109\/TVCG.2017.2734327","volume":"23","author":"H Roodaki","year":"2017","unstructured":"Roodaki H, Navab N, Eslami A, Stapleton C, Navab N (2017) Sonifeye: Sonification of visual information using physical modeling sound synthesis. IEEE Trans Vis Comput Graph 23(11):2366\u20132371","journal-title":"IEEE Transactions and Visualization and Computer Graphics"},{"key":"909_CR66","unstructured":"Rouben A, Terveen L (2007) Speech and non-speech audio: Navigational information and cognitive load. In: Proc. of International Conference on Auditory Display, pp 468\u2013475"},{"issue":"2","key":"909_CR67","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1007\/s12650-020-00705-3","volume":"24","author":"S Rubab","year":"2021","unstructured":"Rubab S, Tang J, Wu Y (2021) Examining interaction techniques in data visualization authoring tools from the perspective of goals and human cognition: a survey. J Vis 24(2):397\u2013418","journal-title":"Journal of Visualization"},{"issue":"7","key":"909_CR68","doi-asserted-by":"publisher","first-page":"2505","DOI":"10.1109\/TVCG.2018.2829750","volume":"25","author":"B Saket","year":"2019","unstructured":"Saket B, Endert A, Demiralp C (2019) Task-based effectiveness of basic visualizations. IEEE Trans Vis Comput Graph 25(7):2505\u20132512","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"issue":"18","key":"909_CR69","first-page":"2745","volume":"15","author":"D Sanabria","year":"2004","unstructured":"Sanabria D, Soto-Faraco S, Spence C (2004) Exploring the role of visual perceptual grouping on the audiovisual integration of motion. Neuroreport 15(18):2745\u20132749","journal-title":"Neuroreport"},{"key":"909_CR70","doi-asserted-by":"publisher","first-page":"46","DOI":"10.3389\/fcomm.2020.00046","volume":"5","author":"N Sawe","year":"2020","unstructured":"Sawe N, Chafe C, Trevi\u00f1o J (2020) Using data sonification to overcome science literacy, numeracy, and visualization barriers in science communication. Front comm 5:46","journal-title":"Frontiers and Communication"},{"issue":"2","key":"909_CR71","doi-asserted-by":"publisher","first-page":"597","DOI":"10.22237\/jmasm\/1257035100","volume":"8","author":"SS Sawilowsky","year":"2009","unstructured":"Sawilowsky SS (2009) New effect size rules of thumb. J Mod Appl Stat Methods 8(2):597\u2013599","journal-title":"Journal of Modern Applied Statistical Methods"},{"issue":"5","key":"909_CR72","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1080\/13658816.2017.1420192","volume":"32","author":"J Schito","year":"2018","unstructured":"Schito J, Fabrikant SI (2018) Exploring maps by sounds: using parameter mapping sonification to make digital elevation models audible.  Int J Geogr Inf Sci 32(5):874\u2013906","journal-title":"International Journal of Geographical Information Science"},{"key":"909_CR73","unstructured":"Shenkar O, Weiss PL, Algom D (2005) Auditory representation of visual stimuli: Mapping versus association. In: Proc. of International Conference on Auditory Display, pp 273\u2013275"},{"issue":"3","key":"909_CR74","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1111\/cgf.12888","volume":"35","author":"D Skau","year":"2016","unstructured":"Skau D, Kosara R (2016) Arcs, angles, or areas: individual data encodings in pie and donut charts. Comput Graph Forum 35(3):121\u2013130","journal-title":"Computer Graphics Forum"},{"issue":"8","key":"909_CR75","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1002\/acp.1146","volume":"19","author":"DR Smith","year":"2005","unstructured":"Smith DR, Walker BN (2005) Effects of auditory context cues and training on performance of a point estimation sonification task. Appl Cogn Psychol 19(8):1065\u20131087","journal-title":"Applied Cognitive Psychology"},{"issue":"2","key":"909_CR76","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1250\/ast.28.61","volume":"28","author":"C Spence","year":"2007","unstructured":"Spence C (2007) Audiovisual multisensory integration. Acoust Sci Technol 28(2):61\u201370","journal-title":"Acoustical Science and Technology"},{"issue":"4","key":"909_CR77","doi-asserted-by":"publisher","first-page":"971","DOI":"10.3758\/s13414-010-0073-7","volume":"73","author":"C Spence","year":"2011","unstructured":"Spence C (2011) Crossmodal correspondences: a tutorial review. Atten Percept Psychophys 73(4):971\u2013995","journal-title":"Attention, Perception, & Psychophysics"},{"issue":"1","key":"909_CR78","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1250\/ast.41.6","volume":"41","author":"C Spence","year":"2020","unstructured":"Spence C (2020) Simple and complex crossmodal correspondences involving audition.  Acoust Sci Technol 41(1):6\u201312","journal-title":"Acoustical Science and Technology"},{"issue":"4","key":"909_CR79","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.visinf.2021.12.005","volume":"5","author":"C Su","year":"2021","unstructured":"Su C, Yang C, Chen Y, Wang F, Wang F, Wu Y, Zhang X (2021) Natural multimodal interaction in immersive flow visualization. Vis Inform 5(4):56\u201366","journal-title":"Visual Informatics "},{"key":"909_CR80","doi-asserted-by":"publisher","first-page":"e4443","DOI":"10.7717\/peerj.4443","volume":"6","author":"X Sun","year":"2018","unstructured":"Sun X, Li X, Ji L, Han F, Wang H, Liu Y, Chen Y, Lou Z, Li Z (2018) An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics. PeerJ 6:e4443","journal-title":"PeerJ"},{"issue":"1","key":"909_CR81","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1109\/TVCG.2018.2864899","volume":"25","author":"T Tang","year":"2019","unstructured":"Tang T, Rubab S, Lai J, Cui W, Yu L, Wu Y (2019) iStoryline: effective convergence to hand-drawn storylines. IEEE Trans Vis Comput Graph 25(1):769\u2013778","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"issue":"5","key":"909_CR82","doi-asserted-by":"publisher","first-page":"1991","DOI":"10.1109\/TVCG.2020.2973058","volume":"26","author":"Z Tang","year":"2020","unstructured":"Tang Z, Bryan NJ, Li D, Langlois TR, Manocha D (2020) Scene-aware audio rendering via deep acoustic analysis. IEEE Trans Vis Comput Graph 26(5):1991\u20132001","journal-title":"IEEE Transcations on Visualization and Computer Graphics "},{"key":"909_CR83","unstructured":"Tsiros A (2014) Evaluating the perceived similarity between audio-visual features using corpus-based concatenative synthesis. In: Proc. of International Conference on New Interfaces for Musical Expression, pp 421\u2013426"},{"key":"909_CR84","unstructured":"Tsuchiya T, Freeman J, Lerner LW (2016) Data-driven live coding with datatomusic api"},{"issue":"2","key":"909_CR85","doi-asserted-by":"publisher","first-page":"270","DOI":"10.3758\/BF03204779","volume":"28","author":"KD Turnage","year":"1996","unstructured":"Turnage KD, Bonebright TL, Buhman DC, Flowers JH (1996) The effects of task demands on the equivalence of visual and auditory representations of periodic numerical data. Behav res meth instrum comput 28(2):270\u2013274","journal-title":"Behavior Research Methods, Instruments, & Computers"},{"key":"909_CR86","doi-asserted-by":"crossref","unstructured":"Wang J, Cai X, Su J, Liao Y, Wu Y (2022a) What makes a scatterplot hard to comprehend: data size and pattern salience matter. J Vis 25(1):59\u201375","DOI":"10.1007\/s12650-021-00778-8"},{"issue":"1","key":"909_CR87","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.visinf.2022.02.003","volume":"6","author":"L Wang","year":"2022","unstructured":"Wang L, Sun G, Wang Y, Ma J, Zhao X, Liang R (2022b) AFExplorer: Visual analysis and interactive selection of audio features. Vis Inform 6(1):47\u201355","journal-title":"Visual Informatics "},{"issue":"5","key":"909_CR88","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1002\/acp.1291","volume":"21","author":"BN Walker","year":"2007","unstructured":"Walker BN (2007) Consistency of magnitude estimations with conceptual data dimensions used for sonification. Appl Cogn Psychol 21(5):579\u2013599","journal-title":"Applied Cognitive Psychology"},{"key":"909_CR89","doi-asserted-by":"crossref","unstructured":"Wan CH, Chuang SP, Lee HY (2019) Towards audio to scene image synthesis using generative adversarial network.  In: Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp 496\u2013500","DOI":"10.1109\/ICASSP.2019.8682383"},{"issue":"1","key":"909_CR90","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1109\/TVCG.2018.2864912","volume":"25","author":"Y Wang","year":"2019","unstructured":"Wang Y, Chen X, Ge T, Bao C, Sedlmair M, Fu CW, Deussen O, Chen B (2019) Optimizing color assignment for perception of class separability in multiclass scatterplots. IEEE Trans Vis Comput Graph 25(1):820\u2013829","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"12","key":"909_CR91","doi-asserted-by":"publisher","first-page":"3457","DOI":"10.1109\/TVCG.2020.3023573","volume":"26","author":"X Wen","year":"2020","unstructured":"Wen X, Wang M, Richardt C, Chen ZY, Hu SM (2020) Photorealistic audio-driven video portraits. IEEE Trans Vis Comput Graph 26(12):3457\u20133466","journal-title":"IEEE Transactions on Visualization and Computer Graphics "},{"key":"909_CR92","volume-title":"Human auditory development","author":"L Werner","year":"2011","unstructured":"Werner L, Fay RR, Popper AN (2011) Human auditory development, vol 42. Springer, Newyork"},{"key":"909_CR93","unstructured":"Wers\u00e9nyi G, Nagy H, Csap\u00f3 A (2015) Evaluation of reaction times to sound stimuli on mobile devices. In: Proc. of International Conference on Auditory Display, pp 268\u2013272"},{"key":"909_CR94","doi-asserted-by":"crossref","unstructured":"Wilson SR (1982) Sound and exploratory data analysis. In: COMPSTAT symposium, Springer, pp 447\u2013450","DOI":"10.1007\/978-3-642-51461-6_69"},{"key":"909_CR95","doi-asserted-by":"crossref","unstructured":"Xia H, Araujo B, Grossman T, Wigdor D (2016) Object-oriented drawing.  In: Proc. of ACM CHI Conference on Human Factors in Computing Systems, pp 4610\u20134621","DOI":"10.1145\/2858036.2858075"},{"issue":"9","key":"909_CR96","doi-asserted-by":"publisher","first-page":"703","DOI":"10.17743\/jaes.2018.0042","volume":"66","author":"J Yang","year":"2018","unstructured":"Yang J, Hermann T (2018) Interactive mode explorer sonification enhances exploratory cluster analysis. AES: J Audio Eng Soc 66(9):703\u2013711","journal-title":"Journal of the Audio Engineering Society"},{"issue":"7","key":"909_CR97","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1021\/ac50057a028","volume":"52","author":"ES Yeung","year":"1980","unstructured":"Yeung ES (1980) Pattern recognition by audio representation of multivariate analytical data. Anal Chem 52(7):1120\u20131123","journal-title":"Analytical Chemistry"},{"issue":"6","key":"909_CR98","doi-asserted-by":"publisher","first-page":"1073","DOI":"10.3758\/BF03201236","volume":"27","author":"J Zacks","year":"1999","unstructured":"Zacks J, Tversky B (1999) Bars and lines: a study of graphic communication. Memory Cogn 27(6):1073\u20131079","journal-title":"Memory & Cognition"},{"key":"909_CR99","doi-asserted-by":"crossref","unstructured":"Zhou Y, Meng X, Wu Y, Tang T, Wang Y, Wu Y (2022) An intelligent approach to automatically discovering visual insights. J Vis, To appear","DOI":"10.1007\/s12650-022-00894-z"},{"issue":"1","key":"909_CR100","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.visinf.2022.03.002","volume":"6","author":"Y Zhao","year":"2022","unstructured":"Zhao Y, Jiang J, Chen Y, Liu R, Yang Y, Xue X, Chen S (2022) Metaverse: Perspectives from graphics, interactions and visualization. Vis Inform 6(1):56\u201367","journal-title":"Visual Informatics "},{"key":"909_CR101","doi-asserted-by":"crossref","unstructured":"Ziemer T, Schultheis H (2018) A psychoacoustic auditory display for navigation. In: Proc. of International Conference on Auditory Display, pp 136\u2013144","DOI":"10.21785\/icad2018.007"},{"key":"909_CR102","unstructured":"Zhao H, Plaisant C, Shneiderman B, Duraiswami R (2004) Sonification of geo-referenced data for auditory information seeking: Design principle and pilot study. In: Proc. of International Conference on Auditory Display, pp 1\u20138"}],"container-title":["Journal of Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12650-023-00909-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12650-023-00909-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12650-023-00909-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T09:11:12Z","timestamp":1686733872000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12650-023-00909-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,10]]},"references-count":102,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["909"],"URL":"https:\/\/doi.org\/10.1007\/s12650-023-00909-3","relation":{},"ISSN":["1343-8875","1875-8975"],"issn-type":[{"value":"1343-8875","type":"print"},{"value":"1875-8975","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,10]]},"assertion":[{"value":"28 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 January 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 April 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}