{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T18:16:41Z","timestamp":1776968201153,"version":"3.51.4"},"reference-count":30,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003406","name":"Tekes","doi-asserted-by":"publisher","award":["40296\/14"],"award-info":[{"award-number":["40296\/14"]}],"id":[{"id":"10.13039\/501100003406","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Big Data"],"abstract":"<jats:p>The process of transforming data into sounds for auditory display provides unique user experiences and new perspectives for analyzing and interpreting data. A research study for data transformation to sounds based on musical elements, called data-to-music sonification, reveals how musical characteristics can serve analytical purposes with enhanced user engagement. An existing user engagement scale has been applied to measure engagement levels in three conditions within melodic, rhythmic, and chordal contexts. This article reports findings from a user engagement study with musical traits and states the benefits and challenges of using musical characteristics in sonifications. The results can guide the design of future sonifications of multivariable data.<\/jats:p>","DOI":"10.3389\/fdata.2023.1206081","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T11:44:21Z","timestamp":1691667861000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Data-to-music sonification and user engagement"],"prefix":"10.3389","volume":"6","author":[{"given":"Jonathan","family":"Middleton","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaakko","family":"Hakulinen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katariina","family":"Tiitinen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juho","family":"Hella","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tuuli","family":"Keskinen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pertti","family":"Huuskonen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Culver","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juhani","family":"Linna","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markku","family":"Turunen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mounia","family":"Ziat","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roope","family":"Raisamo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"B1","volume-title":"Harmony and Voice Leading.","author":"Aldwell","year":"2011"},{"key":"B2","article-title":"Who's sonifying data and how are they doing it? A comparison of ICAD and other venues since 2009","volume-title":"Proceedings of the 18th International Conference of Auditory Display (ICAD)","author":"Bearman","year":"2012"},{"key":"B3","doi-asserted-by":"publisher","first-page":"e0190322","DOI":"10.1371\/journal.pone.0190322","article-title":"What makes a rhythm complex? The influence of musical training and accent type on beat perception","volume":"13","author":"Bouwer","year":"2018","journal-title":"PLoS ONE"},{"key":"B4","first-page":"223","article-title":"Non-Speech auditory output","volume-title":"Human Computer Interaction Handbook: Fundamentals","author":"Brewster","year":"2009"},{"key":"B5","article-title":"Design guidelines for audio presentation of graphs and tables","volume-title":"Proceedings of the 9th International Conference of Auditory Display (ICAD)","author":"Brown","year":"2003"},{"key":"B6","doi-asserted-by":"publisher","first-page":"e00175","DOI":"10.1016\/j.heliyon.2016.e00175","article-title":"Melody discrimination and protein fold classification","volume":"2","author":"Bywater","year":"2016","journal-title":"Heliyon"},{"key":"B7","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1068\/p3370","article-title":"The formation of rhythmic categories and metric priming","volume":"32","author":"Desain","year":"2003","journal-title":"Perception"},{"key":"B8","first-page":"21","article-title":"Information interactions: Bridging disciplines in the creation of new technologies","volume-title":"the Human-Computer Interaction and Management Information Systems: Foundations","author":"Dillon","year":"2006"},{"key":"B9","volume-title":"The Sonification Handbook.","author":"Hermann","year":"2011"},{"key":"B10","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.ijhcs.2016.06.002","article-title":"Continuous sonification enhances adequacy of interactions in peripheral process monitoring","volume":"95","author":"Hildebrandt","year":"2016","journal-title":"Int. J. Hum-Comput. Stud."},{"key":"B11","unstructured":"KramerG.\n            WalkerB.\n            BonebrightT.\n          International Community for Auditory Display Conferences, ICAD Conferences1999"},{"key":"B12","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/s11145-014-9523-2","article-title":"Comparing relations of motivation, engagement, and achievement among struggling and advance adolescent readers","volume":"28","author":"Lutz Klauda","year":"2015","journal-title":"Read Writ"},{"key":"B13","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/B978-0-12-381460-9.00002-X","article-title":"Musical timbre perception","volume-title":"the Psychology of Music","author":"McAdams","year":"2013"},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.1145\/1015530.1015549","volume-title":"Technology as Experience.","author":"McCarthy","year":"2004"},{"key":"B15","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1162\/leon.2008.41.2.128","article-title":"Web-based algorithmic composition from extramusical resources","volume":"41","author":"Middleton","year":"2008","journal-title":"Leonardo"},{"key":"B16","doi-asserted-by":"crossref","DOI":"10.21785\/icad2018.006","article-title":"Sonification with musical characteristics: a path guided by user-engagement","volume-title":"Proceedings of the 24th International Conference of Auditory Display","author":"Middleton","year":"2018"},{"key":"B17","first-page":"63","article-title":"Perception, cognition and action in auditory displays","volume-title":"The Sonification Handbook","author":"Neuhoff","year":"2011"},{"key":"B18","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1207\/s15327051hci1904_1","article-title":"Introduction to this special section on beauty, goodness, and usability","volume":"19","author":"Norman","year":"2004","journal-title":"Hum. Comput. Interact."},{"key":"B19","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.ijhcs.2018.01.004","article-title":"A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form","volume":"112","author":"O'Brien","year":"2018","journal-title":"Int. J. of Hum- Comput. Stud."},{"key":"B20","doi-asserted-by":"publisher","first-page":"938","DOI":"10.1002\/asi.20801","article-title":"What is user engagement? A conceptual framework for defining user engagement with technology","volume":"59","author":"O'Brien","year":"2008","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"B21","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1002\/asi.21229","article-title":"The development and evaluation of a survey to measure user engagement","volume":"61","author":"O'Brien","year":"2010","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"B22","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1121\/1.1907300","article-title":"Information of elementary multidimensional auditory displays","volume":"26","author":"Pollack","year":"1954","journal-title":"J. Acoust. Soc. Am."},{"key":"B23","first-page":"330","article-title":"Aesthetics in information technology: Motivation and future research directions","volume-title":"the Human-Computer Interaction and Management Information Systems: Foundations","author":"Tractinsky","year":"2006"},{"key":"B24","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/S0953-5438(00)00031-X","article-title":"What is beautiful is usable","volume":"13","author":"Tractinsky","year":"2000","journal-title":"Interact. Comput."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1596","DOI":"10.1016\/j.chb.2012.03.024","article-title":"Is beautiful usable? Toward understanding the relation between usability, aesthetics, and affect in HCI","volume":"28","author":"Tuch","year":"2012","journal-title":"Comput. Hum. Behav."},{"key":"B26","first-page":"135","article-title":"Sonification and music, music and sonification","volume-title":"The Routledge Companion to Sounding Art","author":"Vickers","year":"2017"},{"key":"B27","doi-asserted-by":"crossref","first-page":"89","DOI":"10.4324\/9781315569628-6","article-title":"Aesthetics of sonification: Taking the subject- position","volume-title":"the Body, Sound and Space in Music and Beyond: Multimodal Explorations","author":"Vickers","year":"2017"},{"key":"B28","first-page":"9","article-title":"Theory of sonification","volume-title":"The Sonification Handbook","author":"Walker","year":"2011"},{"key":"B29","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1145\/1101530.1101534","article-title":"Mappings and metaphors in auditory displays: An experiment assessment","volume":"2","author":"Walker","year":"2005","journal-title":"ACM Trans. Appl. Percept."},{"key":"B30","doi-asserted-by":"publisher","first-page":"661","DOI":"10.2307\/25148744","article-title":"Enhancing the design of Web navigation systems: The influence of user disorientation on engagement and performance","volume":"30","author":"Webster","year":"2006","journal-title":"MIS Q."}],"container-title":["Frontiers in Big Data"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2023.1206081\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T11:44:42Z","timestamp":1691667882000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2023.1206081\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":30,"alternative-id":["10.3389\/fdata.2023.1206081"],"URL":"https:\/\/doi.org\/10.3389\/fdata.2023.1206081","relation":{},"ISSN":["2624-909X"],"issn-type":[{"value":"2624-909X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,10]]},"article-number":"1206081"}}