{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T18:15:26Z","timestamp":1772302526322,"version":"3.50.1"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,3,6]],"date-time":"2024-03-06T00:00:00Z","timestamp":1709683200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,6]],"date-time":"2024-03-06T00:00:00Z","timestamp":1709683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004233","name":"Universitat Polit\u00e8cnica de Val\u00e8ncia","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004233","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Virtual Reality"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This work presents the development of a mixed reality (MR) application that uses color Passthrough for learning to play the piano. A study was carried out to compare the interpretation outcomes of the participants and their subjective experience when using the MR application developed to learn to play the piano with a system that used Synthesia (<jats:italic>N<\/jats:italic>\u2009=\u200933). The results show that the MR application and Synthesia were effective in learning piano. However, the students played the pieces significantly better when using the MR application. The two applications both provided a satisfying user experience. However, the subjective experience of the students was better when they used the MR application. Other conclusions derived from the study include the following: (1) The outcomes of the students and their subjective opinion about the experience when using the MR application were independent of age and gender; (2) the sense of presence offered by the MR application was high (above 6 on a scale of 1 to 7); (3) the adverse effects induced by wearing the Meta Quest Pro and using our MR application were negligible; and (4) the students showed their preference for the MR application. As a conclusion, the advantage of our MR application compared to other types of applications (e.g., non-projected piano roll notation) is that the user has a direct view of the piano and the help elements appear integrated in the user\u2019s view. The user does not have to take their eyes off the keyboard and is focused on playing the piano.<\/jats:p>","DOI":"10.1007\/s10055-024-00953-w","type":"journal-article","created":{"date-parts":[[2024,3,6]],"date-time":"2024-03-06T07:02:27Z","timestamp":1709708547000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A color Passthrough mixed reality application for learning piano"],"prefix":"10.1007","volume":"28","author":[{"given":"Mariano","family":"Banquiero","sequence":"first","affiliation":[]},{"given":"Gracia","family":"Valdeolivas","sequence":"additional","affiliation":[]},{"given":"David","family":"Ram\u00f3n","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8764-1470","authenticated-orcid":false,"given":"M.-Carmen","family":"Juan","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,3,6]]},"reference":[{"key":"953_CR1","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/MMUL.2022.3232892","volume":"30","author":"M Banquiero","year":"2023","unstructured":"Banquiero M, Valdeolivas G, Trincado S et al (2023) Passthrough mixed reality with Oculus Quest 2: a case study on learning piano. IEEE Multimed 30:60\u201369. https:\/\/doi.org\/10.1109\/MMUL.2022.3232892","journal-title":"IEEE Multimed"},{"key":"953_CR2","doi-asserted-by":"crossref","unstructured":"Bimberg P, Weissker T, Kulik A (2020) On the usage of the simulator sickness questionnaire for virtual reality research. In: 2020 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW), pp 464\u2013467","DOI":"10.1109\/VRW50115.2020.00098"},{"key":"953_CR3","doi-asserted-by":"crossref","unstructured":"Birhanu A, Rank S (2017) KeynVision: exploring piano pedagogy in mixed reality. In: Extended abstracts publication of the annual symposium on computer-human interaction in play. Association for Computing Machinery, New York, NY, USA, pp 299\u2013304","DOI":"10.1145\/3130859.3131336"},{"key":"953_CR4","doi-asserted-by":"crossref","unstructured":"C\u00e1rdenas-Delgado S, Juan MC, M\u00e9ndez-L\u00f3pez M, P\u00e9rez-Hern\u00e1ndez E (2017) Could people with stereo-deficiencies have a rich 3D experience using HMDs? In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), pp 97\u2013116","DOI":"10.1007\/978-3-319-67744-6_7"},{"key":"953_CR5","unstructured":"Chow J, Feng H, Amor R, W\u00fcnsche BC (2013) Music education using augmented reality with a head mounted display. In: Proceedings of the fourteenth australasian user interface conference, vol 139. Australian Computer Society, Inc., AUS, pp 73\u201379"},{"key":"953_CR6","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1006\/imms.1993.1022","volume":"38","author":"FD Davis","year":"1993","unstructured":"Davis FD (1993) User acceptance of information technology: system characteristics, user perceptions and behavioral impacts. Int J Man Mach Stud 38:475\u2013487. https:\/\/doi.org\/10.1006\/imms.1993.1022","journal-title":"Int J Man Mach Stud"},{"key":"953_CR7","doi-asserted-by":"publisher","DOI":"10.1145\/3567719","author":"JA Deja","year":"2022","unstructured":"Deja JA, Mayer S, \u010copi\u010d Pucihar K, Kljun M (2022) A Survey of augmented piano prototypes: Has augmentation improved learning experiences? Proc ACM Hum Comput Interact. https:\/\/doi.org\/10.1145\/3567719","journal-title":"Proc ACM Hum Comput Interact"},{"key":"953_CR8","doi-asserted-by":"crossref","unstructured":"Desnoyers-Stewart J, Gerhard D, Smith M (2017) Mixed reality MIDI keyboard. In: 13th International symposium on CMMR, pp 376\u2013386","DOI":"10.1145\/3123514.3123560"},{"key":"953_CR9","unstructured":"Hackl D, Anthes C (2017) HoloKeys\u2014an augmented reality application for learning the piano. In: CEUR workshop, pp 140\u2013144"},{"key":"953_CR10","doi-asserted-by":"crossref","unstructured":"Huang F, Zhou Y, Yu Y et al (2011) Piano AR: a markerless augmented reality based piano teaching system. In: 2011 Third international conference on intelligent human-machine systems and cybernetics, pp 47\u201352","DOI":"10.1109\/IHMSC.2011.82"},{"key":"953_CR11","doi-asserted-by":"publisher","first-page":"12040","DOI":"10.1088\/1742-6596\/1318\/1\/012040","volume":"1318","author":"J Julia","year":"2019","unstructured":"Julia J, Kurnia D, Isrokatun I et al (2019) The use of the Synthesia application to simplify Angklung learning. J Phys Conf Ser 1318:12040. https:\/\/doi.org\/10.1088\/1742-6596\/1318\/1\/012040","journal-title":"J Phys Conf Ser"},{"key":"953_CR12","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1207\/s15327108ijap0303_3","volume":"3","author":"RS Kennedy","year":"1993","unstructured":"Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG (1993) Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 3:203\u2013220. https:\/\/doi.org\/10.1207\/s15327108ijap0303_3","journal-title":"Int J Aviat Psychol"},{"key":"953_CR13","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/978-3-540-89350-9_6","volume-title":"HCI and usability for education and work","author":"B Laugwitz","year":"2008","unstructured":"Laugwitz B, Held T, Schrepp M (2008) Construction and evaluation of a user experience questionnaire. In: Holzinger A (ed) HCI and usability for education and work. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 63\u201376"},{"key":"953_CR14","doi-asserted-by":"publisher","first-page":"40","DOI":"10.9781\/ijimai.2017.445","volume":"4","author":"S Martin","year":"2017","unstructured":"Martin S, J\u00f6rg T, Andreas H (2017) Construction of a benchmark for the user experience questionnaire (UEQ). Int J Interact Multimed Artif Intell 4:40\u201344. https:\/\/doi.org\/10.9781\/ijimai.2017.445","journal-title":"Int J Interact Multimed Artif Intell"},{"key":"953_CR15","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/s11042-020-09678-9","volume":"80","author":"D Molero","year":"2021","unstructured":"Molero D, Schez-Sobrino S, Vallejo D et al (2021) A novel approach to learning music and piano based on mixed reality and gamification. Multimed Tools Appl 80:165\u2013186. https:\/\/doi.org\/10.1007\/s11042-020-09678-9","journal-title":"Multimed Tools Appl"},{"key":"953_CR16","doi-asserted-by":"crossref","unstructured":"Molloy W, Huang E, W\u00fcnsche BC (2019) Mixed reality piano tutor: a gamified piano practice environment. In: 2019 International conference on electronics, information, and communication (ICEIC), pp 1\u20137","DOI":"10.23919\/ELINFOCOM.2019.8706474"},{"key":"953_CR17","unstructured":"Regenbrecht H, Schubert T (2002) Measuring presence in augmented reality environments: design and a first test of a questionnaire. In: Proceedings of the 5th annual international workshop presence, pp 1\u20137"},{"key":"953_CR18","doi-asserted-by":"crossref","unstructured":"Rigby L, W\u00fcnsche BC, Shaw A (2020) PiARno\u2014an augmented reality piano tutor. In: Proceedings of the 32nd Australian conference on human\u2013computer interaction. Association for Computing Machinery, New York, NY, USA, pp 481\u2013491","DOI":"10.1145\/3441000.3441039"},{"key":"953_CR19","doi-asserted-by":"crossref","unstructured":"Rogers K, R\u00f6hlig A, Weing M et al (2014) P.I.A.N.O.: faster piano learning with interactive projection. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces. Association for Computing Machinery, New York, NY, USA, pp 149\u2013158","DOI":"10.1145\/2669485.2669514"},{"key":"953_CR20","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2014.00662","author":"M Villeneuve","year":"2014","unstructured":"Villeneuve M, Penhune V, Lamontagne A (2014) A piano training program to improve manual dexterity and upper extremity function in chronic stroke survivors. Front Hum Neurosci. https:\/\/doi.org\/10.3389\/fnhum.2014.00662","journal-title":"Front Hum Neurosci"},{"key":"953_CR21","doi-asserted-by":"crossref","unstructured":"Wijaya F, Tseng Y-C, Tsai W-L et al (2020) VR piano learning platform with leap motion and pressure sensors. In: 2020 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW), pp 584\u2013585","DOI":"10.1109\/VRW50115.2020.00143"},{"key":"953_CR22","doi-asserted-by":"crossref","unstructured":"Xiao L, Nouri S, Hegland J et al (2022) NeuralPassthrough: learned real-time view synthesis for VR. In: ACM SIGGRAPH 2022 conference proceedings. Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3528233.3530701"}],"container-title":["Virtual Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-024-00953-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10055-024-00953-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-024-00953-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T19:28:29Z","timestamp":1719516509000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10055-024-00953-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,6]]},"references-count":22,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["953"],"URL":"https:\/\/doi.org\/10.1007\/s10055-024-00953-w","relation":{},"ISSN":["1434-9957"],"issn-type":[{"value":"1434-9957","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,6]]},"assertion":[{"value":"31 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"67"}}