{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T04:55:09Z","timestamp":1781499309535,"version":"3.54.1"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T00:00:00Z","timestamp":1781481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJBS2410"],"award-info":[{"award-number":["JPMJBS2410"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJMS2630"],"award-info":[{"award-number":["JPMJMS2630"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Cognit."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>This study examined whether coordination dynamics in singing differ when a person sings along with a human partner vs. an artificial partner generated by voice synthesis software (VOCALOID 6). We further investigated how the presence or absence of visual information shapes these coordination patterns.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Thirteen female participants sang a chorus excerpt of Silent Night in unison with a partner heard through earphones. The task crossed two partner types (a human singer and an artificial VOCALOID 6 singer) with two visual conditions (with and without partner video). Artificial-partner videos were created using an AI video platform (Hedra Character 3) that combined the artificial partner's synthesized voice with a still image of the human partner. Coordination was assessed through cross-correlation and Granger causality analyses of vocal amplitude envelopes, evaluated using linear mixed-effects models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Singing with a human partner elicited stronger anticipatory synchronization and greater similarity in amplitude envelopes than singing with an artificial partner. With the human partner, participants tended to sing slightly ahead of their partner, indicative of anticipatory coordination. Notably, this tendency was further strengthened when visual information was available.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>These findings indicate that the temporal variability of the human singing voice, together with the fine-grained bodily movements characteristic of naturalistic vocal production, provides perceptual information that supports anticipation and synchronization in joint singing.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fcogn.2026.1810330","type":"journal-article","created":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T04:28:32Z","timestamp":1781497712000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Coordination dynamics in singing with human and artificial partners: the role of visual information"],"prefix":"10.3389","volume":"5","author":[{"given":"Rina","family":"Nishiyama","sequence":"first","affiliation":[{"name":"Graduate School of Human Development and Environment, Kobe University","place":["Kobe, Japan"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tetsushi","family":"Nonaka","sequence":"additional","affiliation":[{"name":"Graduate School of Human Development and Environment, Kobe University","place":["Kobe, Japan"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,6,15]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.jneumeth.2013.10.018","article-title":"The MVGC multivariate Granger causality toolbox: a new approach to Granger-causal inference","volume":"223","author":"Barnett","year":"2014","journal-title":"J. Neurosci. Methods"},{"key":"B2","doi-asserted-by":"publisher","first-page":"103077","DOI":"10.29140\/tltl.v7n4.103077","article-title":"Visual language learning: exploring the effects of artificial intelligence\u2013generated animations on vocabulary and motivational growth","volume":"7","author":"Behforouz","year":"2025","journal-title":"Technol. Lang. Teach. Learn."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1525\/mp.2019.37.1.1","article-title":"Moving to communicate, moving to interact: patterns of body motion in musical duo performance","volume":"37","author":"Bishop","year":"2019","journal-title":"Mus. Percept."},{"key":"B4","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1177\/1029864915570355","article-title":"When they listen and when they watch: pianists' use of nonverbal audio and visual cues during duet performance","volume":"19","author":"Bishop","year":"2015","journal-title":"Mus. Sci."},{"key":"B5","doi-asserted-by":"publisher","first-page":"3833","DOI":"10.1016\/j.cub.2018.10.057","article-title":"Cortical response to the natural speech envelope correlates with neuroimaging evidence of cognition in severe brain injury","volume":"28","author":"Braiman","year":"2018","journal-title":"Curr. Biol"},{"key":"B6","doi-asserted-by":"publisher","first-page":"903","DOI":"10.3389\/fnhum.2014.00903","article-title":"Hunting for the beat in the body: on period and phase locking in music-induced movement","volume":"8","author":"Burger","year":"2014","journal-title":"Front. Hum. Neurosci."},{"key":"B7","doi-asserted-by":"publisher","first-page":"E4134","DOI":"10.1073\/pnas.1617657114","article-title":"Body sway reflects leadership in joint music performance","volume":"114","author":"Chang","year":"2017","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"B8","doi-asserted-by":"publisher","first-page":"13","DOI":"10.3390\/e26010013","article-title":"Detection of anticipatory dynamics between a pair of zebrafish","volume":"26","author":"Chen","year":"2023","journal-title":"Entropy"},{"key":"B9","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1177\/1461445605054404","article-title":"Coordinating with each other in a material world","volume":"7","author":"Clark","year":"2005","journal-title":"Discourse Stud."},{"key":"B10","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1525\/mp.2020.38.2.136","article-title":"Interpersonal entrainment in music performance: theory, method, and model","volume":"38","author":"Clayton","year":"2020","journal-title":"Mus. Percept"},{"key":"B11","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.tics.2015.01.005","article-title":"What can music tell us about social interaction?","volume":"19","author":"D'Ausilio","year":"2015","journal-title":"Trends Cogn. Sci."},{"key":"B12","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.neubiorev.2017.02.011","article-title":"Temporal modulations in speech and music","volume":"81","author":"Ding","year":"2017","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2402.08690","article-title":"If Turing played piano with an artificial partner","author":"Dotov","year":"2024","journal-title":"arXiv [Preprint]"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e1000302","DOI":"10.1371\/journal.pcbi.1000302","article-title":"The modulation transfer function for speech intelligibility","volume":"5","author":"Elliott","year":"2009","journal-title":"PLoS Comput. Biol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1489","DOI":"10.1016\/S0378-2166(99)00096-X","article-title":"Action and embodiment within situated human interaction","volume":"32","author":"Goodwin","year":"2000","journal-title":"J. Pragmat."},{"key":"B16","doi-asserted-by":"publisher","first-page":"85","DOI":"10.4013\/cld.2010.82.01","article-title":"Multimodality in human interaction","volume":"8","author":"Goodwin","year":"2010","journal-title":"Calidosc\u00f3pio"},{"key":"B17","doi-asserted-by":"publisher","first-page":"424","DOI":"10.2307\/1912791","article-title":"Investigating causal relations by econometric models and cross-spectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econometrica"},{"key":"B18","doi-asserted-by":"publisher","first-page":"120675","DOI":"10.1016\/j.neuroimage.2024.120675","article-title":"On the speech envelope in the cortical tracking of speech","volume":"297","author":"Issa","year":"2024","journal-title":"NeuroImage"},{"key":"B19","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1037\/pmu0000264","article-title":"Multimodal perception of interpersonal synchrony: evidence from global and continuous ratings of improvised musical duo performances","volume":"30","author":"Jakubowski","year":"2020","journal-title":"Psychomusicology"},{"key":"B20","doi-asserted-by":"publisher","first-page":"527","DOI":"10.3758\/s13414-013-0568-0","article-title":"Gazing behavior and coordination during piano duo performance","volume":"76","author":"Kawase","year":"2014","journal-title":"Atten. Percept. Psychophys."},{"key":"B21","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1016\/j.concog.2005.12.004","article-title":"Pianists duet better when they play with themselves: on the possible role of action simulation in synchronization","volume":"16","author":"Keller","year":"2007","journal-title":"Conscious. Cogn."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1559","DOI":"10.3389\/fpsyg.2017.01559","article-title":"Simultaneous cooperation and competition in the evolution of musical behavior: sex-related modulations of the singer's formant in human chorusing","volume":"8","author":"Keller","year":"2017","journal-title":"Front. Psychol."},{"key":"B23","first-page":"4009","article-title":"\u201cVOCALOID-commercial singing synthesizer based on sample concatenation,\u201d","author":"Kenmochi","year":"2007","journal-title":"Proceeding of Interspeech 2007"},{"key":"B24","doi-asserted-by":"publisher","first-page":"38","DOI":"10.21608\/shedet.2025.375550.1296","article-title":"Let statues talk: applying AI storytelling scenarios in the Gr\u00e6co-Roman Museum in Alexandria","volume":"15","author":"Kitat","year":"2025","journal-title":"SHEDET"},{"key":"B25","doi-asserted-by":"publisher","first-page":"982177","DOI":"10.3389\/fnhum.2022.982177","article-title":"Follow the sound of my violin: Granger causality reflects information flow in sound","volume":"16","author":"Klein","year":"2022","journal-title":"Front. Hum. Neurosci."},{"key":"B26","doi-asserted-by":"publisher","first-page":"2220","DOI":"10.1080\/17470218.2010.497843","article-title":"Follow you, follow me: continuous mutual prediction and adaptation in joint tapping","volume":"63","author":"Konvalinka","year":"2010","journal-title":"Q. J. Exp. Psychol."},{"key":"B27","doi-asserted-by":"publisher","first-page":"593732","DOI":"10.3389\/fnbot.2020.593732","article-title":"The human takes it all: humanlike synthesized voices are perceived as less eerie and more likable. Evidence from a subjective ratings study","volume":"14","author":"K\u00fchne","year":"2020","journal-title":"Front. Neurorobotics"},{"key":"B28","unstructured":"Lenth\n              R.\n            \n          \n          emmeans: Estimated Marginal Means, aka Least-Squares Means\n          \n          2024"},{"key":"B29","doi-asserted-by":"publisher","first-page":"955","DOI":"10.1109\/TCDS.2017.2779218","article-title":"Extending human\u2013robot relationships based in music with virtual presence","volume":"10","author":"McCallum","year":"2018","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1463477","DOI":"10.3389\/frobt.2024.1463477","article-title":"Can a human sing with an unseen artificial partner? Coordination dynamics when singing with an unseen human or artificial partner","volume":"11","author":"Nishiyama","year":"2024","journal-title":"Front. Robot. AI"},{"key":"B31","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1080\/17458927.2023.2232621","article-title":"Hearing with the eyes: visual hearing in (a trio) music rehearsals","volume":"18","author":"Pentimalli","year":"2023","journal-title":"Senses Soc."},{"key":"B32","unstructured":"Pinheiro\n              J.\n            \n            \n              Bates\n              D.\n            \n            \n              DebRoy\n              S.\n            \n            \n              Sarkar\n              D.\n            \n            \n              Heisterkamp\n              S.\n            \n            \n              Van Willigen\n              B.\n            \n          \n          Package \u2018nlme': Linear and Nonlinear Mixed Effects Models\n          \n          2024"},{"key":"B33","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1038\/s41598-021-04463-6","article-title":"Coordination dynamics of multi-agent interaction in a musical ensemble","volume":"12","author":"Proksch","year":"2022","journal-title":"Sci. Rep"},{"key":"B34","doi-asserted-by":"publisher","first-page":"403","DOI":"10.3758\/s13423-012-0371-2","article-title":"Sensorimotor synchronization: a review of recent research (2006\u20132012)","volume":"20","author":"Repp","year":"2013","journal-title":"Psychon. Bull. Rev."},{"key":"B35","doi-asserted-by":"publisher","first-page":"1507","DOI":"10.1007\/s12369-022-00891-0","article-title":"Designing sound for social robots: candidate design principles","volume":"14","author":"Robinson","year":"2022","journal-title":"Int. J. Soc. Robot."},{"key":"B36","doi-asserted-by":"publisher","first-page":"e0300663","DOI":"10.1371\/journal.pone.0300663","article-title":"Leadership dynamics in musical groups: quantifying effects of musical structure on directionality of influence in concert performance videos","volume":"19","author":"Sabharwal","year":"2024","journal-title":"PLoS ONE"},{"key":"B37","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.tics.2005.12.009","article-title":"Joint action: bodies and minds moving together","volume":"10","author":"Sebanz","year":"2006","journal-title":"Trends Cogn. Sci."},{"key":"B38","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s12369-017-0432-9","article-title":"Music to motion: using music information to create expressive robot motion","volume":"10","author":"Sunardi","year":"2017","journal-title":"Int. J. Soc. Robot."},{"key":"B39","doi-asserted-by":"publisher","first-page":"8799","DOI":"10.1038\/srep08799","article-title":"Involvement of the left insula in the ecological validity of the human voice","volume":"5","author":"Tamura","year":"2015","journal-title":"Sci. Rep"},{"key":"B40","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1109\/MSP.2015.2424572","article-title":"Expression control in singing voice synthesis: features, approaches, evaluation, and challenges","volume":"32","author":"Umbert","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"B41","doi-asserted-by":"publisher","first-page":"20150377","DOI":"10.1098\/rstb.2015.0377","article-title":"Measuring social interaction in music ensembles","volume":"371","author":"Volpe","year":"2016","journal-title":"Philos. Trans. R. Soc. London. B Biol. Sci."},{"key":"B42","doi-asserted-by":"publisher","first-page":"4650","DOI":"10.1109\/TRO.2024.3484633","article-title":"Human\u2013Robot cooperative piano playing with learning-based real-time music accompaniment","volume":"40","author":"Wang","year":"2024","journal-title":"IEEE Trans. Rob."},{"key":"B43","doi-asserted-by":"publisher","first-page":"803","DOI":"10.3389\/fpsyg.2014.00803","article-title":"Singing and social inclusion","volume":"5","author":"Welch","year":"2014","journal-title":"Front. Psychol."}],"container-title":["Frontiers in Cognition"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcogn.2026.1810330\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T04:28:38Z","timestamp":1781497718000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcogn.2026.1810330\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,15]]},"references-count":43,"alternative-id":["10.3389\/fcogn.2026.1810330"],"URL":"https:\/\/doi.org\/10.3389\/fcogn.2026.1810330","relation":{},"ISSN":["2813-4532"],"issn-type":[{"value":"2813-4532","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,15]]},"article-number":"1810330"}}