{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T13:46:47Z","timestamp":1767275207917,"version":"3.41.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2008,12,1]],"date-time":"2008-12-01T00:00:00Z","timestamp":1228089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Comput. Entertain."],"published-print":{"date-parts":[[2008,12]]},"abstract":"<jats:p>The Virtual Conductor project concerns the development of the first properly interactive virtual orchestra conductor\u2014a Virtual Human that can conduct a piece of music through interaction with musicians, leading and following them while they are playing. This article describes our motivation for developing such a system; related work in the areas of ambient entertainment and coordinated timing, automatic music processing, virtual humans, and conducting; the design, implementation, and evaluation of the Virtual Conductor, and, finally, contains a discussion of the resulting system and expected developments in the (still ongoing) Virtual Conductor project.<\/jats:p>","DOI":"10.1145\/1461999.1462005","type":"journal-article","created":{"date-parts":[[2009,1,7]],"date-time":"2009-01-07T15:50:36Z","timestamp":1231343436000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Temporal interaction between an artificial orchestra conductor and human musicians"],"prefix":"10.1145","volume":"6","author":[{"given":"Dennis","family":"Reidsma","sequence":"first","affiliation":[{"name":"Human Media Interaction, University of Twente, Enschede, The Netherlands"}]},{"given":"Anton","family":"Nijholt","sequence":"additional","affiliation":[{"name":"Human Media Interaction, University of Twente, Enschede, The Netherlands"}]},{"given":"Pieter","family":"Bos","sequence":"additional","affiliation":[{"name":"Human Media Interaction, University of Twente, Enschede, The Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2008,12,24]]},"reference":[{"volume-title":"Proceedings International Conference on Music Information Retrieval. 158--163","author":"Alonso M.","key":"e_1_2_1_1_1","unstructured":"Alonso , M. , David , B. , and Richard , G . 2004. Tempo and beat estimation of musical signals . In Proceedings International Conference on Music Information Retrieval. 158--163 . Alonso, M., David, B., and Richard, G. 2004. Tempo and beat estimation of musical signals. In Proceedings International Conference on Music Information Retrieval. 158--163."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2005.01619.x"},{"volume-title":"Human Media Interaction","author":"Bos P.","key":"e_1_2_1_3_1","unstructured":"Bos , P. 2007. Interacting with a virtual conductor. M. S. thesis , Human Media Interaction , University of Twente , NL. Bos, P. 2007. Interacting with a virtual conductor. M. S. thesis, Human Media Interaction, University of Twente, NL."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.400476"},{"key":"e_1_2_1_5_1","unstructured":"Carse A. 1935. Orchestral Conducting. Augener Ltd.  Carse A. 1935. Orchestral Conducting. Augener Ltd."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X91101002"},{"volume-title":"Proceedings of the Interactional Computer Music Conference. International Computer Music Association, 27--33","author":"Dannenberg R.","key":"e_1_2_1_7_1","unstructured":"Dannenberg , R. and Hu , N . 2003. Polyphonic audio matching for score following and intelligent audio editors . In Proceedings of the Interactional Computer Music Conference. International Computer Music Association, 27--33 . Dannenberg, R. and Hu, N. 2003. Polyphonic audio matching for score following and intelligent audio editors. In Proceedings of the Interactional Computer Music Conference. International Computer Music Association, 27--33."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183316.1183337"},{"key":"e_1_2_1_9_1","first-page":"122","article-title":"On the analysis of musical expression in audio signals. In Storage and Retrieval for Media Databases","volume":"5021","author":"Dixon S.","year":"2003","unstructured":"Dixon , S. 2003 . On the analysis of musical expression in audio signals. In Storage and Retrieval for Media Databases , SPIE vol. 5021. 122 -- 132 . Dixon, S. 2003. On the analysis of musical expression in audio signals. In Storage and Retrieval for Media Databases, SPIE vol. 5021. 122--132.","journal-title":"SPIE"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 8th International Conference on Digital Audio Effects. 92--97","author":"Dixon S.","year":"2005","unstructured":"Dixon , S. 2005 . Live tracking of musical performances using on-line time warping . In Proceedings of the 8th International Conference on Digital Audio Effects. 92--97 . Dixon, S. 2005. Live tracking of musical performances using on-line time warping. In Proceedings of the 8th International Conference on Digital Audio Effects. 92--97."},{"key":"e_1_2_1_11_1","first-page":"1","article-title":"The effect of various left-hand conducting gestures on perceptions of anticipated vocal tension in singers","volume":"2","author":"Fuelberth R. J. V.","year":"2004","unstructured":"Fuelberth , R. J. V. 2004 . The effect of various left-hand conducting gestures on perceptions of anticipated vocal tension in singers . Int. J. Research Choral Singing 2 , 1 (Jan.), 27--38. Fuelberth, R. J. V. 2004. The effect of various left-hand conducting gestures on perceptions of anticipated vocal tension in singers. Int. J. Research Choral Singing 2, 1 (Jan.), 27--38.","journal-title":"Int. J. Research Choral Singing"},{"volume-title":"A History off Orchestral Conducting: In Theory and Practice","author":"Galkin E. W.","key":"e_1_2_1_12_1","unstructured":"Galkin , E. W. 1988. A History off Orchestral Conducting: In Theory and Practice . Stuyvesant, New York . Galkin, E. W. 1988. A History off Orchestral Conducting: In Theory and Practice. Stuyvesant, New York."},{"key":"e_1_2_1_13_1","first-page":"2","article-title":"An audio-based real-time beat tracking system for music with or without drumsounds","volume":"3","author":"Goto M.","year":"2001","unstructured":"Goto , M. 2001 . An audio-based real-time beat tracking system for music with or without drumsounds . J. New Music Research 3 , 2 (June), 159--171. Goto, M. 2001. An audio-based real-time beat tracking system for music with or without drumsounds. J. New Music Research 3, 2 (June), 159--171.","journal-title":"J. New Music Research"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1162\/comj.2005.29.1.34"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSA.2005.858509"},{"volume-title":"Proceedings of the International Computer Music Conference (ICMC","author":"Ilmonen T.","key":"e_1_2_1_16_1","unstructured":"Ilmonen , T. and Takala , T . 1999. Conductor following with artificial neural networks . In Proceedings of the International Computer Music Conference (ICMC , Beijing), 367--370. Ilmonen, T. and Takala, T. 1999. Conductor following with artificial neural networks. In Proceedings of the International Computer Music Conference (ICMC, Beijing), 367--370."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1139073.1139075"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSA.2005.854090"},{"volume-title":"Proceedings of the International Computer Music Conference (ICMC).","author":"Kolesnik P.","key":"e_1_2_1_19_1","unstructured":"Kolesnik , P. and Wanderley , M . 2004. Recognition, analysis and performance with expressive conducting gestures . In Proceedings of the International Computer Music Conference (ICMC). Kolesnik, P. and Wanderley, M. 2004. Recognition, analysis and performance with expressive conducting gestures. In Proceedings of the International Computer Music Conference (ICMC)."},{"volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression (NIME, IRCAM, Centre Pompidou","author":"Lee E.","key":"e_1_2_1_20_1","unstructured":"Lee , E. , Gr\u00fcll , I. , Kiel , H. , and Borchers , J . 2006. CONGA: A framework for adaptive conducting gesture analysis . In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME, IRCAM, Centre Pompidou , Paris), 260--265. Lee, E., Gr\u00fcll, I., Kiel, H., and Borchers, J. 2006. CONGA: A framework for adaptive conducting gesture analysis. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME, IRCAM, Centre Pompidou, Paris), 260--265."},{"volume-title":"Proceedings of the International Computer Music Conference. International Computer Music Association, 454--455","author":"Lee M.","key":"e_1_2_1_21_1","unstructured":"Lee , M. , Garnett , G. , and Wessel , D . 1992. An adaptive conductor follower . In Proceedings of the International Computer Music Conference. International Computer Music Association, 454--455 . Lee, M., Garnett, G., and Wessel, D. 1992. An adaptive conductor follower. In Proceedings of the International Computer Music Conference. International Computer Music Association, 454--455."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2007.899256"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1228716.1228729"},{"volume-title":"Proceedings of the GW03","author":"Murphy D.","key":"e_1_2_1_24_1","unstructured":"Murphy , D. , Andersen , T. H. , and Jensen , K . 2003. Conducting audio files via computer vision . In Proceedings of the GW03 . 529--540. Murphy, D., Andersen, T. H., and Jensen, K. 2003. Conducting audio files via computer vision. In Proceedings of the GW03. 529--540."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Nagaoka C. Komori M. and Yoshikawa S. 2007. Embodied synchrony in conversation. In Conversational Informatics: An Engineering Approach L. Nishida (ed.) Wiley 331--351.  Nagaoka C. Komori M. and Yoshikawa S. 2007. Embodied synchrony in conversation. In Conversational Informatics: An Engineering Approach L. Nishida (ed.) Wiley 331--351.","DOI":"10.1002\/9780470512470.ch18"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70872-8_6"},{"key":"e_1_2_1_28_1","unstructured":"Pardo B. and Birmingham W. P. 2005. Modeling form for on-line following of musical performances. In AAAI. 1018--1023.   Pardo B. and Birmingham W. P. 2005. Modeling form for on-line following of musical performances. In AAAI. 1018--1023."},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Poggi I. 2002. The lexicon of the conductor's face. In Language Vision and Music. John Benjamins 271--284.  Poggi I. 2002. The lexicon of the conductor's face. In Language Vision and Music. John Benjamins 271--284.","DOI":"10.1075\/aicr.35.25pog"},{"volume-title":"Score and Podium: A Complete Guide to Conducting","author":"Prausnitz F.","key":"e_1_2_1_30_1","unstructured":"Prausnitz , F. 1983. Score and Podium: A Complete Guide to Conducting . W. W. Norton , New York . Prausnitz, F. 1983. Score and Podium: A Complete Guide to Conducting. W. W. Norton, New York."},{"key":"e_1_2_1_31_1","volume-title":"Simultaneity: Temporal Structures and Observer Perspectives. World Scientific","author":"Ramseyer F.","year":"2008","unstructured":"Ramseyer , F. and Tschacher , W . 2008 . Synchrony in dyadic psychotherapy sessions. In Simultaneity: Temporal Structures and Observer Perspectives. World Scientific , Singapore, Ch . 18. Ramseyer, F. and Tschacher, W. 2008. Synchrony in dyadic psychotherapy sessions. In Simultaneity: Temporal Structures and Observer Perspectives. World Scientific, Singapore, Ch. 18."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the International Conference on Music Information Retrieval.","author":"Raphael C.","year":"2004","unstructured":"Raphael , C. 2004 . A hybrid graphical model for aligning polyphonic audio with musical scores . In Proceedings of the International Conference on Music Information Retrieval. Raphael, C. 2004. A hybrid graphical model for aligning polyphonic audio with musical scores. In Proceedings of the International Conference on Music Information Retrieval."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/11872320_1"},{"volume-title":"Proceedings of the 14th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN).","author":"Robins B.","key":"e_1_2_1_34_1","unstructured":"Robins , B. , Dautenhahn , K. , Nehaniv , C. L. , Mirza , N. A. , Francois , D. , and Olsson , L . 2005. Sustaining interaction dynamics and engagement in dyadic child-robot interaction kinesics: Lessons learnt from an exploratory study . In Proceedings of the 14th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN). Robins, B., Dautenhahn, K., Nehaniv, C. L., Mirza, N. A., Francois, D., and Olsson, L. 2005. Sustaining interaction dynamics and engagement in dyadic child-robot interaction kinesics: Lessons learnt from an exploratory study. In Proceedings of the 14th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN)."},{"key":"e_1_2_1_35_1","volume-title":"The Grammar of Conducting: A Comprehensive Guide to Baton Technique and Interpretation","author":"Rudolph M.","unstructured":"Rudolph , M. 1995. The Grammar of Conducting: A Comprehensive Guide to Baton Technique and Interpretation ( 3 rd ed.), Schirmer . Rudolph, M. 1995. The Grammar of Conducting: A Comprehensive Guide to Baton Technique and Interpretation (3rd ed.), Schirmer.","edition":"3"},{"volume-title":"Proceedings of the 2nd Hungarian Computer Graphics Conference. 9--16","author":"Ruttkay Z. M.","key":"e_1_2_1_36_1","unstructured":"Ruttkay , Z. M. , Huang , A. , and Eli\u00ebns , A . 2003. The conductor: Gestures for embodied agents with logic programming . In Proceedings of the 2nd Hungarian Computer Graphics Conference. 9--16 . Ruttkay, Z. M., Huang, A., and Eli\u00ebns, A. 2003. The conductor: Gestures for embodied agents with logic programming. In Proceedings of the 2nd Hungarian Computer Graphics Conference. 9--16."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.421129"},{"key":"e_1_2_1_38_1","first-page":"40","article-title":"Music as a tool in communications research","volume":"7","author":"Sch\u00f6gler B.","year":"1998","unstructured":"Sch\u00f6gler , B. 1998 . Music as a tool in communications research . Nordic J. Music Therapy 7 , 1, 40 -- 49 . Sch\u00f6gler, B. 1998. Music as a tool in communications research. Nordic J. Music Therapy 7, 1, 40--49.","journal-title":"Nordic J. Music Therapy"},{"volume-title":"Proceedings of the International Computer Music Conference (ICMC).","author":"Schwarz D.","key":"e_1_2_1_39_1","unstructured":"Schwarz , D. , Orio , N. , and Schnell , N . 2004. Robust polyphonic midi score following with hidden markov models . In Proceedings of the International Computer Music Conference (ICMC). Schwarz, D., Orio, N., and Schnell, N. 2004. Robust polyphonic midi score following with hidden markov models. In Proceedings of the International Computer Music Conference (ICMC)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/311625.311984"},{"volume-title":"Proceedings of the 7th International Conference on Music Information Retrieval, R. Dannenberg et al. (eds.), 23--28","author":"Sepp\u00e4nen J.","key":"e_1_2_1_41_1","unstructured":"Sepp\u00e4nen , J. , Eronen , A. , and Hiipakka , J . 2006. Joint beat and tatum tracking from music signals . In Proceedings of the 7th International Conference on Music Information Retrieval, R. Dannenberg et al. (eds.), 23--28 . Sepp\u00e4nen, J., Eronen, A., and Hiipakka, J. 2006. Joint beat and tatum tracking from music signals. In Proceedings of the 7th International Conference on Music Information Retrieval, R. Dannenberg et al. (eds.), 23--28."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2006.00964.x"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.2307\/3345419"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00180-2"},{"volume-title":"Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), IEEE, 419--424","author":"Tanaka H.","key":"e_1_2_1_45_1","unstructured":"Tanaka , H. and Suzuki , H . 2004. Dance interaction with qrio: A case study for non-boring interaction by using an entrainment ensemble model . In Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), IEEE, 419--424 . Tanaka, H. and Suzuki, H. 2004. Dance interaction with qrio: A case study for non-boring interaction by using an entrainment ensemble model. In Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), IEEE, 419--424."},{"volume-title":"Proceedings of the INTETAIN. ACM","author":"Ter Maat M.","key":"e_1_2_1_46_1","unstructured":"Ter Maat , M. , Ebbers , R. M. , Reidsma , D. , and Nijholt , A . 2008. Beyond the beat: Modeling intentions in a virtual conductor . In Proceedings of the INTETAIN. ACM , New York. Ter Maat, M., Ebbers, R. M., Reidsma, D., and Nijholt, A. 2008. Beyond the beat: Modeling intentions in a virtual conductor. In Proceedings of the INTETAIN. ACM, New York."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1255047.1255128"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1524-0703(03)00040-7"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124957"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101353"}],"container-title":["Computers in Entertainment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1461999.1462005","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1461999.1462005","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:29:40Z","timestamp":1750253380000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1461999.1462005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12]]},"references-count":49,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2008,12]]}},"alternative-id":["10.1145\/1461999.1462005"],"URL":"https:\/\/doi.org\/10.1145\/1461999.1462005","relation":{},"ISSN":["1544-3574"],"issn-type":[{"type":"electronic","value":"1544-3574"}],"subject":[],"published":{"date-parts":[[2008,12]]},"assertion":[{"value":"2008-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-12-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}