{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,4,1]],"date-time":"2023-04-01T04:15:28Z","timestamp":1680322528529},"reference-count":24,"publisher":"Walter de Gruyter GmbH","issue":"1","funder":[{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["85037983"],"award-info":[{"award-number":["85037983"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>This paper presents a first prototype of a virtual Theremin instrument for accompanying film scenes with sound. The virtual Theremin is implemented as a hybrid application for the web. Sound control is achieved by capturing user gestures with a webcam and mapping the gestures to the corresponding virtual Theremin parameters pitch and volume. Different sound types can be selected. The application\u2019s underlying research is part of the multi-modal digital heritage project KOLLISIONEN which targets to open up the private archive of the Russian film maker Sergej Eisenstein to a broader public in digital form. Eisenstein, a film theorist and pioneer of film montage, was particularly intrigued by the Theremin as an instrument for film sound design. The virtual Theremin presented here is therefore linked to a film scene from the 1929 Soviet drama \u201cThe General Line\u201d by Sergej Eisenstein which was never set to music originally. In its first implementation state, the application connects music interaction design with digital heritage in a modular, flexible and playful way and uses contemporary web technologies to enable easy operation and the greatest possible accessibility.<\/jats:p>","DOI":"10.1515\/icom-2022-0007","type":"journal-article","created":{"date-parts":[[2022,3,31]],"date-time":"2022-03-31T23:32:22Z","timestamp":1648769542000},"page":"109-121","source":"Crossref","is-referenced-by-count":0,"title":["The Virtual Theremin: Designing an Interactive Digital Music Instrument for Film Scene Scoring"],"prefix":"10.1515","volume":"21","author":[{"given":"Bela","family":"Usabaev","sequence":"first","affiliation":[{"name":"38930 Filmuniversit\u00e4t Babelsberg KONRAD WOLF , Potsdam , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Eschenbacher","sequence":"additional","affiliation":[{"name":"38930 Filmuniversit\u00e4t Babelsberg KONRAD WOLF , Potsdam , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angela","family":"Brennecke","sequence":"additional","affiliation":[{"name":"38930 Filmuniversit\u00e4t Babelsberg KONRAD WOLF , Potsdam , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2022,4,1]]},"reference":[{"key":"2023033118352984299_j_icom-2022-0007_ref_001","doi-asserted-by":"crossref","unstructured":"Michel Beaudouin-Lafon. Designing interaction, not interfaces. pages 15\u201322, 01 2004.","DOI":"10.1145\/989863.989865"},{"key":"2023033118352984299_j_icom-2022-0007_ref_002","unstructured":"Fr\u00e9d\u00e9ric Bevilacqua and Norbert Schnell. From musical interfaces to musical interactions. In Andrea Gaggioli, Alois Ferscha, Giuseppe Riva, Stephen Dunne, and Isabelle Viaud Delmon, editors, Human Computer Confluence. Transforming Human Experience Through Symbiotic Technologies, Lecture Notes in Computer Science, pages 125\u2013140. De Gruyter Open Ltd, Warsaw\/Berlin, 2016."},{"key":"2023033118352984299_j_icom-2022-0007_ref_003","doi-asserted-by":"crossref","unstructured":"Angela Brennecke, Markus Traber, Simon Stimberg, and Bj\u00f6rn Stockleben. Interactive image driven sound. In Proceedings of the Conference on Mensch Und Computer, MuC \u201920, page 85\u201389, Association for Computing Machinery, New York, NY, USA, 2020.","DOI":"10.1145\/3404983.3410004"},{"key":"2023033118352984299_j_icom-2022-0007_ref_004","unstructured":"Michel Chion. Audio-Vision. Sound on Screen. Columbia University Press, 1994."},{"key":"2023033118352984299_j_icom-2022-0007_ref_005","unstructured":"Tadej Droljc. Composing with isomorphic audiovisual gestalts. Doctoral thesis, University of Huddersfield, 2018."},{"key":"2023033118352984299_j_icom-2022-0007_ref_006","unstructured":"Sergej Eisenstein. Jenseits der Einstellung: Schriften zur Filmtheorie. Suhrkamp Taschenbuch Wissenschaft, Suhrkamp, 2006."},{"key":"2023033118352984299_j_icom-2022-0007_ref_007","doi-asserted-by":"crossref","unstructured":"Christian Geiger, Holger Reckter, David Paschke, and Florian Schulz. Poster: Evolution of a theremin-based 3d-interface for music synthesis. In 2008 IEEE Symposium on 3D User Interfaces, IEEE, mar 2008.","DOI":"10.1109\/3DUI.2008.4476618"},{"key":"2023033118352984299_j_icom-2022-0007_ref_008","doi-asserted-by":"crossref","unstructured":"Simon Holland, Katie Wilkie, Paul Mulholland, and Allan Seago. Music interaction: Understanding music and human-computer interaction. In Simon Holland, Katie Wilkie, Paul Mulholland, and Allan Seago, editors, Music and Human-Computer Interaction, Springer Series on Cultural Computing, pages 51\u201374. Springer, London, 2013.","DOI":"10.1007\/978-1-4471-2990-5"},{"key":"2023033118352984299_j_icom-2022-0007_ref_009","unstructured":"David Johnson and George Tzanetakis. Vrmin: using mixed reality to augment the theremin for musical tutoring. In Cumhur Erkut, editor, 17th International Conference on New Interfaces for Musical Expression, NIME 2017, Aalborg University, Copenhagen, Denmark, May 15\u201318, 2017, pages 151\u2013156. nime.org, 2017."},{"key":"2023033118352984299_j_icom-2022-0007_ref_010","doi-asserted-by":"crossref","unstructured":"Alex Kendall, Matthew Grimes, and Roberto Cipolla. Posenet: A convolutional network for real-time 6-dof camera relocalization. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), ICCV \u201915, page 2938\u20132946, IEEE Computer Society, USA, 2015.","DOI":"10.1109\/ICCV.2015.336"},{"key":"2023033118352984299_j_icom-2022-0007_ref_011","doi-asserted-by":"crossref","unstructured":"Mark Marshall, Max Hartshorn, Marcelo Wanderley, and Daniel Levitin. Sensor choice for parameter modulations in digital musical instruments: Empirical evidence from pitch modulation. Journal of New Music Research, 38, 12 2009.","DOI":"10.1080\/09298210903085865"},{"key":"2023033118352984299_j_icom-2022-0007_ref_012","doi-asserted-by":"crossref","unstructured":"Christian Mayer, Patrick Pogscheba, Dionysios Marinos, Bj\u00f6rn W\u00f6ldecke, and Christian Geiger. An audio-visual music installation with dichotomous user interactions. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, ACE \u201914, Association for Computing Machinery, New York, NY, USA, 2014.","DOI":"10.1145\/2663806.2663842"},{"key":"2023033118352984299_j_icom-2022-0007_ref_013","doi-asserted-by":"crossref","unstructured":"Stefano Delle Monache, Davide Rocchesso, Fr\u00e9d\u00e9ric Bevilacqua, Guillaume Lemaitre, Stefano Baldan, and Andrea Cera. Embodied sound design. International Journal of Human-Computer Studies, 118:47\u201359, 2018.","DOI":"10.1016\/j.ijhcs.2018.05.007"},{"key":"2023033118352984299_j_icom-2022-0007_ref_014","unstructured":"Hye Yeon Nam and Michael Nitsche. Interactive installations as performance: Inspiration for hci. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, TEI \u201914, page 189\u2013196, Association for Computing Machinery, New York, NY, USA, 2014."},{"key":"2023033118352984299_j_icom-2022-0007_ref_015","doi-asserted-by":"crossref","unstructured":"Pavel Nikitin. Leon theremin (lev termen). IEEE Antennas Propagation Magazine, 54:252\u2013257, 10 2012.","DOI":"10.1109\/MAP.2012.6348173"},{"key":"2023033118352984299_j_icom-2022-0007_ref_016","doi-asserted-by":"crossref","unstructured":"Cristina Portal\u00e9s, Jo\u00e3o M.\u2009F. Rodrigues, Alexandra Rodrigues Gon\u00e7alves, Ester Alba, and Jorge Sebasti\u00e1n. Digital cultural heritage. Multimodal Technologies and Interaction, 2(3), 2018.","DOI":"10.3390\/mti2030058"},{"key":"2023033118352984299_j_icom-2022-0007_ref_017","unstructured":"Robert Robertson. Eisenstein on the Audiovisual: The Montage of Music, Image and Sound in Cinema (KINO \u2013 The Russian and Soviet Cinema). I.\u2009B.\u2009Tauris, 2011."},{"key":"2023033118352984299_j_icom-2022-0007_ref_018","doi-asserted-by":"crossref","unstructured":"Raquel Rodr\u00edguez-Carvajal and Oscar Lecuona de la Cruz. Mindfulness and music: A promising subject of an unmapped field. International Journal of Behavioral Research & Psychology, 2(3):27\u201335, 2014.","DOI":"10.19070\/2332-3000-140006"},{"key":"2023033118352984299_j_icom-2022-0007_ref_019","doi-asserted-by":"crossref","unstructured":"Kenneth D. Skeldon, Lindsay M. Reid, Viviene McInally, Brendan Dougan, and Craig Fulton. Physics of the theremin. American Journal of Physics, 66:945\u2013955, 1998.","DOI":"10.1119\/1.19004"},{"key":"2023033118352984299_j_icom-2022-0007_ref_020","doi-asserted-by":"crossref","unstructured":"Alexei Sourin and Zhong Cai Chock. Playing digital music by waving hands in the air. In Proceedings of the International Workshop on Advanced Image Technology (IWAIT), volume Proceedings Volume 11049, Singapore, 2019.","DOI":"10.1117\/12.2521373"},{"key":"2023033118352984299_j_icom-2022-0007_ref_021","doi-asserted-by":"crossref","unstructured":"Richard Stevens and Dave Raybould. Game Audio Implementation: A Practical Guide Using the Unreal Engine. Routledge, 2015.","DOI":"10.4324\/9781315772783"},{"key":"2023033118352984299_j_icom-2022-0007_ref_022","doi-asserted-by":"crossref","unstructured":"Rex van der Spuy. Sound with the Web Audio API, pages 331\u2013368. Apress, Berkeley, CA, 2015.","DOI":"10.1007\/978-1-4302-5801-8_9"},{"key":"2023033118352984299_j_icom-2022-0007_ref_023","doi-asserted-by":"crossref","unstructured":"M.\u2009M. Wanderley and P. Depalle. Gestural control of sound synthesis. Proceedings of the IEEE, 92(4):632\u2013644, 2004.","DOI":"10.1109\/JPROC.2004.825882"},{"key":"2023033118352984299_j_icom-2022-0007_ref_024","doi-asserted-by":"crossref","unstructured":"Lonce Wyse and Srikumar Subramanian. The Viability of the Web Browser as a Computer Music Platform. Computer Music Journal, 37(4):10\u201323, 12 2013.","DOI":"10.1162\/COMJ_a_00213"}],"container-title":["i-com"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/icom-2022-0007\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/icom-2022-0007\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,1]],"date-time":"2023-04-01T02:17:55Z","timestamp":1680315475000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/icom-2022-0007\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,1]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,4,1]]},"published-print":{"date-parts":[[2022,4,26]]}},"alternative-id":["10.1515\/icom-2022-0007"],"URL":"https:\/\/doi.org\/10.1515\/icom-2022-0007","relation":{},"ISSN":["2196-6826","1618-162X"],"issn-type":[{"value":"2196-6826","type":"electronic"},{"value":"1618-162X","type":"print"}],"subject":[],"published":{"date-parts":[[2022,4,1]]}}}