{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T07:00:20Z","timestamp":1791356420035,"version":"4.3.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,10,22]],"date-time":"2016-10-22T00:00:00Z","timestamp":1477094400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-13-CORD-0011"],"award-info":[{"award-number":["ANR-13-CORD-0011"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2017,4,30]]},"abstract":"<jats:p>Audio, visual, and proprioceptive actions are involved when manipulating a graphic tablet musical interface. Previous works suggested a possible dominance of the visual over the auditory modality in this situation. The main goal of the present study is to examine the interferences between these modalities in visual, audio, and audio-visual target acquisition tasks. Experiments are based on a movement replication paradigm, where a subject controls a cursor on a screen or the pitch of a synthesized sound by changing the stylus position on a covered graphic tablet. The experiments consisted of the following tasks: (1) a target acquisition task that was aimed at a visual target (reaching a cue with the cursor displayed on a screen), an audio target (reaching a reference note by changing the pitch of the sound played in headsets), or an audio-visual target, and (2) the replication of the target acquisition movement in the opposite direction. In the return phase, visual and audio feedback were suppressed. Different gain factors perturbed the relationships among the stylus movements, visual cursor movements, and audio pitch movements. The deviations between acquisition and return movements were analyzed. The results showed that hand amplitudes varied in accordance with visual, audio, and audio-visual perturbed gains, showing a larger effect for the visual modality. This indicates that visual, audio, and audio-visual actions interfered with the motor modality and confirms the spatial representation of pitch reported in previous studies. In the audio-visual situation, vision dominated over audition, as the latter had no significant influence on motor movement. Consequently, visual feedback is helpful for musical targeting of pitch on a graphic tablet, at least during the learning phase of the instrument. This result is linked to the underlying spatial organization of pitch perception. Finally, this work brings a complementary approach to previous studies showing that audition may dominate over vision for other aspects of musical sound (e.g., timing, rhythm, and timbre).<\/jats:p>","DOI":"10.1145\/2990501","type":"journal-article","created":{"date-parts":[[2016,10,25]],"date-time":"2016-10-25T12:37:00Z","timestamp":1477399020000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Seeing, Listening, Drawing"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9909-6078","authenticated-orcid":false,"given":"Olivier","family":"Perrotin","sequence":"first","affiliation":[{"name":"LIMSI, CNRS, Universit\u00e9 Paris-Saclay, Orsay, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christophe","family":"D\u2019alessandro","sequence":"additional","affiliation":[{"name":"LIMSI, CNRS, Universit\u00e9 Paris-Saclay, Orsay, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,10,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139508925152"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1773965.1773968"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-12976-1_14"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12553-9_14"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/IUSER.2010.5716759"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/57167.57203"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140130500197260"},{"key":"e_1_2_1_8_1","volume-title":"The R Book--","author":"Crawley Michael J."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.4875718"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3531802"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). ACM, 266--271","author":"Alessandro Nicolas","year":"2006"},{"key":"e_1_2_1_12_1","volume-title":"Handsketch: Bi-Manual Control of Voice Quality Dimensions and Long Term Practice Issues. Quarterly Progress and Status Report 2. Numediart Research Program.","author":"Alessandro Nicolas","year":"2009"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2014.12.002"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the International Conference on Auditory Display (ICAD), Perry R. Cook (Ed.). International Community for Auditory Display","author":"Ghez Claude"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0028689"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X01000103"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2007.08.002"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of Sound and Music Computing. IRCAM; Centre Pompidou","author":"Kessous Lo\u00efc","year":"2004"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1027\/2151-2604\/a000085"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-013-3710-2"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0014-4886(67)90060-X"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.concog.2009.02.004"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-014-0663-x"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897513"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00426-003-0143-8"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-004-2203-8"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-011-2837-2"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2005.01.004"},{"key":"e_1_2_1_30_1","first-page":"2375","article-title":"Effects of multimodal error feedback on human performance in steering tasks","volume":"51","author":"Sun Minghui","year":"2010","journal-title":"Inform. Process. Soc. Jpn. J."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449291003660349"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2012.12.001"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03204247"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0035441"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-12976-1_15"},{"key":"e_1_2_1_36_1","volume-title":"When acoustic stimuli turn visual circles into ellipses: sounds evoking accelerations modify visuo-motor coupling. (June 11--14","author":"Thoret Etienne","year":"2014"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0044082"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2012.00289"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00225"},{"key":"e_1_2_1_40_1","volume-title":"Attention and Performance 13: Motor Representation and Control","author":"Wright Charles E."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1279740.1279758"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2990501","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2990501","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:15:24Z","timestamp":1750281324000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2990501"}},"subtitle":["Interferences between Sensorimotor Modalities in the Use of a Tablet Musical Interface"],"short-title":[],"issued":{"date-parts":[[2016,10,22]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,4,30]]}},"alternative-id":["10.1145\/2990501"],"URL":"https:\/\/doi.org\/10.1145\/2990501","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,10,22]]},"assertion":[{"value":"2015-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}