{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T11:34:23Z","timestamp":1786361663377,"version":"build-2736575974"},"reference-count":49,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:00:00Z","timestamp":1785542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:00:00Z","timestamp":1785542400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Rehabilitation and Assistive Technologies Engineering"],"published-print":{"date-parts":[[2026,8]]},"abstract":"<jats:p>Users with Severe Speech Motor Impairment (SSMI) face difficulties interacting with digital systems due to limited speech and motor control. To address this, we present an eye gaze-based system that enables users with SSMI to generate short music using eye gaze control. The system combines a webcam-based eye-tracking with a music generation system that transforms user-selected images into music. A user study was conducted with 15 participants with SSMI across 74 sessions. The results show that the participants were able to interact with the system using gaze-based control, with an average engagement time of 61.38 seconds per session. Eye-tracking calibration accuracy varied across participants, reflecting individual differences in gaze control. These findings demonstrate the feasibility of gaze-based generative music interaction as an accessible assistive system for users with SSMI.<\/jats:p>","DOI":"10.1177\/20556683261476038","type":"journal-article","created":{"date-parts":[[2026,8,8]],"date-time":"2026-08-08T06:55:53Z","timestamp":1786172153000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Gaze-based music generation system for users with severe speech motor impairment"],"prefix":"10.1177","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-0826-2695","authenticated-orcid":false,"given":"Taishin","family":"Aoki","sequence":"first","affiliation":[{"name":"Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc)"},{"name":"Shimane University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5298-4618","authenticated-orcid":false,"given":"Yash Kumar","family":"Sahu","sequence":"additional","affiliation":[{"name":"Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1420-279X","authenticated-orcid":false,"given":"Himanshu","family":"Vishwakarma","sequence":"additional","affiliation":[{"name":"Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"L. R. D.","family":"Murthy","sequence":"additional","affiliation":[{"name":"Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc)"},{"name":"Mercedes-Benz Research & Development"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gowdham","family":"Prabhakar","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pradipta","family":"Biswas","sequence":"additional","affiliation":[{"name":"Robert Bosch Centre for Cyber-Physical Systems (RBCCPS), Indian Institute of Science (IISc)"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,8,7]]},"reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"crossref","unstructured":"Murthy LRD Biswas P. Appearance-based gaze estimation using attention and difference mechanism. In: 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE pp. 3137\u20133146.","DOI":"10.1109\/CVPRW53098.2021.00351"},{"key":"e_1_3_5_3_2","doi-asserted-by":"crossref","unstructured":"Vishwakarma H Mitra M Sharma VK et al. Unlocking potential: Gaze-based interfaces in assistive robotics for users with severe speech and motor impairment. In: 2025 IEEE International Conference on Robotics and Automation (ICRA). IEEE pp. 1944\u20131950.","DOI":"10.1109\/ICRA55743.2025.11128213"},{"key":"e_1_3_5_4_2","volume-title":"Tobii pro lab","author":"Tobii Pro AB","year":"2014","unstructured":"Tobii Pro AB. Tobii pro lab. Computer software, 2014."},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.3402\/qhw.v8i0.20635"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.1310\/sci2003-236"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.3233\/NRE-208012"},{"key":"e_1_3_5_8_2","article-title":"Rhythm and music-based interventions in motor rehabilitation: Current evidence and future perspectives","volume":"15","author":"Braun JT","year":"2022","unstructured":"Braun JT, Koshimori Y, Richard NM, et al. Rhythm and music-based interventions in motor rehabilitation: Current evidence and future perspectives. Frontiers in Human Neuroscience 2022; 15.","journal-title":"Frontiers in Human Neuroscience"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2008.917305"},{"key":"e_1_3_5_10_2","doi-asserted-by":"publisher","DOI":"10.3233\/TAD-180206"},{"key":"e_1_3_5_11_2","doi-asserted-by":"publisher","DOI":"10.1080\/10400435.2015.1092182"},{"key":"e_1_3_5_12_2","doi-asserted-by":"publisher","DOI":"10.1080\/17518423.2019.1600066"},{"key":"e_1_3_5_13_2","doi-asserted-by":"crossref","unstructured":"Majaranta P R\u00e4ih\u00e4 KJ. Twenty years of eye typing: systems and design issues. In: Proceedings of the 2002 symposium on Eye tracking research & applications pp. 15\u201322.","DOI":"10.1145\/507072.507076"},{"key":"e_1_3_5_14_2","doi-asserted-by":"crossref","unstructured":"Creed C Frutos-Pascual M Williams I. Multimodal gaze interaction for creative design. In: Proceedings of the 2020 CHI conference on human factors in computing systems pp. 1\u201313.","DOI":"10.1145\/3313831.3376196"},{"key":"e_1_3_5_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2022.102966"},{"key":"e_1_3_5_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.30"},{"key":"e_1_3_5_17_2","doi-asserted-by":"crossref","unstructured":"Jacob RJ. What you look at is what you get: eye movement-based interaction techniques. In: Proceedings of the SIGCHI conference on Human factors in computing systems pp. 11\u201318.","DOI":"10.1145\/97243.97246"},{"key":"e_1_3_5_18_2","doi-asserted-by":"publisher","DOI":"10.35765\/mjse.2024.1326\/11"},{"key":"e_1_3_5_19_2","first-page":"67","volume-title":"A Better Life in Digital World: Using Eye-Gaze Technology to Enhance Life Quality of Physically Disabled People. ISBN","author":"Neri\u015fanu R","year":"2024","unstructured":"Neri\u015fanu R, Cioca LI. A Better Life in Digital World: Using Eye-Gaze Technology to Enhance Life Quality of Physically Disabled People. ISBN. World Scientific Publishing, 2024, pp. 67\u201399. https:\/\/doi.org\/10.1007\/978-3-031-63337-9_5"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11554-024-01478-w"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3164075"},{"key":"e_1_3_5_22_2","doi-asserted-by":"publisher","DOI":"10.51583\/IJLTEMAS.2025.140300011"},{"key":"e_1_3_5_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/0255761410370658"},{"key":"e_1_3_5_24_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3666"},{"key":"e_1_3_5_25_2","doi-asserted-by":"crossref","unstructured":"Davanzo N Dondi P Mosconi M et al. Playing music with the eyes through an isomorphic interface. In: Proceedings of the Workshop on Communication by Gaze Interaction pp. 1\u20135.","DOI":"10.1145\/3206343.3206350"},{"key":"e_1_3_5_26_2","doi-asserted-by":"crossref","unstructured":"Valencia S Lamb D Williams S et al. Dueto: accessible gaze-operated musical expression. In: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility pp. 513\u2013515.","DOI":"10.1145\/3308561.3354603"},{"key":"e_1_3_5_27_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2016.00906"},{"key":"e_1_3_5_28_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1212562110"},{"key":"e_1_3_5_29_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-010-0073-7"},{"key":"e_1_3_5_30_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2014.00352"},{"key":"e_1_3_5_31_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2024.1520131"},{"key":"e_1_3_5_32_2","unstructured":"Agostinelli A Denk TI Borsos Z et al. Musiclm: Generating music from text. arXiv preprint arXiv:230111325 2023."},{"key":"e_1_3_5_33_2","doi-asserted-by":"publisher","DOI":"10.52202\/075280-2066"},{"key":"e_1_3_5_34_2","doi-asserted-by":"crossref","unstructured":"Hammad N Fraser CA Harpstead E et al. \u201cit\u2019s more of a vibe i\u2019m going for\u201d: Designing text-to-music generation interfaces for video creators. In: Proceedings of the 2025 ACM Designing Interactive Systems Conference pp. 2738\u20132754.","DOI":"10.1145\/3715336.3735814"},{"key":"e_1_3_5_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3689050.3704798"},{"key":"e_1_3_5_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642899"},{"issue":"2","key":"e_1_3_5_37_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3659600","article-title":"Can large language models be good companions? an llm-based eyewear system with conversational common ground","volume":"8","author":"Xu Z","year":"2024","unstructured":"Xu Z, Xu H, Lu Z, et al. Can large language models be good companions? an llm-based eyewear system with conversational common ground. Proc ACM Interact Mob Wearable Ubiquitous Technol 2024; 8(2): 1\u201341. https:\/\/doi.org\/10.1145\/3659600","journal-title":"Proc ACM Interact Mob Wearable Ubiquitous Technol"},{"key":"e_1_3_5_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2024.105347"},{"issue":"1","key":"e_1_3_5_39_2","first-page":"CD006787","article-title":"Music interventions for acquired brain injury","volume":"1","author":"Magee WL","year":"2017","unstructured":"Magee WL, Clark I, Tamplin J, et al. Music interventions for acquired brain injury. Cochrane Database of Systematic Reviews 2017; 1(1): CD006787. https:\/\/doi.org\/10.1002\/14651858.CD006787.pub3","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"e_1_3_5_40_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.68"},{"key":"e_1_3_5_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci12050622"},{"key":"e_1_3_5_42_2","volume-title":"Unimidihub: A prototype of accessible digital musical instruments for musical inclusion","author":"Faschi V","year":"2025","unstructured":"Faschi V. Unimidihub: A prototype of accessible digital musical instruments for musical inclusion, 2025."},{"key":"e_1_3_5_43_2","volume-title":"Dueto: accessible, gaze-operated musical expression","author":"Valencia S","year":"2019","unstructured":"Valencia S, Lamb D, Williams S, et al. Dueto: accessible, gaze-operated musical expression, 2019."},{"key":"e_1_3_5_44_2","doi-asserted-by":"crossref","unstructured":"Davanzo N Valente L Ludovico LA et al. Kiroll: A gaze-based instrument for quadriplegic musicians based on the context-switching paradigm. In: Proceedings of the 18th International Audio Mostly Conference pp. 59\u201362.","DOI":"10.1145\/3616195.3616225"},{"key":"e_1_3_5_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/app16094120"},{"key":"e_1_3_5_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apmr.2012.10.006"},{"key":"e_1_3_5_47_2","volume-title":"Therapeutic instrumental music performance to improve upper extremity function in patients with paresis and apraxia after stroke","author":"Yoo J","year":"2018","unstructured":"Yoo J. Therapeutic instrumental music performance to improve upper extremity function in patients with paresis and apraxia after stroke, 2018."},{"key":"e_1_3_5_48_2","doi-asserted-by":"publisher","DOI":"10.1525\/mp.2002.20.2.151"},{"key":"e_1_3_5_49_2","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1970.10488634"},{"key":"e_1_3_5_50_2","first-page":"1","article-title":"Eye gaze controlled adaptive virtual keyboard for users with ssmi","volume":"33","author":"Divya VJ","year":"2021","unstructured":"Divya VJ, Jain P, Mukhopadhyay A, et al. Eye gaze controlled adaptive virtual keyboard for users with ssmi. Technology and Disability 2021; 33: 1\u201320. https:\/\/doi.org\/10.3233\/TAD-200292","journal-title":"Technology and Disability"}],"container-title":["Journal of Rehabilitation and Assistive Technologies Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20556683261476038","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20556683261476038","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20556683261476038","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T11:19:15Z","timestamp":1786360755000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20556683261476038"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8]]},"references-count":49,"alternative-id":["10.1177\/20556683261476038"],"URL":"https:\/\/doi.org\/10.1177\/20556683261476038","relation":{},"ISSN":["2055-6683","2055-6683"],"issn-type":[{"value":"2055-6683","type":"print"},{"value":"2055-6683","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8]]},"article-number":"20556683261476038"}}