{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T09:53:55Z","timestamp":1792230835109,"version":"4.4.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"ETRA","license":[{"start":{"date-parts":[[2022,5,13]],"date-time":"2022-05-13T00:00:00Z","timestamp":1652400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["101021229"],"award-info":[{"award-number":["101021229"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,5,13]]},"abstract":"<jats:p>With eye-tracking increasingly available in Augmented Reality, we explore how gaze can be used to assist freehand gestural text entry. Here the eyes are often coordinated with manual input across the spatial positions of the keys. Inspired by this, we investigate gaze-assisted selection-based text entry through the concept of spatial alignment of both modalities. Users can enter text by aligning both gaze and manual pointer at each key, as a novel alternative to existing dwell-time or explicit manual triggers. We present a text entry user study comparing two of such alignment techniques to a gaze-only and a manual-only baseline. The results show that one alignment technique reduces physical finger movement by more than half compared to standard in-air finger typing, and is faster and exhibits less perceived eye fatigue than an eyes-only dwell-time technique. We discuss trade-offs between uni and multimodal text entry techniques, pointing to novel ways to integrate eye movements to facilitate virtual text entry.<\/jats:p>","DOI":"10.1145\/3530882","type":"journal-article","created":{"date-parts":[[2022,5,13]],"date-time":"2022-05-13T22:17:43Z","timestamp":1652480263000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":49,"title":["Exploring Gaze for Assisting Freehand Selection-based Text Entry in AR"],"prefix":"10.1145","volume":"6","author":[{"given":"Mathias N.","family":"Lystb\u00e6k","sequence":"first","affiliation":[{"name":"Aarhus University, Aarhus, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ken","family":"Pfeuffer","sequence":"additional","affiliation":[{"name":"Aarhus University &amp; Bundeswehr University Munich, Aarhus, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jens Emil Sloth","family":"Gr\u00f8nb\u00e6k","sequence":"additional","affiliation":[{"name":"Aarhus University, Aarhus, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hans","family":"Gellersen","sequence":"additional","affiliation":[{"name":"Lancaster University &amp; Aarhus University, Lancaster, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,5,13]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.16.2.248"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2012.12.003"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2016.1142054"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/259963.260447"},{"key":"e_1_2_2_5_1","unstructured":"Gunnar Borg. 1998. Borg's Perceived Exertion And Pain Scales.  Gunnar Borg. 1998. Borg's Perceived Exertion And Pain Scales."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2015.03.003"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1778331.1778385"},{"key":"e_1_2_2_8_1","volume-title":"Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society","author":"Dudley J.","year":"2019","unstructured":"J. Dudley , H. Benko , D. Wigdor , and P. Kristensson . 2019 . Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society , Los Alamitos, CA, USA, 289--300. https:\/\/doi.org\/10.1109\/ISMAR. 2019 .00027 10.1109\/ISMAR.2019.00027 J. Dudley, H. Benko, D. Wigdor, and P. Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society, Los Alamitos, CA, USA, 289--300. https:\/\/doi.org\/10.1109\/ISMAR.2019.00027"},{"key":"e_1_2_2_9_1","volume-title":"HGaze Typing: HeadGesture Assisted Gaze Typing. In ACM Symposium on Eye Tracking Research and Applications","author":"Feng Wenxin","year":"2021","unstructured":"Wenxin Feng , Jiangnan Zou , Andrew Kurauchi , Carlos H Morimoto , and Margrit Betke . 2021 . HGaze Typing: HeadGesture Assisted Gaze Typing. In ACM Symposium on Eye Tracking Research and Applications ( Virtual Event, Germany) (ETRA '21 Full Papers). Association for Computing Machinery, New York, NY, USA, Article 11, 11 pages. https: \/\/doi.org\/10.1145\/3448017.3457379 10.1145\/3448017.3457379 Wenxin Feng, Jiangnan Zou, Andrew Kurauchi, Carlos H Morimoto, and Margrit Betke. 2021. HGaze Typing: HeadGesture Assisted Gaze Typing. In ACM Symposium on Eye Tracking Research and Applications (Virtual Event, Germany) (ETRA '21 Full Papers). Association for Computing Machinery, New York, NY, USA, Article 11, 11 pages. https: \/\/doi.org\/10.1145\/3448017.3457379"},{"key":"e_1_2_2_10_1","volume-title":"New Trends on Human--Computer Interaction","author":"Gonz\u00e1lez Gabriel","unstructured":"Gabriel Gonz\u00e1lez , Jos\u00e9 P Molina , Arturo S Garc\u00eda , Diego Mart\u00ednez , and Pascual Gonz\u00e1lez . 2009. Evaluation of text input techniques in immersive virtual environments . In New Trends on Human--Computer Interaction . Springer , 109--118. Gabriel Gonz\u00e1lez, Jos\u00e9 P Molina, Arturo S Garc\u00eda, Diego Mart\u00ednez, and Pascual Gonz\u00e1lez. 2009. Evaluation of text input techniques in immersive virtual environments. In New Trends on Human--Computer Interaction. Springer, 109--118."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355020"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97246"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/123078.128728"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.21-17-06917.2001"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858335"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858335"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173655"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1068\/p2935"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1044588.1044680"},{"key":"e_1_2_2_21_1","volume-title":"Exploration of Hands-free Text Entry Techniques For Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 344--349","author":"Lu Xueshi","year":"2020","unstructured":"Xueshi Lu , Difeng Yu , Hai-Ning Liang , Wenge Xu , Yuzheng Chen , Xiang Li , and Khalad Hasan . 2020 . Exploration of Hands-free Text Entry Techniques For Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 344--349 . https:\/\/doi.org\/10.1109\/ISMAR50242.2020.00061 10.1109\/ISMAR50242.2020.00061 Xueshi Lu, Difeng Yu, Hai-Ning Liang, Wenge Xu, Yuzheng Chen, Xiang Li, and Khalad Hasan. 2020. Exploration of Hands-free Text Entry Techniques For Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 344--349. https:\/\/doi.org\/10.1109\/ISMAR50242.2020.00061"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3530886"},{"key":"e_1_2_2_23_1","volume-title":"CHI '03 Extended Abstracts on Human Factors in Computing Systems (Ft.","author":"MacKenzie I. Scott","unstructured":"I. Scott MacKenzie and R. William Soukoreff . 2003. Phrase Sets for Evaluating Text Entry Techniques . In CHI '03 Extended Abstracts on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA ) (CHI EA '03). Association for Computing Machinery , New York, NY, USA, 754--755. https:\/\/doi.org\/10.1145\/765891.765971 10.1145\/765891.765971 I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI EA '03). Association for Computing Machinery, New York, NY, USA, 754--755. https:\/\/doi.org\/10.1145\/765891.765971"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518758"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/507072.507076"},{"key":"e_1_2_2_26_1","volume-title":"Mikkel R\u00f8nne Jakobsen, and Kasper Hornb\u00e6k","author":"Markussen Anders","year":"2013","unstructured":"Anders Markussen , Mikkel R\u00f8nne Jakobsen, and Kasper Hornb\u00e6k . 2013 . Selection-Based Mid-Air Text Entry on Large Displays. In INTERACT. Anders Markussen, Mikkel R\u00f8nne Jakobsen, and Kasper Hornb\u00e6k. 2013. Selection-Based Mid-Air Text Entry on Large Displays. In INTERACT."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117309.1117345"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025517"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724728"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647397"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807460"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131277.3132180"},{"key":"e_1_2_2_33_1","volume-title":"Empirical Evaluation of Gaze-Enhanced Menus in Virtual Reality. In 26th ACM Symposium on Virtual Reality Software and Technology","author":"Pfeuffer Ken","year":"2020","unstructured":"Ken Pfeuffer , Lukas Mecke , Sarah Delgado Rodriguez , Mariam Hassib , Hannah Maier , and Florian Alt . 2020 . Empirical Evaluation of Gaze-Enhanced Menus in Virtual Reality. In 26th ACM Symposium on Virtual Reality Software and Technology ( Virtual Event, Canada) (VRST '20). Association for Computing Machinery, New York, NY, USA, Article 20, 11 pages. https:\/\/doi.org\/10.1145\/3385956.34 18962 10.1145\/3385956.3418962 Ken Pfeuffer, Lukas Mecke, Sarah Delgado Rodriguez, Mariam Hassib, Hannah Maier, and Florian Alt. 2020. Empirical Evaluation of Gaze-Enhanced Menus in Virtual Reality. In 26th ACM Symposium on Virtual Reality Software and Technology (Virtual Event, Canada) (VRST '20). Association for Computing Machinery, New York, NY, USA, Article 20, 11 pages. https:\/\/doi.org\/10.1145\/3385956.3418962"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the 1997 Symposium on Interactive 3D Graphics","author":"Pierce Jeffrey S.","unstructured":"Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , and Mark R. Mine . 1997. Image Plane Interaction Techniques in 3D Immersive Environments . In Proceedings of the 1997 Symposium on Interactive 3D Graphics ( Providence, Rhode Island, USA) (I3D '97). Association for Computing Machinery, New York, NY, USA, 39--ff. https:\/\/doi.org\/10.1145\/253284.253303 10.1145\/253284.253303 Jeffrey S. Pierce, Andrew S. Forsberg, Matthew J. Conway, Seung Hong, Robert C. Zeleznik, and Mark R. Mine. 1997. Image Plane Interaction Techniques in 3D Immersive Environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (Providence, Rhode Island, USA) (I3D '97). Association for Computing Machinery, New York, NY, USA, 39--ff. https:\/\/doi.org\/10.1145\/253284.253303"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598153.2598157"},{"key":"e_1_2_2_36_1","volume-title":"Proc. SIGCHI Conference on Human Factors in Computing Systems","author":"Linda","year":"2040","unstructured":"Linda E. Sibert and Robert J. K. Jacob. 2000. Evaluation of Eye Gaze Interaction . In Proc. SIGCHI Conference on Human Factors in Computing Systems ( The Hague, The Netherlands) (CHI '00). ACM, New York, USA, 281--288. https:\/\/doi.org\/10.1145\/33 2040 .332445 10.1145\/332040.332445 Linda E. Sibert and Robert J. K. Jacob. 2000. Evaluation of Eye Gaze Interaction. In Proc. SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI '00). ACM, New York, USA, 281--288. https:\/\/doi.org\/10.1145\/332040.332445"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314111.3319815"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642632"},{"key":"e_1_2_2_39_1","volume-title":"Pascal Ziegler, and Antonio Kr\u00fcger.","author":"Speicher Marco","year":"2018","unstructured":"Marco Speicher , Anna Maria Feit , Pascal Ziegler, and Antonio Kr\u00fcger. 2018 . Selection-Based Text Entry in Virtual Reality. Association for Computing Machinery , New York, NY, USA, 1--13. https:\/\/doi.org\/10.1145\/3173574.3174221 10.1145\/3173574.3174221 Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Kr\u00fcger. 2018. Selection-Based Text Entry in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1--13. https:\/\/doi.org\/10.1145\/3173574.3174221"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208709"},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of the Symposium on Eye Tracking Research and Applications","author":"Tula Antonio Diaz","unstructured":"Antonio Diaz Tula , Filipe M. S. de Campos , and Carlos H. Morimoto . 2012. Dynamic Context Switching for Gaze Based Interaction . In Proceedings of the Symposium on Eye Tracking Research and Applications ( Santa Barbara, California) (ETRA '12). Association for Computing Machinery, New York, NY, USA, 353--356. https:\/\/doi.org\/10.1145\/2168556.2168635 10.1145\/2168556.2168635 Antonio Diaz Tula, Filipe M. S. de Campos, and Carlos H. Morimoto. 2012. Dynamic Context Switching for Gaze Based Interaction. In Proceedings of the Symposium on Eye Tracking Research and Applications (Santa Barbara, California) (ETRA '12). Association for Computing Machinery, New York, NY, USA, 353--356. https:\/\/doi.org\/10.1145\/2168556.2168635"},{"key":"e_1_2_2_42_1","volume-title":"Human-Computer Interaction INTERACT '97","author":"Velichkovsky Boris","unstructured":"Boris Velichkovsky , Andreas Sprenger , and Pieter Unema . 1997. Towards gaze-mediated interaction: Collecting solutions of the \"Midas touch problem \". In Human-Computer Interaction INTERACT '97 . Springer , Boston, MA , 509--516. https:\/\/doi.org\/10.1007\/978-0--387--35175--9_77 10.1007\/978-0--387--35175--9_77 Boris Velichkovsky, Andreas Sprenger, and Pieter Unema. 1997. Towards gaze-mediated interaction: Collecting solutions of the \"Midas touch problem\". In Human-Computer Interaction INTERACT '97. Springer, Boston, MA, 509--516. https:\/\/doi.org\/10.1007\/978-0--387--35175--9_77"},{"key":"e_1_2_2_43_1","volume-title":"Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis. Experimental brain research 99, 3","author":"Vercher Jean-Louis","year":"1994","unstructured":"Jean-Louis Vercher , G Magenes , C Prablanc , and GM Gauthier . 1994. Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis. Experimental brain research 99, 3 ( 1994 ), 507--523. Jean-Louis Vercher, G Magenes, C Prablanc, and GM Gauthier. 1994. Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis. Experimental brain research 99, 3 (1994), 507--523."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1038\/418838a"},{"key":"e_1_2_2_45_1","volume-title":"International Conference on Intelligent Decision Technologies. Springer, Springer International Publishing, Cham, 287--296","author":"Weill-Tessier Pierre","year":"2017","unstructured":"Pierre Weill-Tessier and Hans Gellersen . 2017 . Touch input and gaze correlation on tablets . In International Conference on Intelligent Decision Technologies. Springer, Springer International Publishing, Cham, 287--296 . Pierre Weill-Tessier and Hans Gellersen. 2017. Touch input and gaze correlation on tablets. In International Conference on Intelligent Decision Technologies. Springer, Springer International Publishing, Cham, 287--296."},{"key":"e_1_2_2_46_1","volume-title":"Proceedings of the 2008 Symposium on Eye Tracking Research & Applications","author":"Wobbrock Jacob O.","unstructured":"Jacob O. Wobbrock , James Rubinstein , Michael W. Sawyer , and Andrew T. Duchowski . 2008. Longitudinal Evaluation of Discrete Consecutive Gaze Gestures for Text Entry . In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications ( Savannah, Georgia) (ETRA '08). Association for Computing Machinery, New York, NY, USA, 11--18. https:\/\/doi.org\/10.1145\/1344471.1344475 10.1145\/1344471.1344475 Jacob O. Wobbrock, James Rubinstein, Michael W. Sawyer, and Andrew T. Duchowski. 2008. Longitudinal Evaluation of Discrete Consecutive Gaze Gestures for Text Entry. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia) (ETRA '08). Association for Computing Machinery, New York, NY, USA, 11--18. https:\/\/doi.org\/10.1145\/1344471.1344475"},{"key":"e_1_2_2_47_1","volume-title":"Pointing and Selection Methods for Text Entry in Augmented Reality Head Mounted Displays. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 279--288","author":"Xu Wenge","year":"2019","unstructured":"Wenge Xu , Hai-Ning Liang , Anqi He , and Zifan Wang . 2019 . Pointing and Selection Methods for Text Entry in Augmented Reality Head Mounted Displays. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 279--288 . https:\/\/doi.org\/10.1109\/ISMAR.2019.00026 10.1109\/ISMAR.2019.00026 Wenge Xu, Hai-Ning Liang, Anqi He, and Zifan Wang. 2019. Pointing and Selection Methods for Text Entry in Augmented Reality Head Mounted Displays. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 279--288. https:\/\/doi.org\/10.1109\/ISMAR.2019.00026"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025964"},{"key":"e_1_2_2_49_1","first-page":"9","article-title":"The Word-Gesture Keyboard","volume":"55","author":"Zhai Shumin","year":"2012","unstructured":"Shumin Zhai and Per Ola Kristensson . 2012 . The Word-Gesture Keyboard : Reimagining Keyboard Interaction. Commun. ACM 55 , 9 (sep 2012), 91--101. https:\/\/doi.org\/10.1145\/2330667.2330689 10.1145\/2330667.2330689 Shumin Zhai and Per Ola Kristensson. 2012. The Word-Gesture Keyboard: Reimagining Keyboard Interaction. Commun. ACM 55, 9 (sep 2012), 91--101. https:\/\/doi.org\/10.1145\/2330667.2330689","journal-title":"Reimagining Keyboard Interaction. Commun. ACM"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303053"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530882","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3530882","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:26Z","timestamp":1750183766000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,13]]},"references-count":50,"journal-issue":{"issue":"ETRA","published-print":{"date-parts":[[2022,5,13]]}},"alternative-id":["10.1145\/3530882"],"URL":"https:\/\/doi.org\/10.1145\/3530882","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,13]]},"assertion":[{"value":"2022-05-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}