{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T21:27:14Z","timestamp":1778275634080,"version":"3.51.4"},"reference-count":26,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T00:00:00Z","timestamp":1749772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"auspices of the UNESCO Chair on AI &amp; VR"},{"name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>As head-mounted displays (HMDs) with eye tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs free viewing, making multitasking difficult. We present a gaze\u2013hand steering technique that combines eye tracking with hand pointing: users steer only when gaze aligns with a hand-defined target, reducing unintended actions and enabling free look. Speed is controlled via either a joystick or a waist-level speed circle. We evaluated our method in a user study (n = 20) across multitasking and single-task scenarios, comparing it to a similar technique. Results show that gaze\u2013hand steering maintains performance and enhances user comfort and spatial awareness during multitasking. Our findings support using gaze\u2013hand steering in gaze-dominant VR applications requiring precision and simultaneous interaction. Our method significantly improves VR navigation in gaze\u2013dominant, multitasking-intensive applications, supporting immersion and efficient control.<\/jats:p>","DOI":"10.3390\/mti9060061","type":"journal-article","created":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T03:53:12Z","timestamp":1749786792000},"page":"61","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Gaze\u2013Hand Steering for Travel and Multitasking in Virtual Environments"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2323-9690","authenticated-orcid":false,"given":"Mona","family":"Zavichi","sequence":"first","affiliation":[{"name":"Instituto de Engenharia de Sistemas e Computadores Investiga\u00e7\u00e3o e Desenvolvimento em Lisboa (INESC-ID), Rua Alves Redol 9, 1000-029 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9","family":"Santos","sequence":"additional","affiliation":[{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8826-5163","authenticated-orcid":false,"given":"Catarina","family":"Moreira","sequence":"additional","affiliation":[{"name":"Data Science Institute, University of Technology Sydney, Ultimo, NSW 2007, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0780-6555","authenticated-orcid":false,"given":"Anderson","family":"Maciel","sequence":"additional","affiliation":[{"name":"Instituto de Engenharia de Sistemas e Computadores Investiga\u00e7\u00e3o e Desenvolvimento em Lisboa (INESC-ID), Rua Alves Redol 9, 1000-029 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5441-4637","authenticated-orcid":false,"given":"Joaquim","family":"Jorge","sequence":"additional","affiliation":[{"name":"Instituto de Engenharia de Sistemas e Computadores Investiga\u00e7\u00e3o e Desenvolvimento em Lisboa (INESC-ID), Rua Alves Redol 9, 1000-029 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2793","DOI":"10.1109\/TVCG.2019.2905200","article-title":"Magic Carpet: Interaction Fidelity for Flying in VR","volume":"26","author":"Medeiros","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_2","unstructured":"LaViola, J.J., Kruijff, E., McMahan, R.P., Bowman, D., and Poupyrev, I.P. (2017). 3D User Interfaces: Theory and Practice, Addison-Wesley Professional."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jacob, R.J.K. (1990, January 1\u20135). What you look at is what you get: Eye movement-based interaction techniques. Proceedings of the CHI\u201990: SIGCHI Conference on Human Factors in Computing Systems, Seattle, WA, USA.","DOI":"10.1145\/97243.97246"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kang, S., Jeong, J., Lee, G.A., Kim, S.H., Yang, H.J., and Kim, S. (2024, January 11\u201316). The RayHand Navigation: A Virtual Navigation Method with Relative Position between Hand and Gaze-Ray. Proceedings of the CHI\u201924: 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642147"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, D.L., Giordano, M., Benko, H., Grossman, T., and Santosa, S. (2023, January 9\u201311). GazeRayCursor: Facilitating Virtual Reality Target Selection by Blending Gaze and Controller Raycasting. Proceedings of the VRST\u201923: 29th ACM Symposium on Virtual Reality Software and Technology, Christchurch, New Zealand.","DOI":"10.1145\/3611659.3615693"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wagner, U., Lystb\u00e6k, M.N., Manakhov, P., Gr\u00f8nb\u00e6k, J.E.S., Pfeuffer, K., and Gellersen, H. (2023, January 23\u201328). A Fitts\u2019 Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. Proceedings of the CHI\u201923: 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany.","DOI":"10.1145\/3544548.3581423"},{"key":"ref_7","first-page":"141","article-title":"Exploring Gaze for Assisting Freehand Selection-based Text Entry in AR","volume":"6","author":"Pfeuffer","year":"2022","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_8","first-page":"145","article-title":"Gaze-Hand Alignment: Combining Eye Gaze and Mid-Air Pointing for Interacting with Menus in Augmented Reality","volume":"6","author":"Rosenberg","year":"2022","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Suma, E.A., Babu, S., and Hodges, L.F. (2007, January 10\u201311). Comparison of travel techniques in a complex, multi-level 3d environment. Proceedings of the 2007 IEEE Symposium on 3D User Interfaces, Charlotte, NC, USA.","DOI":"10.1109\/3DUI.2007.340788"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Suma, E.A., Finkelstein, S.L., Reid, M., Ulinski, A., and Hodges, L.F. (2009, January 14\u201318). Real walking increases simulator sickness in navigationally complex virtual environments. Proceedings of the 2009 IEEE Virtual Reality Conference, Lafayette, LA, USA.","DOI":"10.1109\/VR.2009.4811037"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TVCG.2012.43","article-title":"Evaluating Display Fidelity and Interaction Fidelity in a Virtual Reality Game","volume":"18","author":"McMahan","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Shumaker, R. (2013). A Study of Navigation and Selection Techniques in Virtual Environments Using Microsoft Kinect\u00ae. Virtual Augmented and Mixed Reality. Designing and Developing Augmented and Virtual Environments, Springer.","DOI":"10.1007\/978-3-642-39405-8"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijhcs.2017.03.006","article-title":"Hip-directed walking-in-place using a single depth camera","volume":"105","author":"Bruno","year":"2017","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lai, C., Hu, X., Segismundo, A., Phadke, A., and McMahan, R.P. (2020, January 9\u201313). The Comfort Benefits of Gaze-Directed Steering. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Recife, Brazil.","DOI":"10.1109\/ISMAR-Adjunct51615.2020.00040"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1109\/TVCG.2009.93","article-title":"Evaluation of the cognitive effects of travel technique in complex real and virtual environments","volume":"16","author":"Suma","year":"2009","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_16","unstructured":"Bowman, D., Koller, D., and Hodges, L. (1997, January 1\u20135). Travel in immersive virtual environments: An evaluation of viewpoint motion control techniques. Proceedings of the IEEE 1997 Annual International Symposium on Virtual Reality, Albuquerque, NM, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Christou, C., Tzanavari, A., Herakleous, K., and Poullis, C. (2016, January 18\u201320). Navigation in virtual reality: Comparison of gaze-directed and pointing motion control. Proceedings of the 2016 18th Mediterranean Electrotechnical Conference (MELECON), Lemesos, Cyprus.","DOI":"10.1109\/MELCON.2016.7495413"},{"key":"ref_18","unstructured":"Zeleznik, R.C., Forsberg, A.S., and Schulze, J.P. (2005). Look-That-There: Exploiting Gaze in Virtual Reality Interactions, Brown University. Tech Report CS-05-12."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4289","DOI":"10.1109\/TVCG.2021.3106507","article-title":"The Cognitive Loads and Usability of Target-based and Steering-based Travel Techniques","volume":"27","author":"Lai","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Habgood, M.J., Wilson, D., Moore, D., and Alapont, S. (2017, January 15\u201318). HCI Lessons From PlayStation VR. Proceedings of the CHI PLAY\u201917: Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, Amsterdam, The Netherlands. Extended Abstracts.","DOI":"10.1145\/3130859.3131437"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zielasko, D., Law, Y.C., and Weyers, B. (2020, January 22\u201326). Take a Look Around\u2014The Impact of Decoupling Gaze and Travel-direction in Seated and Ground-based Virtual Reality Utilizing Torso-directed Steering. Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Atlanta, GA, USA.","DOI":"10.1109\/VR46266.2020.00060"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tregillus, S., Al Zayer, M., and Folmer, E. (2017, January 6\u201311). Handsfree Omnidirectional VR Navigation Using Head Tilt. Proceedings of the CHI\u201917: 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3025453.3025521"},{"key":"ref_23","unstructured":"Medeiros, D., dos Anjos, R.K., Mendes, D., Pereira, J.a.M., Raposo, A., and Jorge, J. (December, January 28). Keep my head on my shoulders! why third-person is bad for navigation in VR. Proceedings of the VRST\u201918: 24th ACM Symposium on Virtual Reality Software and Technology, Tokyo, Japan."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1162\/pres.1994.3.2.130","article-title":"Depth of Presence in Virtual Environments","volume":"3","author":"Slater","year":"1994","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1207\/s15327108ijap0303_3","article-title":"Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness","volume":"3","author":"Kennedy","year":"1993","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_26","unstructured":"Hancock, P.A., and Meshkati, N. (1988). Human Mental Workload, North-Holland."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/6\/61\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:51:12Z","timestamp":1760032272000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/6\/61"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,13]]},"references-count":26,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["mti9060061"],"URL":"https:\/\/doi.org\/10.3390\/mti9060061","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,13]]}}}