{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T13:41:48Z","timestamp":1781358108120,"version":"3.54.1"},"reference-count":135,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T00:00:00Z","timestamp":1644883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>This document presents a systematic review of Multimodal Human\u2013Computer Interaction. It shows how different types of interaction technologies (virtual reality (VR) and augmented reality, force and vibration feedback devices (haptics), and tracking) are used in different domains (concepts, medicine, physics, human factors\/user experience design, transportation, cultural heritage, and industry). A systematic literature search was conducted identifying 406 articles initially. From these articles, we selected 112 research works that we consider most relevant for the content of this article. The articles were analyzed in-depth from the viewpoint of temporal patterns, frequency of usage in types of technology in different domains, and cluster analysis. The analysis allowed us to answer relevant questions in searching for the next steps in work related to multimodal HCI. We looked at the typical technology type, how the technology type and frequency have changed in time over each domain, and how papers are grouped across metrics given their similarities. This analysis determined that VR and haptics are the most widely used in all domains. While VR is the most used, haptic interaction is presented in an increasing number of applications, suggesting future work on applications that configure VR and haptic together.<\/jats:p>","DOI":"10.3390\/informatics9010013","type":"journal-article","created":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T22:44:47Z","timestamp":1644965087000},"page":"13","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":63,"title":["Systematic Review of Multimodal Human\u2013Computer Interaction"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6843-4863","authenticated-orcid":false,"given":"Jose Daniel","family":"Azofeifa","sequence":"first","affiliation":[{"name":"Department of Engineering and Sciences, Tecnologico de Monterrey, Monterrey 64849, NL, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6000-3452","authenticated-orcid":false,"given":"Julieta","family":"Noguez","sequence":"additional","affiliation":[{"name":"Department of Engineering and Sciences, Tecnologico de Monterrey, Monterrey 64849, NL, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4853-2992","authenticated-orcid":false,"given":"Sergio","family":"Ruiz","sequence":"additional","affiliation":[{"name":"Department of Engineering and Sciences, Tecnologico de Monterrey, Monterrey 64849, NL, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4118-6951","authenticated-orcid":false,"given":"Jos\u00e9 Mart\u00edn","family":"Molina-Espinosa","sequence":"additional","affiliation":[{"name":"Department of Engineering and Sciences, Tecnologico de Monterrey, Monterrey 64849, NL, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6117-7502","authenticated-orcid":false,"given":"Alejandra J.","family":"Magana","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Technology, Purdue University, West Lafayette, IN 47907, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5293-2112","authenticated-orcid":false,"given":"Bedrich","family":"Benes","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Purdue University, West Lafayette, IN 47907, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1177\/1063293X14568814","article-title":"Virtual reality applications in manufacturing industries: Past research, present findings, and future directions","volume":"23","author":"Choi","year":"2015","journal-title":"Concurr. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10055-016-0293-9","article-title":"Industry use of virtual reality in product design and manufacturing: A survey","volume":"21","author":"Berg","year":"2017","journal-title":"Virtual Real."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.12753\/2066-026X-15-020","article-title":"A literature review on immersive virtual reality in education: State of the art and perspectives","volume":"Volume 1","author":"Freina","year":"2015","journal-title":"The International Scientific Conference eLearning and Software for Education"},{"key":"ref_4","first-page":"1","article-title":"A Review of Simulators with Haptic Devices for Medical Training","volume":"40","author":"Noguez","year":"2016","journal-title":"J. Med. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.medengphy.2015.11.021","article-title":"A review of virtual reality based training simulators for orthopaedic surgery","volume":"38","author":"Vaughan","year":"2016","journal-title":"Med. Eng. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Escobar-Castillejos, D., Noguez, J., Bello, F., Neri, L., Magana, A.J., and Benes, B. (2020). A Review of Training and Guidance Systems in Medical Surgery. Appl. Sci., 10.","DOI":"10.3390\/app10175752"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/TOH.2017.2689006","article-title":"Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives","volume":"10","author":"Pacchierotti","year":"2017","journal-title":"IEEE Trans. Haptics"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jung, T., Tom Dieck, M.C., Lee, H., and Chung, N. (2016). Effects of virtual reality and augmented reality on visitor experiences in museum. Information and Communication Technologies in Tourism 2016, Springer.","DOI":"10.1007\/978-3-319-28231-2_45"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3145534","article-title":"A survey of augmented, virtual, and mixed reality for cultural heritage","volume":"11","author":"Bekele","year":"2018","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/MC.2004.139","article-title":"Modeling multimodal human-computer interaction","volume":"37","author":"Obrenovic","year":"2004","journal-title":"Computer"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Anthes, C., Garc\u00eda-Hern\u00e1ndez, R.J., Wiedemann, M., and Kranzlmuller, D. (2016, January 5\u201312). State of the art of virtual reality technology. Proceedings of the 2016 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2016.7500674"},{"key":"ref_12","first-page":"1","article-title":"What Do We Mean by \u201cInteraction\u201d? An Analysis of 35 Years of CHI","volume":"26","author":"Mottelson","year":"2019","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1145\/142413.142427","article-title":"A survey of algorithms for volume visualization","volume":"26","author":"Elvins","year":"1992","journal-title":"ACM Siggraph Comput. Graph."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kucher, K., and Kerren, A. (2015, January 14\u201317). Text visualization techniques: Taxonomy, visual survey, and community insights. Proceedings of the 2015 IEEE Pacific Visualization Symposium (PacificVis), Hangzhou, China.","DOI":"10.1109\/PACIFICVIS.2015.7156366"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1007\/s00371-013-0892-3","article-title":"A survey on information visualization: Recent advances and challenges","volume":"30","author":"Liu","year":"2014","journal-title":"Vis. Comput."},{"key":"ref_16","unstructured":"Desai, P.R., Desai, P.N., Ajmera, K.D., and Mehta, K. (2014). A review paper on oculus rift-a virtual reality headset. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Garz\u00f3n, J. (2021). An Overview of Twenty-Five Years of Augmented Reality in Education. Multimodal Technol. Interact., 5.","DOI":"10.3390\/mti5070037"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3427324","article-title":"Interaction with Virtual Content Using Augmented Reality: A User Study in Assembly Procedures","volume":"4","author":"Marques","year":"2020","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2535923","article-title":"Emergent Effects in Multimodal Feedback from Virtual Buttons","volume":"21","author":"Faeth","year":"2014","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4182","DOI":"10.1016\/j.matpr.2017.02.120","article-title":"Haptic technology: A comprehensive review on its applications and future prospects","volume":"4","author":"Sreelakshmi","year":"2017","journal-title":"Mater. Today Proc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1830","DOI":"10.1001\/jama.299.15.1830","article-title":"Gizmo idolatry","volume":"299","author":"Leff","year":"2008","journal-title":"JAMA"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1803","DOI":"10.1007\/s11192-019-03264-z","article-title":"Web of Science and Scopus language coverage","volume":"121","author":"Thelwall","year":"2019","journal-title":"Scientometrics"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.1002\/asi.21589","article-title":"Ranking of the subject areas of Scopus","volume":"62","year":"2011","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_24","first-page":"105906","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_25","unstructured":"Kitchenham, B., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, Keele University and Durham University Joint Report. Technical Report, Ver.2.3."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1177\/0739456X17723971","article-title":"Guidance on conducting a systematic literature review","volume":"39","author":"Xiao","year":"2019","journal-title":"J. Plan. Educ. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Torres-Carri\u00f3n, P.V., Gonz\u00e1lez-Gonz\u00e1lez, C.S., Aciar, S., and Rodr\u00edguez-Morales, G. (2018, January 17\u201320). Methodology for systematic literature review applied to engineering and education. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON), Santa Cruz de Tenerife, Spain.","DOI":"10.1109\/EDUCON.2018.8363388"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1109\/TVCG.2012.110","article-title":"Visualization and Visual Analysis of Multifaceted Scientific Data: A Survey","volume":"19","author":"Kehrer","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MCG.2013.37","article-title":"Visualizing Large, Heterogeneous Data in Hybrid-Reality Environments","volume":"33","author":"Reda","year":"2013","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s40537-015-0031-2","article-title":"Visualizing Big Data with augmented and virtual reality: Challenges and research agenda","volume":"2","author":"Olshannikova","year":"2015","journal-title":"J. Big Data"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"74","DOI":"10.3389\/frobt.2016.00074","article-title":"Enhancing Our Lives with Immersive Virtual Reality","volume":"3","author":"Slater","year":"2016","journal-title":"Front. Robot. AI"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mihelj, M., Novak, D., and Begus, S. (2014). Interaction with a Virtual Environment. Virtual Reality Technology and Applications, Springer.","DOI":"10.1007\/978-94-007-6910-6"},{"key":"ref_33","first-page":"344","article-title":"Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions","volume":"27","author":"Muhanna","year":"2015","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_34","first-page":"1947","article-title":"Augmented reality vs. virtual reality: Differences and similarities","volume":"5","author":"Chavan","year":"2016","journal-title":"Int. J. Adv. Res. Comput. Eng. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rubio-Tamayo, J.L., Gertrudix Barrio, M., and Garcia Garcia, F. (2017). Immersive Environments and Virtual Reality: Systematic Review and Advances in Communication, Interaction and Simulation. Multimodal Technol. Interact., 1.","DOI":"10.3390\/mti1040021"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Achibet, M., Marchal, M., Argelaguet, F., and L\u00e9cuyer, A. (2014, January 29\u201330). The Virtual Mitten: A novel interaction paradigm for visuo-haptic manipulation of objects using grip force. Proceedings of the 2014 IEEE Symposium on 3D User Interfaces (3DUI), Minneapolis, MN, USA.","DOI":"10.1109\/3DUI.2014.6798843"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"17","DOI":"10.17083\/ijsg.v1i4.24","article-title":"Multimodality with eye tracking and haptics: A new horizon for serious games?","volume":"1","author":"Deng","year":"2014","journal-title":"Int. J. Serious Games"},{"key":"ref_38","unstructured":"Hekler, E.B., Klasnja, P., Froehlich, J.E., and Buman, M.P. (May, January 27). Mind the Theoretical Gap: Interpreting, Using, and Developing Behavioral Theory in HCI Research. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI \u201913, Paris, France."},{"key":"ref_39","unstructured":"Vines, J., Clarke, R., Wright, P., McCarthy, J., and Olivier, P. (May, January 27). Configuring Participation: On How We Involve People in Design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI \u201913, Paris, France."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Diefenbach, S., Kolb, N., and Hassenzahl, M. (2014, January 21\u201325). The \u2018hedonic\u2019 in human-computer interaction: History, contributions, and future research directions. Proceedings of the 2014 Conference on Designing Interactive Systems, Vancouver, BC, Canada.","DOI":"10.1145\/2598510.2598549"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1057\/jos.2014.14","article-title":"Virtual reality for medical training: The state-of-the-art","volume":"9","author":"Ruthenbeck","year":"2015","journal-title":"J. Simul."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/TOH.2012.64","article-title":"Integration of Force Reflection with Tactile Sensing for Minimally Invasive Robotics-Assisted Tumor Localization","volume":"6","author":"Talasaz","year":"2013","journal-title":"IEEE Trans. Haptics"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.cmpb.2013.10.010","article-title":"A haptic pedal for surgery assistance","volume":"116","author":"Gil","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1109\/TOH.2014.2330300","article-title":"Haptic Tumor Augmentation: Exploring Multi-Point Interaction","volume":"7","author":"Jeon","year":"2014","journal-title":"IEEE Trans. Haptics"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Esteban, G., Fern\u00e1ndez, C., Conde, M.A., and Garc\u00eda-Pe\u00f1alvo, F.J. (2014, January 1\u20133). Playing with SHULE: Surgical Haptic Learning Environment. Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality, TEEM \u201914, Salamanca, Spain.","DOI":"10.1145\/2669711.2669907"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ruffaldi, E., Brizzi, F., Filippeschi, A., and Avizzano, C.A. (2015, January 25\u201329). Co-located haptic interaction for virtual USG exploration. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7318667"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TOH.2015.2445768","article-title":"Direct Visuo-Haptic 4D Volume Rendering Using Respiratory Motion Models","volume":"8","author":"Fortmeier","year":"2015","journal-title":"IEEE Trans. Haptics"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.jbi.2014.04.005","article-title":"Collaborative virtual reality based advanced cardiac life support training simulator using virtual reality principles","volume":"51","author":"Khanal","year":"2014","journal-title":"J. Biomed. Informat."},{"key":"ref_49","unstructured":"Hamza-Lup, F.G., Bogdan, C.M., Popovici, D.M., and Costea, O.D. (2019). A Survey of Visuo-Haptic Simulation in Surgical Training. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1002\/rcs.1582","article-title":"Virtual reality training and assessment in laparoscopic rectum surgery","volume":"11","author":"Pan","year":"2015","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.apergo.2018.01.009","article-title":"Immersion of virtual reality for rehabilitation\u2014Review","volume":"69","author":"Rose","year":"2018","journal-title":"Appl. Ergon."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Andaluz, V.H., Salazar, P.J., Escudero, M., Bustamante, C., Silva, M., Quevedo, W., S\u00e1nchez, J.S., Espinosa, E.G., and Rivas, D. (2016). Virtual reality integration with force feedback in upper limb rehabilitation. International Symposium on Visual Computing, Springer.","DOI":"10.1007\/978-3-319-50832-0_25"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Won, A.S., Bailey, J., Bailenson, J., Tataru, C., Yoon, I.A., and Golianu, B. (2017). Immersive Virtual Reality for Pediatric Pain. Children, 4.","DOI":"10.3390\/children4070052"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1111\/eje.12173","article-title":"Survey on multisensory feedback virtual reality dental training systems","volume":"20","author":"Wang","year":"2016","journal-title":"Eur. J. Dent. Educ."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"S747","DOI":"10.3233\/BME-151366","article-title":"Preliminary evaluation of a virtual reality dental simulation system on drilling operation","volume":"26","author":"Wang","year":"2015","journal-title":"Bio-Med. Mater. Eng."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/TOH.2012.21","article-title":"Intention Recognition for Dynamic Role Exchange in Haptic Collaboration","volume":"6","author":"Kucukyilmaz","year":"2013","journal-title":"IEEE Trans. Haptics"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Donalek, C., Djorgovski, S.G., Davidoff, S., Cioc, A., Wang, A., Longo, G., Norris, J.S., Zhang, J., Lawler, E., and Yeh, S. (2014). Immersive and Collaborative Data Visualization Using Virtual Reality Platforms. arXiv.","DOI":"10.1109\/BigData.2014.7004282"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"2041","DOI":"10.1007\/s11042-013-1471-3","article-title":"Haptic interaction with objects in a picture based on pose estimation","volume":"72","author":"Kim","year":"2014","journal-title":"Multimed. Tools Appl."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Kokubun, A., Ban, Y., Narumi, T., Tanikawa, T., and Hirose, M. (2014, January 23\u201326). Representing normal and shearing forces on the mobile device with visuo-haptic interaction and a rear touch interface. Proceedings of the 2014 IEEE Haptics Symposium (HAPTICS), Houston, TX, USA.","DOI":"10.1109\/HAPTICS.2014.6775491"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Nakamura, T., and Yamamoto, A. (2014, January 23\u201326). Multi-finger surface visuo-haptic rendering using electrostatic stimulation with force-direction sensing gloves. Proceedings of the 2014 IEEE Haptics Symposium (HAPTICS), Houston, TX, USA.","DOI":"10.1109\/HAPTICS.2014.6775504"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Yuksel, T., Walsh, Y., Krs, V., Benes, B., Ngambeki, I.B., Berger, E.J., and Magana, A.J. (2017, January 18\u201321). Exploration of affordances of visuo-haptic simulations to learn the concept of friction. Proceedings of the 2017 IEEE Frontiers in Education Conference (FIE), Indianapolis, IN, USA.","DOI":"10.1109\/FIE.2017.8190471"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1376","DOI":"10.1002\/cae.22157","article-title":"Visuohaptic experiments: Exploring the effects of visual and haptic feedback on students\u2019 learning of friction concepts","volume":"27","author":"Yuksel","year":"2019","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Neri, L., Magana, A.J., Noguez, J., Walsh, Y., Gonzalez-Nucamendi, A., Robledo-Rella, V., and Benes, B. (2018, January 3\u20136). Visuo-haptic Simulations to Improve Students\u2019 Understanding of Friction Concepts. Proceedings of the 2018 IEEE Frontiers in Education Conference (FIE), San Jose, CA, USA.","DOI":"10.1109\/FIE.2018.8658439"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Prachyabrued, M., and Borst, C.W. (2014, January 29\u201330). Visual feedback for virtual grasping. Proceedings of the 2014 IEEE Symposium on 3D User Interfaces (3DUI), Minneapolis, MN, USA.","DOI":"10.1109\/3DUI.2014.6798835"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/TOH.2014.2384049","article-title":"Recognition of Haptic Interaction Patterns in Dyadic Joint Object Manipulation","volume":"8","author":"Madan","year":"2015","journal-title":"IEEE Trans. Haptics"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Wang, Z., and Wang, Y. (2014). Haptic Interaction with Fluid Based on Smooth Particles and Finite Elements. Computational Science and Its Applications, Springer. ICCSA 2014 Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-09144-0_56"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Walsh, Y., Magana, A.J., Quintana, J., Krs, V., Coutinho, G., Berger, E., Ngambeki, I.B., Efendy, E., and Benes, B. (2018, January 3\u20136). Designing a Visuohaptic Simulation to Promote Graphical Representations and Conceptual Understanding of Structural Analysis. Proceedings of the 2018 IEEE Frontiers in Education Conference (FIE), San Jose, CA, USA.","DOI":"10.1109\/FIE.2018.8658885"},{"key":"ref_68","first-page":"9","article-title":"Exploring Multimedia Principles for Supporting Conceptual Learning of Electricity and Magnetism with Visuohaptic Simulations","volume":"8","author":"Magana","year":"2017","journal-title":"Comput. Educ. J."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s41239-017-0053-2","article-title":"Undergraduate students\u2019 conceptual interpretation and perceptions of haptic-enabled learning experiences","volume":"14","author":"Shaikh","year":"2017","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1002\/cae.21727","article-title":"Design and implementation of an interactive virtual control laboratory using haptic interface for undergraduate engineering students","volume":"24","author":"Amirkhani","year":"2016","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.compedu.2016.01.001","article-title":"Enhancing learning and engagement through embodied interaction within a mixed reality simulation","volume":"95","author":"Lindgren","year":"2016","journal-title":"Comput. Educ."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/s10055-018-0345-4","article-title":"Haptic virtual reality and immersive learning for enhanced organic chemistry instruction","volume":"23","author":"Edwards","year":"2018","journal-title":"Virtual Real."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/TOH.2012.32","article-title":"Psychophysical Dimensions of Tactile Perception of Textures","volume":"6","author":"Okamoto","year":"2013","journal-title":"IEEE Trans. Haptics"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1080\/10447318.2012.668131","article-title":"Personality and Presence in Virtual Reality: Does Their Relationship Depend on the Used Presence Measure?","volume":"29","author":"Kober","year":"2013","journal-title":"Int. J. -Hum.-Comput. Interact."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Cavrag, M., Larivi\u00e8re, G., Cretu, A.M., and Bouchard, S. (2014, January 10\u201311). Interaction with virtual spiders for eliciting disgust in the treatment of phobias. Proceedings of the 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings, Richardson, TX, USA.","DOI":"10.1109\/HAVE.2014.6954327"},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Odom, W., Zimmerman, J., and Forlizzi, J. (2014, January 21\u201325). Placelessness, Spacelessness, and Formlessness: Experiential Qualities of Virtual Possessions. Proceedings of the 2014 Conference on Designing Interactive Systems, DIS \u201914, Vancouver, BC, Canada.","DOI":"10.1145\/2598510.2598577"},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"869","DOI":"10.3389\/fpsyg.2015.00869","article-title":"Studying social interactions through immersive virtual environment technology: Virtues, pitfalls, and future challenges","volume":"6","author":"Bombari","year":"2015","journal-title":"Front. Psychol."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Ahmed, I., Harjunen, V., Jacucci, G., Hoggan, E., Ravaja, N., and Spap\u00e9, M.M. (2016, January 12\u201316). Reach out and touch me: Effects of four distinct haptic technologies on affective touch in virtual reality. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2993171"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"e1729","DOI":"10.1002\/cav.1729","article-title":"Interaction with virtual crowd in Immersive and semi-Immersive Virtual Reality systems","volume":"28","author":"Kyriakou","year":"2017","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TOH.2012.2","article-title":"The role of haptic feedback for the integration of intentions in shared task execution","volume":"6","author":"Groten","year":"2013","journal-title":"IEEE Trans. Haptics"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.advengsoft.2014.05.009","article-title":"Quantitative assessment of the effectiveness of using display techniques with a haptic device for manipulating 3D objects in virtual environments","volume":"76","author":"Aras","year":"2014","journal-title":"Adv. Eng. Softw."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"28:1","DOI":"10.1145\/2540991","article-title":"A Quality of Experience Model for Haptic Virtual Environments","volume":"10","author":"Hamam","year":"2014","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Achibet, M., Girard, A., Talvas, A., Marchal, M., and L\u00e9cuyer, A. (2015, January 23\u201327). Elastic-Arm: Human-scale passive haptic feedback for augmenting interaction and perception in virtual environments. Proceedings of the 2015 IEEE Virtual Reality (VR), Arles, France.","DOI":"10.1109\/VR.2015.7223325"},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Fittkau, F., Krause, A., and Hasselbring, W. (2015, January 27\u201328). Exploring software cities in virtual reality. Proceedings of the 2015 IEEE 3rd Working Conference on Software Visualization (VISSOFT), Bremen, Germany.","DOI":"10.1109\/VISSOFT.2015.7332423"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Moran, A., Gadepally, V., Hubbell, M., and Kepner, J. (2015, January 15\u201317). Improving Big Data visual analytics with interactive virtual reality. Proceedings of the 2015 IEEE High Performance Extreme Computing Conference (HPEC), Waltham, MA, USA.","DOI":"10.1109\/HPEC.2015.7322473"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Atienza, R., Blonna, R., Saludares, M.I., Casimiro, J., and Fuentes, V. (2016, January 9\u201311). Interaction techniques using head gaze for virtual reality. Proceedings of the 2016 IEEE Region 10 Symposium (TENSYMP), Bali, Indonesia.","DOI":"10.1109\/TENCONSpring.2016.7519387"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Carvalheiro, C., N\u00f3brega, R., da Silva, H., and Rodrigues, R. (2016, January 23\u201327). User redirection and direct haptics in virtual environments. Proceedings of the 24th ACM international conference on Multimedia, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2964293"},{"key":"ref_88","unstructured":"Chen, Y.S., Han, P.H., Hsiao, J.C., Lee, K.C., Hsieh, C.E., Lu, K.Y., Chou, C.H., and Hung, Y.P. (2016, January 16\u201319). SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Matsumoto, K., Ban, Y., Narumi, T., Yanase, Y., Tanikawa, T., and Hirose, M. (2016, January 5\u20138). Unlimited Corridor: Redirected Walking Techniques Using Visuo Haptic Interaction. Proceedings of the ACM SIGGRAPH 2016 Emerging Technologies, SIGGRAPH \u201916, Macao, China.","DOI":"10.1145\/2929464.2929482"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Kim, M., Jeon, C., and Kim, J. (2017). A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality. Sensors, 17.","DOI":"10.3390\/s17051141"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Lee, J., Kim, M., and Kim, J. (2017). A Study on Immersion and VR Sickness in Walking Interaction for Immersive Virtual Reality Applications. Symmetry, 9.","DOI":"10.3390\/sym9050078"},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"42","DOI":"10.3389\/frobt.2017.00042","article-title":"Wearable vibrotactile haptic device for stiffness discrimination during virtual interactions","volume":"4","author":"Maereg","year":"2017","journal-title":"Front. Robot. AI"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Piumsomboon, T., Lee, G., Lindeman, R.W., and Billinghurst, M. (2017, January 18\u201319). Exploring natural eye-gaze-based interaction for immersive virtual reality. Proceedings of the 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA, USA.","DOI":"10.1109\/3DUI.2017.7893315"},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10055-019-00378-w","article-title":"Open data exploration in virtual reality: A comparative study of input technology","volume":"24","author":"Reski","year":"2019","journal-title":"Virtual Real."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.trf.2012.12.011","article-title":"Driving performance during visual and haptic menu selection with in-vehicle rotary device","volume":"18","author":"Grane","year":"2013","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Kemeny, A. (2014, January 9\u201311). From driving simulation to virtual reality. Proceedings of the 2014 Virtual Reality International Conference, Laval, France.","DOI":"10.1145\/2617841.2620721"},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Altendorf, E., Baltzer, M., Heesen, M., Kienle, M., Weissgerber, T., and Flemisch, F. (2014). H-Mode: A haptic-multimodal interaction concept for cooperative guidance and control of partially and highly automated vehicles. Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort, Springer.","DOI":"10.1007\/978-3-319-09840-1_60-1"},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1109\/TOH.2013.2295095","article-title":"Analysis of Human-Machine Cooperation When Driving with Different Degrees of Haptic Shared Control","volume":"7","author":"Mars","year":"2014","journal-title":"IEEE Trans. Haptics"},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zheng, R., Kaizuka, T., and Nakano, K. (2018, January 26\u201330). Driver-automation shared control: Modeling driver behavior by taking account of reliance on haptic guidance steering. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500671"},{"key":"ref_100","doi-asserted-by":"crossref","unstructured":"Stamer, M., Michaels, J., and T\u00fcmler, J. (2020). Investigating the Benefits of Haptic Feedback During In-Car Interactions in Virtual Reality. International Conference on Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-030-50523-3_29"},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Aslandere, T., Dreyer, D., and Pankratz, F. (2015, January 7\u201314). Virtual hand-button interaction in a generic virtual reality flight simulator. Proceedings of the 2015 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2015.7118876"},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"Li, L., and Zhou, J. (2016, January 3\u20134). Virtual reality technology based developmental designs of multiplayer-interaction-supporting exhibits of science museums: Taking the exhibit of \u201cvirtual experience on an aircraft carrier\u201d in China science and technology museum as an example. Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, Zhuhai, China.","DOI":"10.1145\/3013971.3014018"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"17","DOI":"10.2514\/1.D0056","article-title":"Force-Feedback Integration with NASA\u2019s Next Generation Air Transportation System Cockpit Situation Display","volume":"25","author":"Marayong","year":"2017","journal-title":"J. Air Transp."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s10111-017-0421-7","article-title":"A virtual reality flight simulator for human factors engineering","volume":"19","author":"Oberhauser","year":"2017","journal-title":"Cogn. Technol. Work."},{"key":"ref_105","first-page":"21","article-title":"Virtual reality flight simulator","volume":"9","author":"Valentino","year":"2017","journal-title":"Internetworking Indones. J."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s00779-013-0647-1","article-title":"Multimedia augmented reality information system for museum guidance","volume":"18","author":"Chen","year":"2014","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Shumaker, R., and Lackey, S. (2014). Touching the Past: Haptic Augmented Reality for Museum Artefacts. Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality, Springer International Publishing.","DOI":"10.1007\/978-3-319-07464-1"},{"key":"ref_108","unstructured":"Papaefthymiou, M., Plelis, K., Mavromatis, D., and Papagiannakis, G. (2015). Mobile Virtual Reality Featuring a Six Degrees of Freedom Interaction Paradigm in a Virtual Museum Application, Institute of Computer Science. Available online: https:\/\/fdocument.org\/document\/mobile-virtual-reality-featuring-a-six-degrees-of-freedom-google-cardboard.html."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"361","DOI":"10.5194\/isprs-archives-XLII-2-W3-361-2017","article-title":"Development of a virtual museum including a 4D presentation of building history in virtual reality","volume":"42","author":"Kersten","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_110","doi-asserted-by":"crossref","unstructured":"Tsai, T.H., Shen, C.Y., Lin, Z.S., Liu, H.R., and Chiou, W.K. (2017). Exploring location-based augmented reality experience in museums. International Conference on Universal Access in Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-319-58703-5_15"},{"key":"ref_111","doi-asserted-by":"crossref","unstructured":"Carrozzino, M., Colombo, M., Tecchia, F., Evangelista, C., and Bergamasco, M. (2018). Comparing different storytelling approaches for virtual guides in digital immersive museums. International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Springer.","DOI":"10.1007\/978-3-319-95282-6_22"},{"key":"ref_112","first-page":"1","article-title":"Immersia, an open immersive infrastructure: Doing archaeology in virtual reality","volume":"5","author":"Gaugne","year":"2014","journal-title":"Archeol. Calc."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2611375","article-title":"Interacting with virtual reconstructions in museums: The Etruscanning Project","volume":"7","author":"Pietroni","year":"2014","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1007\/s12008-017-0414-z","article-title":"User-centered design of a virtual reality exhibit for archaeological museums","volume":"12","author":"Barbieri","year":"2018","journal-title":"Int. J. Interact. Des. Manuf."},{"key":"ref_115","first-page":"1","article-title":"Virtual and augmented reality for rich interaction with cultural heritage sites: A case study from the Roman Theater at Byblos","volume":"5","author":"Younes","year":"2017","journal-title":"Digit. Appl. Archaeol. Cult. Herit."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1108\/AA-03-2013-017","article-title":"Interactive assembly simulation with haptic feedback","volume":"33","author":"Perret","year":"2013","journal-title":"Assem. Autom."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1007\/s00170-013-5207-3","article-title":"Virtual human modeling for interactive assembly and disassembly operation in virtual reality environment","volume":"69","author":"Qiu","year":"2013","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1108\/01445151311306672","article-title":"A review of virtual reality and haptics for product assembly: From rigid parts to soft cables","volume":"33","author":"Xia","year":"2013","journal-title":"Assem. Autom."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1108\/AA-03-2013-023","article-title":"The development of a physics and constraint-based haptic virtual assembly system","volume":"34","author":"Lim","year":"2014","journal-title":"Assem. Autom."},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Hamid, N.S.S., Aziz, F.A., and Azizi, A. (2014, January 27\u201329). Virtual reality applications in manufacturing system. Proceedings of the 2014 Science and Information Conference, London, UK.","DOI":"10.1109\/SAI.2014.6918317"},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"041007","DOI":"10.1115\/1.4028588","article-title":"The influence of interaction technology on the learning of assembly tasks using virtual reality","volume":"14","author":"Arce","year":"2014","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ifacol.2015.06.065","article-title":"Haptics assisted virtual assembly","volume":"48","author":"Abidi","year":"2015","journal-title":"IFAC-PapersOnLine"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1080\/10494820.2013.815221","article-title":"Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks","volume":"23","author":"Gavish","year":"2015","journal-title":"Interact. Learn. Environ."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/j.procs.2015.12.258","article-title":"Immersive and haptic educational simulations of assembly workplace conditions","volume":"75","author":"Grajewski","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1080\/10447318.2014.994194","article-title":"Augmented Reality-Based Manual Assembly Support with Visual Features for Different Degrees of Difficulty","volume":"31","author":"Radkowski","year":"2015","journal-title":"Int. J.-Hum.-Comput. Interact."},{"key":"ref_126","first-page":"1687814016639824","article-title":"Development of a virtual manufacturing assembly simulation system","volume":"8","author":"Abidi","year":"2016","journal-title":"Adv. Mech. Eng."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.rcim.2016.03.005","article-title":"Real-virtual components interaction for assembly simulation and planning","volume":"41","author":"Wang","year":"2016","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1109\/TOH.2016.2554551","article-title":"Haptics for product design and manufacturing simulation","volume":"9","author":"Xia","year":"2016","journal-title":"IEEE Trans. Haptics"},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"30651","DOI":"10.1007\/s11042-018-6216-x","article-title":"Virtual reality training for assembly of hybrid medical devices","volume":"77","author":"Ho","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.rcim.2019.05.004","article-title":"A training system for Industry 4.0 operators in complex assemblies based on virtual reality and process mining","volume":"59","author":"Crespo","year":"2019","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.ifacol.2018.08.235","article-title":"Integrating Haptic Interaction into a Virtual Training System for Manual Procedures in Industrial Environments","volume":"51","author":"Loch","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_132","unstructured":"Gurman, M. (2020). Facebook\u2019s Oculus Is Developing a New Quest VR Headset."},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TCOM.1973.1091610","article-title":"The Bidirectional Communication Theory\u2014A Generalization of Information Theory","volume":"21","author":"Marko","year":"1973","journal-title":"IEEE Trans. Commun."},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.jbusres.2019.01.017","article-title":"Exploring barriers to adoption of Virtual Reality through Social Media Analytics and Machine Learning\u2014An assessment of technology, network, price and trialability","volume":"100","author":"Laurell","year":"2019","journal-title":"J. Bus. Res."},{"key":"ref_135","unstructured":"Heinonen, M. (2018, January 17\u201320). Adoption of VR and AR technologies in the enterprise. Proceedings of the ISPIM Innovation Conference\u2014Innovation, The Name of The Game, Stockholm, Sweden."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/13\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:19:53Z","timestamp":1760134793000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/13"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,15]]},"references-count":135,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["informatics9010013"],"URL":"https:\/\/doi.org\/10.3390\/informatics9010013","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,15]]}}}