{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:26:40Z","timestamp":1766068000991,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:00:00Z","timestamp":1721001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korea government (MSIT, MOIS, MOLIT, and MOTIE)","award":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"],"award-info":[{"award-number":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"]}]},{"name":"Korean Ministry of Interior and Safety (MOIS)","award":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"],"award-info":[{"award-number":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"]}]},{"name":"Korea government (MSIT)","award":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"],"award-info":[{"award-number":["2020-0-00061","2019-MOIS34-001","2021R1F1A1046513"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Recently, VR-based training applications have become popular and promising, as they can simulate real-world situations in a safe, repeatable, and cost-effective way. For immersive simulations, various input devices have been designed and proposed to increase the effectiveness of training. In this study, we developed a novel device that generates 3D hand motion data and provides haptic force feedback for VR interactions. The proposed device can track 3D hand positions using a combination of the global position estimation of ultrasonic sensors and the hand pose estimation of inertial sensors in real time. For haptic feedback, shape\u2013memory alloy (SMA) actuators were designed to provide kinesthetic forces and an efficient power control without an overheat problem. Our device improves upon the shortcomings of existing commercial devices in tracking and haptic capabilities such that it can track global 3D positions and estimate hand poses in a VR space without using an external suit or tracker. For better flexibility in handling and feeling physical objects compared to exoskeleton-based devices, we introduced an SMA-based actuator to control haptic forces. Overall, our device was designed and implemented as a lighter and less bulky glove which provides comparable accuracy and performance in generating 3D hand motion data for a VR training application (i.e., the use of a fire extinguisher), as demonstrated in the experimental results.<\/jats:p>","DOI":"10.3390\/mti8070062","type":"journal-article","created":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T15:17:06Z","timestamp":1721056626000},"page":"62","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["3D Hand Motion Generation for VR Interactions Using a Haptic Data Glove"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7400-3966","authenticated-orcid":false,"given":"Sang-Woo","family":"Seo","sequence":"first","affiliation":[{"name":"Defense and Safety Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea"}]},{"given":"Woo-Sug","family":"Jung","sequence":"additional","affiliation":[{"name":"Defense and Safety Convergence Research Division, Electronics and Telecommunications Research Institute, Daejeon 34129, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4209-4266","authenticated-orcid":false,"given":"Yejin","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Games, Hongik University, Sejong 30016, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1002\/hfm.20702","article-title":"Effects of Three-Dimensional Virtual Reality and Traditional Training Methods on Mental Workload and Training Performance","volume":"27","author":"Chao","year":"2017","journal-title":"Hum. Factors Ergon. Manuf. Serv. Ind."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tan, Y., Xu, W., Li, S., and Chen, K. (2022). Augmented and Virtual Reality (AR\/VR) for Education and Training in the AEC Industry: A Systematic Review of Research and Applications. Buildings, 12.","DOI":"10.3390\/buildings12101529"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xie, B., Liu, H., Alghofaili, R., Zhang, Y., Jiang, Y., Lobo, F.D., Li, C., Li, W., Huang, H., and Akdere, M. (2021). A Review on Virtual Reality Skill Training Applications. Front. Virtual Real., 2.","DOI":"10.3389\/frvir.2021.645153"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"103778","DOI":"10.1016\/j.compedu.2019.103778","article-title":"A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda","volume":"147","author":"Radianti","year":"2020","journal-title":"Comput. Educ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.ifacol.2018.08.235","article-title":"Integrating Haptic Interaction into a Virtual Training System for Manual Procedures in Industrial Environments","volume":"51","author":"Loch","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Seo, S.-W., Kwon, S., Hassan, W., Talhan, A., and Jeon, S. (2019, January 12\u201315). Interactive Virtual-Reality Fire Extinguisher with Haptic Feedback. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Parramatta, NSW, Australia.","DOI":"10.1145\/3359996.3364725"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Saghafian, M., Laumann, K., Akhtar, R.S., and Skogstad, M.R. (2020). The Evaluation of Virtual Reality Fire Extinguisher Training. Front. Psychol., 11.","DOI":"10.3389\/fpsyg.2020.593466"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Arora, J., Saini, A., Mehra, N., Jain, V., Shrey, S., and Parnami, A. (2019, January 4\u20139). VirtualBricks: Exploring a Scalable, Modular Toolkit for Enabling Physical Manipulation in VR. Proceedings of the CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300286"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhu, K., Chen, T., Han, F., and Wu, Y.-S. (2019, January 4\u20139). HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts. Proceedings of the CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300923"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shigeyama, J., Hashimoto, T., Yoshida, S., Narumi, T., Tanikawa, T., and Hirose, M. (2019, January 4\u20139). Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model. Proceedings of the CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300241"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zenner, A., and Kr\u00fcger, A. (2019, January 4\u20139). Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. Proceedings of the CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300441"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Baek, S., Gil, Y.-H., and Kim, Y. (2021). VR-Based Job Training System Using Tangible Interactions. Sensors, 21.","DOI":"10.3390\/s21206794"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3184","DOI":"10.1109\/ACCESS.2017.2787601","article-title":"Pneumatic Actuation in Haptic-Enabled Medical Simulators: A Review","volume":"6","author":"Talhan","year":"2017","journal-title":"Access"},{"key":"ref_14","unstructured":"(2024, May 01). VRgluv. Available online: https:\/\/kickstarter.com."},{"key":"ref_15","unstructured":"(2024, May 01). BeBop Data Glove. Available online: https:\/\/www.youtube.com\/@BeBopSensors\/featured."},{"key":"ref_16","unstructured":"(2024, May 01). Home Hi5 VR Glove. Available online: https:\/\/hi5vrglove.com\/."},{"key":"ref_17","unstructured":"(2024, May 01). MANUS Prime Glove. Available online: https:\/\/www.manus-meta.com."},{"key":"ref_18","unstructured":"(2024, May 01). Teslasuit Glove. Available online: https:\/\/teslasuit.io."},{"key":"ref_19","unstructured":"(2024, May 01). CyberGlove Systems. Available online: http:\/\/www.cyberglovesystems.com."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shen, Z., Yi, J., Li, X., Mark, L.H.P., Hu, Y., and Wang, Z. (2016, January 6\u201310). A Soft Stretchable Bending Sensor and Data Glove Applications. Proceedings of the 2016 IEEE International Conference on Real-Time Computing and Robotics (RCAR), Angkor Wat, Cambodia.","DOI":"10.1109\/RCAR.2016.7784006"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1700136","DOI":"10.1002\/admt.201700136","article-title":"Batch Fabrication of Customizable Silicone-Textile Composite Capacitive Strain Sensors for Human Motion Tracking","volume":"2","author":"Atalay","year":"2017","journal-title":"Adv. Mater. Technol."},{"key":"ref_22","unstructured":"O\u2019Flynn, B., Sanchez, T., Connolly, J., Curran, K., Gardiner, P., Ireland, N., and Downes, B. (2015, January 23). Integrated Smart Glove for Hand Motion Monitoring. Proceedings of the SENSORDEVICES 2015, Venice, Italy."},{"key":"ref_23","unstructured":"(2024, May 01). VIVE Tracker. Available online: https:\/\/www.vive.com\/kr\/accessory\/tracker3\/."},{"key":"ref_24","unstructured":"(2024, May 01). HTC VIVE. Available online: https:\/\/www.vive.com."},{"key":"ref_25","unstructured":"(2024, May 01). Meta Quest. Available online: https:\/\/www.meta.com."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kuhlmann de Canaviri, L., Meiszl, K., Hussein, V., Abbassi, P., Mirraziroudsari, S.D., Hake, L., Potthast, T., Ratert, F., Schulten, T., and Silberbach, M. (2023). Static and Dynamic Accuracy and Occlusion Robustness of SteamVR Tracking 2.0 in Multi-Base Station Setups. Sensors, 23.","DOI":"10.3390\/s23020725"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Simeone, L., Velloso, E., and Gellersen, H. (2015, January 18\u201323). Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. Proceedings of the CHI Conference on Human Factors in Computing Systems, Seoul, Republic of Korea.","DOI":"10.1145\/2702123.2702389"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hinchet, R., Vechev, V., Shea, H., and Hilliges, O. (2018, January 11). DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. Proceedings of the Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, Berlin, Germany.","DOI":"10.1145\/3242587.3242657"},{"key":"ref_29","unstructured":"Bouzit, M., Popescu, G., Burdea, G., and Boian, R. (2002, January 24\u201325). The Rutgers Master II-ND Force Feedback Glove. Proceedings of the Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS 2002), Orlando, FL, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fujimoto, K., Kobayashi, F., Nakamoto, H., and Kojima, F. (2013, January 15\u201317). Development of Haptic Device for Five-Fingered Robot Hand Teleoperation. Proceedings of the Proceedings of the 2013 IEEE\/SICE International Symposium on System Integration, Kobe, Japan.","DOI":"10.1109\/SII.2013.6776746"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Patterson, Z.J., Sabelhaus, A.P., Chin, K., Hellebrekers, T., and Majidi, C. (2020, January 24). An Untethered Brittle Star-Inspired Soft Robot for Closed-Loop Underwater Locomotion. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341008"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Seo, S.-W., Yun, S., Kim, M.-G., Sung, M., and Kim, Y. (2019). Screen-Based Sports Simulation Using Acoustic Source Localization. Appl. Sci., 9.","DOI":"10.3390\/app9152970"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Madgwick, S.O.H., Harrison, A.J.L., and Vaidyanathan, R. (July, January 29). Estimation of IMU and MARG Orientation Using a Gradient Descent Algorithm. Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics, Zurich, Switzerland.","DOI":"10.1109\/ICORR.2011.5975346"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hong, S., and Kim, Y. (2018). Dynamic Pose Estimation Using Multiple RGB-D Cameras. Sensors, 18.","DOI":"10.3390\/s18113865"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/0363-5023(90)90102-W","article-title":"Functional Range of Motion of the Joints of the Hand","volume":"15","author":"Hume","year":"1990","journal-title":"J. Hand Surg."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bullock, I.M., Borras, J., and Dollar, A.M. (2012, January 24\u201327). Assessing Assumptions in Kinematic Hand Models: A Review. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.","DOI":"10.1109\/BioRob.2012.6290879"},{"key":"ref_37","unstructured":"(2024, May 01). TEGWAY. Available online: https:\/\/tegway.cafe24.com\/tegway."},{"key":"ref_38","unstructured":"(2024, May 01). Hagisonic. Available online: http:\/\/hagisonic.com."},{"key":"ref_39","unstructured":"(2024, May 01). Knowles. Available online: http:\/\/knowles.com."},{"key":"ref_40","unstructured":"(2024, May 01). Analog Devices. Available online: http:\/\/analog.com."},{"key":"ref_41","unstructured":"(2024, May 01). TDK. Available online: http:\/\/invensense.tdk.com."},{"key":"ref_42","unstructured":"(2024, May 01). STMicroelectronics. Available online: http:\/\/st.com."},{"key":"ref_43","unstructured":"(2024, May 01). Silicon Labs. Available online: http:\/\/silabs.com."},{"key":"ref_44","unstructured":"(2024, May 01). OptiTrack. Available online: http:\/\/optitrack.com."},{"key":"ref_45","unstructured":"(2024, May 01). Texas Instruments. Available online: http:\/\/ti.com."},{"key":"ref_46","unstructured":"(2024, May 01). Infineon Technologies. Available online: https:\/\/www.infineon.com."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/7\/62\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:16:57Z","timestamp":1760109417000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/7\/62"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,15]]},"references-count":46,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["mti8070062"],"URL":"https:\/\/doi.org\/10.3390\/mti8070062","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2024,7,15]]}}}