{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T07:23:56Z","timestamp":1760081036075,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:00:00Z","timestamp":1739404800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"CONAHCYT","award":["CVU 660708"],"award-info":[{"award-number":["CVU 660708"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Using the senses is essential to interacting with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: (i) experience design, (ii) sensory representation, (iii) development, (iv) display, and (v) fusion. The first stage is the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth stage for fusion in the user experience. The diamond methodology was tested by generating a user\u2019s dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object\u2019s deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology.<\/jats:p>","DOI":"10.3390\/mti9020015","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T04:03:35Z","timestamp":1739419415000},"page":"15","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Diamond Approach to Develop Virtual Object Interaction: Fusing Augmented Reality and Kinesthetic Haptics"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9854-1387","authenticated-orcid":false,"given":"Alma","family":"Rodriguez-Ramirez","sequence":"first","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Universidad Aut\u00f3noma de Ciudad Ju\u00e1rez, Ciudad Ju\u00e1rez 32310, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6572-6596","authenticated-orcid":false,"given":"Osslan Osiris","family":"Vergara Villegas","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Universidad Aut\u00f3noma de Ciudad Ju\u00e1rez, Ciudad Ju\u00e1rez 32310, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5928-9561","authenticated-orcid":false,"given":"Manuel","family":"Nandayapa","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Universidad Aut\u00f3noma de Ciudad Ju\u00e1rez, Ciudad Ju\u00e1rez 32310, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8571-914X","authenticated-orcid":false,"given":"Francesco","family":"Garcia-Luna","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Universidad Aut\u00f3noma de Ciudad Ju\u00e1rez, Ciudad Ju\u00e1rez 32310, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2851-7840","authenticated-orcid":false,"given":"Mar\u00eda Cristina","family":"Guevara Neri","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Universidad Aut\u00f3noma de Ciudad Ju\u00e1rez, Ciudad Ju\u00e1rez 32310, Mexico"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1803637","DOI":"10.1002\/adma.201803637","article-title":"Bioinspired Electronics for Artificial Sensory Systems","volume":"31","author":"Hwan","year":"2019","journal-title":"Adv. Mater."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Walsh, Y., and Magana, A. (2023). Learning Statics through Physical Manipulative Tools and Visuohaptic Simulations: The Effect of Visual and Haptic Feedback. Electronics, 12.","DOI":"10.3390\/electronics12071659"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Qi, K., Borland, D., Williams, N., Jackson, E., Minogue, J., and Peck, T. (2020, January 22\u201326). Augmenting Physics Education with Haptic and Visual Feedback. Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA.","DOI":"10.1109\/VRW50115.2020.00093"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Neri, L., Robledo-Rella, V., Garc\u00eda-Castel\u00e1n, R., Gonzalez-Nucamendi, A., Escobar-Castillejos, D., and Noguez, J. (2020). Visuo-Haptic Simulations to Understand the Dependence of Electric Forces on Distance. Appl. Sci., 10.","DOI":"10.3390\/app10207190"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.jsurg.2018.06.008","article-title":"Haptic feedback, force feedback, and force-sensing in simulation training for laparoscopy: A systematic overview","volume":"76","author":"Overtoom","year":"2019","journal-title":"J. Surg. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7793","DOI":"10.1007\/s10639-023-11921-3","article-title":"Effects of Haptic interaction on learning performance and satisfaction with 3D collections","volume":"29","author":"Qi","year":"2024","journal-title":"Educ. Inf. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103312","DOI":"10.1016\/j.ijhcs.2024.103312","article-title":"New-user experience evaluation in a semi-immersive and haptic-enabled virtual reality system for assembly operations","volume":"190","year":"2024","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_8","unstructured":"Saddik, A.E., Orozco, M., Eid, M., and Cha, J. (2011). Haptics Technologies, Springer."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Man, D., and Olchawa, R. (2018, January 13\u201314). Brain Biophysics: Perception, Consciousness, Creativity. Brain Computer Interface (BCI). Proceedings of the Biomedical Engineering and Neuroscience, Cham, Switzerland.","DOI":"10.1007\/978-3-319-75025-5_5"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1109\/TOH.2021.3077619","article-title":"Survey of Pseudo-Haptics: Haptic Feedback Design and Application Proposals","volume":"14","author":"Ujitoko","year":"2021","journal-title":"IEEE Trans. Haptics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"136","DOI":"10.3724\/SP.J.2096-5796.2019.0008","article-title":"Haptic Display for Virtual Reality: Progress and Challenges","volume":"1","author":"Wang","year":"2019","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1108\/02602280410515770","article-title":"Haptic Interfaces and Devices","volume":"24","author":"Hayward","year":"2004","journal-title":"Sens. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Giri, G., Maddahi, Y., and Zareinia, K. (2021). An Application-Based Review of Haptics Technology. Robotics, 10.","DOI":"10.3390\/robotics10010029"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sanfilippo, F., Blazauskas, T., Salvietti, G., Ramos, I., Vert, S., Radianti, J., Majchrzak, T.A., and Oliveira, D. (2022). A Perspective Review on Integrating VR\/AR with Haptics into STEM Education for Multi-Sensory Learning. Robotics, 11.","DOI":"10.3390\/robotics11020041"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Crandall, R., and Karado\u011fan, E. (2021). Designing Pedagogically Effective Haptic Systems for Learning: A Review. Appl. Sci., 11.","DOI":"10.3390\/app11146245"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Qi, K., Borland, D., Brunsen, E., Minogue, J., and Peck, T.C. (2021, January 8\u201312). The Impact of Prior Knowledge on the Effectiveness of Haptic and Visual Modalities for Teaching Forces. Proceedings of the 2021 International Conference on Multimodal Interaction, ICMI \u201921, New York, NY, USA.","DOI":"10.1145\/3462244.3479915"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"012120","DOI":"10.1088\/1742-6596\/1511\/1\/012120","article-title":"Strategic study of visual, auditory, haptic information processing and identification of physics learning materials that require VAH-based learning media facilities","volume":"1511","author":"Kristiyanto","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1109\/TOH.2020.2968903","article-title":"How Do Novice Hapticians Design? A Case Study in Creating Haptic Learning Environments","volume":"13","author":"Seifi","year":"2020","journal-title":"IEEE Trans. Haptics"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nor\u2019a, M.N.A., Fadzli, F.E., Ismail, A.W., Vicubelab, Z.S.O., Aladin, M.Y.F., and Hanif, W.A.A.W. (2020, January 30\u201331). Fingertips Interaction Method in Handheld Augmented Reality for 3D Manipulation. Proceedings of the 2020 IEEE 5th International Conference on Computing Communication and Automation (ICCCA), Greater Noida, India.","DOI":"10.1109\/ICCCA49541.2020.9250913"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Oh, J.Y., Park, J.H., and Park, J.M. (2019). Virtual Object Manipulation by Combining Touch and Head Interactions for Mobile Augmented Reality. Appl. Sci., 9.","DOI":"10.3390\/app9142933"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Aleotti, J., Micconi, G., Caselli, S., Benassi, G., Zambelli, N., Bettelli, M., and Zappettini, A. (2017). Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface. Sensors, 17.","DOI":"10.3390\/s17102234"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lopes, P., You, S., Cheng, L.P., Marwecki, S., and Baudisch, P. (2017, January 6\u201311). Providing Haptics to Walls and Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI \u201917, New York, NY, USA.","DOI":"10.1145\/3025453.3025600"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1109\/LRA.2019.2891283","article-title":"Improving User Performance in Haptics-Based Rehabilitation Exercises by Colocation of User\u2019s Visual and Motor Axes via a Three-Dimensional Augmented-Reality Display","volume":"4","author":"Ocampo","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ocampo, R., and Tavakoli, M. (2019, January 3\u20135). Visual-Haptic Colocation in Robotic Rehabilitation Exercises Using a 2D Augmented-Reality Display. Proceedings of the 2019 International Symposium on Medical Robotics (ISMR), Atlanta, GA, USA.","DOI":"10.1109\/ISMR.2019.8710185"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1007\/s12008-019-00532-3","article-title":"Haptic Augmented Reality (HapticAR) for Assembly Guidance","volume":"13","year":"2019","journal-title":"Int. J. Interact. Des. Manuf. IJIDeM"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Noguez, J., Neri, L., Robledo-Rella, V., Garc\u00eda-Castel\u00e1n, R., Gonzalez-Nucamendi, A., Escobar-Castillejos, D., and Molina, A. (2021). VIS-HAPT: A Methodology Proposal to Develop Visuo-Haptic Environments in Education 4.0. Future Internet, 13.","DOI":"10.3390\/fi13100255"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"118002","DOI":"10.1016\/j.eswa.2022.118002","article-title":"Augmented Reality and Artificial Intelligence in Industry: Trends, Tools, and Future Challenges","volume":"207","author":"Wang","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A Survey of Augmented Reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1108\/AA-11-2016-152","article-title":"Mechanical Assembly Assistance Using Marker-less Augmented Reality System","volume":"38","author":"Wang","year":"2018","journal-title":"Assem. Autom."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Stankovi\u0107, S. (2016). Virtual Reality and Virtual Environments in 10 Lectures, Morgan & Claypool. [1st ed.].","DOI":"10.1007\/978-3-031-02254-8"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/0010-0285(87)90008-9","article-title":"Hand Movements: A Window into Haptic Object Recognition","volume":"19","author":"Lederman","year":"1987","journal-title":"Cogn. Psychol."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Grunwald, M. (2008). Human Haptic Perception: Basics and Applications, Birkh\u00e4user. [1st ed.].","DOI":"10.1007\/978-3-7643-7612-3"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez, J., Vel\u00e1zquez, R., Del-Valle-Soto, C., Guti\u00e9rrez, S., Varona, J., and Enr\u00edquez-Zarate, J. (2019). Active and Passive Haptic Perception of Shape: Passive Haptics Can Support Navigation. Electronics, 8.","DOI":"10.3390\/electronics8030355"},{"key":"ref_34","unstructured":"Peters, A. (2008). Haptic Rendering: Foundations, Algorithms, and Applications, CRC Press."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Salisbury, K., Brock, D., Massie, T., Swarup, N., and Zilles, C. (1995, January 9\u201312). Haptic Rendering: Programming Touch Interaction with Virtual Objects. Proceedings of the 1995 Symposium on Interactive 3D Graphics, Monterey, CA, USA.","DOI":"10.1145\/199404.199426"},{"key":"ref_36","unstructured":"Preece, J., Sharp, H., and Rogers, Y. (2015). Interaction Design: Beyond Human-Computer Interaction, Wiley."},{"key":"ref_37","unstructured":"Shneiderman, B., Plaisant, C., Cohen, M., Jacobs, S., Elmqvist, N., and Diakopoulos, N. (2017). Designing the User Interface: Strategies for Effective Human-Computer Interaction, Pearson Education. [6th ed.]."},{"key":"ref_38","unstructured":"(2009). Ergonomics of Human System Interaction-Part 210: Human-Centred Design for Interactive Systems (Standard No. ISO 9241-210:2010)."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994). Usability Engineering, Morgan Kaufmann.","DOI":"10.1016\/B978-0-08-052029-2.50009-7"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Q."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1007\/BF02905780","article-title":"Development and use of the ARCS model of instructional design","volume":"10","author":"Keller","year":"1987","journal-title":"J. Instr. Dev."},{"key":"ref_42","unstructured":"George, S., Reddy, G.S., Kumar, M., and Lal, S. (2019, January 11\u201312). Augmented Reality Immersion (ARI) Framework: A Systematic Review. Proceedings of the 2019 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dubai, United Arab Emirates."},{"key":"ref_43","unstructured":"Brooke, J. (1996). SUS: A \u201cQuick and Dirty\u201d Usability Scale, Taylor and Francis."},{"key":"ref_44","unstructured":"Norman Donald, A. (2013). The Design of Everyday Things, MIT Press."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Craig, A. (2013). Understanding Augmented Reality: Concepts and Applications, Newnes.","DOI":"10.1016\/B978-0-240-82408-6.00002-3"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1109\/TOH.2021.3061150","article-title":"\u201cHaptics On-Demand\u201d: A Survey on Encountered-Type Haptic Displays","volume":"14","author":"Mercado","year":"2021","journal-title":"IEEE Trans. Haptics"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"91923","DOI":"10.1109\/ACCESS.2022.3202986","article-title":"Haptic Devices: Wearability-Based Taxonomy and Literature Review","volume":"10","author":"Adilkhanov","year":"2022","journal-title":"IEEE Access"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"van Wegen, M., Herder, J., Adelsberger, R., Pastore, M., van Wegen, E., Bohlhalter, S., Nef, T., Krack, P., and Vanbellingen, T. (2023). An Overview of Wearable Haptic Technologies and Their Performance in Virtual Object Exploration. Sensors, 23.","DOI":"10.3390\/s23031563"},{"key":"ref_49","unstructured":"(2020, January 01). Unity. Unity\u2014Game Engine. Available online: https:\/\/unity.com\/."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"78467","DOI":"10.1109\/ACCESS.2020.2990172","article-title":"Haptic Augmentation Towards a Smart Learning Environment: The Haptic Lever Design","volume":"8","author":"Nandayapa","year":"2020","journal-title":"IEEE Access"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/2\/15\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:32:36Z","timestamp":1760027556000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/2\/15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,13]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["mti9020015"],"URL":"https:\/\/doi.org\/10.3390\/mti9020015","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2025,2,13]]}}}