{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T03:23:33Z","timestamp":1777519413473,"version":"3.51.4"},"reference-count":45,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Sciences and Engineering Research Council (NSERC) of Canada"},{"name":"Western University\u2019s Undergraduate Student Research Internship"},{"name":"Western Academy for Advanced Research (WAFAR) at Western University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the era of aging civil infrastructure and growing concerns about rapid structural deterioration due to climate change, the demand for real-time structural health monitoring (SHM) techniques has been predominant worldwide. Traditional SHM methods face challenges, including delays in processing acquired data from large structures, time-intensive dense instrumentation, and visualization of real-time structural information. To address these issues, this paper develops a novel real-time visualization method using Augmented Reality (AR) to enhance vibration-based onsite structural inspections. The proposed approach presents a visualization system designed for real-time fieldwork, enabling detailed multi-sensor analyses within the immersive environment of AR. Leveraging the remote connectivity of the AR device, real-time communication is established with an external database and Python library through a web server, expanding the analytical capabilities of data acquisition, and data processing, such as modal identification, and the resulting visualization of SHM information. The proposed system allows live visualization of time-domain, frequency-domain, and system identification information through AR. This paper provides an overview of the proposed technology and presents the results of a lab-scale experimental model. It is concluded that the proposed approach yields accurate processing of real-time data and visualization of system identification information by highlighting its potential to enhance efficiency and safety in SHM by integrating AR technology with real-world fieldwork.<\/jats:p>","DOI":"10.3390\/s24051609","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T03:31:23Z","timestamp":1709263883000},"page":"1609","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Augmented Reality-Based Real-Time Visualization for Structural Modal Identification"],"prefix":"10.3390","volume":"24","author":[{"given":"Elliott","family":"Carter","sequence":"first","affiliation":[{"name":"Department of Software Engineering, Western University, London, ON N6A 5B9, Canada"}]},{"given":"Micheal","family":"Sakr","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, Western University, London, ON N6A 5B9, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5685-7087","authenticated-orcid":false,"given":"Ayan","family":"Sadhu","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, The Western Academy for Advanced Research, Western University, London, ON N6A 5B9, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"04723001","DOI":"10.1061\/JBENF2.BEENG-6336","article-title":"A benchmark dataset for vision-based traffic load monitoring in a cable-stayed bridge","volume":"29","author":"Ge","year":"2024","journal-title":"J. Bridge Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hassani, S., and Dackermann, U. (2023). A Systematic Review of Advanced Sensor Technologies for Non-Destructive Testing and Structural Health Monitoring. Sensors, 23.","DOI":"10.3390\/s23042204"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1016\/j.istruc.2022.08.021","article-title":"Recent advancement of concrete dam health monitoring technology: A systematic literature review","volume":"44","author":"Prakash","year":"2022","journal-title":"Structures"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"123314","DOI":"10.1016\/j.eswa.2024.123314","article-title":"Enhancing pavement health assessment: An attention-based approach for accurate crack detection, measurement and mapping","volume":"247","author":"Ranyal","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4672","DOI":"10.1109\/JSEN.2023.3240092","article-title":"Noncontact Sensing Techniques for AI-Aided Structural Health Monitoring: A Systematic Review","volume":"23","author":"Sabato","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"03122008","DOI":"10.1061\/PPSCFX.SCENG-1259","article-title":"Recent advancements and future trends in indirect bridge health monitoring","volume":"28","author":"Singh","year":"2023","journal-title":"J. Pract. Period. Struct. Des. Constr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e2321","DOI":"10.1002\/stc.2321","article-title":"A literature review of next-generation smart sensing technology in structural health monitoring","volume":"26","author":"Sony","year":"2019","journal-title":"Struct. Control Health Monit."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"111347","DOI":"10.1016\/j.engstruct.2020.111347","article-title":"A systematic review of convolutional neural network-based structural condition assessment techniques","volume":"226","author":"Sony","year":"2021","journal-title":"Eng. Struct."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Entezami, A., Sarmadi, H., Behkamal, B., and Mariani, S. (2020). Big Data Analytics and Structural Health Monitoring: A Statistical Pattern Recognition-Based Approach. Sensors, 20.","DOI":"10.3390\/s20082328"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.1080\/15732479.2019.1602150","article-title":"Improved visualization of infrastructure monitoring data using building information modeling","volume":"15","author":"Boddupalli","year":"2019","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_11","first-page":"100053","article-title":"Visualization of structural health monitoring information using internet-of-things integrated with building information modeling","volume":"2","author":"Sakr","year":"2023","journal-title":"J. Infrastruct. Intell. Resil."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1109\/TLT.2022.3144356","article-title":"Augmented Reality and Engineering Education: A Systematic Review","volume":"14","year":"2021","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_13","unstructured":"Wyckoff, E., Reza, R., and Moreu, F. (2023). Feedback and Control of Dynamics and Robotics using Augmented Reality. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"113020","DOI":"10.1016\/j.enbuild.2023.113020","article-title":"Thermal reality capturing with the Microsoft HoloLens 2 for energy system analysis","volume":"288","author":"Kinnen","year":"2023","journal-title":"Energy Build."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"03122006","DOI":"10.1061\/(ASCE)ST.1943-541X.0003498","article-title":"A Review of Data Management and Visualization Techniques for Structural Health Monitoring Using BIM and Virtual or Augmented Reality","volume":"149","author":"Sadhu","year":"2022","journal-title":"J. Struct. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"640732","DOI":"10.3389\/fbuil.2021.640732","article-title":"A Review of Augmented Reality Applications in Civil Infrastructure During the 4th Industrial Revolution","volume":"7","author":"Xu","year":"2021","journal-title":"Front. Built Environ."},{"key":"ref_17","first-page":"111","article-title":"A Review: Investigation of Augmented Reality\u2014BIM Benefits in Design Process in AEC Industry","volume":"47","author":"Taib","year":"2023","journal-title":"Informatica"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2014.02.011","article-title":"Component based engineering of a mobile BIM-based augmented reality system","volume":"42","author":"Turk","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"A4014009","DOI":"10.1061\/(ASCE)ME.1943-5479.0000315","article-title":"BIM2MAR: An Efficient BIM Translation to Mobile Augmented Reality Applications","volume":"31","author":"Williams","year":"2015","journal-title":"J. Manag. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5194\/isprsarchives-XL-5-W7-35-2015","article-title":"HBIM and augmented information: Towards a wider user community of image and range-based reconstructions","volume":"40","author":"Barazzetti","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. ISPRS Arch."},{"key":"ref_21","unstructured":"Salamak, M., and Januszka, M. (2015, January 1\u20132). BIM Models and Augmented Reality for Concrete Bridge Inspections. Proceedings of the 11th Central European Congress on Concrete Engineering, Hainburg, Austria."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yamaguchi, T., Shibuya, T., Kanda, M., and Yasojima, A. (2019, January 10\u201313). Crack Inspection Support System for Concrete Structures Using Head Mounted Display in Mixed Reality Space. Proceedings of the 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), Hiroshima, Japan.","DOI":"10.23919\/SICE.2019.8859876"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1177\/1475921720953846","article-title":"Augmented reality for next generation infrastructure inspections","volume":"20","author":"Ballor","year":"2021","journal-title":"Struct. Health Monit."},{"key":"ref_24","first-page":"100024","article-title":"Automated multiclass structural damage detection and quantification using augmented reality","volume":"2","author":"Awadallah","year":"2023","journal-title":"J. Infrastruct. Intell. Resil."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1007\/s13349-023-00698-1","article-title":"Innovative technologies for structural health monitoring of SFTs: Proposal of combination of infrared thermography with mixed reality","volume":"13","author":"Palma","year":"2023","journal-title":"J. Civ. Struct. Health Monit."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"103936","DOI":"10.1016\/j.compind.2023.103936","article-title":"Augmented reality-computer vision combination for automatic fatigue crack detection and localization","volume":"149","author":"Mohammadkhorasani","year":"2023","journal-title":"Comput. Ind."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Natephra, W., and Motamedi, A. (2019, January 21\u201324). Live data visualization of IoT sensors using augmented reality (AR) and BIM. Proceedings of the 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, AB, Canada.","DOI":"10.22260\/ISARC2019\/0084"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.14716\/ijtech.v10i7.3278","article-title":"Bim integration in augmented reality model","volume":"10","author":"Chai","year":"2019","journal-title":"Int. J. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"04020073","DOI":"10.1061\/(ASCE)CP.1943-5487.0000958","article-title":"Integrating Building Information Model and Augmented Reality for Drone-Based Building Inspection","volume":"35","author":"Liu","year":"2021","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"16963","DOI":"10.1109\/ACCESS.2024.3358843","article-title":"Integration of Bridge Health Monitoring System With Augmented Reality Application Developed Using 3D Game Engine\u2013Case Study","volume":"12","author":"Fawad","year":"2024","journal-title":"IEEE Access"},{"key":"ref_31","first-page":"100383","article-title":"Digital Twins: State of the art theory and practice, challenges, and open research questions","volume":"30","author":"Sharma","year":"2022","journal-title":"J. Ind. Inf. Integr."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Schroeder, G., Steinmetz, C., Pereira, C.E., Muller, I., Garcia, N., Espindola, D., and Rodrigues, R. (2016, January 19\u201321). Visualising the digital twin using web services and augmented reality. Proceedings of the 2016 IEEE International Conference on Industrial Informatics (INDIN), Poitiers, France.","DOI":"10.1109\/INDIN.2016.7819217"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Revetria, R., Tonelli, F., Damiani, L., Demartini, M., Bisio, F., and Peruzzo, N. (May, January 29). A Real-Time Mechanical Structures Monitoring System Based On Digital Twin, Iot and Augmented Reality; A Real-Time Mechanical Structures Monitoring System Based On Digital Twin, Iot and Augmented Reality. Proceedings of the 2019 Spring Simulation Conference (SpringSim), Tucson, AZ, USA.","DOI":"10.23919\/SpringSim.2019.8732917"},{"key":"ref_34","unstructured":"Nguyen, D.-C., Kang, M., Jang, D., and Shim, C. (2022, January 16\u201319). Developing Mixed Reality-Based Digital Twin Model for Bridge Maintenance System. Proceedings of the 22nd International Conference on Construction Applications of Virtual Reality (CONVR 2022), Seoul, Republic of Korea."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Napolitano, R., Blyth, A., and Glisic, B. (2018). Virtual environments for visualizing structural health monitoring sensor networks, data, and metadata. Sensors, 18.","DOI":"10.3390\/s18010243"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"50","DOI":"10.3389\/fbuil.2019.00050","article-title":"Combination of image-based documentation and augmented reality for structural health monitoring and building pathology","volume":"5","author":"Napolitano","year":"2019","journal-title":"Front. Built Environ."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Aguero, M., Maharjan, D., del Pilar Rodriguez, M., Mascarenas, D.D.L., and Moreu, F. (2020). Design and implementation of a connection between augmented reality and sensors. Robotics, 9.","DOI":"10.3390\/robotics9010003"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s11803-023-2184-x","article-title":"Visualization of real-time displacement time history superimposed with dynamic experiments using wireless smart sensors and augmented reality","volume":"22","author":"Aguero","year":"2023","journal-title":"Earthq. Eng. Eng. Vib."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"111135","DOI":"10.1016\/j.ymssp.2024.111135","article-title":"A domain adaptation approach to damage classification with an application to bridge monitoring","volume":"209","author":"Giglioni","year":"2024","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_40","unstructured":"(2023, November 14). Architecture Overview\u2014MRTK 2 | Microsoft Learn. Available online: https:\/\/learn.microsoft.com\/en-us\/windows\/mixed-reality\/mrtk-unity\/mrtk2\/architecture\/overview?view=mrtkunity-2022-05."},{"key":"ref_41","unstructured":"(2024, February 19). knutankv\/koma: Mode Visualization and Animation (Slightly Experimental) added. Available online: https:\/\/zenodo.org\/records\/10677831."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"101216","DOI":"10.1016\/j.softx.2022.101216","article-title":"PyOMA and PyOMA_GUI: A Python module and software for Operational Modal Analysis","volume":"20","author":"Pasca","year":"2022","journal-title":"SoftwareX"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"101091","DOI":"10.1016\/j.softx.2022.101091","article-title":"CESSIPy: A Python open-source module for stochastic system identification in civil engineering","volume":"18","author":"Carini","year":"2022","journal-title":"SoftwareX"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2172","DOI":"10.1016\/j.proeng.2017.09.170","article-title":"ScienceDirect ScienceDirect Automated Operational Modal Analysis of an arch bridge considering the influence of the parametric methods inputs","volume":"199","author":"Marrongelli","year":"2017","journal-title":"Procedia Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"110669","DOI":"10.1016\/j.ymssp.2023.110669","article-title":"Intelligent automatic operational modal analysis","volume":"201","author":"Rosso","year":"2023","journal-title":"Mech. Syst. Signal Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/5\/1609\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:07:42Z","timestamp":1760105262000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/5\/1609"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["s24051609"],"URL":"https:\/\/doi.org\/10.3390\/s24051609","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,1]]}}}