{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T05:09:07Z","timestamp":1780463347889,"version":"3.54.1"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004085","name":"Ministry of Education, Science and Technology","doi-asserted-by":"publisher","award":["2016R1D1A1B03930795"],"award-info":[{"award-number":["2016R1D1A1B03930795"]}],"id":[{"id":"10.13039\/501100004085","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["IITP-2018-0-00599"],"award-info":[{"award-number":["IITP-2018-0-00599"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Augmented reality (AR) systems are becoming next-generation technologies to intelligently visualize the real world in 3D. This research proposes a sensor fusion based pipeline inspection and retrofitting for the AR system, which can be used in pipeline inspection and retrofitting processes in industrial plants. The proposed methodology utilizes a prebuilt 3D point cloud data of the environment, real-time Light Detection and Ranging (LiDAR) scan and image sequence from the camera. First, we estimate the current pose of the sensors platform by matching the LiDAR scan and the prebuilt point cloud data from the current pose prebuilt point cloud data augmented on to the camera image by utilizing the LiDAR and camera calibration parameters. Next, based on the user selection in the augmented view, geometric parameters of a pipe are estimated. In addition to pipe parameter estimation, retrofitting in the existing plant using augmented scene are illustrated. Finally, step-by-step procedure of the proposed method was experimentally verified at a water treatment plant. Result shows that the integration of AR with building information modelling (BIM) greatly benefits the post-occupancy evaluation process or pre-retrofitting and renovation process for identifying, evaluating, and updating the geometric specifications of a construction environment.<\/jats:p>","DOI":"10.3390\/sym11101325","type":"journal-article","created":{"date-parts":[[2019,10,23]],"date-time":"2019-10-23T11:46:59Z","timestamp":1571831219000},"page":"1325","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Sensor Fusion Based Pipeline Inspection for the Augmented Reality System"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1182-7241","authenticated-orcid":false,"given":"G. Ajay","family":"Kumar","sequence":"first","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 156-756, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0283-8037","authenticated-orcid":false,"given":"Ashok Kumar","family":"Patil","sequence":"additional","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 156-756, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tae Wook","family":"Kang","sequence":"additional","affiliation":[{"name":"ICT Convergence and Integration Research Division SOC, Research Institute, Korea Institute of Construction Technology, Gyeonggi-do 411-712, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0513-7471","authenticated-orcid":false,"given":"Young Ho","family":"Chai","sequence":"additional","affiliation":[{"name":"Graduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 156-756, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1016\/j.proeng.2016.11.649","article-title":"A review of Building Information Modelling for construction in developing countries","volume":"164","author":"Bui","year":"2016","journal-title":"Procedia Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1016\/j.proeng.2017.08.030","article-title":"BIM-based applications of metaheuristic algorithms to support the decision-making process: Uses in the planning of construction site layout","volume":"196","author":"Amiri","year":"2017","journal-title":"Procedia Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.rser.2018.03.064","article-title":"Building information modeling for energy retrofitting\u2013A review","volume":"89","author":"Sanhudo","year":"2018","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.sbspro.2013.07.175","article-title":"Building Information Modeling (BIM): A new paradigm for quality of life within Architectural, Engineering and Construction (AEC) industry","volume":"101","author":"Takim","year":"2013","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/2213-7459-1-10","article-title":"Spatial and visual data fusion for capturing, retrieval, and modeling of as-built building geometry and features","volume":"1","author":"Zhu","year":"2013","journal-title":"Vis. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.autcon.2013.12.003","article-title":"Integrating Augmented Reality with Building Information Modeling: Onsite construction process controlling for liquefied natural gas industry","volume":"40","author":"Wang","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1061\/(ASCE)CP.1943-5487.0000067","article-title":"3D\/4D CAD applicability for life-cycle facility management","volume":"25","author":"Park","year":"2011","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_8","first-page":"99","article-title":"4DCAD-Safety: Visualizing project scheduling and safety planning","volume":"5","author":"Chantawit","year":"2005","journal-title":"Constr. Innov."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.autcon.2017.11.003","article-title":"A critical review of virtual and augmented reality (VR\/AR) applications in construction safety","volume":"86","author":"Li","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Khalek, I.A., Chalhoub, J.M., and Ayer, S.K. (2019). Augmented reality for identifying maintainability concerns during design. Adv. Civ. Eng.","DOI":"10.1155\/2019\/8547928"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/2213-7459-1-3","article-title":"High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (AEC\/FM) applications","volume":"1","author":"Bae","year":"2013","journal-title":"Vis. Eng."},{"key":"ref_12","unstructured":"Toro, C., San\u00edn, C., Vaquero, J., Posada, J., and Szczerbicki, E. (2007, January 12\u201314). Knowledge based industrial maintenance using portable devices and augmented reality. Proceedings of the International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, Vietri sul Mare, Italy."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.autcon.2012.10.012","article-title":"A conceptual framework for integrating building information modeling with augmented reality","volume":"34","author":"Wang","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.autcon.2017.10.032","article-title":"Integrating mobile Building Information Modelling and Augmented Reality systems: An experimental study","volume":"85","author":"Chu","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Doil, F., Schreiber, W., Alt, T., and Patron, C. (2003, January 22\u201323). Augmented reality for manufacturing planning. Proceedings of the Workshop on Virtual Environments 2003, Zurich, Switzerland.","DOI":"10.1145\/769953.769962"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tang, A., Owen, C., Biocca, F., and Mou, W. (2003, January 5\u201310). Comparative effectiveness of augmented reality in object assembly. Proceedings of the SIGCHI conference on Human factors in computing systems 2003, Ft. Lauderdale, FL, USA.","DOI":"10.1145\/642611.642626"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"112","DOI":"10.4028\/www.scientific.net\/MSF.692.112","article-title":"Using virtual reality in the teaching of manufacturing processes with material removal in CNC machine-tools","volume":"Volume 692","author":"Sanz","year":"2011","journal-title":"Materials Science Forum"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tabrizi, A., and Sanguinetti, P. (2019). Literature review of augmented reality application in the architecture, engineering, and construction industry with relation to building information. Advanced Methodologies and Technologies in Engineering and Environmental Science, IGI Global.","DOI":"10.4018\/978-1-5225-7359-3.ch005"},{"key":"ref_19","unstructured":"De Freitas, M.R., and Ruschel, R.C. (2013, January 9\u201312). Augmented reality supporting building assesment in terms of retrofit detection. Proceedings of the CIB W078 International Conference, Beijing, China."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"153","DOI":"10.5194\/isprsannals-II-5-153-2014","article-title":"Augmented reality system using lidar point cloud data for displaying dimensional information of objects on mobile phones","volume":"2","author":"Gupta","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1109\/TVCG.2012.310","article-title":"Registration of 3D point clouds and meshes: A survey from rigid to nonrigid","volume":"19","author":"Tam","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Diao, P.H., and Shih, N.J. (2019). BIM-based AR Maintenance System (BARMS) as an intelligent instruction platform for complex plumbing facilities. Appl. Sci., 9.","DOI":"10.3390\/app9081592"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modelling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_25","unstructured":"Low, K.L. (2004). Linear Least-Squares Optimization for Point-To-Plane ICP Surface Registration, University of North Carolina. Technical Report TR04-004."},{"key":"ref_26","first-page":"53","article-title":"ICL: Iterative closest line A novel point cloud registration algorithm based on linear features","volume":"10","author":"Alshawa","year":"2007","journal-title":"Ekscentar"},{"key":"ref_27","unstructured":"Segal, A., Haehnel, D., and Thrun, S. (July, January 28). Generalized-ICP. Proceedings of the Robotics: Science and Systems, Seattle, WA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1550147718766452","DOI":"10.1177\/1550147718766452","article-title":"Hybrid approach for alignment of a pre-processed three-dimensional point cloud, video, and CAD model using partial point cloud in retrofitting applications","volume":"14","author":"Patil","year":"2018","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_29","unstructured":"(2019, October 07). Trimble. Available online: http:\/\/trl.trimble.com\/docushare\/dsweb\/Get\/Document-628869\/022504-122_Trimble_TX5_DS_1012_LR.pdf."},{"key":"ref_30","unstructured":"(2019, October 07). Velodyne LiDAR. Available online: http:\/\/velodynelidar.com\/vlp-16.html."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1145\/358105.893","article-title":"Faster methods for random sampling","volume":"27","author":"Vitter","year":"1984","journal-title":"Commun. ACM"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1109\/MRA.2015.2432331","article-title":"Registration with the point cloud library: A modular framework for aligning in 3-d","volume":"22","author":"Holz","year":"2015","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_33","unstructured":"Vel\u2019as, M., \u0160pan\u011bl, M., Materna, Z., and Herout, A. (2014, January 2\u20135). Calibration of RGB camera with velodyne lidar. Proceedings of the 22nd International Conference on Computer Graphics, Visualization and Computer Vision, Plzen, Czech Republic."},{"key":"ref_34","unstructured":"(2019, October 07). MTw Awinda. Available online: https:\/\/www.xsens.com\/products\/mtw-awinda\/."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kumar, G.A., Patil, A.K., Patil, R., Park, S.S., and Chai, Y.H. (2017). A LiDAR and IMU integrated indoor navigation system for UAVs and its application in real-time pipeline classification. Sensors, 17.","DOI":"10.3390\/s17061268"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/10\/1325\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:28:30Z","timestamp":1760189310000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/10\/1325"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,22]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["sym11101325"],"URL":"https:\/\/doi.org\/10.3390\/sym11101325","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,22]]}}}