{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T06:09:06Z","timestamp":1771999746643,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,5]],"date-time":"2021-02-05T00:00:00Z","timestamp":1612483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Mixed reality (MR) enables a novel way to visualize virtual objects on real scenarios considering physical constraints. This technology arises with other significant advances in the field of sensors fusion for human-centric 3D capturing. Recent advances for scanning the user environment, real-time visualization and 3D vision using ubiquitous systems like smartphones allow us to capture 3D data from the real world. In this paper, a disruptive application for assessing the status of indoor infrastructures is proposed. The installation and maintenance of hidden facilities such as water pipes, electrical lines and air conditioning tubes, which are usually occluded behind the wall, supposes tedious and inefficient tasks. Most of these infrastructures are digitized but they cannot be visualized onsite. In this research, we focused on the development of a new application (GEUINF) to be launched on smartphones that are capable of capturing 3D data of the real world by depth sensing. This information is relevant to determine the user position and orientation. Although previous approaches used fixed markers for this purpose, our application enables the estimation of both parameters with a centimeter accuracy without them. This novelty is possible since our method is based on a matching process between reconstructed walls of the real world and 3D planes of the replicated world in a virtual environment. Our markerless approach is based on scanning planar surfaces of the user environment and then, these are geometrically aligned with their corresponding virtual 3D entities. In a preprocessing phase, the 2D CAD geometry available from an architectural project is used to generate 3D models of an indoor building structure. In real time, these virtual elements are tracked with the real ones modeled by using ARCore library. Once the alignment between virtual and real worlds is done, the application enables the visualization, navigation and interaction with the virtual facility networks in real-time. Thus, our method may be used by private companies and public institutions responsible of the indoor facilities management and also may be integrated with other applications focused on indoor navigation.<\/jats:p>","DOI":"10.3390\/s21041123","type":"journal-article","created":{"date-parts":[[2021,2,7]],"date-time":"2021-02-07T14:04:13Z","timestamp":1612706653000},"page":"1123","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["GEUINF: Real-Time Visualization of Indoor Facilities Using Mixed Reality"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2408-4926","authenticated-orcid":false,"given":"David","family":"Jurado","sequence":"first","affiliation":[{"name":"Computing and Numerical Analysis Department, University of C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8009-9033","authenticated-orcid":false,"given":"Juan M.","family":"Jurado","sequence":"additional","affiliation":[{"name":"Computer Graphics and Geomatics Group of Ja\u00e9n, University of Ja\u00e9n, 23071 Ja\u00e9n, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7320-7382","authenticated-orcid":false,"given":"Lidia","family":"Ortega","sequence":"additional","affiliation":[{"name":"Computer Graphics and Geomatics Group of Ja\u00e9n, University of Ja\u00e9n, 23071 Ja\u00e9n, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8230-6529","authenticated-orcid":false,"given":"Francisco R.","family":"Feito","sequence":"additional","affiliation":[{"name":"Computer Graphics and Geomatics Group of Ja\u00e9n, University of Ja\u00e9n, 23071 Ja\u00e9n, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,5]]},"reference":[{"key":"ref_1","first-page":"1839","article-title":"A Review on Using Opportunities of Augmented Reality and Virtual Reality in Construction Project Management","volume":"11","author":"Ahmed","year":"2019","journal-title":"Organ. Technol. Manag. Constr. Int. J."},{"key":"ref_2","first-page":"12","article-title":"Augmented Reality for Identifying Maintainability Concerns during Design","volume":"2019","author":"Khalek","year":"2019","journal-title":"Adv. Civ. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"04019016","DOI":"10.1061\/(ASCE)AE.1943-5568.0000362","article-title":"Mobile Augmented Reality to Influence Design and Constructability Review Sessions","volume":"25","author":"Alsafouri","year":"2019","journal-title":"J. Archit. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1007\/s00371-019-01745-z","article-title":"OP-MR: The implementation of order picking based on mixed reality in a smart warehouse","volume":"36","author":"Latif","year":"2020","journal-title":"Vis. Comput."},{"key":"ref_5","first-page":"140","article-title":"Augmented-Reality-Based Indoor Navigation: A Comparative Analysis of Handheld Devices Versus Google Glass","volume":"47","author":"Rehman","year":"2017","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gerstweiler, G. (2018, January 18\u201322). Guiding People in Complex Indoor Environments Using Augmented Reality. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen\/Reutlingen, Germany.","DOI":"10.1109\/VR.2018.8446138"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s42524-019-0071-y","article-title":"Framework based on building information modeling, mixed reality, and a cloud platform to support information flow in facility management","volume":"7","author":"Naticchia","year":"2020","journal-title":"Front. Eng. Manag."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bhateja, V., Satapathy, S.C., and Satori, H. (2020). From Marker to Markerless in Augmented Reality. Embedded Systems and Artificial Intelligence, Springer.","DOI":"10.1007\/978-981-15-0947-6"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Choi, J., Son, M.G., Lee, Y.Y., Lee, K.H., Park, J.P., Yeo, C.H., Park, J., Choi, S., Kim, W.D., and Kang, T.W. (2020). Position-based augmented reality platform for aiding construction and inspection of offshore plants. Vis. Comput.","DOI":"10.1007\/s00371-020-01902-9"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1007\/s00371-016-1281-5","article-title":"Line-based initialization method for mobile augmented reality in aircraft assembly","volume":"33","author":"Han","year":"2017","journal-title":"Vis. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ayadi, M., Scuturici, M., Ben Amar, C., and Miguet, S. (2020). A skyline-based approach for mobile augmented reality. Vis. Comput.","DOI":"10.1007\/s00371-020-01830-8"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1007\/s00371-018-1523-9","article-title":"Real-time camera pose estimation via line tracking","volume":"34","author":"Liu","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1533","DOI":"10.1007\/s00779-012-0599-x","article-title":"Smart Vidente: Advances in mobile augmented reality for interactive visualization of underground infrastructure","volume":"17","author":"Schall","year":"2012","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.autcon.2012.10.012","article-title":"A conceptual framework for integrating building information modeling with augmented reality","volume":"34","author":"Wang","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"041008","DOI":"10.1115\/1.4040460","article-title":"Augmented and Virtual Reality for Underground Facilities Management","volume":"18","author":"Soria","year":"2018","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Romero-Ramirez, F., Mu\u00f1oz-Salinas, R., and Medina-Carnicer, R. (2018). Speeded Up Detection of Squared Fiducial Markers. Image Vis. Comput., 76.","DOI":"10.1016\/j.imavis.2018.05.004"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1007\/s00371-018-1530-x","article-title":"Navigation in AR based on digital replicas","volume":"34","author":"Sharma","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.mfglet.2017.12.014","article-title":"Methods and Materials for Smart Manufacturing: Additive Manufacturing, Internet of Things, Flexible Sensors and Soft Robotics","volume":"15","author":"Kumar","year":"2018","journal-title":"Manuf. Lett."},{"key":"ref_19","unstructured":"Rassia, S.T., and Pardalos, P.M. (2017). Virtual and Augmented Reality Applications in Building Industry. Smart City Networks: Through the Internet of Things, Springer International Publishing."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/3383653.3383661","article-title":"GeoSim 2019 Workshop Report: The 2nd ACM SIGSPATIAL International Workshop on Geospatial Simulation","volume":"11","author":"Kim","year":"2020","journal-title":"SIGSPATIAL Special"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1016\/j.apm.2018.06.031","article-title":"Indoor positioning system based on BLE location fingerprinting with classification approach","volume":"62","author":"Pu","year":"2018","journal-title":"Appl. Math. Model."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/10447318.2010.496335","article-title":"Invisible Marker\u2013Based Augmented Reality","volume":"26","author":"Park","year":"2010","journal-title":"Int. J. Hum. Comput. Interaction"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"103135","DOI":"10.1016\/j.autcon.2020.103135","article-title":"Transfer learning enhanced AR spatial registration for facility maintenance management","volume":"113","author":"Chen","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yu, K., Ahn, J., Lee, J., Kim, M., and Han, J. (2020). Collaborative SLAM and AR-guided navigation for floor layout inspection. Vis. Comput.","DOI":"10.1007\/s00371-020-01911-8"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103012","DOI":"10.1016\/j.autcon.2019.103012","article-title":"On-demand monitoring of construction projects through a game-like hybrid application of BIM and machine learning","volume":"110","author":"Rahimian","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.patrec.2018.06.031","article-title":"Real time vanishing points detection on smartphones under Manhattan world assumption","volume":"115","author":"Huang","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, L., and Wu, Z. (2019). RGB-D SLAM with Manhattan Frame Estimation Using Orientation Relevance. Sensors (Basel, Switzerland), 19.","DOI":"10.3390\/s19051050"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fu, Y., Yan, Q., Liao, J., Chow, A.L.H., and Xiao, C. (2020). Real-time dense 3D reconstruction and camera tracking via embedded planes representation. Vis. Comput.","DOI":"10.1007\/s00371-020-01899-1"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"103120","DOI":"10.1016\/j.autcon.2020.103120","article-title":"A BIM-based method to plan indoor paths","volume":"113","author":"Hamieh","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, Q., Chen, J., and Huang, W. (2020). Method for Generation of Indoor GIS Models Based on BIM Models to Support Adjacent Analysis of Indoor Spaces. ISPRS Int. J. Geo-Inform., 9.","DOI":"10.3390\/ijgi9090508"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Moshtaghian, F., Golabchi, M., and Noorzai, E. (2020). A framework to dynamic identification of project risks. Smart Sustain. Built Environ.","DOI":"10.1108\/SASBE-09-2019-0123"},{"key":"ref_32","first-page":"60","article-title":"Lean, BIM and Augmented Reality Applied in the Design and Construction Phase: A Literature Review","volume":"9","author":"Brioso","year":"2018","journal-title":"Int. J. Innov. Manag. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2019.02.009","article-title":"OpenBIM-Tango integrated virtual showroom for offsite manufactured production of self-build housing","volume":"102","author":"Rahimian","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ha-Minh, C., Dao, D.V., Benboudjema, F., Derrible, S., Huynh, D.V.K., and Tang, A.M. (2020). Application of Building Information Modelling, Extended tracking technique and Augmented Reality in Building Operating Management. CIGOS 2019, Innovation for Sustainable Infrastructure, Springer.","DOI":"10.1007\/978-981-15-0802-8"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s13319-015-0072-5","article-title":"Fast Markerless Tracking for Augmented Reality in Planar Environment","volume":"6","author":"Basori","year":"2015","journal-title":"3D Res."},{"key":"ref_36","unstructured":"Lai, S.H., Lepetit, V., Nishino, K., and Sato, Y. (2017). Planar Markerless Augmented Reality Using Online Orientation Estimation. Computer Vision\u2014ACCV 2016, Springer International Publishing."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1007\/s00371-013-0840-2","article-title":"Augmented reality supporting user-centric building information management","volume":"29","author":"Olbrich","year":"2013","journal-title":"Vis. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/s00371-016-1346-5","article-title":"Evaluation of X-ray visualization techniques for vertical depth judgments in underground exploration","volume":"34","author":"Eren","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chung, S., Kwon, S., Moon, D., and Ko, T. (2018, January 20\u201325). Smart Facility Management Systems Utilizing Open BIM and Augmented\/Virtual Reality. Proceedings of the 35th International Symposium on Automation and Robotics in Construction (ISARC 2018), Berlin, Germany.","DOI":"10.22260\/ISARC2018\/0118"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.promfg.2018.01.021","article-title":"Augmented Reality in Maintenance: An information-centred design framework","volume":"19","author":"Erkoyuncu","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"227","DOI":"10.69554\/SULP7204","article-title":"A glimpse into the future of facility and maintenance management: A case study of augmented reality","volume":"6","author":"May","year":"2017","journal-title":"Corp. Real Estate J."},{"key":"ref_42","first-page":"179","article-title":"An indoor thermal environment design system for renovation using augmented reality","volume":"6","author":"Fukuda","year":"2019","journal-title":"J. Comput. Des. Eng."},{"key":"ref_43","unstructured":"Jurado, J.M., Ortega, L., Cubillas, J.J., and Feito, F.R. (2021, February 04). GEU (Geospatial and Environmental tools of University of Ja\u00e9n). Available online: http:\/\/gis3d4d.ujaen.es\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.cad.2011.12.009","article-title":"Semiautomatic detection of floor topology from CAD architectural drawings","volume":"44","author":"Feito","year":"2012","journal-title":"Comput. Aided Des."},{"key":"ref_45","unstructured":"Daniel, L., Loree, P., and Whitener, A. (2002). Inside MapInfo Professional: The Friendly User Guide to MapInfo Professional, Cengage Learning."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Brightman, M. (2018). The SketchUp Workflow for Architecture, John Wiley & Sons, Ltd.","DOI":"10.1002\/9781119410171"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1145\/364099.364331","article-title":"An improved equivalence algorithm","volume":"7","author":"Galler","year":"1964","journal-title":"Commun. ACM"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Dugulean\u0103, M., Carrozzino, M., Gams, M., and Tanea, I. (2019). Exploring Cultural Heritage Using Augmented Reality Through Google\u2019s Project Tango and ARCore. VR Technologies in Cultural Heritage, Springer International Publishing.","DOI":"10.1007\/978-3-030-05819-7"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhang, X., Yao, X., Zhu, Y., and Hu, F. (2019). An ARCore based user centric assistive navigation system for visually impaired people. Appl. Sci., 9.","DOI":"10.3390\/app9050989"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Nowacki, P., and Woda, M. (2019, January 10\u201313). Capabilities of arcore and arkit platforms for ar\/vr applications. Proceedings of the International Conference on Dependability and Complex Systems, Guangzhou, China.","DOI":"10.1007\/978-3-030-19501-4_36"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1111\/cgf.13386","article-title":"State of the Art on 3D Reconstruction with RGB-D Cameras","volume":"37","author":"Stotko","year":"2018","journal-title":"Comput. Graph. Forum"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1123\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:20:10Z","timestamp":1760160010000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,5]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041123"],"URL":"https:\/\/doi.org\/10.3390\/s21041123","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,5]]}}}