{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T21:50:15Z","timestamp":1773438615582,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["OAC-1835473"],"award-info":[{"award-number":["OAC-1835473"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image data remains an important tool for post-event building assessment and documentation. After each natural hazard event, significant efforts are made by teams of engineers to visit the affected regions and collect useful image data. In general, a global positioning system (GPS) can provide useful spatial information for localizing image data. However, it is challenging to collect such information when images are captured in places where GPS signals are weak or interrupted, such as the indoor spaces of buildings. The inability to document the images\u2019 locations hinders the analysis, organization, and documentation of these images as they lack sufficient spatial context. In this work, we develop a methodology to localize images and link them to locations on a structural drawing. A stream of images can readily be gathered along the path taken through a building using a compact camera. These images may be used to compute a relative location of each image in a 3D point cloud model, which is reconstructed using a visual odometry algorithm. The images may also be used to create local 3D textured models for building-components-of-interest using a structure-from-motion algorithm. A parallel set of images that are collected for building assessment is linked to the image stream using time information. By projecting the point cloud model to the structural drawing, the images can be overlaid onto the drawing, providing clear context information necessary to make use of those images. Additionally, components- or damage-of-interest captured in these images can be reconstructed in 3D, enabling detailed assessments having sufficient geospatial context. The technique is demonstrated by emulating post-event building assessment and data collection in a real building.<\/jats:p>","DOI":"10.3390\/s20061610","type":"journal-article","created":{"date-parts":[[2020,3,18]],"date-time":"2020-03-18T08:13:27Z","timestamp":1584519207000},"page":"1610","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Automated Indoor Image Localization to Support a Post-Event Building Assessment"],"prefix":"10.3390","volume":"20","author":[{"given":"Xiaoyu","family":"Liu","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3697-992X","authenticated-orcid":false,"given":"Shirley J.","family":"Dyke","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA"}]},{"given":"Chul Min","family":"Yeum","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}]},{"given":"Ilias","family":"Bilionis","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA"}]},{"given":"Ali","family":"Lenjani","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6138-8809","authenticated-orcid":false,"given":"Jongseong","family":"Choi","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907, USA"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1109\/TMC.2015.2444379","article-title":"Smartphoto: A resource-aware crowdsourcing approach for image sensing with smartphones","volume":"15","author":"Wu","year":"2015","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hua, Y., He, W., Liu, X., and Feng, D. (May, January 26). SmartEye: Real-time and efficient cloud image sharing for disaster environments. Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM), Hongkong, China.","DOI":"10.1109\/INFOCOM.2015.7218541"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lenjani, A., Yeum, C.M., Dyke, S.J., and Bilionis, I. (2020, January 05). Automated Building Image Extraction from 360-Degree Panoramas for Post-Disaster Evaluation. Available online: https:\/\/onlinelibrary.wiley.com\/doi\/full\/10.1111\/mice.12493.","DOI":"10.1111\/mice.12493"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lenjani, A., Dyke, S.J., Bilionis, I., Yeum, C.M., Kamiya, K., Choi, J., Liu, X., and Chowdhury, A.G. (2019). Towards fully automated post-event data collection and analysis: Pre-event and post-event information fusion. Eng. Struct., in press.","DOI":"10.1016\/j.engstruct.2019.109884"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Adams, S.M., Levitan, M.L., and Friedland, C.J. (2013). High resolution imagery collection utilizing unmanned aerial vehicles (UAVs) for post-disaster studies. Advances in Hurricane Engineering: Learning from Our Past, ASCE Press.","DOI":"10.1061\/9780784412626.067"},{"key":"ref_6","unstructured":"EERI (2020, January 05). (Earthquake Engineering Research Institute). Available online: www.eqclearinghouse.org."},{"key":"ref_7","unstructured":"UC CEISMIC (2020, January 05). Canterbury Earthquake Digital Archive. Available online: www.ceismic.org.nz."},{"key":"ref_8","unstructured":"NIST (2020, January 17). 2010 Chile Earthquake, Available online: https:\/\/www.nist.gov\/image\/2010chileearthquakejpg."},{"key":"ref_9","unstructured":"DesignSafe-CI (2020, January 05). Rapid Experimental Facility. Available online: https:\/\/rapid.designsafe-ci.org."},{"key":"ref_10","unstructured":"(2020, January 05). QuakeQoRE. Available online: http:\/\/www.quakecore.nz\/."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MCSE.2017.3301213","article-title":"A cyberplatform for sharing scientific research data at DataCenterHub","volume":"20","author":"Christine","year":"2018","journal-title":"Comput. Sci. Eng."},{"key":"ref_12","unstructured":"(2020, January 05). Pacific Earthquake Engineering Research Center. Available online: https:\/\/peer.berkeley.edu\/."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1177\/1475921718765419","article-title":"Automated region-of-interest localization and classification for vision-based visual assessment of civil infrastructure","volume":"18","author":"Yeum","year":"2019","journal-title":"Struct. Health Monit."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"04018103","DOI":"10.1061\/(ASCE)CF.1943-5509.0001253","article-title":"Postevent Reconnaissance Image Documentation Using Automated Classification","volume":"33","author":"Yeum","year":"2018","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Choi, J., and Dyke, S.J. (2020, January 05). CrowdLIM: Crowdsourcing to Enable Lifecycle Infrastructure Management. Available online: http:\/\/arxiv.org\/pdf\/1607.02565.pdf.","DOI":"10.1016\/j.compind.2019.103185"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Choi, J., Yeum, C.M., Dyke, J.S., and Jahanshahi, M. (2018). Computer-aided approach for rapid post-event visual evaluation of a building fa\u00e7ade. Sensors, 18.","DOI":"10.3390\/s18093017"},{"key":"ref_17","unstructured":"(2020, January 05). GeoSLAM. Available online: https:\/\/geoslam.com\/."},{"key":"ref_18","unstructured":"Leica Geosystems (2020, January 17). BLK360. Available online: https:\/\/shop.leica-geosystems.com\/ca\/learn\/reality-capture\/blk360."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"04018056","DOI":"10.1061\/(ASCE)CP.1943-5487.0000798","article-title":"Automated Recovery of Structural Drawing Images Collected from Postdisaster Reconnaissance","volume":"33","author":"Yeum","year":"2018","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_20","unstructured":"Kos, T., Markezic, I., and Pokrajcic, J. (2010, January 15\u201317). Effects of multipath reception on GPS positioning performance. Proceedings of the ELMAR-2010, Zadar, Croatia."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1145\/128756.128759","article-title":"The active badge location system","volume":"10","author":"Want","year":"1992","journal-title":"Trans. Inf. Syst. (TOIS)"},{"key":"ref_22","unstructured":"Bahl, V., and Padmanabhan, V. (2000). Enhancements to the RADAR User Location and Tracking System, Microsoft Corporation."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gutmann, J.-S., Fong, P., Chiu, L., and Munich, M.E. (2013, January 22\u201323). Challenges of designing a low-cost indoor localization system using active beacons. Proceedings of the 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA, USA.","DOI":"10.1109\/TePRA.2013.6556348"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/TRO.2013.2293834","article-title":"A beacon-based angle measurement sensor for mobile robot positioning","volume":"30","author":"Pierlot","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Meng, W., He, Y., Deng, Z., and Li, C. (2012, January 1\u20134). Optimized access points deployment for WLAN indoor positioning system. Proceedings of the 2012 IEEE Wireless Communications and Networking Conference (WCNC), Paris, France.","DOI":"10.1109\/WCNC.2012.6214209"},{"key":"ref_26","first-page":"1","article-title":"A passive RFID information grid for location and proximity sensing for the blind user","volume":"TR04\u2013TR09","author":"Willis","year":"2004","journal-title":"Univ. Fla. Tech. Rep."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1109\/TIM.2011.2181912","article-title":"An RFID-based position and orientation measurement system for mobile objects in intelligent environments","volume":"61","author":"Shirehjini","year":"2012","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ruiz-L\u00f3pez, T., Garrido, J.L., Benghazi, K., and Chung, L. (2010). A survey on indoor positioning systems: Foreseeing a quality design. Distributed Computing and Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-642-14883-5_48"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/MRA.2011.943233","article-title":"Visual odometry [tutorial]","volume":"18","author":"Scaramuzza","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MRA.2012.2182810","article-title":"Visual odometry: Part II: Matching, robustness, optimization, and applications","volume":"19","author":"Fraundorfer","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s10462-012-9365-8","article-title":"Visual simultaneous localization and mapping: A survey","volume":"43","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_32","first-page":"363","article-title":"The slam problem: A survey","volume":"184","author":"Aulinas","year":"2008","journal-title":"CCIA"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/s41074-017-0027-2","article-title":"Applications. Visual SLAM algorithms: A survey from 2010 to 2016","volume":"9","author":"Taketomi","year":"2017","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_34","unstructured":"Nist\u00e9r, D., Naroditsky, O., and Bergen, J. (July, January 27). Visual odometry. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the 13th European conference on computer vision (ECCV 2014), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","unstructured":"Wing, D. (2017, March 03). TrueSNAP Shutter Freezes Fast-Moving Objects. Available online: http:\/\/ericfossum.com\/Articles\/Cumulative%20Articles%20about%20EF\/truesnaparticle.pdf."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1111\/0031-868X.00113","article-title":"The development of camera calibration methods and models","volume":"16","author":"Clarke","year":"1998","journal-title":"Photogramm. Rec."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huber, P.J. (1992). Robust estimation of a location parameter. Breakthroughs in Statistics, Springer.","DOI":"10.1007\/978-1-4612-4380-9_35"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1364\/JOSAA.5.001127","article-title":"Closed-form solution of absolute orientation using orthonormal matrices","volume":"5","author":"Horn","year":"1988","journal-title":"JOSA A"},{"key":"ref_44","unstructured":"Engel, J. (2020, March 03). DSO: Direct Sparse Odometry. Available online: https:\/\/github.com\/JakobEngel\/dso."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/6\/1610\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:06:46Z","timestamp":1760173606000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/6\/1610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,13]]},"references-count":44,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20061610"],"URL":"https:\/\/doi.org\/10.3390\/s20061610","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,13]]}}}