{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T05:03:41Z","timestamp":1785128621025,"version":"3.55.0"},"reference-count":43,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2017,8,2]],"date-time":"2017-08-02T00:00:00Z","timestamp":1501632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Suomen Akatemia","doi-asserted-by":"publisher","award":["272195"],"award-info":[{"award-number":["272195"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002341","name":"Suomen Akatemia","doi-asserted-by":"publisher","award":["293389"],"award-info":[{"award-number":["293389"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Accurate three-dimensional (3D) data from indoor spaces are of high importance for various applications in construction, indoor navigation and real estate management. Mobile scanning techniques are offering an efficient way to produce point clouds, but with a lower accuracy than the traditional terrestrial laser scanning (TLS). In this paper, we first tackle the problem of how the quality of a point cloud should be rigorously evaluated. Previous evaluations typically operate on some point cloud subset, using a manually-given length scale, which would perhaps describe the ranging precision or the properties of the environment. Instead, the metrics that we propose perform the quality evaluation to the full point cloud and over all of the length scales, revealing the method precision along with some possible problems related to the point clouds, such as outliers, over-completeness and misregistration. The proposed methods are used to evaluate the end product point clouds of some of the latest methods. In detail, point clouds are obtained from five commercial indoor mapping systems, Matterport, NavVis, Zebedee, Stencil and Leica Pegasus: Backpack, and three research prototypes, Aalto VILMA , FGI Slammer and the W\u00fcrzburg backpack. These are compared against survey-grade TLS point clouds captured from three distinct test sites that each have different properties. Based on the presented experimental findings, we discuss the properties of the proposed metrics and the strengths and weaknesses of the above mapping systems and then suggest directions for future research.<\/jats:p>","DOI":"10.3390\/rs9080796","type":"journal-article","created":{"date-parts":[[2017,8,2]],"date-time":"2017-08-02T10:05:25Z","timestamp":1501668325000},"page":"796","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":139,"title":["Comparison of the Selected State-Of-The-Art 3D Indoor Scanning and Point Cloud Generation Methods"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8856-5919","authenticated-orcid":false,"given":"Ville","family":"Lehtola","sequence":"first","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"},{"name":"Institute of Measuring and Modeling for the Built Environment, Aalto University, P.O. box 15800, 00076 Aalto, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4796-3942","authenticated-orcid":false,"given":"Harri","family":"Kaartinen","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"N\u00fcchter","sequence":"additional","affiliation":[{"name":"Informatics VII\u2014Robotics and Telematics, Julius Maximilians University W\u00fcrzburg, 97074 W\u00fcrzburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Risto","family":"Kaijaluoto","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3841-6533","authenticated-orcid":false,"given":"Antero","family":"Kukko","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paula","family":"Litkey","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7236-2145","authenticated-orcid":false,"given":"Eija","family":"Honkavaara","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5269-9023","authenticated-orcid":false,"given":"Tomi","family":"Rosnell","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9907-0516","authenticated-orcid":false,"given":"Matti","family":"Vaaja","sequence":"additional","affiliation":[{"name":"Institute of Measuring and Modeling for the Built Environment, Aalto University, P.O. box 15800, 00076 Aalto, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juho-Pekka","family":"Virtanen","sequence":"additional","affiliation":[{"name":"Institute of Measuring and Modeling for the Built Environment, Aalto University, P.O. box 15800, 00076 Aalto, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matti","family":"Kurkela","sequence":"additional","affiliation":[{"name":"Institute of Measuring and Modeling for the Built Environment, Aalto University, P.O. box 15800, 00076 Aalto, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aimad","family":"El Issaoui","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingli","family":"Zhu","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anttoni","family":"Jaakkola","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juha","family":"Hyypp\u00e4","sequence":"additional","affiliation":[{"name":"Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute FGI, Geodeetinrinne 2, FI-02430 Masala, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,8,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1111\/cgf.12077","article-title":"A Survey of Urban Reconstruction","volume":"32","author":"Musialski","year":"2013","journal-title":"Comput. Graph. Forum"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1016\/j.autcon.2010.06.007","article-title":"Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques","volume":"19","author":"Tang","year":"2010","journal-title":"Autom. Constr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.autcon.2013.10.023","article-title":"Building Information Modeling (BIM) for existing buildings\u2014Literature review and future needs","volume":"38","author":"Volk","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_4","first-page":"3218","article-title":"Accuracy of Kinematic Positioning Using Global Satellite Navigation Systems under Forest Canopies","volume":"6","author":"Kaartinen","year":"2015","journal-title":"For. Trees Livelihoods"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13753","DOI":"10.3390\/rs71013753","article-title":"Evaluation of a Backpack-Mounted 3D Mobile Scanning System","volume":"7","author":"Lauterbach","year":"2015","journal-title":"Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.isprsjprs.2016.09.004","article-title":"Localization of a mobile laser scanner via dimensional reduction","volume":"121","author":"Lehtola","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1109\/TRO.2012.2200990","article-title":"Zebedee: Design of a Spring-Mounted 3-D Range Sensor with Application to Mobile Mapping","volume":"28","author":"Bosse","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 14\u201316). LOAM: Lidar odometry and mapping in real-time. Proceedings of the Robotics: Science and Systems Conference (RSS), Berkeley, CA, USA.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, T., Carlberg, M., Chen, G., Chen, J., Kua, J., and Zakhor, A. (2010, January 15\u201317). Indoor localization and visualization using a human-operated backpack system. Proceedings of the 2010 International Conference on Indoor Positioning and Indoor Navigation, Zurich, Switzerland.","DOI":"10.1109\/IPIN.2010.5646820"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Furukawa, Y., Curless, B., Seitz, S.M., and Szeliski, R. (October, January 29). Reconstructing building interiors from images. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459145"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lehtola, V.V., Kurkela, M., and Hyypp\u00e4, H. (2014). Automated image-based reconstruction of building interiors\u2014A case study. Photogramm. J. Finl., 24.","DOI":"10.17690\/0414241.1"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"26430","DOI":"10.3390\/s151026430","article-title":"Development of kinematic 3D laser scanning system for indoor mapping and as-built BIM using constrained SLAM","volume":"15","author":"Jung","year":"2015","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.isprsjprs.2015.01.016","article-title":"Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers","volume":"105","author":"Weinmann","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","first-page":"17","article-title":"Challenges and present fields of action at laser scanner based deformation analyses","volume":"10","author":"Holst","year":"2016","journal-title":"J. Appl. Geod."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"143","DOI":"10.5194\/isprs-annals-III-1-143-2016","article-title":"Comparison of Zeb1 and Leica C10 indoor laser scanning point clouds","volume":"3","author":"Sirmacek","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","first-page":"476","article-title":"Change Detection in Terrestrial Laser Scanner Data Via Point Cloud Correspondence","volume":"4","author":"Tsakiri","year":"2015","journal-title":"Int. J. Eng. Innov. Res."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Schwertfeger, S., Jacoff, A.S., Scrapper, C., Pellenz, J., and Kleiner, A. (2011, January 28\u201330). Evaluation of Maps using Fixed Shapes: The Fiducial Map Metric. Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS \u201910) Workshop, Baltimore, MD, USA.","DOI":"10.1145\/2377576.2377638"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Schwertfeger, S., and Birk, A. (2013, January 6\u201310). Evaluation of Map Quality by Matching and Scoring High-Level, Topological Map Structures. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA \u201913), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630876"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/rob.20234","article-title":"Benchmarking Urban 6D SLAM","volume":"25","author":"Wulf","year":"2008","journal-title":"J. Field Rob. (JFR)"},{"key":"ref_20","first-page":"99","article-title":"A review of the use of terrestrial laser scanning application for change detection and deformation monitoring of structures","volume":"49","author":"Mukupa","year":"2017","journal-title":"Surv. Rev."},{"key":"ref_21","first-page":"601","article-title":"On the estimation of rigid-body transformation for tls registration","volume":"XXXIX-B5","author":"Scaioni","year":"2012","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_22","unstructured":"Gelfand, N., Ikemoto, L., Rusinkiewicz, S., and Levoy, M. (2003, January 6\u201310). Geometrically stable sampling for the ICP algorithm. Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling, Banff, AL, Canada."},{"key":"ref_23","unstructured":"(2016, October 21). Immersive 3D Spaces for real-world applications, Matterport. Available online: https:\/\/matterport.com\/."},{"key":"ref_24","unstructured":"Navvis (2016, October 20). Digitizing indoors\u2014NavVis. Available online: http:\/\/www.navvis.com."},{"key":"ref_25","unstructured":"Leica Geosystems (2017, February 01). Leica Pegasus: Backpack. Available online: http:\/\/www.leica-geosystems.com."},{"key":"ref_26","unstructured":"Kaarta (2017, February 01). Stencil. Available online: http:\/\/www.kaarta.com."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.isprsjprs.2014.10.008","article-title":"Localization of mobile laser scanner using classical mechanics","volume":"99","author":"Lehtola","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5194\/isprsarchives-XL-4-W5-1-2015","article-title":"Precise indoor localization for mobile laser scanner","volume":"XL-4\/W5","author":"Kaijaluoto","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_29","first-page":"W19","article-title":"Change detection on points cloud data acquired with a ground laser scanner","volume":"36","author":"Roux","year":"2005","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.isprsjprs.2007.07.008","article-title":"Deformation measurement using terrestrial laser scanning data and least squares 3D surface matching","volume":"63","author":"Monserrat","year":"2008","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.isprsjprs.2004.05.004","article-title":"Experimental comparison of filter algorithms for bare-Earth extraction from airborne laser scanning point clouds","volume":"59","author":"Sithole","year":"2004","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.isprsjprs.2014.02.004","article-title":"Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut","volume":"90","author":"Oesau","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s10208-004-0145-y","article-title":"A Theoretical and Computational Framework for Isometry Invariant Recognition of Point Cloud Data","volume":"5","author":"Sapiro","year":"2005","journal-title":"Found. Comput. Math."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1007\/s11263-009-0301-6","article-title":"A Gromov-Hausdorff Framework with Diffusion Geometry for Topologically-Robust Non-rigid Shape Matching","volume":"89","author":"Bronstein","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s10208-011-9093-5","article-title":"Gromov\u2014Wasserstein Distances and the Metric Approach to Object Matching","volume":"11","year":"2011","journal-title":"Found. Comput. Math."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.comgeo.2007.10.007","article-title":"On the performance of the ICP algorithm","volume":"41","author":"Ezra","year":"2008","journal-title":"Comput. Geom."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and resolution of kinect depth data for indoor mapping applications","volume":"12","author":"Khoshelham","year":"2012","journal-title":"Sensors"},{"key":"ref_38","first-page":"1","article-title":"Low-drift and real-time lidar odometry and mapping","volume":"41","author":"Zhang","year":"2016","journal-title":"Auton. Robot."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kohlbrecher, S., Von Stryk, O., Meyer, J., and Klingauf, U. (2011, January 1\u20135). A flexible and scalable slam system with full 3D motion estimation. Proceedings of the 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics, Kyoto, Japan.","DOI":"10.1109\/SSRR.2011.6106777"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.robot.2007.07.002","article-title":"Globally consistent 3D mapping with scan matching","volume":"56","author":"Borrmann","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"81","DOI":"10.5194\/isprs-annals-III-4-81-2016","article-title":"Localization corrections for mobile laser scanner using local support-based outlier filtering","volume":"III-4","author":"Lehtola","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_42","unstructured":"(2016, October 20). Karto Robotics. Available online: http:\/\/www.kartorobotics.com."},{"key":"ref_43","unstructured":"(2016, October 20). ROS.org | Powering the world\u2019s robots. Available online: http:\/\/www.ros.org."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/8\/796\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:44:58Z","timestamp":1760208298000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/8\/796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,2]]},"references-count":43,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2017,8]]}},"alternative-id":["rs9080796"],"URL":"https:\/\/doi.org\/10.3390\/rs9080796","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,2]]}}}