{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T17:20:06Z","timestamp":1771521606157,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T00:00:00Z","timestamp":1610409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mobile mapping is in the process of becoming a routinely applied standard tool to support administration of cities. For ensuring the usability of the mobile mapping data it is necessary to have a practical method to evaluate the quality of different systems, which reaches beyond 3D accuracy of individual points. Such a method must be objective, easy to implement, and provide quantitative results to be used in tendering processes. We present such an approach which extracts quality figures for point density, point distribution, point cloud planarity, image resolution, and street sign legibility. In its practical application for the mobile mapping campaign of the City of Vienna (Austria) in 2020 the proposed test method proved to fulfill the above requirements. As an additional result, quality figures are reported for the panorama images and point clouds of three different mobile mapping systems.<\/jats:p>","DOI":"10.3390\/rs13020237","type":"journal-article","created":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T20:11:31Z","timestamp":1610482291000},"page":"237","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Test Charts for Evaluating Imaging and Point Cloud Quality of Mobile Mapping Systems for Urban Street Space Acquisition"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2348-7929","authenticated-orcid":false,"given":"Norbert","family":"Pfeifer","sequence":"first","affiliation":[{"name":"Department of Geodesy and Geoinformation, TU Wien, Wiedner Hauptstra\u00dfe 8-10, 1040 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2885-0237","authenticated-orcid":false,"given":"Johannes","family":"Falkner","sequence":"additional","affiliation":[{"name":"City of Vienna, Municipal Department \u201cSurveying and Mapping\u201d (MA 41), Muthgasse 62, 1190 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8032-4085","authenticated-orcid":false,"given":"Andreas","family":"Bayr","sequence":"additional","affiliation":[{"name":"Department of Geodesy and Geoinformation, TU Wien, Wiedner Hauptstra\u00dfe 8-10, 1040 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9224-5878","authenticated-orcid":false,"given":"Lothar","family":"Eysn","sequence":"additional","affiliation":[{"name":"City of Vienna, Municipal Department \u201cSurveying and Mapping\u201d (MA 41), Muthgasse 62, 1190 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3716-8961","authenticated-orcid":false,"given":"Camillo","family":"Ressl","sequence":"additional","affiliation":[{"name":"Department of Geodesy and Geoinformation, TU Wien, Wiedner Hauptstra\u00dfe 8-10, 1040 Vienna, Austria"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,12]]},"reference":[{"key":"ref_1","unstructured":"Eysn, L. (2020). City of Vienna\u2019s Activity in Large Scale Mobile Mapping and Related Image Based Artificial Intelligence\u2014Digitizing the Public Space\u2014Project \u201cWien gibt Raum\u201d, Cultural Heritage and New Technologies (CHNT)."},{"key":"ref_2","unstructured":"Falkner, J., and Eysn, L. (2019, January 20\u201322). Kappazunder\u2014Ein Mobile Mapping Tool als L\u00f6sung f\u00fcr Fragestellungen der Verwaltung im \u00f6ffentlichen Raum. Proceedings of the 39th Wissenschaftlich-Technische Jahrestagung der DGPF e.V. (Dreil\u00e4ndertagung), Wien, \u00d6sterreich."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MC.2010.170","article-title":"Google Street View: Capturing the World at Street Level","volume":"43","author":"Anguelov","year":"2010","journal-title":"Computer"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1080\/1472586X.2014.941559","article-title":"Google Street View: Navigating the operative image","volume":"29","author":"Hoelzl","year":"2014","journal-title":"Vis. Stud."},{"key":"ref_5","unstructured":"Jeansoulin, R., and Goodchild, M.F. (1998). Metamodels for data quality description. Data Quality in Geographic Information: From Error to Uncertainty, Herm\u00e8s."},{"key":"ref_6","unstructured":"Mocnik, F.B., Fan, H., and Zipf, A. (2017, January 9\u201312). Data Quality and Fitness for Purpose. Proceedings of the 20th AGILE Conference on Geographic Information Science, Wageningen, The Netherlands."},{"key":"ref_7","unstructured":"Riegl Laser Measurement Systems GmbH (2021, January 11). Riegl VMX-2HA. Available online: http:\/\/www.riegl.com\/uploads\/tx_pxpriegldownloads\/RIEGL_VMX-2HA_brochure_2020-09-11.pdf."},{"key":"ref_8","unstructured":"Mitsubishi Electric Corporation (2021, January 11). MMS-G. Available online: http:\/\/www.mitsubishielectric.com\/bu\/mms\/catalog\/pdf\/catalog.pdf."},{"key":"ref_9","unstructured":"iNovitas AG (2021, January 11). Product portfolio. Available online: https:\/\/www.inovitas.ch\/en\/products\/overview."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Menze, M., and Geiger, A. (2015, January 7\u201312). Object Scene Flow for Autonomous Vehicles. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298925"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.isprsjprs.2013.10.004","article-title":"Results of the ISPRS benchmark on urban object detection and 3D building reconstruction","volume":"93","author":"Rottensteiner","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.isprsjprs.2018.06.021","article-title":"International benchmarking of terrestrial laser scanning approaches for forest inventories","volume":"144","author":"Liang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/978-3-319-11752-2_3","article-title":"High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth","volume":"Volume 8753","author":"Scharstein","year":"2014","journal-title":"German Conference on Pattern Recognition"},{"key":"ref_14","unstructured":"Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. (2006, January 17\u201322). A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_15","first-page":"135","article-title":"ISPRS Benchmark for Multi-Platform Photogrammetry","volume":"2","author":"Nex","year":"2015","journal-title":"Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"12814","DOI":"10.3390\/s120912814","article-title":"Benchmarking the Performance of Mobile Laser Scanning Systems Using a Permanent Test Field","volume":"12","author":"Kaartinen","year":"2012","journal-title":"Sensors"},{"key":"ref_17","unstructured":"Olsen, M., Roe, G., Glennie, C., Persi, F., Reedy, M., Hurwitz, D., Williams, K., Tuss, H., Squellati, A., and Knodler, M. (2013). NCHRP 15\u201344 Guidelines for the Use of Mobile LiDAR in Transportation Applications, National Academy of Sciences."},{"key":"ref_18","unstructured":"Cramer, M. (2005). 10 Years ifp Test Site Vaihingen\/Enz: An Independent Performance Study, Wichmann. Photogrammetric Week."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"95","DOI":"10.14358\/PERS.74.1.95","article-title":"A Permanent Test Field for Digital Photogrammetric Systems","volume":"74","author":"Honkavaara","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_20","first-page":"1","article-title":"Proposal for a full testing procedure for terrestrial laser scanners (TLS)","volume":"Volume II","author":"Kahmen","year":"2009","journal-title":"Optical 3-D Measurement Techniques IX"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.3390\/ijgi2041038","article-title":"Georeferenced Point Clouds: A Survey of Features and Point Cloud Management","volume":"2","author":"Otepka","year":"2013","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., Chen, Q., Zhu, Q., Liu, L., Li, C., and Zheng, D. (2019). A Survey of Mobile Laser Scanning Applications and Key Techniques over Urban Areas. Remote Sens., 11.","DOI":"10.3390\/rs11131540"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.isprsjprs.2015.01.016","article-title":"Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers","volume":"105","author":"Weinmann","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_24","unstructured":"Arief, H.A., Arief, M., Bhat, M., Indahl, U., Tveite, H., and Zhao, D. (2019, January 15\u201320). Density-Adaptive Sampling for Heterogeneous Point Cloud Object Segmentation in Autonomous Vehicle Applications. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"743","DOI":"10.14358\/PERS.71.6.743","article-title":"Neighborhood systems for airborne laser data","volume":"71","author":"Filin","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9471","DOI":"10.3390\/s140609471","article-title":"Calculation of Target-Specific Point Distribution for 2D Mobile Laser Scanners","volume":"14","author":"Cahalane","year":"2014","journal-title":"Sensors"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cahalane, C., Lewis, P., McElhinney, C.P., McNerney, E., and McCarthy, T. (2016). Improving MMS Performance during Infrastructure Surveys through Geometry Aided Design. Infrastructures, 1.","DOI":"10.3390\/infrastructures1010005"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sandau, R. (2010). Digital Ariborne Camera, Springer.","DOI":"10.1007\/978-1-4020-8878-0"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"577","DOI":"10.3390\/rs1030577","article-title":"Digital Airborne Photogrammetry\u2014A New Tool for Quantitative Remote Sensing?\u2014A State-of-the-Art Review On Radiometric Aspects of Digital Photogrammetric Images","volume":"1","author":"Honkavaara","year":"2009","journal-title":"Remote Sens."},{"key":"ref_30","unstructured":"Reulke, R., Tempelmann, U., Stallmann, D., Cramer, M., and Haala, N. (2004, January 12\u201323). Improvement of spatial resolution with staggered arrays as used in the airborne optical sensor ADS40. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Istanbul, Turkey."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Milenkovi\u0107, M., Ressl, C., Karel, W., Mandlburger, G., and Pfeifer, N. (2018). Roughness Spectra Derived from Multi-Scale LiDAR Point Clouds of a Gravel Surface: A Comparison and Sensitivity Analysis. Isprs Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7020069"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.ijtst.2016.09.003","article-title":"Analysis of factors temporarily impacting traffic sign readability","volume":"5","author":"Khalilikhah","year":"2016","journal-title":"Int. J. Transp. Sci. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1177\/096032719202400304","article-title":"Legibility and readability of light refecting matrix variable message road signs","volume":"24","author":"Collins","year":"1992","journal-title":"Light. Res. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1127\/pfg\/2016\/0288","article-title":"Dense Image Matching vs. Airborne Laser Scanning\u2014Comparison of two methods for deriving terrain models","volume":"2016","author":"Ressl","year":"2016","journal-title":"PFG Photogramm. Fernerkundung Geoinf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Stricker, R., Eisenbach, M., Sesselmann, M., Debes, K., and Gross, H. (2019, January 14\u201319). Improving Visual Road Condition Assessment by Extensive Experiments on the Extended GAPs Dataset. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852257"},{"key":"ref_36","unstructured":"(2021, January 11). CloudCompare. Version 2.1. Available online: http:\/\/www.cloudcompare.org\/."},{"key":"ref_37","unstructured":"(2020, November 20). Octave. Version 5. Available online: https:\/\/octave.org\/."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.compenvurbsys.2013.11.002","article-title":"OPALS\u2014A framework for Airborne Laser Scanning data analysis","volume":"45","author":"Pfeifer","year":"2014","journal-title":"Comput. Environ. Urban Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/237\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:10:00Z","timestamp":1760159400000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/237"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,12]]},"references-count":38,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["rs13020237"],"URL":"https:\/\/doi.org\/10.3390\/rs13020237","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,12]]}}}