{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T01:34:54Z","timestamp":1771810494952,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,5]],"date-time":"2021-08-05T00:00:00Z","timestamp":1628121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>A successful application of low-cost 3D cameras in combination with artificial intelligence (AI)-based 3D object detection algorithms to outdoor mobile mapping would offer great potential for numerous mapping, asset inventory, and change detection tasks in the context of smart cities. This paper presents a mobile mapping system mounted on an electric tricycle and a procedure for creating on-street parking statistics, which allow government agencies and policy makers to verify and adjust parking policies in different city districts. Our method combines georeferenced red-green-blue-depth (RGB-D) imagery from two low-cost 3D cameras with state-of-the-art 3D object detection algorithms for extracting and mapping parked vehicles. Our investigations demonstrate the suitability of the latest generation of low-cost 3D cameras for real-world outdoor applications with respect to supported ranges, depth measurement accuracy, and robustness under varying lighting conditions. In an evaluation of suitable algorithms for detecting vehicles in the noisy and often incomplete 3D point clouds from RGB-D cameras, the 3D object detection network PointRCNN, which extends region-based convolutional neural networks (R-CNNs) to 3D point clouds, clearly outperformed all other candidates. The results of a mapping mission with 313 parking spaces show that our method is capable of reliably detecting parked cars with a precision of 100% and a recall of 97%. It can be applied to unslotted and slotted parking and different parking types including parallel, perpendicular, and angle parking.<\/jats:p>","DOI":"10.3390\/rs13163099","type":"journal-article","created":{"date-parts":[[2021,8,5]],"date-time":"2021-08-05T21:43:53Z","timestamp":1628199833000},"page":"3099","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Outdoor Mobile Mapping and AI-Based 3D Object Detection with Low-Cost RGB-D Cameras: The Use Case of On-Street Parking Statistics"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8574-1988","authenticated-orcid":false,"given":"Stephan","family":"Nebiker","sequence":"first","affiliation":[{"name":"Institute of Geomatics, FHNW University of Applied Sciences and Arts Northwestern Switzerland, Hofackerstrasse 30, 4132 Muttenz, Switzerland"}]},{"given":"Jonas","family":"Meyer","sequence":"additional","affiliation":[{"name":"Institute of Geomatics, FHNW University of Applied Sciences and Arts Northwestern Switzerland, Hofackerstrasse 30, 4132 Muttenz, Switzerland"}]},{"given":"Stefan","family":"Blaser","sequence":"additional","affiliation":[{"name":"Institute of Geomatics, FHNW University of Applied Sciences and Arts Northwestern Switzerland, Hofackerstrasse 30, 4132 Muttenz, Switzerland"}]},{"given":"Manuela","family":"Ammann","sequence":"additional","affiliation":[{"name":"Institute of Geomatics, FHNW University of Applied Sciences and Arts Northwestern Switzerland, Hofackerstrasse 30, 4132 Muttenz, Switzerland"}]},{"given":"Severin","family":"Rhyner","sequence":"additional","affiliation":[{"name":"Institute of Geomatics, FHNW University of Applied Sciences and Arts Northwestern Switzerland, Hofackerstrasse 30, 4132 Muttenz, Switzerland"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/j.tranpol.2006.05.005","article-title":"Cruising for Parking","volume":"13","author":"Shoup","year":"2006","journal-title":"Transp. Policy"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Rapp Trans AG Basel-Stadt (2019). Erhebung Parkplatzauslastung Stadt Basel 2019, RAPP Group. Version 1.","DOI":"10.12685\/jbab.2019.1-15"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mathur, S., Jin, T., Kasturirangan, N., Chandrasekaran, J., Xue, W., Gruteser, M., and Trappe, W. (2010, January 15\u201318). ParkNet. Proceedings of the 8th International Conference on Mobile Systems,  Applications and Services\u2014MobiSys\u201910, San Francisco, CA, USA.","DOI":"10.1145\/1814433.1814448"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bock, F., Eggert, D., and Sester, M. (2015, January 15\u201318). On-Street Parking Statistics Using LiDAR Mobile Mapping. Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems, Gran Canaria, Spain.","DOI":"10.1109\/ITSC.2015.452"},{"key":"ref_5","unstructured":"Fetscher, S. (2020). Automatische Analyse von Streetlevel-Bilddaten F\u00fcr das Digitale Parkplatzmanagement. [Bachelor\u2019s Thesis, FHNW University of Applied Sciences and Arts Northwestern Switzerland]."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Polycarpou, E., Lambrinos, L., and Protopapadakis, E. (2013, January 4\u20137). Smart Parking Solutions for Urban Areas. Proceedings of the 2013 IEEE 14th International Symposium on \u201cA World of Wireless, Mobile and Multimedia Networks\u201d (WoWMoM), Madrid, Spain.","DOI":"10.1109\/WoWMoM.2013.6583499"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1049\/iet-its.2017.0406","article-title":"Smart Parking Sensors, Technologies and Applications for Open Parking Lots: A Review","volume":"12","author":"Paidi","year":"2018","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Barriga, J.J., Sulca, J., Le\u00f3n, J.L., Ulloa, A., Portero, D., Andrade, R., and Yoo, S.G. (2019). Smart Parking: A Literature Review from the Technological Perspective. Appl. Sci., 9.","DOI":"10.3390\/app9214569"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Houben, S., Komar, M., Hohm, A., Luke, S., Neuhausen, M., and Schlipsing, M. (2013, January 6\u20139). On-Vehicle Video-Based Parking Lot Recognition with Fisheye Optics. Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), The Hague, The Netherlands.","DOI":"10.1109\/ITSC.2013.6728595"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Suhr, J., and Jung, H. (2018). A Universal Vacant Parking Slot Recognition System Using Sensors Mounted on Off-the-Shelf Vehicles. Sensors, 18.","DOI":"10.3390\/s18041213"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Grassi, G., Jamieson, K., Bahl, P., and Pau, G. (2017, January 12\u201314). Parkmaster: An in\u2013Vehicle, Edge\u2013Based Video Analytics Service for Detecting Open Parking Spaces in Urban Environments. Proceedings of the Second ACM\/IEEE Symposium on Edge Computing, San Jose, CA, USA.","DOI":"10.1145\/3132211.3134452"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2267","DOI":"10.3390\/ijgi4042267","article-title":"Cloud-Based Geospatial 3D Image Spaces\u2014A Powerful Urban Model for the Smart City","volume":"4","author":"Nebiker","year":"2015","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_13","unstructured":"Wu, Y., Kirillov, A., Massa, F., Lo, W.-Y., and Girshick, R. (2021, August 03). Detectron2. Available online: https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"29375","DOI":"10.1007\/s11042-020-09479-0","article-title":"Analysis of RGB-D Camera Technologies for Supporting Different Facial Usage Scenarios","volume":"79","author":"Ulrich","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kuznetsova, A., Leal-Taixe, L., and Rosenhahn, B. (2013, January 2\u20138). Real-Time Sign Language Recognition Using a Consumer Depth Camera. Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops, Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.18"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jain, H.P., Subramanian, A., Das, S., and Mittal, A. (2011, January 10\u201311). Real-Time Upper-Body Human Pose Estimation Using a Depth Camera. Proceedings of the International Conference on Computer Vision\/Computer Graphics Collaboration Techniques and Applications, Rocquencourt, France.","DOI":"10.1007\/978-3-642-24136-9_20"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1111\/cgf.13386","article-title":"State of the Art on 3D Reconstruction with RGB-D Cameras","volume":"37","author":"Stotko","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105","DOI":"10.5194\/isprs-archives-XLII-2-W8-105-2017","article-title":"Design and Implementation of a Novel Portable 360\u00b0 Stereo Camera System with Low-Cost Action Cameras","volume":"42","author":"Holdener","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"741","DOI":"10.5194\/isprs-annals-V-2-2020-741-2020","article-title":"Performance evaluation of a mobile mapping application using smartphones and augmented reality frameworks","volume":"5","author":"Hasler","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Torresani, A., Menna, F., Battisti, R., and Remondino, F. (2021). A V-SLAM Guided and Portable System for Photogrammetric Applications. Remote Sens., 13.","DOI":"10.3390\/rs13122351"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D Mapping: Using Kinect-Style Depth Cameras for Dense 3D Modeling of Indoor Environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Rob. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Henry, P., Krainin, M., Herbst, E., Ren, X., and Fox, D. (2014). RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments. Experimental Robotics, Springer.","DOI":"10.1007\/978-3-642-28572-1_33"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Brahmanage, G., and Leung, H. (2019, January 27\u201330). Outdoor RGB-D Mapping Using Intel-RealSense. Proceedings of the 2019 IEEE SENSORS, Montreal, QC, Canada.","DOI":"10.1109\/SENSORS43011.2019.8956916"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"31","DOI":"10.5194\/isprs-archives-XLII-1-W2-31-2019","article-title":"Evaluation of a mobile multi-sensor system for seamless outdoor and indoor mapping","volume":"XLII-1\/W2","author":"Iwaszczuk","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MRA.2018.2852795","article-title":"An Empirical Evaluation of Ten Depth Cameras: Bias, Precision, Lateral Noise, Different Lighting Conditions and Materials, and Multiple Sensor Setups in Indoor Environments","volume":"26","author":"Suchi","year":"2019","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Louren\u00e7o, F., and Araujo, H. (2021, January 8\u201310). Intel RealSense SR305, D415 and L515: Experimental Evaluation and Comparison of Depth Estimation. Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021), Online Streaming.","DOI":"10.5220\/0010254203620369"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Vit, A., and Shani, G. (2018). Comparing RGB-D Sensors for Close Range Outdoor Agricultural Phenotyping. Sensors, 18.","DOI":"10.20944\/preprints201810.0664.v1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object Detection with Deep Learning: A Review","volume":"30","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Friederich, J., and Zschech, P. (2020, January 8\u201311). Review and Systematization of Solutions for 3d Object Detection. Proceedings of the 15th International Conference on Business Information Systems, Potsdam, Germany.","DOI":"10.30844\/wi_2020_r2-friedrich"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3782","DOI":"10.1109\/TITS.2019.2892405","article-title":"A Survey on 3D Object Detection Methods for Autonomous Driving Applications","volume":"20","author":"Arnold","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, X., and Li, H. (2019, January 16\u201320). PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00086"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., and Li, H. (2020, January 14\u201319). PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection. Proceedings of the Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01054"},{"key":"ref_33","unstructured":"(2021, July 29). KITTI 3D Object Detection Online Benchmark. Available online: http:\/\/www.cvlibs.net\/datasets\/kitti\/eval_object.php?obj_benchmark=3d."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zheng, W., Tang, W., Jiang, L., and Fu, C.-W. (2021). SE-SSD: Self-Ensembling Single-Stage Object Detector from Point Cloud. arXiv.","DOI":"10.1109\/CVPR46437.2021.01426"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Li, Z., Yao, Y., Quan, Z., Yang, W., and Xie, J. (2021). SIENet: Spatial Information Enhancement Network for 3D Object Detection from Point Cloud. arXiv.","DOI":"10.1016\/j.patcog.2022.108684"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Deng, J., Shi, S., Li, P., Zhou, W., Zhang, Y., and Li, H. (2020). Voxel R-CNN: Towards High Performance Voxel-Based 3D Object Detection. arXiv.","DOI":"10.1609\/aaai.v35i2.16207"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18\u201323). Frustum PointNets for 3D Object Detection from RGB-D Data. Proceedings of the Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, Z., and Jia, K. (2019, January 3\u20138). Frustum ConvNet: Sliding Frustums to Aggregate Local Point-Wise Features for Amodal. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8968513"},{"key":"ref_39","unstructured":"Swift Navigation, I. (2021, August 03). PiksiMulti GNSS Module Hardware Specification. Available online: https:\/\/www.swiftnav.com\/latest\/piksi-multi-hw-specification."},{"key":"ref_40","unstructured":"Intel Corporation (2021, August 03). Intel\u00aeRealSense Product Family D400 Series: Datasheet. Available online: https:\/\/dev.intelrealsense.com\/docs\/intel-realsense-d400-series-product-family-datasheet."},{"key":"ref_41","unstructured":"nVidia Developers (2021, July 29). Jetson TX2 Module. Available online: https:\/\/developer.nvidia.com\/embedded\/jetson-tx2."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"333","DOI":"10.5194\/isprs-annals-V-1-2020-333-2020","article-title":"Centimetre-accuracy in forests and urban canyons\u2014Combining a high-performance image-based mobile mapping backpack with new georeferencing methods","volume":"1","author":"Blaser","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"13","DOI":"10.5194\/isprs-annals-IV-1-13-2018","article-title":"Development of a Portable High Performance Mobile Mapping System Using the Robot Operating System","volume":"4","author":"Blaser","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_44","first-page":"5","article-title":"ROS: An Open-Source Robot Operating System","volume":"3","author":"Quigley","year":"2009","journal-title":"ICRA Workshop Open Source Softw."},{"key":"ref_45","unstructured":"Dorodnicov, S., and Hirshberg, D. (2021, July 29). Realsense2_Camera. Available online: http:\/\/wiki.ros.org\/realsense2_camera."},{"key":"ref_46","unstructured":"NovAtel (2021, August 03). Inertial Explorer 8.9 User Manual. Available online: https:\/\/docs.novatel.com\/Waypoint\/Content\/PDFs\/Waypoint_Software_User_Manual_OM-20000166.pdf."},{"key":"ref_47","unstructured":"understand.ai (2021, August 03). Anonymizer. Available online: https:\/\/github.com\/understand-ai\/anonymizer."},{"key":"ref_48","unstructured":"OpenPCDet Development Team (2021, July 29). OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds. Available online: https:\/\/github.com\/open-mmlab\/OpenPCDet."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 16\u201320). Pointpillars: Fast Encoders for Object Detection from Point Clouds. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Yan, Y., Mao, Y., and Li, B. (2018). Second: Sparsely Embedded Convolutional Detection. Sensors, 18.","DOI":"10.3390\/s18103337"},{"key":"ref_51","first-page":"2977026","article-title":"From Points to Parts: 3D Object Detection from Point Cloud with Part-Aware and Part-Aggregation Network","volume":"1","author":"Shi","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Butler, H., Daly, M., Doyle, A., Gillies, S., Hagen, S., and Schaub, T. (2016). The GeoJSON Format. RFC 7946. IETF Internet Eng. Task Force, Available online: https:\/\/www.rfc-editor.org\/info\/rfc7946.","DOI":"10.17487\/RFC7946"},{"key":"ref_54","unstructured":"QGIS Development Team (2021, August 03). QGIS Geographic Information System. Open Source Geospatial Foundation, Available online: https:\/\/qgis.org\/en\/site\/."},{"key":"ref_55","unstructured":"Ester, M., Kriegel, H.-P., Sander, J., and Xu, X. (1996, January 2\u20134). A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, OR, USA."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"529","DOI":"10.5194\/isprs-archives-XLI-B1-529-2016","article-title":"A Systematic Comparison of Direct and Image-Based Georeferencing in Challenging Urban Areas","volume":"41","author":"Cavegn","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_57","unstructured":"Frey, J. (2021). Bildbasierte L\u00f6sung f\u00fcr das mobile Parkplatzmonitoring. [Master\u2019s Thesis, FHNW University of Applied Sciences and Arts Northwestern Switzerland]."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3099\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:41:22Z","timestamp":1760164882000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3099"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,5]]},"references-count":57,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163099"],"URL":"https:\/\/doi.org\/10.3390\/rs13163099","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,5]]}}}