{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T15:17:18Z","timestamp":1780759038675,"version":"3.54.1"},"reference-count":45,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,21]],"date-time":"2021-11-21T00:00:00Z","timestamp":1637452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Paris-CARLA-3D is a dataset of several dense colored point clouds of outdoor environments built by a mobile LiDAR and camera system. The data are composed of two sets with synthetic data from the open source CARLA simulator (700 million points) and real data acquired in the city of Paris (60 million points), hence the name Paris-CARLA-3D. One of the advantages of this dataset is to have simulated the same LiDAR and camera platform in the open source CARLA simulator as the one used to produce the real data. In addition, manual annotation of the classes using the semantic tags of CARLA was performed on the real data, allowing the testing of transfer methods from the synthetic to the real data. The objective of this dataset is to provide a challenging dataset to evaluate and improve methods on difficult vision tasks for the 3D mapping of outdoor environments: semantic segmentation, instance segmentation, and scene completion. For each task, we describe the evaluation protocol as well as the experiments carried out to establish a baseline.<\/jats:p>","DOI":"10.3390\/rs13224713","type":"journal-article","created":{"date-parts":[[2021,11,21]],"date-time":"2021-11-21T21:00:50Z","timestamp":1637528450000},"page":"4713","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":58,"title":["Paris-CARLA-3D: A Real and Synthetic Outdoor Point Cloud Dataset for Challenging Tasks in 3D Mapping"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6696-9354","authenticated-orcid":false,"given":"Jean-Emmanuel","family":"Deschaud","sequence":"first","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Robotics, 75006 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Duque","sequence":"additional","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Mathematical Morphology, 77300 Fontainebleau, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4771-7538","authenticated-orcid":false,"given":"Jean Pierre","family":"Richa","sequence":"additional","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Robotics, 75006 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2438-1747","authenticated-orcid":false,"given":"Santiago","family":"Velasco-Forero","sequence":"additional","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Mathematical Morphology, 77300 Fontainebleau, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beatriz","family":"Marcotegui","sequence":"additional","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Mathematical Morphology, 77300 Fontainebleau, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1527-2650","authenticated-orcid":false,"given":"Fran\u00e7ois","family":"Goulette","sequence":"additional","affiliation":[{"name":"MINES ParisTech, PSL University, Centre for Robotics, 75006 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., and Schmid, C. (2012, January 7\u201313). Indoor Segmentation and Support Inference from RGBD Images. Proceedings of the Computer Vision\u2014ECCV 2012, Florence, Italy.","DOI":"10.1007\/978-3-642-33709-3"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Varney, N., Asari, V.K., and Graehling, Q. (2020, January 14\u201319). DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00101"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, X., Li, C., Tong, Z., Lim, A., Yuan, J., Wu, Y., Tang, J., and Huang, R. (2020, January 12\u201316). Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413661"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hu, Q., Yang, B., Khalid, S., Xiao, W., Trigoni, N., and Markham, A. (2021, January 19\u201325). Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00494"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., and Gall, J. (2019, January 27\u201328). SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00939"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tan, W., Qin, N., Ma, L., Li, Y., Du, J., Cai, G., Yang, K., and Li, J. (2020, January 14\u201319). Toronto-3D: A Large-Scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadways. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00109"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hackel, T., Savinov, N., Ladicky, L., Wegner, J.D., Schindler, K., and Pollefeys, M. (2017). SEMANTIC3D.NET: A new large-scale point cloud classification benchmark. arXiv.","DOI":"10.5194\/isprs-annals-IV-1-W1-91-2017"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xiao, J., Owens, A., and Torralba, A. (2013, January 1\u20138). SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia.","DOI":"10.1109\/ICCV.2013.458"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"McCormac, J., Handa, A., Leutenegger, S., and Davison, A.J. (2017, January 22\u201329). SceneNet RGB-D: Can 5M Synthetic Images Beat Generic ImageNet Pre-training on Indoor Segmentation?. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.292"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Armeni, I., Sener, O., Zamir, A.R., Jiang, H., Brilakis, I., Fischer, M., and Savarese, S. (2016, January 27\u201330). 3D Semantic Parsing of Large-Scale Indoor Spaces. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.170"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dai, A., Chang, A.X., Savva, M., Halber, M., Funkhouser, T., and Nie\u00dfner, M. (2017, January 21\u201326). ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.261"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., and Zhang, Y. (2017, January 10\u201312). Matterport3D: Learning from RGB-D Data in Indoor Environments. Proceedings of the 2017 International Conference on 3D Vision (3DV), Qingdao, China.","DOI":"10.1109\/3DV.2017.00081"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hurl, B., Czarnecki, K., and Waslander, S. (2019, January 9\u201312). Precise Synthetic Image and LiDAR (PreSIL) Dataset for Autonomous Vehicle Perception. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8813809"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020, January 14\u201319). nuScenes: A Multimodal Dataset for Autonomous Driving. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_15","unstructured":"Geyer, J., Kassahun, Y., Mahmudi, M., Ricou, X., Durgesh, R., Chung, A.S., Hauswald, L., Pham, V.H., M\u00fchlegg, M., and Dorn, S. (2020). A2D2: Audi Autonomous Driving Dataset. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pan, Y., Gao, B., Mei, J., Geng, S., Li, C., and Zhao, H. (2020, January 23). SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instances. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304596"},{"key":"ref_17","unstructured":"Xiao, A., Huang, J., Guan, D., Zhan, F., and Lu, S. (2021). SynLiDAR: Learning From Synthetic LiDAR Sequential Point Cloud for Semantic Segmentation. arXiv."},{"key":"ref_18","unstructured":"Deschaud, J.E. (2021). KITTI-CARLA: A KITTI-like dataset generated by CARLA Simulator. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Munoz, D., Bagnell, J.A., Vandapel, N., and Hebert, M. (2009, January 20\u201325). Contextual classification with functional Max-Margin Markov Networks. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206590"},{"key":"ref_20","unstructured":"Serna, A., Marcotegui, B., Goulette, F., and Deschaud, J.E. (2014, January 6\u20138). Paris-rue-Madame database: A 3D mobile laser scanner dataset for benchmarking urban detection, segmentation and classification methods. Proceedings of the 4th International Conference on Pattern Recognition, Applications and Methods (ICPRAM 2014), Loire Valley, France."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.cag.2015.03.004","article-title":"TerraMobilita\/iQmulus urban point cloud analysis benchmark","volume":"49","author":"Vallet","year":"2015","journal-title":"Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1177\/0278364918767506","article-title":"Paris-Lille-3D: A large and high-quality ground-truth urban point cloud dataset for automatic segmentation and classification","volume":"37","author":"Roynard","year":"2018","journal-title":"Int. J. Robot. Res."},{"key":"ref_23","unstructured":"Griffiths, D., and Boehm, J. (2019). SynthCity: A large scale synthetic point cloud. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhu, J., Gehrung, J., Huang, R., Borgmann, B., Sun, Z., Hoegner, L., Hebel, M., Xu, Y., and Stilla, U. (2020). TUM-MLS-2016: An Annotated Mobile LiDAR Dataset of the TUM City Campus for Semantic Point Cloud Interpretation in Urban Areas. Remote Sens., 12.","DOI":"10.3390\/rs12111875"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Deschaud, J.E. (2018, January 21\u201325). IMLS-SLAM: Scan-to-Model Matching Based on 3D Data. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460653"},{"key":"ref_27","unstructured":"Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, January 13\u201315). CARLA: An Open Urban Driving Simulator. Proceedings of the 1st Annual Conference on Robot Learning, Mountain View, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bello, S.A., Yu, S., Wang, C., Adam, J.M., and Li, J. (2020). Review: Deep Learning on 3D Point Clouds. Remote Sens., 12.","DOI":"10.3390\/rs12111729"},{"key":"ref_29","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4\u20139). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (2019, January 27\u201328). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00651"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4338","DOI":"10.1109\/TPAMI.2020.3005434","article-title":"Deep Learning for 3D Point Clouds: A Survey","volume":"43","author":"Guo","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Duque-Arias, D., Velasco-Forero, S., Deschaud, J.E., Goulette, F., Serna, A., Decenci\u00e8re, E., and Marcotegui, B. (2021, January 8\u201310). On power Jaccard losses for semantic segmentation. Proceedings of the VISAPP 2021: 16th International Conference on Computer Vision Theory and Applications, Vienna, Austria.","DOI":"10.5220\/0010304005610568"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chaton, T., Chaulet, N., Horache, S., and Landrieu, L. (2020, January 25\u201328). Torch-Points3D: A Modular Multi-Task Framework for Reproducible Deep Learning on 3D Point Clouds. Proceedings of the 2020 International Conference on 3D Vision (3DV), Fukuoka, Japan.","DOI":"10.1109\/3DV50981.2020.00029"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kirillov, A., He, K., Girshick, R., Rother, C., and Doll\u00e1r, P. (2019, January 15\u201320). Panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00963"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.isprsjprs.2014.03.015","article-title":"Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning","volume":"93","author":"Serna","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2014.03.023","article-title":"3D reconstruction methods for digital preservation of cultural heritage: A survey","volume":"50","author":"Gomes","year":"2014","journal-title":"Pattern Recognit. Lett."},{"key":"ref_38","unstructured":"Xu, Y., Zhu, X., Shi, J., Zhang, G., Bao, H., and Li, H. (November, January 27). Depth Completion From Sparse LiDAR Data With Depth-Normal Constraints. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s00371-016-1316-y","article-title":"A Survey on Algorithms of Hole Filling in 3D Surface Reconstruction","volume":"34","author":"Guo","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Roldao, L., de Charette, R., and Verroust-Blondet, A. (2021). 3D Semantic Scene Completion: A Survey. arXiv.","DOI":"10.1007\/s11263-021-01504-5"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Dai, A., Siddiqui, Y., Thies, J., Valentin, J., and Niessner, M. (2021, January 21\u201324). SPSG: Self-Supervised Photometric Scene Generation From RGB-D Scans. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00179"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1145\/142920.134011","article-title":"Surface Reconstruction from Unorganized Points","volume":"26","author":"Hoppe","year":"1992","journal-title":"SIGGRAPH Comput. Graph."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Dai, A., Diller, C., and Niessner, M. (2020, January 14\u201319). SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00093"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Curless, B., and Levoy, M. (1996, January 4\u20139). A Volumetric Method for Building Complex Models from Range Images. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237269"},{"key":"ref_45","unstructured":"Lorensen, W.E., and Cline, H.E. (, January July). Marching cubes: A high resolution 3D surface construction algorithm. Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, New York, NY, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4713\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:33:42Z","timestamp":1760168022000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4713"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,21]]},"references-count":45,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["rs13224713"],"URL":"https:\/\/doi.org\/10.3390\/rs13224713","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,21]]}}}