{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T08:31:37Z","timestamp":1770971497154,"version":"3.50.1"},"reference-count":62,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T00:00:00Z","timestamp":1684195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"project \u201cAI@TN\u201d funded by the Autonomous Province of Trento, Italy, the FWO Postdoc grant","award":["1251522N"],"award-info":[{"award-number":["1251522N"]}]},{"name":"Geomatics research group of the Department of Civil Engineering, TC Construction at the KU Leuven in Belgium","award":["1251522N"],"award-info":[{"award-number":["1251522N"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Deep learning approaches have sparked much interest in the AI community during the last decade, becoming state-of-the-art in domains such as pattern recognition, computer vision, and data analysis. However, these methods are highly demanding in terms of training data, which is often a major issue in the geospatial and remote sensing fields. One possible solution to this problem comes from the Neuro-Symbolic Integration field (NeSy), where multiple methods have been defined to incorporate background knowledge into the neural network\u2019s learning pipeline. One such method is KENN (Knowledge Enhanced Neural Networks), which injects logical knowledge into the neural network\u2019s structure through additional final layers. Empirically, KENN showed comparable or better results than other NeSy frameworks in various tasks while being more scalable. Therefore, we propose the usage of KENN for point cloud semantic segmentation tasks, where it has immense potential to resolve issues with small sample sizes and unbalanced classes. While other works enforce the knowledge constraints in post-processing, to the best of our knowledge, no previous methods have injected inject such knowledge into the learning pipeline through the use of a NeSy framework. The experiment results over different datasets demonstrate that the introduction of knowledge rules enhances the performance of the original network and achieves state-of-the-art levels of accuracy, even with subideal training data.<\/jats:p>","DOI":"10.3390\/rs15102590","type":"journal-article","created":{"date-parts":[[2023,5,17]],"date-time":"2023-05-17T01:58:06Z","timestamp":1684288686000},"page":"2590","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Knowledge Enhanced Neural Networks for Point Cloud Semantic Segmentation"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3400-9364","authenticated-orcid":false,"given":"Eleonora","family":"Grilli","sequence":"first","affiliation":[{"name":"3D Optical Metrology (3DOM) Unit, Bruno Kessler Foundation (FBK), Via Sommarive 18, 38121 Trento, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9441-0729","authenticated-orcid":false,"given":"Alessandro","family":"Daniele","sequence":"additional","affiliation":[{"name":"Data and Knowledge Management (DKM) Unit, Bruno Kessler Foundation (FBK), 38121 Trento, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8526-8847","authenticated-orcid":false,"given":"Maarten","family":"Bassier","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, TC Construction-Geomatics, Faculty of Engineering Technology, KU Leuven, 9000 Ghent, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6097-5342","authenticated-orcid":false,"given":"Fabio","family":"Remondino","sequence":"additional","affiliation":[{"name":"3D Optical Metrology (3DOM) Unit, Bruno Kessler Foundation (FBK), Via Sommarive 18, 38121 Trento, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4812-1031","authenticated-orcid":false,"given":"Luciano","family":"Serafini","sequence":"additional","affiliation":[{"name":"Data and Knowledge Management (DKM) Unit, Bruno Kessler Foundation (FBK), 38121 Trento, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Matrone, F., Grilli, E., Martini, M., Paolanti, M., Pierdicca, R., and Remondino, F. (2020). Comparing machine and deep learning methods for large 3D heritage semantic segmentation. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9090535"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"471","DOI":"10.5194\/isprs-archives-XLIII-B2-2021-471-2021","article-title":"Unsupervised object-based clustering in support of supervised point-based 3d point cloud classification","volume":"43","author":"Grilli","year":"2021","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100001","DOI":"10.1016\/j.ophoto.2021.100001","article-title":"The Hessigheim 3D (H3D) benchmark on semantic segmentation of high-resolution 3D point clouds and textured meshes from UAV LiDAR and Multi-View-Stereo","volume":"1","author":"Laupheimer","year":"2021","journal-title":"ISPRS Open J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MGRS.2019.2937630","article-title":"Linking points with labels in 3D: A review of point cloud semantic segmentation","volume":"8","author":"Xie","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"195","DOI":"10.5194\/gi-11-195-2022","article-title":"GeoAI: A review of artificial intelligence approaches for the interpretation of complex geomatics data","volume":"11","author":"Pierdicca","year":"2022","journal-title":"Geosci. Instrum. Methods Data Syst."},{"key":"ref_6","unstructured":"Matrone, F., Lingua, A., Pierdicca, R., Malinverni, E., Paolanti, M., Grilli, E., Remondino, F., Murtiyoso, A., and Landes, T. (2020, January 22\u201326). A benchmark for large-scale heritage point cloud semantic segmentation. Proceedings of the XXIV ISPRS Congress, Online."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ye, Z., Xu, Y., Huang, R., Tong, X., Li, X., Liu, X., Luan, K., Hoegner, L., and Stilla, U. (2020). Lasdu: A large-scale aerial lidar dataset for semantic labeling in dense urban areas. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9070450"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hu, Q., Yang, B., Khalid, S., Xiao, W., Trigoni, N., and Markham, A. (2021, January 20\u201325). Towards semantic segmentation of urban-scale 3D point clouds: A dataset, benchmarks and challenges. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00494"},{"key":"ref_9","unstructured":"Yadav, K., Ramrakhya, R., Ramakrishnan, S.K., Gervet, T., Turner, J., Gokaslan, A., Maestre, N., Chang, A.X., Batra, D., and Savva, M. (2022). Habitat-Matterport 3D Semantics Dataset. arXiv."},{"key":"ref_10","unstructured":"Achlioptas, P., Diamanti, O., Mitliagkas, I., and Guibas, L. (2018, January 10\u201315). Learning representations and generative models for 3d point clouds. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Y., Hu, V.T., Gavves, E., Mensink, T., Mettes, P., Yang, P., and Snoek, C.G. (2020, January 23\u201328). Pointmixup: Augmentation for point clouds. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part III 16.","DOI":"10.1007\/978-3-030-58580-8_20"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Griffiths, D., and Boehm, J. (2019). Weighted point cloud augmentation for neural network training data class-imbalance. arXiv.","DOI":"10.5194\/isprs-archives-XLII-2-W13-981-2019"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lin, H.I., and Nguyen, M.C. (2020). Boosting minority class prediction on imbalanced point cloud data. Appl. Sci., 10.","DOI":"10.3390\/app10030973"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3453","DOI":"10.3934\/era.2023175","article-title":"Classification method for imbalanced LiDAR point cloud based on stack autoencoder","volume":"31","author":"Ren","year":"2023","journal-title":"Electron. Res. Arch."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"91","DOI":"10.5194\/isprs-archives-XLVI-4-W4-2021-91-2021","article-title":"ALS point cloud classification using Pointnet++ and KPConv with prior knowledge","volume":"46","author":"Kada","year":"2021","journal-title":"ISPRS-Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_17","first-page":"183","article-title":"A hybrid semantic point cloud classification-segmentation framework based on geometric features and semantic rules","volume":"85","author":"Weinmann","year":"2017","journal-title":"PFG\u2013J. Photogramm. Remote. Sens. Geoinf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Daniele, A., and Serafini, L. (2019, January 26\u201330). Knowledge enhanced neural networks. Proceedings of the Pacific Rim International Conference on Artificial Intelligence, Yanuca Island, Fiji.","DOI":"10.1007\/978-3-030-29908-8_43"},{"key":"ref_19","unstructured":"Daniele, A., and Serafini, L. (2022). Knowledge Enhanced Neural Networks for relational domains. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.isprsjprs.2013.11.001","article-title":"Contextual classification of lidar data and building object detection in urban areas","volume":"87","author":"Niemeyer","year":"2014","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_21","unstructured":"Armeni, I., Sax, A., Zamir, A.R., and Savarese, S. (2017). Joint 2D-3D-Semantic Data for Indoor Scene Understanding. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Maturana, D., and Scherer, S. (October, January 28). Voxnet: A 3d convolutional neural network for real-time object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353481"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Choy, C.B., Xu, D., Gwak, J., Chen, K., and Savarese, S. (2016, January 11\u201314). 3d-r2n2: A unified approach for single and multi-view 3d object reconstruction. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7\u201313). Multi-view convolutional neural networks for 3d shape recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lawin, F.J., Danelljan, M., Tosteberg, P., Bhat, G., Khan, F.S., and Felsberg, M. (2017, January 22\u201324). Deep projective 3D semantic segmentation. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Ystad, Sweden.","DOI":"10.1007\/978-3-319-64689-3_8"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Armeni, I., Sener, O., Zamir, A.R., Jiang, H., Brilakis, I., Fischer, M., and Savarese, S. (2016, January 27\u201330). 3d semantic parsing of large-scale indoor spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.170"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Maarten, B., Vergauwen, M., and Poux, F. (2020). Point Cloud vs. Mesh Features for Building Interior Classification. Remote Sens., 12.","DOI":"10.3390\/rs12142224"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bello, S.A., Yu, S., Wang, C., Adam, J.M., and Li, J. (2020). Review: Deep learning on 3D point clouds. Remote Sens., 12.","DOI":"10.3390\/rs12111729"},{"key":"ref_29","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_30","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_31","unstructured":"Li, Y., Bu, R., Sun, M., Wu, W., Di, X., and Chen, B. (2018). Pointcnn: Convolution on x-transformed points. Adv. Neural Inf. Process. Syst., 31."},{"key":"ref_32","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., and Markham, A. (2020, January 13\u201319). Randla-net: Efficient semantic segmentation of large-scale point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01112"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Simonovsky, M., and Komodakis, N. (2017, January 21\u201326). Dynamic edge-conditioned filters in convolutional neural networks on graphs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.11"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1145\/3326362","article-title":"Dynamic graph cnn for learning on point clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_36","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., and Funtowicz, M. (2020, January 16\u201320). Transformers: State-of-the-art natural language processing. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Online.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhao, H., Jiang, L., Jia, J., Torr, P.H., and Koltun, V. (2021, January 11\u201317). Point transformer. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01595"},{"key":"ref_39","unstructured":"Lu, D., Xie, Q., Wei, M., Xu, L., and Li, J. (2022). Transformers in 3D Point Clouds: A Survey. arXiv."},{"key":"ref_40","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3d shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1145\/2980179.2980238","article-title":"A scalable active framework for region annotation in 3d shape collections","volume":"35","author":"Yi","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"\u00d6zdemir, E., Remondino, F., and Golkar, A. (2021). An efficient and general framework for aerial point cloud classification in urban scenarios. Remote Sens., 13.","DOI":"10.3390\/rs13101985"},{"key":"ref_43","unstructured":"Dietenbeck, T., Torkhani, F., Othmani, A., Attene, M., and Favreau, J.M. (2017). Advances in Knowledge Discovery and Management, Springer."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ponciano, J.J., Tr\u00e9meau, A., and Boochs, F. (2019). Automatic detection of objects in 3D point clouds based on exclusively semantic guided processes. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8100442"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Ponciano, J.J., Roetner, M., Reiterer, A., and Boochs, F. (2021). Object Semantic Segmentation in Point Clouds\u2014Comparison of a Deep Learning and a Knowledge-Based Method. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10040256"},{"key":"ref_46","unstructured":"Garcez, A.d., Gori, M., Lamb, L.C., Serafini, L., Spranger, M., and Tran, S.N. (2019). Neural-symbolic computing: An effective methodology for principled integration of machine learning and reasoning. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1613\/jair.5714","article-title":"Learning explanatory rules from noisy data","volume":"61","author":"Evans","year":"2018","journal-title":"J. Artif. Intell. Res."},{"key":"ref_48","unstructured":"Campero, A., Pareja, A., Klinger, T., Tenenbaum, J., and Riedel, S. (2018). Logical rule induction and theory learning using neural theorem proving. arXiv."},{"key":"ref_49","unstructured":"Manhaeve, R., Dumancic, S., Kimmig, A., Demeester, T., and De Raedt, L. (2018, January 3\u20138). Deepproblog: Neural probabilistic logic programming. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_50","unstructured":"Serafini, L., and d\u2019Avila Garcez, A.S. (December, January 29). Learning and reasoning with logic tensor networks. Proceedings of the Conference of the Italian Association for Artificial Intelligence, Genova, Italy."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"103649","DOI":"10.1016\/j.artint.2021.103649","article-title":"Logic tensor networks","volume":"303","author":"Badreddine","year":"2022","journal-title":"Artif. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.artint.2015.08.011","article-title":"Semantic-based regularization for learning and inference","volume":"244","author":"Diligenti","year":"2017","journal-title":"Artif. Intell."},{"key":"ref_53","unstructured":"Xu, J., Zhang, Z., Friedman, T., Liang, Y., and Broeck, G. (2018, January 10\u201315). A semantic loss function for deep learning with symbolic knowledge. Proceedings of the International Conference on Machine Learning. PMLR, Stockholm, Sweden."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"103602","DOI":"10.1016\/j.artint.2021.103602","article-title":"Analyzing differentiable fuzzy logic operators","volume":"302","author":"Acar","year":"2022","journal-title":"Artif. Intell."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0004-3702(94)90105-8","article-title":"Knowledge-based Artificial Neural Networks","volume":"70","author":"Towell","year":"1994","journal-title":"Artif. Intell."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1023\/A:1008328630915","article-title":"The connectionist inductive learning and logic programming system","volume":"11","author":"Garcez","year":"1999","journal-title":"Appl. Intell."},{"key":"ref_57","unstructured":"Marra, G., Diligenti, M., Giannini, F., Gori, M., and Maggini, M. (2020). Relational Neural Machines. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Daniele, A., van Krieken, E., Serafini, L., and van Harmelen, F. (2022). Refining neural network predictions using background knowledge. arXiv.","DOI":"10.1007\/s10994-023-06310-3"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.isprsjprs.2015.01.016","article-title":"Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers","volume":"105","author":"Weinmann","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"103338","DOI":"10.1016\/j.autcon.2020.103338","article-title":"Unsupervised reconstruction of Building Information Modeling wall objects from point cloud data","volume":"120","author":"Bassier","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_61","unstructured":"ISPRS (2023, February 14). The International Society for Photogrammetry and Remote Sensing. Available online: https:\/\/www.isprs.org\/education\/benchmarks\/UrbanSemLab\/results\/vaihingen-3d-semantic-labeling.aspx."},{"key":"ref_62","unstructured":"Haala, N., and Cavegn, S. (2023, February 14). Benchmark on High Density Aerial Image Matching. Available online: https:\/\/ifpwww.ifp.uni-stuttgart.de\/benchmark\/hessigheim\/results.aspx."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2590\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:35:56Z","timestamp":1760124956000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2590"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,16]]},"references-count":62,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["rs15102590"],"URL":"https:\/\/doi.org\/10.3390\/rs15102590","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,16]]}}}