{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T20:12:24Z","timestamp":1770063144168,"version":"3.49.0"},"reference-count":55,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:00:00Z","timestamp":1671667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771480"],"award-info":[{"award-number":["41771480"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771480"],"award-info":[{"award-number":["41771480"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Scholarship Council and International Exchange Program for Graduate Students, Tongji University","award":["41771480"],"award-info":[{"award-number":["41771480"]}]},{"name":"China Scholarship Council and International Exchange Program for Graduate Students, Tongji University","award":["41771480"],"award-info":[{"award-number":["41771480"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771480"],"award-info":[{"award-number":["41771480"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771480"],"award-info":[{"award-number":["41771480"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Continuous implicit representations can flexibly describe complex 3D geometry and offer excellent potential for 3D point cloud analysis. However, it remains challenging for existing point-based deep learning architectures to leverage the implicit representations due to the discrepancy in data structures between implicit fields and point clouds. In this work, we propose a new point cloud representation by integrating the 3D Cartesian coordinates with the intrinsic geometric information encapsulated in its implicit field. Specifically, we parameterize the continuous unsigned distance field around each point into a low-dimensional feature vector that captures the local geometry. Then we concatenate the 3D Cartesian coordinates of each point with its encoded implicit feature vector as the network input. The proposed method can be plugged into an existing network architecture as a module without trainable weights. We also introduce a novel local canonicalization approach to ensure the transformation-invariance of encoded implicit features. With its local mechanism, our implicit feature encoding module can be applied to not only point clouds of single objects but also those of complex real-world scenes. We have validated the effectiveness of our approach using five well-known point-based deep networks (i.e., PointNet, SuperPoint Graph, RandLA-Net, CurveNet, and Point Structuring Net) on object-level classification and scene-level semantic segmentation tasks. Extensive experiments on both synthetic and real-world datasets have demonstrated the effectiveness of the proposed point representation.<\/jats:p>","DOI":"10.3390\/rs15010061","type":"journal-article","created":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T03:26:25Z","timestamp":1671765985000},"page":"61","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Enriching Point Clouds with Implicit Representations for 3D Classification and Segmentation"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9047-6691","authenticated-orcid":false,"given":"Zexin","family":"Yang","sequence":"first","affiliation":[{"name":"College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China"},{"name":"3D Geoinformation Research Group, Delft University of Technology, 2628 BL Delft, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1056-9159","authenticated-orcid":false,"given":"Qin","family":"Ye","sequence":"additional","affiliation":[{"name":"College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1393-7279","authenticated-orcid":false,"given":"Jantien","family":"Stoter","sequence":"additional","affiliation":[{"name":"3D Geoinformation Research Group, Delft University of Technology, 2628 BL Delft, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5629-9975","authenticated-orcid":false,"given":"Liangliang","family":"Nan","sequence":"additional","affiliation":[{"name":"3D Geoinformation Research Group, Delft University of Technology, 2628 BL Delft, The Netherlands"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Huang, J., Stoter, J., Peters, R., and Nan, L. (2022). City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds. Remote Sens., 14.","DOI":"10.3390\/rs14092254"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"165","DOI":"10.14358\/PERS.21-00032R2","article-title":"Automated 3D reconstruction of LoD2 and LoD1 models for all 10 million buildings of the Netherlands","volume":"88","author":"Peters","year":"2022","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"111280","DOI":"10.1016\/j.rse.2019.111280","article-title":"Airborne and spaceborne remote sensing for archaeological and cultural heritage applications: A review of the century (1907\u20132017)","volume":"232","author":"Luo","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3412","DOI":"10.1109\/TNNLS.2020.3015992","article-title":"Deep learning for lidar point clouds in autonomous driving: A review","volume":"32","author":"Li","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s40903-015-0032-7","article-title":"An overview to visual odometry and visual SLAM: Applications to mobile robotics","volume":"1","author":"Yousif","year":"2015","journal-title":"Intell. Ind. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4338","DOI":"10.1109\/TPAMI.2020.3005434","article-title":"Deep learning for 3d point clouds: A survey","volume":"43","author":"Guo","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_8","first-page":"5099","article-title":"Pointnet++: Deep hierarchical feature learning on point sets in a metric space","volume":"30","author":"Qi","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhao, H., Jiang, L., Fu, C.W., and Jia, J. (2019, January 15\u201320). Pointweb: Enhancing local neighborhood features for point cloud processing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00571"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jiang, M., Wu, Y., Zhao, T., Zhao, Z., and Lu, C. (2018). Pointsift: A sift-like network module for 3d point cloud semantic segmentation. arXiv.","DOI":"10.1109\/IGARSS.2019.8900102"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Engelmann, F., Kontogianni, T., Schult, J., and Leibe, B. (2018, January 8\u201314). Know what your neighbors do: 3D semantic segmentation of point clouds. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11015-4_29"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hua, B.S., Tran, M.K., and Yeung, S.K. (2018, January 18\u201322). Pointwise convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00109"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, S., Suo, S., Ma, W.C., Pokrovsky, A., and Urtasun, R. (2018, January 18\u201323). Deep parametric continuous convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00274"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Engelmann, F., Kontogianni, T., and Leibe, B. (2019). Dilated point convolutions: On the receptive field of point convolutions. arXiv.","DOI":"10.1109\/ICRA40945.2020.9197503"},{"key":"ref_15","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, J., Zhang, Q., Ni, B., Li, L., Liu, J., Zhou, M., and Tian, Q. (2019, January 15\u201320). Modeling point clouds with self-attention and gumbel subset sampling. Proceedings of the IEEE\/CVF Conference On Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00344"},{"key":"ref_17","unstructured":"Chen, L.Z., Li, X.Y., Fan, D.P., Wang, K., Lu, S.P., and Cheng, M.M. (2019). LSANet: Feature learning on point sets by local spatial aware layer. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhao, C., Zhou, W., Lu, L., and Zhao, Q. (2019, January 22\u201325). Pooling scores of neighboring points for improved 3D point cloud segmentation. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803048"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Landrieu, L., and Simonovsky, M. (2018, January 18\u201323). Large-scale point cloud semantic segmentation with superpoint graphs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00479"},{"key":"ref_20","first-page":"8338","article-title":"Learning semantic segmentation of large-scale point clouds with random sampling","volume":"44","author":"Hu","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xiang, T., Zhang, C., Song, Y., Yu, J., and Cai, W. (2021, January 11\u201317). Walk in the cloud: Learning curves for point clouds shape analysis. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00095"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6835","DOI":"10.1109\/TCSVT.2022.3171968","article-title":"PSNet: Fast Data Structuring for Hierarchical Deep Learning on Point Cloud","volume":"32","author":"Li","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3d shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_24","unstructured":"Armeni, I., Sax, S., Zamir, A.R., and Savarese, S. (2017). Joint 2d-3d-semantic data for indoor scene understanding. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1007\/s11263-021-01554-9","article-title":"Sensaturban: Learning semantics from urban-scale photogrammetric point clouds","volume":"130","author":"Hu","year":"2022","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","unstructured":"Michalkiewicz, M., Pontes, J.K., Jack, D., Baktashmotlagh, M., and Eriksson, A. (November, January 27). Implicit surface representations as layers in neural networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ran, H., Liu, J., and Wang, C. (2022, January 19\u201320). Surface Representation for Point Clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01837"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tretschk, E., Tewari, A., Golyanik, V., Zollh\u00f6fer, M., Stoll, C., and Theobalt, C. (2020, January 23\u201328). Patchnets: Patch-based generalizable deep implicit 3d shape representations. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58517-4_18"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Michalkiewicz, M., Pontes, J.K., Jack, D., Baktashmotlagh, M., and Eriksson, A. (2019). Deep level sets: Implicit surface representations for 3d shape inference. arXiv.","DOI":"10.1109\/ICCV.2019.00484"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15\u201320). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Peng, S., Niemeyer, M., Mescheder, L., Pollefeys, M., and Geiger, A. (2020, January 23\u201328). Convolutional occupancy networks. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58580-8_31"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jiang, C., Sud, A., Makadia, A., Huang, J., Nie\u00dfner, M., and Funkhouser, T. (2020, January 13\u201319). Local implicit grid representations for 3d scenes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00604"},{"key":"ref_33","unstructured":"Juhl, K.A., Morales, X., Backer, O.D., Camara, O., and Paulsen, R.R. (October, January 27). Implicit neural distance representation for unsupervised and supervised classification of complex anatomies. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Fujiwara, K., and Hashimoto, T. (2020, January 13\u201319). Neural implicit embedding for point cloud analysis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01175"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lawin, F.J., Danelljan, M., Tosteberg, P., Bhat, G., Khan, F.S., and Felsberg, M. (2017, January 22\u201324). Deep projective 3D semantic segmentation. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Ystad, Sweden.","DOI":"10.1007\/978-3-319-64689-3_8"},{"key":"ref_36","first-page":"1","article-title":"Unstructured point cloud semantic labeling using deep segmentation networks","volume":"3","author":"Boulch","year":"2017","journal-title":"3dor@ Eurograph."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7\u201313). Multi-view convolutional neural networks for 3d shape recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.cag.2017.11.010","article-title":"SnapNet: 3D point cloud semantic labeling with 2D deep segmentation networks","volume":"71","author":"Boulch","year":"2018","journal-title":"Comput. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Maturana, D., and Scherer, S. (October, January 28). Voxnet: A 3d convolutional neural network for real-time object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353481"},{"key":"ref_40","unstructured":"Meng, H.Y., Gao, L., Lai, Y.K., and Manocha, D. (November, January 27). Vv-net: Voxel vae net with group convolutions for point cloud segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_41","first-page":"1","article-title":"Dynamic graph cnn for learning on point clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, F., Fujiwara, K., Okura, F., and Matsushita, Y. (2021, January 11\u201317). A closer look at rotation-invariant deep point cloud analysis. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01591"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"4503","DOI":"10.1109\/TVCG.2021.3092570","article-title":"A rotation-invariant framework for deep point cloud analysis","volume":"28","author":"Li","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Deng, H., Birdal, T., and Ilic, S. (2018, January 8\u201314). Ppf-foldnet: Unsupervised learning of rotation invariant 3d local descriptors. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01228-1_37"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Hua, B.S., Rosen, D.W., and Yeung, S.K. (2019, January 16\u201319). Rotation invariant convolutions for 3d point clouds deep learning. Proceedings of the 2019 International Conference on 3d Vision (3DV), Qu\u00e9bec City, QC, Canada.","DOI":"10.1109\/3DV.2019.00031"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Chen, C., Li, G., Xu, R., Chen, T., Wang, M., and Lin, L. (2019, January 15\u201320). Clusternet: Deep hierarchical cluster network with rigorously rotation-invariant representation for point cloud analysis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00513"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Yu, R., Wei, X., Tombari, F., and Sun, J. (2020, January 23\u201328). Deep positional and relational feature learning for rotation-invariant point cloud analysis. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58607-2_13"},{"key":"ref_48","first-page":"8174","article-title":"Rotation-invariant local-to-global representation learning for 3d point cloud","volume":"33","author":"Kim","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Xiao, Z., Lin, H., Li, R., Geng, L., Chao, H., and Ding, S. (2020, January 6\u201310). Endowing deep 3d models with rotation invariance based on principal component analysis. Proceedings of the 2020 IEEE International Conference on Multimedia and Expo (ICME), London, UK.","DOI":"10.1109\/ICME46284.2020.9102947"},{"key":"ref_50","unstructured":"Shlens, J. (2014). A tutorial on principal component analysis. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3d is here: Point cloud library (pcl). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/99.660313","article-title":"OpenMP: An industry standard API for shared-memory programming","volume":"5","author":"Dagum","year":"1998","journal-title":"IEEE Comput. Sci. Eng."},{"key":"ref_54","unstructured":"Yan, X. (2022, February 08). Pointnet\/Pointnet++ Pytorch. Available online: https:\/\/github.com\/yanx27\/Pointnet_Pointnet2_pytorch."},{"key":"ref_55","first-page":"820","article-title":"Pointcnn: Convolution on x-transformed points","volume":"31","author":"Li","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/1\/61\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:48:39Z","timestamp":1760147319000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/1\/61"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,22]]},"references-count":55,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["rs15010061"],"URL":"https:\/\/doi.org\/10.3390\/rs15010061","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,22]]}}}