{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T05:21:23Z","timestamp":1775798483509,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2023,6,10]],"date-time":"2023-06-10T00:00:00Z","timestamp":1686355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012542","name":"Sichuan Province Science and Technology Support Program","doi-asserted-by":"publisher","award":["2021YJ0080"],"award-info":[{"award-number":["2021YJ0080"]}],"id":[{"id":"10.13039\/100012542","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012542","name":"Sichuan Province Science and Technology Support Program","doi-asserted-by":"publisher","award":["61960206010"],"award-info":[{"award-number":["61960206010"]}],"id":[{"id":"10.13039\/100012542","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Foundation International Cooperation Project","award":["2021YJ0080"],"award-info":[{"award-number":["2021YJ0080"]}]},{"name":"Natural Foundation International Cooperation Project","award":["61960206010"],"award-info":[{"award-number":["61960206010"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Point cloud registration is a critical problem in 3D vision tasks, and numerous learning-based point cloud registration methods have been proposed in recent years. However, a common issue with most of these methods is that their feature descriptors are rotation-sensitive, which makes them difficult to converge at large rotations. In this paper, we propose a new learning-based pipeline to address this issue, which can also handle partially overlapping 3D point clouds. Specifically, we employ rotation-invariant local features to guide the point matching task, and utilize a cross-attention mechanism to update the feature information between the two point clouds to predict the key points in the overlapping regions. Subsequently, we construct a feature matrix based on the features of the key points to solve the soft correspondences. Finally, we construct a non-learning correspondence constraint module that exploits the spatial geometric invariance of the point clouds after rotation and translation, as well as the compatibility between point pairs, to reject the wrong correspondences. To validate our approach, we conduct extensive experiments on ModelNet40. Our approach achieves better performance compared to other methods, especially in the presence of large rotations.<\/jats:p>","DOI":"10.3390\/rs15123054","type":"journal-article","created":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T01:59:07Z","timestamp":1686535147000},"page":"3054","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Partial-to-Partial Point Cloud Registration by Rotation Invariant Features and Spatial Geometric Consistency"],"prefix":"10.3390","volume":"15","author":[{"given":"Yu","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Physical Science and Technology, Southwest Jiaotong University, Chengdu 610036, China"}]},{"given":"Wenhao","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Physical Science and Technology, Southwest Jiaotong University, Chengdu 610036, China"}]},{"given":"Jinlong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Physical Science and Technology, Southwest Jiaotong University, Chengdu 610036, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., and Davison, A. (2011, January 16\u201319). Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera. Proceedings of the 24th Annual ACM Symposium on Utilizer Interface Software and Technology, Santa Barbara, CA, USA.","DOI":"10.1145\/2047196.2047270"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Eldefrawy, M., King, S.A., and Starek, M. (2022). Partial Scene Reconstruction for Close Range Photogrammetry Using Deep Learning Pipeline for Region Masking. Remote Sens., 14.","DOI":"10.3390\/rs14133199"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.vrih.2020.05.002","article-title":"Deep learning based point cloud registration: An overview","volume":"2","author":"Zhang","year":"2020","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2000","DOI":"10.1109\/LRA.2022.3142739","article-title":"Direct lidar odometry: Fast localization with dense point clouds","volume":"7","author":"Chen","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"22312","DOI":"10.1109\/TITS.2022.3153133","article-title":"Global-PBNet: A novel point cloud registration for autonomous driving","volume":"23","author":"Zheng","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","first-page":"586","article-title":"Method for registration of 3-D shapes","volume":"Volume 1611","author":"Besl","year":"1992","journal-title":"Proceedings of the Sensor Fusion IV: Control Paradigms and Data Structures"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2241","DOI":"10.1109\/TPAMI.2015.2513405","article-title":"Go-ICP: A globally optimal solution to 3D ICP point-set registration","volume":"38","author":"Yang","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2016, January 8\u201316). Fast global registration. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_47"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Aoki, Y., Goforth, H., Srivatsan, R.A., and Lucey, S. (2019, January 15\u201320). Pointnetlk: Robust & efficient point cloud registration using pointnet. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00733"},{"key":"ref_10","unstructured":"Sarode, V., Li, X., Goforth, H., Aoki, Y., Srivatsan, R.A., Lucey, S., and Choset, H. (2019). Pcrnet: Point cloud registration network using pointnet encoding. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xu, H., Liu, S., Wang, G., Liu, G., and Zeng, B. (2021, January 11\u201317). Omnet: Learning overlapping mask for partial-to-partial point cloud registration. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00312"},{"key":"ref_12","unstructured":"Wang, Y., and Solomon, J.M. (November, January 27). Deep closest point: Learning representations for point cloud registration. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_13","unstructured":"Wang, Y., and Solomon, J.M. (2019). Prnet: Self-supervised learning for partial-to-partial registration. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yew, Z.J., and Lee, G.H. (2020, January 13\u201319). Rpm-net: Robust point matching using learned features. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01184"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, J., Zhang, C., Xu, Z., Zhou, H., and Zhang, C. (2020, January 23\u201328). Iterative distance-aware similarity matrix convolution with mutual-supervised point elimination for efficient point cloud registration. Proceedings of the 16th European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58586-0_23"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Drost, B., Ulrich, M., Navab, N., and Ilic, S. (2010, January 13\u201318). Model globally, match locally: Efficient and robust 3D object recognition. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540108"},{"key":"ref_17","unstructured":"Low, K.L. (2004). Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration, University of North Carolina."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/cgf.12178","article-title":"Sparse iterative closest point","volume":"32","author":"Bouaziz","year":"2013","journal-title":"Computer Graphics Forum"},{"key":"ref_19","unstructured":"Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient variants of the ICP algorithm. Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modelling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12\u201317). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Tombari, F., Salti, S., and Di Stefano, L. (2010, January 5\u201311). Unique signatures of histograms for local surface description. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15558-1_26"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1360612.1360684","article-title":"4-points congruent sets for robust pairwise surface registration","volume":"27","author":"Aiger","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_25","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_26","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the IJCAI\u201981: 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_27","first-page":"1","article-title":"Dynamic graph cnn for learning on point clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph. (Tog)"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1214\/aoms\/1177703591","article-title":"A relationship between arbitrary positive matrices and doubly stochastic matrices","volume":"35","author":"Sinkhorn","year":"1964","journal-title":"Ann. Math. Stat."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Deng, H., Birdal, T., and Ilic, S. (2018, January 18\u201323). Ppfnet: Global context aware local features for robust 3d point matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00028"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Deng, H., Birdal, T., and Ilic, S. (2018, January 8\u201314). Ppf-foldnet: Unsupervised learning of rotation invariant 3d local descriptors. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01228-1_37"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, Y., Feng, C., Shen, Y., and Tian, D. (2018, January 18\u201323). Foldingnet: Point cloud auto-encoder via deep grid deformation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00029"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ginzburg, D., and Raviv, D. (2022, January 16\u201319). Deep Weighted Consensus Dense Correspondence Confidence Maps for 3d Shape Registration. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.","DOI":"10.1109\/ICIP46576.2022.9897800"},{"key":"ref_33","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Advances in Neural Information Processing Systems, Morgan Kaufmann Publishers Inc."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huang, S., Gojcic, Z., Usvyatsov, M., Wieser, A., and Schindler, K. (2021, January 20\u201325). Predator: Registration of 3d point clouds with low overlap. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00425"},{"key":"ref_35","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3d shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_36","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2018). Open3D: A modern library for 3D data processing. arXiv."},{"key":"ref_37","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Curless, B., and Levoy, M. (1996, January 4\u20139). A volumetric method for building complex models from range images. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237269"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_40","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). Advances in neural Information Processing Systems, Morgan Kaufmann Publishers Inc."},{"key":"ref_41","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_42","unstructured":"Choy, C., Park, J., and Koltun, V. (November, January 27). Fully convolutional geometric features. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/12\/3054\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:52:28Z","timestamp":1760125948000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/12\/3054"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,10]]},"references-count":42,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["rs15123054"],"URL":"https:\/\/doi.org\/10.3390\/rs15123054","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,10]]}}}