{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T00:25:37Z","timestamp":1772497537259,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T00:00:00Z","timestamp":1681948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Three-dimensional point cloud registration, which aims to find the transformation that best aligns two point clouds, is a widely studied problem in computer vision with a wide spectrum of applications, such as underground mining. Many learning-based approaches have been developed and have demonstrated their effectiveness for point cloud registration. Particularly, attention-based models have achieved outstanding performance due to the extra contextual information captured by attention mechanisms. To avoid the high computation cost brought by attention mechanisms, an encoder\u2013decoder framework is often employed to hierarchically extract the features where the attention module is only applied in the middle. This leads to the compromised effectiveness of the attention module. To tackle this issue, we propose a novel model with the attention layers embedded in both the encoder and decoder stages. In our model, the self-attentional layers are applied in the encoder to consider the relationship between points inside each point cloud, while the decoder utilizes cross-attentional layers to enrich features with contextual information. Extensive experiments conducted on public datasets prove that our model is able to achieve quality results on a registration task.<\/jats:p>","DOI":"10.3390\/s23084123","type":"journal-article","created":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T03:25:11Z","timestamp":1681961111000},"page":"4123","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Learning Representative Features by Deep Attention Network for 3D Point Cloud Registration"],"prefix":"10.3390","volume":"23","author":[{"given":"Xiaokai","family":"Xia","sequence":"first","affiliation":[{"name":"Beijing Institute of System Engineering, Beijing 100101, China"},{"name":"Artificial Intelligence Institute of China Electronics Technology Group Corporation, Beijing 100041, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiqiang","family":"Fan","sequence":"additional","affiliation":[{"name":"Artificial Intelligence Institute of China Electronics Technology Group Corporation, Beijing 100041, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gang","family":"Xiao","sequence":"additional","affiliation":[{"name":"Beijing Institute of System Engineering, Beijing 100101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangyue","family":"Chen","sequence":"additional","affiliation":[{"name":"Artificial Intelligence Institute of China Electronics Technology Group Corporation, Beijing 100041, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Software Development Environment, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiheng","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.neucom.2023.01.094","article-title":"Class-Aware Tiny Object Recognition over Large-Scale 3D Point Clouds","volume":"529","author":"Li","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lin, C.H., Kong, C., and Lucey, S. (2018, January 2\u20137). Learning efficient point cloud generation for dense 3D object reconstruction. Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12278"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1109\/TCYB.2015.2430526","article-title":"Robotic online path planning on point cloud","volume":"46","author":"Liu","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/S0890-6955(01)00120-1","article-title":"A new segmentation method for point cloud data","volume":"42","author":"Woo","year":"2002","journal-title":"Int. J. Mach. Tools Manuf."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Huang, X., Zhang, J., Wu, Q., Fan, L., and Yuan, C. (December, January 30). A coarse-to-fine algorithm for registration in 3D street-view cross-source point clouds. Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, QLD, Australia.","DOI":"10.1109\/DICTA.2016.7796986"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bai, X., Luo, Z., Zhou, L., Fu, H., Quan, L., and Tai, C.L. (2020, January 13\u201319). D3feat: Joint learning of dense detection and description of 3D local features. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00639"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Choy, C., Dong, W., and Koltun, V. (2020, January 13\u201319). Deep global registration. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00259"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gojcic, Z., Zhou, C., Wegner, J.D., Guibas, L.J., and Birdal, T. (2020, January 13\u201319). Learning multiview 3D point cloud registration. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00183"},{"key":"ref_9","unstructured":"Choy, C., Park, J., and Koltun, V. (November, January 27). Fully convolutional geometric features. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huang, S., Gojcic, Z., Usvyatsov, M., Wieser, A., and Schindler, K. (2021, January 20\u201325). Predator: Registration of 3D point clouds with low overlap. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00425"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12\u201317). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_12","unstructured":"Tombari, F., Salti, S., and Di Stefano, L. (2010). Computer Vision\u2014ECCV 2010, Proceedings of the 11th European Conference on Computer Vision, Heraklion, Crete, Greece, 5\u201311 September 2010, Springe. Proceedings, Part III 11."},{"key":"ref_13","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3D classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_14","first-page":"1","article-title":"Pointnet++: Deep hierarchical feature learning on point sets in a metric space","volume":"30","author":"Qi","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zeng, A., Song, S., Nie\u00dfner, M., Fisher, M., Xiao, J., and Funkhouser, T. (2017, January 21\u201326). 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.29"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sarlin, P.E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13\u201319). Superglue: Learning feature matching with graph neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00499"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fischer, K., Simon, M., Olsner, F., Milz, S., Gross, H.M., and Mader, P. (2021, January 20\u201325). Stickypillars: Robust and efficient feature matching on point clouds using graph neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00038"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8221","DOI":"10.1109\/LRA.2021.3097275","article-title":"Keypoint matching for point cloud registration using multiplex dynamic graph attention networks","volume":"6","author":"Shi","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qin, Z., Yu, H., Wang, C., Guo, Y., Peng, Y., and Xu, K. (2022, January 18\u201324). Geometric transformer for fast and robust point cloud registration. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01086"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yew, Z.J., and Lee, G.H. (2022, January 18\u201324). Regtr: End-to-end point cloud correspondences with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00656"},{"key":"ref_21","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF international Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_22","first-page":"1","article-title":"Dynamic graph cnn for learning on point clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Choy, C., Gwak, J., and Savarese, S. (2019, January 16\u201317). 4D spatio-temporal convnets: Minkowski convolutional neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00319"},{"key":"ref_24","unstructured":"Wang, Y., and Solomon, J.M. (November, January 27). Deep closest point: Learning representations for point cloud registration. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fu, K., Liu, S., Luo, X., and Wang, M. (2021, January 20\u201325). Robust point cloud registration framework based on deep graph matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00878"},{"key":"ref_26","unstructured":"Li, J., and Lee, G.H. (November, January 27). Usip: Unsupervised stable interest point detection from 3D point clouds. Proceedings of the IEEE\/CVF international Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sun, Y., Cheng, C., Zhang, Y., Zhang, C., Zheng, L., Wang, Z., and Wei, Y. (2020, January 13\u201319). Circle loss: A unified perspective of pair similarity optimization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00643"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1117\/12.57955","article-title":"Method for registration of 3-D shapes","volume":"1611","author":"Besl","year":"1992","journal-title":"Proc. Sens. Fusion IV Control Paradig. Data Struct."},{"key":"ref_29","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2016). Computer Vision\u2014ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer. Proceedings, Part II 14."},{"key":"ref_30","unstructured":"Yuan, W., Eckart, B., Kim, K., Jampani, V., Fox, D., and Kautz, J. (2020). Computer Vision\u2014ECCV 2020, Proceedings of the 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer. Proceedings, Part V 16."},{"key":"ref_31","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2018). Open3D: A modern library for 3D data processing. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1007\/s00371-021-02391-0","article-title":"A novel partial point cloud registration method based on graph attention network","volume":"39","author":"Song","year":"2023","journal-title":"Vis. Comput."},{"key":"ref_33","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3D shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/8\/4123\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:19:31Z","timestamp":1760123971000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/8\/4123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,20]]},"references-count":33,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23084123"],"URL":"https:\/\/doi.org\/10.3390\/s23084123","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,20]]}}}