{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T20:17:47Z","timestamp":1778617067251,"version":"3.51.4"},"reference-count":47,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T00:00:00Z","timestamp":1694649600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["U190620140"],"award-info":[{"award-number":["U190620140"]}]},{"name":"National Natural Science Foundation of China","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}]},{"name":"National Natural Science Foundation of China","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}]},{"name":"National Natural Science Foundation of China","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}]},{"name":"Natural Science Foundation of Heilongjiang Province","award":["U190620140"],"award-info":[{"award-number":["U190620140"]}]},{"name":"Natural Science Foundation of Heilongjiang Province","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}]},{"name":"Natural Science Foundation of Heilongjiang Province","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}]},{"name":"Natural Science Foundation of Heilongjiang Province","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province under grant","award":["U190620140"],"award-info":[{"award-number":["U190620140"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province under grant","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province under grant","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province under grant","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recognizing targets through side-scan sonar (SSS) data by deep learning-based techniques has been particularly challenging. The primary challenge stems from the difficulty and time consumption associated with underwater acoustic data acquisition, which demands systematic explorations to obtain sufficient training samples for accurate deep learning-based models. Moreover, if the sample size of the available data is small, the design of effective target recognition models becomes complex. These challenges have posed significant obstacles to developing accurate SSS-based target recognition methods via deep learning models. However, utilizing multi-modal datasets to enhance the recognition performance of sonar images through knowledge transfer in deep networks appears promising. Owing to the unique statistical properties of various modal images, transitioning between different modalities can significantly increase the complexity of network training. This issue remains unresolved, directly impacting the target transfer recognition performance. To enhance the precision of categorizing underwater sonar images when faced with a limited number of mode types and data samples, this study introduces a crossed point-to-point second-order self-attention (PPCSSA) method based on double-mode sample transfer recognition. In the PPCSSA method, first-order importance features are derived by extracting key horizontal and longitudinal point-to-point features. Based on these features, the self-supervised attention strategy effectively removes redundant features, securing the second-order significant features of SSS images. This strategy introduces a potent low-mode-type small-sample learning method for transfer learning. Classification experiment results indicate that the proposed method excels in extracting key features with minimal training complexity. Moreover, experimental outcomes underscore that the proposed technique enhances recognition stability and accuracy, achieving a remarkable overall accuracy rate of 99.28%. Finally, the proposed method maintains high recognition accuracy even in noisy environments.<\/jats:p>","DOI":"10.3390\/rs15184517","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T04:06:13Z","timestamp":1694750773000},"page":"4517","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An Underwater Side-Scan Sonar Transfer Recognition Method Based on Crossed Point-to-Point Second-Order Self-Attention Mechanism"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4184-7059","authenticated-orcid":false,"given":"Jian","family":"Wang","sequence":"first","affiliation":[{"name":"National Key Laboratory of Underwater Acoustic Technology, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haisen","family":"Li","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Underwater Acoustic Technology, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Dong","sequence":"additional","affiliation":[{"name":"South China Sea Marine Survey Center, Ministry of Natural Resources, Guangzhou 510300, China"},{"name":"Key Laboratory of Marine Environmental Survey Technology and Application, Ministry of Natural Resources, Guangzhou 510300, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute for Advanced Study, University of Electronic Science and Technology of China, UESTC, Shenzhen 518000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bing","family":"Zheng","sequence":"additional","affiliation":[{"name":"South China Sea Marine Survey Center, Ministry of Natural Resources, Guangzhou 510300, China"},{"name":"Key Laboratory of Marine Environmental Survey Technology and Application, Ministry of Natural Resources, Guangzhou 510300, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianyao","family":"Xing","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Underwater Acoustic Technology, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Xu, G., Shi, Y., Sun, X., and Shen, W. (2019). Internet of things in marine environment monitoring: A review. Sensors, 19.","DOI":"10.3390\/s19071711"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"125522","DOI":"10.1109\/ACCESS.2019.2939005","article-title":"Accurate underwater ATR in forward-looking sonar imagery using deep convolutional neural networks","volume":"7","author":"Jin","year":"2019","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103128","DOI":"10.1016\/j.apor.2022.103128","article-title":"Submarine pipeline tracking technology based on AUVs with forward looking sonar","volume":"122","author":"Zhang","year":"2022","journal-title":"Appl. Ocean. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TAES.1986.310772","article-title":"Automatic target recognition: State of the art survey","volume":"AES-22","author":"Bhanu","year":"1986","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1016\/j.sigpro.2006.08.001","article-title":"Speckle noise reduction in SAS imagery","volume":"87","author":"Chaillan","year":"2007","journal-title":"Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kazimierski, W., and Zaniewicz, G. (2021). Determination of process noise for underwater target tracking with forward looking sonar. Remote Sens., 13.","DOI":"10.3390\/rs13051014"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pinto, M.A. (2018, January 22\u201325). Split-beam range-gated Doppler velocity sonar for operations at high altitude above the seabed. Proceedings of the OCEANS 2018 MTS\/IEEE Charleston, Charleston, SC, USA.","DOI":"10.1109\/OCEANS.2018.8604599"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1109\/JOE.2021.3130662","article-title":"Interferometric Doppler Velocity Sonar for Low Bias Long Range Estimation of Speed Over Seabed","volume":"47","author":"Pinto","year":"2022","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/LGRS.2020.2993652","article-title":"MiNet: Efficient deep learning automatic target recognition for small autonomous vehicles","volume":"18","author":"Topple","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/LGRS.2018.2882551","article-title":"Squeeze and excitation rank faster R-CNN for ship detection in SAR images","volume":"16","author":"Lin","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, T., Zhang, X., Shi, J., and Wei, S. (2019, January 13\u201315). High-speed ship detection in SAR images by improved yolov3. Proceedings of the 2019 IEEE 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, Chengdu, China.","DOI":"10.1109\/ICCWAMTIP47768.2019.9067695"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1117\/12.280846","article-title":"Automated detection and classification of sea mines in sonar imagery","volume":"Volume 3079","author":"Dobeck","year":"1997","journal-title":"Proceedings of the Detection and Remediation Technologies for Mines and Minelike Targets II"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wan, S., Yeh, M.L., and Ma, H.L. (2021). An innovative intelligent system with integrated CNN and SVM: Considering various crops through hyperspectral image data. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10040242"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"\u00c7elebi, A.T., G\u00fcll\u00fc, M.K., and Ert\u00fcrk, S. (2011, January 20\u201322). Mine detection in side scan sonar images using Markov Random Fields with brightness compensation. Proceedings of the 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU), Antalya, Turkey.","DOI":"10.1109\/SIU.2011.5929801"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ye, X., Li, C., Zhang, S., Yang, P., and Li, X. (2018, January 22\u201325). Research on side-scan sonar image target classification method based on transfer learning. Proceedings of the OCEANS 2018 MTS\/IEEE Charleston, Charleston, SC, USA.","DOI":"10.1109\/OCEANS.2018.8604691"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"47407","DOI":"10.1109\/ACCESS.2020.2978880","article-title":"Underwater object classification in sidescan sonar images using deep transfer learning and semisynthetic training data","volume":"8","author":"Huo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"98331","DOI":"10.1109\/ACCESS.2019.2927366","article-title":"Sediment classification of small-size seabed acoustic images using convolutional neural networks","volume":"7","author":"Luo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"29416","DOI":"10.1109\/ACCESS.2021.3052206","article-title":"Optimizing the sediment classification of small side-scan sonar images based on deep learning","volume":"9","author":"Qin","year":"2021","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2020.3045649","article-title":"Structural prior driven regularized deep learning for sonar image classification","volume":"60","author":"Gerg","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","first-page":"1","article-title":"Self-trained target detection of radar and sonar images using automatic deep learning","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_23","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (26\u20131, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xu, S., Qiu, X., Wang, C., Zhong, L., and Yuan, X. (2018, January 22\u201327). Desnet: Deep residual networks for Descalloping of ScanSar images. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519078"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.patcog.2019.01.006","article-title":"Wider or deeper: Revisiting the resnet model for visual recognition","volume":"90","author":"Wu","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Qiu, C., and Zhou, W. (2020, January 28\u201331). A survey of recent advances in CNN-based fine-grained visual categorization. Proceedings of the 2020 IEEE 20th International Conference on Communication Technology (ICCT), Nanning, China.","DOI":"10.1109\/ICCT50939.2020.9295723"},{"key":"ref_27","unstructured":"Yu, F., and Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22\u201329). Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.89"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_32","unstructured":"He, K., Girshick, R., and Doll\u00e1r, P. (November, January 27). Rethinking imagenet pre-training. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3263","DOI":"10.1016\/j.matpr.2021.07.222","article-title":"Side scan sonar image augmentation for sediment classification using deep learning based transfer learning approach","volume":"80","author":"Chandrashekar","year":"2023","journal-title":"Mater. Today Proc."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ji-yang, Y., Dan, H., Lu-yuan, W., Xin, L., and Wen-juan, L. (2016, January 6\u201310). On-board ship targets detection method based on multi-scale salience enhancement for remote sensing image. Proceedings of the 2016 IEEE 13th International Conference on Signal Processing (ICSP), Chengdu, China.","DOI":"10.1109\/ICSP.2016.7877827"},{"key":"ref_35","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems 28 (NIPS 2015), Montreal, QC, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"173450","DOI":"10.1109\/ACCESS.2020.3024813","article-title":"Shipwreck target recognition in side-scan sonar images by improved YOLOv3 model based on transfer learning","volume":"8","author":"Yulin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Fuchs, L.R., G\u00e4llstr\u00f6m, A., and Folkesson, J. (2018, January 6\u20139). Object recognition in forward looking sonar images using transfer learning. Proceedings of the 2018 IEEE\/OES Autonomous Underwater Vehicle Workshop (AUV), Porto, Portugal.","DOI":"10.1109\/AUV.2018.8729686"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"18023","DOI":"10.1109\/ACCESS.2022.3150339","article-title":"Target detection of forward-looking sonar image based on improved yolov5","volume":"10","author":"Zhang","year":"2022","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ge, Q., Ruan, F., Qiao, B., Zhang, Q., Zuo, X., and Dang, L. (2021). Side-scan sonar image classification based on style transfer and pre-trained convolutional neural networks. Electronics, 10.","DOI":"10.3390\/electronics10151823"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cheng, Z., Huo, G., and Li, H. (2022). A multi-domain collaborative transfer learning method with multi-scale repeated attention mechanism for underwater side-scan sonar image classification. Remote Sens., 14.","DOI":"10.3390\/rs14020355"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, J., Li, H., Huo, G., Li, C., and Wei, Y. (2023). Multi-Mode Channel Position Attention Fusion Side-Scan Sonar Transfer Recognition. Electronics, 12.","DOI":"10.3390\/electronics12040791"},{"key":"ref_42","first-page":"1","article-title":"Automatic detection of underwater small targets using forward-looking sonar images","volume":"60","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1007\/s11760-020-01841-x","article-title":"Detection and segmentation of underwater objects from forward-looking sonar based on a modified Mask RCNN","volume":"15","author":"Fan","year":"2021","journal-title":"Signal Image Video Process."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Nadimi, N., Javidan, R., and Layeghi, K. (2021). Efficient detection of underwater natural gas pipeline leak based on synthetic aperture sonar (SAS) systems. J. Mar. Sci. Eng., 9.","DOI":"10.3390\/jmse9111273"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/JOE.2021.3103264","article-title":"Coherence-induced bias reduction in synthetic aperture sonar along-track micronavigation","volume":"47","author":"Thomas","year":"2021","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1502205","DOI":"10.1109\/LGRS.2023.3286180","article-title":"Multireceiver SAS imagery with generalized PCA","volume":"20","author":"Zhang","year":"2023","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1049761","DOI":"10.3389\/fmars.2022.1049761","article-title":"Synthetic aperture imagery for high-resolution imaging sonar","volume":"9","author":"Huang","year":"2022","journal-title":"Front. Mar. Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4517\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:50:52Z","timestamp":1760129452000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4517"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,14]]},"references-count":47,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15184517"],"URL":"https:\/\/doi.org\/10.3390\/rs15184517","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,14]]}}}