{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T04:08:15Z","timestamp":1782446895545,"version":"3.54.5"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T00:00:00Z","timestamp":1677369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["U1906218"],"award-info":[{"award-number":["U1906218"]}]},{"name":"National Natural Science Foundation of China","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}]},{"name":"National Natural Science Foundation of China","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}]},{"name":"National Natural Science Foundation of China","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}]},{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province","doi-asserted-by":"publisher","award":["U1906218"],"award-info":[{"award-number":["U1906218"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province","doi-asserted-by":"publisher","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province","doi-asserted-by":"publisher","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province","doi-asserted-by":"publisher","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"publisher"}]},{"name":"key areas of research and development plan key projects of Guangdong Province","award":["U1906218"],"award-info":[{"award-number":["U1906218"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province","award":["2021YFC3101803"],"award-info":[{"award-number":["2021YFC3101803"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province","award":["ZD2020D001"],"award-info":[{"award-number":["ZD2020D001"]}]},{"name":"key areas of research and development plan key projects of Guangdong Province","award":["2020B1111010002"],"award-info":[{"award-number":["2020B1111010002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Due to the small sample size of underwater acoustic data and the strong noise interference caused by seabed reverberation, recognizing underwater targets in Side-Scan Sonar (SSS) images is challenging. Using a transfer-learning-based recognition method to train the backbone network on a large optical dataset (ImageNet) and fine-tuning the head network with a small SSS image dataset can improve the classification of sonar images. However, optical and sonar images have different statistical characteristics, directly affecting transfer-learning-based target recognition. In order to improve the accuracy of underwater sonar image classification, a style transformation method between optical and SSS images is proposed in this study. In the proposed method, objects with the SSS style were synthesized through content image feature extraction and image style transfer to reduce the variability of different data sources. A staged optimization strategy using multi-modal data effectively captures the anti-noise features of sonar images, providing a new learning method for transfer learning. The results of the classification experiment showed that the approach is more stable when using synthetic data and other multi-modal datasets, with an overall accuracy of 100%.<\/jats:p>","DOI":"10.3390\/rs15051303","type":"journal-article","created":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T02:04:11Z","timestamp":1677463451000},"page":"1303","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Multi-Modal Multi-Stage Underwater Side-Scan Sonar Target Recognition Based on Synthetic Images"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4184-7059","authenticated-orcid":false,"given":"Jian","family":"Wang","sequence":"first","affiliation":[{"name":"Acoustic Science and Technology Laboratory, Harbin Engineering University, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haisen","family":"Li","sequence":"additional","affiliation":[{"name":"Acoustic Science and Technology Laboratory, Harbin Engineering University, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanying","family":"Huo","sequence":"additional","affiliation":[{"name":"College of Internet of Things Engineering, Hohai University, Changzhou 213022, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8228-3398","authenticated-orcid":false,"given":"Chao","family":"Li","sequence":"additional","affiliation":[{"name":"Acoustic Science and Technology Laboratory, Harbin Engineering University, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuhang","family":"Wei","sequence":"additional","affiliation":[{"name":"Acoustic Science and Technology Laboratory, Harbin Engineering University, Harbin 150001, China"},{"name":"College of Underwater Acoustic Engineering, Harbin Engineering University, Harbin 150001, China"},{"name":"Key Laboratory of Marine Information Acquisition and Security (Harbin Engineering University), Ministry of Industry and Information Technology, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TAES.1986.310772","article-title":"Automatic target recognition: State of the art survey","volume":"AES-22","author":"Bhanu","year":"1986","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1016\/j.sigpro.2006.08.001","article-title":"Speckle noise reduction in SAS imagery","volume":"87","author":"Chaillan","year":"2007","journal-title":"Signal Process."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kazimierski, W., and Zaniewicz, G. (2021). Determination of process noise for underwater target tracking with forward looking sonar. Remote. Sens., 13.","DOI":"10.3390\/rs13051014"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1109\/LCOMM.2022.3151790","article-title":"IAFNet: Few-shot learning for modulation recognition in underwater impulsive noise","volume":"26","author":"Wang","year":"2022","journal-title":"IEEE Commun. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1049\/iet-rsn.2019.0477","article-title":"Parameter estimation of underwater impulsive noise with the Class B model","volume":"14","author":"Zhang","year":"2020","journal-title":"IET Radar Sonar Navig."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6018","DOI":"10.1109\/TVT.2021.3079469","article-title":"A non-gaussianity-aware receiver for impulsive noise mitigation in underwater communications","volume":"70","author":"Li","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/LGRS.2020.2993652","article-title":"MiNet: Efficient deep learning automatic target recognition for small autonomous vehicles","volume":"18","author":"Topple","year":"2020","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/LGRS.2018.2882551","article-title":"Squeeze and excitation rank faster R-CNN for ship detection in SAR images","volume":"16","author":"Lin","year":"2018","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, T., Zhang, X., Shi, J., and Wei, S. (2019, January 13\u201315). High-speed ship detection in SAR images by improved yolov3. Proceedings of the 2019 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, Chengdu, China.","DOI":"10.1109\/ICCWAMTIP47768.2019.9067695"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1117\/12.280846","article-title":"Automated detection and classification of sea mines in sonar imagery","volume":"3079","author":"Dobeck","year":"1997","journal-title":"Proc. SPIE"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wan, S., Yeh, M.L., and Ma, H.L. (2021). An innovative intelligent system with integrated CNN and SVM: Considering various crops through hyperspectral image data. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10040242"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"\u00c7elebi, A.T., G\u00fcll\u00fc, M.K., and Ert\u00fcrk, S. (2011, January 20\u201322). Mine detection in side scan sonar images using Markov Random Fields with brightness compensation. Proceedings of the 2011 IEEE 19th Signal Processing and Communications Applications Conference (SIU), Antalya, Turkey.","DOI":"10.1109\/SIU.2011.5929801"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ye, X., Li, C., Zhang, S., Yang, P., and Li, X. (2018, January 22\u201325). Research on side-scan sonar image target classification method based on transfer learning. Proceedings of the OCEANS 2018 Conference, Charleston, NC, USA.","DOI":"10.1109\/OCEANS.2018.8604691"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"47407","DOI":"10.1109\/ACCESS.2020.2978880","article-title":"Underwater object classification in sidescan sonar images using deep transfer learning and semisynthetic training data","volume":"8","author":"Huo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"98331","DOI":"10.1109\/ACCESS.2019.2927366","article-title":"Sediment classification of small-size seabed acoustic images using convolutional neural networks","volume":"7","author":"Luo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"29416","DOI":"10.1109\/ACCESS.2021.3052206","article-title":"Optimizing the sediment classification of small side-scan sonar images based on deep learning","volume":"9","author":"Qin","year":"2021","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gerg, I.D., and Monga, V. (2021). Structural prior driven regularized deep learning for sonar image classification. IEEE Trans. Geosci. Remote. Sens., 60.","DOI":"10.1109\/TGRS.2020.3045649"},{"key":"ref_18","first-page":"4701914","article-title":"Self-trained target detection of radar and sonar images using automatic deep learning","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_19","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_21","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, S., Qiu, X., Wang, C., Zhong, L., and Yuan, X. (2018, January 23\u201327). Desnet: Deep residual networks for Descalloping of ScanSar images. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519078"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.patcog.2019.01.006","article-title":"Wider or deeper: Revisiting the resnet model for visual recognition","volume":"90","author":"Wu","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Qiu, C., and Zhou, W. (2020, January 28\u201331). A survey of recent advances in CNN-based fine-grained visual categorization. Proceedings of the 2020 IEEE 20th International Conference on Communication Technology (ICCT), Nanning, China.","DOI":"10.1109\/ICCT50939.2020.9295723"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1109\/TSMC.1983.6313076","article-title":"Neocognitron: A neural network model for a mechanism of visual pattern recognition","volume":"13","author":"Fukushima","year":"1983","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_26","first-page":"18","article-title":"Generalization and network design strategies","volume":"19","author":"LeCun","year":"1989","journal-title":"Connect. Perspect."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201315). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"He, K., Girshick, R., and Doll\u00e1r, P. (2019, January 11\u201317). Rethinking imagenet pre-training. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00502"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhao, L., and Li, S. (2020). Object detection algorithm based on improved YOLOv3. Electronics, 9.","DOI":"10.3390\/electronics9030537"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xu, X., Zhao, M., Shi, P., Ren, R., He, X., Wei, X., and Yang, H. (2022). Crack detection and comparison study based on faster R-CNN and mask R-CNN. Sensors, 22.","DOI":"10.3390\/s22031215"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"173450","DOI":"10.1109\/ACCESS.2020.3024813","article-title":"Shipwreck target recognition in side-scan sonar images by improved YOLOv3 model based on transfer learning","volume":"8","author":"Yulin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ji-yang, Y., Dan, H., Lu-yuan, W., Xin, L., and Wen-juan, L. (2016, January 6\u201310). On-board ship targets detection method based on multi-scale salience enhancement for remote sensing image. Proceedings of the 2016 IEEE 13th International Conference on Signal Processing (ICSP), Chengdu, China.","DOI":"10.1109\/ICSP.2016.7877827"},{"key":"ref_33","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the 28th International Conference on Neural Information Processing Systems (NIPS\u201915), Montreal, QC, Canada."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chandrashekar, G., Raaza, A., Rajendran, V., and Ravikumar, D. (2021). Side scan sonar image augmentation for sediment classification using deep learning based transfer learning approach. Mater. Today Proc.","DOI":"10.1016\/j.matpr.2021.07.222"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ge, Q., Ruan, F., Qiao, B., Zhang, Q., Zuo, X., and Dang, L. (2021). Side-scan sonar image classification based on style transfer and pre-trained convolutional neural networks. Electronics, 10.","DOI":"10.3390\/electronics10151823"},{"key":"ref_36","unstructured":"Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., and Yang, M.H. (July, January 21). Diversified texture synthesis with feed-forward networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_37","unstructured":"Gatys, L.A., Ecker, A.S., and Bethge, M. (July, January 26). Image style transfer using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Gatys, L., Ecker, A.S., and Bethge, M. (2015). Texture synthesis using convolutional neural networks. Adv. Neural Inf. Process. Syst., 28.","DOI":"10.1109\/CVPR.2016.265"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1303\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:43:09Z","timestamp":1760121789000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1303"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,26]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["rs15051303"],"URL":"https:\/\/doi.org\/10.3390\/rs15051303","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,26]]}}}