{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T18:46:15Z","timestamp":1767897975538,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,22]],"date-time":"2023-03-22T00:00:00Z","timestamp":1679443200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province","doi-asserted-by":"publisher","award":["LH2020F023"],"award-info":[{"award-number":["LH2020F023"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>SAR-ATR (synthetic aperture radar-automatic target recognition) is a hot topic in remote sensing. This work suggests a few-shot target recognition approach (FTL) based on the concept of transfer learning to accomplish accurate target recognition of SAR images in a few-shot scenario since the classic SAR ATR method has significant data reliance. At the same time, the strategy introduces a model distillation method to improve the model\u2019s performance further. This method is composed of three parts. First, the data engine, which uses the style conversion model and optical image data to generate image data similar to SAR style and realize cross-domain conversion, can effectively solve the problem of insufficient training data of the SAR image classification model. Second is model training, which uses SAR image data sets to pre-train the model. Here, we introduce the deep Brownian distance covariance (Deep BDC) pooling layer to optimize the image feature representation so that the model can learn the image representation by measuring the difference between the joint feature function of the embedded feature and the edge product. Third, model fine-tuning, which freezes the model structure, except the classifier, and fine-tunes it by using a small amount of novel data. The knowledge distillation approach is also introduced simultaneously to train the model repeatedly, sharpen the knowledge, and enhance model performance. According to experimental results on the MSTAR benchmark dataset, the proposed method is demonstrably better than the SOTA method in the few-shot SAR ATR issue. The recognition accuracy is about 80% in the case of 10-way 10-shot.<\/jats:p>","DOI":"10.3390\/rs15061709","type":"journal-article","created":{"date-parts":[[2023,3,22]],"date-time":"2023-03-22T06:35:28Z","timestamp":1679466928000},"page":"1709","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Improving Pre-Training and Fine-Tuning for Few-Shot SAR Automatic Target Recognition"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7594-0417","authenticated-orcid":false,"given":"Chao","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China"}]},{"given":"Hongbin","family":"Dong","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China"}]},{"given":"Baosong","family":"Deng","sequence":"additional","affiliation":[{"name":"Defense Innovation Institute, Academy of Military Sciences, Beijing 100071, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,22]]},"reference":[{"key":"ref_1","unstructured":"Novak, L.M., Owirka, G.J., Brower, W.S., and Weaver, A.L. (1997). The automatic target-recognition system in SAIP. Linc. Lab. J., 10."},{"key":"ref_2","unstructured":"Ikeuchi, K., Wheeler, M.D., Yamazaki, T., and Shakunaga, T. (1996, January 8\u201312). Model-based SAR ATR system. Proceedings of the Aerospace\/Defense Sensing and Controls, Orlando, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep Learning","volume":"521","author":"Goodfellow","year":"2015","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hertzmann, A. (1998, January 19\u201324). Painterly rendering with curved brush strokes of multiple sizes. Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA.","DOI":"10.1145\/280814.280951"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Frigo, O., Sabater, N., Delon, J., and Hellier, P. (July2016, January 26). Split and Match: Example-Based Adaptive Patch Sampling for Unsupervised Style Transfer. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.66"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1145\/1141911.1142018","article-title":"Real-time video abstraction","volume":"25","author":"Olsen","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_7","unstructured":"Gatys, L.A., Ecker, A.S., and Bethge, M. (,  2015). Texture Synthesis Using Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems 28 (NIPS 2015), Available online: https:\/\/papers.nips.cc\/paper\/2015."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, C., and Wand, M. (July, January 26). Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.272"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"An, J., Huang, S., Song, Y., Dou, D., Liu, W., and Luo, J. (2021, January 20\u201325). ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00092"},{"key":"ref_10","unstructured":"An, J., Li, T., Huang, H., Shen, L., Wang, X., Tang, Y., Ma, J., Liu, W., and Luo, J. (2020). Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning. arXiv."},{"key":"ref_11","unstructured":"Santoro, A., Bartunov, S., Botvinick, M.M., Wierstra, D., and Lillicrap, T.P. (2016, January 19\u201324). Meta-Learning with Memory-Augmented Neural Networks. Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhao, X., Lv, X., Cai, J., Guo, J., Zhang, Y., Qiu, X., and Wu, Y. (2022). Few-Shot SAR-ATR Based on Instance-Aware Transformer. Remote Sens., 14.","DOI":"10.3390\/rs14081884"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.neucom.2021.09.009","article-title":"A novel few-shot learning method for synthetic aperture radar image recognition","volume":"465","author":"Yue","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_14","unstructured":"Vinyals, O., Blundell, C., Lillicrap, T.P., Kavukcuoglu, K., and Wierstra, D. (,  2016). Matching Networks for One Shot Learning. Proceedings of the Advances in Neural Information Processing Systems 29 (NIPS 2016), Available online: https:\/\/researchr.org\/publication\/nips-2016."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xie, J., Long, F., Lv, J., Wang, Q., and Li, P. (2022, January 18\u201324). Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00781"},{"key":"ref_16","unstructured":"Settles, B. (2009). Active Learning Literature Survey, Department of Computer Sciences, University of Wisconsin-Madison."},{"key":"ref_17","unstructured":"Aggarwal, C.C., Kong, X., Gu, Q., Han, J., and Philip, S.Y. (2014). Data Classification, Chapman and Hall\/CRC."},{"key":"ref_18","unstructured":"Tian, Y., Krishnan, D., and Isola, P. (2020, January 26\u201330). Contrastive Representation Distillation. Proceedings of the 2020 International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_19","unstructured":"Adriana, R., Nicolas, B., Ebrahimi, K.S., Antoine, C., Carlo, G., and Yoshua, B. (2015). Fitnets: Hints for thin deep nets. Proc. ICLR, 2."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yim, J., Joo, D., Bae, J., and Kim, J. (2017, January 21\u201326). A gift from knowledge distillation: Fast optimization, network minimization and transfer learning. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.754"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, L., Song, J., Gao, A., Chen, J., Bao, C., and Ma, K. (November, January 27). Be your own teacher: Improve the performance of convolutional neural networks via self distillation. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00381"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"90366","DOI":"10.1109\/ACCESS.2021.3089766","article-title":"Training compact change detection network for remote sensing imagery","volume":"9","author":"Mahmoud","year":"2021","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Xiang, T., Hospedales, T.M., and Lu, H. (2018, January 18\u201322). Deep mutual learning. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00454"},{"key":"ref_24","first-page":"2184","article-title":"Self-distillation as instance-specific label smoothing","volume":"33","author":"Zhang","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3068","DOI":"10.1609\/aaai.v33i01.33013068","article-title":"Amalgamating knowledge towards comprehensive classification","volume":"Volume 33","author":"Shen","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fu, Y., Li, S., Zhao, H., Wang, W., Fang, W., Zhuang, Y., Pan, Z., and Li, X. (2021). Elastic knowledge distillation by learning from recollection. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2021.3107317"},{"key":"ref_27","first-page":"1236","article-title":"Brownian distance covariance","volume":"3","author":"Rizzo","year":"2009","journal-title":"Ann. Appl. Stat."},{"key":"ref_28","unstructured":"Furlanello, T., Lipton, Z., Tschannen, M., Itti, L., and Anandkumar, A. (2018, January 10\u201315). Born again neural networks. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, C., Cai, Y., Lin, G., and Shen, C. (2020, January 13\u201319). DeepEMD: Few-Shot Image Classification With Differentiable Earth Mover\u2019s Distance and Structured Classifiers. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01222"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, C., Cai, Y., Lin, G., and Shen, C. DeepEMD: Differentiable Earth Mover\u2019s Distance for Few-Shot Learning. IEEE Trans. Pattern Anal. Mach. Intell., 2022.","DOI":"10.1109\/TPAMI.2022.3217373"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, W., Wang, L., Xu, J., Huo, J., Gao, Y., and Luo, J. (2019, January 15\u201320). Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00743"},{"key":"ref_32","unstructured":"Snell, J., Swersky, K., and Zemel, R.S. (,  2017). Prototypical Networks for Few-shot Learning. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Available online: https:\/\/papers.nips.cc\/paper\/2017."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P.H.S., and Hospedales, T.M. (2018, January 18\u201322). Learning to Compare: Relation Network for Few-Shot Learning. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00131"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/6\/1709\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:00:36Z","timestamp":1760122836000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/6\/1709"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,22]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["rs15061709"],"URL":"https:\/\/doi.org\/10.3390\/rs15061709","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,22]]}}}