{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T07:48:16Z","timestamp":1769932096901,"version":"3.49.0"},"reference-count":68,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,26]],"date-time":"2021-12-26T00:00:00Z","timestamp":1640476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Research Program of Frontier Sciences, CAS","award":["ZDBS-LY-DQC016"],"award-info":[{"award-number":["ZDBS-LY-DQC016"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["61836013"],"award-info":[{"award-number":["61836013"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA19020103"],"award-info":[{"award-number":["XDA19020103"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA19020203"],"award-info":[{"award-number":["XDA19020203"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Cloud recognition is a basic task in ground meteorological observation. It is of great significance to accurately identify cloud types from long-time-series satellite cloud images for improving the reliability and accuracy of weather forecasting. However, different from ground-based cloud images with a small observation range and easy operation, satellite cloud images have a wider cloud coverage area and contain more surface features. Hence, it is difficult to effectively extract the structural shape, area size, contour shape, hue, shadow and texture of clouds through traditional deep learning methods. In order to analyze the regional cloud type characteristics effectively, we construct a China region meteorological satellite cloud image dataset named CRMSCD, which consists of nine cloud types and the clear sky (cloudless). In this paper, we propose a novel neural network model, UATNet, which can realize the pixel-level classification of meteorological satellite cloud images. Our model efficiently integrates the spatial and multi-channel information of clouds. Specifically, several transformer blocks with modified self-attention computation (swin transformer blocks) and patch merging operations are used to build a hierarchical transformer, and spatial displacement is introduced to construct long-distance cross-window connections. In addition, we introduce a Channel Cross fusion with Transformer (CCT) to guide the multi-scale channel fusion, and design an Attention-based Squeeze and Excitation (ASE) to effectively connect the fused multi-scale channel information to the decoder features. The experimental results demonstrate that the proposed model achieved 82.33% PA, 67.79% MPA, 54.51% MIoU and 70.96% FWIoU on CRMSCD. Compared with the existing models, our method produces more precise segmentation performance, which demonstrates its superiority on meteorological satellite cloud recognition tasks.<\/jats:p>","DOI":"10.3390\/rs14010104","type":"journal-article","created":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T01:06:54Z","timestamp":1640567214000},"page":"104","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["UATNet: U-Shape Attention-Based Transformer Net for Meteorological Satellite Cloud Recognition"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1880-2522","authenticated-orcid":false,"given":"Zhanjie","family":"Wang","sequence":"first","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7036-0800","authenticated-orcid":false,"given":"Jianghua","family":"Zhao","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"}]},{"given":"Ran","family":"Zhang","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Zheng","family":"Li","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"}]},{"given":"Qinghui","family":"Lin","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"}]},{"given":"Xuezhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"D19105","DOI":"10.1029\/2003JD004457","article-title":"Calculation of radiative fluxes from the surface to top of atmosphere based on isccp and other global data sets: Refinements of the radiative transfer model and the input data","volume":"109","author":"Zhang","year":"2004","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1732","DOI":"10.1126\/science.1076964","article-title":"Cosmic rays, clouds, and climate","volume":"298","author":"Carslaw","year":"2002","journal-title":"Science"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1175\/JCLI-3243.1","article-title":"Cloud feedbacks in the climate system: A critical review","volume":"18","author":"Stephens","year":"2005","journal-title":"J. Clim."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"388","DOI":"10.4028\/www.scientific.net\/AMR.1073-1076.388","article-title":"Prediction of Regional Global Horizontal Irradiance Combining Ground-Based Cloud Observation and Numerical Weather Prediction","volume":"1073\u20131076","author":"Cui","year":"2014","journal-title":"Adv. Mater. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"151","DOI":"10.2151\/jmsj.2016-009","article-title":"An introduction to himawari-8\/9\u2014Japan\u2019s new-generation geostationary meteorological satellites","volume":"94","author":"Bessho","year":"2016","journal-title":"J. Meteorol. Soc. Jpn. Ser. II"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1175\/BAMS-D-15-00230.1","article-title":"A closer look at the ABI on the GOES-R series","volume":"98","author":"Schmit","year":"2017","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1175\/BAMS-D-16-0065.1","article-title":"Introducing the new generation of chinese geostationary weather satellites, Fengyun-4","volume":"98","author":"Yang","year":"2017","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1175\/JTECH-D-13-00048.1","article-title":"Cloud classification of ground-based images using texture\u2013structure features","volume":"31","author":"Zhuo","year":"2014","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Li, D., Liu, S., Xiao, B., and Cao, X. (2018). Multi-view ground-based cloud recognition by transferring deep visual information. Appl. Sci., 8.","DOI":"10.3390\/app8050748"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fang, C., Jia, K., Liu, P., and Zhang, L. (2019, January 18\u201321). Research on cloud recognition technology based on transfer learning. Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China.","DOI":"10.1109\/APSIPAASC47483.2019.9023267"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, S., Li, M., Zhang, Z., Xiao, B., and Durrani, T.S. (2020). Multi-evidence and multi-modal fusion network for ground-based cloud recognition. Remote Sens., 12.","DOI":"10.3390\/rs12030464"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5558","DOI":"10.3390\/s90705558","article-title":"An improved cloud classification algorithm for China\u2019s FY-2C multi-channel images using artificial neural network","volume":"9","author":"Liu","year":"2009","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bai, T., Li, D., Sun, K., Chen, Y., and Li, W. (2016). Cloud detection for high-resolution satellite imagery using machine learning and multi-feature fusion. Remote Sens., 8.","DOI":"10.3390\/rs8090715"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cai, K., and Wang, H. (2017, January 24\u201326). Cloud classification of satellite image based on convolutional neural networks. Proceedings of the 2017 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China.","DOI":"10.1109\/ICSESS.2017.8343049"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2341","DOI":"10.1175\/1520-0442(1993)006<2341:CDUSMO>2.0.CO;2","article-title":"Cloud detection using satellite measurements of infrared and visible radiances for ISCCP","volume":"6","author":"Rossow","year":"1993","journal-title":"J. Clim."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.14358\/PERS.72.10.1179","article-title":"Characterization of the landsat-7 ETM+ automated cloud-cover assessment (ACCA) algorithm","volume":"72","author":"Irish","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.rse.2011.10.028","article-title":"Object-based cloud and cloud shadow detection in landsat imagery","volume":"118","author":"Zhu","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_18","unstructured":"Azimi-Sadjadi, M., and Zekavat, S. (2000, January 24\u201328). Cloud classification using support vector machines. Proceedings of the IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No. 00CH37120), Honolulu, HI, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2662","DOI":"10.1109\/TGRS.2003.815404","article-title":"Multifeature texture analysis for the classification of clouds in satellite imagery","volume":"41","author":"Christodoulou","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1175\/1520-0450(2003)042<0204:HSRSAC>2.0.CO;2","article-title":"High-spatial-resolution surface and cloud-type classification from modis multispectral band measurements","volume":"42","author":"Li","year":"2003","journal-title":"J. Appl. Meteorol."},{"key":"ref_21","first-page":"2735","article-title":"Probabilistic physically based cloud screening of satellite infrared imagery for operational sea surface temperature retrieval","volume":"131","author":"Merchant","year":"2005","journal-title":"Q. J. R. Meteorol. Soc. A J. Atmos. Sci. Appl. Meteorol. Phys. Oceanogr."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1016\/j.rse.2007.06.004","article-title":"Statistical cloud detection from seviri multispectral images","volume":"112","author":"Amato","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.isprsjprs.2008.12.007","article-title":"Use of markov random fields for automatic cloud\/shadow detection on high resolution optical images","volume":"64","year":"2009","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.neucom.2014.09.102","article-title":"A cloud image detection method based on SVM vector machine","volume":"169","author":"Li","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4197","DOI":"10.1109\/JSTARS.2015.2431676","article-title":"Bag-of-words and object-based classification for cloud extraction from satellite imagery","volume":"8","author":"Yuan","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1109\/LGRS.2014.2356616","article-title":"Neural networks and support vector machine algorithms for automatic cloud classification of whole-sky ground-based images","volume":"12","author":"Taravat","year":"2014","journal-title":"Geosci. Remote Sens. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shi, M., Xie, F., Zi, Y., and Yin, J. (2016, January 10\u201315). Cloud detection of remote sensing images by deep learning. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729176"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Phung, V.H., and Rhee, E.J. (2019). A high-accuracy model average ensemble of convolutional neural networks for classification of cloud image patches on small datasets. Appl. Sci., 9.","DOI":"10.3390\/app9214500"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3323","DOI":"10.1109\/JIOT.2020.3043289","article-title":"Ensemble meteorological cloud classification meets internet of dependable and controllable things","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Manzo, M., and Pellino, S. (2021). Voting in transfer learning system for ground-based cloud classification. arXiv.","DOI":"10.3390\/make3030028"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"032051","DOI":"10.1088\/1742-6596\/1802\/3\/032051","article-title":"A novel computer-aided cloud type classification method based on convolutional neural network with squeeze-and-excitation","volume":"1802","author":"Li","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, S., Li, M., Zhang, Z., Xiao, B., and Cao, X. (2018). Multimodal ground-based cloud classification using joint fusion convolutional neural network. Remote Sens., 10.","DOI":"10.3390\/rs10060822"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"8665","DOI":"10.1029\/2018GL077787","article-title":"Cloudnet: Ground-based cloud classification with deep convolutional neural network","volume":"45","author":"Zhang","year":"2018","journal-title":"Geophys. Res. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"87323","DOI":"10.1109\/ACCESS.2019.2925565","article-title":"P_segnet and np_segnet: New neural network architectures for cloud recognition of remote sensing images","volume":"7","author":"Lu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_35","unstructured":"Zhang, L., Jia, K., Liu, P., and Fang, C. (2020, January 7\u201310). Cloud recognition based on lightweight neural network. Proceedings of the 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Auckland, New Zealand."},{"key":"ref_36","unstructured":"Luo, W., Li, Y., Urtasun, R., and Zemel, R. (2016, January 5\u201310). Understanding the effective receptive field in deep convolutional neural networks. Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_37","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20138). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., and Chen, L.-C. (2020). Axial-Deeplab: Stand-Alone Axial-Attention for Panoptic Segmentation. Computer Vision\u2014ECCV 2020, Proceeding of the European Conference on Computer Vision, Glasgow, UK, 23\u201328 August 2020, Springer.","DOI":"10.1007\/978-3-030-58548-8_7"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 21\u201324). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"ref_40","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1007\/s13351-017-6161-z","article-title":"Developing the science product algorithm testbed for chinese next-generation geostationary meteorological satellites: Fengyun-4 series","volume":"31","author":"Min","year":"2017","journal-title":"J. Meteorol. Res."},{"key":"ref_42","first-page":"31","article-title":"FY-4 meteorological satellite","volume":"18","author":"Yaohai","year":"2019","journal-title":"China Aerosp."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"8827","DOI":"10.1109\/TGRS.2019.2923247","article-title":"Intercomparisons of cloud mask products among Fengyun-4a, Himawari-8, and modis","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","first-page":"43","article-title":"High-resolution cloud analysis information derived from Himawari-8 data","volume":"61","author":"Suzue","year":"2016","journal-title":"Meteorol. Satell. Cent. Tech. Note"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin transformer: Hierarchical vision transformer using shifted windows. arXiv.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_46","unstructured":"Huang, Z., Ben, Y., Luo, G., Cheng, P., Yu, G., and Fu, B. (2021). Shuffle transformer: Rethinking spatial shuffle for vision transformer. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Wang, H., Cao, P., Wang, J., and Zaiane, O.R. (2021). Uctransnet: Rethinking the skip connections in u-net from a channel-wise perspective with transformer. arXiv.","DOI":"10.1609\/aaai.v36i3.20144"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. MICCAI 2015, Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5\u20139 October 2015, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., and Wu, J. (2020, January 4\u20138). Unet 3+: A full-scale connected unet for medical image segmentation. Proceedings of the ICASSP 2020\u20132020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9053405"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_55","unstructured":"Takikawa, T., Acuna, D., Jampani, V., and Fidler, S. (November, January 27). Gated-scnn: Gated shape cnns for semantic segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_56","unstructured":"Sun, K., Zhao, Y., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., and Wang, J. (2019). High-resolution representations for labeling pixels and regions. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Chen, X., and Wang, J. (2020). Object-contextual representations for semantic segmentation. Computer Vision\u2014ECCV 2020, Proceedings of the 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer. Part VI 16.","DOI":"10.1007\/978-3-030-58539-6_11"},{"key":"ref_58","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Liu, Y., and Lapata, M. (2019). Text summarization with pretrained encoders. arXiv.","DOI":"10.18653\/v1\/D19-1387"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"26146","DOI":"10.1109\/ACCESS.2019.2900753","article-title":"Transformer-based neural network for answer selection in question answering","volume":"7","author":"Shao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Wang, Q., Li, B., Xiao, T., Zhu, J., Li, C., Wong, D.F., and Chao, L.S. (2019). Learning deep transformer models for machine translation. arXiv.","DOI":"10.18653\/v1\/P19-1176"},{"key":"ref_62","unstructured":"Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The long-document transformer. arXiv."},{"key":"ref_63","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). Squeezenet: Alexnet-level accuracy with 50\u00d7 fewer parameters and <0.5 mb model size. arXiv."},{"key":"ref_64","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s40537-016-0043-6","article-title":"A survey of transfer learning","volume":"3","author":"Weiss","year":"2016","journal-title":"J. Big Data"},{"key":"ref_67","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.1007\/s11263-021-01453-z","article-title":"Knowledge distillation: A survey","volume":"129","author":"Gou","year":"2021","journal-title":"Int. J. Comput. Vis."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/104\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:53:46Z","timestamp":1760169226000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/1\/104"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,26]]},"references-count":68,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["rs14010104"],"URL":"https:\/\/doi.org\/10.3390\/rs14010104","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,26]]}}}