{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:32:00Z","timestamp":1760146320532,"version":"build-2065373602"},"reference-count":68,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T00:00:00Z","timestamp":1729123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62376282"],"award-info":[{"award-number":["62376282"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Remote sensing image (RSI) scene classification aims to identify semantic categories in RSI using neural networks. However, high-performance deep neural networks typically demand substantial storage and computational resources, making practical deployment challenging. Knowledge distillation has emerged as an effective technique for developing compact models that maintain high classification accuracy in RSI tasks. Existing knowledge distillation methods often overlook the high inter-class similarity in RSI scenes, leading to low-confidence soft labels from the teacher model, which can mislead the student model. Conversely, overly confident soft labels may discard valuable non-target information. Additionally, the significant intra-class variability in RSI contributes to instability in the model\u2019s decision boundaries. To address these challenges, we propose an efficient method called instance-level scaling and dynamic margin-alignment knowledge distillation (ISDM) for RSI scene classification. To balance the target and non-target class influence, we apply an entropy regularization loss to scale the teacher model\u2019s target class at the instance level. Moreover, we introduce dynamic margin alignment between the student and teacher models to improve the student\u2019s discriminative capability. By optimizing soft labels and enhancing the student\u2019s ability to distinguish between classes, our method reduces the effects of inter-class similarity and intra-class variability. Experimental results on three public RSI scene classification datasets (AID, UCMerced, and NWPU-RESISC) demonstrate that our method achieves state-of-the-art performance across all teacher\u2013student pairs with lower computational costs. Additionally, we validate the generalization of our approach on general datasets, including CIFAR-100 and ImageNet-1k.<\/jats:p>","DOI":"10.3390\/rs16203853","type":"journal-article","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T03:49:34Z","timestamp":1729136974000},"page":"3853","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Instance-Level Scaling and Dynamic Margin-Alignment Knowledge Distillation for Remote Sensing Image Scene Classification"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8041-2538","authenticated-orcid":false,"given":"Chuan","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8012-2088","authenticated-orcid":false,"given":"Xiao","family":"Teng","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4741-517X","authenticated-orcid":false,"given":"Yan","family":"Ding","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4238-8985","authenticated-orcid":false,"given":"Long","family":"Lan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1080\/10106049.2015.1027291","article-title":"Pixel-based and object-based classifications using high-and medium-spatial-resolution imageries in the urban and suburban landscapes","volume":"30","author":"Estoque","year":"2015","journal-title":"Geocarto Int."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2217","DOI":"10.1109\/JSTARS.2019.2918242","article-title":"Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification","volume":"12","author":"Helber","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1080\/2150704X.2017.1422873","article-title":"An object-based supervised classification framework for very-high-resolution remote sensing images using convolutional neural networks","volume":"9","author":"Zhang","year":"2018","journal-title":"Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1109\/JSTARS.2018.2810320","article-title":"Symmetrical dense-shortcut deep fully convolutional networks for semantic segmentation of very-high-resolution remote sensing images","volume":"11","author":"Chen","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_5","first-page":"221","article-title":"Support vector machines for hyperspectral remote sensing classification","volume":"Volume 3584","author":"Gualtieri","year":"1999","journal-title":"Proceedings of the 27th AIPR Workshop: Advances in Computer-Assisted Recognition"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.rse.2011.11.020","article-title":"A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery","volume":"118","author":"Duro","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/TGRS.2013.2241444","article-title":"Unsupervised feature learning for aerial scene classification","volume":"52","author":"Cheriyadat","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5019","DOI":"10.3390\/rs6065019","article-title":"Object-based image classification of summer crops with machine learning methods","volume":"6","author":"Six","year":"2014","journal-title":"Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1080\/15481603.2014.983338","article-title":"A comparative analysis of approaches for successional vegetation classification in the Brazilian Amazon","volume":"51","author":"Lu","year":"2014","journal-title":"Giscience Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.14358\/PERS.75.8.1005","article-title":"Individual object change detection for monitoring the impact of a forest pathogen on a hardwood forest","volume":"75","author":"Kelly","year":"2009","journal-title":"PHotogrammetr. Eng. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1887","DOI":"10.3390\/rs4071887","article-title":"Monitoring seasonal hydrological dynamics of minerotrophic peatlands using multi-date GeoEye-1 very high resolution imagery and object-based classification","volume":"4","author":"Dribault","year":"2012","journal-title":"Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2008, January 12\u201315). Comparing SIFT descriptors and Gabor texture features for classification of remote sensed imagery. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712139"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1109\/CVPR.2005.177","article-title":"Histograms of oriented gradients for human detection","volume":"Volume 1","author":"Dalal","year":"2005","journal-title":"Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8\u201314). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_8"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4585","DOI":"10.1109\/TIP.2018.2843129","article-title":"Interacting tracklets for multi-object tracking","volume":"27","author":"Lan","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1007\/s11263-020-01314-1","article-title":"Semi-online multi-people tracking by re-identification","volume":"128","author":"Lan","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2656","DOI":"10.1109\/TIP.2021.3049970","article-title":"Nocal-siam: Refining visual features and response with advanced non-local blocks for real-time siamese tracking","volume":"30","author":"Tan","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3338","DOI":"10.1109\/TIP.2023.3278860","article-title":"Learning to purification for unsupervised person re-identification","volume":"32","author":"Lan","year":"2023","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Teng, X., Lan, L., Zhao, J., Li, X., and Tang, Y. (2023). Highly Efficient Active Learning With Tracklet-Aware Co-Cooperative Annotators for Person Re-Identification. IEEE Trans. Neural Netw. Learn. Syst., 1\u201314.","DOI":"10.1109\/TNNLS.2023.3289178"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Teng, X., Li, C., Li, X., Liu, X., and Lan, L. (2024). TIG-CL: Teacher-Guided Individual and Group Aware Contrastive Learning for Unsupervised Person Re-Identification in Internet of Things. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2024.3435371"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep learning-based classification of hyperspectral data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"473","DOI":"10.5194\/isprs-annals-III-3-473-2016","article-title":"Semantic segmentation of aerial images with an ensemble of CNSS","volume":"3","author":"Marmanis","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/j.patcog.2016.07.001","article-title":"Towards better exploiting convolutional neural networks for remote sensing scene classification","volume":"61","author":"Nogueira","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/JSTARS.2017.2761800","article-title":"Scene classification via triplet networks","volume":"11","author":"Liu","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5632","DOI":"10.1080\/01431161.2016.1246775","article-title":"Stacked Autoencoder-based deep learning for remote-sensing image classification: A case study of African land-cover mapping","volume":"37","author":"Li","year":"2016","journal-title":"Int. J. Remote Sens."},{"key":"ref_31","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhao, B., Cui, Q., Song, R., Qiu, Y., and Liang, J. (2022, January 18\u201324). Decoupled knowledge distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01165"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, C., Teng, X., Yan, D., and Lan, L. (2024, January 18\u201320). Instance-level Scaling and Dynamic Margin-alignment Knowledge Distillation. Proceedings of the 7th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2024), Urumqi, China. Accepted for presentation; proceedings not yet available.","DOI":"10.1007\/978-981-97-8795-1_12"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cortes, C. (1995). Support-Vector Networks. Mach. Learn.","DOI":"10.1007\/BF00994018"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman","year":"1992","journal-title":"Am. Stat."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 3\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chen, L., Yang, W., Xu, K., and Xu, T. (2011, January 11\u201313). Evaluation of local features for scene classification using VHR satellite images. Proceedings of the 2011 Joint Urban Remote Sensing Event, Munich, Germany.","DOI":"10.1109\/JURSE.2011.5764800"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Perronnin, F., and Dance, C. (2007, January 17\u201322). Fisher kernels on visual vocabularies for image categorization. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383266"},{"key":"ref_39","unstructured":"Yang, Y., and Newsam, S. (2011, January 6\u201313). Spatial pyramid co-occurrence for image classification. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2169","DOI":"10.1109\/CVPR.2006.68","article-title":"Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories","volume":"Volume 2","author":"Lazebnik","year":"2006","journal-title":"Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906)"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013spatial classification of hyperspectral data based on deep belief network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bosch, A., Zisserman, A., and Munoz, X. (2006, January 7\u201313). Scene classification via pLSA. Proceedings of the Computer Vision\u2013ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria. Proceedings, Part IV 9.","DOI":"10.1007\/11744085_40"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/LGRS.2009.2023536","article-title":"Semantic annotation of satellite images using latent Dirichlet allocation","volume":"7","author":"Lienou","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"6207","DOI":"10.1109\/TGRS.2015.2435801","article-title":"Scene classification based on the multifeature fusion probabilistic topic model for high spatial resolution remote sensing imagery","volume":"53","author":"Zhong","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2016). Wide residual networks. arXiv.","DOI":"10.5244\/C.30.87"},{"key":"ref_47","unstructured":"Adriana, R., Nicolas, B., Ebrahimi, K.S., Antoine, C., Carlo, G., and Yoshua, B. (2014). Fitnets: Hints for thin deep nets. arXiv."},{"key":"ref_48","unstructured":"Komodakis, N., and Zagoruyko, S. (2017, January 24\u201326). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. Proceedings of the ICLR, Toulon, France."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Chen, P., Liu, S., Zhao, H., and Jia, J. (2021, January 20\u201325). Distilling Knowledge via Knowledge Review. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00497"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Yim, J., Joo, D., Bae, J., and Kim, J. (2017, January 21\u201326). A gift from knowledge distillation: Fast optimization, network minimization and transfer learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.754"},{"key":"ref_51","first-page":"3830","article-title":"Asymmetric temperature scaling makes larger networks teach well again","volume":"35","author":"Li","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, C., Teng, X., Ding, Y., and Lan, L. (2024). NTCE-KD: Non-Target-Class-Enhanced Knowledge Distillation. Sensors, 24.","DOI":"10.3390\/s24113617"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"111915","DOI":"10.1016\/j.knosys.2024.111915","article-title":"Student-friendly knowledge distillation","volume":"296","author":"Yuan","year":"2024","journal-title":"Knowl.-Based Syst."},{"key":"ref_54","unstructured":"M\u00fcller, R., Kornblith, S., and Hinton, G.E. (2019). When does label smoothing help?. Adv. Neural Inf. Process. Syst., 32."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Yuan, L., Tay, F.E., Li, G., Wang, T., and Feng, J. (2020, January 14\u201319). Revisiting knowledge distillation via label smoothing regularization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00396"},{"key":"ref_56","unstructured":"Chandrasegaran, K., Tran, N.T., Zhao, Y., and Cheung, N.M. (2022, January 17\u201323). Revisiting label smoothing and knowledge distillation compatibility: What was missing?. Proceedings of the International Conference on Machine Learning. PMLR, Baltimore, MD, USA."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Li, C., Cheng, G., and Han, J. (2023). Boosting knowledge distillation via intra-class logit distribution smoothing. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TCSVT.2023.3327113"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Meng, Z., Li, J., Zhao, Y., and Gong, Y. (2019, January 12\u201317). Conditional teacher-student learning. Proceedings of the ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683438"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1109\/JPROC.2017.2675998","article-title":"Remote sensing image scene classification: Benchmark and state of the art","volume":"105","author":"Cheng","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep learning based feature selection for remote sensing scene classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Jin, Y., Wang, J., and Lin, D. (2023, January 17\u201324). Multi-Level Logit Distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.02325"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Sun, S., Ren, W., Li, J., Wang, R., and Cao, X. (2024). Logit Standardization in Knowledge Distillation. arXiv.","DOI":"10.1109\/CVPR52733.2024.01489"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Wei, S., Luo, C., and Luo, Y. (2024, January 17\u201321). Scaled Decoupled Distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.01512"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Park, W., Kim, D., Lu, Y., and Cho, M. (2019, January 15\u201320). Relational knowledge distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00409"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Heo, B., Kim, J., Yun, S., Park, H., Kwak, N., and Choi, J.Y. (2019, January 27\u201329). A comprehensive overhaul of feature distillation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00201"},{"key":"ref_67","unstructured":"Tian, Y., Krishnan, D., and Isola, P. (2020, January 30). Contrastive Representation Distillation. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Guo, Z., Yan, H., Li, H., and Lin, X. (2023, January 17\u201324). Class Attention Transfer Based Knowledge Distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01142"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/20\/3853\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:14:54Z","timestamp":1760112894000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/20\/3853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,17]]},"references-count":68,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["rs16203853"],"URL":"https:\/\/doi.org\/10.3390\/rs16203853","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,10,17]]}}}