{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T05:02:34Z","timestamp":1789707754394,"version":"4.0.1"},"reference-count":51,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T00:00:00Z","timestamp":1789084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Education Department of Guangxi Zhuang Autonomous Region through the Guangxi Higher Education Young and Middle-Aged Teachers\u2019 Basic Scientific Research Ability Enhancement Project","award":["2025KY0290"],"award-info":[{"award-number":["2025KY0290"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Compact deep models are attractive for medical image classification, but conventional knowledge distillation mainly transfers class-level predictions and may not adequately preserve lesion-relevant spatial cues. To address this limitation, we propose LaHKD, a lesion-aware hierarchical knowledge distillation framework for parameter-efficient medical image classification. LaHKD enables a lightweight student to learn hierarchical semantic representations together with lesion-focused guidance from a stronger teacher. We evaluate LaHKD on HAM10000 dermoscopic lesion classification and a brain tumor MRI classification benchmark. Across both datasets, LaHKD improves compact-student classification performance, with the clearest lesion-focused spatial benefits observed on HAM10000, where lesion morphology is central to diagnosis and direct lesion supervision is available. On the magnetic resonance imaging (MRI) benchmark, localization analysis is limited to an auxiliary recovered-mask subset and is therefore interpreted as exploratory; under this setting, consistent localization gains are not observed. Overall, LaHKD provides an effective framework for compact medical image classification, with spatial benefits most clearly supported in tasks with reliable lesion supervision.<\/jats:p>","DOI":"10.3390\/jimaging12090437","type":"journal-article","created":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T14:39:24Z","timestamp":1789137564000},"page":"437","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Improving Parameter-Efficient Medical Image Classification with Lesion-Aware Hierarchical Knowledge Distillation"],"prefix":"10.3390","volume":"12","author":[{"given":"Yarong","family":"Liu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China"},{"name":"Guangxi Key Laboratory of Embedded Technology and Intelligent System, Guilin University of Technology, Guilin 541006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Runmei","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolan","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China"},{"name":"Guangxi Key Laboratory of Embedded Technology and Intelligent System, Guilin University of Technology, Guilin 541006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huilin","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Guilin University of Technology, Guilin 541006, China"},{"name":"Guangxi Key Laboratory of Embedded Technology and Intelligent System, Guilin University of Technology, Guilin 541006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_3","unstructured":"Tan, M., and Le, Q.V. (2019, January 9\u201315). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning (ICML), Long Beach, CA, USA."},{"key":"ref_4","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An image is worth 16\u00d716 words: Transformers for image recognition at scale. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria."},{"key":"ref_5","unstructured":"Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., and J\u00e9gou, H. (2021, January 18\u201324). Training data-efficient image transformers & distillation through attention. Proceedings of the International Conference on Machine Learning (ICML), Online."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_7","unstructured":"Dai, Z., Liu, H., Le, Q.V., and Tan, M. (2021, January 6\u201314). CoAtNet: Marrying convolution and attention for all data sizes. Proceedings of the Neural Information Processing Systems (NeurIPS), Online."},{"key":"ref_8","unstructured":"Mehta, S., and Rastegari, M. (2022, January 25\u201329). MobileViT: Light-weight, general-purpose, and mobile-friendly vision transformer. Proceedings of the International Conference on Learning Representations (ICLR), Online."},{"key":"ref_9","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_10","unstructured":"Romero, A., Ballas, N., Kahou, S.E., Chassang, A., Gatta, C., and Bengio, Y. (2015, January 7\u20139). FitNets: Hints for thin deep nets. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_11","unstructured":"Zagoruyko, S., and Komodakis, N. (2017, January 24\u201326). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. Proceedings of the International Conference on Learning Representations (ICLR), Toulon, France."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Park, W., Kim, D., Lu, Y., and Cho, M. (2019, January 16\u201320). Relational knowledge distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00409"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, X., Cao, Q., Zhong, Y., Zhang, J., Gao, S., and Tao, D. (2022, January 18\u201324). DearKD: Data-efficient early knowledge distillation for vision transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01174"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhao, B., Song, R., and Liang, J. (2023, January 2\u20136). Cumulative spatial knowledge distillation for vision transformers. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Paris, France.","DOI":"10.1109\/ICCV51070.2023.00565"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, K., Zhang, J., Peng, H., Liu, M., Xiao, B., Fu, J., and Yuan, L. (2022, January 23\u201327). TinyViT: Fast pretraining distillation for small vision transformers. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19803-8_5"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"109430","DOI":"10.1016\/j.engappai.2024.109430","article-title":"HDKD: Hybrid data-efficient knowledge distillation network for medical image classification","volume":"138","author":"Hamed","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1007\/s10489-024-05274-8","article-title":"Lesion-aware knowledge distillation for diabetic retinopathy lesion segmentation","volume":"54","author":"Wang","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104041","DOI":"10.1016\/j.media.2026.104041","article-title":"Clinical priors-inspired privileged knowledge distillation for reliable pancreatic lesion classification","volume":"111","author":"Han","year":"2026","journal-title":"Med. Image Anal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"104857","DOI":"10.1016\/j.ipm.2026.104857","article-title":"Dynamic weighted knowledge distillation for skin lesion diagnosis","volume":"63","author":"Liu","year":"2026","journal-title":"Inf. Process. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chen, H., Ding, H., Jiang, Y., Lan, J., Li, K.C., Cheng, G.W.Y., Pu, Y., and Cai, J. (2025, January 15\u201318). REACT-KD: Region-Aware Cross-Modal Topological Knowledge Distillation for Interpretable Medical Image Classification. Proceedings of the 2025 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Wuhan, China.","DOI":"10.1109\/BIBM66473.2025.11357187"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201323). ShuffleNet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_23","unstructured":"Sen, T., Rahaman, G.M.A., and Saha, S. (2023, January 28\u201330). A lightweight CNN for brain tumor classification in resource-constrained settings. Proceedings of the International Conference on Digital Image Computing: Techniques and Applications (DICTA), Sydney, Australia. Available online: https:\/\/ieeexplore.ieee.org\/document\/11302430."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, W., Xie, E., Li, X., Fan, D.P., Song, K., Liang, D., Lu, T., Luo, P., and Shao, L. (2021, January 10\u201317). Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00061"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s41095-022-0274-8","article-title":"PVT v2: Improved baselines with pyramid vision transformer","volume":"8","author":"Wang","year":"2022","journal-title":"Comput. Vis. Media"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, Q., Shi, H., Wu, X., and Li, X. (2024, January 14\u201317). Dual-branch brain tumor classification based on CNN and Transformer. Proceedings of the IEEE 7th International Conference on Electronics, Information, and Communication Technologies (ICEICT), Harbin, China.","DOI":"10.1109\/ICEICT61637.2024.10670751"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ahn, S., Hu, S.X., Damianou, A., Lawrence, N.D., and Dai, Z. (2019, January 16\u201320). Variational information distillation for knowledge transfer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00938"},{"key":"ref_28","unstructured":"Tian, Y., Krishnan, D., and Isola, P. (May, January 26). Contrastive representation distillation. Proceedings of the International Conference on Learning Representations (ICLR), Online."},{"key":"ref_29","unstructured":"Mir, A.N., and Rizvi, D.R. (2025). Explainable Knowledge Distillation for Efficient Medical Image Classification. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zeng, X., Ji, Z., Zhang, H., Chen, R., Liao, Q., Wang, J., Lyu, T., and Zhao, L. (2024). DSP-KD: Dual-stage progressive knowledge distillation for skin disease classification. Bioengineering, 11.","DOI":"10.3390\/bioengineering11010070"},{"key":"ref_31","unstructured":"Khan, S.U.R., Bilal, O., Mistry, S., Deb, N., Mahmud, M., and Bhuyan, M. (July, January 30). KDLight: A Lightweight Knowledge Distillation Framework for Medical Image Classification. Proceedings of the 2025 International Joint Conference on Neural Networks (IJCNN), Rome, Italy."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"114711","DOI":"10.1016\/j.knosys.2025.114711","article-title":"Multi-teacher knowledge distillation and ensemble algorithm for efficient brain tumor classification in resource-constrained environments with explainable AI","volume":"330","author":"Alim","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, Y., Liu, X., Ma, X., and Kuang, H. (2026, January 20\u201322). MANO-UniDerm: A Lightweight Multimodal Skin Lesion Classification Framework Based on Multi-Scale Attention and Knowledge Distillation. Proceedings of the 2026 9th International Conference on Advanced Algorithms and Control Engineering (ICAACE), Jinan, China.","DOI":"10.1109\/ICAACE69793.2026.11509126"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Filho, F., Cunha, K., Papais, F., dos Santos, E., Mota, R., Bezerra, T., Medeiros, E., Borba, P., and Ren, T.I. (2026, January 8\u201311). DERMAE: Improving Skin Lesion Classification Through Conditioned Latent Diffusion and MAE Distillation. Proceedings of the 2026 IEEE 23rd International Symposium on Biomedical Imaging (ISBI), London, UK.","DOI":"10.1109\/ISBI61048.2026.11515461"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"39792","DOI":"10.1038\/s41598-025-23403-2","article-title":"Multi-stage knowledge distillation with layer fusion-based deep learning approach for skin cancer classification","volume":"15","author":"Pavel","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"115268","DOI":"10.1016\/j.asoc.2026.115268","article-title":"Agentic MobileViT: A stage-wise progressive transfer learning framework with knowledge stabilization for multi-dataset skin lesion classification","volume":"199","author":"Yousaf","year":"2026","journal-title":"Appl. Soft Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1109\/TMI.2019.2898414","article-title":"Attention to lesion: Lesion-aware convolutional neural network for retinal optical coherence tomography image classification","volume":"38","author":"Fang","year":"2019","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sevinc, A., Ucan, M., and Kaya, B. (2025). A Distillation Approach to Transformer-Based Medical Image Classification with Limited Data. Diagnostics, 15.","DOI":"10.3390\/diagnostics15070929"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Manivannan, S. (2026). Semi-supervised Learning with Online Knowledge Distillation for Skin Lesion Classification. J. Digit. Imaging, in press.","DOI":"10.1007\/s10278-026-01965-5"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ngan, K.H., Phelan, J., Townsend, J., and d\u2019Avila Garcez, A. (July, January 30). Symbolic Knowledge Extraction and Distillation into Convolutional Neural Networks to Improve Medical Image Classification. Proceedings of the 2024 International Joint Conference on Neural Networks (IJCNN), Yokohama, Japan.","DOI":"10.1109\/IJCNN60899.2024.10650683"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"110729","DOI":"10.1016\/j.compbiomed.2025.110729","article-title":"MTA-Net: Multi-scale triplet attention-aware network for multiclass skin lesion classification","volume":"196","author":"Gajera","year":"2025","journal-title":"Comput. Biol. Med."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"109766","DOI":"10.1016\/j.bspc.2026.109766","article-title":"Refining explainability in chest X-ray diagnostics with lesion-aware hybrid transformer and local similarity of integrated re-normalized attention map","volume":"119","author":"Shin","year":"2026","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"180161","DOI":"10.1038\/sdata.2018.161","article-title":"The HAM10000 Dataset, a Large Collection of Multi-Source Dermatoscopic Images of Common Pigmented Skin Lesions","volume":"5","author":"Tschandl","year":"2018","journal-title":"Sci. Data"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Datta, S.K., Shaikh, M.A., Srihari, S.N., and Gao, M. (2021). Soft-Attention Improves Skin Cancer Classification Performance. arXiv.","DOI":"10.31219\/osf.io\/hjp56"},{"key":"ref_45","unstructured":"Nickparvar, M. (2026, September 01). Brain Tumor MRI Dataset [Dataset]. Kaggle, 2021. Available online: https:\/\/www.kaggle.com\/datasets\/masoudnickparvar\/brain-tumor-mri-dataset."},{"key":"ref_46","unstructured":"Cheng, J. (2022). Brain Tumor Dataset, Science Data Bank. Version 1."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gayen, M., Das, S., and Bhattacharya, S. (2026, January 6\u20137). GraDeCAR: Gradual Denoising by Contrastive Agreement-based Relabeling for Tackling Label Noise in Medical Imaging. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision Workshops, Tucson, AZ, USA.","DOI":"10.1109\/WACVW68408.2026.00043"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Albahli, S. (2025). A Robust YOLOv8-Based Framework for Real-Time Melanoma Detection and Segmentation with Multi-Dataset Training. Diagnostics, 15.","DOI":"10.3390\/diagnostics15060691"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., and Pang, R. (November, January 27). Searching for MobileNetV3. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00140"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Radosavovic, I., Kosaraju, R.P., Girshick, R., He, K., and Doll\u00e1r, P. (2020, January 13\u201319). Designing Network Design Spaces. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01044"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Chen, C.-F.R., Fan, Q., and Panda, R. (2021, January 10\u201317). CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00041"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/9\/437\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T04:17:25Z","timestamp":1789705045000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/9\/437"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,11]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["jimaging12090437"],"URL":"https:\/\/doi.org\/10.3390\/jimaging12090437","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,11]]}}}