{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T05:02:02Z","timestamp":1789621322218,"version":"build-2803163510"},"reference-count":64,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T00:00:00Z","timestamp":1777680000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Development Plan of Jilin Province","award":["20230201082GX"],"award-info":[{"award-number":["20230201082GX"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biomimetics"],"abstract":"<jats:p>Multi-modal Magnetic Resonance Imaging (MRI) provides complementary information for clinical diagnosis, yet its large-scale storage, privacy sensitivity, and annotation cost pose significant challenges. Inspired by biological vision systems, which integrate multi-sensory inputs and compress experiences into compact memory representations, we propose a bio-inspired framework termed Contrast-Guided Multi-modal Dataset Distillation (CGMDD). In biological perception, different sensory channels observe the same environment from complementary perspectives, while hierarchical neural processing ensures perceptual consistency across modalities. Meanwhile, memory systems such as the associated medial temporal lobe structures consolidate redundant experiences into efficient representations for long-term storage. Motivated by these principles, CGMDD treats multi-modal MRI as multi-view perceptual signals and introduces a hierarchical cross-modal contrastive learning mechanism that enforces perceptual alignment across modalities, analogous to multi-level processing in the visual cortex. Furthermore, we design a dynamic dataset distillation strategy that mimics memory consolidation by compressing large-scale data into compact, informative synthetic representations through gradient-based optimization. The proposed framework jointly optimizes perceptual alignment and memory compression in an end-to-end manner, achieving a biologically plausible integration of perception and learning. Experimental results on two MRI datasets demonstrate that CGMDD can compress the original dataset to 5% of its size while maintaining competitive performance, even with only 30% of the labels. These findings highlight the effectiveness of bio-inspired mechanisms in building efficient, robust, and privacy-preserving computer vision systems.<\/jats:p>","DOI":"10.3390\/biomimetics11050314","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T01:12:09Z","timestamp":1777857129000},"page":"314","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Biologically Inspired Medical Multi-Modal Dataset Distillation via Contrast-Aware Alignment and Memory Compression"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-6488-1759","authenticated-orcid":false,"given":"Taoli","family":"Du","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6687-8377","authenticated-orcid":false,"given":"Ziming","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8824-6207","authenticated-orcid":false,"given":"Yue","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8045-0471","authenticated-orcid":false,"given":"Ming","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6490-9852","authenticated-orcid":false,"given":"Wenhui","family":"Li","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"},{"name":"School of Games, Jilin Animation Institute, Changchun 130013, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1146\/annurev-vision-082114-035447","article-title":"Deep neural networks: A new framework for modeling biological vision and brain information processing","volume":"1","author":"Kriegeskorte","year":"2015","journal-title":"Annu. Rev. Vis. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108058","DOI":"10.1016\/j.visres.2022.108058","article-title":"Deep neural networks and image classification in biological vision","volume":"197","author":"Leek","year":"2022","journal-title":"Vis. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"104157","DOI":"10.1016\/j.ijmedinf.2020.104157","article-title":"The impact of data entry structures on perceptions of individuals with chronic mental disorders and physical diseases towards health information sharing","volume":"141","author":"Esmaeilzadeh","year":"2020","journal-title":"Int. J. Med. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"106293","DOI":"10.1016\/j.cmpb.2021.106293","article-title":"Management of medical and health big data based on integrated learning-based health care system: A review and comparative analysis","volume":"209","author":"Ye","year":"2021","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1007\/s00500-014-1539-7","article-title":"Medical image protection using genetic algorithm operations","volume":"20","author":"Pareek","year":"2016","journal-title":"Soft Comput."},{"key":"ref_6","unstructured":"Dong, T., Zhao, B., and Lyu, L. (2022). Privacy for free: How does dataset condensation help privacy?. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_7","unstructured":"Faisal, F. (2023). Privacy-Preserving Synthetic Image Data Generation and Classification. [Ph.D. Thesis, The University of Manitoba]."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1109\/TPAMI.2023.3323376","article-title":"Dataset distillation: A comprehensive review","volume":"46","author":"Yu","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Gu, J., Liu, M., and Pan, D.Z. (2023). Delving into effective gradient matching for dataset condensation. Proceedings of the 2023 IEEE International Conference on Omni-Layer Intelligent Systems (COINS), IEEE.","DOI":"10.1109\/COINS57856.2023.10189244"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, B., and Bilen, H. (2023). Dataset condensation with distribution matching. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, IEEE.","DOI":"10.1109\/WACV56688.2023.00645"},{"key":"ref_11","unstructured":"Zhao, B., Mopuri, K.R., and Bilen, H. (2021). Dataset condensation with gradient matching. arXiv."},{"key":"ref_12","unstructured":"Nguyen, T., Chen, Z., and Lee, J. (2021, January 3\u20137). Dataset meta-learning from kernel ridge-regression. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wei, H., Ye, J., Li, J., and Wang, Y. (2023). Design and simulation of a hierarchical parallel distributed processing model for orientation selection based on primary visual cortex. Biomimetics, 8.","DOI":"10.3390\/biomimetics8030314"},{"key":"ref_14","unstructured":"Li, G., Togo, R., Ogawa, T., and Haseyama, M. (2022). Dataset distillation for medical dataset sharing. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, G., Togo, R., Ogawa, T., and Haseyama, M. (2020). Soft-label anonymous gastric x-ray image distillation. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), IEEE.","DOI":"10.1109\/ICIP40778.2020.9191357"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"107189","DOI":"10.1016\/j.cmpb.2022.107189","article-title":"Compressed gastric image generation based on soft-label dataset distillation for medical data sharing","volume":"227","author":"Li","year":"2022","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, Z., and Kainz, B. (2024). Image distillation for safe data sharing in histopathology. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-031-72117-5_43"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104058","DOI":"10.1016\/j.inffus.2025.104058","article-title":"SD-Fuse: An Image Structure-Driven Model for Multi-Focus Image Fusion","volume":"129","author":"Wang","year":"2025","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nie, D., Wang, L., Gao, Y., and Shen, D. (2016). Fully convolutional networks for multi-modality isointense infant brain image segmentation. Proceedings of the 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), IEEE.","DOI":"10.1109\/ISBI.2016.7493515"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102612","DOI":"10.1016\/j.media.2022.102612","article-title":"Cross-modal attention for multi-modal image registration","volume":"82","author":"Song","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ma, B., Li, J., Jin, Z., Zhang, W., Song, X., and Jin, B. (2025). Fine-grained image recognition with bio-inspired gradient-aware attention. Biomimetics, 10.","DOI":"10.3390\/biomimetics10120834"},{"key":"ref_22","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020). A simple framework for contrastive learning of visual representations. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_23","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_24","unstructured":"Ba, J., and Caruana, R. (2014). Do deep nets really need to be deep?. arXiv."},{"key":"ref_25","unstructured":"Wang, T., Zhu, J.Y., Torralba, A., and Efros, A.A. (2018). Dataset distillation. arXiv."},{"key":"ref_26","unstructured":"Bachem, O., Lucic, M., and Krause, A. (2017). Practical coreset constructions for machine learning. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cazenavette, G., Wang, T., Torralba, A., Efros, A.A., and Zhu, J.Y. (2022). Dataset distillation by matching training trajectories. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPRW56347.2022.00521"},{"key":"ref_28","unstructured":"Kim, J.H., Kim, J., Oh, S.J., Yun, S., Song, H., Jeong, J., Ha, J.W., and Song, H.O. (2022). Dataset condensation via efficient synthetic-data parameterization. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_29","unstructured":"Loo, N., Hasani, R., Lechner, M., and Rus, D. (2023). Dataset distillation with convexified implicit gradients. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_30","unstructured":"Cui, J., Wang, R., Si, S., and Hsieh, C.J. (2023). Scaling up dataset distillation to imagenet-1k with constant memory. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_31","first-page":"70033","article-title":"Frequency domain-based dataset distillation","volume":"36","author":"Shin","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_32","first-page":"5186","article-title":"Dataset distillation with infinitely wide convolutional networks","volume":"34","author":"Nguyen","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_33","first-page":"13877","article-title":"Efficient dataset distillation using random feature approximation","volume":"35","author":"Loo","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhao, G., Li, G., Qin, Y., and Yu, Y. (2023). Improved distribution matching for dataset condensation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52729.2023.00759"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Du, J., Jiang, Y., Tan, V.Y., Zhou, J.T., and Li, H. (2023). Minimizing the accumulated trajectory error to improve dataset distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52729.2023.00365"},{"key":"ref_36","unstructured":"Guo, Z., Wang, K., Cazenavette, G., Li, H., Zhang, K., and You, Y. (2023). Towards lossless dataset distillation via difficulty-aligned trajectory matching. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"67487","DOI":"10.52202\/075280-2950","article-title":"Sequential subset matching for dataset distillation","volume":"36","author":"Du","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2529","DOI":"10.1007\/s11263-023-01806-w","article-title":"When multi-focus image fusion networks meet traditional edge-preservation technology","volume":"131","author":"Wang","year":"2023","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","unstructured":"Huang, Z., Lin, L., Cheng, P., Peng, L., and Tang, X. (2022). Multi-modal brain tumor segmentation via missing modality synthesis and modality-level attention fusion. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Song, H., Ge, M., Wang, J., and Duan, H. (2025). Highlight What You Want: Weakly-Supervised Instance-Level Controllable Infrared-Visible Image Fusion. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV51701.2025.01174"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"113022","DOI":"10.1016\/j.patcog.2025.113022","article-title":"Infrared and Visible Image Fusion via Iterative Feature Decomposition and Deep Balanced Fusion","volume":"174","author":"Li","year":"2025","journal-title":"Pattern Recognit."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1109\/TIP.2026.3654370","article-title":"Rethinking Multi-Focus Image Fusion: An Input Space Optimisation View","volume":"35","author":"Wang","year":"2026","journal-title":"IEEE Trans. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"103064","DOI":"10.1016\/j.media.2023.103064","article-title":"Fusing modalities by multiplexed graph neural networks for outcome prediction from medical data and beyond","volume":"93","author":"Wang","year":"2024","journal-title":"Med. Image Anal."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H.R., and Xu, D. (2021). Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images. Proceedings of the International MICCAI Brainlesion Workshop, Springer.","DOI":"10.1007\/978-3-031-08999-2_22"},{"key":"ref_45","first-page":"12747","article-title":"Dynamic unary convolution in transformers","volume":"45","author":"Duan","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2974","DOI":"10.1609\/aaai.v37i3.25400","article-title":"Cross-modal contrastive learning for domain adaptation in 3d semantic segmentation","volume":"Volume 37","author":"Xing","year":"2023","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"111544","DOI":"10.1016\/j.patcog.2025.111544","article-title":"Multi-modal hypergraph contrastive learning for medical image segmentation","volume":"165","author":"Jing","year":"2025","journal-title":"Pattern Recognit."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","article-title":"GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification","volume":"321","author":"Diamant","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4646","DOI":"10.1007\/s11263-025-02409-3","article-title":"Multi-text guidance is important: Multi-modality image fusion via large generative vision-language model","volume":"133","author":"Wang","year":"2025","journal-title":"Int. J. Comput. Vis."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e232471","DOI":"10.1148\/radiol.232471","article-title":"Generating synthetic data for medical imaging","volume":"312","author":"Koetzier","year":"2024","journal-title":"Radiology"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"4590","DOI":"10.1007\/s11263-025-02398-3","article-title":"Parameter efficient fine-tuning for multi-modal generative vision models with m\u00f6bius-inspired transformation","volume":"133","author":"Duan","year":"2025","journal-title":"Int. J. Comput. Vis."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"112787","DOI":"10.1016\/j.patcog.2025.112787","article-title":"Semi-supervised crowd counting from unlabeled data","volume":"172","author":"Duan","year":"2026","journal-title":"Pattern Recognit."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"120393","DOI":"10.1016\/j.ins.2024.120393","article-title":"Wearable-based behaviour interpolation for semi-supervised human activity recognition","volume":"665","author":"Duan","year":"2024","journal-title":"Inf. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/S0933-3657(02)00050-7","article-title":"Confidentiality issues for medical data miners","volume":"26","author":"Berman","year":"2002","journal-title":"Artif. Intell. Med."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.future.2014.06.004","article-title":"A hybrid solution for privacy preserving medical data sharing in the cloud environment","volume":"43","author":"Yang","year":"2015","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.is.2014.05.004","article-title":"Collaborative and secure sharing of healthcare data in multi-clouds","volume":"48","author":"Fabian","year":"2015","journal-title":"Inf. Syst."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"11","DOI":"10.2310\/JIM.0b013e3181c9b2ea","article-title":"Technical and policy approaches to balancing patient privacy and data sharing in clinical and translational research","volume":"58","author":"Malin","year":"2010","journal-title":"J. Investig. Med."},{"key":"ref_60","unstructured":"Oord, A.v.d., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_62","unstructured":"Xu, Y., Lin, Z., Qiu, Y., Lu, C., and Li, Y.L. (2024). Low-rank similarity mining for multimodal dataset distillation. Proceedings of the International Conference on Machine Learning, ACM."},{"key":"ref_63","unstructured":"Zhao, Z., Wang, H., Wu, J., Shang, Y., Liu, G., and Yan, Y. (2025). Efficient multimodal dataset distillation via generative models. arXiv."},{"key":"ref_64","unstructured":"Choi, J., Mo, S., and Chae, M. (2026, January 24\u201328). Multimodal Dataset Distillation Made Simple by Prototype-Guided Data Synthesis. Proceedings of the Fourteenth International Conference on Learning Representations (ICLR), Rio de Janeiro, Brazil."}],"container-title":["Biomimetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-7673\/11\/5\/314\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T01:39:08Z","timestamp":1777858748000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-7673\/11\/5\/314"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,2]]},"references-count":64,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["biomimetics11050314"],"URL":"https:\/\/doi.org\/10.3390\/biomimetics11050314","relation":{},"ISSN":["2313-7673"],"issn-type":[{"value":"2313-7673","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,2]]}}}