{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,30]],"date-time":"2026-08-30T05:16:22Z","timestamp":1788066982379,"version":"build-2784847793"},"reference-count":38,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T00:00:00Z","timestamp":1787875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["82130058"],"award-info":[{"award-number":["82130058"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"award":["82130058"],"award-info":[{"award-number":["82130058"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["7254541"],"award-info":[{"award-number":["7254541"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["L242063"],"award-info":[{"award-number":["L242063"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Research Cultivation Foundation of Capital Medical University","award":["PYZ24057"],"award-info":[{"award-number":["PYZ24057"]}]},{"award":["PYZ24057"],"award-info":[{"award-number":["PYZ24057"]}],"id":[{"id":"https:\/\/ror.org\/013xs5b60","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Multimodal learning has gained attention in recent years due to its ability to effectively utilize data features from various modalities. Diagnosing the vulnerability of atherosclerotic plaques directly from carotid 3D MRI images is challenging for both radiologists and conventional 3D vision networks. In clinical practice, radiologists assess patients using a multimodal approach that incorporates various imaging modalities and domain-specific expertise, paving the way for the creation of multimodal diagnostic networks. In this study, we proposed an effective framework to leverage radiologists\u2019 domain knowledge to improve the automated diagnosis of carotid plaque vulnerability through variational inference and multimodal knowledge distillation (VMD). This framework excels in harnessing cross-modality prior knowledge from limited image annotations and radiology reports within training data, thereby enhancing the diagnostic network\u2019s accuracy for unannotated 3D MRI images. We validated the proposed VMD framework on our in-house dataset, demonstrating its effectiveness.<\/jats:p>","DOI":"10.3390\/bioengineering13091005","type":"journal-article","created":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T18:33:52Z","timestamp":1787942032000},"page":"1005","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Annotation-Efficient Vulnerable Carotid Plaque Identification in 3D MRI: A Multimodal Knowledge-Transferred Framework"],"prefix":"10.3390","volume":"13","author":[{"given":"Bo","family":"Cao","sequence":"first","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"}]},{"given":"Yue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"}]},{"given":"Qun","family":"Gai","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]},{"given":"Mengze","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"given":"Fan","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]},{"given":"Mengmeng","family":"Feng","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"}]},{"given":"Senhao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"data-curation","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"given":"Jinxu","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"data-curation","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1522-9943","authenticated-orcid":false,"given":"Feng","family":"Shi","sequence":"additional","affiliation":[{"name":"Department of Research and Development, United Imaging Intelligence, Shanghai 200232, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"supervision","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0425-3921","authenticated-orcid":false,"given":"Jie","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine, Xuanwu Hospital Capital Medical University, Changchun Street No. 45, Beijing 100053, China"},{"name":"Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing 100053, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"872","DOI":"10.1002\/bjs.11136","article-title":"Contemporary prevalence of carotid stenosis in patients presenting with ischaemic stroke","volume":"106","author":"Cheng","year":"2019","journal-title":"J. Br. Surg."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1016\/S1474-4422(21)00252-0","article-title":"Global, regional, and national burden of stroke and its risk factors, 1990\u20132019: A systematic analysis for the Global Burden of Disease Study 2019","volume":"20","author":"Collaborators","year":"2021","journal-title":"Lancet Neurol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1016\/S0140-6736(04)16146-1","article-title":"Group MRCACSTC. Prevention of disabling and fatal strokes by successful carotid endarterectomy in patients without recent neurological symptoms: Randomised controlled trial","volume":"363","author":"Halliday","year":"2004","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0140-6736(03)12228-3","article-title":"Analysis of pooled data from the randomised controlled trials of endarterectomy for symptomatic carotid stenosis","volume":"361","author":"Rothwell","year":"2003","journal-title":"Lancet"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/S1474-4422(20)30484-1","article-title":"Risk of stroke in relation to degree of asymptomatic carotid stenosis: A population-based cohort study, systematic review, and meta-analysis","volume":"20","author":"Howard","year":"2021","journal-title":"Lancet Neurol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1016\/S1474-4422(19)30035-3","article-title":"Imaging biomarkers of vulnerable carotid plaques for stroke risk prediction and their potential clinical implications","volume":"18","author":"Saba","year":"2019","journal-title":"Lancet Neurol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1368","DOI":"10.1161\/01.CIR.0000028591.44554.F9","article-title":"Classification of human carotid atherosclerotic lesions with in vivo multicontrast magnetic resonance imaging","volume":"106","author":"Cai","year":"2002","journal-title":"Circulation"},{"key":"ref_8","first-page":"79","article-title":"Associations between carotid artery plaque burden, plaque characteristics, and cardiovascular events: The ARIC carotid magnetic resonance imaging study","volume":"6","author":"Brunner","year":"2021","journal-title":"JAMA Cardiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1426","DOI":"10.1016\/j.jacc.2021.01.038","article-title":"Atherosclerotic carotid plaque composition and incident stroke and coronary events","volume":"77","author":"Bos","year":"2021","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S1474-4422(21)00359-8","article-title":"Management of atherosclerotic extracranial carotid artery stenosis","volume":"21","author":"Bonati","year":"2022","journal-title":"Lancet Neurol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1002\/mrm.28794","article-title":"Domain adaptive and fully automated carotid artery atherosclerotic lesion detection using an artificial intelligence approach (LATTE) on 3D MRI","volume":"86","author":"Chen","year":"2021","journal-title":"Magn. Reson. Med."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015: 18th International Conference, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","article-title":"Unet++: Redesigning skip connections to exploit multiscale features in image segmentation","volume":"39","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H.R., and Xu, D. (2022). Unetr: Transformers for 3d medical image segmentation. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, IEEE.","DOI":"10.1109\/WACV51458.2022.00181"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102402","DOI":"10.1016\/j.compmedimag.2024.102402","article-title":"A 3D framework for segmentation of carotid artery vessel wall and identification of plaque compositions in multi-sequence MR images","volume":"116","author":"Wang","year":"2024","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5544","DOI":"10.1002\/mp.13739","article-title":"Deep morphology aided diagnosis network for segmentation of carotid artery vessel wall and diagnosis of carotid atherosclerosis on black-blood vessel wall MRI","volume":"46","author":"Wu","year":"2019","journal-title":"Med. Phys."},{"key":"ref_17","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_18","unstructured":"Tian, Y., Krishnan, D., and Isola, P. (2019). Contrastive representation distillation. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1038\/s41551-022-00936-9","article-title":"Expert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning","volume":"6","author":"Tiu","year":"2022","journal-title":"Nat. Biomed. Eng."},{"key":"ref_20","unstructured":"Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021, January 18\u201324). Learning transferable visual models from natural language supervision. Proceedings of the 38th International Conference on Machine Learning, Online."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Van Sonsbeek, T., Zhen, X., Worring, M., and Shao, L. (2021, January 28\u201330). Variational knowledge distillation for disease classification in chest X-Rays. Proceedings of the Information Processing in Medical Imaging: 27th International Conference, IPMI 2021, Virtual Event.","DOI":"10.1007\/978-3-030-78191-0_26"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yasunaga, M., Leskovec, J., and Liang, P. (2022, January 22\u201327). LinkBERT: Pretraining Language Models with Document Links. Proceedings of the Association for Computational Linguistics (ACL), Dublin, Ireland.","DOI":"10.18653\/v1\/2022.acl-long.551"},{"key":"ref_23","unstructured":"Huang, K., Altosaar, J., and Ranganath, R. (2019). Clinicalbert: Modeling clinical notes and predicting hospital readmission. arXiv."},{"key":"ref_24","unstructured":"van den Oord, A., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, Y., Xian, Y., Koepke, A., Shan, Y., and Akata, Z. (2021). Distilling audio-visual knowledge by compositional contrastive learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR46437.2021.00694"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, M., Xing, L., Wang, Y., and Zhang, Y. (2023). Enhanced Multimodal Representation Learning With Cross-Modal KD. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52729.2023.01132"},{"key":"ref_27","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ahn, S., Hu, S.X., Damianou, A., Lawrence, N.D., and Dai, Z. (2019, January 15\u201320). Variational Information Distillation for Knowledge Transfer. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00938"},{"key":"ref_29","unstructured":"Xu, Z., Gong, L., Ke, G., He, D., Zheng, S., Wang, L., Bian, J., and Liu, T.Y. (2020). Mc-bert: Efficient language pre-training via a meta controller. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Gao, J., Zhou, M., Wang, X., Qiao, Y., Zhang, S., and Wang, D. (2023, January 8\u201312). Text-guided Foundation Model Adaptation for Pathological Image Classification. Proceedings of the MICCAI, Vancouver, BC, Canada.","DOI":"10.1007\/978-3-031-43904-9_27"},{"key":"ref_31","first-page":"3483","article-title":"Learning structured output representation using deep conditional generative models","volume":"28","author":"Sohn","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"045033","DOI":"10.1088\/1361-6560\/abd4bb","article-title":"Cascaded residual U-net for fully automatic segmentation of 3D carotid artery in high-resolution multi-contrast MR images","volume":"66","author":"Zhu","year":"2021","journal-title":"Phys. Med. Biol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4483","DOI":"10.1109\/TMI.2024.3424884","article-title":"Carotid Vessel Wall Segmentation Through Domain Aligner, Topological Learning, and Segment Anything Model for Sparse Annotation in MR Images","volume":"43","author":"Li","year":"2024","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4S","DOI":"10.1016\/j.jvs.2021.04.073","article-title":"Society for Vascular Surgery clinical practice guidelines for management of extracranial cerebrovascular disease","volume":"75","author":"AbuRahma","year":"2022","journal-title":"J. Vasc. Surg."},{"key":"ref_35","unstructured":"Chen, S., Ma, K., and Zheng, Y. (2019). Med3d: Transfer learning for 3d medical image analysis. arXiv."},{"key":"ref_36","unstructured":"Zhang, N., Jia, Q., Yin, K., Dong, L., Gao, F., and Hua, N. (2020). Conceptualized Representation Learning for Chinese Biomedical Text Mining. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jia, M., Tang, L., Chen, B.C., Cardie, C., Belongie, S., Hariharan, B., and Lim, S.N. (2022, January 23\u201327). Visual Prompt Tuning. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19827-4_41"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual explanations from deep networks via gradient-based localization","volume":"128","author":"Selvaraju","year":"2020","journal-title":"Int. J. Comput. Vis."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/9\/1005\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,30]],"date-time":"2026-08-30T04:30:12Z","timestamp":1788064212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/9\/1005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,28]]},"references-count":38,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["bioengineering13091005"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering13091005","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,28]]}}}