{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T08:03:05Z","timestamp":1779955385153,"version":"3.53.1"},"reference-count":39,"publisher":"IOP Publishing","issue":"5","license":[{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["12404365"],"award-info":[{"award-number":["12404365"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Physiol. Meas."],"published-print":{"date-parts":[[2026,5,29]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective.<\/jats:italic>\n                    Heart failure is one of the leading causes of death worldwide, with millions of deaths each year, according to data from the World Health Organization and other public health agencies. While significant progress has been made in the field of heart failure, leading to improved survival rates and improvement of ejection fraction, there remains substantial unmet needs, due to the complexity and multifactorial characteristics. This study aims to propose and evaluate a composable strategy framework for assessment and treatment optimization in heart failure, designed to provide more holistic patient evaluation and management.\n                    <jats:italic>Approach.<\/jats:italic>\n                    The framework leverages multi-modal algorithms to analyze a comprehensive range of patient data, explicitly integrating cine cardiac magnetic resonance sequences, structured clinical metrics (e.g. lab results, demographics), and unstructured textual records (e.g. medical history, prescriptions). By integrating these various data sources, our framework offers a more holistic evaluation and optimized treatment plan for patients.\n                    <jats:italic>Main results.<\/jats:italic>\n                    The multi-modal framework demonstrates superior accuracy in HF prognosis prediction compared to single-modal AI algorithms. Additionally, it enables a detailed evaluation of the impact of various pathological indicators on HF outcomes.\n                    <jats:italic>Significance.<\/jats:italic>\n                    By integrating heterogeneous clinical data in a systematic manner, this approach supports more comprehensive prognosis assessment and facilitates optimized, personalized treatment planning for heart failure patients.\n                  <\/jats:p>","DOI":"10.1088\/1361-6579\/ae6f6c","type":"journal-article","created":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T22:54:49Z","timestamp":1779144889000},"page":"055020","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["A composable multimodal framework for cine CMR-text\u2013driven prediction of heart failure outcomes"],"prefix":"10.1088","volume":"47","author":[{"given":"Jianzhou","family":"Chen","sequence":"first","affiliation":[{"name":"Nanjing University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinyang","family":"Sun","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiumei","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xi","family":"Chen","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heyu","family":"Chu","sequence":"additional","affiliation":[{"name":"Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guo","family":"Song","sequence":"additional","affiliation":[{"name":"Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuji","family":"Luo","sequence":"additional","affiliation":[{"name":"Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1763-7070","authenticated-orcid":true,"given":"Xingping","family":"Zhou","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rong","family":"Gu","sequence":"additional","affiliation":[{"name":"Nanjing University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2026,5,28]]},"reference":[{"key":"pmeaae6f6cbib1","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1002\/ejhf.1628","type":"journal-article","article-title":"Improving risk prediction in heart failure using machine learning","volume":"22","author":"Adler","year":"2020","journal-title":"Eur. J. Heart Fail."},{"key":"pmeaae6f6cbib2","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1007\/978-3-031-46005-0_8","type":"book","article-title":"DAE-former: dual attention-guided efficient transformer for medical image segmentation","author":"Azad","year":"2023"},{"key":"pmeaae6f6cbib3","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2024.103280","type":"journal-article","article-title":"TransUNet: rethinking the U-net architecture design for medical image segmentation through the lens of transformers","volume":"97","author":"Chen","year":"2024","journal-title":"Med. Image Anal."},{"key":"pmeaae6f6cbib4","doi-asserted-by":"publisher","DOI":"10.1161\/circ.148.suppl_1.17773","type":"journal-article","article-title":"Abstract 17773: novel partition scores identify pathways implicated in clonal hematopoiesis of indeterminate potential (CHIP) mediated heart failure","volume":"148","author":"Chen","year":"2023","journal-title":"Circulation"},{"key":"pmeaae6f6cbib5","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102444","type":"journal-article","article-title":"Recent advances and clinical applications of deep learning in medical image analysis","volume":"79","author":"Chen","year":"2022","journal-title":"Med. Image Anal."},{"key":"pmeaae6f6cbib6","doi-asserted-by":"publisher","first-page":"4171","DOI":"10.18653\/v1\/N19-1423","type":"conference-proceedings","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2019"},{"key":"pmeaae6f6cbib7","doi-asserted-by":"publisher","first-page":"1833","DOI":"10.1161\/CIRCRESAHA.121.318224","type":"journal-article","article-title":"Leveraging machine learning and artificial intelligence to improve peripheral artery disease detection, treatment, and outcomes","volume":"128","author":"Flores","year":"2021","journal-title":"Circ. Res."},{"key":"pmeaae6f6cbib8","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1007\/s11897-015-0261-9","type":"journal-article","article-title":"Role of imaging techniques for diagnosis, prognosis and management of heart failure patients: cardiac magnetic resonance","volume":"12","author":"Gonzalez","year":"2015","journal-title":"Curr. Heart Fail. Rep."},{"key":"pmeaae6f6cbib9","doi-asserted-by":"publisher","first-page":"6191","DOI":"10.1109\/WACV56688.2023.00614","type":"conference-proceedings","article-title":"HiFormer: hierarchical multi-scale representations using transformers for medical image segmentation","author":"Heidari","year":"2023"},{"key":"pmeaae6f6cbib10","doi-asserted-by":"publisher","first-page":"3236","DOI":"10.1038\/s41591-024-03215-z","type":"journal-article","article-title":"A multi-modal single-cell and spatial expression map of metastatic breast cancer biopsies across clinicopathological features","volume":"30","author":"Klughammer","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib11","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1007\/s10741-024-10474-y","type":"journal-article","article-title":"Machine learning in predicting heart failure survival: a review of current models and future prospects","volume":"30","author":"Kokori","year":"2024","journal-title":"Heart Fail. Rev."},{"key":"pmeaae6f6cbib12","article-title":"BERT: a Review of Applications in natural language processing and understanding","author":"Koroteev","year":"2021","type":"preprint"},{"key":"pmeaae6f6cbib13","doi-asserted-by":"publisher","first-page":"2424","DOI":"10.1038\/s41591-023-02567-2","type":"journal-article","article-title":"Recent successes in heart failure treatment","volume":"29","author":"Lam","year":"2023","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib14","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1016\/j.jacc.2023.09.800","type":"journal-article","article-title":"Deep learning\u2013enabled assessment of left heart structure and function predicts cardiovascular outcomes","volume":"82","author":"Lau","year":"2023","journal-title":"J. Am. Coll. Cardiol."},{"key":"pmeaae6f6cbib15","doi-asserted-by":"publisher","first-page":"2886","DOI":"10.1038\/s41591-024-03139-8","type":"journal-article","article-title":"Integrated image-based deep learning and language models for primary diabetes care","volume":"30","author":"Li","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib16","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV48922.2021.00658","type":"preprint","article-title":"AdaAttN: revisit attention mechanism in arbitrary neural style transfer","author":"Liu","year":"2021"},{"key":"pmeaae6f6cbib17","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1038\/s41569-020-00504-1","type":"journal-article","article-title":"Diffuse myocardial fibrosis: mechanisms, diagnosis and therapeutic approaches","volume":"18","author":"L\u00f3pez","year":"2021","journal-title":"Nat. Rev. Cardiol."},{"key":"pmeaae6f6cbib18","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1038\/s41586-024-07618-3","type":"journal-article","article-title":"A multimodal generative AI copilot for human pathology","volume":"634","author":"Lu","year":"2024","journal-title":"Nature"},{"key":"pmeaae6f6cbib19","doi-asserted-by":"publisher","first-page":"euae267","DOI":"10.1093\/europace\/euae267","type":"journal-article","article-title":"Prediction of new-onset atrial fibrillation in patients with hypertrophic cardiomyopathy using plasma proteomics profiling","volume":"26","author":"Lumish","year":"2024","journal-title":"Europace"},{"key":"pmeaae6f6cbib20","doi-asserted-by":"publisher","first-page":"1056","DOI":"10.1161\/CIRCRESAHA.121.320548","type":"journal-article","article-title":"Therapeutic and prognostic significance of arachidonic acid in heart failure","volume":"130","author":"Ma","year":"2022","journal-title":"Circ. Res."},{"key":"pmeaae6f6cbib21","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1016\/j.repc.2021.07.015","type":"journal-article","article-title":"The MAGGIC risk score in the prediction of death or hospitalization in patients with heart failure: comparison with natriuretic peptides","volume":"41","author":"Mafort Rohen","year":"2022","journal-title":"Rev. Port. Cardiol."},{"key":"pmeaae6f6cbib22","doi-asserted-by":"publisher","first-page":"1143","DOI":"10.1038\/s41591-024-02843-9","type":"journal-article","article-title":"Identification of clinical disease trajectories in neurodegenerative disorders with natural language processing","volume":"30","author":"Mekkes","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib23","doi-asserted-by":"publisher","first-page":"3547","DOI":"10.1002\/ejhf.3547","type":"journal-article","article-title":"Machine learning approach to identify phenotypes in patients with ischaemic heart failure with reduced ejection fraction","volume":"27","author":"Monzo","year":"2024","journal-title":"Eur. J. Heart Fail."},{"key":"pmeaae6f6cbib24","doi-asserted-by":"publisher","first-page":"9186","DOI":"10.1038\/s41467-024-53387-y","type":"journal-article","article-title":"LLM-driven multimodal target volume contouring in radiation oncology","volume":"15","author":"Oh","year":"2024","journal-title":"Nat. Commun."},{"key":"pmeaae6f6cbib25","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1111\/bcp.15927","type":"journal-article","article-title":"From statistical inference to machine learning: a paradigm shift in contemporary cardiovascular pharmacotherapy","volume":"90","author":"Pavlov","year":"2024","journal-title":"Br. J. Clin. Pharmacol."},{"key":"pmeaae6f6cbib26","doi-asserted-by":"publisher","first-page":"3404","DOI":"10.1038\/s41467-022-31037-5","type":"journal-article","article-title":"Multimodal deep learning for Alzheimer\u2019s disease dementia assessment","volume":"13","author":"Qiu","year":"2022","journal-title":"Nat. Commun."},{"key":"pmeaae6f6cbib27","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","type":"journal-article","article-title":"AI in health and medicine","volume":"28","author":"Rajpurkar","year":"2022","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib28","doi-asserted-by":"publisher","first-page":"2349","DOI":"10.1038\/s41591-024-03019-1","type":"journal-article","article-title":"Multimodal assessment improves neuroprognosis performance in clinically unresponsive critical-care patients with brain injury","volume":"30","author":"Rohaut","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib29","doi-asserted-by":"publisher","first-page":"2183","DOI":"10.1002\/ejhf.3443","type":"journal-article","article-title":"Development and validation of a machine learning\u2010based approach to identify high\u2010risk diabetic cardiomyopathy phenotype","volume":"26","author":"Segar","year":"2024","journal-title":"Eur. J. Heart Fail."},{"key":"pmeaae6f6cbib30","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1146\/annurev-bioeng-071516-044442","type":"journal-article","article-title":"Deep learning in medical image analysis","volume":"19","author":"Shen","year":"2017","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"pmeaae6f6cbib31","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/P19-1032","type":"preprint","article-title":"Adaptive attention span in transformers","author":"Sukhbaatar","year":"2019"},{"key":"pmeaae6f6cbib32","type":"dataset","article-title":"Multimodal Post-Recovery Tracking Model","author":"Sun","year":"2026","unstructured":"Sun J Chen X 2026 Multimodal Post-Recovery Tracking Model GitHub (available at: https:\/\/github.com\/AlexSun111111\/Multimodal-Post-Recovery-Tracking-Model )"},{"key":"pmeaae6f6cbib33","article-title":"Joint multimodal learning with deep generative models","author":"Suzuki","year":"2016","type":"preprint"},{"key":"pmeaae6f6cbib34","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1038\/s41467-024-45879-8","type":"journal-article","article-title":"Large language models streamline automated machine learning for clinical studies","volume":"15","author":"Tayebi Arasteh","year":"2024","journal-title":"Nat. Commun."},{"key":"pmeaae6f6cbib35","doi-asserted-by":"publisher","first-page":"1962","DOI":"10.1038\/s41591-024-02993-w","type":"journal-article","article-title":"Prediction of recurrence risk in endometrial cancer with multimodal deep learning","volume":"30","author":"Volinsky-Fremond","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib36","doi-asserted-by":"publisher","first-page":"2977","DOI":"10.1038\/s41591-024-03118-z","type":"journal-article","article-title":"AI-based differential diagnosis of dementia etiologies on multimodal data","volume":"30","author":"Xue","year":"2024","journal-title":"Nat. Med."},{"key":"pmeaae6f6cbib37","doi-asserted-by":"publisher","DOI":"10.1161\/circ.148.suppl_1.16324","type":"journal-article","article-title":"Abstract 16324: a deep learning electrocardiogram model identifies risk of incident heart failure in patients with subclinical hypothyroidism","volume":"148","author":"Yagi","year":"2023","journal-title":"Circulation"},{"key":"pmeaae6f6cbib38","doi-asserted-by":"publisher","first-page":"nwae403","DOI":"10.1093\/nsr\/nwae403","type":"journal-article","article-title":"A survey on multimodal large language models","volume":"11","author":"Yin","year":"2024","journal-title":"Natl Sci. Rev."},{"key":"pmeaae6f6cbib39","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1109\/TMI.2024.3432531","type":"journal-article","article-title":"Multi-modal diagnosis of Alzheimer\u2019s disease using interpretable graph convolutional networks","volume":"44","author":"Zhou","year":"2025","journal-title":"IEEE Trans. Med. Imaging"}],"container-title":["Physiological Measurement"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T07:15:41Z","timestamp":1779952541000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6579\/ae6f6c"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,28]]},"references-count":39,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5,28]]},"published-print":{"date-parts":[[2026,5,29]]}},"URL":"https:\/\/doi.org\/10.1088\/1361-6579\/ae6f6c","relation":{},"ISSN":["0967-3334","1361-6579"],"issn-type":[{"value":"0967-3334","type":"print"},{"value":"1361-6579","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,28]]},"assertion":[{"value":"A composable multimodal framework for cine CMR-text\u2013driven prediction of heart failure outcomes","name":"article_title","label":"Article Title"},{"value":"Physiological Measurement","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2026 Institute of Physics and Engineering in Medicine. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2025-09-28","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-05-18","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-05-28","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}