{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T22:34:00Z","timestamp":1793054040583,"version":"4.5.0"},"reference-count":51,"publisher":"National Academy of Sciences","issue":"3","license":[{"start":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T00:00:00Z","timestamp":1704672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011322","name":"Macau University of Science and Technology Foundation","doi-asserted-by":"publisher","award":["0007\/2020\/AFJ 0070\/2020\/A2 0003\/2021\/AKP"],"award-info":[{"award-number":["0007\/2020\/AFJ 0070\/2020\/A2 0003\/2021\/AKP"]}],"id":[{"id":"10.13039\/501100011322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"MOST | National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["6220071694"],"award-info":[{"award-number":["6220071694"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2024,1,16]]},"abstract":"<jats:p>Aging in an individual refers to the temporal change, mostly decline, in the body\u2019s ability to meet physiological demands. Biological age (BA) is a biomarker of chronological aging and can be used to stratify populations to predict certain age-related chronic diseases. BA can be predicted from biomedical features such as brain MRI, retinal, or facial images, but the inherent heterogeneity in the aging process limits the usefulness of BA predicted from individual body systems. In this paper, we developed a multimodal Transformer\u2013based architecture with cross-attention which was able to combine facial, tongue, and retinal images to estimate BA. We trained our model using facial, tongue, and retinal images from 11,223 healthy subjects and demonstrated that using a fusion of the three image modalities achieved the most accurate BA predictions. We validated our approach on a test population of 2,840 individuals with six chronic diseases and obtained significant difference between chronological age and BA (AgeDiff) than that of healthy subjects. We showed that AgeDiff has the potential to be utilized as a standalone biomarker or conjunctively alongside other known factors for risk stratification and progression prediction of chronic diseases. Our results therefore highlight the feasibility of using multimodal images to estimate and interrogate the aging process.<\/jats:p>","DOI":"10.1073\/pnas.2308812120","type":"journal-article","created":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T15:17:28Z","timestamp":1704727048000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":35,"title":["Accurate estimation of biological age and its application in disease prediction using a multimodal image Transformer system"],"prefix":"10.1073","volume":"121","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9464-4426","authenticated-orcid":false,"given":"Jinzhuo","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Big Data and Biomedical AI, College of Future Technology, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5314-0195","authenticated-orcid":false,"given":"Yuanxu","family":"Gao","sequence":"additional","affiliation":[{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5972-8442","authenticated-orcid":false,"given":"Fangfei","family":"Wang","sequence":"additional","affiliation":[{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"},{"name":"Guangzhou National Laboratory, Guangzhou 510005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simiao","family":"Zeng","sequence":"additional","affiliation":[{"name":"Guangzhou Women and Children\u2019s Medical Center, Guangzhou Medical University, Guangzhou 510623, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiahui","family":"Li","sequence":"additional","affiliation":[{"name":"Guangzhou Women and Children\u2019s Medical Center, Guangzhou Medical University, Guangzhou 510623, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanpei","family":"Miao","sequence":"additional","affiliation":[{"name":"Dongguan People\u2019s Hospital, Southern Medical University, Dongguan 523059, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taorui","family":"Wang","sequence":"additional","affiliation":[{"name":"Guangzhou Women and Children\u2019s Medical Center, Guangzhou Medical University, Guangzhou 510623, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin","family":"Zeng","sequence":"additional","affiliation":[{"name":"Guangzhou National Laboratory, Guangzhou 510005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Baptista-Hon","sequence":"additional","affiliation":[{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivia","family":"Monteiro","sequence":"additional","affiliation":[{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8245-8620","authenticated-orcid":false,"given":"Taihua","family":"Guan","sequence":"additional","affiliation":[{"name":"Guangzhou National Laboratory, Guangzhou 510005, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linling","family":"Cheng","sequence":"additional","affiliation":[{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8207-4411","authenticated-orcid":false,"given":"Yuxing","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Big Data and Biomedical AI, College of Future Technology, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengchao","family":"Luo","sequence":"additional","affiliation":[{"name":"Department of Big Data and Biomedical AI, College of Future Technology, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8778-6111","authenticated-orcid":false,"given":"Ming","family":"Li","sequence":"additional","affiliation":[{"name":"National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5134-731X","authenticated-orcid":false,"given":"Jian-kang","family":"Zhu","sequence":"additional","affiliation":[{"name":"Institute of Advanced Biotechnology and School of Life Sciences, Southern University of Science and Technology, Shenzhen 518055, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Nie","sequence":"additional","affiliation":[{"name":"National Clinical Research Center for Kidney Diseases, State Key Laboratory for Organ Failure Research, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Big Data and Biomedical AI, College of Future Technology, Peking University, Beijing 100871, China"},{"name":"Macau Institute for AI in Medicine and Zhuhai People\u2019s Hospital and the First Affiliated Hospital of Faculty of Medicine, Macau University of Science and Technology, Macau 999087, China"},{"name":"Guangzhou National Laboratory, Guangzhou 510005, China"},{"name":"Dongguan People\u2019s Hospital, Southern Medical University, Dongguan 523059, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5221-8026","authenticated-orcid":false,"given":"Yong","family":"Zhou","sequence":"additional","affiliation":[{"name":"Clinical Research Institute, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 201620, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2024,1,8]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"publisher","DOI":"10.2147\/CIA.S134921"},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2017.03.046"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2019.11.062"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2020.630186"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.molcel.2012.10.016"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/mp.2017.62"},{"key":"e_1_3_4_7_2","unstructured":"T. B. Brown Language models are few-shot learners. arXiv [Preprint] (2020). https:\/\/doi.org\/10.48550\/arXiv.2005.14165 (Accessed 28 May 2020)."},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1136\/bjophthalmol-2021-319807"},{"key":"e_1_3_4_9_2","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1007\/978-3-030-32239-7_16","volume-title":"Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13\u201317, 2019, Proceedings, Part I","author":"Liu C.","year":"2019","unstructured":"C. Liu , \u201cBiological age estimated from retinal imaging: A novel biomarker of aging\u201d in Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13\u201317, 2019, Proceedings, Part I (Springer, 2019), pp. 138\u2013146."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42255-020-00270-x"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1038\/cr.2015.36"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrneurol.2012.227"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1093\/braincomms\/fcac212"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1093\/ageing\/afac062"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0209639"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/20552076231191044"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104622"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.3389\/fcvm.2021.730203"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.3389\/fcimb.2022.787143"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.phrs.2017.11.003"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.2337\/dci17-0026"},{"key":"e_1_3_4_22_2","article-title":"Lightgbm: A highly efficient gradient boosting decision tree","author":"Ke G.","year":"2017","unstructured":"G. Ke , \u201cLightgbm: A highly efficient gradient boosting decision tree\u201d in Advances in Neural Information Processing Systems 30 (Curran Associates, Long Beach, California, USA, 2017).","journal-title":"Advances in Neural Information Processing Systems 30"},{"key":"e_1_3_4_23_2","article-title":"A unified approach to interpreting model predictions","author":"Lundberg S. M.","year":"2017","unstructured":"S. M. Lundberg, S.-I. Lee, \u201cA unified approach to interpreting model predictions\u201d in Advances in Neural Information Processing Systems 30 (Curran Associates, Long Beach, California, USA, 2017).","journal-title":"Advances in Neural Information Processing Systems 30"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1002\/mef2.50"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2013-14-10-r115"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2017.10.001"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms9570"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2014-15-2-r24"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-018-1599-6"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.18632\/aging.100968"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1093\/gerona\/gly005"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.preteyeres.2017.01.001"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7580.2005.00395.x"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s004010051151"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000018350"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1097\/PRS.0b013e3181f95b2d"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1089\/tmj.2011.0089"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1002\/mef2.38"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12967-016-1046-y"},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1979.4310076"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2009.03.004"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.93.4.1591"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2020.3023284"},{"key":"e_1_3_4_44_2","doi-asserted-by":"crossref","unstructured":"Z. Liu \u201cSwin transformer v2: Scaling up capacity and resolution\u201d in IEEE Proceedings of the Conference on Computer Vision and Pattern Recognition (New Orleans Louisiana USA 2022) pp. 12009\u201312019.","DOI":"10.1109\/CVPR52688.2022.01170"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-023-02483-5"},{"key":"e_1_3_4_46_2","unstructured":"I. Loshchilov F. Hutter Decoupled weight decay regularization. arXiv [Preprint] (2017). https:\/\/doi.org\/10.48550\/arXiv.1711.05101 (Accessed 14 November 2017)."},{"key":"e_1_3_4_47_2","article-title":"Pytorch: An imperative style, high-performance deep learning library","author":"Paszke A.","year":"2019","unstructured":"A. Paszke , \u201cPytorch: An imperative style, high-performance deep learning library\u201d in Advances in Neural Information Processing Systems 32 (Vancouver, Canada, 2019).","journal-title":"Advances in Neural Information Processing Systems 32"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2018.00097"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2015.015"},{"key":"e_1_3_4_50_2","volume-title":"Statistical Methods in Cancer Research Volume II\u2013the Design and Analysis of Cohort Studies","author":"Breslow N. E.","year":"1986","unstructured":"N. E. Breslow, N. E. Day, Statistical Methods in Cancer Research Volume II\u2013the Design and Analysis of Cohort Studies (IARC Scientific Publications, 1986), vol. 1."},{"key":"e_1_3_4_51_2","unstructured":"J. Wang K. Zhang Multimodal-Biometric-Image. Github. https:\/\/github.com\/PKU-BDBA\/BioAge. Deposited 14 August 2023."}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2308812120","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T15:21:47Z","timestamp":1704727307000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2308812120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,8]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,1,16]]}},"alternative-id":["10.1073\/pnas.2308812120"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2308812120","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,8]]},"assertion":[{"value":"2023-06-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-12","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2308812120"}}