{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T18:24:24Z","timestamp":1771611864712,"version":"3.50.1"},"reference-count":47,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T00:00:00Z","timestamp":1674172800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003665","name":"National IT Industry Promotion Agency","doi-asserted-by":"publisher","award":["S0252-21-1001"],"award-info":[{"award-number":["S0252-21-1001"]}],"id":[{"id":"10.13039\/501100003665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:sec><jats:label\/><jats:p>Papillary thyroid carcinoma (PTC) is the most common endocrine carcinoma and has frequent recurrence instances. Although PTC recurrence has been predicted using predictors established using various features and techniques, its early detection is still challenging. To address this issue, it is aimed to develop a deep\u2010learning model that utilizes not only the initial medical records but also the thyroid function tests (TFTs) performed periodically post\u2010surgery. Herein, a novel multimodal prediction model, called the hybrid architecture for multimodal analysis (HAMA), that can analyze numeric and time\u2010series data simultaneously, is proposed. For quantitative evaluation, fourfold cross validation is conducted on data of 1613 PTC patients including 63 locoregional recurrence patients, and the HAMA is achieved the following performance: sensitivity (0.9688); specificity (0.9781); F1\u2010score (0.7943); and area under the receiver\u2010operating characteristic curve, AUROC (0.9863). Furthermore, a real\u2010time prediction simulation is conducted at 6\u2010month intervals by reconstructing the data of each patient into real\u2010time data. It is demonstrated in the real\u2010time simulation results that the HAMA predicts PTC recurrence at least 1.5\u2009years in advance by recalculating the recurrence probability using the additional follow\u2010up data. To the best of the knowledge, the HAMA is the first deep\u2010learning model to reflect continuous change in the physical condition of a patient post\u2010surgery.<\/jats:p><\/jats:sec>","DOI":"10.1002\/aisy.202200365","type":"journal-article","created":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T22:45:39Z","timestamp":1674254739000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Multimodal Neural Network for Recurrence Prediction of Papillary Thyroid Carcinoma"],"prefix":"10.1002","volume":"5","author":[{"given":"Geun-Hyeong","family":"Kim","sequence":"first","affiliation":[{"name":"Medical AI Research Team Chungbuk National University Hospital  Cheongju-si Chungcheongbuk-do 28644 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong-Hwa","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Endocrinology and Metabolism Department of Internal Medicine Chungbuk National University Hospital  Cheongju-si Chungcheongbuk-do 28644 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jee-Woo","family":"Choi","sequence":"additional","affiliation":[{"name":"Medical AI Research Team Chungbuk National University Hospital  Cheongju-si Chungcheongbuk-do 28644 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyun-Jeong","family":"Jeon","sequence":"additional","affiliation":[{"name":"Division of Endocrinology and Metabolism Department of Internal Medicine Chungbuk National University Hospital  Cheongju-si Chungcheongbuk-do 28644 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2311-9306","authenticated-orcid":false,"given":"Seung","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering Chungbuk National University Hospital  Cheongju-si Chungcheongbuk-do 28644 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2023,1,20]]},"reference":[{"key":"e_1_2_8_2_1","first-page":"209","volume":"71","author":"Sung H.","year":"2021","journal-title":"CA"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrendo.2016.110"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2016.0100"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/965212"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2015-009843"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2017.2719"},{"key":"e_1_2_8_8_1","volume-title":"SEER Cancer Statistics Review, 1975\u20132018","author":"Howlader N.","year":"2021"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2013.07.008"},{"key":"e_1_2_8_10_1","first-page":"5393","volume":"7","author":"Guo K.","year":"2014","journal-title":"Int. J. Clin. Exp. Pathol."},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2009.0110"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(03)12488-9"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.6004\/jnccn.2010.0093"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.6004\/jnccn.2014.0169"},{"key":"e_1_2_8_15_1","unstructured":"S. B.Edge Vol.7 Springer2010 p.97."},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1530\/eje.0.1380249"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/107327480000700302"},{"key":"e_1_2_8_18_1","first-page":"1088","volume":"102","author":"Hay I. D.","year":"1987","journal-title":"Surgery"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0039-6060(98)70034-0"},{"key":"e_1_2_8_20_1","first-page":"1050","volume":"114","author":"Hay I. D.","year":"1993","journal-title":"Surgery"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2021.635771"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-79139-8"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radi.2021.03.001"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-019-06098-8"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202200100"},{"key":"e_1_2_8_26_1","volume":"11","author":"Yu J.","year":"2020","journal-title":"Nat. Commun."},{"key":"e_1_2_8_27_1","first-page":"42","volume":"100","author":"Kim S. Y.","year":"2021","journal-title":"Medicine"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1245\/s10434-016-5594-4"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/cncy.21202"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.3348\/kjr.2011.12.1.1"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.4097\/kjae.2017.70.2.144"},{"key":"e_1_2_8_32_1","unstructured":"S.Ioffe C.Szegedy inInt. Conf. on Machine Learning PMLR 2015 pp.448\u2013456."},{"key":"e_1_2_8_33_1","volume":"30","author":"Vaswani A.","year":"2017","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"e_1_2_8_34_1","unstructured":"J.Devlin M.-W.Chang K.Lee K.Toutanova arXiv preprint arXiv:1810.04805 2018."},{"key":"e_1_2_8_35_1","unstructured":"J. L.Ba J. R.Kiros G. E.Hinton arXiv preprint arXiv:1607.06450 2016."},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/2042018820921019"},{"key":"e_1_2_8_37_1","doi-asserted-by":"crossref","unstructured":"D.Ho I. B. H.Tan M.Motani inProc. of the Conf. on Health Inference and Learning Association for Computing Machinery 2021 pp.204\u2013213.","DOI":"10.1145\/3450439.3451868"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3019989"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2019.00617"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2970836"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_8_42_1","first-page":"2250014","author":"Lin Y.","year":"2022","journal-title":"Int. J. Fin. Eng."},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2985418"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2019.06.048"},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2018.0046"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1210\/jc.2013-1412"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/07435800.2017.1319858"},{"key":"e_1_2_8_48_1","volume":"30","author":"Lundberg S. M.","year":"2017","journal-title":"Adv. Neural Inform. Process. Syst."}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202200365","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/aisy.202200365","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202200365","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T21:12:18Z","timestamp":1759871538000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202200365"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,20]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["10.1002\/aisy.202200365"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202200365","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,20]]},"assertion":[{"value":"2022-10-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2200365"}}