{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T13:13:22Z","timestamp":1778073202855,"version":"3.51.4"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T00:00:00Z","timestamp":1778025600000},"content-version":"vor","delay-in-days":5,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST-109-2314-B-002-151-MY3"],"award-info":[{"award-number":["MOST-109-2314-B-002-151-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science Technology Council, Taiwan","award":["NSTC-114-2314-B-002-067-MY3"],"award-info":[{"award-number":["NSTC-114-2314-B-002-067-MY3"]}]},{"name":"Population Health Research Center from Featured Areas Research Center Program"},{"name":"Higher Education Sprout Project by the Ministry of Education in Taiwan","award":["NTU-114\u00a0L9004"],"award-info":[{"award-number":["NTU-114\u00a0L9004"]}]},{"name":"Development Center for Medical Devices"},{"DOI":"10.13039\/501100006477","name":"National Taiwan University","doi-asserted-by":"publisher","award":["115KKZA3T,1"],"award-info":[{"award-number":["115KKZA3T,1"]}],"id":[{"id":"10.13039\/501100006477","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006477","name":"National Taiwan University","doi-asserted-by":"publisher","award":["GTZ300"],"award-info":[{"award-number":["GTZ300"]}],"id":[{"id":"10.13039\/501100006477","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Background: Ovarian cancer represents the primary cause of mortality from gynecological malignancies among women. Treatment strategies for benign versus malignant ovarian tumors differ significantly, making accurate preoperative diagnosis essential for clinical decision-making. Traditional ultrasound diagnosis is highly operator-dependent, introducing subjectivity and variability. To improve diagnostic precision in ovarian tumor classification, we developed a multimodal deep learning system that combines ultrasound images with corresponding clinical text reports. Methods: We retrospectively analyzed 1342 ultrasound images from 1062 patients who received surgical treatment for ovarian tumors at National Taiwan University Hospital from 2011 to 2021. Patients were classified into benign (n\u2009=\u2009612) and malignant (including borderline, n\u2009=\u2009450) groups based on pathology. A multimodal deep learning architecture was developed, incorporating DenseNet-121 and Swin Transformer for image feature extraction and Bio-Clinical BERT for processing clinical text reports. The dataset was split using subject-level stratification with five-fold cross-validation and a 15% independent test set. Furthermore, an external validation cohort of 268 effective cases from 3 independent medical centers was utilized to evaluate the model\u2019s generalizability. Results: The multimodal model achieved superior performance at the subject level with 81.77% (95% CI: 75.89%, 86.48%) accuracy, 79.59% (95% CI: 70.57%, 86.38%) sensitivity, 83.81% (95% CI: 75.59%, 89.64%) specificity, and an area under the curve (AUC) of 0.88 (95% CI: 0.83, 0.93). In the external validation, the model maintained robust performance with an accuracy of 88.81%, sensitivity of 92.59%, and specificity of 84.96%, outperforming the International Ovarian Tumor Analysis Simple Rules (accuracy 86.4%). Integration of clinical text information significantly improved diagnostic performance compared to image-only models. Backward selection analysis revealed that both uterine findings and ovarian tumor descriptions contributed synergistically to the final diagnosis. Conclusions: This study successfully developed a multimodal deep learning model with diagnostic performance superior to traditional operator-dependent approaches. The model shows promise as a diagnostic tool for ovarian tumor classification, offering clinicians a way to improve preoperative diagnostic accuracy and enhance patient care quality.<\/jats:p>","DOI":"10.1093\/bib\/bbag224","type":"journal-article","created":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T11:32:12Z","timestamp":1776771132000},"source":"Crossref","is-referenced-by-count":0,"title":["Development of a novel multimodal deep learning approach to improve diagnostic precision in ovarian cancer"],"prefix":"10.1093","volume":"27","author":[{"given":"Po-Chun","family":"Chiu","sequence":"first","affiliation":[{"name":"Institute of Health Data Analytics and Statistics, College of Public Health, National Taiwan University , No. 17, Xu-Zhou Road, ZhongZheng District, Taipei City 100025 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chia-Yi","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, National Taiwan University Hospital Hsin-Chu Branch , No. 2, Sec. 1, Shengyi Rd., Zhubei City, Hsinchu County 302058 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heng-Cheng","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, College of Medicine, National Taiwan University , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225,","place":["Taiwan"]},{"name":"Department of Obstetrics and Gynecology, National Taiwan University Hospital , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi-Jou","family":"Tai","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, College of Medicine, National Taiwan University , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225,","place":["Taiwan"]},{"name":"Department of Obstetrics and Gynecology, National Taiwan University Hospital , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying-Cheng","family":"Chiang","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, National Taiwan University Hospital Hsin-Chu Branch , No. 2, Sec. 1, Shengyi Rd., Zhubei City, Hsinchu County 302058 ,","place":["Taiwan"]},{"name":"Department of Obstetrics and Gynecology, College of Medicine, National Taiwan University , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225,","place":["Taiwan"]},{"name":"Department of Obstetrics and Gynecology, National Taiwan University Hospital , No. 7, Chung Shan S. Rd., ZhongZheng Dist., Taipei City 100225 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3697-0386","authenticated-orcid":false,"given":"Tzu-Pin","family":"Lu","sequence":"additional","affiliation":[{"name":"Institute of Health Data Analytics and Statistics, College of Public Health, National Taiwan University , No. 17, Xu-Zhou Road, ZhongZheng District, Taipei City 100025 ,","place":["Taiwan"]},{"name":"Department of Public Health, College of Public Health, National Taiwan University , No. 17, Xu-Zhou Road, ZhongZheng District, Taipei City 100025,","place":["Taiwan"]},{"name":"National Institute of Environmental Health Sciences, National Health Research Institutes , No. 35, Keyan Road, Zhunan Town, Miaoli County 350401 ,","place":["Taiwan"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2026,5,6]]},"reference":[{"key":"2026050608264162900_ref1","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","article-title":"Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"71","author":"Sung","year":"2021","journal-title":"CA Cancer J Clin"},{"key":"2026050608264162900_ref2","doi-asserted-by":"publisher","first-page":"10","DOI":"10.3322\/caac.21871","article-title":"Cancer statistics, 2025","volume":"75","author":"Siegel","year":"2025","journal-title":"CA Cancer J Clin"},{"key":"2026050608264162900_ref3","doi-asserted-by":"publisher","first-page":"342","DOI":"10.3802\/jgo.2013.24.4.342","article-title":"Trends in incidence and survival outcome of epithelial ovarian cancer: 30-year national population-based registry in Taiwan","volume":"24","author":"Chiang","year":"2013","journal-title":"J Gynecol Oncol"},{"key":"2026050608264162900_ref4","doi-asserted-by":"publisher","first-page":"1376","DOI":"10.1016\/S0140-6736(13)62146-7","article-title":"Ovarian cancer","volume":"384","author":"Jayson","year":"2014","journal-title":"Lancet"},{"key":"2026050608264162900_ref5","doi-asserted-by":"publisher","first-page":"2295","DOI":"10.1001\/jama.2011.766","article-title":"Effect of screening on ovarian cancer mortality: the prostate, lung, colorectal and ovarian (PLCO) cancer screening randomized controlled trial","volume":"305","author":"Buys","year":"2011","journal-title":"Jama"},{"key":"2026050608264162900_ref6","volume-title":"Cancer Registry Annual Report, 2022 Taiwan","author":"Health Promotion Administration MoHaW","year":"2022"},{"key":"2026050608264162900_ref7","doi-asserted-by":"publisher","first-page":"1118","DOI":"10.21037\/gs-20-325","article-title":"Secondary and tertiary ovarian cancer recurrence: what is the best management?","volume":"9","author":"Garzon","year":"2020","journal-title":"Gland Surg"},{"key":"2026050608264162900_ref8","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1016\/j.ygyno.2016.11.019","article-title":"Worldwide comparison of ovarian cancer survival: histological group and stage at diagnosis (CONCORD-2)","volume":"144","author":"Matz","year":"2017","journal-title":"Gynecol Oncol"},{"key":"2026050608264162900_ref9","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/j.canlet.2011.01.026","article-title":"Chemotherapy in epithelial ovarian cancer","volume":"303","author":"Pignata","year":"2011","journal-title":"Cancer Lett"},{"key":"2026050608264162900_ref10","doi-asserted-by":"publisher","first-page":"803","DOI":"10.6004\/jnccn.2008.0060","article-title":"The role of cytoreductive\/debulking surgery in ovarian cancer","volume":"6","author":"Wakabayashi","year":"2008","journal-title":"J Natl Compr Cancer Netw"},{"key":"2026050608264162900_ref11","doi-asserted-by":"publisher","first-page":"550","DOI":"10.1055\/a-1912-5361","article-title":"Evaluation of adnexal masses: the IOTA concept","volume":"43","author":"Manegold-Brauer","year":"2022","journal-title":"Ultraschall Med"},{"key":"2026050608264162900_ref12","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1016\/j.ogc.2019.07.002","article-title":"The abnormal ovary: evolving concepts in diagnosis and management","volume":"46","author":"Hack","year":"2019","journal-title":"Obstet Gynecol Clin N Am"},{"key":"2026050608264162900_ref13","doi-asserted-by":"publisher","first-page":"g5920","DOI":"10.1136\/bmj.g5920","article-title":"Evaluating the risk of ovarian cancer before surgery using the ADNEX model to differentiate between benign, borderline, early and advanced stage invasive, and secondary metastatic tumours: prospective multicentre diagnostic study","volume":"349","author":"Van Calster","year":"2014","journal-title":"BMJ"},{"key":"2026050608264162900_ref14","doi-asserted-by":"publisher","first-page":"1415","DOI":"10.1016\/j.jacr.2018.07.004","article-title":"Ovarian-adnexal reporting lexicon for ultrasound: a white paper of the ACR ovarian-adnexal reporting and data system committee","volume":"15","author":"Andreotti","year":"2018","journal-title":"J Am Coll Radiol"},{"key":"2026050608264162900_ref15","doi-asserted-by":"publisher","first-page":"101662","DOI":"10.1016\/j.eclinm.2022.101662","article-title":"Artificial intelligence performance in image-based ovarian cancer identification: a systematic review and meta-analysis","volume":"53","author":"Xu","year":"2022","journal-title":"EClinicalMedicine"},{"key":"2026050608264162900_ref16","doi-asserted-by":"publisher","first-page":"2577","DOI":"10.1111\/jog.14818","article-title":"Application of artificial intelligence in gynecologic malignancies: a review","volume":"47","author":"Sone","year":"2021","journal-title":"J Obstet Gynaecol Res"},{"key":"2026050608264162900_ref17","doi-asserted-by":"publisher","first-page":"1486","DOI":"10.2174\/1573405618666220516122145","article-title":"Pattern classification for ovarian Tumors by integration of radiomics and deep learning features","volume":"18","author":"Liu","year":"2022","journal-title":"Curr Med Imaging"},{"key":"2026050608264162900_ref18","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-1249-7_29","volume-title":"A Convolutional Neural Network Approach for Detecting Malignancy of Ovarian Cancer, Advances in Intelligent Systems and Computing","author":"Mathur","year":"2021"},{"key":"2026050608264162900_ref19","doi-asserted-by":"publisher","first-page":"e179","DOI":"10.1016\/S2589-7500(21)00278-8","article-title":"Deep learning-enabled pelvic ultrasound images for accurate diagnosis of ovarian cancer in China: a retrospective, multicentre, diagnostic study","volume":"4","author":"Gao","year":"2022","journal-title":"Lancet Digit Health"},{"key":"2026050608264162900_ref20","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1002\/uog.23530","article-title":"Ultrasound image analysis using deep neural networks for discriminating between benign and malignant ovarian tumors: comparison with expert subjective assessment","volume":"57","author":"Christiansen","year":"2021","journal-title":"Ultrasound Obstet Gynecol"},{"key":"2026050608264162900_ref21","doi-asserted-by":"publisher","first-page":"424","DOI":"10.1166\/jmihi.2021.3298","article-title":"Ovarian tumor texture classification based on sparse auto-encoder network combined with multi-feature fusion and random Forest in ultrasound image","volume":"11","author":"Wang","year":"2021","journal-title":"J Medical Imaging Health Informatics"},{"key":"2026050608264162900_ref22","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3389\/fonc.2021.770683","article-title":"Application of deep convolutional neural networks for discriminating benign, borderline, and malignant serous ovarian Tumors from ultrasound images, Frontiers","volume":"11","author":"Wang","year":"2021","journal-title":"Oncology"},{"key":"2026050608264162900_ref23","volume-title":"Densely Connected Convolutional Networks","author":"Huang","year":"2018"},{"key":"2026050608264162900_ref24","volume-title":"Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows","author":"Liu","year":"2021"},{"key":"2026050608264162900_ref25","volume-title":"Publicly Available Clinical BERT Embeddings","author":"Alsentzer","year":"2019"},{"key":"2026050608264162900_ref26","doi-asserted-by":"publisher","first-page":"109403","DOI":"10.1016\/j.isci.2024.109403","article-title":"Multi-modality deep learning model reaches high prediction accuracy in the diagnosis of ovarian cancer","volume":"27","author":"Wang","year":"2024","journal-title":"iScience"},{"key":"2026050608264162900_ref27","doi-asserted-by":"publisher","DOI":"10.1007\/s12539-025-00789-1","article-title":"Subtype-HM: a novel cancer subtype identification method based on hypergraph learning and multi-omics data","author":"Wang","year":"2025","journal-title":"Interdiscip Sci"},{"key":"2026050608264162900_ref28","doi-asserted-by":"publisher","DOI":"10.1007\/s12539-025-00783-7","article-title":"HPCSMN: a classification method of chemotherapy sensitivity of hypopharyngeal cancer based on multimodal network","author":"Fu","year":"2025","journal-title":"Interdiscip Sci"},{"key":"2026050608264162900_ref29","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1007\/s12539-023-00562-2","article-title":"Utilization of deep convolutional neural networks for accurate chest X-ray diagnosis and disease detection","volume":"15","author":"Mann","year":"2023","journal-title":"Interdiscip Sci"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/27\/3\/bbag224\/68226542\/bbag224.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/27\/3\/bbag224\/68226542\/bbag224.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T12:26:49Z","timestamp":1778070409000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbag224\/8670386"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5]]},"references-count":29,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,3]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbag224","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,5]]},"published":{"date-parts":[[2026,5]]},"article-number":"bbag224"}}