{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T01:19:50Z","timestamp":1783559990224,"version":"3.55.0"},"reference-count":13,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2020,12,1]],"date-time":"2020-12-01T00:00:00Z","timestamp":1606780800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,1]],"date-time":"2020-12-01T00:00:00Z","timestamp":1606780800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100007210","name":"Varian Medical Systems","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100007210","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2021,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Generalizability is a concern when applying a deep learning (DL) model trained on one dataset to other datasets. It is challenging to demonstrate a DL model\u2019s generalizability efficiently and sufficiently before implementing the model in clinical practice. Training a universal model that works anywhere, anytime, for anybody is unrealistic. In this work, we demonstrate the generalizability problem, then explore potential solutions based on transfer learning by using the cone-beam computed tomography (CBCT) to computed tomography (CT) image conversion task as the testbed. Previous works only studied on one or two anatomical sites and used images from the same vendor\u2019s scanners. Here, we investigated how a model trained for one machine and one anatomical site works on other machines and other anatomical sites. We trained a model on CBCT images acquired from one vendor\u2019s scanners for head and neck cancer patients and applied it to images from another vendor\u2019s scanners and for prostate, pancreatic, and cervical cancer patients. We found that generalizability could be a significant problem for this particular application when applying a trained DL model to datasets from another vendor\u2019s scanners. We then explored three practical solutions based on transfer learning to solve this generalization problem: the target model, which is trained on a target dataset from scratch; the combined model, which is trained on both source and target datasets from scratch; and the adapted model, which fine-tunes the trained source model to a target dataset. We found that when there are sufficient data in the target dataset, all three models can achieve good performance. When the target dataset is limited, the adapted model works the best, which indicates that using the fine-tuning strategy to adapt the trained model to an unseen target dataset is a viable and easy way to implement DL models in the clinic.<\/jats:p>","DOI":"10.1088\/2632-2153\/abb214","type":"journal-article","created":{"date-parts":[[2020,8,24]],"date-time":"2020-08-24T22:45:23Z","timestamp":1598309123000},"page":"015007","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["Generalizability issues with deep learning models in medicine and their potential solutions: illustrated with cone-beam computed tomography (CBCT) to computed tomography (CT) image conversion"],"prefix":"10.1088","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2472-2396","authenticated-orcid":false,"given":"Xiao","family":"Liang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9590-0655","authenticated-orcid":false,"given":"Dan","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve B","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2020,12,1]]},"reference":[{"key":"mlstabb214bib1","doi-asserted-by":"publisher","first-page":"51","DOI":"10.5923\/j.ajsp.20150503.01","article-title":"Image quality assessment for defocused blur images","volume":"5","author":"Al-Obaidi","year":"2015","journal-title":"Am. J. Signal Process."},{"key":"mlstabb214bib2","author":"Bengio","year":"2012"},{"key":"mlstabb214bib3","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1148\/radiol.2019192515","article-title":"Assessing Radiology Research on Artificial Intelligence: A Brief Guide for Authors, Reviewers, and Readers\u2014From the Radiology Editorial Board","volume":"294","author":"David","year":"2020","journal-title":"Radiology"},{"key":"mlstabb214bib4","author":"Goodfellow","year":"2016"},{"key":"mlstabb214bib5","doi-asserted-by":"publisher","first-page":"3998","DOI":"10.1002\/mp.13656","article-title":"Paired cycle\u2010GAN based image correction for quantitative cone\u2010beam CT","volume":"46","author":"Harms","year":"2019","journal-title":"Med. Phys."},{"key":"mlstabb214bib6","article-title":"Cone-beam CT to Planning CT synthesis using generative adversarial networks","author":"Kida","year":"2019"},{"key":"mlstabb214bib7","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6560\/ab22f9","article-title":"Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy","volume":"64","author":"Liang","year":"2019","journal-title":"Phys. Med. Biol."},{"key":"mlstabb214bib8","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","article-title":"International evaluation of an AI system for breast cancer screening","volume":"577","author":"McKinney","year":"2020","journal-title":"Nature"},{"key":"mlstabb214bib9","article-title":"CheXpedition: investigating generalization challenges for translation of chest x-ray algorithms to the clinical setting","author":"Rajpurkar","year":"2020"},{"key":"mlstabb214bib10","author":"Reed","year":"1999"},{"key":"mlstabb214bib11","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: from error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"mlstabb214bib12","first-page":"1398","article-title":"Multiscale structural similarity for image quality assessment","volume":"vol 2","author":"Wang","year":"2003"},{"key":"mlstabb214bib13","doi-asserted-by":"publisher","first-page":"1526","DOI":"10.1002\/acm2.12717","article-title":"Quantifying the accuracy of deformable image registration for cone\u2010beam computed tomography with a physical phantom","volume":"20","author":"Wu","year":"2019","journal-title":"J. Appl. Clin. Med. Phys."}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214","content-type":"text\/html","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T10:18:00Z","timestamp":1641982680000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abb214"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,1]]},"references-count":13,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12,1]]},"published-print":{"date-parts":[[2021,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/abb214","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,1]]},"assertion":[{"value":"Generalizability issues with deep learning models in medicine and their potential solutions: illustrated with cone-beam computed tomography (CBCT) to computed tomography (CT) image conversion","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2020 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2020-04-16","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2020-08-24","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2020-12-01","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}