{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T03:42:05Z","timestamp":1782790925536,"version":"3.54.5"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T00:00:00Z","timestamp":1744329600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T00:00:00Z","timestamp":1744329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000738","name":"U.S. Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging. Inform. med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This study aims to assess the impact of domain shift on chest X-ray classification accuracy and to analyze the influence of ground truth label quality and demographic factors such as age group, sex, and study year. We used a DenseNet121 model pre-trained MIMIC-CXR dataset for deep learning-based multi-label classification using ground truth labels from radiology reports extracted using the CheXpert and CheXbert Labeler. We compared the performance of the 14 chest X-ray labels on the MIMIC-CXR and Veterans Healthcare Administration chest X-ray dataset (VA-CXR). The validation of ground truth and the assessment of multi-label classification performance across various NLP extraction tools revealed that the VA-CXR dataset exhibited lower disagreement rates than the MIMIC-CXR datasets. Additionally, there were notable differences in AUC scores between models utilizing CheXpert and CheXbert. When evaluating multi-label classification performance across different datasets, minimal domain shift was observed in the unseen VA dataset, except for the label \u201cEnlarged Cardiomediastinum.\u201d The subgroup with the most significant variations in multi-label classification performance was study year. These findings underscore the importance of considering domain shift in chest X-ray classification tasks, paying particular attention to the temporality of the exam. Our study reveals the significant impact of domain shift and demographic factors on chest X-ray classification, emphasizing the need for improved transfer learning and robust model development. Addressing these challenges is crucial for advancing medical imaging research and improving patient care.<\/jats:p>","DOI":"10.1007\/s10278-025-01494-7","type":"journal-article","created":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T12:16:42Z","timestamp":1744373802000},"page":"484-499","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Domain Shift Analysis in Chest Radiographs Classification in a Veterans Healthcare Administration Population"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3697-5972","authenticated-orcid":false,"given":"Mayanka","family":"Chandrashekar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Goethert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Md Inzamam Ul","family":"Haque","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"McMahon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sayera","family":"Dhaubhadel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn","family":"Knight","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"Erdos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donna","family":"Reagan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caroline","family":"Taylor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Kuzmak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John Michael","family":"Gaziano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eileen","family":"McAllister","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren","family":"Costa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuk-Lam","family":"Ho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kelly","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suzanne","family":"Tamang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samah","family":"Fodeh-Jarad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olga S.","family":"Ovchinnikova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy C.","family":"Justice","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacob","family":"Hinkle","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ioana","family":"Danciu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,4,11]]},"reference":[{"key":"1494_CR1","doi-asserted-by":"crossref","unstructured":"Abi Rimmer. \u201cRadiologist shortage leaves patient care at risk, warns royal college\u201d. In: BMJ: British Medical Journal (Online) 359 (2017).","DOI":"10.1136\/bmj.j4683"},{"key":"1494_CR2","doi-asserted-by":"crossref","unstructured":"Giovanni Irmici et al. \u201cChest x-ray in emergency radiology: What artificial intelligence applications are available?\u201d In: Diagnostics 13.2 (2023), p. 216.","DOI":"10.3390\/diagnostics13020216"},{"key":"1494_CR3","doi-asserted-by":"crossref","unstructured":"Catherine M Jones et al. \u201cChest radiographs and machine learning\u2013Past, present and future\u201d. In: Journal of Medical Imaging and Radiation Oncology 65.5 (2021), pp. 538\u2013544.","DOI":"10.1111\/1754-9485.13274"},{"key":"1494_CR4","unstructured":"Arjun Soin et al. \u201cCheXstray: real-time multi-modal data concordance for drift detection in medical imaging AI\u201d. In: arXiv preprint arXiv:2202.02833 (2022)."},{"key":"1494_CR5","doi-asserted-by":"crossref","unstructured":"Ravidu Suien Rammuni Silva and Pumudu Fernando. \u201cAn extensive survey of machine learning based approaches on automated pathology detection in chest X-Rays\u201d. In: 2021 28th Conference of Open Innovations Association (FRUCT). IEEE. 2021, pp. 365\u2013373.","DOI":"10.23919\/FRUCT50888.2021.9347605"},{"key":"1494_CR6","doi-asserted-by":"crossref","unstructured":"Christos Matsoukas et al. \u201cWhat makes transfer learning work for medical images: Feature reuse & other factors\u201d. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 2022, pp. 9225\u20139234.","DOI":"10.1109\/CVPR52688.2022.00901"},{"key":"1494_CR7","doi-asserted-by":"crossref","unstructured":"Zhiyun Xue et al. \u201cCross dataset analysis of domain shift in cxr lung region detection\u201d. In: Diagnostics 13.6 (2023), p. 1068.","DOI":"10.3390\/diagnostics13061068"},{"key":"1494_CR8","doi-asserted-by":"crossref","unstructured":"Alistair EW Johnson et al. \u201cMIMIC-CXR-JPG, a large publicly available database of labeled chest radiographs\u201d. In: arXiv preprint arXiv:1901.07042 (2019).","DOI":"10.1038\/s41597-019-0322-0"},{"key":"1494_CR9","doi-asserted-by":"crossref","unstructured":"Akshay Smit et al. \u201cCheXbert: combining automatic labelers and expert annotations for accurate radiology report labeling using BERT\u201d. In: arXiv preprint arXiv:2004.09167 (2020).","DOI":"10.18653\/v1\/2020.emnlp-main.117"},{"key":"1494_CR10","doi-asserted-by":"crossref","unstructured":"Jeremy Irvin et al. \u201cChexpert: A large chest radiograph dataset with uncertainty labels and expert comparison\u201d. In: Proceedings of the AAAI conference on artificial intelligence. Vol. 33. 01. 2019, pp. 590\u2013597.","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"1494_CR11","doi-asserted-by":"crossref","unstructured":"Gao Huang et al. \u201cDensely connected convolutional networks\u201d. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017, pp. 4700\u20134708.","DOI":"10.1109\/CVPR.2017.243"},{"key":"1494_CR12","unstructured":"Md Inzamam Ul Haque et al. \u201cEffect of image resolution on automated classification of chest X-rays\u201d. In: Journal of Medical Imaging 10.4 (2023), pp. 044503\u2013044503."},{"key":"1494_CR13","doi-asserted-by":"crossref","unstructured":"Alistair EW Johnson et al. \u201cMIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports\u201d. In: Scientific data 6.1 (2019), p. 317.","DOI":"10.1038\/s41597-019-0322-0"},{"key":"1494_CR14","doi-asserted-by":"crossref","unstructured":"Chak Fong Chong et al. \u201cCategory-Wise Fine-Tuning for Image Multi-label Classification with Partial Labels\u201d. In: International Conference on Neural Information Processing. Springer. 2023, pp. 332\u2013345.","DOI":"10.1007\/978-981-99-8145-8_26"},{"key":"1494_CR15","unstructured":"Papers with Code - CheXpert Benchmark (Multi-Label Classification). https:\/\/paperswithcode.com\/sota\/multi-label-classification-on-chexpert."},{"key":"1494_CR16","doi-asserted-by":"crossref","unstructured":"Laleh Seyyed-Kalantari et al. \u201cCheXclusion: Fairness gaps in deep chest X-ray classifiers\u201d. In: BIOCOMPUTING 2021: proceedings of the Pacific symposium. World Scientific. 2020, pp. 232\u2013243.","DOI":"10.1142\/9789811232701_0022"},{"key":"1494_CR17","doi-asserted-by":"crossref","unstructured":"Pranav Rajpurkar and Matthew P Lungren. \u201cThe current and future state of AI interpretation of medical images\u201d. In: New England Journal of Medicine 388.21 (2023), pp. 1981\u20131990.","DOI":"10.1056\/NEJMra2301725"},{"key":"1494_CR18","doi-asserted-by":"crossref","unstructured":"Judy Wawira Gichoya et al. \u201cAI recognition of patient race in medical imaging: a modelling study\u201d. In: The Lancet Digital Health 4.6 (2022), e406\u2013e414.","DOI":"10.1016\/S2589-7500(22)00063-2"},{"key":"1494_CR19","doi-asserted-by":"crossref","unstructured":"Bangul Khan et al. \u201cDrawbacks of artificial intelligence and their potential solutions in the healthcare sector\u201d. In: Biomedical Materials & Devices 1.2 (2023), pp. 731\u2013738.","DOI":"10.1007\/s44174-023-00063-2"},{"key":"1494_CR20","doi-asserted-by":"publisher","first-page":"1399","DOI":"10.1038\/s41551-022-00936-9","volume":"6","author":"E Tiu","year":"2022","unstructured":"E Tiu et al. \u201cExpert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning\u201d. In: Nature Biomed. Eng. 6 (2022), pp. 1399\u20131406.","journal-title":"Nature Biomed. Eng."},{"key":"1494_CR21","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","volume":"616","author":"M Moor","year":"2023","unstructured":"M Moor et al. \u201cFoundation models for generalist medical artificial intelligence\u201d. In: Nature 616 (2023), pp. 259\u2013265.","journal-title":"Nature"},{"key":"1494_CR22","unstructured":"Aravind Sasidharan Pillai. \u201cMulti-label chest X-ray classification via deep learning\u201d. In: arXiv preprint arXiv:2211.14929 (2022)."},{"key":"1494_CR23","unstructured":"Knight, Kathryn and Danciu, Ioana and Ovchinnikova, Olga and Hinkle, Jacob and Shekar, Mayanka Chandra and Mukherjee, Debangshu and McAllister, Eileen and Rizy, Caitlin and Cho, Kelly and Justice, Amy C and others. \u201cVISION: Toward a Standardized Process for Radiology Image Management at the National Level\u201d. In: arXiv preprint arXiv:2404.18842 (2024)."}],"container-title":["Journal of Imaging Informatics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-025-01494-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-025-01494-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-025-01494-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T18:46:45Z","timestamp":1771526805000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-025-01494-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,11]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["1494"],"URL":"https:\/\/doi.org\/10.1007\/s10278-025-01494-7","relation":{},"ISSN":["2948-2933"],"issn-type":[{"value":"2948-2933","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,11]]},"assertion":[{"value":"30 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"This study was approved by the VA Central Institutional Review Board (IRB).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}}]}}