{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T06:36:10Z","timestamp":1788244570430,"version":"build-2803163510"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T00:00:00Z","timestamp":1578009600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T00:00:00Z","timestamp":1578009600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"funder":[{"name":"Basic Science Research Program through the National Research Foundation of Korea","award":["2017R1A2B4008517"],"award-info":[{"award-number":["2017R1A2B4008517"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Radiol"],"published-print":{"date-parts":[[2020,4]]},"DOI":"10.1007\/s00330-019-06589-8","type":"journal-article","created":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T12:02:51Z","timestamp":1578052971000},"page":"2346-2355","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Test-retest reproducibility of a deep learning\u2013based automatic detection algorithm for the chest radiograph"],"prefix":"10.1007","volume":"30","author":[{"given":"Hyungjin","family":"Kim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1884-3738","authenticated-orcid":false,"given":"Chang Min","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin Mo","family":"Goo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,1,3]]},"reference":[{"key":"6589_CR1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.1095","volume":"2","author":"EJ Hwang","year":"2019","unstructured":"Hwang EJ, Park S, Jin KN et al (2019) Development and validation of a deep learning based automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Netw Open 2:e191095","journal-title":"JAMA Netw Open"},{"key":"6589_CR2","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1148\/radiol.2018180237","volume":"290","author":"JG Nam","year":"2019","unstructured":"Nam JG, Park S, Hwang EJ et al (2019) Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 290:218\u2013228","journal-title":"Radiology"},{"key":"6589_CR3","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1148\/radiol.2018180921","volume":"291","author":"M Annarumma","year":"2019","unstructured":"Annarumma M, Withey SJ, Bakewell RJ, Pesce E, Goh V, Montana G (2019) Automated triaging of adult chest radiographs with deep artificial neural networks. Radiology 291:196\u2013202","journal-title":"Radiology"},{"key":"6589_CR4","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1148\/radiol.2018181422","volume":"290","author":"JA Dunnmon","year":"2019","unstructured":"Dunnmon JA, Yi D, Langlotz CP, Re C, Rubin DL, Lungren MP (2019) Assessment of convolutional neural networks for automated classification of chest radiographs. Radiology 290:537\u2013544","journal-title":"Radiology"},{"key":"6589_CR5","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1148\/radiol.2017162326","volume":"284","author":"P Lakhani","year":"2017","unstructured":"Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284:574\u2013582","journal-title":"Radiology"},{"key":"6589_CR6","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1093\/cid\/ciy967","volume":"69","author":"EJ Hwang","year":"2019","unstructured":"Hwang EJ, Park S, Jin KN et al (2019) Development and validation of a deep learning-based automatic detection algorithm for active pulmonary tuberculosis on chest radiographs. Clin Infect Dis 69:739\u2013747","journal-title":"Clin Infect Dis"},{"key":"6589_CR7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002686","volume":"15","author":"P Rajpurkar","year":"2018","unstructured":"Rajpurkar P, Irvin J, Ball RL et al (2018) Deep learning for chest radiograph diagnosis: a retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med 15:e1002686","journal-title":"PLoS Med"},{"key":"6589_CR8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0204155","volume":"13","author":"R Singh","year":"2018","unstructured":"Singh R, Kalra MK, Nitiwarangkul C et al (2018) Deep learning in chest radiography: detection of findings and presence of change. PLoS One 13:e0204155","journal-title":"PLoS One"},{"key":"6589_CR9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002697","volume":"15","author":"AG Taylor","year":"2018","unstructured":"Taylor AG, Mielke C, Mongan J (2018) Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: a retrospective study. PLoS Med 15:e1002697","journal-title":"PLoS Med"},{"key":"6589_CR10","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1148\/radiol.2015142202","volume":"277","author":"DC Sullivan","year":"2015","unstructured":"Sullivan DC, Obuchowski NA, Kessler LG et al (2015) Metrology standards for quantitative imaging biomarkers. Radiology 277:813\u2013825","journal-title":"Radiology"},{"key":"6589_CR11","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1097\/RTI.0000000000000389","volume":"34","author":"H Kim","year":"2019","unstructured":"Kim H, Goo JM, Ohno Y et al (2019) Effect of reconstruction parameters on the quantitative analysis of chest computed tomography. J Thorac Imaging 34:92\u2013102","journal-title":"J Thorac Imaging"},{"key":"6589_CR12","doi-asserted-by":"publisher","first-page":"505","DOI":"10.2214\/AJR.18.20018","volume":"212","author":"H Kim","year":"2019","unstructured":"Kim H, Park CM, Gwak J et al (2019) Effect of CT reconstruction algorithm on the diagnostic performance of radiomics models: a task-based approach for pulmonary subsolid nodules. AJR Am J Roentgenol 212:505\u2013512","journal-title":"AJR Am J Roentgenol"},{"key":"6589_CR13","doi-asserted-by":"publisher","first-page":"2124","DOI":"10.1007\/s00330-017-5171-7","volume":"28","author":"H Kim","year":"2018","unstructured":"Kim H, Park CM, Hwang EJ, Ahn SY, Goo JM (2018) Pulmonary subsolid nodules: value of semi-automatic measurement in diagnostic accuracy, diagnostic reproducibility and nodule classification agreement. Eur Radiol 28:2124\u20132133","journal-title":"Eur Radiol"},{"key":"6589_CR14","volume-title":"The chest x-ray: a survival guide","author":"G de Lacey","year":"2007","unstructured":"de Lacey G, Morley S, Berman L (2007) The chest x-ray: a survival guide, 1st edn. Saunders, Elsevier, Amsterdam","edition":"1"},{"key":"6589_CR15","doi-asserted-by":"publisher","first-page":"f1630","DOI":"10.1136\/bmj.f1630","volume":"346","author":"P Sedgwick","year":"2013","unstructured":"Sedgwick P (2013) Limits of agreement (Bland-Altman method). BMJ 346:f1630","journal-title":"BMJ"},{"key":"6589_CR16","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1177\/096228029900800204","volume":"8","author":"JM Bland","year":"1999","unstructured":"Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8:135\u2013160","journal-title":"Stat Methods Med Res"},{"key":"6589_CR17","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","volume":"15","author":"TK Koo","year":"2016","unstructured":"Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155\u2013163","journal-title":"J Chiropr Med"},{"key":"6589_CR18","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1148\/radiol.2018172361","volume":"288","author":"R Berenguer","year":"2018","unstructured":"Berenguer R, Pastor-Juan MDR, Canales-Vazquez J et al (2018) Radiomics of CT features may be nonreproducible and redundant: influence of CT acquisition parameters. Radiology 288:407\u2013415","journal-title":"Radiology"},{"key":"6589_CR19","doi-asserted-by":"crossref","unstructured":"Irvin J, Rajpurkar P, Ko M et al (2019) Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. arXiv:1901.07031 available via https:\/\/arxiv.org\/abs\/1901.07031.","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"6589_CR20","doi-asserted-by":"publisher","first-page":"34921","DOI":"10.1038\/srep34921","volume":"6","author":"L He","year":"2016","unstructured":"He L, Huang Y, Ma Z, Liang C, Liang C, Liu Z (2016) Effects of contrast-enhancement, reconstruction slice thickness and convolution kernel on the diagnostic performance of radiomics signature in solitary pulmonary nodule. Sci Rep 6:34921","journal-title":"Sci Rep"},{"key":"6589_CR21","doi-asserted-by":"publisher","first-page":"17913","DOI":"10.1038\/s41598-018-36421-0","volume":"8","author":"Y Li","year":"2018","unstructured":"Li Y, Lu L, Xiao M et al (2018) CT slice thickness and convolution kernel affect performance of a radiomic model for predicting EGFR status in non-small cell lung cancer: a preliminary study. Sci Rep 8:17913","journal-title":"Sci Rep"},{"key":"6589_CR22","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1148\/radiol.2018182294","volume":"290","author":"SH Park","year":"2019","unstructured":"Park SH (2019) Diagnostic case-control versus diagnostic cohort studies for clinical validation of artificial intelligence algorithm performance. Radiology 290:272\u2013273","journal-title":"Radiology"},{"key":"6589_CR23","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1145\/3134599","volume":"61","author":"I Goodfellow","year":"2018","unstructured":"Goodfellow I, McDaniel P, Papernot N (2018) Making machine learning robust against adversarial inputs. Commun ACM 61:56\u201366","journal-title":"Commun ACM"}],"container-title":["European Radiology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-019-06589-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00330-019-06589-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-019-06589-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,2]],"date-time":"2021-01-02T00:16:03Z","timestamp":1609546563000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00330-019-06589-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,3]]},"references-count":23,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,4]]}},"alternative-id":["6589"],"URL":"https:\/\/doi.org\/10.1007\/s00330-019-06589-8","relation":{},"ISSN":["0938-7994","1432-1084"],"issn-type":[{"value":"0938-7994","type":"print"},{"value":"1432-1084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,3]]},"assertion":[{"value":"22 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 October 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2019","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The scientific guarantor of this publication is Chang Min Park.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Guarantor"}},{"value":"The authors (H.K., C.M.P., and J.M.G.) received research grants from Lunit Inc. (Seoul, South Korea), which developed the deep learning\u2013based detection algorithm (Lunit INISIGHT for Chest Radiography) used in this study. However, Lunit Inc. had no role in the study design; in the collection, analysis, and interpretation of the data; in the writing of the report; and in the decision to submit the article for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"No complex statistical methods were necessary for this paper.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Statistics and biometry"}},{"value":"Written informed consent was waived by the Institutional Review Board.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"Institutional Review Board approval was obtained.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"\u2022 retrospective\u2022 diagnostic or prognostic study\u2022 performed at one institution","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Methodology"}}]}}