{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T11:22:37Z","timestamp":1777029757520,"version":"3.51.4"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,22]],"date-time":"2022-11-22T00:00:00Z","timestamp":1669075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,22]],"date-time":"2022-11-22T00:00:00Z","timestamp":1669075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002424","name":"Fujifilm Corporation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002424","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Lung cancer is the leading cause of cancer-related deaths throughout the world. Chest computed tomography (CT) is now widely used in the screening and diagnosis of lung cancer due to its effectiveness. Radiologists must identify each small nodule shadow from 3D volume images, which is very burdensome and often results in missed nodules. To address these challenges, we developed a computer-aided detection (CAD) system that automatically detects lung nodules in CT images.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A total of 1997 chest CT scans were collected for algorithm development. The algorithm was designed using deep learning technology. In addition to evaluating detection performance on various public datasets, its robustness to changes in radiation dose was assessed by a phantom study. To investigate the clinical usefulness of the CAD system, a reader study was conducted with 10 doctors, including inexperienced and expert readers. This study investigated whether the use of the CAD as a second reader could prevent nodular lesions in lungs that require follow-up examinations from being overlooked. Analysis was performed using the Jackknife Free-Response Receiver-Operating Characteristic (JAFROC).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The CAD system achieved sensitivity of 0.98\/0.96 at 3.1\/7.25 false positives per case on two public datasets. Sensitivity did not change within the range of practical doses for a study using a phantom. A second reader study showed that the use of this system significantly improved the detection ability of nodules that could be picked up clinically (p\u2009=\u20090.026).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We developed a deep learning-based CAD system that is robust to imaging conditions. Using this system as a second reader increased detection performance.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-022-00938-8","type":"journal-article","created":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T10:18:15Z","timestamp":1669198695000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Development and performance evaluation of a deep learning lung nodule detection system"],"prefix":"10.1186","volume":"22","author":[{"given":"Shichiro","family":"Katase","sequence":"first","affiliation":[]},{"given":"Akimichi","family":"Ichinose","sequence":"additional","affiliation":[]},{"given":"Mahiro","family":"Hayashi","sequence":"additional","affiliation":[]},{"given":"Masanaka","family":"Watanabe","sequence":"additional","affiliation":[]},{"given":"Kinka","family":"Chin","sequence":"additional","affiliation":[]},{"given":"Yuhei","family":"Takeshita","sequence":"additional","affiliation":[]},{"given":"Hisae","family":"Shiga","sequence":"additional","affiliation":[]},{"given":"Hidekatsu","family":"Tateishi","sequence":"additional","affiliation":[]},{"given":"Shiro","family":"Onozawa","sequence":"additional","affiliation":[]},{"given":"Yuya","family":"Shirakawa","sequence":"additional","affiliation":[]},{"given":"Koji","family":"Yamashita","sequence":"additional","affiliation":[]},{"given":"Jun","family":"Shudo","sequence":"additional","affiliation":[]},{"given":"Keigo","family":"Nakamura","sequence":"additional","affiliation":[]},{"given":"Akihito","family":"Nakanishi","sequence":"additional","affiliation":[]},{"given":"Kazunori","family":"Kuroki","sequence":"additional","affiliation":[]},{"given":"Kenichi","family":"Yokoyama","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,22]]},"reference":[{"issue":"3","key":"938_CR1","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","volume":"71","author":"H Sung","year":"2021","unstructured":"Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209\u201349.","journal-title":"CA Cancer J Clin"},{"issue":"5","key":"938_CR2","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1056\/NEJMoa1102873","volume":"365","author":"National Lung Screening Trial Research Team","year":"2011","unstructured":"National Lung Screening Trial Research Team. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365(5):395\u2013409.","journal-title":"N Engl J Med"},{"issue":"6","key":"938_CR3","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1056\/NEJMoa1911793","volume":"382","author":"HJ de Koning","year":"2020","unstructured":"de Koning HJ, van der Aalst CM, de Jong PA, Scholten ET, Nackaerts K, Heuvelmans MA, et al. Reduced lung-cancer mortality with volume CT screening in a randomized trial. N Engl J Med. 2020;382(6):503\u201313.","journal-title":"N Engl J Med"},{"issue":"1","key":"938_CR4","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1148\/radiol.2017161659","volume":"284","author":"H MacMahon","year":"2017","unstructured":"MacMahon H, Naidich DP, Goo JM, Lee KS, Leung ANC, Mayo JR, et al. Guidelines for management of incidental pulmonary nodules detected on CT images: from the Fleischner Society 2017. Radiology. 2017;284(1):228\u201343.","journal-title":"Radiology"},{"issue":"4","key":"938_CR5","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1200\/JCO.2002.20.4.911","volume":"20","author":"T Sobue","year":"2002","unstructured":"Sobue T, Moriyama N, Kaneko M, Kusumoto M, Kobayashi T, Tsuchiya R, et al. Screening for lung cancer with low-dose helical computed tomography: anti-lung cancer association project. J Clin Oncol. 2002;20(4):911\u201320.","journal-title":"J Clin Oncol"},{"key":"938_CR6","unstructured":"Royal College of Radiologists. Clinical radiology UK workforce census report; 2019. 2020."},{"issue":"4","key":"938_CR7","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/s11604-018-0724-5","volume":"36","author":"KK Kumamaru","year":"2018","unstructured":"Kumamaru KK, Machitori A, Koba R, Ijichi S, Nakajima Y, Aoki S. Global and Japanese regional variations in radiologist potential workload for computed tomography and magnetic resonance imaging examinations. Jpn J Radiol. 2018;36(4):273\u201381.","journal-title":"Jpn J Radiol"},{"key":"938_CR8","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 2012;25:1097\u2013105.","journal-title":"Adv Neural Inf Process Syst"},{"key":"938_CR9","doi-asserted-by":"crossref","unstructured":"Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2014. p. 580\u20137.","DOI":"10.1109\/CVPR.2014.81"},{"issue":"1","key":"938_CR10","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1007\/s00138-010-0271-2","volume":"23","author":"SLA Lee","year":"2012","unstructured":"Lee SLA, Kouzani AZ, Hu EJ. Automated detection of lung nodules in computed tomography images: a review. Mach Vis Appl. 2012;23(1):151\u201363.","journal-title":"Mach Vis Appl"},{"issue":"2","key":"938_CR11","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1111\/1759-7714.12931","volume":"10","author":"L Li","year":"2019","unstructured":"Li L, Liu Z, Huang H, Lin M, Luo D. Evaluating the performance of a deep learning-based computer-aided diagnosis (DL-CAD) system for detecting and characterizing lung nodules: Comparison with the performance of double reading by radiologists. Thorac Cancer. 2019;10(2):183\u201392.","journal-title":"Thorac Cancer"},{"issue":"7","key":"938_CR12","doi-asserted-by":"publisher","first-page":"3286","DOI":"10.21037\/qims-20-1356","volume":"11","author":"F Bianconi","year":"2021","unstructured":"Bianconi F, Fravolini ML, Pizzoli S, Palumbo I, Minestrini M, Rondini M, et al. Comparative evaluation of conventional and deep learning methods for semi-automated segmentation of pulmonary nodules on CT. Quant Imaging Med Surg. 2021;11(7):3286.","journal-title":"Quant Imaging Med Surg"},{"issue":"3","key":"938_CR13","doi-asserted-by":"publisher","first-page":"497","DOI":"10.2214\/AJR.18.20623","volume":"212","author":"C Hassani","year":"2019","unstructured":"Hassani C, Varghese BA, Nieva J, Duddalwar V. Radiomics in pulmonary lesion imaging. Am J Roentgenol. 2019;212(3):497\u2013504.","journal-title":"Am J Roentgenol"},{"key":"938_CR14","unstructured":"Liu J, Cao L, Akin O, Tian Y. Accurate and robust pulmonary nodule detection by 3D feature pyramid network with self-supervised feature learning. arXiv Preprint arXiv:190711704. 2019."},{"key":"938_CR15","doi-asserted-by":"crossref","unstructured":"Ding J, Li A, Hu Z, Wang L. Accurate pulmonary nodule detection in computed tomography images using deep convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention; 2017. p. 559\u201367.","DOI":"10.1007\/978-3-319-66179-7_64"},{"issue":"1","key":"938_CR16","doi-asserted-by":"publisher","first-page":"13657","DOI":"10.1038\/s41598-020-70629-3","volume":"10","author":"S Cui","year":"2020","unstructured":"Cui S, Ming S, Lin Y, Chen F, Shen Q, Li H, et al. Development and clinical application of deep learning model for lung nodules screening on CT images. Sci Rep. 2020;10(1):13657.","journal-title":"Sci Rep"},{"key":"938_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2020.108928","volume":"126","author":"B Fu","year":"2020","unstructured":"Fu B, Wang G, Wu M, Li W, Zheng Y, Chu Z, et al. Influence of CT effective dose and convolution kernel on the detection of pulmonary nodules in different artificial intelligence software systems: a phantom study. Eur J Radiol. 2020;126: 108928.","journal-title":"Eur J Radiol"},{"issue":"12","key":"938_CR18","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1016\/j.acra.2009.08.006","volume":"16","author":"B Sahiner","year":"2009","unstructured":"Sahiner B, Chan H-P, Hadjiiski LM, Cascade PN, Kazerooni EA, Chughtai AR, et al. Effect of CAD on radiologists\u2019 detection of lung nodules on thoracic CT scans: analysis of an observer performance study by nodule size. Acad Radiol. 2009;16(12):1518\u201330.","journal-title":"Acad Radiol"},{"issue":"3","key":"938_CR19","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1007\/s00330-009-1596-y","volume":"20","author":"JE Roos","year":"2010","unstructured":"Roos JE, Paik D, Olsen D, Liu EG, Chow LC, Leung AN, et al. Computer-aided detection (CAD) of lung nodules in CT scans: radiologist performance and reading time with incremental CAD assistance. Eur Radiol. 2010;20(3):549\u201357.","journal-title":"Eur Radiol"},{"key":"938_CR20","doi-asserted-by":"crossref","unstructured":"Rao RB, Bi J, Fung G, Salganicoff M, Obuchowski N, Naidich D. LungCAD: a clinically approved, machine learning system for lung cancer detection. In: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining; 2007. p. 1033\u20137.","DOI":"10.1145\/1281192.1281306"},{"issue":"3","key":"938_CR21","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.2019180084","volume":"1","author":"K Liu","year":"2019","unstructured":"Liu K, Li Q, Ma J, Zhou Z, Sun M, Deng Y, et al. Evaluating a fully automated pulmonary nodule detection approach and its impact on radiologist performance. Radiol Artif Intell. 2019;1(3): e180084.","journal-title":"Radiol Artif Intell"},{"issue":"2","key":"938_CR22","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1118\/1.3528204","volume":"38","author":"SG Armato","year":"2011","unstructured":"Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, et al. The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys. 2011;38(2):915\u201331.","journal-title":"Med Phys"},{"issue":"4","key":"938_CR23","doi-asserted-by":"publisher","DOI":"10.1117\/1.JMI.3.4.044506","volume":"3","author":"SG Armato","year":"2016","unstructured":"Armato SG, Drukker K, Li F, Hadjiiski L, Tourassi GD, Engelmann RM, et al. LUNGx challenge for computerized lung nodule classification. J Med Imaging. 2016;3(4): 044506.","journal-title":"J Med Imaging"},{"key":"938_CR24","unstructured":"Pedrosa J, Aresta G, Ferreira C, Rodrigues M, Leit\u00e3o P, Carvalho AS, et al. LNDb: a lung nodule database on computed tomography. arXiv Preprint arXiv:191108434. 2019."},{"issue":"6","key":"938_CR25","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39(6):1137\u201349.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"938_CR26","doi-asserted-by":"publisher","first-page":"1160","DOI":"10.1109\/TMI.2016.2536809","volume":"35","author":"AAA Setio","year":"2016","unstructured":"Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging. 2016;35(5):1160\u20139.","journal-title":"IEEE Trans Med Imaging"},{"key":"938_CR27","doi-asserted-by":"crossref","unstructured":"van Ginneken B, Armato SG, de Hoop B, van Amelsvoort-van de Vorst S, Duindam T, Niemeijer M, et al. Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image Anal. 2010;14(6):707\u201322.","DOI":"10.1016\/j.media.2010.05.005"},{"key":"938_CR28","unstructured":"Takagi T. X-sen CT Satsuei ni okeru Hyojunka (The Standerization of X-ray CT scanning). 2nd ed. Japanese Society of Radiological Technology Publishing Committee; 2015."},{"issue":"10","key":"938_CR29","doi-asserted-by":"publisher","first-page":"1187","DOI":"10.1016\/j.acra.2006.06.016","volume":"13","author":"DP Chakraborty","year":"2006","unstructured":"Chakraborty DP. Analysis of location specific observer performance data: validated extensions of the Jackknife Free-Response (JAFROC) method. Acad Radiol. 2006;13(10):1187\u201393.","journal-title":"Acad Radiol"},{"key":"938_CR30","doi-asserted-by":"crossref","unstructured":"Liu J, Cao L, Akin O, Tian Y. 3DFPN-HS2: 3D feature pyramid network based high sensitivity and specificity pulmonary nodule detection. In: International conference on medical image computing and computer-assisted intervention; 2019. p. 513\u201321.","DOI":"10.1007\/978-3-030-32226-7_57"},{"key":"938_CR31","unstructured":"Goodfellow IJ, Shlens J, Szegedy C. Explaining and harnessing adversarial examples. arXiv Preprint arXiv:14126572. 2014."},{"key":"938_CR32","unstructured":"Zhang R. Making convolutional networks shift-invariant again. In: International conference on machine learning. 2019. p. 7324\u201334."},{"issue":"8","key":"938_CR33","doi-asserted-by":"publisher","first-page":"2313","DOI":"10.1118\/1.1769352","volume":"31","author":"DP Chakraborty","year":"2004","unstructured":"Chakraborty DP, Berbaum KS. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys. 2004;31(8):2313\u201330.","journal-title":"Med Phys"},{"issue":"12","key":"938_CR34","first-page":"2844","volume":"75","author":"M Noguchi","year":"1995","unstructured":"Noguchi M, Morikawa A, Kawasaki M, Matsuno Y, Yamada T, Hirohashi S, et al. Small adenocarcinoma of the lung. Histol Charact Prognos Cancer. 1995;75(12):2844\u201352.","journal-title":"Histol Charact Prognos Cancer"},{"issue":"2","key":"938_CR35","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1378\/chest.07-1533","volume":"133","author":"T Hashizume","year":"2008","unstructured":"Hashizume T, Yamada K, Okamoto N, Saito H, Oshita F, Kato Y, et al. Prognostic significance of thin-section CT scan findings in small-sized lung adenocarcinoma. Chest. 2008;133(2):441\u20137.","journal-title":"Chest"},{"issue":"1","key":"938_CR36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-016-0028-x","volume":"7","author":"F Ciompi","year":"2017","unstructured":"Ciompi F, Chung K, Van Riel SJ, Setio AAA, Gerke PK, Jacobs C, et al. Towards automatic pulmonary nodule management in lung cancer screening with deep learning. Sci Rep. 2017;7(1):1\u201311.","journal-title":"Sci Rep"},{"issue":"6","key":"938_CR37","doi-asserted-by":"publisher","first-page":"954","DOI":"10.1038\/s41591-019-0447-x","volume":"25","author":"D Ardila","year":"2019","unstructured":"Ardila D, Kiraly AP, Bharadwaj S, Choi B, Reicher JJ, Peng L, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25(6):954\u201361.","journal-title":"Nat Med"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-022-00938-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-022-00938-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-022-00938-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T10:21:25Z","timestamp":1669198885000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-022-00938-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,22]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["938"],"URL":"https:\/\/doi.org\/10.1186\/s12880-022-00938-8","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,22]]},"assertion":[{"value":"22 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"For this retrospective study, approval was obtained from Kyorin University Ethics Committees and of all participating institutions, including data-collecting institutions, and the requirement for informed consent was waived. All methods were carried out in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"AI and KN are employees of Fujifilm Corporation (Minato-ku, Tokyo, Japan). Other authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"203"}}