{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,4]],"date-time":"2026-10-04T02:50:06Z","timestamp":1791082206553,"version":"4.1.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T00:00:00Z","timestamp":1602806400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T00:00:00Z","timestamp":1602806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study aimed to verify a deep convolutional neural network (CNN) algorithm to detect intussusception in children using a human-annotated data set of plain abdominal X-rays from affected children. From January 2005 to August 2019, 1449 images were collected from plain abdominal X-rays of patients\u2009\u2264\u20096\u00a0years old who were diagnosed with intussusception while 9935 images were collected from patients without intussusception from three tertiary academic hospitals (A, B, and C data sets). Single Shot MultiBox Detector and ResNet were used for abdominal detection and intussusception classification, respectively. The diagnostic performance of the algorithm was analysed using internal and external validation tests. The internal test values after training with two hospital data sets were 0.946 to 0.971 for the area under the receiver operating characteristic curve (AUC), 0.927 to 0.952 for the highest accuracy, and 0.764 to 0.848 for the highest Youden index. The values from external test using the remaining data set were all lower (P-value\u2009&lt;\u20090.001). The mean values of the internal test with all data sets were 0.935 and 0.743 for the AUC and Youden Index, respectively. Detection of intussusception by deep CNN and plain abdominal X-rays could aid in screening for intussusception in children.<\/jats:p>","DOI":"10.1038\/s41598-020-74653-1","type":"journal-article","created":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T10:02:55Z","timestamp":1602842575000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Deep learning algorithms for detecting and visualising intussusception on plain abdominal radiography in children: a retrospective multicenter study"],"prefix":"10.1038","volume":"10","author":[{"given":"Gitaek","family":"Kwon","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jongbin","family":"Ryu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaehoon","family":"Oh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jongwoo","family":"Lim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo-kyeong","family":"Kang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiwon","family":"Ahn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junwon","family":"Bae","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong Keon","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,10,16]]},"reference":[{"key":"74653_CR1","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1002\/bjs.1800790906","volume":"79","author":"MD Stringer","year":"1992","unstructured":"Stringer, M. D., Pablot, S. M. & Brereton, R. J. Paediatric intussusception. Br. J. Surg. 79, 867\u2013876 (1992).","journal-title":"Br. J. Surg."},{"key":"74653_CR2","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1542\/peds.106.6.1413","volume":"106","author":"UD Parashar","year":"2000","unstructured":"Parashar, U. D. et al. Trends in intussusception-associated hospitalizations and deaths among US infants. Pediatrics 106, 1413\u20131421 (2000).","journal-title":"Pediatrics"},{"key":"74653_CR3","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1542\/peds.2007-0035","volume":"120","author":"M Buettcher","year":"2007","unstructured":"Buettcher, M., Baer, G., Bonhoeffer, J., Schaad, U. B. & Heininger, U. Three-year surveillance of intussusception in children in Switzerland. Pediatrics 120, 473\u2013480 (2007).","journal-title":"Pediatrics"},{"key":"74653_CR4","doi-asserted-by":"publisher","first-page":"6476","DOI":"10.1002\/14651858.CD006476.pub3","volume":"6","author":"S Gluckman","year":"2017","unstructured":"Gluckman, S., Karpelowsky, J., Webster, A. C. & McGee, R. G. Management for intussusception in children. Cochrane Database Syst. Rev. 6, 6476. https:\/\/doi.org\/10.1002\/14651858.CD006476.pub3 (2017).","journal-title":"Cochrane Database Syst. Rev."},{"key":"74653_CR5","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1097\/PEC.0b013e31818c2a3e","volume":"24","author":"M Waseem","year":"2008","unstructured":"Waseem, M. & Rosenberg, H. Intussusception. Pediatr. Emerg. Care. 24, 793\u2013800 (2008).","journal-title":"Pediatr. Emerg. Care."},{"key":"74653_CR6","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1016\/j.acra.2017.01.002","volume":"24","author":"AG Carroll","year":"2017","unstructured":"Carroll, A. G. et al. Comparative effectiveness of imaging modalities for the diagnosis and treatment of intussusception: A critically appraised topic. Acad. Radiol. 24, 521\u2013529 (2017).","journal-title":"Acad. Radiol."},{"key":"74653_CR7","doi-asserted-by":"crossref","first-page":"255","DOI":"10.5847\/wjem.j.issn.1920-8642.2014.04.002","volume":"5","author":"SH Lam","year":"2014","unstructured":"Lam, S. H., Wise, A. & Yenter, C. Emergency bedside ultrasound for the diagnosis of pediatric intussusception: A retrospective review. World J. Emerg. Med. 5, 255\u2013258 (2014).","journal-title":"World J. Emerg. Med."},{"key":"74653_CR8","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1007\/s00247-009-1353-z","volume":"39","author":"AL Hryhorczuk","year":"2009","unstructured":"Hryhorczuk, A. L. & Strouse, P. J. Validation of US as a first-line diagnostic test for assessment of pediatric ileocolic intussusception. Pediatr. Radiol. 39, 1075\u20131079 (2009).","journal-title":"Pediatr. Radiol."},{"key":"74653_CR9","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/S0022-3476(05)81185-0","volume":"121","author":"DM Bhistkul","year":"1992","unstructured":"Bhistkul, D. M. et al. Clinical application of ultrasonography in the diagnosis of intussusception. J. Pediatr. 121, 182\u2013186 (1992).","journal-title":"J. Pediatr."},{"key":"74653_CR10","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.annemergmed.2012.02.007","volume":"60","author":"A Riera","year":"2012","unstructured":"Riera, A., Hsiao, A. L., Langhan, M. L., Goodman, T. R. & Chen, L. Diagnosis of intussusception by physician novice sonographers in the emergency department. Ann. Emerg. Med. 60, 264\u2013268 (2012).","journal-title":"Ann. Emerg. Med."},{"key":"74653_CR11","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1148\/radiographics.19.2.g99mr14299","volume":"19","author":"G Del-Pozo","year":"1999","unstructured":"Del-Pozo, G. et al. Intussusception in children: Current concepts in diagnosis and enema reduction. Radiographics 19, 299\u2013319 (1999).","journal-title":"Radiographics"},{"key":"74653_CR12","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1097\/00006565-199212000-00004","volume":"8","author":"DS Smith","year":"1992","unstructured":"Smith, D. S. et al. The role of abdominal x-rays in the diagnosis and management of intussusception. Pediatr. Emerg. Care. 8, 325\u2013327 (1992).","journal-title":"Pediatr. Emerg. Care."},{"key":"74653_CR13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/BF02017652","volume":"24","author":"MA Sargent","year":"1994","unstructured":"Sargent, M. A., Babyn, P. & Alton, D. J. Plain abdominal radiography in suspected intussusception: A reassessment. Pediatr. Radiol. 24, 17\u201320 (1994).","journal-title":"Pediatr. Radiol."},{"key":"74653_CR14","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"74653_CR15","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"74653_CR16","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"74653_CR17","doi-asserted-by":"publisher","first-page":"e1002697","DOI":"10.1371\/journal.pmed.1002697","volume":"15","author":"AG Taylor","year":"2018","unstructured":"Taylor, A. G., Mielke, C. & Mongan, J. Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: A retrospective study. PLoS Med. 15, e1002697. https:\/\/doi.org\/10.1371\/journal.pmed.1002697 (2018).","journal-title":"PLoS Med."},{"key":"74653_CR18","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1001\/archpedi.154.3.250","volume":"154","author":"N Kuppermann","year":"2000","unstructured":"Kuppermann, N., O\u2019Dea, T., Pinckney, L. & Hoecker, C. Predictors of intussusception in young children. Arch. Pediatr. Adolesc. Med. 154, 250\u2013255 (2000).","journal-title":"Arch. Pediatr. Adolesc. Med."},{"key":"74653_CR19","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1002\/bjs.7821","volume":"99","author":"L Samad","year":"2012","unstructured":"Samad, L. et al. Prospective surveillance study of the management of intussusception in UK and Irish infants. Br. J. Surg. 99, 411\u2013415 (2012).","journal-title":"Br. J. Surg."},{"key":"74653_CR20","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1111\/j.1742-6723.2007.00923.x","volume":"19","author":"AJ Blanch","year":"2007","unstructured":"Blanch, A. J., Perel, S. B. & Acworth, J. P. Paediatric intussusception: Epidemiology and outcome. Emerg. Med. Australas. 19, 45\u201350 (2007).","journal-title":"Emerg. Med. Australas."},{"key":"74653_CR21","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1016\/j.ajem.2019.06.006","volume":"37","author":"PY Tsou","year":"2019","unstructured":"Tsou, P. Y. et al. Accuracy of point-of-care ultrasound and radiology-performed ultrasound for intussusception: A systematic review and meta-analysis. Am. J. Emerg. Med. 37, 1760\u20131769 (2019).","journal-title":"Am. J. Emerg. Med."},{"key":"74653_CR22","doi-asserted-by":"crossref","first-page":"e296","DOI":"10.1542\/peds.2010-2432","volume":"127","author":"SN Weihmiller","year":"2011","unstructured":"Weihmiller, S. N., Buonomo, C. & Bachur, R. Risk stratification of children being evaluated for intussusception. Pediatrics 127, e296-303 (2011).","journal-title":"Pediatrics"},{"key":"74653_CR23","doi-asserted-by":"publisher","first-page":"19420","DOI":"10.1038\/s41598-019-55536-6","volume":"9","author":"S Kim","year":"2019","unstructured":"Kim, S. et al. Performance of deep learning-based algorithm for detection of ileocolic intussusception on abdominal radiographs of young children. Sci. Rep. 9, 19420. https:\/\/doi.org\/10.1038\/s41598-019-55536-6 (2019).","journal-title":"Sci. Rep."},{"key":"74653_CR24","doi-asserted-by":"crossref","first-page":"342","DOI":"10.2214\/AJR.18.20362","volume":"212","author":"PM Cheng","year":"2019","unstructured":"Cheng, P. M., Tran, K. N., Whang, G. & Tejura, T. K. Refining convolutional neural network detection of small-bowel obstruction in conventional radiography. AJR Am. J. Roentgenol. 212, 342\u2013350 (2019).","journal-title":"AJR Am. J. Roentgenol."},{"key":"74653_CR25","doi-asserted-by":"crossref","unstructured":"Liu, W. et al. SSD: Single shot multibox detector. arXiv:1512.02325 (2016).","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"74653_CR26","first-page":"1097","volume":"2012","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet classification with deep convolutional neural networks. Adv. Neural. Inf. Process Syst. 2012, 1097\u20131105 (2012).","journal-title":"Adv. Neural. Inf. Process Syst."},{"key":"74653_CR27","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2015)."},{"key":"74653_CR28","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. arXiv:1512.03385 (2015).","DOI":"10.1109\/CVPR.2016.90"},{"key":"74653_CR29","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. arXiv:1608.06993 (2018).","DOI":"10.1109\/CVPR.2017.243"},{"key":"74653_CR30","first-page":"248","volume":"564","author":"J Deng","year":"2009","unstructured":"Deng, J. et al. Imagenet: A large-scale hierarchical image database. Proc. IEEE Conf. Comput. Vis. Pattern Recogn. 564, 248\u2013255 (2009).","journal-title":"Proc. IEEE Conf. Comput. Vis. Pattern Recogn."},{"key":"74653_CR31","first-page":"2921","volume":"6070","author":"B Zhou","year":"2016","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Learning deep features for discriminative localization. Proc. IEEE Conf. Comput. Vis. Pattern Recogn. 6070, 2921\u20132929 (2016).","journal-title":"Proc. IEEE Conf. Comput. Vis. Pattern Recogn."},{"key":"74653_CR32","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1148\/radiol.2017171920","volume":"286","author":"SH Park","year":"2018","unstructured":"Park, S. H. & Han, K. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286, 800\u2013809 (2018).","journal-title":"Radiology"},{"key":"74653_CR33","doi-asserted-by":"crossref","DOI":"10.1201\/9781439800225","volume-title":"ROC Curves for Continuous Data","author":"WJ Krzanowski","year":"2009","unstructured":"Krzanowski, W. J. & Hand, D. ROC Curves for Continuous Data (Chapman and Hall, New York, 2009)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-74653-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-74653-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-74653-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T18:29:34Z","timestamp":1698258574000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-74653-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,16]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["74653"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-74653-1","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,16]]},"assertion":[{"value":"10 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"17582"}}