{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T04:06:05Z","timestamp":1793073965584,"version":"4.5.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100013373","name":"NIHR Oxford Biomedical Research Centre","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100013373","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100009729","name":"Ludwig Institute for Cancer Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009729","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000266","name":"RCUK | Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/M013774\/1 Seebibyte"],"award-info":[{"award-number":["EP\/M013774\/1 Seebibyte"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009729","name":"Ludwig Institute for Cancer Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009729","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vision methods applied to endoscopy and promoting the development of new approaches suitable for clinical translation. Endoscopy is a routine imaging technique for the detection, diagnosis and treatment of diseases in hollow-organs; the esophagus, stomach, colon, uterus and the bladder. However the nature of these organs prevent imaged tissues to be free of imaging artefacts such as bubbles, pixel saturation, organ specularity and debris, all of which pose substantial challenges for any quantitative analysis. Consequently, the potential for improved clinical outcomes through quantitative assessment of abnormal mucosal surface observed in endoscopy videos is presently not realized accurately. The EAD challenge promotes awareness of and addresses this key bottleneck problem by investigating methods that can accurately classify, localize and segment artefacts in endoscopy frames as critical prerequisite tasks. Using a diverse curated multi-institutional, multi-modality, multi-organ dataset of video frames, the accuracy and performance of 23 algorithms were objectively ranked for artefact detection and segmentation. The ability of methods to generalize to unseen datasets was also evaluated. The best performing methods (top 15%) propose deep learning strategies to reconcile variabilities in artefact appearance with respect to size, modality, occurrence and organ type. However, no single method outperformed across all tasks. Detailed analyses reveal the shortcomings of current training strategies and highlight the need for developing new optimal metrics to accurately quantify the clinical applicability of methods.<\/jats:p>","DOI":"10.1038\/s41598-020-59413-5","type":"journal-article","created":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T06:07:02Z","timestamp":1581919622000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy"],"prefix":"10.1038","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1313-3542","authenticated-orcid":false,"given":"Sharib","family":"Ali","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8534-6873","authenticated-orcid":false,"given":"Barbara","family":"Braden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Bailey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2128-5370","authenticated-orcid":false,"given":"Suhui","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanju","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengyi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqiong","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maxime","family":"Kayser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0712-0534","authenticated-orcid":false,"given":"Roger D.","family":"Soberanis-Mukul","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2157-2211","authenticated-orcid":false,"given":"Shadi","family":"Albarqouni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaokang","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunqing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seiryo","family":"Watanabe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6478-0534","authenticated-orcid":false,"given":"Ilkay","family":"Oksuz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingtian","family":"Ning","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0531-2903","authenticated-orcid":false,"given":"Shufan","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Azam","family":"Khan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohong W.","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefano","family":"Realdon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maxim","family":"Loshchenov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia A.","family":"Schnabel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8035-3700","authenticated-orcid":false,"given":"James E.","family":"East","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georges","family":"Wagnieres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victor B.","family":"Loschenov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7365-5652","authenticated-orcid":false,"given":"Enrico","family":"Grisan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Daul","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Walter","family":"Blondel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jens","family":"Rittscher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,17]]},"reference":[{"key":"59413_CR1","unstructured":"Ali, S. et al. A deep learning framework for quality assessment and restoration in video endoscopy. Preprint at http:\/\/arxiv.org\/abs\/1904.07073 (2019)."},{"key":"59413_CR2","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1053\/j.gastro.2018.06.037","volume":"155","author":"G Urban","year":"2018","unstructured":"Urban, G. et al. Deep Learning Localizes and Identifies Polyps in Real Time With 96% Accuracy in Screening Colonoscopy. Gastroenterology 155, 1069\u20131078, https:\/\/doi.org\/10.1053\/j.gastro.2018.06.037 (2018).","journal-title":"Gastroenterology"},{"key":"59413_CR3","doi-asserted-by":"publisher","unstructured":"Ali, S. & Rittscher, J. Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract. In IEEE 16th International Symposium on Biomedical Imaging, 91\u201395, https:\/\/doi.org\/10.1109\/ISBI.2019.8759450 (2019).","DOI":"10.1109\/ISBI.2019.8759450"},{"key":"59413_CR4","doi-asserted-by":"crossref","unstructured":"Ali, S., Daul, C., Weibel, T. & Blondel, W. Fast mosaicing of cystoscopic images from dense correspondence: combined SURF and TV-L1 optical flow method. In IEEE International Conference on Image Processing, 1291\u20131295 (2013).","DOI":"10.1109\/ICIP.2013.6738266"},{"key":"59413_CR5","doi-asserted-by":"crossref","unstructured":"Collins, T. & Bartoli, A. 3D reconstruction in laparoscopy with close-range photometric stereo. In International Conference on Medical Image Computing and Computer-Assisted Interventionm, 634\u2013642 (2012).","DOI":"10.1007\/978-3-642-33418-4_78"},{"key":"59413_CR6","unstructured":"Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J. & Zisserman, A. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. Online http:\/\/www.pascal-network.org\/challenges\/VOC\/voc2012\/workshop\/index.html (2012)."},{"key":"59413_CR7","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Microsoft COCO: Common objects in context. In European conference on computer vision, 740\u2013755 (2014).","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"59413_CR8","doi-asserted-by":"crossref","first-page":"32","DOI":"10.14311\/854","volume":"46","author":"T Stehle","year":"2006","unstructured":"Stehle, T. Removal of specular reflections in endoscopic images. Acta Polytechnica 46, 32\u201336 (2006).","journal-title":"Acta Polytechnica"},{"key":"59413_CR9","doi-asserted-by":"crossref","unstructured":"Tchoulack, S., Langlois, J. P. & Cheriet, F. A video stream processor for real-time detection and correction of specular reflections in endoscopic images. In Joint 6th International IEEE Northeast Workshop on Circuits and Systems and TAISA Conference, 49\u201352 (2008).","DOI":"10.1109\/NEWCAS.2008.4606318"},{"key":"59413_CR10","doi-asserted-by":"crossref","unstructured":"Liu, H., Lu, W.-S. & Meng, M. Q.-H. De-blurring wireless capsule endoscopy images by total variation minimization. In Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, 102\u2013106 (2011).","DOI":"10.1109\/PACRIM.2011.6032875"},{"key":"59413_CR11","doi-asserted-by":"crossref","unstructured":"Lin, J., Seddik, M. E. A., Tamaazousti, M., Tamaazousti, Y. & Bartoli, A. Deep multi-class adversarial specularity removal. In Scandinavian Conference on Image Analysis, 3\u201315 (2019).","DOI":"10.1007\/978-3-030-20205-7_1"},{"key":"59413_CR12","doi-asserted-by":"publisher","unstructured":"Ali, S. et al. Endoscopy Artefact Detection (EAD) dataset, https:\/\/doi.org\/10.17632\/c7fjbxcgj9.2 (2019).","DOI":"10.17632\/c7fjbxcgj9.2"},{"key":"59413_CR13","unstructured":"Ali, S. et al. Endoscopy artifact detection (EAD 2019) challenge dataset. Preprint at https:\/\/arxiv.org\/abs\/1905.03209 (2019)."},{"key":"59413_CR14","doi-asserted-by":"publisher","unstructured":"Pogorelov, K. et al. KVASIR: A Multi-Class Image Dataset for Computer Aided Gastrointestinal Disease Detection. In Proceedings of the 8th ACM on Multimedia Systems Conference, 164\u2013169, https:\/\/doi.org\/10.1145\/3083187.3083212 (2017).","DOI":"10.1145\/3083187.3083212"},{"key":"59413_CR15","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P. & Girshick, R. Mask R-CNN. In Proceedings of the IEEE international conference on computer vision, 2961\u20132969 (2017).","DOI":"10.1109\/ICCV.2017.322"},{"key":"59413_CR16","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Doll\u00e1r, P. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, 2980\u20132988 (2017).","DOI":"10.1109\/ICCV.2017.324"},{"key":"59413_CR17","doi-asserted-by":"crossref","unstructured":"Cai, Z. & Vasconcelos, N. Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 6154\u20136162 (2018).","DOI":"10.1109\/CVPR.2018.00644"},{"key":"59413_CR18","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","volume":"40","author":"L-C Chen","year":"2017","unstructured":"Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K. & Yuille, A. L. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE transactions on pattern analysis and machine intelligence 40, 834\u2013848 (2017).","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"59413_CR19","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F. & Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision, 801\u2013818 (2018).","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"59413_CR20","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems, 91\u201399 (2015)."},{"key":"59413_CR21","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1093\/biomet\/41.1-2.133","volume":"41","author":"AR Jonckheere","year":"1954","unstructured":"Jonckheere, A. R. A distribution-free k-sample test against ordered alternatives. Biometrika 41, 133\u2013145 (1954).","journal-title":"Biometrika"},{"key":"59413_CR22","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1016\/S1385-7258(52)50043-X","volume":"14","author":"TJ Terpstra","year":"1952","unstructured":"Terpstra, T. J. The asymptotic normality and consistency of kendall\u2019s test against trend, when ties are present in one ranking. Indagations Math. 14, 327\u2013333 (1952).","journal-title":"Indagations Math."},{"key":"59413_CR23","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine learning research 7, 1\u201330 (2006).","journal-title":"Journal of Machine learning research"},{"key":"59413_CR24","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-Net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, 234\u2013241 (2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"59413_CR25","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X. & Jia, J. Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2881\u20132890 (2017).","DOI":"10.1109\/CVPR.2017.660"},{"key":"59413_CR26","doi-asserted-by":"crossref","unstructured":"Dai, J. et al. Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision, 764\u2013773 (2017).","DOI":"10.1109\/ICCV.2017.89"},{"key":"59413_CR27","doi-asserted-by":"crossref","unstructured":"Yu, F., Wang, D., Shelhamer, E. & Darrell, T. Deep layer aggregation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2403\u20132412 (2018).","DOI":"10.1109\/CVPR.2018.00255"},{"key":"59413_CR28","unstructured":"Kendall, A., Gal, Y. & Cipolla, R. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 7482\u20137491 (2018)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-59413-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-59413-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-59413-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T02:18:43Z","timestamp":1670293123000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-59413-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,17]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["59413"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-59413-5","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,17]]},"assertion":[{"value":"10 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2748"}}