{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T08:14:03Z","timestamp":1770970443160,"version":"3.50.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,18]],"date-time":"2020-05-18T00:00:00Z","timestamp":1589760000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,18]],"date-time":"2020-05-18T00:00:00Z","timestamp":1589760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We have designed a deep-learning model, an \u201cArtificial Intelligent Endoscopist (a.k.a. AI-doscopist)\u201d, to localise colonic neoplasia during colonoscopy. This study aims to evaluate the agreement between endoscopists and AI-doscopist for colorectal neoplasm localisation. AI-doscopist was pre-trained by 1.2 million non-medical images and fine-tuned by 291,090 colonoscopy and non-medical images. The colonoscopy images were obtained from six databases, where the colonoscopy images were classified into 13 categories and the polyps\u2019 locations were marked image-by-image by the smallest bounding boxes. Seven categories of non-medical images, which were believed to share some common features with colorectal polyps, were downloaded from an online search engine. Written informed consent were obtained from 144 patients who underwent colonoscopy and their full colonoscopy videos were prospectively recorded for evaluation. A total of 128 suspicious lesions were resected or biopsied for histological confirmation. When evaluated image-by-image on the 144 full colonoscopies, the specificity of AI-doscopist was 93.3%. AI-doscopist were able to localise 124 out of 128 polyps (polyp-based sensitivity\u2009=\u200996.9%). Furthermore, after reviewing the suspected regions highlighted by AI-doscopist in a 102-patient cohort, an endoscopist has high confidence in recognizing four missed polyps in three patients who were not diagnosed with any lesion during their original colonoscopies. In summary, AI-doscopist can localise 96.9% of the polyps resected by the endoscopists. If AI-doscopist were to be used in real-time, it can potentially assist endoscopists in detecting one more patient with polyp in every 20\u201333 colonoscopies.<\/jats:p>","DOI":"10.1038\/s41746-020-0281-z","type":"journal-article","created":{"date-parts":[[2020,5,18]],"date-time":"2020-05-18T10:02:50Z","timestamp":1589796170000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["AI-doscopist: a real-time deep-learning-based algorithm for localising polyps in colonoscopy videos with edge computing devices"],"prefix":"10.1038","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7717-4752","authenticated-orcid":false,"given":"Carmen C. Y.","family":"Poon","sequence":"first","affiliation":[]},{"given":"Yuqi","family":"Jiang","sequence":"additional","affiliation":[]},{"given":"Ruikai","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Winnie W. Y.","family":"Lo","sequence":"additional","affiliation":[]},{"given":"Maggie S. H.","family":"Cheung","sequence":"additional","affiliation":[]},{"given":"Ruoxi","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Yali","family":"Zheng","sequence":"additional","affiliation":[]},{"given":"John C. T.","family":"Wong","sequence":"additional","affiliation":[]},{"given":"Qing","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Sunny H.","family":"Wong","sequence":"additional","affiliation":[]},{"given":"Tony W. C.","family":"Mak","sequence":"additional","affiliation":[]},{"given":"James Y. W.","family":"Lau","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,5,18]]},"reference":[{"key":"281_CR1","doi-asserted-by":"publisher","first-page":"394","DOI":"10.3322\/caac.21492","volume":"68","author":"F Bray","year":"2018","unstructured":"Bray, F. et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 68, 394\u2013424 (2018).","journal-title":"CA Cancer J. Clin."},{"key":"281_CR2","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1053\/j.gastro.2019.05.011","volume":"157","author":"K Zimmermann-Fraedrich","year":"2019","unstructured":"Zimmermann-Fraedrich, K. et al. Right-sided location not associated with missed colorectal adenomas in an individual-level reanalysis of tandem colonoscopy studies. Gastroenterology 157, 660 (2019).","journal-title":"Gastroenterology"},{"key":"281_CR3","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1055\/s-0031-1291666","volume":"44","author":"AM Leufkens","year":"2012","unstructured":"Leufkens, A. M., van Oijen, M. G. H., Vleggaar, F. P. & Siersema, P. D. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy 44, 470\u2013475 (2012).","journal-title":"Endoscopy"},{"key":"281_CR4","doi-asserted-by":"publisher","first-page":"1488","DOI":"10.1109\/TMI.2014.2314959","volume":"33","author":"AV Mamonov","year":"2014","unstructured":"Mamonov, A. V., Figueiredo, I. N., Figueiredo, P. N. & Tsai, Y. H. R. Automated polyp detection in colon capsule endoscopy. IEEE Trans. Med. Imaging 33, 1488\u20131502 (2014).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"281_CR5","doi-asserted-by":"publisher","first-page":"2379","DOI":"10.1109\/TMI.2015.2434398","volume":"34","author":"SH Bae","year":"2015","unstructured":"Bae, S. H. & Yoon, K. J. Polyp detection via imbalanced learning and discriminative feature learning. IEEE Trans. Med. Imaging 34, 2379\u20132393 (2015).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"281_CR6","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.cmpb.2015.04.002","volume":"120","author":"Y Wang","year":"2015","unstructured":"Wang, Y., Tavanapong, W., Wong, J., Oh, J. H. & de Groen, P. C. Polyp-Alert: near real-time feedback during colonoscopy. Comput. Methods Programs Biomed. 120, 164\u2013179 (2015).","journal-title":"Comput. Methods Programs Biomed."},{"key":"281_CR7","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"281_CR8","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115 (2017).","journal-title":"Nature"},{"key":"281_CR9","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/JBHI.2016.2635662","volume":"21","author":"RK Zhang","year":"2017","unstructured":"Zhang, R. K. et al. Automatic detection and classification of colorectal polyps by transferring low-level CNN features from nonmedical domain. IEEE J. Biomed. Health Inf. 21, 41\u201347 (2017).","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"281_CR10","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1053\/j.gastro.2017.10.010","volume":"154","author":"PJ Chen","year":"2018","unstructured":"Chen, P. J. et al. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 154, 568\u2013575 (2018).","journal-title":"Gastroenterology"},{"key":"281_CR11","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.patcog.2018.05.026","volume":"83","author":"RK Zhang","year":"2018","unstructured":"Zhang, R. K., Zheng, Y. L., Poon, C. C. Y., Shen, D. G. & Lau, J. Y. W. Polyp detection during colonoscopy using a regression-based convolutional neural network with a tracker. Pattern Recogn. 83, 209\u2013219 (2018).","journal-title":"Pattern Recogn."},{"key":"281_CR12","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/S2468-1253(18)30282-6","volume":"4","author":"OF Ahmad","year":"2019","unstructured":"Ahmad, O. F. et al. Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions. Lancet Gastroenterol. Hepatol. 4, 71\u201380 (2019).","journal-title":"Lancet Gastroenterol. Hepatol."},{"key":"281_CR13","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1038\/s41551-018-0301-3","volume":"2","author":"P Wang","year":"2018","unstructured":"Wang, P. et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat. Biomed. Eng. 2, 741\u2013748 (2018).","journal-title":"Nat. Biomed. Eng."},{"key":"281_CR14","doi-asserted-by":"publisher","first-page":"2027","DOI":"10.1053\/j.gastro.2018.04.003","volume":"154","author":"M Misawa","year":"2018","unstructured":"Misawa, M. et al. Artificial intelligence-assisted polyp detection for colonoscopy: initial experience. Gastroenterology 154, 2027 (2018).","journal-title":"Gastroenterology"},{"key":"281_CR15","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1109\/TMI.2017.2664042","volume":"36","author":"J Bernal","year":"2017","unstructured":"Bernal, J. et al. Comparative validation of polyp detection methods in video colonoscopy: results from the MICCAI 2015 endoscopic vision challenge. IEEE Trans. Med. Imaging 36, 1231\u20131249 (2017).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"281_CR16","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. In 2016 IEEE Conference on Computer Vision and Pattern Recognition 770\u2013778 (Seattle, 2016)."},{"key":"281_CR17","unstructured":"Redmon, J. & Farhadi, A. In 30th IEEE Conference on Computer Vision and Pattern Recognition 6517\u20136525 (2017)."},{"key":"281_CR18","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O. et al. ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115, 211\u2013252 (2015).","journal-title":"Int. J. Comput. Vis."},{"key":"281_CR19","doi-asserted-by":"publisher","first-page":"3166","DOI":"10.1016\/j.patcog.2012.03.002","volume":"45","author":"J Bernal","year":"2012","unstructured":"Bernal, J., Sanchez, J. & Vilarino, F. Towards automatic polyp detection with a polyp appearance model. Pattern Recogn. 45, 3166\u20133182 (2012).","journal-title":"Pattern Recogn."},{"key":"281_CR20","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.compmedimag.2015.02.007","volume":"43","author":"J Bernal","year":"2015","unstructured":"Bernal, J. et al. WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput. Med. Imaging Graph. 43, 99\u2013111 (2015).","journal-title":"Comput. Med. Imaging Graph."},{"key":"281_CR21","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s11548-013-0926-3","volume":"9","author":"J Silva","year":"2014","unstructured":"Silva, J., Histace, A., Romain, O., Dray, X. & Granado, B. Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer. Int. J. Comput. Assist. Radiol. Surg. 9, 283\u2013293 (2014).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"281_CR22","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1109\/TMI.2015.2487997","volume":"35","author":"N Tajbakhsh","year":"2016","unstructured":"Tajbakhsh, N., Gurudu, S. R. & Liang, J. M. Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans. Med. Imaging 35, 630\u2013644 (2016).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"281_CR23","unstructured":"Zheng, Y. et al. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 4142\u20134145 (IEEE, 2018)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0281-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0281-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0281-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:14:39Z","timestamp":1670379279000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0281-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,18]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["281"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0281-z","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,18]]},"assertion":[{"value":"27 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors are inventors of patents related to the submitted work and the corresponding author is a director of a spin-off company aiming to commercialise the product.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"73"}}