{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T15:07:55Z","timestamp":1783350475669,"version":"3.54.6"},"reference-count":40,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T00:00:00Z","timestamp":1742256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Background: This study aims to objectively evaluate the overall quality of colonoscopies using a specially trained deep learning-based semantic segmentation neural network. This represents a modern and valuable approach for the analysis of colonoscopy frames. Methods: We collected thousands of colonoscopy frames extracted from a set of video colonoscopy files. A color-based image processing method was used to extract color features from specific regions of each colonoscopy frame, namely, the intestinal mucosa, residues, artifacts, and lumen. With these features, we automatically annotated all the colonoscopy frames and then selected the best of them to train a semantic segmentation network. This trained network was used to classify the four region types in a different set of test colonoscopy frames and extract pixel statistics that are relevant to quality evaluation. The test colonoscopies were also evaluated by colonoscopy experts using the Boston scale. Results: The deep learning semantic segmentation method obtained good results, in terms of classifying the four key regions in colonoscopy frames, and produced pixel statistics that are efficient in terms of objective quality assessment. The Spearman correlation results were as follows: BBPS vs. pixel scores: 0.69; BBPS vs. mucosa pixel percentage: 0.63; BBPS vs. residue pixel percentage: \u22120.47; BBPS vs. Artifact Pixel Percentage: \u22120.65. The agreement analysis using Cohen\u2019s Kappa yielded a value of 0.28. The colonoscopy evaluation based on the extracted pixel statistics showed a fair level of compatibility with the experts\u2019 evaluations. Conclusions: Our proposed deep learning semantic segmentation approach is shown to be a promising tool for evaluating the overall quality of colonoscopies and goes beyond the Boston Bowel Preparation Scale in terms of assessing colonoscopy quality. In particular, while the Boston scale focuses solely on the amount of residual content, our method can identify and quantify the percentage of colonic mucosa, residues, and artifacts, providing a more comprehensive and objective evaluation.<\/jats:p>","DOI":"10.3390\/jimaging11030084","type":"journal-article","created":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T04:34:43Z","timestamp":1742272483000},"page":"84","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Deep Learning-Based Semantic Segmentation for Objective Colonoscopy Quality Assessment"],"prefix":"10.3390","volume":"11","author":[{"given":"Radu Alexandru","family":"Vulpoi","sequence":"first","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4473-6645","authenticated-orcid":false,"given":"Adrian","family":"Ciobanu","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Romanian Academy, Iasi Branch, 700481 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7596-2656","authenticated-orcid":false,"given":"Vasile Liviu","family":"Drug","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catalina","family":"Mihai","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oana Bogdana","family":"Barboi","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diana Elena","family":"Floria","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandru Ionut","family":"Coseru","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrei","family":"Olteanu","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vadim","family":"Rosca","sequence":"additional","affiliation":[{"name":"Institute of Gastroenterology and Hepatology, \u201cGrigore T. Popa\u201d University of Medicine and Pharmacy, 700111 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8924-3161","authenticated-orcid":false,"given":"Mihaela","family":"Luca","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Romanian Academy, Iasi Branch, 700481 Iasi, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"78074","DOI":"10.1109\/ACCESS.2024.3402818","article-title":"Automated Detection of Colorectal Polyp Utilizing Deep Learning Methods With Explainable AI","volume":"12","author":"Ahamed","year":"2024","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yue, G., Han, W., Li, S., Zhou, T., Lv, J., and Wang, T. (2022). Automated Polyp Segmentation in Colonoscopy Images via Deep Network with Lesion-Aware Feature Selection and Refinement. Biomed. Signal Process Control, 78.","DOI":"10.1016\/j.bspc.2022.103846"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/34.895972","article-title":"Content-Based Image Retrieval at the End of the Early Years","volume":"22","author":"Smeulders","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ciobanu, A., Luca, M., and Drug, V. (2000, January 29\u201330). Objective Method for Colon Cleansing Evaluation Using Color CIELAB Features. Proceedings of the 2020 International Conference on e-Health and Bioengineering, Iasi, Romania.","DOI":"10.1109\/EHB50910.2020.9280110"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1007\/978-3-319-18416-6_67","article-title":"New Method of Iris Recognition Using Dual Tree Complex Wavelet Transform","volume":"357","author":"Ignat","year":"2016","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1007\/978-3-319-18416-6_71","article-title":"Rotation Invariant Texture Retrieval Using Dual Tree Complex Wavelet Transform","volume":"Volume 357","author":"Ignat","year":"2016","journal-title":"Proceedings of the Advances in Intelligent Systems and Computing"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep Learning","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","volume":"40","author":"Chen","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","unstructured":"Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2014). Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs. arXiv."},{"key":"ref_11","first-page":"5999","article-title":"Attention Is All You Need","volume":"2017","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.gie.2022.10.009","article-title":"Variability in Adenoma Detection Rate in Control Groups of Randomized Colonoscopy Trials: A Systematic Review and Meta-Analysis","volume":"97","author":"Hassan","year":"2023","journal-title":"Gastrointest. Endosc."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e27370","DOI":"10.2196\/27370","article-title":"Diagnostic Accuracy of Artificial Intelligence and Computer-Aided Diagnosis for the Detection and Characterization of Colorectal Polyps: Systematic Review and Meta-Analysis","volume":"23","author":"Nazarian","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1055\/a-0959-0505","article-title":"Bowel Preparation for Colonoscopy: European Society of Gastrointestinal Endoscopy (Esge) Guideline-Update 2019","volume":"51","author":"Hassan","year":"2019","journal-title":"Endoscopy"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2833","DOI":"10.3748\/wjg.v24.i26.2833","article-title":"Bowel Preparation Quality Scales for Colonoscopy","volume":"24","author":"Kastenberg","year":"2018","journal-title":"World J. Gastroenterol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, J., Choi, J.M., Lee, J., Han, Y.M., Jin, E.H., Lim, J.H., Bae, J.H., and Seo, J.Y. (2024). Boston Bowel Preparation Scale Score 6 Has More Missed Lesions Compared with 7\u20139. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-52244-8"},{"key":"ref_17","first-page":"625","article-title":"Use of the Boston Bowel Preparation Scale in the Real Life Setting: What Affects It?","volume":"113","author":"Saraiva","year":"2021","journal-title":"Rev. Esp. Enfermedades Dig."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"40496","DOI":"10.1109\/ACCESS.2021.3063716","article-title":"Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning","volume":"9","author":"Jha","year":"2021","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.1053\/j.gastro.2019.12.035","article-title":"Use of Artificial Intelligence-Based Analytics From Live Colonoscopies to Optimize the Quality of the Colonoscopy Examination in Real Time: Proof of Concept","volume":"158","author":"Thakkar","year":"2020","journal-title":"Gastroenterology"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.gie.2023.12.003","article-title":"Consensus Statements on the Current Landscape of Artificial Intelligence Applications in Endoscopy, Addressing Roadblocks, and Advancing Artificial Intelligence in Gastroenterology","volume":"101","author":"Parasa","year":"2025","journal-title":"Gastrointest. Endosc."},{"key":"ref_21","unstructured":"International Color Consortium (2024, December 30). Specification ICC.1:2022 (Profile Version 4.4.0.0) Image Technology Color Management\u2014Architecture, Profile Format and Data Structure. Available online: https:\/\/www.color.org\/icc_specs2.xalter."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101839","DOI":"10.1016\/j.bpg.2023.101839","article-title":"Colorectal Cancer: A Health and Economic Problem","volume":"66","author":"Klimeck","year":"2023","journal-title":"Best. Pract. Res. Clin. Gastroenterol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"(2023). The Economic Burden of Inflammatory Bowel Disease. Lancet Gastroenterol. Hepatol., 8, 391.","DOI":"10.1016\/S2468-1253(23)00075-4"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"229","DOI":"10.3322\/caac.21834","article-title":"Global Cancer Statistics 2022: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries","volume":"74","author":"BrBray","year":"2024","journal-title":"CA Cancer J Clin"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.3748\/wjg.v29.i7.1157","article-title":"Mucosal Healing and Inflammatory Bowel Disease: Therapeutic Implications and New Targets","volume":"29","author":"Otte","year":"2023","journal-title":"World J. Gastroenterol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"132","DOI":"10.5946\/ce.2020.038","article-title":"Artificial Intelligence in Gastrointestinal Endoscopy","volume":"53","author":"Abadir","year":"2020","journal-title":"Clin. Endosc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.gie.2020.06.059","article-title":"Performance of Artificial Intelligence in Colonoscopy for Adenoma and Polyp Detection: A Systematic Review and Meta-Analysis","volume":"93","author":"Hassan","year":"2021","journal-title":"Gastrointest. Endosc."},{"key":"ref_28","first-page":"903","article-title":"Artificial Intelligence-Assisted Endoscopy Changes the Definition of Mucosal Healing in Ulcerative Colitis","volume":"33","author":"Nakase","year":"2021","journal-title":"Dig. Endosc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e697","DOI":"10.1016\/S2589-7500(21)00109-6","article-title":"Multi-Step Validation of a Deep Learning-Based System for the Quantification of Bowel Preparation: A Prospective, Observational Study","volume":"3","author":"Zhou","year":"2021","journal-title":"Lancet Digit. Health"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1016\/j.gie.2021.11.041","article-title":"Artificial Intelligence for the Assessment of Bowel Preparation","volume":"95","author":"Lee","year":"2022","journal-title":"Gastrointest. Endosc."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chu, Y., Yang, X., Li, H., Ai, D., Ding, Y., Fan, J., Song, H., and Yang, J. (2020). Multi-Level Feature Aggregation Network for Instrument Identification of Endoscopic Images. Phys. Med. Biol., 65.","DOI":"10.1088\/1361-6560\/ab8dda"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"101504","DOI":"10.1016\/j.imu.2024.101504","article-title":"Deep Learning for Medical Image Segmentation: State-of-the-Art Advancements and Challenges","volume":"47","author":"Rayed","year":"2024","journal-title":"Inform. Med. Unlocked"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/j.gie.2019.11.026","article-title":"A Novel Artificial Intelligence System for the Assessment of Bowel Preparation (with Video)","volume":"91","author":"Zhou","year":"2020","journal-title":"Gastrointest. Endosc."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cold, K.M., Heen, A., Vamadevan, A., Vilmann, A.S., Konge, L., Rasmussen, M., and Svendsen, M.B.S. Development and Validation of the Open-Source Automatic Bowel Preparation Scale. Gastrointest. Endosc., 2024. in press.","DOI":"10.1016\/j.gie.2024.11.022"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1055\/a-1799-8297","article-title":"Artificial Intelligence-Based Assessments of Colonoscopic Withdrawal Technique: A New Method for Measuring and Enhancing the Quality of Fold Examination","volume":"54","author":"Liu","year":"2022","journal-title":"Endoscopy"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"8103","DOI":"10.3748\/wjg.v27.i47.8103","article-title":"Artificial Intelligence-Assisted Colonoscopy: A Review of Current State of Practice and Research","volume":"27","author":"Taghiakbari","year":"2021","journal-title":"World J. Gastroenterol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2035","DOI":"10.1136\/gutjnl-2019-320466","article-title":"Machine Learning in GI Endoscopy: Practical Guidance in How to Interpret a Novel Field","volume":"69","author":"Struyvenberg","year":"2020","journal-title":"Gut"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sun, W., Li, P., Liang, Y., Feng, Y., and Zhao, L. (2023). Detection of Image Artifacts Using Improved Cascade Region-Based CNN for Quality Assessment of Endoscopic Images. Bioengineering, 10.","DOI":"10.3390\/bioengineering10111288"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zhang, C., Zhang, N., Wang, D., Cao, Y., and Liu, B. (2020, January 21\u201323). Artifact Detection in Endoscopic Video with Deep Convolutional Neural Networks. Proceedings of the 2020 2nd International Conference on Transdisciplinary AI, TransAI 2020, Irvine, CA, USA.","DOI":"10.1109\/TransAI49837.2020.00007"},{"key":"ref_40","unstructured":"(2025, January 09). Kvasir-SEG Benchmark (Medical Image Segmentation)|Papers with Code. Available online: https:\/\/paperswithcode.com\/sota\/medical-image-segmentation-on-kvasir-seg."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/3\/84\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:55:31Z","timestamp":1760028931000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/3\/84"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,18]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["jimaging11030084"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11030084","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,18]]}}}