{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T06:05:58Z","timestamp":1785305158320,"version":"3.55.0"},"reference-count":40,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,14]],"date-time":"2023-01-14T00:00:00Z","timestamp":1673654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2019YFC0117800"],"award-info":[{"award-number":["2019YFC0117800"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Specular Reflections often exist in the endoscopic image, which not only hurts many computer vision algorithms but also seriously interferes with the observation and judgment of the surgeon. The information behind the recovery specular reflection areas is a necessary pre-processing step in medical image analysis and application. The existing highlight detection method is usually only suitable for medium-brightness images. The existing highlight removal method is only applicable to images without large specular regions, when dealing with high-resolution medical images with complex texture information, not only does it have a poor recovery effect, but the algorithm operation efficiency is also low. To overcome these limitations, this paper proposes a specular reflection detection and removal method for endoscopic images based on brightness classification. It can effectively detect the specular regions in endoscopic images of different brightness and can improve the operating efficiency of the algorithm while restoring the texture structure information of the high-resolution image. In addition to achieving image brightness classification and enhancing the brightness component of low-brightness images, this method also includes two new steps: In the highlight detection phase, the adaptive threshold function that changes with the brightness of the image is used to detect absolute highlights. During the highlight recovery phase, the priority function of the exemplar-based image inpainting algorithm was modified to ensure reasonable and correct repairs. At the same time, local priority computing and adaptive local search strategies were used to improve algorithm efficiency and reduce error matching. The experimental results show that compared with the other state-of-the-art, our method shows better performance in terms of qualitative and quantitative evaluations, and the algorithm efficiency is greatly improved when processing high-resolution endoscopy images.<\/jats:p>","DOI":"10.3390\/s23020974","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T05:30:07Z","timestamp":1673847007000},"page":"974","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Specular Reflections Detection and Removal for Endoscopic Images Based on Brightness Classification"],"prefix":"10.3390","volume":"23","author":[{"given":"Chao","family":"Nie","sequence":"first","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"Anhui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"Anhui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengping","family":"Li","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"Anhui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingling","family":"Chu","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"Anhui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunxue","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"Anhui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1146\/annurev-bioeng-062117-120917","article-title":"Advanced endoscopic navigation: Surgical big data, methodology, and applications","volume":"20","author":"Luo","year":"2018","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2352\/ISSN.2470-1173.2016.13.IQSP-212","article-title":"An adaptive contrast enhancement method for stereo endoscopic images combining binocular just noticeable difference model and depth information","volume":"28","author":"Sdiri","year":"2016","journal-title":"Electron. Imaging"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2208","DOI":"10.1111\/j.1467-8659.2011.01971.x","article-title":"A Survey of Specularity Removal Methods","volume":"30","author":"Artusi","year":"2011","journal-title":"Comput. Graph. Forum"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Funke, I., Bodenstedt, S., Riediger, C., Weitz, J., and Speidel, S. (2018, January 12\u201315). Generative adversarial networks for specular highlight removal in endoscopic images. Proceedings of the Conference on Medical Imaging\u2014Image-Guided Procedures, Robotic Interventions, and Modeling, Houston, TX, USA.","DOI":"10.1117\/12.2293755"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.irbm.2017.08.003","article-title":"Detection of Specular Reflection and Segmentation of Cervix Region in Uterine Cervix Images for Cervical Cancer Screening","volume":"38","author":"Kudva","year":"2017","journal-title":"IRBM"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, X.X., Li, P., Du, Y.Z., Lv, Y.C., and Chen, Y.L. (2019, January 25\u201327). Detection and Inpainting of Specular Reflection in Colposcopic Images with Exemplar-based Method. Proceedings of the 2019 IEEE 13th International Conference on Anti-counterfeiting, Security, and Identification (ASID), Xiamen, China.","DOI":"10.1109\/ICASID.2019.8925202"},{"key":"ref_7","first-page":"5401308","article-title":"Integration of Global and Local Features for Specular Reflection Inpainting in Colposcopic Images","volume":"2021","author":"Wang","year":"2021","journal-title":"J. Healthc. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Akbari, M., Mohrekesh, M., Najarian, K., Karimi, N., Samavi, S., and Soroushmehr, S.M.R. (2018, January 7\u201310). Adaptive specular reflection detection and inpainting in colonoscopy video frames. In Proceedings of the 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451699"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1002\/ima.22457","article-title":"Effect of interpolation on specular reflections in texture-based automatic colonic polyp detection","volume":"31","author":"Kacmaz","year":"2021","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1002\/jbio.201500151","article-title":"Development of an image pre-processor for operational hyperspectral laryngeal cancer detection","volume":"9","author":"Regeling","year":"2016","journal-title":"J. Biophotonics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.media.2006.10.003","article-title":"Informative frame classification for endoscopy video","volume":"11","author":"Oh","year":"2007","journal-title":"Med. Image Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"814319","DOI":"10.1155\/2010\/814319","article-title":"Automatic Segmentation and Inpainting of Specular Highlights for Endoscopic Imaging","volume":"2010","author":"Arnold","year":"2010","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_13","first-page":"341","article-title":"Automatic detection and inpainting of specular reflections for colposcopic images","volume":"1","author":"Kardouchi","year":"2011","journal-title":"Cent. Eur. J. Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"669","DOI":"10.3844\/ajassp.2013.669.680","article-title":"Three dimensional reconstruction of human heart surface from single image-view under different illumination conditions","volume":"10","author":"Wirza","year":"2013","journal-title":"Am. J. Appl. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1155\/2013\/593183","article-title":"Closed contour specular reflection segmentation in laparoscopic images","volume":"2013","author":"Marcinczak","year":"2013","journal-title":"Int. J. Biomed. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Alsaleh, S.M., Aviles, A.I., Sobrevilla, P., Casals, A., and Hahn, J.K. (2015, January 25\u201329). Automatic and Robust Single-Camera Specular Highlight Removal in Cardiac Images. Proceedings of the 37th Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7318452"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1007\/s11548-017-1555-z","article-title":"SLIM (slit lamp image mosaicing): Handling reflection artifacts","volume":"12","author":"Prokopetc","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.compmedimag.2019.02.002","article-title":"ReTouchImg: Fusioning from-local-to-global context detection and graph data structures for fully-automatic specular reflection removal for endoscopic images","volume":"73","author":"Alsaleh","year":"2019","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105414","DOI":"10.1016\/j.cmpb.2020.105414","article-title":"Content-aware specular reflection suppression based on adaptive image inpainting and neural network for endoscopic images","volume":"192","author":"Shen","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TMI.2019.2926501","article-title":"Specular Reflections Removal for Endoscopic Image Sequences with Adaptive-RPCA Decomposition","volume":"39","author":"Li","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1109\/TPAMI.2014.2360402","article-title":"Efficient and Robust Specular Highlight Removal","volume":"37","author":"Yang","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2327","DOI":"10.1109\/TIP.2017.2675204","article-title":"Specular Reflection Separation With Color-Lines Constraint","volume":"26","author":"Ren","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4483","DOI":"10.1364\/AO.52.004483","article-title":"Real-time highlight removal using intensity ratio","volume":"52","author":"Shen","year":"2013","journal-title":"Appl. Opt."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"125976","DOI":"10.1109\/ACCESS.2019.2939229","article-title":"A Global Optimization Method for Specular Highlight Removal from A Single Image","volume":"7","author":"Xia","year":"2019","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/JPROC.2018.2853589","article-title":"On the Applications of Robust PCA in Image and Video Processing","volume":"106","author":"Bouwmans","year":"2018","journal-title":"Proc. IEEE"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MSP.2018.2826566","article-title":"Robust Subspace Learning Robust PCA, robust subspace tracking, and robust subspace recovery","volume":"35","author":"Vaswani","year":"2018","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region Filling and Object Removal by Exemplar-Based Image Inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","unstructured":"Yin, L., and Chang, C. (2012, January 9\u201311). An Effective Exemplar-based Image Inpainting Method. Proceedings of the 14th IEEE International Conference on Communication Technology (ICCT), Chengdu, China."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.neucom.2013.06.022","article-title":"Robust object removal with an exemplar-based image inpainting approach","volume":"123","author":"Wang","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_30","first-page":"423","article-title":"A new image inpainting approach based on Criminisi algorithm","volume":"10","author":"Ouattara","year":"2019","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hui-Qin, W., Qing, C., Cheng-Hsiung, H., and Peng, Y. (2012, January 15\u201317). Fast exemplar-based image inpainting approach. Proceedings of the 2012 International Conference on Machine Learning and Cybernetics, Xian, China.","DOI":"10.1109\/ICMLC.2012.6359638"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1016\/j.procs.2017.03.161","article-title":"Dynamic Searching and Classification for Highlight Removal on Endoscopic Image","volume":"107","author":"Gao","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1007\/s00138-017-0864-0","article-title":"Bright spot regions segmentation and classification for specular highlights detection in colonoscopy videos","volume":"28","author":"Bernal","year":"2017","journal-title":"Mach. Vis. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"101900","DOI":"10.1016\/j.media.2020.101900","article-title":"A deep learning framework for quality assessment and restoration in video endoscopy","volume":"68","author":"Ali","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"104106","DOI":"10.1016\/j.compbiomed.2020.104106","article-title":"Intrinsic layer based automatic specular reflection detection in endoscopic images","volume":"128","author":"Asif","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1109\/TIP.2012.2226047","article-title":"Efficient contrast enhancement using adaptive gamma correction with weighting distribution","volume":"22","author":"Huang","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.irbm.2019.04.007","article-title":"A Modified DWT-SVD Algorithm for T1-w Brain MR Images Contrast Enhancement","volume":"40","author":"Sahnoun","year":"2019","journal-title":"IRBM"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1016\/j.bbe.2020.02.006","article-title":"A hybridfeature preservation technique based on luminosity and edge based contrast enhancement in color fundus images","volume":"40","author":"Palanisamy","year":"2020","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Pogorelov, K., Randel, K.R., Griwodz, C., Eskeland, S.L., de Lange, T., Johansen, D., Spampinato, C., Dang-Nguyen, D.T., Lux, M., and Schmidt, P.T. (2017, January 20\u201323). KVASIR: A Multi-Class Image Dataset for Computer Aided Gastrointestinal Disease Detection. Proceedings of the Proceedings of the 8th ACM on Multimedia Systems Conference, Taipei, Taiwan.","DOI":"10.1145\/3083187.3083212"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u2018Completely Blind\u2019 Image Quality Analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/974\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:06:04Z","timestamp":1760119564000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/974"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,14]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020974"],"URL":"https:\/\/doi.org\/10.3390\/s23020974","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,14]]}}}