{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T18:55:42Z","timestamp":1782413742281,"version":"3.54.5"},"reference-count":31,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U20A20201"],"award-info":[{"award-number":["U20A20201"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["20311803D"],"award-info":[{"award-number":["20311803D"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100015286","name":"Key Research and Development Program of Hebei Province","doi-asserted-by":"publisher","award":["U20A20201"],"award-info":[{"award-number":["U20A20201"]}],"id":[{"id":"10.13039\/501100015286","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100015286","name":"Key Research and Development Program of Hebei Province","doi-asserted-by":"publisher","award":["20311803D"],"award-info":[{"award-number":["20311803D"]}],"id":[{"id":"10.13039\/501100015286","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Reflective phenomena often occur in the detecting process of pointer meters by inspection robots in complex environments, which can cause the failure of pointer meter readings. In this paper, an improved k-means clustering method for adaptive detection of pointer meter reflective areas and a robot pose control strategy to remove reflective areas are proposed based on deep learning. It mainly includes three steps: (1) YOLOv5s (You Only Look Once v5-small) deep learning network is used for real-time detection of pointer meters. The detected reflective pointer meters are preprocessed by using a perspective transformation. Then, the detection results and deep learning algorithm are combined with the perspective transformation. (2) Based on YUV (luminance-bandwidth-chrominance) color spatial information of collected pointer meter images, the fitting curve of the brightness component histogram and its peak and valley information is obtained. Then, the k-means algorithm is improved based on this information to adaptively determine its optimal clustering number and its initial clustering center. In addition, the reflection detection of pointer meter images is carried out based on the improved k-means clustering algorithm. (3) The robot pose control strategy, including its moving direction and distance, can be determined to eliminate the reflective areas. Finally, an inspection robot detection platform is built for experimental study on the performance of the proposed detection method. Experimental results show that the proposed method not only has good detection accuracy that achieves 0.809 but also has the shortest detection time, which is only 0.6392 s compared with other methods available in the literature. The main contribution of this paper is to provide a theoretical and technical reference to avoid circumferential reflection for inspection robots. It can adaptively and accurately detect reflective areas of pointer meters and can quickly remove them by controlling the movement of inspection robots. The proposed detection method has the potential application to realize real-time reflection detection and recognition of pointer meters for inspection robots in complex environments.<\/jats:p>","DOI":"10.3390\/s23052562","type":"journal-article","created":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T02:10:46Z","timestamp":1677463846000},"page":"2562","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Adaptive Reflection Detection and Control Strategy of Pointer Meters Based on YOLOv5s"],"prefix":"10.3390","volume":"23","author":[{"given":"Deyuan","family":"Liu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, China"},{"name":"Hebei Key Laboratory of Robot Sensing and Human-Robot Integration, Tianjin 300401, China"},{"name":"School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5139-1118","authenticated-orcid":false,"given":"Changgen","family":"Deng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, China"},{"name":"Hebei Key Laboratory of Robot Sensing and Human-Robot Integration, Tianjin 300401, China"},{"name":"School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haodong","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, China"},{"name":"Hebei Key Laboratory of Robot Sensing and Human-Robot Integration, Tianjin 300401, China"},{"name":"School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinrong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1688-603X","authenticated-orcid":false,"given":"Baojun","family":"Shi","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, China"},{"name":"Hebei Key Laboratory of Robot Sensing and Human-Robot Integration, Tianjin 300401, China"},{"name":"School of Mechanical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1109\/34.85655","article-title":"Constraining Object Features Using a Polarization Reflectance Model","volume":"13","author":"Wolff","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region Filling and Object Removal by Exemplar-Based Image Inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2990","DOI":"10.1364\/JOSAA.11.002990","article-title":"Temporal-color Space Analysis of Reflection","volume":"11","author":"Sato","year":"1994","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1109\/TVCG.2012.53","article-title":"Online Tracking of Outdoor Lighting Variations for Augmented Reality with Moving Cameras","volume":"18","author":"Liu","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_5","first-page":"526001","article-title":"Reflected Light Separation on Transparent Object Surface Based on Normal Vector Estimation","volume":"41","author":"Zhang","year":"2021","journal-title":"Acta Opt. Sin."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Islam, M.N., Tahtali, M., and Pickering, M. (2021). Specular Reflection Detection and Inpainting in Transparent Object through MSPLFI. Remote Sens., 13.","DOI":"10.3390\/rs13030455"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hao, J., Zhao, Y., and Peng, Q. (2022). A Specular Highlight Removal Algorithm for Quality Inspection of Fresh Fruits. Remote Sens., 14.","DOI":"10.3390\/rs14133215"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhai, Y., and Shah, M. (2006). Visual Attention Detection in Video Sequences Using Spatiotemporal and Cues, Conference on Multimedia.","DOI":"10.1145\/1180639.1180824"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/TIP.2016.2639450","article-title":"LIME: Low-light Image Enhancement via Illumination Map Estimation","volume":"26","author":"Guo","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1002\/col.22824","article-title":"Appearance Estimation and Reconstruction of Glossy Object Surfaces Based on the Dichromatic Reflection Model","volume":"47","author":"Shoji","year":"2022","journal-title":"Color Res. Appl."},{"key":"ref_11","first-page":"37","article-title":"Research on the Algorithm of Rain Sensors Based on Vehicle-Mounted Cameras","volume":"31","author":"Zhang","year":"2017","journal-title":"J. Hunan Univ. Technol."},{"key":"ref_12","first-page":"1422","article-title":"Illumination Estimation Based on Image Decomposition","volume":"13","author":"Cao","year":"2021","journal-title":"Comput. Eng. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103106","DOI":"10.1016\/j.jvcir.2021.103106","article-title":"Specular Highlight Region Restoration Using Image Clustering and Inpainting","volume":"77","author":"Kang","year":"2021","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"104106","DOI":"10.1016\/j.compbiomed.2020.104106","article-title":"Intrinsic layer based automatic specular reflection detection in endoscopic images","volume":"128","author":"Asif","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Nie, C., Xu, C., Li, Z., Chu, L., and Hu, Y. (2023). Specular Reflections Detection and Removal for Endoscopic Images Based on Brightness Classification. Sensors, 23.","DOI":"10.3390\/s23020974"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2056003","DOI":"10.1142\/S0218001420560030","article-title":"Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network","volume":"34","author":"Cheng","year":"2020","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"115158","DOI":"10.1016\/j.engstruct.2022.115158","article-title":"Novel visual crack width measurement based on backbone double-scale features for improved detection automation","volume":"274","author":"Tang","year":"2023","journal-title":"Eng. Struct."},{"key":"ref_18","first-page":"2925812","article-title":"Window Zooming\u2013Based Localization Algorithm of Fruit and Vegetable for Harvesting Robot","volume":"7","author":"Wang","year":"2019","journal-title":"J. Mag."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"107079","DOI":"10.1016\/j.compag.2022.107079","article-title":"Rachis detection and three-dimensional localization of cut off point for vision-based banana robot","volume":"198","author":"Wu","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, H., Lin, Y., Xu, X., Chen, Z., Wu, Z., and Tang, Y. (2022). A Study on Long-Close Distance Coordination Control Strategy for Litchi Picking. Agronomy, 12.","DOI":"10.3390\/agronomy12071520"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, Z., Wang, W., Xue, C., and Jiang, R. (2022). Resource-Efficient Hardware Implementation of Perspective Transformation Based on Central Projection. Electronics, 11.","DOI":"10.3390\/electronics11091367"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"7009","DOI":"10.1109\/LRA.2021.3097057","article-title":"Real-Time Ellipse Detection for Robotics Applications","volume":"6","author":"Keipour","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_24","unstructured":"Zang, X. (2015). Design and Research on the Vision Based Autonomous Instrument Recognition System of Surveillance Robots, Harbin Institute of Technology. (In Chinese)."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1054689","DOI":"10.3389\/fenvs.2022.1054689","article-title":"Detrended Fluctuation Analysis Based on Best-fit Polynomial","volume":"2","author":"Zhao","year":"2022","journal-title":"Front. Environ. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/JAS.2017.7510319","article-title":"Determination of Polynomial Degree in the Regression of Drug Combinations","volume":"4","author":"Wang","year":"2017","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_27","first-page":"682","article-title":"Energy Analysis Method of Computational Complexity","volume":"4","author":"Wang","year":"2008","journal-title":"Int. Symp. Comput. Sci. Comput. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, J., Zhong, C., Chen, J., Han, Y., Zhou, J., and Wang, L. (2022). K-Means Clustering and Bidirectional Long- and Short-Term Neural Networks for Predicting Performance Degradation Trends of Built-In Relays in Meters. Sensors, 22.","DOI":"10.3390\/s22218149"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/TAP.2017.2778042","article-title":"Beam-shaping Technique Based on Generalized Laws of Refraction and Reflection","volume":"66","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Antennas Propag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"107333","DOI":"10.1016\/j.measurement.2019.107333","article-title":"A Detection and Recognition System of Pointer Meters in Substations","volume":"152","author":"Liu","year":"2019","journal-title":"Measurement"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.neucom.2020.01.032","article-title":"A robust approach to reading recognition of pointer meters based on improved mask-RCNN","volume":"388","author":"Zuo","year":"2020","journal-title":"Neurocomputing"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2562\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:42:26Z","timestamp":1760121746000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2562"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,25]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23052562"],"URL":"https:\/\/doi.org\/10.3390\/s23052562","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,25]]}}}