{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:41:11Z","timestamp":1760229671687,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T00:00:00Z","timestamp":1655856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program","award":["2020YFB1711902"],"award-info":[{"award-number":["2020YFB1711902"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>When unattended substations are popular, the knob is a vital monitoring object for unattended substations. However, in the actual scene of the substation, the recognition method of a knob gear has low accuracy. The main reasons are as follows. Firstly, the SNR of knob images is low due to the influence of lighting conditions, which are challenging to extract image features. Secondly, the image deviates from the front view affected by the shooting angle; that knob has a certain deformation, which causes the feature judgment to be disturbed. Finally, the feature distribution of each kind of knob is inconsistent, which interferes with image extraction features and leads to weak spatial generalization ability. For the above problems, we propose a three-stage knob gear recognition method based on YOLOv4 and Darknet53-DUC-DSNT models for the first time and apply key point detection of deep learning to knob gear recognition for the first time. Firstly, YOLOv4 is used as the knob area detector to find knobs from a picture of a cabinet panel. Then, Darknet53, which can extract features, is used as the backbone network for keypoint detection of knobs, combined with DUC structure to recover detailed information and DSNT structure to enhance feature extraction and improve spatial generalization ability. Finally, we obtained the knob gear by calculating the angle between the line of the rotating center point and the pointing point and horizontal direction. The experimental results show that this method effectively solves the above problems and improves the performance of knob gear detection.<\/jats:p>","DOI":"10.3390\/s22134722","type":"journal-article","created":{"date-parts":[[2022,6,22]],"date-time":"2022-06-22T23:11:19Z","timestamp":1655939479000},"page":"4722","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Recognition Method of Knob Gear in Substation Based on YOLOv4 and Darknet53-DUC-DSNT"],"prefix":"10.3390","volume":"22","author":[{"given":"Ronglin","family":"Qin","sequence":"first","affiliation":[{"name":"School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 610032, China"}]},{"given":"Zexi","family":"Hua","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610032, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6067-0514","authenticated-orcid":false,"given":"Ziwei","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610032, China"}]},{"given":"Rujiang","family":"He","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610032, China"},{"name":"Qianghua Times (Chengdu) Technology Co., Ltd., Chengdu 610095, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liu, X., Dong, B., Li, P., Yuan, B., and Wang, K. (2021). Research and application of image recognition of substation inspection robots based on edge computing and incremental learning. Res. Sq.","DOI":"10.21203\/rs.3.rs-172739\/v1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1108\/IR-09-2019-0193","article-title":"An intelligent robot for indoor substation inspection","volume":"47","author":"Wang","year":"2020","journal-title":"Ind. Robot. Int. J. Robot. Res. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wu, X., Gao, X., and Gong, J. (2020, January 27\u201329). Intelligent Instrument Recognition Scheme Based on Unattended Substation Inspection. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.","DOI":"10.23919\/CCC50068.2020.9188756"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"107333","DOI":"10.1016\/j.measurement.2019.107333","article-title":"A detection and recognition system of pointer meters in substations based on computer vision","volume":"152","author":"Liu","year":"2020","journal-title":"Measurement"},{"key":"ref_5","first-page":"15","article-title":"The application of live-operated robot system in the high voltage switch cabinet","volume":"34","author":"Cai","year":"2020","journal-title":"Mach. Des. Manuf. Eng."},{"key":"ref_6","unstructured":"Wu, Y., Zhao, S., Gao, X., and Zhan, C. (2021). Design of Control System of Intelligent Emergency Operation Robot for Transformation and Distribution. Mech. Eng. Autom., 163\u2013165."},{"key":"ref_7","first-page":"192","article-title":"Research on Image Recognition System of Aircraft Cockpit Knob","volume":"37","author":"Wu","year":"2020","journal-title":"Commun. Power Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Siciliano, B., Khatib, O., and Kr\u00f6ger, T. (2008). Springer Handbook of Robotics, Springer.","DOI":"10.1007\/978-3-540-30301-5"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.neucom.2020.01.032","article-title":"A robust approach to reading recognition of pointer meters based on improved mask-RCNN","volume":"388","author":"Zuo","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_10","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Stateline, NV, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.-F. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_13","unstructured":"Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5\u201310). R-fcn: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2017, January 1). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems Advances in Neural Information Processing Systems, Montreal, QC, Canada.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_15","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2021, January 20\u201325). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01283"},{"key":"ref_17","unstructured":"Jiang, Z., Zhao, L., Li, S., and Jia, Y. (2020). Real-time object detection method based on improved YOLOv4-tiny. arXiv."},{"key":"ref_18","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201323). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_21","first-page":"3679","article-title":"Power station rotary switch status recognition based on YOLO-tiny-RFB model","volume":"40","author":"Shi","year":"2020","journal-title":"Comput. Appl."},{"key":"ref_22","first-page":"26","article-title":"Measurement method of knob pose based on edge detection and deep network","volume":"44","author":"Zhu","year":"2021","journal-title":"Electron. Meas. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., and Cottrell, G. (2018, January 12\u201315). Understanding convolution for semantic segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00163"},{"key":"ref_24","first-page":"3523","article-title":"Image segmentation using deep learning: A survey","volume":"44","author":"Minaee","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27\u201330). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_26","unstructured":"Nibali, A., He, Z., Morgan, S., and Prendergast, L. (2018). Numerical coordinate regression with convolutional neural networks. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sun, X., Xiao, B., Wei, F., Liang, S., and Wei, Y. (2018, January 8\u201314). Integral human pose regression. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_33"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, F., Zhu, X., Dai, H., Ye, M., and Zhu, C. (2020, January 14\u201319). Distribution-aware coordinate representation for human pose estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR42600.2020.00712"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102897","DOI":"10.1016\/j.cviu.2019.102897","article-title":"Monocular human pose estimation: A survey of deep learning-based methods","volume":"192","author":"Chen","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Park, K., Patten, T., Prankl, J., and Vincze, M. (2019, January 20\u201324). Multi-task template matching for object detection, segmentation and pose estimation using depth images. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794448"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107874","DOI":"10.1016\/j.patcog.2021.107874","article-title":"Mean-shift outlier detection and filtering","volume":"115","author":"Yang","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_32","first-page":"117360F","article-title":"Real time circle detection by simplified Hough transform on smartphones","volume":"Volume 11736","author":"Schneider","year":"2021","journal-title":"Proceedings of the Real-Time Image Processing and Deep Learning 2021"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhao, K., Han, Q., Zhang, C.B., Xu, J., and Cheng, M.M. (2021). Deep Hough Transform for Semantic Line Detection. IEEE Trans. Pattern Anal. Mach. Intell., 1.","DOI":"10.1109\/TPAMI.2021.3077129"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Srinivasu, P.N., SivaSai, J.G., Ijaz, M.F., Bhoi, A.K., Kim, W., and Kang, J.J. (2021). Classification of skin disease using deep learning neural networks with MobileNet V2 and LSTM. Sensors, 21.","DOI":"10.3390\/s21082852"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1007\/s13198-021-01262-0","article-title":"Research on image text recognition based on canny edge detection algorithm and k-means algorithm","volume":"13","author":"Wu","year":"2021","journal-title":"Int. J. Syst. Assur. Eng. Manag."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhang, F., and Wang, L. (2020, January 11\u201312). Fruit classification model based on improved Darknet53 convolutional neural network. Proceedings of the 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Vientiane, Laos.","DOI":"10.1109\/ICITBS49701.2020.00194"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yi, X., Song, Y., and Zhang, Y. (2020). Enhanced Darknet53 Combine MLFPN Based Real-Time Defect Detection in Steel Surface. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Proceedings of the Third Chinese Conference, PRCV 2020, Nanjing, China, 16\u201318 October 2020, Springer.","DOI":"10.1007\/978-3-030-60633-6_25"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"167754","DOI":"10.1016\/j.ijleo.2021.167754","article-title":"Content-based image retrieval using feature-fusion of GroupNormalized-Inception-Darknet-53 features and handcraft features","volume":"246","author":"Pathak","year":"2021","journal-title":"Optik"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Liao, H.Y.M., Wu, Y.H., Chen, P.Y., Hsieh, J.W., and Yeh, I.H. (2020, January 14\u201319). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_40","unstructured":"Purkait, P., Zhao, C., and Zach, C. (2017). SPP-Net: Deep absolute pose regression with synthetic views. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18\u201323). Path aggregation network for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Al-Haija, Q.A., Smadi, M., and Al-Bataineh, O.M. (2021, January 21\u201324). Identifying Phasic dopamine releases using DarkNet-19 Convolutional Neural Network. Proceedings of the 2021 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Toronto, ON, Canada.","DOI":"10.1109\/IEMTRONICS52119.2021.9422617"},{"key":"ref_43","first-page":"573","article-title":"Bacterial Disease Detection for Pepper Plant by Utilizing Deep Features Acquired from DarkNet-19 CNN Model","volume":"12","year":"2021","journal-title":"Dicle \u00dcniversitesi M\u00fchendislik Fak\u00fcltesi M\u00fchendislik Dergisi"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"167448","DOI":"10.1109\/ACCESS.2020.3021660","article-title":"Recognition of different types of leukocytes using YOLOv2 and optimized bag-of-features","volume":"8","author":"Sharif","year":"2020","journal-title":"IEEE Access"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42452-021-04897-7","article-title":"A novel ResNet101 model based on dense dilated convolution for image classification","volume":"4","author":"Zhang","year":"2022","journal-title":"SN Appl. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Xu, Z., Sun, K., and Mao, J. (2020, January 14\u201316). Research on ResNet101 Network Chemical Reagent Label Image Classification Based on Transfer Learning. Proceedings of the 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology (ICCASIT), Weihai, China.","DOI":"10.1109\/ICCASIT50869.2020.9368658"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Nguyen, L.D., Lin, D., Lin, Z., and Cao, J. (2018, January 27\u201330). Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation. Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.","DOI":"10.1109\/ISCAS.2018.8351550"},{"key":"ref_48","unstructured":"\u0160ulc, M., Mishkin, D., and Matas, J. (2016, January 5\u20138). Very deep residual networks with maxout for plant identification in the wild. Working Notes of CLEF. Proceedings of the Conference and Labs of the Evaluation Forum, \u00c9vora, Portugal."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Han, S.S., Park, G.H., Lim, W., Kim, M.S., Na, J.I., Park, I., and Chang, S.E. (2018). Deep neural networks show an equivalent and often superior performance to dermatologists in onychomycosis diagnosis: Automatic construction of onychomycosis datasets by region-based convolutional deep neural network. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0191493"},{"key":"ref_50","first-page":"5866","article-title":"Breast Cancer Histopathological Image Classification Using Augmentation Based on Optimized Deep ResNet-152 Structure","volume":"25","author":"Reenadevi","year":"2021","journal-title":"Ann. Rom. Soc. Cell Biol."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4722\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:37:57Z","timestamp":1760139477000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4722"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,22]]},"references-count":51,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134722"],"URL":"https:\/\/doi.org\/10.3390\/s22134722","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,6,22]]}}}