{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T05:08:08Z","timestamp":1767848888898,"version":"3.49.0"},"reference-count":39,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,10]],"date-time":"2022-09-10T00:00:00Z","timestamp":1662768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2020YFB1600704"],"award-info":[{"award-number":["2020YFB1600704"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Transmission line inspection plays an important role in maintaining power security. In the object detection of the transmission line, the large-scale gap of the fittings is still a main and negative factor in affecting the detection accuracy. In this study, an optimized method is proposed based on the contextual information enhancement (CIE) and joint heterogeneous representation (JHR). In the high-resolution feature extraction layer of the Swin transformer, the convolution is added in the part of the self-attention calculation, which can enhance the contextual information features and improve the feature extraction ability for small objects. Moreover, in the detection head, the joint heterogeneous representations of different detection methods are combined to enhance the features of classification and localization tasks, which can improve the detection accuracy of small objects. The experimental results show that this optimized method has a good detection performance on the small-sized and obscured objects in the transmission line. The total mAP (mean average precision) of the detected objects by this optimized method is increased by 5.8%, and in particular, the AP of the normal pin is increased by 18.6%. The improvement of the accuracy of the transmission line object detection method lays a foundation for further real-time inspection.<\/jats:p>","DOI":"10.3390\/s22186855","type":"journal-article","created":{"date-parts":[[2022,9,13]],"date-time":"2022-09-13T04:05:41Z","timestamp":1663041941000},"page":"6855","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Transmission Line Object Detection Method Based on Contextual Information Enhancement and Joint Heterogeneous Representation"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3661-0401","authenticated-orcid":false,"given":"Lijuan","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chang\u2019an","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongquan","family":"Qu","sequence":"additional","affiliation":[{"name":"School of Information, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9699","DOI":"10.1109\/TIE.2017.2716862","article-title":"Acoustic Fault Detection Technique for High-Power Insulators","volume":"64","author":"Park","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"38448","DOI":"10.1109\/ACCESS.2020.2974798","article-title":"Detection and Evaluation Method of Transmission Line Defects Based on Deep Learning","volume":"8","author":"Liang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1599","DOI":"10.1109\/TPWRD.2019.2944741","article-title":"IN-YOLO: Real-Time Detection of Outdoor High Voltage Insulators Using UAV Imaging","volume":"35","author":"Sadykova","year":"2020","journal-title":"IEEE Trans. Power Deliv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Meng, L., Peng, Z., Zhou, J., Zhang, J., Lu, Z., Baumann, A., and Du, Y. (2020). Real-Time Detection of Ground Objects Based on Unmanned Aerial Vehicle Remote Sensing with Deep Learning: Application in Excavator Detection for Pipeline Safety. Remote Sens., 12.","DOI":"10.3390\/rs12010182"},{"key":"ref_5","first-page":"102603","article-title":"Hyperspectral Image Classification on Insufficient-Sample and Feature Learning Using Deep Neural Networks: A Review","volume":"105","author":"Wambugu","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wu, Y., Mu, G., Qin, C., Miao, Q., Ma, W., and Zhang, X. (2020). Semi-Supervised Hyperspectral Image Classification via Spatial-Regulated Self-Training. Remote Sens., 12.","DOI":"10.3390\/rs12010159"},{"key":"ref_7","unstructured":"Zou, Z., Shi, Z., Guo, Y., and Ye, J. (2019). Object Detection in 20 Years: A Survey. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"114417","DOI":"10.1016\/j.eswa.2020.114417","article-title":"A Review of Deep Learning Methods for Semantic Segmentation of Remote Sensing Imagery","volume":"169","author":"Yuan","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4257","DOI":"10.1109\/TNNLS.2021.3056238","article-title":"Commonality Autoencoder: Learning Common Features for Change Detection From Heterogeneous Images","volume":"33","author":"Wu","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_10","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper With Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_14","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2017, January 21\u201326). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_16","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2022, January 19\u201320). ResNeSt: Split-Attention Networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00309"},{"key":"ref_18","first-page":"1","article-title":"Research on Detection Method of Insulator Defects on Transmission Lines Based on SSD Algorithm","volume":"26","author":"Li","year":"2019","journal-title":"Instrum. Cust."},{"key":"ref_19","first-page":"1","article-title":"An Insulator in Transmission Lines Recognition and Fault Detection Model Based on Improved Faster RCNN","volume":"70","author":"Zhao","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bao, W., Ren, Y., Wang, N., Hu, G., and Yang, X. (2021). Detection of Abnormal Vibration Dampers on Transmission Lines in UAV Remote Sensing Images with PMA-YOLO. Remote Sens., 13.","DOI":"10.3390\/rs13204134"},{"key":"ref_21","first-page":"60","article-title":"Research on Part Recognition and Defect Detection of Transmission Line in Deep Learning","volume":"41","author":"Tang","year":"2018","journal-title":"Electron. Meas. Technol."},{"key":"ref_22","first-page":"54","article-title":"Detection of Key Components of Transmission Lines Based on Multi-Scale Feature Fusion","volume":"57","author":"Yang","year":"2020","journal-title":"Electr. Meas. Instrum."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6080","DOI":"10.1109\/TIM.2020.2969057","article-title":"Detection Method Based on Automatic Visual Shape Clustering for Pin-Missing Defect in Transmission Lines","volume":"69","author":"Zhao","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2551","DOI":"10.1109\/TPWRD.2021.3112285","article-title":"A Deep Learning Model for Small-Size Defective Components Detection in Power Transmission Tower","volume":"37","author":"Jiao","year":"2022","journal-title":"IEEE Trans. Power Deliv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018). Non-Local Neural Networks. arXiv.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.-M. (2020). End-to-End Object Detection with Transformers. Computer Vision\u2014ECCV 2020, Springer International Publishing. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-58565-5"},{"key":"ref_27","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., and Shao, L. (2021, January 10\u201317). Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction Without Convolutions. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00061"},{"key":"ref_29","first-page":"15908","article-title":"Transformer in Transformer","volume":"Volume 34","author":"Han","year":"2021","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_31","unstructured":"Chen, C.-F., Panda, R., and Fan, Q. (2022). RegionViT: Regional-to-Local Attention for Vision Transformers. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). Microsoft COCO: Common Objects in Context. Computer Vision\u2014ECCV 2014, Springer International Publishing. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-10590-1"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). SSD: Single Shot MultiBox Detector. Computer Vision\u2014ECCV 2016, Springer International Publishing. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-46466-4"},{"key":"ref_35","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollar, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201323). Cascade R-CNN: Delving Into High Quality Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_38","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). FCOS: Fully Convolutional One-Stage Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zhang, T., Luo, B., Sharda, A., and Wang, G. (2022). Dynamic Label Assignment for Object Detection by Combining Predicted IoUs and Anchor IoUs. J. Imaging, 8.","DOI":"10.3390\/jimaging8070193"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6855\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:28:58Z","timestamp":1760142538000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6855"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,10]]},"references-count":39,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22186855"],"URL":"https:\/\/doi.org\/10.3390\/s22186855","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,10]]}}}