{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T01:21:16Z","timestamp":1772500876214,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,4,8]],"date-time":"2020-04-08T00:00:00Z","timestamp":1586304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61871182; 61773160"],"award-info":[{"award-number":["61871182; 61773160"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Natural Science Foundation of Beijing Municipality","doi-asserted-by":"publisher","award":["4192055"],"award-info":[{"award-number":["4192055"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"publisher","award":["F2016502101; F2017502016"],"award-info":[{"award-number":["F2016502101; F2017502016"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2018MS095; 2020YJ006"],"award-info":[{"award-number":["2018MS095; 2020YJ006"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Open Project Program of the National Laboratory of Pattern Recognition","award":["201900051"],"award-info":[{"award-number":["201900051"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Deep convolutional neural networks (DCNNs) with alternating convolutional, pooling and decimation layers are widely used in computer vision, yet current works tend to focus on deeper networks with many layers and neurons, resulting in a high computational complexity. However, the recognition task is still challenging for insufficient and uncomprehensive object appearance and training sample types such as infrared insulators. In view of this, more attention is focused on the application of a pretrained network for image feature representation, but the rules on how to select the feature representation layer are scarce. In this paper, we proposed a new concept, the layer entropy and relative layer entropy, which can be referred to as an image representation method based on relative layer entropy (IRM_RLE). It was designed to excavate the most suitable convolution layer for image recognition. First, the image was fed into an ImageNet pretrained DCNN model, and deep convolutional activations were extracted. Then, the appropriate feature layer was selected by calculating the layer entropy and relative layer entropy of each convolution layer. Finally, the number of the feature map was selected according to the importance degree and the feature maps of the convolution layer, which were vectorized and pooled by VLAD (vector of locally aggregated descriptors) coding and quantifying for final image representation. The experimental results show that the proposed approach performs competitively against previous methods across all datasets. Furthermore, for the indoor scenes and actions datasets, the proposed approach outperforms the state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/e22040419","type":"journal-article","created":{"date-parts":[[2020,4,8]],"date-time":"2020-04-08T05:59:47Z","timestamp":1586325587000},"page":"419","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Image Representation Method Based on Relative Layer Entropy for Insulator Recognition"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2290-0598","authenticated-orcid":false,"given":"Zhenbing","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6158-4618","authenticated-orcid":false,"given":"Hongyu","family":"Qi","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoqing","family":"Fan","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guozhi","family":"Xu","sequence":"additional","affiliation":[{"name":"Hangzhou Institute, NetEase, Hangzhou 310052, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yincheng","family":"Qi","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2997-5840","authenticated-orcid":false,"given":"Yongjie","family":"Zhai","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, North China Electric Power University, Baoding 071003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,8]]},"reference":[{"key":"ref_1","first-page":"274","article-title":"Recognition and fault diagnosis of insulator string in aerial images","volume":"32","author":"Jiang","year":"2015","journal-title":"J. Mech. Electr. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Qi, H., Qi, Y., Zhang, K., Zhai, Y., and Zhao, W. (2020). Detection Method Based on Automatic Visual Shape Clustering for Pin-Missing Defect in Transmission Lines. IEEE Trans. Instrum. Meas., 1.","DOI":"10.1109\/TIM.2020.2969057"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.ijepes.2017.12.016","article-title":"Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning","volume":"99","author":"Nguyen","year":"2018","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1109\/TDEI.2016.7736846","article-title":"Representation of binary feature pooling for detection of insulator strings in infrared images","volume":"23","author":"Zhao","year":"2016","journal-title":"IEEE Trans. Dielectr. Electr. Insul."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhaohui, L., Weiping, F., Zihui, Y., Yunpeng, L., Jiangwei, W., and Shaotong, P. (2017, January 23\u201326). Insulator identification method based on infrared image. Proceedings of the 2017 IEEE International Conference on Smart Grid and Smart Cities (ICSGSC), Singapore.","DOI":"10.1109\/ICSGSC.2017.8038564"},{"key":"ref_6","first-page":"175","article-title":"Detection method of porcelain insulator contamination grade based on infrared-thermal-image","volume":"32","author":"Fang","year":"2016","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1016\/j.procs.2017.05.398","article-title":"Research on Insulator Fault Diagnosis and Remote Monitoring System Based on Infrared Images","volume":"109","author":"Xi","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, X., and Zhang, Y. (2016, January 7\u201310). Insulator identification from aerial images using Support Vector Machine with background suppression. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.","DOI":"10.1109\/ICUAS.2016.7502544"},{"key":"ref_9","unstructured":"Liu, Y., Yong, J., Liu, L., Zhao, J., and Li, Z. (2016, January 11\u201313). The method of insulator recognition based on deep learning. Proceedings of the 2016 4th International Conference on Applied Robotics for the Power Industry (CARPI), Jinan, China."},{"key":"ref_10","unstructured":"Wu, Y. (2016). Research on Insulator Recognition Methods in Aerial Images Based on Machine Learning, North China Electric Power University."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Xu, G., Qi, Y., Liu, N., and Zhang, T. (2016, January 24\u201329). Multi-patch deep features for power line insulator status classification from aerial images. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727606"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., Malik, J., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Pdf ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_14","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.patrec.2017.05.013","article-title":"Face recognition against occlusions via colour fusion using 2D-MCF model and SRC","volume":"95","author":"Alrjebi","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1109\/TIP.2016.2629443","article-title":"Locally Supervised Deep Hybrid Model for Scene Recognition","volume":"26","author":"Guo","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hariharan, B., Arbelaez, P., Girshick, R., and Malik, J. (2015, January 7\u201312). Hypercolumns for object segmentation and fine-grained localization. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kulkarni, P., Zepeda, J., Jurie, F., P\u00e9rez, P., Chevallier, L., and Praveen, K. (2015, January 19\u201324). Hybrid multi-layer deep CNN\/aggregator feature for image classification. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QC, Australia.","DOI":"10.1109\/ICASSP.2015.7178196"},{"key":"ref_22","unstructured":"Yosinski, J., Clune, J., Nguyen, A., Fuchs, T., and Lipson, H. (2015, January 6\u201311). Understanding Neural Networks through Deep Visualization. Proceedings of the International Conference on Machine Learning (ICML), Lile, France."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., and Fergus, R. (2014, January 6\u201312). Visualizing and understanding computer vision. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"ref_24","unstructured":"Babenko, A., and Lempitsky, V. (2015, January 7\u201313). Aggregating Deep Convolutional Features for Image Retrieval. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile."},{"key":"ref_25","unstructured":"Zheng, L., Zhao, Y., Wang, S., Wang, J., and Tian, Q. (2016). Good Practice in CNN Feature Transfer. arXiv."},{"key":"ref_26","unstructured":"Zhang, X.-Y., Li, C., Shi, H., Zhu, X., Li, P., and Dong, J. (2020). AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization. IEEE Trans. Neural Networks Learn. Syst., 1\u201312."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.neucom.2015.03.056","article-title":"Update vs. upgrade: Modeling with indeterminate multi-class active learning","volume":"162","author":"Zhang","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, X.-Y., Shi, H., Li, C., Zheng, K., Zhu, X., and Duan, L. (2019, January 27\u201328). Learning Transferable Self-Attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.","DOI":"10.1609\/aaai.v33i01.33019227"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"J\u00e9gou, H., Douze, M., Schmid, C., and Perez, P. (2010, January 13\u201318). Aggregating local descriptors into a compact image representation. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540039"},{"key":"ref_30","first-page":"1704","article-title":"Aggregating Local Image Descriptors into Compact Codes","volume":"34","author":"Perronnin","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2868","DOI":"10.1109\/TIP.2017.2688133","article-title":"Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval","volume":"26","author":"Wei","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bau, D., Zhou, B., Khosla, A., Oliva, A., and Torralba, A. (2017, January 21\u201326). Network Dissection: Quantifying Interpretability of Deep Visual Representations. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.354"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., Komodakis, N., Wilson, R.C., Hancock, E.R., Smith, W.A.P., Pears, N.E., and Bors, A.G. (2016, January 19\u201322). Wide Residual Networks. Proceedings of the British Machine Vision Conference 2016, York, UK.","DOI":"10.5244\/C.30.87"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Quattoni, A., and Torralba, A. (2009, January 20\u201325). Recognizing indoor scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206537"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yao, B., Jiang, X., Khosla, A., Lin, A.L., Guibas, L., and Fei-Fei, L. (2011, January 6\u201313). Human action recognition by learning bases of action attributes and parts. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126386"},{"key":"ref_36","first-page":"1871","article-title":"LIBLINEAR: A library for large linear classification","volume":"9","author":"Fan","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1007\/978-3-319-10584-0_26","article-title":"Multi-scale Orderless Pooling of Deep Convolutional Activation Features","volume":"Volume 8695","author":"Gong","year":"2014","journal-title":"Proceedings of the Lecture Notes in Computer Science"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Azizpour, H., Razavian, A.S., Sullivan, J., Maki, A., and Carlsson, S. (2015, January 7\u201312). From generic to specific deep representations for visual recognition. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301270"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liu, L., Shen, C., and Hengel, A.V.D. (2015, January 7\u201312). The treasure beneath convolutional layers: Cross-convolutional-layer pooling for image classification. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299107"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 Million Image Database for Scene Recognition","volume":"40","author":"Zhou","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/419\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:16:26Z","timestamp":1760174186000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/419"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,8]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["e22040419"],"URL":"https:\/\/doi.org\/10.3390\/e22040419","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,8]]}}}