{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T10:33:25Z","timestamp":1773916405956,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T00:00:00Z","timestamp":1773705600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Fundamental Research Funds for the Central Universities of Beijing Jiaotong University","award":["2022JBZY031"],"award-info":[{"award-number":["2022JBZY031"]}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program","doi-asserted-by":"crossref","award":["2022YFB4300400"],"award-info":[{"award-number":["2022YFB4300400"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In autonomous driving, deep convolutional neural networks face a core conflict between computational efficiency and safety-critical robustness on resource-constrained onboard computing units. Dominant structural pruning, based on weight magnitude or geometric statistics, fails in long-tailed traffic scenarios by equating parameter magnitude with feature importance and pruning critical filters in the tail classes. To address this, we propose a structural pruning framework that evaluates the semantic utility of features using weighted copula entropy rather than relying solely on their magnitude. Our novel approach integrates Elastic Net regularization for inducing sparsity and weighted copula entropy for unbiased information-theoretic feature selection. By incorporating inverse class frequency weighting into empirical Copula estimation, we decouple feature relevance from sample abundance, ensuring the preservation of rare-class discriminators based on their information content rather than occurrence frequency. Furthermore, this metric is embedded into an enhanced max-relevance and min-redundancy algorithm to eliminate semantic redundancy while maintaining representational diversity. Extensive experiments on the BDD100K dataset with YOLOv5l and YOLOv8l architectures demonstrate that, at a 50% pruning rate, the proposed method reduces FLOPs and parameters by nearly 50%, with only 0.09% mAP@0.5 loss for YOLOv5l and 0.14% mAP@0.5 loss for YOLOv8l, while significantly improving the mAP of the extreme tail class Train from 0% to 3.84% and 2.76% to 5.12%, respectively. It achieves a more favorable trade-off between detection accuracy and computational efficiency than mainstream pruning approaches. This work provides a lightweight scheme for autonomous driving perception models and a new information-theoretic perspective for structured network pruning.<\/jats:p>","DOI":"10.3390\/e28030336","type":"journal-article","created":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T16:20:14Z","timestamp":1773764414000},"page":"336","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Weighted Copula Entropy for Structural Pruning in Long-Tailed Autonomous Driving Object Detection"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-3341-647X","authenticated-orcid":false,"given":"Yue","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Traffic and Transportation, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihui","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Traffic and Transportation, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Honghui","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Traffic and Transportation, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China"},{"name":"State Key Laboratory of Advanced Rail Autonomous Operation, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China"},{"name":"The Beijing Research Center of Urban Traffic Information Intelligent Sensing and Service Technologies, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,17]]},"reference":[{"key":"ref_1","unstructured":"(2021). Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles (Standard No. J3016_202104)."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Valverde, M., Moutinho, A., and Zacchi, J.-V. (2025). A Survey of Deep Learning-Based 3D Object Detection Methods for Autonomous Driving Across Different Sensor Modalities. Sensors, 25.","DOI":"10.3390\/s25175264"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11213","DOI":"10.1109\/TVT.2023.3266940","article-title":"Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach","volume":"72","author":"Wang","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"128098","DOI":"10.1016\/j.eswa.2025.128098","article-title":"Deep learning methods for autonomous driving scene understanding tasks: A review","volume":"287","author":"Awan","year":"2025","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_6","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1007\/s10462-025-11253-3","article-title":"YOLO Advances to Its Genesis: A Decadal and Comprehensive Review of the You Only Look Once (YOLO) Series","volume":"58","author":"Sapkota","year":"2025","journal-title":"Artif. Intell. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, J., Wu, Q.M.J., Zhang, N., Suto, K., and Zhong, L. (2025). Compressing Multi-Task Model for Autonomous Driving via Pruning and Knowledge Distillation. arXiv.","DOI":"10.1109\/AIoT66900.2025.00028"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, J., Du, F., Kang, W., Wang, C., and Li, G. (2025). Real-Time Lightweight Vehicle Object Detection via Layer-Adaptive Model Pruning. Electronics, 14.","DOI":"10.3390\/electronics14214149"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11804","DOI":"10.1007\/s10489-024-05747-w","article-title":"A comprehensive review of model compression techniques in machine learning","volume":"54","author":"Dantas","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"10558","DOI":"10.1109\/TPAMI.2024.3447085","article-title":"A Survey on Deep Neural Network Pruning: Taxonomy, Comparison, Analysis, and Recommendations","volume":"46","author":"Cheng","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 13\u201319). BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00271"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., and Zhang, C. (2017, January 22\u201329). Learning Efficient Convolutional Networks through Network Slimming. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.298"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Xu, X., Chen, Q., Xie, L., and Su, H. (2020, January 13\u201315). Batch-Normalization-based Soft Filter Pruning for Deep Convolutional Neural Networks. Proceedings of the 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, China.","DOI":"10.1109\/ICARCV50220.2020.9305319"},{"key":"ref_15","unstructured":"Lee, J., Park, S., Mo, S., Ahn, S., and Shin, J. (2020). Layer-adaptive Sparsity for the Magnitude-based Pruning. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, Y., Liu, P., Wang, Z., Hu, Z., and Yang, Y. (2019, January 15\u201320). Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00447"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lin, M., Ji, R., Wang, Y., Zhang, Y., Zhang, B., Tian, Y., and Shao, L. (2020, January 13\u201319). HRank: Filter Pruning Using High-Rank Feature Map. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00160"},{"key":"ref_18","unstructured":"Lin, W., Tang, S., Yu, C., Ye, P., Chen, T., and Yu, C. (2024, January 10\u201315). S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ganjdanesh, A., Gao, S., and Huang, H. (2024, January 17\u201321). Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.01520"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lin, H., Bai, H., Liu, Z., Hou, L., Sun, M., Song, L., Wei, Y., and Surr, Z. (2024, January 17\u201321). MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.02584"},{"key":"ref_21","unstructured":"Sabaghian, M., Keyvanrad, M.A., and Moghadami, S.M. (2025). A Novel Compression Framework for YOLOv8: Achieving Real-Time Aerial Object Detection on Edge Devices via Structured Pruning and Channel-Wise Distillation. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"193462","DOI":"10.1109\/ACCESS.2025.3632200","article-title":"KSG-YOLO: Application of YOLO-Based Detection with Knowledge Distillation and Structured Pruning in Green Assembly Building Scenarios","volume":"13","author":"Lin","year":"2025","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2194","DOI":"10.1049\/icp.2024.1427","article-title":"Structural Pruning for LiDAR 3D Detection Network by Dependency Graph","volume":"2023","author":"Xu","year":"2024","journal-title":"IET Conf. Proc."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Huang, H., Song, H.-J., and Zhao, Q. (2025). Explainable Structured Pruning of BERT via Mutual Information. Entropy, 27.","DOI":"10.3390\/e27121224"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"126297","DOI":"10.1016\/j.neucom.2023.126297","article-title":"Filter pruning by quantifying feature similarity and entropy of feature maps","volume":"544","author":"Liu","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Qiu, Y., Niu, L., Sha, F., Cheng, Z., and Yanai, K. (2025). Entropy-Guided Search Space Optimization for Efficient Neural Network Pruning. Algorithms, 18.","DOI":"10.3390\/a18120736"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lu, Y., Guan, Z., Yang, Y., Zhao, W., Gong, M., and Xu, C. (2024, January 20\u201327). Entropy Induced Pruning Framework for Convolutional Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), Vancouver, BC, Canada.","DOI":"10.1609\/aaai.v38i4.28184"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, J., Tang, A., Chen, W., and Zhang, Y. (2024, January 24\u201326). An Enhanced YOLOv8 Network Combined with Model Pruning for Defect Detection in Solar Cell Images. Proceedings of the 2024 IEEE 8th International Conference on Vision, Image and Signal Processing (ICVISP), Kunming, China.","DOI":"10.1109\/ICVISP64524.2024.10959386"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mu\u015fat, B., and Andonie, R. (2023, January 25\u201328). Accelerating Convolutional Neural Network Pruning via Spatial Aura Entropy. Proceedings of the 2023 27th International Conference Information Visualisation (IV), Tampere, Finland.","DOI":"10.1109\/IV60283.2023.00056"},{"key":"ref_30","unstructured":"Ma, J. (2025). Copula Entropy: Theory and Applications. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"297","DOI":"10.3103\/S1066530724700157","article-title":"Copula-Based Mutual Information Measures and Mutual Entropy: A Brief Survey","volume":"33","author":"Ghosh","year":"2024","journal-title":"Math. Methods Stat."},{"key":"ref_32","unstructured":"Ma, J. (2023). Two-Sample Test with Copula Entropy. arXiv."},{"key":"ref_33","unstructured":"Rostami, P., Sinha, N., Chenni, N., Kacem, A., El Rahman Shabayek, A., Shneider, C., and Aouada, D. (March, January 28). Information Theoretic Pruning of Coupled Channels in Deep Neural Networks. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), Tucson, AZ, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"8491","DOI":"10.1007\/s10489-024-05615-7","article-title":"An Effective Two-Stage Channel Pruning Method Based on Two-Dimensional Information Entropy","volume":"54","author":"Xu","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"158376","DOI":"10.1109\/ACCESS.2024.3480976","article-title":"YOLOv8n-FAWL: Object Detection for Autonomous Driving Using YOLOv8 Network on Edge Devices","volume":"12","author":"Cai","year":"2024","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MIS.2024.3350628","article-title":"Overcoming the Challenges of Long-Tail Distribution in Nighttime Vehicle Detection","volume":"39","author":"Zhang","year":"2024","journal-title":"IEEE Intell. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhao, J., Li, W., Zhu, B., Zhang, P., Hu, Z., and Meng, J. (2025). Corner Case Dataset for Autonomous Vehicle Testing Based on Naturalistic Driving Data. Smart Cities, 8.","DOI":"10.3390\/smartcities8040129"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"20729","DOI":"10.1109\/TITS.2024.3456232","article-title":"A More Balanced Loss-Reweighting Method for Long-Tailed Traffic Sign Detection and Recognition","volume":"25","author":"Wang","year":"2024","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ren, N., Li, X., Wu, Y., and Fu, Y. (2024). Mixed Mutual Transfer for Long-Tailed Image Classification. Entropy, 26.","DOI":"10.3390\/e26100839"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/3\/336\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T05:15:23Z","timestamp":1773897323000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/3\/336"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,17]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["e28030336"],"URL":"https:\/\/doi.org\/10.3390\/e28030336","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,17]]}}}