{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T05:32:22Z","timestamp":1762061542316,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T00:00:00Z","timestamp":1659916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ZhongYuan Science and Technology Innovation Leading Talent Program","award":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"],"award-info":[{"award-number":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"]}]},{"name":"National Natural Science Foundation of China","award":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"],"award-info":[{"award-number":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"]}]},{"name":"Key Research Project of Colleges and Universities in Henan Province","award":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"],"award-info":[{"award-number":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"]}]},{"name":"Scientific Research Grants and Start-up Projects for Overseas Student","award":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"],"award-info":[{"award-number":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"]}]},{"DOI":"10.13039\/501100016360","name":"Major Project Achievement Cultivation Plan of Zhongyuan University of Technology","doi-asserted-by":"publisher","award":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"],"award-info":[{"award-number":["214200510013","62171318","21A510016","21A520052","HRSS2021-36","K2020ZDPY02"]}],"id":[{"id":"10.13039\/501100016360","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>With the development of convolutional neural networks, the effect of pedestrian detection has been greatly improved by deep learning models. However, the presence of pseudo pedestrians will lead to accuracy reduction in pedestrian detection. To solve the problem that the existing pedestrian detection algorithms cannot distinguish pseudo pedestrians from real pedestrians, a real and pseudo pedestrian detection method with CA-YOLOv5s based on stereo image fusion is proposed in this paper. Firstly, the two-view images of the pedestrian are captured by a binocular stereo camera. Then, a proposed CA-YOLOv5s pedestrian detection algorithm is used for the left-view and right-view images, respectively, to detect the respective pedestrian regions. Afterwards, the detected left-view and right-view pedestrian regions are matched to obtain the feature point set, and the 3D spatial coordinates of the feature point set are calculated with Zhengyou Zhang\u2019s calibration method. Finally, the RANSAC plane-fitting algorithm is adopted to extract the 3D features of the feature point set, and the real and pseudo pedestrian detection is achieved by the trained SVM. The proposed real and pseudo pedestrian detection method with CA-YOLOv5s based on stereo image fusion effectively solves the pseudo pedestrian detection problem and efficiently improves the accuracy. Experimental results also show that for the dataset with real and pseudo pedestrians, the proposed method significantly outperforms other existing pedestrian detection algorithms in terms of accuracy and precision.<\/jats:p>","DOI":"10.3390\/e24081091","type":"journal-article","created":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T21:09:18Z","timestamp":1659992958000},"page":"1091","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Real and Pseudo Pedestrian Detection Method with CA-YOLOv5s Based on Stereo Image Fusion"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9215-0572","authenticated-orcid":false,"given":"Xiaowei","family":"Song","sequence":"first","affiliation":[{"name":"School of Electronic and Information, Zhongyuan University of Technology, Zhengzhou 450007, China"},{"name":"Dongjing Avenue Campus, Kaifeng University, Kaifeng 475004, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2694-1437","authenticated-orcid":false,"given":"Gaoyang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electronic and Information, Zhongyuan University of Technology, Zhengzhou 450007, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4864-2702","authenticated-orcid":false,"given":"Lei","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information, Zhongyuan University of Technology, Zhengzhou 450007, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7551-6712","authenticated-orcid":false,"given":"Luxiao","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Electronic and Information, Zhongyuan University of Technology, Zhengzhou 450007, China"}]},{"given":"Chunping","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4714-3311","authenticated-orcid":false,"given":"Zixiang","family":"Xiong","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Pattanayak, S., Ningthoujam, C., and Pradhan, N. (2022). A survey on pedestrian detection system using computer vision and deep learning. Advanced Computational Paradigms and Hybrid Intelligent Computing, Springer.","DOI":"10.1007\/978-981-16-4369-9_41"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1109\/TMM.2019.2929005","article-title":"WiderPerson: A Diverse Dataset for Dense Pedestrian Detection in the Wild","volume":"22","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1109\/TPAMI.2014.2300479","article-title":"Fast Feature Pyramids for Object Detection","volume":"36","author":"Appel","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3210","DOI":"10.1109\/TIP.2017.2694224","article-title":"Learning Multilayer Channel Features for Pedestrian Detection","volume":"26","author":"Cao","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2019.12.110","article-title":"Hybrid channel based pedestrian detection","volume":"389","author":"Tesema","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_7","first-page":"2969239","article-title":"Towards real-time object detection with region proposal networks","volume":"9199","author":"Faster","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Ssd: Single shot multibox detector. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s13640-020-00507-5","article-title":"A semi-supervised convolutional neural network based on subspace representation for image classification","volume":"2020","author":"Gatto","year":"2020","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_10","unstructured":"Cheng, H., Zheng, N., and Qin, J. (2005, January 6\u20138). Pedestrian detection using sparse Gabor filter and support vector machine. Proceedings of the IEEE Proceedings. Intelligent Vehicles Symposium, Las Vegas, NV, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Doll\u00e1r, P., Tu, Z., Perona, P., and Belongie, S. (2009). Integral channel features. Proceedings of the British Machine Vision Conference, BMVC Press.","DOI":"10.5244\/C.23.91"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mao, J., Xiao, T., Jiang, Y., and Cao, Z. (2017, January 21\u201326). What can help pedestrian detection?. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.639"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yu, X., Si, Y., and Li, L. (2019, January 11\u201313). Pedestrian detection based on improved Faster RCNN algorithm. Proceedings of the 2019 IEEE\/CIC International Conference on Communications in China (ICCC), Changchun, China.","DOI":"10.1109\/ICCChina.2019.8855960"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4913","DOI":"10.1109\/TPAMI.2021.3076733","article-title":"From handcrafted to deep features for pedestrian detection: A survey","volume":"44","author":"Cao","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.neucom.2020.05.019","article-title":"Asymmetric multi-stage CNNs for small-scale pedestrian detection","volume":"409","author":"Zhang","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, H., Guo, M., Nedjah, N., Zhang, J., and Li, P. (2022). Vehicle and pedestrian detection algorithm based on lightweight YOLOv3-promote and semi-precision acceleration. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2021.3137253"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3608","DOI":"10.1109\/TCSVT.2018.2883558","article-title":"Multi-Grained Deep Feature Learning for Robust Pedestrian Detection","volume":"29","author":"Lin","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8889","DOI":"10.1109\/TIE.2019.2945295","article-title":"Deep Learning Approaches on Pedestrian Detection in Hazy Weather","volume":"67","author":"Li","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1640","DOI":"10.1109\/TITS.2018.2807199","article-title":"An Extended Filtered Channel Framework for Pedestrian Detection","volume":"19","author":"You","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2019","DOI":"10.1177\/0144598720913964","article-title":"The algorithm of nighttime pedestrian detection in intelligent surveillance for renewable energy power stations","volume":"38","author":"Peng","year":"2020","journal-title":"Energy Explor. Exploit."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Noh, J., Lee, S., Kim, B., and Kim, G. (2018, January 18\u201323). Improving Occlusion and Hard Negative Handling for Single-Stage Pedestrian Detectors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00107"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lombacher, J., Hahn, M., Dickmann, J., and W\u00f6hler, C. (2016, January 19\u201320). Potential of radar for static object classification using deep learning methods. Proceedings of the 2016 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM), San Diego, CA, USA.","DOI":"10.1109\/ICMIM.2016.7533931"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shakeri, A., Moshiri, B., and Garakani, H.G. (2018, January 17\u201319). Pedestrian Detection Using Image Fusion and Stereo Vision in Autonomous Vehicles. Proceedings of the 2018 9th International Symposium on Telecommunications (IST), Tehran, Iran.","DOI":"10.1109\/ISTEL.2018.8661069"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"11469","DOI":"10.1109\/JSEN.2019.2929527","article-title":"Occluded Pedestrian Detection Based on Depth Vision Significance in Biomimetic Binocular","volume":"19","author":"Wei","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1729881420987400","DOI":"10.1177\/1729881420987400","article-title":"Light-field imaging for distinguishing fake pedestrians using convolutional neural networks","volume":"18","author":"Zhao","year":"2021","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Diner, D.B., and Fender, D.H. (1993). Stereoscopic Properties of the Human Visual System. Human Engineering in Stereoscopic Viewing Devices, Springer.","DOI":"10.1007\/978-1-4899-1274-9"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/B978-0-444-52903-9.00007-8","article-title":"Anatomy and physiology of the afferent visual system","volume":"102","author":"Prasad","year":"2011","journal-title":"Handb. Clin. Neurol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., and Hu, Q. (2020, January 14\u201319). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hou, Q., Zhou, D., and Feng, J. (2021, January 20\u201325). Coordinate attention for efficient mobile network design. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01350"},{"key":"ref_32","unstructured":"Zhu, X., Cheng, D., Zhang, Z., Lin, S., and Dai, J. (November, January 27). An Empirical Study of Spatial Attention Mechanisms in Deep Networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/JAS.2022.105686","article-title":"SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer","volume":"9","author":"Ma","year":"2022","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.inffus.2018.09.004","article-title":"FusionGAN: A generative adversarial network for infrared and visible image fusion","volume":"48","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/TPAMI.2020.3012548","article-title":"U2Fusion: A unified unsupervised image fusion network","volume":"44","author":"Xu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.neucom.2020.01.085","article-title":"Recent advances in deep learning for object detection","volume":"396","author":"Wu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201312). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Boston, MA, USA.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201323). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_42","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Liu, S., and Huang, D. (2018, January 8\u201314). Receptive field block net for accurate and fast object detection. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_24"},{"key":"ref_44","unstructured":"Zhao, Q., Sheng, T., Wang, Y., Tang, Z., Chen, Y., Cai, L., and Ling, H. (February, January 27). M2det: A single-shot object detector based on multi-level feature pyramid network. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jiao, S., Miao, T., and Guo, H. (2021). Image Target Detection Method Using the Yolov5 Algorithm. 3D Imaging Technologies\u2014Multidimensional Signal Processing and Deep Learning, Springer.","DOI":"10.1007\/978-981-16-3180-1_40"},{"key":"ref_47","unstructured":"(2022, August 05). Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/j.patrec.2010.10.009","article-title":"CC-RANSAC: Fitting planes in the presence of multiple surfaces in range data","volume":"32","author":"Gallo","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"15335","DOI":"10.1109\/TVT.2020.3040014","article-title":"Highly Accurate Scale Estimation from Multiple Keyframes Using RANSAC Plane Fitting with a Novel Scoring Method","volume":"69","author":"Fan","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1007\/s11263-018-1117-z","article-title":"Locality preserving matching","volume":"127","author":"Ma","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Fan, A., Ma, J., Jiang, X., and Ling, H. (2021). Efficient deterministic search with robust loss functions for geometric model fitting. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2021.3109784"},{"key":"ref_52","unstructured":"State Bureau of Technical Supervision (2022, August 05). Chinese Adult Body Size: GB\/T 10000-1988. Available online: https:\/\/www.chinesestandard.net\/PDF.aspx\/GBT10000-1988."},{"key":"ref_53","first-page":"403","article-title":"Bayes\u2019 theorem and naive Bayes classifier","volume":"1","author":"Berrar","year":"2019","journal-title":"Encycl. Bioinform. Comput. Biol."},{"key":"ref_54","first-page":"246","article-title":"Decision tree classifier: A detailed survey","volume":"12","author":"Priyanka","year":"2020","journal-title":"Int. J. Inf. Decis. Sci."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"14346","DOI":"10.1016\/j.eswa.2011.04.222","article-title":"Forecasting stock indices with back propagation neural network","volume":"38","author":"Wang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.neucom.2019.10.118","article-title":"A comprehensive survey on support vector machine classification: Applications, challenges and trends","volume":"408","author":"Cervantes","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Wang, L. (2005). Support Vector Machines: Theory and Applications, Springer Science & Business Media.","DOI":"10.1007\/b95439"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/8\/1091\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:05:40Z","timestamp":1760141140000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/8\/1091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,8]]},"references-count":57,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["e24081091"],"URL":"https:\/\/doi.org\/10.3390\/e24081091","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,8,8]]}}}