{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T10:20:44Z","timestamp":1783938044722,"version":"3.55.0"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,12,27]],"date-time":"2020-12-27T00:00:00Z","timestamp":1609027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["KYCX20_0886"],"award-info":[{"award-number":["KYCX20_0886"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Pedestrian detection is widely used in cooperative vehicle infrastructure systems. Traditional pedestrian detection methods perform sufficiently well under sunny scenarios and obtain trustworthy traffic data. However, the detection drastically decreases under rainy scenarios. This study proposes a pedestrian detection algorithm with a de-raining module that improves detection accuracy under various rainy scenarios. Specifically, this algorithm determines the density information of rain and effectively removes rain streaks through the de-raining module. Then the algorithm detects pedestrians as a pair of keypoints through the pedestrian detection module to solve the problem of occlusion. Furthermore, a new pedestrian dataset containing rain density labels is established and used to train the algorithm. For the scenarios of light, medium, and heavy rain, extensive experiments on synthetic datasets demonstrate that the proposed algorithm increases AP (average precision) of pedestrian detection by 21.1%, 48.1%, and 60.9%. Moreover, the proposed algorithm performs well on real datasets and achieves improvements over the state-of-the-art methods, which reveals that the proposed algorithm can significantly improve the accuracy of pedestrian detection in rainy scenarios.<\/jats:p>","DOI":"10.3390\/s21010112","type":"journal-article","created":{"date-parts":[[2020,12,27]],"date-time":"2020-12-27T20:52:21Z","timestamp":1609102341000},"page":"112","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A Novel Algorithm for Detecting Pedestrians on Rainy Image"],"prefix":"10.3390","volume":"21","author":[{"given":"Yuhang","family":"Liu","sequence":"first","affiliation":[{"name":"College of Automobile and Traffic Engineering, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianxiao","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Automobile and Traffic Engineering, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuchen","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Automobile and Traffic Engineering, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenhong","family":"Zong","sequence":"additional","affiliation":[{"name":"College of Automobile and Traffic Engineering, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,27]]},"reference":[{"key":"ref_1","first-page":"13","article-title":"Deviation between Actual and Shortest Travel Time Paths for Commuters","volume":"144","author":"Tang","year":"2018","journal-title":"J. Transp. Eng. Pt. A-Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chen, X.-Z., Chang, C.-M., Yu, C.-W., and Chen, Y.-L. (2020). A Real-Time Vehicle Detection System under Various Bad Weather Conditions Based on a Deep Learning Model without Retraining. Sensors, 20.","DOI":"10.3390\/s20205731"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kallioras, N.A., and Lagaros, N.D. (2020). DL-SCALE: A novel deep learning-based model order upscaling scheme for solving topology optimization problems. Neural Comput. Appl.","DOI":"10.1007\/s00521-020-05480-8"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, X., Wu, J., Lin, Z., Liu, H., and Zha, H. (2018, January 8\u201314). Recurrent squeeze-and-excitation context aggregation net for single image deraining. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_16"},{"key":"ref_5","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fu, X.Y., Huang, J.B., Zeng, D.L., Huang, Y., Ding, X.H., Paisley, J., and IEEE (2016, January 21\u201326). Removing rain from single images via a deep detail network. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.186"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yang, W.H., Tan, R.T., Feng, J.S., Liu, J.Y., Guo, Z.M., Yan, S.C., and IEEE (2016, January 21\u201326). Deep Joint Rain Detection and Removal from a Single Image. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.183"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, H., Patel, V.M., and IEEE (2018, January 18\u201322). Density-aware Single Image De-raining using a Multi-stream Dense Network. Proceedings of the 2018 IEEE\/Cvf Conference on Computer Vision and Pattern Recognition, Salk Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00079"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mairal, J., Bach, F., Ponce, J., and Sapiro, G. (2009, January 14\u201318). Online dictionary learning for sparse coding. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553463"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1006\/dspr.1999.0361","article-title":"Speaker verification using adapted Gaussian mixture models","volume":"10","author":"Reynolds","year":"2000","journal-title":"Digit. Signal Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1109\/TPAMI.2012.88","article-title":"Robust Recovery of Subspace Structures by Low-Rank Representation","volume":"35","author":"Liu","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1109\/TIP.2011.2179057","article-title":"Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition","volume":"21","author":"Kang","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Luo, Y., Xu, Y., Ji, H., and IEEE (2015, January 11\u201318). Removing rain from a single image via discriminative sparse coding. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.388"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gu, S., Meng, D., Zuo, W., Zhang, L., and IEEE (2017, January 22\u201327). Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.189"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chang, Y., Yan, L.X., Zhong, S., and IEEE (2017, January 22\u201327). Transformed Low-rank Model for Line Pattern Noise Removal. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.191"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2944","DOI":"10.1109\/TIP.2017.2691802","article-title":"Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal","volume":"26","author":"Fu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","unstructured":"Yang, W., Tan, R.T., Feng, J., Liu, J., Guo, Z., and Yan, S. (2016). Joint rain detection and removal via iterative region dependent multi-task learning. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3943","DOI":"10.1109\/TCSVT.2019.2920407","article-title":"Image de-raining using a conditional generative adversarial network","volume":"30","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ren, D., Zuo, W., Hu, Q., Zhu, P., Meng, D., and Soc, I.C. (2019, January 15\u201320). Progressive Image Deraining Networks: A Better and Simpler Baseline. Proceedings of the 2019 IEEE\/Cvf Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00406"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cai, L., Li, S.-Y., Ren, D., Wang, P., and IEEE (2019, January 22\u201325). Dual Recursive Network for Fast Image Deraining. Proceedings of the 2019 IEEE International Conference on Image Processing, Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803308"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., Malik, J., and IEEE (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Girshick, R., and IEEE (2015, January 7\u201313). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., Farhadi, A., and IEEE (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Redmon, J., Farhadi, A., and IEEE (2016, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_26","unstructured":"Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). Dssd: Deconvolutional single shot detector. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal Loss for Dense Object Detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1007\/s11263-019-01204-1","article-title":"CornerNet: Detecting Objects as Paired Keypoints","volume":"128","author":"Law","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","unstructured":"Law, H., Teng, Y., Russakovsky, O., and Deng, J. (2019). Cornernet-lite: Efficient keypoint based object detection. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., He, T., and IEEE (2019, January 27\u201328). FCOS: Fully Convolutional One-Stage Object Detection. Proceedings of the 2019 IEEE\/Cvf International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_32","unstructured":"Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., and Weinberger, K.Q. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems 27, Neural Information Processing Systems (Nips)."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Qian, R., Tan, R.T., Yang, W.H., Su, J.J., Liu, J.Y., and IEEE (2018, January 18\u201323). Attentive Generative Adversarial Network for Raindrop Removal from A Single Image. Proceedings of the 2018 IEEE\/Cvf Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00263"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1109\/TMM.2017.2648498","article-title":"Diversified Visual Attention Networks for Fine-Grained Object Classification","volume":"19","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/978-3-319-46484-8_29","article-title":"Stacked Hourglass Networks for Human Pose Estimation","volume":"Volume 9912","author":"Leibe","year":"2016","journal-title":"Computer Vision\u2014Eccv 2016, Pt VIII"},{"key":"ref_36","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_38","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Pixels to Graphs by Associative Embedding. Advances in Neural Information Processing Systems 30, Neural Information Processing Systems (Nips)."},{"key":"ref_39","first-page":"13","article-title":"Lagrangian Relaxation for the Multiple Constrained Robust Shortest Path Problem","volume":"2019","author":"Pan","year":"2019","journal-title":"Math. Probl. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1007\/978-3-319-10602-1_48","article-title":"Microsoft COCO: Common Objects in Context","volume":"Volume 8693","author":"Fleet","year":"2014","journal-title":"Computer Vision\u2014Eccv 2014, Pt V"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/112\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:46:35Z","timestamp":1760179595000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/112"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,27]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010112"],"URL":"https:\/\/doi.org\/10.3390\/s21010112","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,27]]}}}