{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T18:23:29Z","timestamp":1775845409684,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,5]],"date-time":"2021-02-05T00:00:00Z","timestamp":1612483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFB0105002"],"award-info":[{"award-number":["2018YFB0105002"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Intelligent transportation systems (ITSs) play an increasingly important role in traffic management and traffic safety. Smart cameras are the most widely used sensors in ITSs. However, cameras suffer from a reduction in detection and positioning accuracy due to target occlusion and external environmental interference, which has become a bottleneck restricting ITS development. This work designs a stable perception system based on a millimeter-wave radar and camera to address these problems. Radar has better ranging accuracy and weather robustness, which is a better complement to camera perception. Based on an improved Gaussian mixture probability hypothesis density (GM-PHD) filter, we also propose an optimal attribute fusion algorithm for target detection and tracking. The algorithm selects the sensors\u2019 optimal measurement attributes to improve the localization accuracy while introducing an adaptive attenuation function and loss tags to ensure the continuity of the target trajectory. The verification experiments of the algorithm and the perception system demonstrate that our scheme can steadily output the classification and high-precision localization information of the target. The proposed framework could guide the design of safer and more efficient ITSs with low costs.<\/jats:p>","DOI":"10.3390\/s21041116","type":"journal-article","created":{"date-parts":[[2021,2,5]],"date-time":"2021-02-05T08:33:48Z","timestamp":1612514028000},"page":"1116","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Robust Target Detection and Tracking Algorithm Based on Roadside Radar and Camera"],"prefix":"10.3390","volume":"21","author":[{"given":"Jie","family":"Bai","sequence":"first","affiliation":[{"name":"Institute of Intelligent Vehicles, School of Automotive Studies, Tongji University, Shanghai 201804, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7850-1866","authenticated-orcid":false,"given":"Sen","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Vehicles, School of Automotive Studies, Tongji University, Shanghai 201804, China"}]},{"given":"Han","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Vehicles, School of Automotive Studies, Tongji University, Shanghai 201804, China"}]},{"given":"Libo","family":"Huang","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Vehicles, School of Automotive Studies, Tongji University, Shanghai 201804, China"}]},{"given":"Ping","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, Tongji University, Shanghai 201804, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,5]]},"reference":[{"key":"ref_1","unstructured":"WHO (2020, December 18). Global Status Report on Road Safety, Available online: http:\/\/www.who.int\/violence_injury_prevention\/road_traffic\/en\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Abdelkader, G., and Elgazzar, K. (2020, January 2\u201316). Connected Vehicles: Towards Accident-Free Intersections. Proceedings of the 2020 IEEE 6th World Forum on Internet of Things (WF-IoT), New Orleans, LA, USA.","DOI":"10.1109\/WF-IoT48130.2020.9221470"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8591623","DOI":"10.1155\/2019\/8591623","article-title":"Effects of on-Board Unit on Driving Behavior in Connected Vehicle Traffic Flow","volume":"2019","author":"Chang","year":"2019","journal-title":"J. Adv. Transp."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, H., Zhao, G., Qin, L., Aizeke, H., and Yang, Y. (2020). A Survey of Safety Warnings Under Connected Vehicle Environments. IEEE Trans. Intell. Transp. Syst., in press.","DOI":"10.1109\/TITS.2020.3026309"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/TITS.2014.2330199","article-title":"Artificial Co-Drivers as a Universal Enabling Technology for Future Intelligent Vehicles and Transportation Systems","volume":"16","author":"Lio","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Guerrero-Ib\u00e1\u00f1ez, J., Zeadally, S., and Contreras-Castillo, J. (2018). Sensor Technologies for Intelligent Transportation Systems. Sensors, 18.","DOI":"10.3390\/s18041212"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/JIOT.2014.2327587","article-title":"Connected Vehicles: Solutions and Challenges","volume":"1","author":"Ning","year":"2014","journal-title":"IEEE Internet Things J."},{"key":"ref_8","first-page":"70","article-title":"Vehicle-to-Everything (v2x) Services Supported by LTE-Based Systems and 5G","volume":"1","author":"Chen","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3872","DOI":"10.1109\/JIOT.2020.2974823","article-title":"A Vision of C-V2X: Technologies, Field Testing and Challenges with Chinese Development","volume":"7","author":"Chen","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, C., Liu, B., Wan, S., Qiao, P., and Pei, Q. (2020). An Edge Traffic Flow Detection Scheme Based on Deep Learning in an Intelligent Transportation System. IEEE Trans. Intell. Transp. Syst., in press.","DOI":"10.1109\/TITS.2020.3025687"},{"key":"ref_11","unstructured":"Souza, A.M.D., Oliveira, H.F., Zhao, Z., Braun, T., and Loureiro, A.A.F. (2020). Enhancing Sensing and Decision-Making of Automated Driving Systems with Multi-Access Edge Computing and Machine Learning. IEEE Intell. Transp. Syst. Mag., in press."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/MCOM.2018.1701065","article-title":"A City-Wide Real-Time Traffic Management System: Enabling Crowdsensing in Social Internet of Vehicles","volume":"56","author":"Wang","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lefevre, S., Petit, J., Bajcsy, R., Laugier, C., and Kargl, F. (2013, January 16\u201318). Impact of V2X privacy strategies on Intersection Collision Avoidance systems. Proceedings of the 2013 IEEE Vehicular Networking Conference, Boston, MA, USA.","DOI":"10.1109\/VNC.2013.6737592"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhao, H., Cui, J., Zha, H., Katabira, K., Shao, X., and Shibasaki, R. (2008, January 12\u201315). Monitoring an intersection using a network of laser scanners. Proceedings of the 2008 11th International IEEE Conference on Intelligent Transportation Systems, Beijing, China.","DOI":"10.1109\/ITSC.2008.4732613"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, C.C., Lo, T.C., and Yang, S.W. (2007, January 10\u201314). Interacting Object Tracking in Crowded Urban Areas. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364192"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Meissner, D., and Dietmayer, K. (2010, January 21\u201324). Simulation and calibration of infrastructure based laser scanner networks at intersections. Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, San Diego, CA, USA.","DOI":"10.1109\/IVS.2010.5547970"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1109\/34.868684","article-title":"A Bayesian Computer Vision System for Modeling Human Interaction","volume":"22","author":"Oliver","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Babaei, P. (2010, January 15\u201317). Vehicles tracking and classification using traffic zones in a hybrid scheme for intersection traffic management by smart cameras. Proceedings of the 2010 International Conference on Signal and Image Processing, Chennai, India.","DOI":"10.1109\/ICSIP.2010.5697440"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1109\/TVT.2012.2186323","article-title":"Vehicular Traffic Surveillance and Road Lane Detection Using Radar Interferometry","volume":"61","year":"2012","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1624","DOI":"10.1109\/TGRS.2008.916465","article-title":"Traffic Surveillance System Based on a High-Resolution Radar","volume":"46","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MITS.2009.933864","article-title":"Sensing an intersection using a network of laser scanners and video cameras","volume":"1","author":"Zhao","year":"2009","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.mcm.2011.02.043","article-title":"Automated traffic surveillance using fusion of Doppler radar and video information","volume":"54","author":"Roy","year":"2011","journal-title":"Math. Comput. Model."},{"key":"ref_23","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020, December 18). YOLOv4: Optimal Speed and Accuracy of Object Detection. Available online: https:\/\/arxiv.org\/abs\/2004.10934."},{"key":"ref_24","unstructured":"Tan, M., and Le, Q.V. (2019, January 9\u201315). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proceeding of the 36th International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hua, S., and Anastasiu, D.C. (2019, January 4\u20139). Effective Vehicle Tracking Algorithm for Smart Traffic Networks. Proceedings of the 2019 IEEE International Conference on Service-Oriented System Engineering, San Francisco East Bay, CA, USA.","DOI":"10.1109\/SOSE.2019.00019"},{"key":"ref_26","unstructured":"Xun, L., Lei, H., Li, L., and Liang, H. (2016, January 14\u201317). A method of vehicle trajectory tracking and prediction based on traffic video. Proceedings of the 2016 2nd IEEE International Conference on Computer and Communications, Chengdu, China."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1049\/iet-its.2019.0665","article-title":"Vision-based approach for predicting the probability of vehicle\u2013pedestrian collisions at intersections","volume":"14","author":"Zhou","year":"2020","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5597","DOI":"10.1109\/JSTARS.2020.3024921","article-title":"Vehicle Tracking and Speed Estimation from Roadside Lidar","volume":"13","author":"Zhang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4086","DOI":"10.1109\/TITS.2019.2936498","article-title":"Automatic Background Construction and Object Detection Based on Roadside LiDAR","volume":"21","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wu, J., Xu, H., Zhang, Y., Tian, Y., and Song, X. (2020). Real-Time Queue Length Detection with Roadside LiDAR Data. Sensors, 20.","DOI":"10.3390\/s20082342"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"161594","DOI":"10.1109\/ACCESS.2019.2951763","article-title":"Automatic Vehicle-Pedestrian Conflict Identification with Trajectories of Road Users Extracted from Roadside LiDAR Sensors Using a Rule-based Method","volume":"7","author":"Lv","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","unstructured":"Liu, W.J., Kasahara, T., Yasugi, M., and Nakagawa, Y. (2016, January 5\u20137). Pedestrian recognition using 79GHz radars for intersection surveillance. Proceedings of the 2016 European Radar Conference, London, UK."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, W., Muramatsu, S., and Okubo, Y. (2018, January 15\u201317). Cooperation of V2I\/P2I Communication and Roadside Radar Perception for the Safety of Vulnerable Road Users. Proceedings of the 2018 16th International Conference on Intelligent Transportation Systems Telecommunications (ITST), Lisboa, Portugal.","DOI":"10.1109\/ITST.2018.8566704"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Arguello, A.G., and Berges, D. (2018, January 26\u201328). Radar Classification for Traffic Intersection Surveillance based on Micro-Doppler Signatures. Proceedings of the 2018 15th European Radar Conference (EuRAD), Madrid, Spain.","DOI":"10.23919\/EuRAD.2018.8546545"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"837","DOI":"10.3390\/s18030837","article-title":"On the Deployment and Noise Filtering of Vehicular Radar Application for Detection Enhancement in Roads and Tunnels","volume":"18","author":"Kim","year":"2018","journal-title":"Sensors"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Fu, Y., Tian, D., Duan, X., Zhou, J., Lang, P., Lin, C., and You, X. (2020, January 19\u201323). A Camera\u2013Radar Fusion Method Based on Edge Computing. Proceedings of the 2020 IEEE International Conference on Edge Computing (EDGE), Beijing, China.","DOI":"10.1109\/EDGE50951.2020.00009"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, J.G., Chen, S.J., Zhou, L.B., Wan, K.W., and Yau, W.Y. (2018, January 18\u201321). Vehicle Detection and Width Estimation in Rain by Fusing Radar and Vision. Proceedings of the 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore.","DOI":"10.1109\/ICARCV.2018.8581246"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Schller, C., Schnettler, M., Krmmer, A., Hinz, G., and Knoll, A. (2019, January 27\u201330). Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917135"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kaul, P., Martini, D.D., Gadd, M., and Newman, P. (November, January 19). RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radar. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304674"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mohammed, A.S., Amamou, A., Ayevide, F.K., Kelouwani, S., Agbossou, K., and Zioui, N. (2020). The perception system of intelligent ground vehicles in all weather conditions: A systematic literature review. Sensors, 20.","DOI":"10.3390\/s20226532"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hasirlioglu, S., and Riener, A. (2017, January 16\u201319). Introduction to rain and fog attenuation on automotive surround sensors. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317823"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kutila, M., Pyykonen, P., Ritter, W., Sawade, O., and Schaufele, B. (2016, January 1\u20134). Automotive LIDAR sensor development scenarios for harsh weather conditions. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795565"},{"key":"ref_43","unstructured":"Buller, W., Xique, I.J., Fard, Z.B., Dennis, E., and Hart, B. (2018, January 27\u201330). Evaluating Complementary Strengths and Weaknesses of ADAS Sensors. Proceedings of the IEEE 88th Vehicular Technology Conference (VTC-Fall), Chicago, IL, USA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4091","DOI":"10.1109\/TSP.2006.881190","article-title":"The Gaussian Mixture Probability Hypothesis Density Filter","volume":"54","author":"Vo","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1109\/TSP.2007.908968","article-title":"Bayesian Filtering with Random Finite Set Observations","volume":"56","author":"Vo","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MSP.2016.2628914","article-title":"Automotive Radars: A review of signal processing techniques","volume":"34","author":"Patole","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1162\/neco_a_00990","article-title":"Deep convolutional neural networks for image classification: A comprehensive review","volume":"29","author":"Rawat","year":"2017","journal-title":"Neural Comput."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.patcog.2017.08.014","article-title":"A review of recent advances in lane detection and departure warning system","volume":"73","author":"Narote","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.3390\/s150102161","article-title":"Fast Traffic Sign Recognition with a Rotation Invariant Binary Pattern Based Feature","volume":"15","author":"Yin","year":"2015","journal-title":"Sensors"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"102907","DOI":"10.1016\/j.cviu.2020.102907","article-title":"UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Tracking","volume":"193","author":"Wen","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A Flexible New Technique for Camera Calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Domhof, J., Kooij, J.F.P., and Kooij, D.M. (2019, January 20\u201324). An Extrinsic Calibration Tool for Radar, Camera and Lidar. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794186"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1016\/S0262-8856(02)00054-9","article-title":"A new approach to vanishing point detection in architectural environments","volume":"20","author":"Rother","year":"2002","journal-title":"Image Vis. Comput."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"3497","DOI":"10.1109\/TSP.2011.2128316","article-title":"CPHD Filtering with Unknown Clutter Rate and Detection Profile","volume":"59","author":"Mahler","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Si, W., Wang, L., and Qu, Z. (2016). Multi-Target Tracking Using an Improved Gaussian Mixture CPHD Filter. Sensors, 16.","DOI":"10.3390\/s16111964"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1016\/j.sigpro.2009.02.006","article-title":"Gaussian mixture CPHD filter with gating technique","volume":"89","author":"Zhang","year":"2009","journal-title":"Signal Process."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"3452","DOI":"10.1109\/TSP.2011.2140111","article-title":"A Metric for Performance Evaluation of Multi-Target Tracking Algorithms","volume":"59","author":"Ristic","year":"2011","journal-title":"IEEE Trans. Signal Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1116\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:20:04Z","timestamp":1760160004000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1116"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,5]]},"references-count":57,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041116"],"URL":"https:\/\/doi.org\/10.3390\/s21041116","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,5]]}}}