{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:18:59Z","timestamp":1767183539595,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T00:00:00Z","timestamp":1686528000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2022M712787","52178306"],"award-info":[{"award-number":["2022M712787","52178306"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2022M712787","52178306"],"award-info":[{"award-number":["2022M712787","52178306"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The estimation of vehicle loads is a rising research hotspot in bridge structure health monitoring (SHM). Traditional methods, such as the bridge weight-in-motion system (BWIM), are widely used but they fail to record the locations of vehicles on the bridges. Computer vision-based approaches are promising ways for vehicle tracking on bridges. Nevertheless, keeping track of vehicles from the video frames of multiple cameras without an overlapped visual field poses a challenge for the tracking of vehicles across the whole bridge. In this study, a method that was You Only Look Once v4 (YOLOv4)- and Omni-Scale Net (OSNet)-based was proposed to realize vehicle detecting and tracking across multiple cameras. A modified IoU-based tracking method was proposed to track a vehicle in adjacent video frames from the same camera, which takes both the appearance of vehicles and overlapping rates between the vehicle bounding boxes into consideration. The Hungary algorithm was adopted to match vehicle photos in various videos. Moreover, a dataset with 25,080 images of 1727 vehicles for vehicle identification was established to train and evaluate four models. Field validation experiments based on videos from three surveillance cameras were conducted to validate the proposed method. Experimental results show that the proposed method has an accuracy of 97.7% in terms of vehicle tracking in the visual field of a single camera and over 92.5% in tracking across multiple cameras, which can contribute to the acquisition of the temporal\u2013spatial distribution of vehicle loads on the whole bridge.<\/jats:p>","DOI":"10.3390\/s23125510","type":"journal-article","created":{"date-parts":[[2023,6,13]],"date-time":"2023-06-13T02:00:45Z","timestamp":1686621645000},"page":"5510","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Identification and Tracking of Vehicles between Multiple Cameras on Bridges Using a YOLOv4 and OSNet-Based Method"],"prefix":"10.3390","volume":"23","author":[{"given":"Tao","family":"Jin","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Zhejiang University, Hangzhou 310058, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0012-5842","authenticated-orcid":false,"given":"Xiaowei","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Zhejiang University, Hangzhou 310058, China"}]},{"given":"Zhexun","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Zhejiang University, Hangzhou 310058, China"}]},{"given":"Zhaoyu","family":"Huo","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Zhejiang University, Hangzhou 310058, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1061\/(ASCE)BE.1943-5592.0000119","article-title":"Experimental Assessment of Dynamic Responses Induced in Concrete Bridges by Permit Vehicles","volume":"16","author":"Szurgott","year":"2011","journal-title":"J. Bridge Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1061\/(ASCE)BE.1943-5592.0000435","article-title":"Experimental and Numerical Studies of Nonstationary Random Vibrations for a High-Pier Bridge under Vehicular Loads","volume":"18","author":"Yin","year":"2013","journal-title":"J. Bridge Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"05016002","DOI":"10.1061\/(ASCE)BE.1943-5592.0000811","article-title":"Hybrid Sensor-Camera Monitoring for Damage Detection: Case Study of a Real Bridge","volume":"21","author":"Zaurin","year":"2016","journal-title":"J. Bridge Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"04721008","DOI":"10.1061\/(ASCE)ST.1943-541X.0003140","article-title":"Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks","volume":"147","author":"Ye","year":"2021","journal-title":"J. Struct. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1080\/15732479.2013.767844","article-title":"Suspension Bridge Response Due to Extreme Vehicle Loads","volume":"10","author":"Westgate","year":"2014","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_6","first-page":"141","article-title":"Smartphone-Based Structural Crack Detection Using Pruned Fully Convolutional Networks and Edge Computing","volume":"29","author":"Ye","year":"2022","journal-title":"Smart Struct. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"(1979). Fred Moses Weigh-in-Motion System Using Instrumented Bridges. Transp. Eng. J. ASCE, 105, 233\u2013249.","DOI":"10.1061\/TPEJAN.0000783"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"04014078","DOI":"10.1061\/(ASCE)BE.1943-5592.0000674","article-title":"Bridge Damage Detection Using Weigh-in-Motion Technology","volume":"20","author":"Cantero","year":"2015","journal-title":"J. Bridge Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.12989\/sss.2016.17.6.1087","article-title":"Statistical Analysis and Probabilistic Modeling of WIM Monitoring Data of an Instrumented Arch Bridge","volume":"17","author":"Ye","year":"2016","journal-title":"Smart Struct. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"111533","DOI":"10.1016\/j.engstruct.2020.111533","article-title":"A B-WIM Algorithm Considering the Modeling of the Bridge Dynamic Response","volume":"228","author":"Carraro","year":"2021","journal-title":"Eng. Struct."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wu, Y., Deng, L., and He, W. (2020). BwimNet: A Novel Method for Identifying Moving Vehicles Utilizing a Modified Encoder-Decoder Architecture. Sensors, 20.","DOI":"10.3390\/s20247170"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"108384","DOI":"10.1016\/j.measurement.2020.108384","article-title":"Novel Methodology for Identifying the Weight of Moving Vehicles on Bridges Using Structural Response Pattern Extraction and Deep Learning Algorithms","volume":"168","author":"Zhou","year":"2021","journal-title":"Measurement"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/TVT.2010.2096832","article-title":"Compensating Background for Noise Due to Camera Vibration in Uncalibrated-Camera-Based Vehicle Speed Measurement System","volume":"60","author":"Nguyen","year":"2011","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1016\/j.eswa.2014.09.045","article-title":"A Novel Video Based System for Detecting and Counting Vehicles at User-Defined Virtual Loops","volume":"42","author":"Barcellos","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_15","first-page":"723","article-title":"Development and testing of a composite system for bridge health monitoring utilising computer vision and deep learning","volume":"24","author":"Lydon","year":"2019","journal-title":"Smart Struct. Syst. Int. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"107801","DOI":"10.1016\/j.measurement.2020.107801","article-title":"Vehicle Weight Identification System for Spatiotemporal Load Distribution on Bridges Based on Non-Contact Machine Vision Technology and Deep Learning Algorithms","volume":"159","author":"Zhou","year":"2020","journal-title":"Measurement"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e2636","DOI":"10.1002\/stc.2636","article-title":"An Accurate and Robust Monitoring Method of Full-bridge Traffic Load Distribution Based on YOLO-v3 Machine Vision","volume":"27","author":"Ge","year":"2020","journal-title":"Struct. Control Health Monit."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, Z., Feng, Y., Zhang, Y., Liu, J., Zhu, C., and Chen, A. (2022). An Accurate and Convenient Method of Vehicle Spatiotemporal Distribution Recognition Based on Computer Vision. Sensors, 22.","DOI":"10.3390\/s22176437"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, Z., Ellis, T., and Velastin, S.A. (2012, January 16\u201319). Vehicle Detection, Tracking and Classification in Urban Traffic. Proceedings of the 2012 15th International IEEE Conference on Intelligent Transportation Systems, Anchorage, AK, USA.","DOI":"10.1109\/ITSC.2012.6338852"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1049\/iet-its.2018.5005","article-title":"Fast Single Shot Multibox Detector and Its Application on Vehicle Counting System","volume":"12","author":"Chen","year":"2018","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1007\/s11760-020-01829-7","article-title":"Fast Approach for Moving Vehicle Localization and Bounding Box Estimation in Highway Traffic Videos","volume":"15","author":"Harikrishnan","year":"2021","journal-title":"Signal Image Video Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1111\/mice.12434","article-title":"A Methodology for Obtaining Spatiotemporal Information of the Vehicles on Bridges Based on Computer Vision","volume":"34","author":"Zhang","year":"2019","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1002\/stc.1780","article-title":"Identification of Spatio-Temporal Distribution of Vehicle Loads on Long-Span Bridges Using Computer Vision Technology: Spatio-Temporal Distribution Identification of Vehicle Loads","volume":"23","author":"Chen","year":"2016","journal-title":"Struct. Control Health Monit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.measurement.2019.05.042","article-title":"Identification of Moving Loads Based on the Information Fusion of Weigh-in-Motion System and Multiple Camera Machine Vision","volume":"144","author":"Dan","year":"2019","journal-title":"Measurement"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wu, C.-W., Liu, C.-T., Chiang, C.-E., Tu, W.-C., and Chien, S.-Y. (2018, January 18\u201322). Vehicle Re-Identification with the Space-Time Prior. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00024"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"172443","DOI":"10.1109\/ACCESS.2019.2956172","article-title":"A Survey of Vehicle Re-Identification Based on Deep Learning","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3691","DOI":"10.1177\/13694332211033956","article-title":"A Deep Neural Network-Based Vehicle Re-Identification Method for Bridge Load Monitoring","volume":"24","author":"Zhang","year":"2021","journal-title":"Adv. Struct. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Khorramshahi, P., Kumar, A., Peri, N., Rambhatla, S.S., Chen, J.-C., and Chellappa, R. (2019, January 27\u201328). A Dual-Path Model With Adaptive Attention for Vehicle Re-Identification. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00623"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhou, K., Yang, Y., Cavallaro, A., and Xiang, T. (2019, January 27\u201328). Omni-Scale Feature Learning for Person Re-Identification. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00380"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10441","DOI":"10.1109\/TITS.2021.3094504","article-title":"A Novel Vision-Based Framework for Identifying Dynamic Vehicle Loads on Long-Span Bridges: A Case Study of Jiangyin Bridge, China","volume":"23","author":"Pan","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shen, Y., Xiao, T., Li, H., Yi, S., and Wang, X. (2017, January 27\u201329). Learning Deep Neural Networks for Vehicle Re-ID with Visual-Spatio-Temporal Path Proposals. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.210"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1007\/978-3-319-46475-6_53","article-title":"A Deep Learning-Based Approach to Progressive Vehicle Re-Identification for Urban Surveillance","volume":"Volume 9906","author":"Leibe","year":"2016","journal-title":"Computer Vision\u2014ECCV 2016"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yang, L., Luo, P., Loy, C.C., and Tang, X. (2015, January 7\u201312). A Large-Scale Car Dataset for Fine-Grained Categorization and Verification. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299023"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lou, Y., Bai, Y., Liu, J., Wang, S., and Duan, L. (2019, January 15\u201320). VERI-Wild: A Large Dataset and a New Method for Vehicle Re-Identification in the Wild. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00335"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1137\/0105003","article-title":"Algorithms for the Assignment and Transportation Problems","volume":"5","author":"Munkres","year":"1957","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_36","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tang, X., Song, H., Wang, W., and Yang, Y. (2020). Vehicle Spatial Distribution and 3D Trajectory Extraction Algorithm in a Cross-Camera Traffic Scene. Sensors, 20.","DOI":"10.3390\/s20226517"},{"key":"ref_38","first-page":"194228","article-title":"A Deep Learning-Based Hybrid Framework for Object Detection and Recognition in Autonomous Driving","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access Pract. Innov. Open Solut."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Mark Liao, H.-Y., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., and Yeh, I.-H. (2020, January 14\u201319). CSPNet: A New Backbone That Can Enhance Learning Capability of CNN. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"85042","DOI":"10.1109\/ACCESS.2019.2923407","article-title":"Effective Contexts for UAV Vehicle Detection","volume":"7","author":"Yang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_42","unstructured":"Paliwal, K., and Basu, A. (1987, January 6\u20139). A Speech Enhancement Method Based on Kalman Filtering. Proceedings of the ICASSP \u201987. IEEE International Conference on Acoustics, Speech, and Signal Processing, Dallas, TX, USA."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"7040","DOI":"10.1109\/TITS.2020.3001154","article-title":"A Traffic Surveillance System for Obtaining Comprehensive Information of the Passing Vehicles Based on Instance Segmentation","volume":"22","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_44","unstructured":"Yu, Q., Chang, X., Song, Y.-Z., Xiang, T., and Hospedales, T.M. (2018). The Devil Is in the Middle: Exploiting Mid-Level Representations for Cross-Domain Instance Matching. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1007\/978-3-030-01225-0_30","article-title":"Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)","volume":"Volume 11208","author":"Ferrari","year":"2018","journal-title":"Computer Vision\u2014ECCV 2018"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Li, W., Zhu, X., and Gong, S. (2018, January 18\u201323). Harmonious Attention Network for Person Re-Identification. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00243"},{"key":"ref_47","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Zheng, L., Cao, D., and Li, S. (2017, January 21\u201326). Re-Ranking Person Re-Identification with k-Reciprocal Encoding. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.389"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.neucom.2019.06.013","article-title":"Learning Multi-Region Features for Vehicle Re-Identification with Context-Based Ranking Method","volume":"359","author":"Peng","year":"2019","journal-title":"Neurocomputing"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5510\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:53:15Z","timestamp":1760125995000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,12]]},"references-count":50,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23125510"],"URL":"https:\/\/doi.org\/10.3390\/s23125510","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,6,12]]}}}