{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:43:06Z","timestamp":1776120186471,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,2,12]],"date-time":"2021-02-12T00:00:00Z","timestamp":1613088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Project of China","award":["2020YFB1710800"],"award-info":[{"award-number":["2020YFB1710800"]}]},{"name":"National Nature Science Foundation of China","award":["51879211"],"award-info":[{"award-number":["51879211"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Ship detection and tracking is an important task in video surveillance in inland waterways. However, ships in inland navigation are faced with accidents such as collisions. For collision avoidance, we should strengthen the monitoring of navigation and the robustness of the entire system. Hence, this paper presents ship detection and tracking of ships using the improved You Only Look Once version 3 (YOLOv3) detection algorithm and Deep Simple Online and Real-time Tracking (Deep SORT) tracking algorithm. Three improvements are made to the YOLOv3 target detection algorithm. Firstly, the Kmeans clustering algorithm is used to optimize the initial value of the anchor frame to make it more suitable for ship application scenarios. Secondly, the output classifier is modified to a single Softmax classifier to suit our ship dataset which has three ship categories and mutual exclusion. Finally, Soft Non-Maximum Suppression (Soft-NMS) is introduced to solve the deficiencies of the Non-Maximum Suppression (NMS) algorithm when screening candidate frames. Results showed the mean Average Precision (mAP) and Frame Per Second (FPS) of the improved algorithm are increased by about 5% and 2, respectively, compared with the existing YOLOv3 detecting Algorithm. Then the improved YOLOv3 is applied in Deep Sort and the performance result of Deep Sort showed that, it has greater performance in complex scenes, and is robust to interference such as occlusion and camera movement, compared to state of art algorithms such as KCF, MIL, MOSSE, TLD, and Median Flow. With this improvement, it will help in the safety of inland navigation and protection from collisions and accidents.<\/jats:p>","DOI":"10.3390\/sym13020308","type":"journal-article","created":{"date-parts":[[2021,2,12]],"date-time":"2021-02-12T18:46:31Z","timestamp":1613155591000},"page":"308","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT"],"prefix":"10.3390","volume":"13","author":[{"given":"Yang","family":"Jie","sequence":"first","affiliation":[{"name":"Department of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9453-8925","authenticated-orcid":false,"given":"LilianAsimwe","family":"Leonidas","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5213-608X","authenticated-orcid":false,"given":"Farhan","family":"Mumtaz","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"},{"name":"Department of Electronics, Quaid-i-Azam University, Islamabad 15320, Pakistan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2876-6564","authenticated-orcid":false,"given":"Munsif","family":"Ali","sequence":"additional","affiliation":[{"name":"Department of Electronics, Quaid-i-Azam University, Islamabad 15320, Pakistan"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chen, J., Chen, D., and Meng, S. (2018, January 1). A Novel Region Selection Algorithm for Auto-Focusing Method Based on Depth from Focus. Proceedings of the Fourth Euro-China Conference on Intelligent Data Analysis and Applications, Cham, Swizerland.","DOI":"10.1007\/978-3-319-68527-4_11"},{"key":"ref_2","first-page":"9","article-title":"Feature Extraction for Object Recognition and Image Classification","volume":"2","author":"Tiwari","year":"2013","journal-title":"Int. J. Eng. Res."},{"key":"ref_3","unstructured":"Sun, D.-W. (2016). Chapter 4\u2014Object Classification Methods. Computer Vision Technology for Food Quality Evaluation, Academic Press. [2nd ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_5","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_6","unstructured":"Suykens, J.A.K., and Vandewalle, J. (1998). The Support Vector Method of Function Estimation. Nonlinear Modeling: Advanced Black-Box Techniques, Springer."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., Luo, Z., and Vovk, V. (2013). Explaining AdaBoost. Empirical Inference, Springer.","DOI":"10.1007\/978-3-642-41136-6"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kaido, N., Yamamoto, S., and Hashimoto, T. (2016). Examination of Automatic Detection and Tracking of Ships on Camera Image in Marine Environment. 2016 Techno-Ocean (Techno-Ocean).","DOI":"10.1109\/Techno-Ocean.2016.7890748"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"De Paz, J.F., Juli\u00e1n, V., Villarrubia, G., Marreiros, G., and Novais, P. (2017, January 21\u201323). Computer Vision Algorithms Fishing Vessel Monitoring\u2014Identification of Vessel Plate Number. Proceedings of the Ambient Intelligence\u2014Software and Applications\u20148th International Symposium on Ambient Intelligence (ISAmI 2017), Porto, Portugal.","DOI":"10.1007\/978-3-319-61118-1"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. arXiv.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015). Fast R-CNN. arXiv.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2016). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_15","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-319-46448-0_2","article-title":"SSD: Single Shot MultiBox Detector","volume":"9905","author":"Liu","year":"2016","journal-title":"Computer Vision\u2014ECCV 2016"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3614","DOI":"10.1080\/01431161.2019.1706781","article-title":"Learning a Robust CNN-Based Rotation Insensitive Model for Ship Detection in VHR Remote Sensing Images","volume":"41","author":"Dong","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fan, W., Zhou, F., Bai, X., Tao, M., and Tian, T. (2019). Ship Detection Using Deep Convolutional Neural Networks for PolSAR Images. Remote Sens., 11.","DOI":"10.3390\/rs11232862"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20881","DOI":"10.1109\/ACCESS.2018.2825376","article-title":"A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection","volume":"6","author":"Jiao","year":"2018","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8333","DOI":"10.1109\/TGRS.2019.2920534","article-title":"DRBox-v2: An Improved Detector with Rotatable Boxes for Target Detection in SAR Images","volume":"57","author":"An","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Qi, L., Li, B., Chen, L., Wang, W., Dong, L., Jia, X., Huang, J., Ge, C., Xue, G., and Wang, D. (2019). Ship Target Detection Algorithm Based on Improved Faster R-CNN. Electronics, 8.","DOI":"10.3390\/electronics8090959"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"141662","DOI":"10.1109\/ACCESS.2019.2943241","article-title":"A Lightweight Feature Optimizing Network for Ship Detection in SAR Image","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Song, J., Kim, D., and Kang, K. (2020). Automated Procurement of Training Data for Machine Learning Algorithm on Ship Detection Using AIS Information. Remote Sens., 12.","DOI":"10.3390\/rs12091443"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Imani, M., and Ghoreishi, S.F. (2021). Scalable Inverse Reinforcement Learning Through Multi-Fidelity Bayesian Optimization. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2021.3051012"},{"key":"ref_25","unstructured":"Sr, Y.Z., Sr, J.S., Sr, L.H., Sr, Q.Z., and Sr, Z.D. (2020, January 31). A Ship Target Tracking Algorithm Based on Deep Learning and Multiple Features. Proceedings of the Twelfth International Conference on Machine Vision (ICMV 2019), Amsterdam, The Netherlands."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1520872","DOI":"10.1155\/2020\/1520872","article-title":"An Intelligent Ship Image\/Video Detection and Classification Method with Improved Regressive Deep Convolutional Neural Network","volume":"2020","author":"Huang","year":"2020","journal-title":"Complexity"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep Learning in Neural Networks: An Overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw. Off. J. Int. Neural Netw. Soc."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017). Simple Online and Realtime Tracking with a Deep Association Metric. arXiv.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017). Feature Pyramid Networks for Object Detection. arXiv.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, K., Huang, Z., Cheng, Y., and Lee, C. (2014, January 4\u20139). A Maximal Figure-of-Merit Learning Approach to Maximizing Mean Average Precision with Deep Neural Network Based Classifiers. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6854454"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Babenko, B., Yang, M., and Belongie, S. (2009, January 20\u201325). Visual Tracking with Online Multiple Instance Learning. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206737"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bolme, D., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13\u201318). Visual Object Tracking Using Adaptive Correlation Filters. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539960"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1109\/TPAMI.2011.239","article-title":"Tracking-Learning-Detection","volume":"34","author":"Kalal","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kalal, Z., Mikolajczyk, K., and Matas, J. (2010, January 23\u201326). Forward-Backward Error: Automatic Detection of Tracking Failures. Proceedings of the 2010 20th International Conference on Pattern Recognition, ICPR \u201910, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.675"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/308\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:23:11Z","timestamp":1760160191000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/308"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,12]]},"references-count":36,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["sym13020308"],"URL":"https:\/\/doi.org\/10.3390\/sym13020308","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,12]]}}}