{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T04:00:53Z","timestamp":1775966453722,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T00:00:00Z","timestamp":1725408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2022YFB4301400"],"award-info":[{"award-number":["2022YFB4301400"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Detecting and tracking personnel onboard is an important measure to prevent ships from being invaded by outsiders and ensure ship security. Ships are characterized by more cabins, numerous equipment, and dense personnel, so there are problems such as unpredictable personnel trajectories, frequent occlusions, and many small targets, which lead to the poor performance of existing multi-target-tracking algorithms on shipboard surveillance videos. This study conducts research in the context of onboard surveillance and proposes a multi-object detection and tracking algorithm for anti-intrusion on ships. First, this study designs the BR-YOLO network to provide high-quality object-detection results for the tracking algorithm. The shallow layers of its backbone network use the BiFormer module to capture dependencies between distant objects and reduce information loss. Second, the improved C2f module is used in the deep layer of BR-YOLO to introduce the RepGhost structure to achieve model lightweighting through reparameterization. Then, the Part OSNet network is proposed, which uses different pooling branches to focus on multi-scale features, including part-level features, thereby obtaining strong Re-ID feature representations and providing richer appearance information for personnel tracking. Finally, by integrating the appearance information for association matching, the tracking trajectory is generated in Tracking-By-Detection mode and validated on the self-constructed shipboard surveillance dataset. The experimental results show that the algorithm in this paper is effective in shipboard surveillance. Compared with the present mainstream algorithms, the MOTA, HOTP, and IDF1 are enhanced by about 10 percentage points, the MOTP is enhanced by about 7 percentage points, and IDs are also significantly reduced, which is of great practical significance for the prevention of intrusion by ship personnel.<\/jats:p>","DOI":"10.3390\/s24175756","type":"journal-article","created":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T10:58:46Z","timestamp":1725447526000},"page":"5756","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Personnel Monitoring in Shipboard Surveillance Using Improved Multi-Object Detection and Tracking Algorithm"],"prefix":"10.3390","volume":"24","author":[{"given":"Yiming","family":"Li","sequence":"first","affiliation":[{"name":"Marine Engineering College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9726-2554","authenticated-orcid":false,"given":"Bin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Marine Engineering College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yichen","family":"Liu","sequence":"additional","affiliation":[{"name":"Marine Engineering College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huibing","family":"Wang","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shibo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Marine Engineering College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"114198","DOI":"10.1016\/j.oceaneng.2023.114198","article-title":"Improving maritime traffic surveillance in inland waterways using the robust fusion of AIS and visual data","volume":"275","author":"Qu","year":"2023","journal-title":"Ocean Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, X., He, Y., Zhu, W., Qu, W., Li, Y., Li, C., and Zhu, B. (2024). Split_ Composite: A Radar Target Recognition Method on FFT Convolution Acceleration. Sensors, 24.","DOI":"10.3390\/s24144476"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ogunrinde, I., and Bernadin, S. (2024). Improved DeepSORT-Based Object Tracking in Foggy Weather for AVs Using Sematic Labels and Fused Appearance Feature Network. Sensors, 24.","DOI":"10.3390\/s24144692"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"116005","DOI":"10.1016\/j.oceaneng.2023.116005","article-title":"Multi-target tracking algorithm in aquaculture monitoring based on deep learning","volume":"289","author":"Zhai","year":"2023","journal-title":"Ocean Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.neucom.2019.11.023","article-title":"Deep learning in video multi-object tracking: A survey. Neurocomputing","volume":"381","author":"Ciaparrone","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"104514","DOI":"10.1016\/j.imavis.2022.104514","article-title":"Tackling multiple object tracking with complicated motions\u2014Re-designing the integration of motion and appearance","volume":"124","author":"Yang","year":"2022","journal-title":"Image Vision Comput."},{"key":"ref_7","unstructured":"Chen, C., Guo, Z., Zeng, H., Xiong, P., and Dong, J. (2022). Repghost: A hardware-efficient ghost module via re-parameterization. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5626911","DOI":"10.1109\/TGRS.2023.3336665","article-title":"Multiple source domain adaptation for multiple object tracking in satellite video","volume":"61","author":"Zheng","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, Z., Wang, R., Li, H., Wei, B., Shi, Y., Ling, H., and Zheng, H. (2023, January 18\u201322). Hierarchical clustering and refinement for generalized multi-camera person tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00584"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"103630","DOI":"10.1016\/j.apor.2023.103630","article-title":"Real-time underwater target detection for AUV using side scan sonar images based on deep learning","volume":"138","author":"Li","year":"2023","journal-title":"Appl. Ocean Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103833","DOI":"10.1016\/j.apor.2023.103833","article-title":"Real-time ship detection system for wave glider based on YOLOv5s-lite-CBAM model","volume":"144","author":"Lyu","year":"2024","journal-title":"Appl. Ocean Res."},{"key":"ref_12","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.dt.2021.10.007","article-title":"Object detection in crowded scenes via joint prediction","volume":"21","author":"Xu","year":"2023","journal-title":"Def. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.aej.2023.09.061","article-title":"Athlete target detection method in dynamic scenario based on nonlinear filtering and YOLOv5","volume":"82","author":"Dong","year":"2023","journal-title":"Alexandria Eng. J."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple online and realtime tracking with a deep association metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cao, J., Pang, J., Weng, X., Khirodkar, R., and Kitani, K. (2023, January 18\u201322). Observation-centric sort: Rethinking sort for robust multi-object tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00934"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Maggiolino, G., Ahmad, A., Cao, J., and Kitani, K. (2023, January 8\u201311). Deep oc-sort: Multi-pedestrian tracking by adaptive re-identification. Proceedings of the IEEE International Conference on Image Processing, Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICIP49359.2023.10222576"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103710","DOI":"10.1016\/j.jvcir.2022.103710","article-title":"Dynamic representation-based tracker for long-term pedestrian tracking with occlusion","volume":"90","author":"Yang","year":"2023","journal-title":"J. Visual Commun. Image Represent."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_21","unstructured":"Zhou, K., Yang, Y., Cavallaro, A., and Xiang, T. (November, January 27). Omni-scale feature learning for person re-identification. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"104951","DOI":"10.1016\/j.imavis.2024.104951","article-title":"Multiple object detection and tracking from drone videos based on GM-YOLO and multi-tracker","volume":"143","author":"Yuan","year":"2024","journal-title":"Image Vision Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"012021","DOI":"10.1088\/1742-6596\/1948\/1\/012021","article-title":"Research towards yolo-series algorithms: Comparison and analysis of object detection models for real-time UAV applications","volume":"1948","author":"Wang","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"113534","DOI":"10.1016\/j.oceaneng.2022.113534","article-title":"Crack identification for marine engineering equipment based on improved SSD and YOLOv5","volume":"268","author":"Jia","year":"2023","journal-title":"Ocean Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sohan, M., Sai Ram, T., Reddy, R., and Venkata, C. (2024, January 18\u201320). A Review on YOLOv8 and Its Advancements. Proceedings of the International Conference on Data Intelligence and Cognitive Informatics, Tirunelveli, India.","DOI":"10.1007\/978-981-99-7962-2_39"},{"key":"ref_26","unstructured":"He, L., Liao, X., Liu, W., Liu, X., Cheng, P., and Mei, T. (November, January 29). Fastreid: A pytorch toolbox for general instance re-identification. Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Herzog, F., Ji, X., Teepe, T., H\u00f6rmann, S., Gilg, J., and Rigoll, G. (2021, January 19\u201322). Lightweight multi-branch network for person re-identification. Proceedings of the IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA.","DOI":"10.1109\/ICIP42928.2021.9506733"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.neucom.2020.06.074","article-title":"Multi-scale and multi-branch feature representation for person re-identification","volume":"414","author":"Jiao","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhu, L., Wang, X., Ke, Z., Zhang, W., and Lau, R.W. (2023, January 17\u201324). Biformer: Vision transformer with bi-level routing attention. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00995"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 13\u201319). Ghostnet: More features from cheap operations. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00165"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1007\/s11263-022-01575-y","article-title":"GhostNets on heterogeneous devices via cheap operations","volume":"130","author":"Han","year":"2022","journal-title":"Int. J. Comput. Vision"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, X., Jia, Y., Tong, X., and Li, Z. (2022). Research on pedestrian detection and deepsort tracking in front of intelligent vehicle based on deep learning. Sustainability, 14.","DOI":"10.3390\/su14159281"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, R., Tan, J., Cao, Z., Xu, L., Liu, Y., Si, L., and Sun, F. (2024). Part-Aware Correlation Networks for Few-shot Learning. IEEE Trans. Multimedia, 1\u201313.","DOI":"10.1109\/TMM.2024.3394681"},{"key":"ref_34","unstructured":"Hermans, A., Beyer, L., and Leibe, B. (2017). In defense of the triplet loss for person re-identification. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, R., Cao, Z., Yang, S., Si, L., Sun, H., Xu, L., and Sun, F. (2024). Cognition-Driven Structural Prior for Instance-Dependent Label Transition Matrix Estimation. IEEE Trans. Neural Networks Learn. Syst.","DOI":"10.1109\/TNNLS.2023.3347633"},{"key":"ref_36","unstructured":"Aharon, N., Orfaig, R., and Bobrovsky, B.Z. (2022). BoT-SORT: Robust associations multi-pedestrian tracking. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Du, Y., Zhao, Z., Song, Y., Zhao, Y., Su, F., Gong, T., and Meng, H. (2022). StrongSORT: Make DeepSORT Great Again. arXiv.","DOI":"10.1109\/TMM.2023.3240881"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., and Wang, X. (2022, January 23\u201327). Bytetrack: Multi-object tracking by associating every detection box. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-20047-2_1"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/17\/5756\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:48:42Z","timestamp":1760111322000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/17\/5756"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,4]]},"references-count":38,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["s24175756"],"URL":"https:\/\/doi.org\/10.3390\/s24175756","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,4]]}}}