{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T12:33:25Z","timestamp":1775133205208,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,21]],"date-time":"2022-08-21T00:00:00Z","timestamp":1661040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Major Science and Technology Project of Sanya","award":["SKJC-KJ-2019KY03"],"award-info":[{"award-number":["SKJC-KJ-2019KY03"]}]},{"name":"Major Science and Technology Project of Sanya","award":["2020C03012"],"award-info":[{"award-number":["2020C03012"]}]},{"name":"Major Science and Technology Project of Sanya","award":["ZDKJ202019"],"award-info":[{"award-number":["ZDKJ202019"]}]},{"name":"Major Science and Technology Project of Sanya","award":["2019R52045"],"award-info":[{"award-number":["2019R52045"]}]},{"name":"Key Research and Development Plan of Zhejiang Province","award":["SKJC-KJ-2019KY03"],"award-info":[{"award-number":["SKJC-KJ-2019KY03"]}]},{"name":"Key Research and Development Plan of Zhejiang Province","award":["2020C03012"],"award-info":[{"award-number":["2020C03012"]}]},{"name":"Key Research and Development Plan of Zhejiang Province","award":["ZDKJ202019"],"award-info":[{"award-number":["ZDKJ202019"]}]},{"name":"Key Research and Development Plan of Zhejiang Province","award":["2019R52045"],"award-info":[{"award-number":["2019R52045"]}]},{"name":"Finance Science and Technology Project of Hainan Province","award":["SKJC-KJ-2019KY03"],"award-info":[{"award-number":["SKJC-KJ-2019KY03"]}]},{"name":"Finance Science and Technology Project of Hainan Province","award":["2020C03012"],"award-info":[{"award-number":["2020C03012"]}]},{"name":"Finance Science and Technology Project of Hainan Province","award":["ZDKJ202019"],"award-info":[{"award-number":["ZDKJ202019"]}]},{"name":"Finance Science and Technology Project of Hainan Province","award":["2019R52045"],"award-info":[{"award-number":["2019R52045"]}]},{"name":"High-Level Personnel of Special Support Program of Zhejiang Province","award":["SKJC-KJ-2019KY03"],"award-info":[{"award-number":["SKJC-KJ-2019KY03"]}]},{"name":"High-Level Personnel of Special Support Program of Zhejiang Province","award":["2020C03012"],"award-info":[{"award-number":["2020C03012"]}]},{"name":"High-Level Personnel of Special Support Program of Zhejiang Province","award":["ZDKJ202019"],"award-info":[{"award-number":["ZDKJ202019"]}]},{"name":"High-Level Personnel of Special Support Program of Zhejiang Province","award":["2019R52045"],"award-info":[{"award-number":["2019R52045"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>State-of-the-art multiple-object tracking methods are frequently applied to people or vehicle tracking, but rarely involve underwater-object tracking. Compared with the processing in non-underwater photos or videos, underwater fish tracking is challenging due to variations in light conditions, water turbidity levels, shape deformations, and the similar appearances of fish. This article proposes a robust underwater fish-school tracking algorithm (FSTA). The FSTA is based on the tracking-by-detection paradigm. To solve the problem of low recognition accuracy in an underwater environment, we add an amendment detection module that uses prior knowledge to modify the detection result. Second, we introduce an underwater data association algorithm for aquatic non-rigid organisms that recombines representation and location information to refine the data matching process and improve the tracking results. The Resnet50-IBN network is used as a re-identification network to track fish. We introduce a triplet loss function based on a centroid to train the feature extraction network. The multiple-object tracking accuracy (MOTA) of the FSTA is 79.1% on the underwater dataset, which shows that it can achieve state-of-the-art performance in a complex real-world marine environment.<\/jats:p>","DOI":"10.3390\/rs14164106","type":"journal-article","created":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T01:56:40Z","timestamp":1661133400000},"page":"4106","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Robust Underwater Multiclass Fish-School Tracking Algorithm"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4726-0104","authenticated-orcid":false,"given":"Tao","family":"Liu","sequence":"first","affiliation":[{"name":"Ocean College, Zhejiang University, Zhoushan 316021, China"}]},{"given":"Shuangyan","family":"He","sequence":"additional","affiliation":[{"name":"Ocean College, Zhejiang University, Zhoushan 316021, China"},{"name":"Hainan Institute, Zhejiang University, Sanya 572025, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7420-9873","authenticated-orcid":false,"given":"Haoyang","family":"Liu","sequence":"additional","affiliation":[{"name":"Ocean College, Zhejiang University, Zhoushan 316021, China"}]},{"given":"Yanzhen","family":"Gu","sequence":"additional","affiliation":[{"name":"Ocean College, Zhejiang University, Zhoushan 316021, China"},{"name":"Hainan Institute, Zhejiang University, Sanya 572025, China"}]},{"given":"Peiliang","family":"Li","sequence":"additional","affiliation":[{"name":"Ocean College, Zhejiang University, Zhoushan 316021, China"},{"name":"Hainan Institute, Zhejiang University, Sanya 572025, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,21]]},"reference":[{"key":"ref_1","unstructured":"(2020). The State of World Fisheries and Aquaculture, FAO."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/s11160-016-9435-0","article-title":"Stock assessment in inland fisheries: A foundation for sustainable use and conservation","volume":"26","author":"Lorenzen","year":"2016","journal-title":"Rev. Fish Biol. Fish"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1390","DOI":"10.1111\/raq.12388","article-title":"Nonintrusive methods for biomass estimation in aquaculture with emphasis on fish: A review","volume":"12","author":"Li","year":"2020","journal-title":"Rev. Aquac."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1073\/pnas.1609915114","article-title":"Fisheries management impacts on target species status","volume":"114","author":"Melnychuk","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1016\/j.compag.2018.05.025","article-title":"Automated within tank fish mass estimation using infrared reflection system","volume":"150","author":"Saberioon","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.compag.2012.07.010","article-title":"The use of computer vision technologies in aquaculture\u2014A review","volume":"88","author":"Zion","year":"2012","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"735508","DOI":"10.1016\/j.aquaculture.2020.735508","article-title":"Automatic recognition methods of fish feeding behavior in aquaculture: A review","volume":"528","author":"Li","year":"2020","journal-title":"Aquaculture"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"115051","DOI":"10.1016\/j.eswa.2021.115051","article-title":"Real-time nondestructive fish behavior detecting in mixed polyculture system using deep-learning and low-cost devices","volume":"178","author":"Hu","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, W., Zhu, Z., Ge, F., Han, Z., and Li, J. (2020). Analysis of Behavior Trajectory Based on Deep Learning in Ammonia Environment for Fish. Sensors, 20.","DOI":"10.3390\/s20164425"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106169","DOI":"10.1016\/j.compag.2021.106169","article-title":"Identification methodology of special behaviors for fish school based on spatial behavior characteristics","volume":"185","author":"Yu","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3219","DOI":"10.1038\/s41598-021-81997-9","article-title":"Zebrafish tracking using YOLOv2 and Kalman filter","volume":"11","author":"Barreiros","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e05906","DOI":"10.1016\/j.heliyon.2021.e05906","article-title":"ECOPAMPA: A new tool for automatic fish schools detection and assessment from echo data","volume":"7","author":"Villar","year":"2021","journal-title":"Heliyon"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_14","unstructured":"Boom, B.J., Huang, P.X., He, J., and Fisher, R.B. (2012, January 11\u201315). Supporting Ground-Truth Annotation of Image Datasets Using Clustering. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"23679","DOI":"10.1007\/s11042-016-4045-3","article-title":"Robust tracking of fish schools using CNN for head identification","volume":"76","author":"Wang","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1111\/raq.12464","article-title":"Deep learning for smart fish farming: Applications, opportunities and challenges","volume":"13","author":"Yang","year":"2021","journal-title":"Rev. Aquac."},{"key":"ref_17","unstructured":"Piccardi, M. (2004, January 10\u201313). Background subtraction techniques: A review. Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583), The Hague, The Netherlands."},{"key":"ref_18","unstructured":"Rasmussen, C.E. (2000). The Infinite Gaussian Mixture Model. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_19","unstructured":"Welch, G., and Bishop, G. (2006). An Introduction to the Kalman Filter, University of North Carolina."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MAES.2010.5546308","article-title":"Particle filter theory and practice with positioning applications","volume":"25","author":"Gustafsson","year":"2010","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_21","unstructured":"Zhang, J., Zhou, S., Chang, X., Wan, F., Wang, J., Wu, Y., and Huang, D. (2020). Multiple Object Tracking by Flowing and Fusing. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/j.procs.2020.03.123","article-title":"MSR-YOLO: Method to Enhance Fish Detection and Tracking in Fish Farms","volume":"170","author":"Mohamed","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zheng, L., Liu, Y., Li, Y., and Wang, S. (2020, January 23\u201328). Towards Real-Time Multi-Object Tracking. Proceedings of the Computer Vision\u2014ECCV 2020, Glasgow, UK.","DOI":"10.1007\/978-3-030-58621-8_7"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1007\/s11263-021-01513-4","article-title":"FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking","volume":"129","author":"Zhang","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"101240","DOI":"10.1016\/j.ecoinf.2021.101240","article-title":"Multi-class fish stock statistics technology based on object classification and tracking algorithm","volume":"63","author":"Liu","year":"2021","journal-title":"Ecol. Inform."},{"key":"ref_26","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"Zheng, M., Gao, P., Zhang, R., Li, K., Wang, X., Li, H., and Dong, H. (2021). End-to-End Object Detection with Adaptive Clustering Transformer. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016). Simple Online and Realtime Tracking. IEEE Int. Conf. Image Processing, 3464\u20133468.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017). Simple Online and Realtime Tracking with a Deep Association Metric. arXiv.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Sun, P., Jiang, Y., Yu, D., Yuan, Z., Luo, P., Liu, W., and Wang, X. (2021). ByteTrack: Multi-Object Tracking by Associating Every Detection Box. arXiv.","DOI":"10.1007\/978-3-031-20047-2_1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1109\/TCSVT.2014.2357093","article-title":"Tracking Live Fish From Low-Contrast and Low-Frame-Rate Stereo Videos","volume":"25","author":"Chuang","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Palconit, M.G.B., Almero, V.J.D., Rosales, M.A., Sybingco, E., Bandala, A.A., Vicerra, R.R.P., and Dadios, E.P. (2020, January 16\u201319). Towards Tracking: Investigation of Genetic Algorithm and LSTM as Fish Trajectory Predictors in Turbid Water. Proceedings of the 2020 IEEE Region 10 Conference (TENCON), Osaka, Japan.","DOI":"10.1109\/TENCON50793.2020.9293730"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sun, N., Nian, R., He, B., and Yan, T. (2014, January 7\u201310). Consistent fish tracking via multiple underwater cameras. Proceedings of the OCEANS 2014\u2013TAIPEI., Taipei, Taiwan.","DOI":"10.1109\/OCEANS-TAIPEI.2014.6964366"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/nav.20053","article-title":"The Hungarian method for the assignment problem","volume":"52","author":"Kuhn","year":"2005","journal-title":"Nav. Res. Logist."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chen, L., Ai, H., Zhuang, Z., and Shang, C. (2018, January 23\u201327). Real-Time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.","DOI":"10.1109\/ICME.2018.8486597"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The Pascal Visual Object Classes Challenge: A Retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Qiu, S., Wang, X., and Tang, X. (2016, January 27\u201330). DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.124"},{"key":"ref_40","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net. Proceedings of the Computer Vision\u2014ECCV 2018, Springer International Publishing."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wieczorek, M., Rychalska, B., and Dabrowski, J. (2021). On the Unreasonable Effectiveness of Centroids in Image Retrieval. arXiv.","DOI":"10.1007\/978-3-030-92273-3_18"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"He, S., Luo, H., Chen, W., Zhang, M., Zhang, Y., Wang, F., Li, H., and Jiang, W. (2020, January 14\u201319). Multi-Domain Learning and Identity Mining for Vehicle Re-Identification. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00299"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yang, H., Pasupa, K., Leung, A.C.-S., Kwok, J.T., Chan, J.H., and King, I. (2020). A Strong Baseline for Fashion Retrieval with Person Re-identification Models. Proceedings of the Neural Information Processing, Springer.","DOI":"10.1007\/978-3-030-63823-8"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/4106\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:13:20Z","timestamp":1760141600000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/4106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,21]]},"references-count":43,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14164106"],"URL":"https:\/\/doi.org\/10.3390\/rs14164106","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,21]]}}}