{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T12:33:26Z","timestamp":1775133206192,"version":"3.50.1"},"reference-count":28,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T00:00:00Z","timestamp":1621209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korea government","award":["2019R1A2C2088859"],"award-info":[{"award-number":["2019R1A2C2088859"]}]},{"name":"Yantai","award":["2018YT06000808"],"award-info":[{"award-number":["2018YT06000808"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A parallel fish school tracking based on multiple-feature fish detection has been proposed in this paper to obtain accurate movement trajectories of a large number of zebrafish. Zebrafish are widely adapted in many fields as an excellent model organism. Due to the non-rigid body, similar appearance, rapid transition, and frequent occlusions, vision-based behavioral monitoring is still a challenge. A multiple appearance feature based fish detection scheme was developed by examining the fish head and center of the fish body based on shape index features. The proposed fish detection has the advantage of locating individual fishes from occlusions and estimating their motion states, which could ensure the stability of tracking multiple fishes. Moreover, a parallel tracking scheme was developed based on the SORT framework by fusing multiple features of individual fish and motion states. The proposed method was evaluated in seven video clips taken under different conditions. These videos contained various scales of fishes, different arena sizes, different frame rates, and various image resolutions. The maximal number of tracking targets reached 100 individuals. The correct tracking ratio was 98.60% to 99.86%, and the correct identification ratio ranged from 97.73% to 100%. The experimental results demonstrate that the proposed method is superior to advanced deep learning-based methods. Nevertheless, this method has real-time tracking ability, which can acquire online trajectory data without high-cost hardware configuration.<\/jats:p>","DOI":"10.3390\/s21103476","type":"journal-article","created":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T04:25:07Z","timestamp":1621225507000},"page":"3476","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Parallel Fish School Tracking Based on Multiple Appearance Feature Detection"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2883-1661","authenticated-orcid":false,"given":"Zhitao","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Electronics Engineering, Pusan National University, Busan 46241, Korea"},{"name":"Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6379-9863","authenticated-orcid":false,"given":"Chunlei","family":"Xia","sequence":"additional","affiliation":[{"name":"Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jangmyung","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electronics Engineering, Pusan National University, Busan 46241, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1146\/annurev-neuro-071714-033857","article-title":"Zebrafish behavior: Opportunities and challenges","volume":"40","author":"Orger","year":"2017","journal-title":"Annu. Rev. Neurosci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.envsoft.2018.01.007","article-title":"Quantitatively scoring behavior from video-recorded, long-lasting fish trajectories","volume":"106","author":"Manjabacas","year":"2018","journal-title":"Environ. Model. Softw."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Heras, F.J., Romero-Ferrero, F., Hinz, R.C., and de Polavieja, G.G. (2019). Deep attention networks reveal the rules of collective motion in zebrafish. PLoS Comput. Biol., 15.","DOI":"10.1371\/journal.pcbi.1007354"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xia, C., Fu, L., Liu, Z., Liu, H., Chen, L., and Liu, Y. (2018). Aquatic toxic analysis by monitoring fish behavior using computer vision: A recent progress. J. Toxicol.","DOI":"10.1155\/2018\/2591924"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Qian, Z.M., Wang, S.H., Cheng, X.E., and Chen, Y.Q. (2016). An effective and robust method for tracking multiple fish in video image based on fish head detection. BMC Bioinform., 17.","DOI":"10.1186\/s12859-016-1138-y"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, S.H., Cheng, X.E., Qian, Z.M., Liu, Y., and Chen, Y.Q. (2016). Automated planar tracking the waving bodies of multiple zebrafish swimming in shallow water. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0154714"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1016\/j.ecoinf.2016.07.004","article-title":"Posture tracking of multiple individual fish for behavioral monitoring with visual sensors","volume":"36","author":"Xia","year":"2016","journal-title":"Ecol. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xia, C., Li, Y., and Lee, J.M. (2014, January 17\u201320). A visual measurement of fish locomotion based on deformable models. Proceedings of the International Conference on Intelligent Robotics and Applications, Guangzhou, China.","DOI":"10.1007\/978-3-319-13966-1_11"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.1242\/jeb.010272","article-title":"Automated visual tracking for studying the ontogeny of zebrafish swimming","volume":"211","author":"Fontaine","year":"2008","journal-title":"J. Exp. Biol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ning, X., Gong, K., Li, W., Zhang, L., Bai, X., and Tian, S. (2020). Feature Refinement and Filter Network for Person Re-Identification. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TCSVT.2020.3043026"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Qian, Z.M., Cheng, X.E., and Chen, Y.Q. (2014). Automatically detect and track multiple fish swimming in shallow water with frequent occlusion. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0106506"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"23679","DOI":"10.1007\/s11042-016-4045-3","article-title":"Robust tracking of fish schools using CNN for head identification","volume":"76","author":"Wang","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3219","DOI":"10.1038\/s41598-021-81997-9","article-title":"Zebrafish tracking using YOLOv2 and Kalman filter","volume":"11","author":"Ribeiro","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_14","first-page":"625","article-title":"An automated player detection and tracking in basketball game","volume":"58","author":"Santhosh","year":"2019","journal-title":"Comput. Mater. Contin."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, J., Sun, J., Wang, J., and Yue, X.G. (2020). Visual object tracking based on residual network and cascaded correlation filters. J. Ambient Intell. Humaniz. Comput., 1\u20134.","DOI":"10.1007\/s12652-020-02572-0"},{"key":"ref_16","unstructured":"Perera, A.A., Srinivas, C., Hoogs, A., Brooksby, G., and Hu, W. (2006, January 17\u201322). Multi-object tracking through simultaneous long occlusions and split-merge conditions. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR \u201906), New York, NY, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101238","DOI":"10.1016\/j.ecoinf.2021.101238","article-title":"Group behavior tracking of Daphnia magna based on motion estimation and appearance models","volume":"61","author":"Wang","year":"2021","journal-title":"Ecol. Inform."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"14774","DOI":"10.1038\/s41598-017-15104-2","article-title":"ToxId: An efficient algorithm to solve occlusions when tracking multiple animals","volume":"7","author":"Rodriguez","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1038\/nmeth.2994","article-title":"idTracker: Tracking individuals in a group by automatic identification of unmarked animals","volume":"11","author":"Hinz","year":"2014","journal-title":"Nat. Methods"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1038\/s41592-018-0295-5","article-title":"Idtracker. ai: Tracking all individuals in small or large collectives of unmarked animals","volume":"16","author":"Bergomi","year":"2019","journal-title":"Nat. Methods"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"42815","DOI":"10.1038\/srep42815","article-title":"Zebrafish tracking using convolutional neural networks","volume":"7","author":"Zhiping","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/0262-8856(92)90076-F","article-title":"Surface shape and curvature scales","volume":"10","author":"Koenderink","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1109\/TPAMI.2003.1233909","article-title":"Detecting moving objects, ghosts, and shadows in video streams","volume":"25","author":"Cucchiara","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Ester, M., Kriegel, H.P., Sander, J., and Xu, X. (1996, January 2\u20134). A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, Oregon."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Nav. Res. Logist. Q."},{"key":"ref_28","first-page":"223","article-title":"A review of freely available, open-source software for the automated analysis of the behavior of adult zebrafish","volume":"16","author":"Forero","year":"2019","journal-title":"Zebrafish"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3476\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:02:25Z","timestamp":1760162545000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3476"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,17]]},"references-count":28,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103476"],"URL":"https:\/\/doi.org\/10.3390\/s21103476","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,17]]}}}