{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T09:29:08Z","timestamp":1786526948925,"version":"build-2736575974"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T00:00:00Z","timestamp":1786492800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T00:00:00Z","timestamp":1786492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"European Union Next Generation EU","award":["PID2021"],"award-info":[{"award-number":["PID2021"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Data"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The automatic monitoring of fish in underwater imagery plays a key role in marine ecology, fisheries management, and environmental monitoring, yet progress is limited by the lack of large, high-quality fish-focused datasets. We present a new dataset of underwater videos of fish in natural habitats, annotated for pixel-level segmentation and multi-object tracking. The data was collected in the Balearic Sea, the western Mediterranean region surrounding the island of Mallorca (Spain), across diverse marine environments to capture variations in species, lighting, turbidity, and background complexity. Each video frame has been carefully annotated to ensure spatial and temporal consistency, yielding a challenging and comprehensive resource for developing and benchmarking underwater vision algorithms. To illustrate the dataset\u2019s utility, we provide baseline tracking results obtained with Deep OC-SORT, which highlight both the dataset\u2019s challenging nature and its potential for future method evaluation. In addition, we release an open-source, browser-based annotation tool integrating the Segment Anything Model (SAM2) and CUTIE for efficient semi-automatic segmentation and tracking. This tool facilitates high-quality annotations without specialized hardware, improving accessibility and reproducibility within the marine imaging community.<\/jats:p>","DOI":"10.1038\/s41597-026-07786-z","type":"journal-article","created":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T08:35:46Z","timestamp":1786523746000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Dataset for Fish Segmentation and Tracking in Underwater Videos"],"prefix":"10.1038","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-6912-6837","authenticated-orcid":false,"given":"Josep","family":"Sanchez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jose-Luis","family":"Lisani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ignacio A.","family":"Catalan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amaya","family":"Alvarez-Ellacur\u00eda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,8,12]]},"reference":[{"issue":"7-8","key":"7786_CR1","doi-asserted-by":"publisher","first-page":"2396","DOI":"10.1093\/icesjms\/fsaa169","volume":"77","author":"J Aguzzi","year":"2020","unstructured":"Aguzzi, J. et al. The potential of video imagery from worldwide cabled observatory networks to provide information supporting fish-stock and biodiversity assessment. ICES Journal of Marine Science 77(7-8), 2396\u20132410, https:\/\/doi.org\/10.1093\/icesjms\/fsaa169 (2020).","journal-title":"ICES Journal of Marine Science"},{"key":"7786_CR2","unstructured":"Condal, F. et al Cabled video-observatory monitoring of seasonal rhythms in a mediterranean coastal fish community. Hal preprint hal-03013945, (2020)."},{"issue":"2","key":"7786_CR3","doi-asserted-by":"publisher","first-page":"297","DOI":"10.3390\/jmse10020297","volume":"10","author":"F Glaviano","year":"2022","unstructured":"Glaviano, F. et al. Management and sustainable exploitation of marine environments through smart monitoring and automation. Journal of Marine Science and Engineering 10(2), 297, https:\/\/doi.org\/10.3390\/jmse10020297 (2022).","journal-title":"Journal of Marine Science and Engineering"},{"key":"7786_CR4","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1007\/s11160-023-09799-y","volume":"33","author":"M Nalmpanti","year":"2023","unstructured":"Nalmpanti, M. et al. Monitoring marine fishes using underwater video techniques in the mediterranean sea. Reviews in Fish Biology and Fisheries 33, 1291\u20131310, https:\/\/doi.org\/10.1007\/s11160-023-09799-y (2023).","journal-title":"Reviews in Fish Biology and Fisheries"},{"key":"7786_CR5","doi-asserted-by":"publisher","first-page":"114025","DOI":"10.1016\/j.ecolind.2025.114025","volume":"178","author":"G Buscaino","year":"2025","unstructured":"Buscaino, G. et al. Integrated video and acoustic monitoring of coastal fish biodiversity using a cabled observatory. Ecological Indicators 178, 114025, https:\/\/doi.org\/10.1016\/j.ecolind.2025.114025 (2025).","journal-title":"Ecological Indicators"},{"issue":"6","key":"7786_CR6","doi-asserted-by":"publisher","first-page":"341","DOI":"10.5376\/ijms.2024.14.0038","volume":"14","author":"FC Domingo","year":"2024","unstructured":"Domingo, F. C. Urban marine biodiversity monitoring by environmental science students. International Journal of Marine Science 14(6), 341\u2013349, https:\/\/doi.org\/10.5376\/ijms.2024.14.0038 (2024).","journal-title":"International Journal of Marine Science"},{"key":"7786_CR7","doi-asserted-by":"publisher","first-page":"1425259","DOI":"10.3389\/fmars.2024.1425259","volume":"11","author":"JP Gr\u00f6ger","year":"2024","unstructured":"Gr\u00f6ger, J. P. et al. Development and operation of a novel non-invasive opto-acoustic underwater fish observatory in kiel bight, southwestern baltic sea. Frontiers in Marine Science 11, 1425259, https:\/\/doi.org\/10.3389\/fmars.2024.1425259 (2024).","journal-title":"Frontiers in Marine Science"},{"issue":"no. 1","key":"7786_CR8","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-71639-x","volume":"10","author":"A Saleh","year":"2020","unstructured":"Saleh, A. et al. A realistic fish-habitat dataset to evaluate algorithms for underwater visual analysis. Scientific Reports 10(1), 14671 (2020).","journal-title":"Scientific Reports"},{"key":"7786_CR9","doi-asserted-by":"publisher","DOI":"10.3389\/fmars.2020.00429","volume":"7","author":"EM Ditria","year":"2020","unstructured":"Ditria, E. M. et al. Automating the analysis of fish abundance using object detection: Optimising out-of-sample generalisation requires more than big data. Frontiers in Marine Science 7, 561893 (2020).","journal-title":"Frontiers in Marine Science"},{"key":"7786_CR10","unstructured":"Watson, M. Ozfish dataset: machine learning dataset for baited remote underwater video stations. CSIRO Data Collection (2020)."},{"key":"7786_CR11","unstructured":"Watson, M. OzFish Dataset: Machine Learning Dataset for Baited Remote Underwater Video Stations, CSIRO Data Collection, Available at: https:\/\/researchdata.edu.au\/ozfish-dataset-machine-learning\/1333757, accessed June 2026."},{"key":"7786_CR12","doi-asserted-by":"publisher","unstructured":"Dendorfer, P. et al. Mot20: A benchmark for multi-object tracking in crowded scenes. arXiv preprint arXiv:2003.09003, https:\/\/doi.org\/10.48550\/arXiv.2003.09003 (2020).","DOI":"10.48550\/arXiv.2003.09003"},{"key":"7786_CR13","doi-asserted-by":"publisher","unstructured":"Yang, L., Fan, Y. & Xu, N. Video instance segmentation. In Proceedings of the IEEE\/CVF international conference on computer vision, pages 5188-5197, https:\/\/doi.org\/10.1109\/ICCV.2019.00529 (2019).","DOI":"10.1109\/ICCV.2019.00529"},{"key":"7786_CR14","unstructured":"Yang, L., Fan, Y. & Xu, N. YouTube-VIS: Video Instance Segmentation Dataset, Available at: https:\/\/youtube-vos.org\/dataset\/vis\/, accessed June 2026."},{"key":"7786_CR15","doi-asserted-by":"publisher","unstructured":"Sun, P. et al Dancetrack: Multi-object tracking in uniform appearance and diverse motion. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pages 20993-21002, https:\/\/doi.org\/10.1109\/CVPR52688.2022.02032 (2022).","DOI":"10.1109\/CVPR52688.2022.02032"},{"key":"7786_CR16","unstructured":"DanceTrack Team, DanceTrack Dataset and Benchmark, Available at: https:\/\/dancetrack.github.io\/, accessed June 2026."},{"key":"7786_CR17","unstructured":"MOTChallenge Team, MOT20: Multiple Object Tracking Benchmark Dataset, MOTChallenge, Available at: https:\/\/motchallenge.net\/data\/MOT20\/, accessed June 2026."},{"issue":"4","key":"7786_CR18","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1007\/s11263-020-01393-0","volume":"129","author":"P Dendorfer","year":"2021","unstructured":"Dendorfer, P. et al. Motchallenge: A benchmark for single-camera multiple target tracking. International Journal of Computer Vision 129(4), 845\u2013881, https:\/\/doi.org\/10.1007\/s11263-020-01393-0 (2021).","journal-title":"International Journal of Computer Vision"},{"key":"7786_CR19","unstructured":"MOTChallenge Team, MOT17: Multiple Object Tracking Benchmark Dataset, MOTChallenge, Available at: https:\/\/motchallenge.net\/data\/MOT17\/, accessed June 2026."},{"key":"7786_CR20","doi-asserted-by":"publisher","unstructured":"Pont-Tuset, J. et al. The 2017 davis challenge on video object segmentation. arXiv preprint arXiv:1704.00675, https:\/\/doi.org\/10.48550\/arXiv.1704.00675 (2018).","DOI":"10.48550\/arXiv.1704.00675"},{"key":"7786_CR21","unstructured":"DAVIS Team, DAVIS: Densely Annotated Video Segmentation Dataset, Available at: https:\/\/davischallenge.org\/, accessed June 2026."},{"key":"7786_CR22","doi-asserted-by":"publisher","unstructured":"Cutter, G., Stierhoff, K. & Zeng, J. Automated Detection of Rockfish in Unconstrained Underwater Videos Using Haar Cascades and a New Image Dataset: Labeled Fishes in the Wild. in Proceedings of the 2015 IEEE Winter Conference on Applications of Computer Vision Workshops (WACVW), Waikoloa, HI, USA, pp. 57\u201362, https:\/\/doi.org\/10.1109\/WACVW.2015.11 (2015).","DOI":"10.1109\/WACVW.2015.11"},{"key":"7786_CR23","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1594\/PANGAEA.980000","volume":"2","author":"T Wilts","year":"2025","unstructured":"Wilts, T. et al. Hodor: Hydroacoustic and optical dataset for oceanic research. IEEE Data Descriptions 2, 262\u2013270, https:\/\/doi.org\/10.1594\/PANGAEA.980000 (2025).","journal-title":"IEEE Data Descriptions"},{"issue":"3","key":"7786_CR24","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1109\/JOE.2023.3252760","volume":"49","author":"Z Fu","year":"2023","unstructured":"Fu, Z. et al. Masnet: A robust deep marine animal segmentation network. IEEE Journal of Oceanic Engineering 49(3), 1104\u20131115, https:\/\/doi.org\/10.1109\/JOE.2023.3252760 (2023).","journal-title":"IEEE Journal of Oceanic Engineering"},{"key":"7786_CR25","unstructured":"Australian Research Data Commons (ARDC), FishID: A Robust and Intuitive AI System for Researchers to Annotate Imagery and Train and Evaluate Deep Learning Models, [Online]. https:\/\/ardc.edu.au\/project\/fishid\/. Accessed: Jun. 4, 2026 (2022)."},{"key":"7786_CR26","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1016\/j.ecoinf.2018.09.007","volume":"48","author":"S Villon","year":"2018","unstructured":"Villon, S. et al. A deep learning method for accurate and fast identification of coral reef fishes in underwater images. Ecological Informatics 48, 238\u2013244, https:\/\/doi.org\/10.1016\/j.ecoinf.2018.09.007 (2018).","journal-title":"Ecological Informatics"},{"key":"7786_CR27","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.14888440","author":"P Ba\u00f1os Castell\u00f3","year":"2025","unstructured":"Banos Castello, P. et al.Underwater images from obsea fish detection training dataset (yolo). Zenodo https:\/\/doi.org\/10.5281\/zenodo.14888440 (2025)."},{"key":"7786_CR28","unstructured":"Francescangeli, M., R\u00edo, J. D., Nogueras, M., Chatzievangelou, D. & Aguzzi, J. Implementation of the OBSEA coastal seafloor observatory to derive ecological indicators, in Proceedings of the VII International Symposium on Marine Sciences (ISMS 2020), Barcelona, Spain (2020)."},{"issue":"no. 12","key":"7786_CR29","doi-asserted-by":"publisher","first-page":"2809","DOI":"10.1007\/s00227-012-2041-3","volume":"159","author":"F Condal","year":"2012","unstructured":"Condal, F. et al. Seasonal rhythm in a Mediterranean coastal fish community as monitored by a cabled observatory. Marine Biology 159(12), 2809\u20132817, https:\/\/doi.org\/10.1007\/s00227-012-2041-3 (2012).","journal-title":"Marine Biology"},{"key":"7786_CR30","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.neucom.2022.10.039","volume":"517","author":"C Fu","year":"2023","unstructured":"Fu, C. et al. Rethinking general underwater object detection: Datasets, challenges, and solutions. Neurocomputing 517, 243\u2013256, https:\/\/doi.org\/10.1016\/j.neucom.2022.10.039 (2023).","journal-title":"Neurocomputing"},{"key":"7786_CR31","doi-asserted-by":"publisher","unstructured":"Joly, A. et al. Lifeclef 2015: Multimedia life species identification challenges. In Proceedings of the 6th International Conference on Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2015), pages 462-483. Springer, https:\/\/doi.org\/10.1007\/978-3-319-24027-5_46 (2015).","DOI":"10.1007\/978-3-319-24027-5_46"},{"key":"7786_CR32","unstructured":"LifeCLEF, LifeCLEF 2015 Fish Identification Task Dataset, Available at: https:\/\/www.imageclef.org\/lifeclef\/2015\/fish, accessed June 2026."},{"key":"7786_CR33","doi-asserted-by":"publisher","unstructured":"Joly, A. et al. Lifeclef 2017 lab overview: Multimedia species identification challenges. In Experimental IR Meets Multilinguality, Multimodality, and Interaction, volume 10456 of Lecture Notes in Computer Science. Springer, https:\/\/doi.org\/10.1007\/978-3-319-65813-1_24 (2017).","DOI":"10.1007\/978-3-319-65813-1_24"},{"key":"7786_CR34","doi-asserted-by":"publisher","unstructured":"Fisher, R. B. et al. Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data, 104. Springer, https:\/\/doi.org\/10.1007\/978-3-319-30208-9 (2016).","DOI":"10.1007\/978-3-319-30208-9"},{"key":"7786_CR35","doi-asserted-by":"publisher","unstructured":"Li, W. et al. When trackers date fish: A benchmark and framework for underwater multiple fish tracking. In Proceedings of the Fortieth AAAI Conference on Artificial Intelligence and Thirty-Eighth Conference on Innovative Applications of Artificial Intelligence and Sixteenth Symposium on Educational Advances in Artificial Intelligence, AAAI Press, 718, https:\/\/doi.org\/10.1609\/aaai.v40i8.37574 (2026).","DOI":"10.1609\/aaai.v40i8.37574"},{"issue":"1","key":"7786_CR36","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1109\/JOE.2021.3086907","volume":"47","author":"K Panetta","year":"2022","unstructured":"Panetta, K., Kezebou, L., Oludare, V. & Agaian, S. Comprehensive underwater object tracking benchmark dataset and underwater image enhancement with gan. IEEE Journal of Oceanic Engineering 47(1), 59\u201375, https:\/\/doi.org\/10.1109\/JOE.2021.3086907 (2022).","journal-title":"IEEE Journal of Oceanic Engineering"},{"key":"7786_CR37","doi-asserted-by":"publisher","unstructured":"Zhang, C. et al. Webuot-1m: advancing deep underwater object tracking with a million-scale benchmark, in Advances in Neural Information Processing Systems, vol. 37, A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, & C. Zhang, Eds. Curran Associates, Inc., pp. 50152\u2013 50167, https:\/\/doi.org\/10.52202\/079017-1587 (2024).","DOI":"10.52202\/079017-1587"},{"key":"7786_CR38","doi-asserted-by":"publisher","unstructured":"Ravi, N. et al. Sam 2: segment anything in images and videos. arXiv preprint arXiv:2408.00714, https:\/\/doi.org\/10.48550\/arXiv.2408.00714 (2024).","DOI":"10.48550\/arXiv.2408.00714"},{"key":"7786_CR39","doi-asserted-by":"publisher","unstructured":"Cheng, H. K., Oh, S. W., Price, B., Lee, J. Y. & Schwing, A. Putting the object back into video object segmentation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 3151\u20133161, https:\/\/doi.org\/10.1109\/CVPR52733.2024.00304 (2023).","DOI":"10.1109\/CVPR52733.2024.00304"},{"key":"7786_CR40","doi-asserted-by":"publisher","DOI":"10.3389\/fmars.2023.1151758","volume":"10","author":"IA Catalan","year":"2023","unstructured":"Catalan, I. A. et al. Automatic detection and classification of coastal mediterranean fish from underwater images: Good practices for robust training. Frontiers in Marine Science 10, 1151758, https:\/\/doi.org\/10.3389\/fmars.2023.1151758 (2023).","journal-title":"Frontiers in Marine Science"},{"key":"7786_CR41","doi-asserted-by":"publisher","unstructured":"Sanchez, J. & Lisani, J. Open source video annotation tool for underwater scenes. In Artificial Intelligence Research and Development 205-208, https:\/\/doi.org\/10.3233\/FAIA240437 (2024).","DOI":"10.3233\/FAIA240437"},{"key":"7786_CR42","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.20617668","author":"J S\u00e1nchez","year":"2026","unstructured":"S\u00e1nchez, J., Lisani, J.-L., Catal\u00e1n, I. & Alvarez-Ellacuria, A. SFISHTRACK, Zenodo https:\/\/doi.org\/10.5281\/zenodo.20617668 (2026).","journal-title":"SFISHTRACK, Zenodo"},{"key":"7786_CR43","doi-asserted-by":"publisher","unstructured":"Maggiolino, G., Ahmad, A., Cao, J. & Kitani, K. Deep oc-sort: Multi-pedestrian tracking by adaptive re-identification. In Proceedings of the IEEE International Conference on Image Processing (ICIP) 3025\u20133029, https:\/\/doi.org\/10.1109\/ICIP49359.2023.10222576 (2023).","DOI":"10.1109\/ICIP49359.2023.10222576"},{"issue":"no. 1","key":"7786_CR44","doi-asserted-by":"publisher","DOI":"10.1155\/2008\/246309","volume":"2008","author":"K Bernardin","year":"2008","unstructured":"Bernardin, K. & Stiefelhagen, R. Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP Journal on Image and Video Processing 2008(1), 246309, https:\/\/doi.org\/10.1155\/2008\/246309 (2008).","journal-title":"EURASIP Journal on Image and Video Processing"},{"key":"7786_CR45","doi-asserted-by":"publisher","unstructured":"Luiten, J. et al. HOTA: A higher order metric for evaluating multi-object tracking. International Journal of Computer Vision, 129(2), 548-578, https:\/\/doi.org\/10.1007\/s11263-020-01375-2 (2021).","DOI":"10.1007\/s11263-020-01375-2"},{"key":"7786_CR46","unstructured":"Fu, C. et al. RUOD: Real-world Underwater Object Detection Dataset, GitHub repository https:\/\/github.com\/xiaoDetection\/RUOD accessed June 2026."},{"key":"7786_CR47","unstructured":"Fish4Knowledge Consortium. Fish4Knowledge Project and Dataset https:\/\/homepages.inf.ed.ac.uk\/rbf\/Fish4Knowledge\/GROUNDTRUTH\/ accessed June 2026."},{"key":"7786_CR48","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.20617668","author":"J S\u00e1nchez","year":"2026","unstructured":"S\u00e1nchez, J., Lisani, J.-L., Catal\u00e1n, I. & Alvarez-Ellacuria, A. SFISHTRACK: A Dataset for Fish Segmentation and Tracking in Underwater Videos. Zenodo https:\/\/doi.org\/10.5281\/zenodo.20617668 (2026)."}],"container-title":["Scientific Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-07786-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-07786-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-07786-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T08:35:56Z","timestamp":1786523756000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-07786-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,12]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["7786"],"URL":"https:\/\/doi.org\/10.1038\/s41597-026-07786-z","relation":{"references":[{"id-type":"doi","id":"10.5281\/zenodo.14888440","asserted-by":"subject"},{"id-type":"doi","id":"10.5281\/zenodo.20617668","asserted-by":"subject"}]},"ISSN":["2052-4463"],"issn-type":[{"value":"2052-4463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,12]]},"assertion":[{"value":"27 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"1181"}}