{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T12:31:25Z","timestamp":1784118685769,"version":"3.55.0"},"reference-count":61,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T00:00:00Z","timestamp":1661126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Nowadays, underwater video systems are largely used by marine ecologists to study the biodiversity in underwater environments. These systems are non-destructive, do not perturb the environment and generate a large amount of visual data usable at any time. However, automatic video analysis requires efficient techniques of image processing due to the poor quality of underwater images and the challenging underwater environment. In this paper, we address live reef fish species classification in an unconstrained underwater environment. We propose using a deep Convolutional Neural Network (CNN) and training this network by using a new strategy based on incremental learning. This training strategy consists of training the CNN progressively by focusing at first on learning the difficult species well and then gradually learning the new species incrementally using knowledge distillation loss while keeping the high performances of the old species already learned. The proposed approach yields an accuracy of 81.83% on the LifeClef 2015 Fish benchmark dataset.<\/jats:p>","DOI":"10.3390\/make4030036","type":"journal-article","created":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T05:18:17Z","timestamp":1661145497000},"page":"753-767","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Live Fish Species Classification in Underwater Images by Using Convolutional Neural Networks Based on Incremental Learning with Knowledge Distillation Loss"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8260-5569","authenticated-orcid":false,"given":"Abdelouahid","family":"Ben Tamou","sequence":"first","affiliation":[{"name":"ENIB, UMR CNRS 6285 LabSTICC, 29238 Brest, France"},{"name":"Univ Brest, UMR CNRS 6285 LabSTICC, 29238 Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1859-3409","authenticated-orcid":false,"given":"Abdesslam","family":"Benzinou","sequence":"additional","affiliation":[{"name":"ENIB, UMR CNRS 6285 LabSTICC, 29238 Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9834-3399","authenticated-orcid":false,"given":"Kamal","family":"Nasreddine","sequence":"additional","affiliation":[{"name":"ENIB, UMR CNRS 6285 LabSTICC, 29238 Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1111\/brv.12423","article-title":"The hidden half: Ecology and evolution of cryptobenthic fishes on coral reefs","volume":"93","author":"Brandl","year":"2018","journal-title":"Biol. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/S0422-9894(08)71107-3","article-title":"Pollution and degradation of coral reef communities","volume":"Volume 12","author":"Johannes","year":"1975","journal-title":"Elsevier Oceanography Series"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1111\/gcb.13482","article-title":"Fishing degrades size structure of coral reef fish communities","volume":"23","author":"Robinson","year":"2017","journal-title":"Glob. Chang. Biol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2723","DOI":"10.1016\/j.cub.2019.06.077","article-title":"Rapid coral decay is associated with marine heatwave mortality events on reefs","volume":"29","author":"Leggat","year":"2019","journal-title":"Curr. Biol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1016\/j.cub.2014.01.049","article-title":"Human-mediated loss of phylogenetic and functional diversity in coral reef fishes","volume":"24","author":"Mouillot","year":"2014","journal-title":"Curr. Biol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1038\/nature22901","article-title":"Coral reefs in the Anthropocene","volume":"546","author":"Hughes","year":"2017","journal-title":"Nature"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1126\/science.1059199","article-title":"Historical overfishing and the recent collapse of coastal ecosystems","volume":"293","author":"Jackson","year":"2001","journal-title":"Science"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"127","DOI":"10.3354\/meps213127","article-title":"Impacts of trawling disturbance on the trophic structure of benthic invertebrate communities","volume":"213","author":"Jennings","year":"2001","journal-title":"Mar. Ecol. Prog. Ser."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1590\/1519-6984.15015","article-title":"The efficacy of clove oil as an anaesthetic and in euthanasia procedure for small-sized tropical fishes","volume":"77","author":"Fernandes","year":"2016","journal-title":"Braz. J. Biol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/BF00001740","article-title":"Comparative analysis of visual census techniques for highly mobile, reef-associated piscivores (Carangidae)","volume":"17","author":"Thresher","year":"1986","journal-title":"Environ. Biol. Fishes"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5809","DOI":"10.1007\/s10489-020-02155-8","article-title":"Multi-stream fish detection in unconstrained underwater videos by the fusion of two convolutional neural network detectors","volume":"51","author":"Benzinou","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Huang, P.X., Boom, B.J., and Fisher, R.B. (2012, January 5\u20139). Underwater live fish recognition using a balance-guaranteed optimized tree. Proceedings of the Asian Conference on Computer Vision, Daejeon, Korea.","DOI":"10.1007\/978-3-642-37331-2_32"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Spampinato, C., Giordano, D., Di Salvo, R., Chen-Burger, Y.H.J., Fisher, R.B., and Nadarajan, G. (2010, January 29). Automatic fish classification for underwater species behavior understanding. Proceedings of the first ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams, Firenze, Italy.","DOI":"10.1145\/1877868.1877881"},{"key":"ref_14","unstructured":"Cabrera-G\u00e1mez, J., Castrill\u00f3n-Santana, M., Dominguez-Brito, A., Hern\u00e1ndez Sosa, J.D., Isern-Gonz\u00e1lez, J., and Lorenzo-Navarro, J. (2015, January 11). Exploring the use of local descriptors for fish recognition in lifeclef 2015. Proceedings of the CEUR Workshop Proceedings, Toledo, Spain."},{"key":"ref_15","unstructured":"Szucs, G., Papp, D., and Lovas, D. (2015, January 8\u201311). SVM classification of moving objects tracked by Kalman filter and Hungarian method. Proceedings of the Working Notes of CLEF 2015 Conference, Toulouse, France."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hu, K., Weng, C., Zhang, Y., Jin, J., and Xia, Q. (2022). An Overview of Underwater Vision Enhancement: From Traditional Methods to Recent Deep Learning. J. Mar. Sci. Eng., 10.","DOI":"10.3390\/jmse10020241"},{"key":"ref_17","unstructured":"Edge, C., Islam, M.J., Morse, C., and Sattar, J. (2020). A Generative Approach for Detection-driven Underwater Image Enhancement. arXiv."},{"key":"ref_18","unstructured":"Li, X., Shang, M., Qin, H., and Chen, L. (2015, January 19\u201322). Fast accurate fish detection and recognition of underwater images with fast r-cnn. Proceedings of the OCEANS 2015-MTS\/IEEE, Washington, DC, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"101088","DOI":"10.1016\/j.ecoinf.2020.101088","article-title":"Fish detection and species classification in underwater environments using deep learning with temporal information","volume":"57","author":"Jalal","year":"2020","journal-title":"Ecol. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"107815","DOI":"10.1016\/j.ecss.2022.107815","article-title":"Coastal fisheries resource monitoring through A deep learning-based underwater video analysis","volume":"269","author":"Zhang","year":"2022","journal-title":"Estuar. Coast. Shelf Sci."},{"key":"ref_21","unstructured":"J\u00e4ger, J., Rodner, E., Denzler, J., Wolff, V., and Fricke-Neuderth, K. (2016, January 5\u20138). SeaCLEF 2016: Object Proposal Classification for Fish Detection in Underwater Videos. Proceedings of the CLEF (Working Notes), \u00c9vora, Portugal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1016\/j.neucom.2017.09.044","article-title":"Transferring deep knowledge for object recognition in low-quality underwater videos","volume":"275","author":"Sun","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"165499","DOI":"10.1016\/j.ijleo.2020.165499","article-title":"Fish species recognition using an improved AlexNet model","volume":"223","author":"Ju","year":"2020","journal-title":"Optik"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1007\/s11277-019-06634-1","article-title":"Automatic fish species classification using deep convolutional neural networks","volume":"116","author":"Iqbal","year":"2021","journal-title":"Wirel. Pers. Commun."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Villon, S., Chaumont, M., Subsol, G., Vill\u00e9ger, S., Claverie, T., and Mouillot, D. (2016, January 24\u201327). Coral reef fish detection and recognition in underwater videos by supervised machine learning: Comparison between Deep Learning and HOG + SVM methods. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Lecce, Italy.","DOI":"10.1007\/978-3-319-48680-2_15"},{"key":"ref_26","first-page":"188","article-title":"Fish species recognition using transfer learning techniques","volume":"7","author":"Murugaiyan","year":"2021","journal-title":"Int. J. Adv. Intell. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"31625","DOI":"10.1007\/s11042-020-09371-x","article-title":"Crosspooled FishNet: Transfer learning based fish species classification model","volume":"79","author":"Mathur","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/s42979-021-00614-8","article-title":"FishResNet: Automatic Fish Classification Approach in Underwater Scenario","volume":"2","author":"Mathur","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1007\/s10115-021-01643-8","article-title":"Large-scale underwater fish recognition via deep adversarial learning","volume":"64","author":"Zhang","year":"2022","journal-title":"Knowl. Inf. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qin, H., Li, X., Yang, Z., and Shang, M. (2015, January 19\u201322). When underwater imagery analysis meets deep learning: A solution at the age of big visual data. Proceedings of the OCEANS 2015-MTS\/IEEE, Washington, DC, USA.","DOI":"10.23919\/OCEANS.2015.7404463"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1002\/lom3.10113","article-title":"Fish species classification in unconstrained underwater environments based on deep learning","volume":"14","author":"Salman","year":"2016","journal-title":"Limnol. Oceanogr. Methods"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Paraschiv, M., Padrino, R., Casari, P., Bigal, E., Scheinin, A., Tchernov, D., and Fern\u00e1ndez Anta, A. (2022). Classification of Underwater Fish Images and Videos via Very Small Convolutional Neural Networks. J. Mar. Sci. Eng., 10.","DOI":"10.3390\/jmse10060736"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.neucom.2015.10.122","article-title":"DeepFish: Accurate underwater live fish recognition with a deep architecture","volume":"187","author":"Qin","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sun, X., Shi, J., Dong, J., and Wang, X. (2016, January 15\u201317). Fish recognition from low-resolution underwater images. Proceedings of the 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Datong, China.","DOI":"10.1109\/CISP-BMEI.2016.7852757"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4719","DOI":"10.1109\/TIP.2021.3074738","article-title":"Composited FishNet: Fish detection and species recognition from low-quality underwater videos","volume":"30","author":"Zhao","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_38","first-page":"17","article-title":"Fish Image Classification by XgBoost Based on Gist and GLCM Features","volume":"4","author":"Dhar","year":"2021","journal-title":"Int. J. Inf. Technol. Comput. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Grauman, K., and Darrell, T. (2005, January 17\u201321). The pyramid match kernel: Discriminative classification with sets of image features. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV\u201905), Beijing, China.","DOI":"10.1109\/ICCV.2005.239"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5017","DOI":"10.1109\/TIP.2015.2475625","article-title":"PCANet: A simple deep learning baseline for image classification?","volume":"24","author":"Chan","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","unstructured":"Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv."},{"key":"ref_43","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2022, July 07). Imagenet Classification with Deep Convolutional Neural Networks. Available online: https:\/\/proceedings.neurips.cc\/paper\/2012\/file\/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Pang, J., Liu, W., Liu, B., Tao, D., Zhang, K., and Lu, X. (2022, January 4\u20138). Interference Distillation for Underwater Fish Recognition. Proceedings of the Asian Conference on Pattern Recognition, Macau SAR, China.","DOI":"10.1007\/978-3-031-02375-0_5"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cheng, L., and He, C. (2021, January 4\u20136). Fish Recognition Based on Deep Residual Shrinkage Network. Proceedings of the 2021 4th International Conference on Robotics, Control and Automation Engineering (RCAE), Wuhan, China.","DOI":"10.1109\/RCAE53607.2021.9638791"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"6988","DOI":"10.1007\/s10489-020-02154-9","article-title":"Temperate fish detection and classification: A deep learning based approach","volume":"52","author":"Wiklund","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_49","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Olsvik, E., Trinh, C., Knausg\u00e5rd, K.M., Wiklund, A., S\u00f8rdalen, T.K., Kleiven, A.R., Jiao, L., and Goodwin, M. (2019, January 9\u201311). Biometric fish classification of temperate species using convolutional neural network with squeeze-and-excitation. Proceedings of the International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, Graz, Austria.","DOI":"10.1007\/978-3-030-22999-3_9"},{"key":"ref_51","unstructured":"Mittal, S., Srivastava, S., and Jayanth, J.P. (2022, July 07). A Survey of Deep Learning Techniques for Underwater Image Classification. Available online: https:\/\/www.researchgate.net\/profile\/Sparsh-Mittal-2\/publication\/357826927_A_Survey_of_Deep_Learning_Techniques_for_Underwater_Image_Classification\/links\/61e145aec5e310337591ec08\/A-Survey-of-Deep-Learning-Techniques-for-Underwater-Image-Classification.pdf."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1111\/faf.12666","article-title":"Computer vision and deep learning for fish classification in underwater habitats: A survey","volume":"23","author":"Saleh","year":"2022","journal-title":"Fish Fish."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Shmelkov, K., Schmid, C., and Alahari, K. (2017, January 22\u201329). Incremental learning of object detectors without catastrophic forgetting. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.368"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xiao, T., Zhang, J., Yang, K., Peng, Y., and Zhang, Z. (2014, January 3\u20137). Error-driven incremental learning in deep convolutional neural network for large-scale image classification. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654926"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1109\/5326.983933","article-title":"Learn++: An incremental learning algorithm for supervised neural networks","volume":"31","author":"Polikar","year":"2001","journal-title":"IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.)"},{"key":"ref_56","unstructured":"Rusu, A.A., Rabinowitz, N.C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., and Hadsell, R. (2016). Progressive neural networks. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"3521","DOI":"10.1073\/pnas.1611835114","article-title":"Overcoming catastrophic forgetting in neural networks","volume":"114","author":"Kirkpatrick","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","article-title":"Learning without forgetting","volume":"40","author":"Li","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Hayes, T.L., Cahill, N.D., and Kanan, C. (2019, January 20\u201324). Memory efficient experience replay for streaming learning. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, Canada.","DOI":"10.1109\/ICRA.2019.8793982"},{"key":"ref_60","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_61","unstructured":"Boom, B.J., Huang, P.X., He, J., and Fisher, R.B. (2012, January 11\u201315). Supporting ground-truth annotation of image datasets using clustering. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/3\/36\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:13:23Z","timestamp":1760141603000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/3\/36"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,22]]},"references-count":61,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["make4030036"],"URL":"https:\/\/doi.org\/10.3390\/make4030036","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,22]]}}}