{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T11:39:45Z","timestamp":1778153985064,"version":"3.51.4"},"reference-count":31,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T00:00:00Z","timestamp":1651708800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund-The Competitiveness and Cohesion Operational Programme Competitiveness and Cohesion 2014\u20132020","award":["KK.01.1.1.04.0036"],"award-info":[{"award-number":["KK.01.1.1.04.0036"]}]},{"name":"European Regional Development Fund-The Competitiveness and Cohesion Operational Programme Competitiveness and Cohesion 2014\u20132020","award":["10248782"],"award-info":[{"award-number":["10248782"]}]},{"name":"Interreg Italy-Croatia InnovaMare project","award":["KK.01.1.1.04.0036"],"award-info":[{"award-number":["KK.01.1.1.04.0036"]}]},{"name":"Interreg Italy-Croatia InnovaMare project","award":["10248782"],"award-info":[{"award-number":["10248782"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Aquaculture net pens inspection and monitoring are important to ensure net stability and fish health in the fish farms. Remotely operated vehicles (ROVs) offer a low-cost and sophisticated solution for the regular inspection of the underwater fish net pens due to their ability of visual sensing and autonomy in a challenging and dynamic aquaculture environment. In this paper, we report the integration of an ROV with a visual servoing scheme for regular inspection and tracking of the net pens. We propose a vision-based positioning scheme that consists of an object detector, a pose generator, and a closed-loop controller. The system employs a modular approach that first utilizes two easily identifiable parallel ropes attached to the net for image processing through traditional computer vision methods. Second, the reference positions of the ROV relative to the net plane are extracted on the basis of a vision triangulation method. Third, a closed-loop control law is employed to instruct the vehicle to traverse from top to bottom along the net plane to inspect its status. The proposed vision-based scheme has been implemented and tested both through simulations and field experiments. The extensive experimental results have allowed the assessment of the performance of the scheme that resulted satisfactorily and can supplement the traditional aquaculture net pens inspection and tracking systems.<\/jats:p>","DOI":"10.3390\/s22093525","type":"journal-article","created":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T02:46:39Z","timestamp":1651805199000},"page":"3525","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A Visual Servoing Scheme for Autonomous Aquaculture Net Pens Inspection Using ROV"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7401-5120","authenticated-orcid":false,"given":"Waseem","family":"Akram","sequence":"first","affiliation":[{"name":"Department of Informatics, Modeling, Electronics, and Systems (DIMES), University of Calabria, 87036 Rende, Italy"}]},{"given":"Alessandro","family":"Casavola","sequence":"additional","affiliation":[{"name":"Department of Informatics, Modeling, Electronics, and Systems (DIMES), University of Calabria, 87036 Rende, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1167-2000","authenticated-orcid":false,"given":"Nadir","family":"Kapetanovi\u0107","sequence":"additional","affiliation":[{"name":"Laboratory for Underwater Systems and Technologies (LABUST), Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia"}]},{"given":"Nikola","family":"Mi\u0161kovic","sequence":"additional","affiliation":[{"name":"Laboratory for Underwater Systems and Technologies (LABUST), Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Jovanovi\u0107, V., Svendsen, E., Risojevi\u0107, V., and Babi\u0107, Z. (2018, January 20\u201321). Splash detection in fish Plants surveillance videos using deep learning. Proceedings of the 2018 14th Symposium on Neural Networks and Applications (NEUREL), Belgrade, Serbia.","DOI":"10.1109\/NEUREL.2018.8586984"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"102219","DOI":"10.1016\/j.aquaeng.2021.102219","article-title":"Research on intelligent damage detection of far-sea cage based on machine vision and deep learning","volume":"96","author":"Liao","year":"2022","journal-title":"Aquac. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ubina, N.A., and Cheng, S.C. (2022). A Review of Unmanned System Technologies with Its Application to Aquaculture Farm Monitoring and Management. Drones, 6.","DOI":"10.3390\/drones6010012"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"102071","DOI":"10.1016\/j.aquaeng.2020.102071","article-title":"An adaptive method of damage detection for fishing nets based on image processing technology","volume":"90","author":"Zhao","year":"2020","journal-title":"Aquac. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"108424","DOI":"10.1016\/j.oceaneng.2020.108424","article-title":"An integrated approach for monitoring structural deformation of aquaculture net cages","volume":"219","author":"Su","year":"2021","journal-title":"Ocean. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1016\/j.ifacol.2021.10.128","article-title":"Vision-based pose estimation for autonomous operations in aquacultural fish farms","volume":"54","author":"Schellewald","year":"2021","journal-title":"IFAC-PapersOnLine"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chalkiadakis, V., Papandroulakis, N., Livanos, G., Moirogiorgou, K., Giakos, G., and Zervakis, M. (2017, January 18\u201320). Designing a small-sized autonomous underwater vehicle architecture for regular periodic fish-cage net inspection. Proceedings of the 2017 IEEE International Conference on Imaging Systems and Techniques (IST), Beijing, China.","DOI":"10.1109\/IST.2017.8261525"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tao, Q., Huang, K., Qin, C., Guo, B., Lam, R., and Zhang, F. (2018, January 22\u201325). Omnidirectional surface vehicle for fish cage inspection. Proceedings of the OCEANS 2018 MTS\/IEEE Charleston, Charleston, SC, USA.","DOI":"10.1109\/OCEANS.2018.8604674"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lin, T.X., Tao, Q., and Zhang, F. (September, January 31). Planning for Fish Net Inspection with an Autonomous OSV. Proceedings of the 2020 International Conference on System Science and Engineering (ICSSE), Kagawa, Japan.","DOI":"10.1109\/ICSSE50014.2020.9219318"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ohrem, S.J., Kelasidi, E., and Bloecher, N. (2020, January 15\u201318). Analysis of a novel autonomous underwater robot for biofouling prevention and inspection in fish farms. Proceedings of the 2020 28th Mediterranean Conference on Control and Automation (MED), Saint-Rapha\u00ebl, France.","DOI":"10.1109\/MED48518.2020.9183157"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JOE.2021.3105285","article-title":"Autonomous ROV inspections of aquaculture net pens using DVL","volume":"47","author":"Amundsen","year":"2021","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42452-020-03623-z","article-title":"An integrated ROV solution for underwater net-cage inspection in fish farms using computer vision","volume":"2","author":"Betancourt","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cario, G., Casavola, A., Gjanci, P., Lupia, M., Petrioli, C., and Spaccini, D. (2017, January 19\u201322). Long lasting underwater wireless sensors network for water quality monitoring in fish farms. Proceedings of the OCEANS 2017-Aberdeen, Aberdeen, UK.","DOI":"10.1109\/OCEANSE.2017.8084777"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Livanos, G., Zervakis, M., Chalkiadakis, V., Moirogiorgou, K., Giakos, G., and Papandroulakis, N. (2018, January 16\u201318). Intelligent navigation and control of a prototype Autonomous underwater vehicle for automated inspection of aquaculture net pen cages. Proceedings of the 2018 IEEE International Conference on Imaging Systems and Techniques (IST), Krakow, Poland.","DOI":"10.1109\/IST.2018.8577180"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bjerkeng, M., Kirkhus, T., Caharija, W., T Thielemann, J., B Amundsen, H., Johan Ohrem, S., and Ingar Gr\u00f8tli, E. (2021). ROV Navigation in a Fish Cage with Laser-Camera Triangulation. J. Mar. Sci. Eng., 9.","DOI":"10.3390\/jmse9010079"},{"key":"ref_16","first-page":"652","article-title":"Applying Artificial Intelligence (AI) Techniques to Implement a Practical Smart Cage Aquaculture Management System","volume":"41","author":"Chang","year":"2021","journal-title":"J. Med. Biol. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2028","DOI":"10.1049\/iet-ipr.2019.1667","article-title":"Automated fish cage net inspection using image processing techniques","volume":"14","author":"Paspalakis","year":"2020","journal-title":"IET Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kapetanovi\u0107, N., Nad, D., and Mi\u0161kovi\u0107, N. (2021, January 20\u201323). Towards a Heterogeneous Robotic System for Autonomous Inspection in Mariculture. Proceedings of the OCEANS 2021 Conference and Exposition, San Diego\u2014Porto (Hybrid), San Diego, CA, USA.","DOI":"10.23919\/OCEANS44145.2021.9705776"},{"key":"ref_19","unstructured":"Rezo, M., \u010cagalj, K.M., and Kova\u010di\u0107, Z. (October, January 27). Collecting information for biomass estimation in mariculture with a heterogeneous robotic system. Proceedings of the 44th International ICT Convention MIPRO, Opatija, Croatia."},{"key":"ref_20","unstructured":"Gori\u010danec, J., Kapetanovi\u0107, N., Vatavuk, I., Hrabar, I., Kurtela, A., Ani\u0107, M., Vasilijevi\u0107, G., Bolotin, J., Ko\u017eul, V., and Stuhne, D. (July, January 30). Heterogeneous autonomous robotic system in viticulture and mariculture-project overview. Proceedings of the 16th International Conference on Telecommunications-ConTEL, Zagreb, Croatia."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Borkovi\u0107, G., Fabijani\u0107, M., Magdaleni\u0107, M., Malobabi\u0107, A., Vukovi\u0107, J., Zieli\u0144ski, I., Kapetanovi\u0107, N., Kvasi\u0107, I., Babi\u0107, A., and Mi\u0161kovi\u0107, N. (October, January 27). Underwater ROV Software for Fish Cage Inspection. Proceedings of the 2021 44th International Convention on Information, Communication and Electronic Technology (MIPRO), Opatija, Croatia.","DOI":"10.23919\/MIPRO52101.2021.9596823"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Duda, A., Schwendner, J., Stahl, A., and Rundtop, P. (2015, January 18\u201321). Visual pose estimation for autonomous inspection of fish pens. Proceedings of the OCEANS 2015-Genova, Genova, Italy.","DOI":"10.1109\/OCEANS-Genova.2015.7271392"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Osen, O.L., Leinan, P.M., Blom, M., Bakken, C., Heggen, M., and Zhang, H. (2018, January 22\u201325). A novel sea farm inspection platform for norwegian aquaculture application. Proceedings of the OCEANS 2018 MTS\/IEEE Charleston, Charleston, SC, USA.","DOI":"10.1109\/OCEANS.2018.8604648"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1109\/5.4400","article-title":"Variable structure control of nonlinear multivariable systems: A tutorial","volume":"76","author":"DeCarlo","year":"1988","journal-title":"Proc. IEEE"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1007\/s10846-017-0700-9","article-title":"Development and experimental tests of a ROS multi-agent structure for autonomous surface vehicles","volume":"92","author":"Conte","year":"2018","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Djapic, V., and Nad, D. (2010, January 24\u201327). Using collaborative autonomous vehicles in mine countermeasures. Proceedings of the OCEANS\u201910 IEEE SYDNEY, Sydney, NSW, Australia.","DOI":"10.1109\/OCEANSSYD.2010.5603969"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1007\/s41315-021-00193-0","article-title":"Vision-based positioning system for auto-docking of unmanned surface vehicles (USVs)","volume":"6","author":"Volden","year":"2021","journal-title":"Int. J. Intell. Robot. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s11370-011-0103-x","article-title":"Real-time optical SLAM-based mosaicking for unmanned underwater vehicles","volume":"5","author":"Ferreira","year":"2012","journal-title":"Intell. Serv. Robot."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Manh\u00e3es, M.M.M., Scherer, S.A., Voss, M., Douat, L.R., and Rauschenbach, T. (2016, January 19\u201323). UUV Simulator: A Gazebo-based package for underwater intervention and multi-robot simulation. Proceedings of the OCEANS 2016 MTS\/IEEE Monterey, Monterey, CA, USA.","DOI":"10.1109\/OCEANS.2016.7761080"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fossen, T.I. (2011). Handbook of Marine Craft Hydrodynamics and Motion Control, John Wiley & Sons.","DOI":"10.1002\/9781119994138"},{"key":"ref_31","unstructured":"Kapetanovi\u0107, N., and Vukovi\u0107, J. (2021, July 22). Blueye SDK-ROS2 Interface. Available online: https:\/\/github.com\/labust\/blueye-ros2-pkg.git."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/9\/3525\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:06:35Z","timestamp":1760137595000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/9\/3525"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,5]]},"references-count":31,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["s22093525"],"URL":"https:\/\/doi.org\/10.3390\/s22093525","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,5]]}}}