{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T19:20:55Z","timestamp":1773861655759,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,10,17]],"date-time":"2018-10-17T00:00:00Z","timestamp":1539734400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"publisher","award":["727153"],"award-info":[{"award-number":["727153"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Images obtained in an underwater environment are often affected by colour casting and suffer from poor visibility and lack of contrast. In the literature, there are many enhancement algorithms that improve different aspects of the underwater imagery. Each paper, when presenting a new algorithm or method, usually compares the proposed technique with some alternatives present in the current state of the art. There are no studies on the reliability of benchmarking methods, as the comparisons are based on various subjective and objective metrics. This paper would pave the way towards the definition of an effective methodology for the performance evaluation of the underwater image enhancement techniques. Moreover, this work could orientate the underwater community towards choosing which method can lead to the best results for a given task in different underwater conditions. In particular, we selected five well-known methods from the state of the art and used them to enhance a dataset of images produced in various underwater sites with different conditions of depth, turbidity, and lighting. These enhanced images were evaluated by means of three different approaches: objective metrics often adopted in the related literature, a panel of experts in the underwater field, and an evaluation based on the results of 3D reconstructions.<\/jats:p>","DOI":"10.3390\/rs10101652","type":"journal-article","created":{"date-parts":[[2018,10,17]],"date-time":"2018-10-17T10:22:54Z","timestamp":1539771774000},"page":"1652","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["Guidelines for Underwater Image Enhancement Based on Benchmarking of Different Methods"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6587-9958","authenticated-orcid":false,"given":"Marino","family":"Mangeruga","sequence":"first","affiliation":[{"name":"University of Calabria, Rende, 87036 Cosenza, Italy"},{"name":"3D Research s.r.l., Rende, 87036 Cosenza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9755-475X","authenticated-orcid":false,"given":"Fabio","family":"Bruno","sequence":"additional","affiliation":[{"name":"University of Calabria, Rende, 87036 Cosenza, Italy"},{"name":"3D Research s.r.l., Rende, 87036 Cosenza, Italy"}]},{"given":"Marco","family":"Cozza","sequence":"additional","affiliation":[{"name":"3D Research s.r.l., Rende, 87036 Cosenza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4474-5007","authenticated-orcid":false,"given":"Panagiotis","family":"Agrafiotis","sequence":"additional","affiliation":[{"name":"Photogrammetric Vision Laboratory, Department of Civil Engineering and Geomatics, Cyprus University of Technology, 3036 Limassol, Cyprus"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2732-4780","authenticated-orcid":false,"given":"Dimitrios","family":"Skarlatos","sequence":"additional","affiliation":[{"name":"Photogrammetric Vision Laboratory, Department of Civil Engineering and Geomatics, Cyprus University of Technology, 3036 Limassol, Cyprus"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,17]]},"reference":[{"key":"ref_1","unstructured":"(2018, January 08). MareCulture. Available online: http:\/\/www.imareculture.eu\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bruno, F., Lagudi, A., Ritacco, G., \u010cejka, J., Kou\u0159il, P., Liarokapis, F., Agrafiotis, P., Skarlatos, D., Philpin-Briscoe, O., and Poullis, C. (2017, January 19\u201322). Development and integration of digital technologies addressed to raise awareness and access to European underwater cultural heritage: An overview of the H2020 i-MARECULTURE project. Proceedings of the OCEANS 2017, Aberdeen, UK.","DOI":"10.1109\/OCEANSE.2017.8084984"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ioannides, M., Fink, E., Moropoulou, A., Hagedorn-Saupe, M., Fresa, A., Liest\u00f8l, G., Rajcic, V., and Grussenmeyer, P. (2016). Project iMARECULTURE: Advanced VR, iMmersive Serious Games and Augmented REality as Tools to Raise Awareness and Access to European Underwater CULTURal heritagE. Digital Heritage: Progress in Cultural Heritage: Documentation, Preservation, and Protection, Lecture Notes in Computer Science; Springer.","DOI":"10.1007\/978-3-319-48496-9"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mangeruga, M., Cozza, M., and Bruno, F. (2018). Evaluation of Underwater Image Enhancement Algorithms under Different Environmental Conditions. J. Mar. Sci. Eng., 6.","DOI":"10.3390\/jmse6010010"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.culher.2018.02.017","article-title":"State of the art and applications in archaeological underwater 3D recording and mapping","volume":"33","author":"Menna","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_6","unstructured":"Han, M., Lyu, Z., Qiu, T., and Xu, M. (2018). A Review on Intelligence Dehazing and Color Restoration for Underwater Images. IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2341","DOI":"10.1109\/TPAMI.2010.168","article-title":"Single Image Haze Removal Using Dark Channel Prior","volume":"33","author":"He","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Drews, P., Nascimento, E., Moraes, F., Botelho, S., and Campos, M. (2013, January 1\u20138). Transmission Estimation in Underwater Single Images. Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.113"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1145\/1360612.1360671","article-title":"Single image dehazing","volume":"27","author":"Fattal","year":"2008","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/2651362","article-title":"Dehazing using color-lines","volume":"34","author":"Fattal","year":"2014","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_11","unstructured":"Berman, D., and Avidan, S. (July, January 26). Non-local image dehazing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Berman, D., Treibitz, T., and Avidan, S. (2017, January 12\u201314). Air-light estimation using haze-lines. Proceedings of the 2017 IEEE International Conference on Computational Photography (ICCP), Stanford, CA, USA.","DOI":"10.1109\/ICCPHOT.2017.7951489"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sankpal, S.S., and Deshpande, S.S. (2016). Nonuniform Illumination Correction Algorithm for Underwater Images Using Maximum Likelihood Estimation Method. J. Eng., 2016.","DOI":"10.1155\/2016\/5718297"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"16","DOI":"10.5201\/ipol.2014.84","article-title":"Screened Poisson Equation for Image Contrast Enhancement","volume":"4","author":"Morel","year":"2014","journal-title":"Image Process. On Line"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Carlevaris-Bianco, N., Mohan, A., and Eustice, R.M. (2010, January 20\u201323). Initial results in underwater single image dehazing. Proceedings of the OCEANS 2010, Seattle, WA, USA.","DOI":"10.1109\/OCEANS.2010.5664428"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"25","DOI":"10.5194\/isprsarchives-XL-5-W5-25-2015","article-title":"A new color correction method for underwater imaging","volume":"40","author":"Bianco","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_17","unstructured":"Bianco, G., and Neumann, L. (2017, January 18\u201322). A fast enhancing method for non-uniformly illuminated underwater images. Proceedings of the OCEANS 2017, Anchorage, AL, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gatta, C., Rizzi, A., and Marini, D. (2002, January 2\u20135). Ace: An automatic color equalization algorithm. Proceedings of the Conference on Colour in Graphics, Imaging, and Vision, Poitiers, France.","DOI":"10.2352\/CGIV.2002.1.1.art00067"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"266","DOI":"10.5201\/ipol.2012.g-ace","article-title":"Automatic Color Enhancement (ACE) and its Fast Implementation","volume":"2","author":"Getreuer","year":"2012","journal-title":"Image Process. On Line"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zuiderveld, K. (1994). Contrast limited adaptive histogram equalization. Graphics Gems IV, Academic Press Professional, Inc.","DOI":"10.1016\/B978-0-12-336156-1.50061-6"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Singh, R., and Biswas, M. (2017, January 21\u201323). Contrast and color improvement based haze removal of underwater images using fusion technique. Proceedings of the 2017 4th International Conference on Signal Processing, Computing and Control (ISPCC), Solan, India.","DOI":"10.1109\/ISPCC.2017.8269664"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ancuti, C.O., Ancuti, C., Vleeschouwer, C.D., Neumann, L., and Garcia, R. (2017, January 17\u201320). Color transfer for underwater dehazing and depth estimation. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296370"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.jvcir.2014.11.006","article-title":"Automatic Red-Channel underwater image restoration","volume":"26","author":"Galdran","year":"2015","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_25","unstructured":"\u0141uczy\u0144ski, T., and Birk, A. (2018). Underwater Image Haze Removal and Color Correction with an Underwater-ready Dark Channel Prior. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lu, J., Li, N., Zhang, S., Yu, Z., Zheng, H., and Zheng, B. (2018). Multi-scale adversarial network for underwater image restoration. Opt. Laser Technol.","DOI":"10.1016\/j.optlastec.2018.05.048"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, C.Y., and Cavallaro, A. (2018, January 7\u201310). Background Light Estimation for Depth-Dependent Underwater Image Restoration. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451400"},{"key":"ref_28","unstructured":"Anwar, S., Li, C., and Porikli, F. (2018). Deep Underwater Image Enhancement. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/LSP.2018.2831630","article-title":"Underwater Image Color Correction using Exposure-Bracketing Imaging","volume":"25","author":"Nomura","year":"2018","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chang, H., Cheng, C., and Sung, C. (2018). Single Underwater Image Restoration Based on Depth Estimation and Transmission Compensation. IEEE J. Ocean. Eng.","DOI":"10.1109\/JOE.2018.2865045"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ancuti, C., Ancuti, C.O., Haber, T., and Bekaert, P. (2012, January 16\u201321). Enhancing underwater images and videos by fusion. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247661"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1109\/TIP.2017.2759252","article-title":"Color Balance and Fusion for Underwater Image Enhancement","volume":"27","author":"Ancuti","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Agrafiotis, P., Drakonakis, G.I., Georgopoulos, A., and Skarlatos, D. (2017). The Effect of Underwater Imagery Radiometry on 3d Reconstruction and Orthoimagery. ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci.","DOI":"10.5194\/isprs-archives-XLII-2-W3-25-2017"},{"key":"ref_35","unstructured":"Remondino, F., Georgopoulos, A., Gonz\u00e1lez-Aguilera, D., and Agrafiotis, P. (2018). Underwater Image Enhancement before Three-Dimensional (3D) Reconstruction and Orthoimage Production Steps: Is It Worth?. Latest Developments in Reality-Based 3D Surveying and Modelling, MDPI."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Agrafiotis, P., Skarlatos, D., Forbes, T., Poullis, C., Skamantzari, M., and Georgopoulos, A. (2018). Underwater photogrammetry in very shallow waters: Main challenges and caustics effect removal. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., 42.","DOI":"10.5194\/isprs-archives-XLII-2-15-2018"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Forbes, T., Goldsmith, M., Mudur, S., and Poullis, C. (2018). DeepCaustics: Classification and Removal of Caustics From Underwater Imagery. IEEE J. Ocean. Eng.","DOI":"10.1109\/JOE.2018.2838939"},{"key":"ref_38","unstructured":"Agisoft, L.L.C. (2017). Agisoft PhotoScan User Manual: Professional Edition, Agisoft LLC."},{"key":"ref_39","unstructured":"Leonardis, A., Bischof, H., and Pinz, A. (2006). SURF: Speeded Up Robust Features. European Conference on Computer Vision, Proceedings of the 9th European Conference on Computer Vision, Graz, Austria, 7\u201313 May 2006, Springer. Lecture Notes in Computer Science."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_41","unstructured":"(2017, December 04). OpenCV Library. Available online: https:\/\/opencv.org\/."},{"key":"ref_42","unstructured":"(2017, December 04). Eigen. Available online: http:\/\/eigen.tuxfamily.org\/index.php."},{"key":"ref_43","unstructured":"(2017, December 04). FLANN-Fast Library for Approximate Nearest Neighbors: FLANN-FLANN Browse. Available online: https:\/\/www.cs.ubc.ca\/research\/flann\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"297","DOI":"10.5201\/ipol.2011.llmps-scb","article-title":"Simplest Color Balance","volume":"1","author":"Limare","year":"2011","journal-title":"Image Process. On Line"},{"key":"ref_45","unstructured":"(2017, December 04). FFTW Home Page. Available online: http:\/\/www.fftw.org\/."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bruno, F., Lagudi, A., Gallo, A., Muzzupappa, M., Davidde Petriaggi, B., and Passaro, S. (2015). 3D Documentation of Archeological Remains in the Underwater Park of Baiae. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci.","DOI":"10.5194\/isprsarchives-XL-5-W5-41-2015"},{"key":"ref_47","unstructured":"Bruno, F., Barbieri, L., Lagudi, A., Medaglia, S., Miriello, D., Muzzupappa, M., and Taliano Grasso, A. (2017, January 23\u201325). Survey and documentation of the \u201cCala Cicala\u201d shipwreck. Proceedings of the IMEKO International Conference on Metrology for Archaeology and Cultural Heritage, Lecce, Italy."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1007\/s11045-016-0407-2","article-title":"Underwater video dehazing based on spatial\u2013temporal information fusion","volume":"27","author":"Qing","year":"2016","journal-title":"Multidimens. Syst. Signal Process."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Xie, Z.-X., and Wang, Z.-F. (2010, January 29\u201331). Color image quality assessment based on image quality parameters perceived by human vision system. Proceedings of the 2010 IEEE International Conference on Multimedia Technology (ICMT), Ningbo, China.","DOI":"10.1109\/ICMULT.2010.5630949"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/MCG.2016.24","article-title":"Underwater visual computing: The grand challenge just around the corner","volume":"36","year":"2016","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mahiddine, A., Seinturier, J., Bo\u00ef, D.P.J., Drap, P., Merad, D., and Long, L. (2012, January 2\u20135). Underwater image preprocessing for automated photogrammetry in high turbidity water: An application on the Arles-Rhone XIII roman wreck in the Rhodano river, France. Proceedings of the 2012 18th International Conference on Virtual Systems and Multimedia, Milan, Italy.","DOI":"10.1109\/VSMM.2012.6365924"},{"key":"ref_52","unstructured":"(2018, July 20). CloudCompare (Version 2.10 alpha) [GPL Software]. Available online: http:\/\/www.cloudcompare.org\/."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1111\/j.1095-9270.2010.00269.x","article-title":"The 4th-Century-BC Mazotos Shipwreck, Cyprus: A preliminary report","volume":"40","author":"Demesticha","year":"2011","journal-title":"Int. J. Naut. Archaeol."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Remondino, F., Nocerino, E., Toschi, I., and Menna, F. (2017). A Critical Review of Automated Photogrammetric Processing of Large Datasets. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., 42.","DOI":"10.5194\/isprs-archives-XLII-2-W5-591-2017"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.5194\/isprs-archives-XLII-2-1097-2018","article-title":"3DNOW: Image-based 3D reconstruction and modeling via WEB","volume":"42","author":"Tefera","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. ISPRS Arch."},{"key":"ref_56","unstructured":"Skarlatos, D., Agrafiotis, P., Menna, F., Nocerino, E., and Remondino, F. (2017, January 23\u201325). Ground control networks for underwater photogrammetry in archaeological excavations. Proceedings of the 3rd IMEKO International Conference on Metrology for Archaeology and Cultural Heritage, Lecce, Italy."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/10\/1652\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:26:14Z","timestamp":1760196374000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/10\/1652"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,17]]},"references-count":56,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["rs10101652"],"URL":"https:\/\/doi.org\/10.3390\/rs10101652","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,17]]}}}