{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T14:58:06Z","timestamp":1773413886519,"version":"3.50.1"},"reference-count":25,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T00:00:00Z","timestamp":1707955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"Horizon Europe programme of the European Union","doi-asserted-by":"publisher","award":["101086340"],"award-info":[{"award-number":["101086340"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The use of Synthetic Aperture Sonar (SAS) in autonomous underwater vehicle (AUV) surveys has found applications in archaeological searches, underwater mine detection and wildlife monitoring. However, the easy confusability of natural objects with the target object leads to high false positive rates. To improve detection, the combination of SAS and optical images has recently attracted attention. While SAS data provides a large-scale survey, optical information can help contextualize it. This combination creates the need to match multimodal, optical\u2013acoustic image pairs. The two images are not aligned, and are taken from different angles of view and at different times. As a result, challenges such as the different resolution, scaling and posture of the two sensors need to be overcome. In this research, motivated by the information gain when using both modalities, we turn to statistical exploration for feature analysis to investigate the relationship between the two modalities. In particular, we propose an entropic method for recognizing matching multimodal images of the same object and investigate the probabilistic dependency between the images of the two modalities based on their conditional probabilities. The results on a real dataset of SAS and optical images of the same and different objects on the seafloor confirm our assumption that the conditional probability of SAS images is different from the marginal probability given an optical image, and show a favorable trade-off between detection and false alarm rate that is higher than current benchmarks. For reproducibility, we share our database.<\/jats:p>","DOI":"10.3390\/rs16040689","type":"journal-article","created":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T05:55:59Z","timestamp":1707976559000},"page":"689","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Statistical Evaluation of the Connection between Underwater Optical and Acoustic Images"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-1471-8437","authenticated-orcid":false,"given":"Rebeca","family":"Chinicz","sequence":"first","affiliation":[{"name":"Hatter Department of Marine Technologies, University of Haifa, Haifa 3103301, Israel"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2430-7061","authenticated-orcid":false,"given":"Roee","family":"Diamant","sequence":"additional","affiliation":[{"name":"Hatter Department of Marine Technologies, University of Haifa, Haifa 3103301, Israel"},{"name":"Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,15]]},"reference":[{"key":"ref_1","unstructured":"Chantler, M., Lindsay, D., Reid, C., and Wright, V. (1994, January 13\u201316). Optical and acoustic range sensing for underwater robotics. Proceedings of the OCEANS\u201994, Brest, France."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6027","DOI":"10.1109\/JSEN.2022.3148530","article-title":"Feature set for classification of man-made underwater objects in optical and SAS data","volume":"22","author":"Abu","year":"2022","journal-title":"IEEE Sensors J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4240","DOI":"10.3182\/20140824-6-ZA-1003.02290","article-title":"Combined acoustic and video characterization of coastal environment by means of unmanned surface vehicles","volume":"47","author":"Fumagalli","year":"2014","journal-title":"IFAC Proc. Vol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1109\/TIP.2019.2930148","article-title":"Enhanced fuzzy-based local information algorithm for sonar image segmentation","volume":"29","author":"Abu","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gubnitsky, G., and Diamant, R. (2021, January 20\u201323). A multispectral target detection in sonar imagery. Proceedings of the OCEANS 2021: San Diego\u2013Porto, San Diego, CA, USA.","DOI":"10.23919\/OCEANS44145.2021.9705755"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2010\/746052","article-title":"Underwater image processing: State of the art of restoration and image enhancement methods","volume":"2010","author":"Schettini","year":"2010","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.asoc.2014.11.020","article-title":"Underwater image quality enhancement through integrated color model with Rayleigh distribution","volume":"27","author":"Ghani","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s11263-006-0011-2","article-title":"Non-rigid multi-modal image registration using cross-cumulative residual entropy","volume":"74","author":"Wang","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","first-page":"2","article-title":"Sift-the scale invariant feature transform","volume":"2","author":"Lowe","year":"2004","journal-title":"Int. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/LGRS.2017.2660067","article-title":"Robust optical-to-SAR image matching based on shape properties","volume":"14","author":"Ye","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9059","DOI":"10.1109\/TGRS.2019.2924684","article-title":"Fast and robust matching for multimodal remote sensing image registration","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","unstructured":"Jang, H., Kim, G., Lee, Y., and Kim, A. (2019, January 24). CNN-based approach for opti-acoustic reciprocal feature matching. Proceedings of the ICRA Workshop on Underwater Robotics Perception, Montreal, QC, Canada."},{"key":"ref_13","unstructured":"Fei, T. (2015). Advances in Detection and Classification of Underwater Targets Using Synthetic Aperture Sonar Imagery. [Ph.D. Thesis, Technische Universit\u00e4t]."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Xu, S., Luczynski, T., Willners, J.S., Hong, Z., Zhang, K., Petillot, Y.R., and Wang, S. (October, January 27). Underwater visual acoustic SLAM with extrinsic calibration. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636258"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"71329","DOI":"10.1109\/ACCESS.2022.3187032","article-title":"An Integrated Visual Odometry System With Stereo Camera for Unmanned Underwater Vehicles","volume":"10","author":"Xu","year":"2022","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"123070","DOI":"10.1109\/ACCESS.2023.3329834","article-title":"Camera-Sonar Combination for Improved Underwater Localization and Mapping","volume":"11","author":"Cardaillac","year":"2023","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Abu, A., and Diamant, R. (2023). A SLAM Approach to Combine Optical and Sonar Information from an AUV. IEEE Trans. Mob. Comput.","DOI":"10.1109\/TMC.2023.3336697"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1109\/TCSVT.2012.2211176","article-title":"Fast and robust spatially constrained Gaussian mixture model for image segmentation","volume":"23","author":"Nguyen","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_19","unstructured":"Faes, L. (2023, July 28). cTE\u2014Matlab Tool for Computing the Corrected Transfer Entropy. Available online: http:\/\/www.lucafaes.net\/cTE.html."},{"key":"ref_20","unstructured":"MacQueen, J. (1967). Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press. Number 14."},{"key":"ref_21","unstructured":"Wackerly, D., Mendenhall, W., and Scheaffer, R.L. (2014). Mathematical Statistics with Applications, Cengage Learning."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1640","DOI":"10.1109\/JSTARS.2016.2516014","article-title":"A spatial fuzzy clustering algorithm with kernel metric based on immune clone for SAR image segmentation","volume":"9","author":"Shang","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"10835","DOI":"10.1109\/JSTARS.2021.3121405","article-title":"Multireceiver SAS imagery based on monostatic conversion","volume":"14","author":"Zhang","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, P. (2023). An imaging algorithm for high-resolution imaging sonar system. Multimed. Tools Appl., 1\u201317.","DOI":"10.1007\/s11042-023-16757-0"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/4\/689\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:00:10Z","timestamp":1760104810000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/4\/689"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,15]]},"references-count":25,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["rs16040689"],"URL":"https:\/\/doi.org\/10.3390\/rs16040689","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,15]]}}}