{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T11:29:32Z","timestamp":1764588572572,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T00:00:00Z","timestamp":1728864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-15-1-2089"],"award-info":[{"award-number":["N00014-15-1-2089"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Underwater sonar is the primary remote sensing and imaging modality within turbid environments with poor visibility. The two-dimensional (2-D) images of a target near the air\u2013sea interface (or resting on a hard seabed), acquired by forward-scan sonar (FSS), are generally corrupted by the ghost and sometimes mirror components, formed by the multipath propagation of transmitted acoustic beams. In the processing of the 2-D FSS views to generate an accurate three-dimensional (3-D) object model, the corrupted regions have to be discarded. The sonar tilt angle and distance from the sea surface are two important parameters for the accurate localization of the ghost and mirror components. We propose a unified optimization technique for improving both the measurements of these two parameters from inexpensive sensors and the accuracy of a 3-D object model using 2-D FSS images at known poses. The solution is obtained by the recursive updating of sonar parameters and 3-D object model. Utilizing the 3-D object model, we can enhance the original images and generate synthetic views for arbitrary sonar poses. We demonstrate the performance of our method in experiments with the synthetic and real images of three targets: two dominantly convex coral rocks and a highly concave toy wood table.<\/jats:p>","DOI":"10.3390\/rs16203814","type":"journal-article","created":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T07:47:05Z","timestamp":1728892025000},"page":"3814","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Ghost Removal from Forward-Scan Sonar Views near the Sea Surface for Image Enhancement and 3-D Object Modeling"],"prefix":"10.3390","volume":"16","author":[{"given":"Yuhan","family":"Liu","sequence":"first","affiliation":[{"name":"ECE Department, University of Miami, Coral Gables, FL 33146, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5676-5238","authenticated-orcid":false,"given":"Shahriar","family":"Negahdaripour","sequence":"additional","affiliation":[{"name":"ECE Department, University of Miami, Coral Gables, FL 33146, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,14]]},"reference":[{"unstructured":"(2024, October 05). Available online: https:\/\/oceanexplorer.noaa.gov\/edu\/materials\/multibeam-sonar-fact-sheet.pdf.","key":"ref_1"},{"unstructured":"(2024, October 05). Available online: https:\/\/www.uio.no\/studier\/emner\/matnat\/ifi\/INF-GEO4310\/h12\/undervisningsmateriale\/sonar_introduction_2012_compressed.pdf.","key":"ref_2"},{"unstructured":"(2024, October 05). Available online: https:\/\/en.wikipedia.org\/wiki\/Side-scan_sonar.","key":"ref_3"},{"doi-asserted-by":"crossref","unstructured":"Burguera, A., and Oliver, G. (2016). High-resolution underwater mapping using side-scan sonar. PLoS ONE, 11.","key":"ref_4","DOI":"10.1371\/journal.pone.0146396"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"117","DOI":"10.4031\/MTSJ.47.5.5","article-title":"Synthetic aperture sonar technology review","volume":"47","author":"Hansen","year":"2013","journal-title":"Mar. Technol. Soc. J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1109\/JOE.2009.2020853","article-title":"Synthetic aperture sonar: A review of current status","volume":"34","author":"Hayes","year":"2009","journal-title":"IEEE J. Ocean. Eng."},{"unstructured":"(2024, October 05). Available online: https:\/\/www.sonardyne.com\/applications\/obstacle-avoidance\/#:~:text=When%20your%20marine%20operation%20takes,warn\\%20of%20potential%20collision%20hazards.","key":"ref_7"},{"unstructured":"(2024, October 05). Available online: https:\/\/www.simrad-yachting.com\/sonar-and-transducers\/forwardscan-sonar\/.","key":"ref_8"},{"unstructured":"(2024, October 05). Available online: https:\/\/www.teledynemarine.com\/en-us\/products\/product-line\/Pages\/forward-looking-sonars.aspx.","key":"ref_9"},{"unstructured":"(2024, October 05). Available online: http:\/\/www.soundmetrics.com\/Products\/DIDSON-Sonars.","key":"ref_10"},{"unstructured":"(2024, October 05). Available online: https:\/\/www.seascapesubsea.com\/product\/oculus-m750d\/#:~{}\\protect\\protect\\leavevmode@ifvmode\\kern+.1667em\\relax:text=Description,horizontal%20fields%20of%20view%20\\respectively.","key":"ref_11"},{"unstructured":"(2024, October 05). Available online: https:\/\/www.tritech.co.uk\/products\/gemini-720is.","key":"ref_12"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.arcontrol.2015.09.014","article-title":"Forward looking sonar mosaicing for mine countermeasures","volume":"40","author":"Ferreira","year":"2015","journal-title":"Annu. Rev. Control."},{"doi-asserted-by":"crossref","unstructured":"Hurtos, N., Petillot, Y., and Salvi, J. (2012, January 7\u201312). Fourier-based registrations for two-dimensional forward-looking sonar image mosaicing. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201912), Vilamoura-Algarve, Portugal.","key":"ref_14","DOI":"10.1109\/IROS.2012.6385813"},{"unstructured":"Hurtos, N., Nagappa, S., Palomeras, N., and Salvi, J. (June, January 31). Real-time mosaicing with two-dimensional forward-looking sonar. Proceedings of the IEEE International Conference Robotics and Automation (ICRA\u201914), Hong Kong, China.","key":"ref_15"},{"unstructured":"Kim, K., Intrator, N., and Neretti, N. (2004, January 15). Image registration and mosaicing of noisy acoustic camera images. Proceedings of the IEEE International Conference on Electronics, Circuits and Systems, (ICECS\u201904), Tel Aviv, Israel.","key":"ref_16"},{"doi-asserted-by":"crossref","unstructured":"Negahdaripour, S., Aykin, M.D., and Sinnarajah, S. (2011, January 19\u201322). Dynamic scene analysis and mosaicing of benthic habitats by FS sonar imaging\u2014Issues and complexities. Proceedings of the OCEANS\u201911 MTS\/IEEE, Waikoloa, HI, USA.","key":"ref_17","DOI":"10.23919\/OCEANS.2011.6107093"},{"unstructured":"Geiger, A. (2024, October 05). Computer Vision - Lecture 8.1 (Shape-from-X: Shape-from-Shading). Available online: https:\/\/www.youtube.com\/watch?v=YQ5QOiyoF9U.","key":"ref_18"},{"unstructured":"Liu, Y. (2022). 3-D Object Modeling from 2-D Underwater Forward-Scan Sonar Imagery in the Presence of Multipath near Sea Surface. [Master\u2019s Thesis, University of Miami].","key":"ref_19"},{"doi-asserted-by":"crossref","unstructured":"Liu, Y., and Negahdaripour, S. (2024). Object modeling from underwater forward-scan sonar imagery with sea-surface multipath. IEEE J. Ocean. Eng., 1\u201314.","key":"ref_20","DOI":"10.1109\/JOE.2024.3412268"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1109\/JOE.2017.2751139","article-title":"Auv-based underwater 3-D point cloud generation using acoustic lens-based multibeam sonar","volume":"43","author":"Cho","year":"2018","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1002\/rob.21783","article-title":"Three-dimensional reconstruction of underwater objects using wide-aperture imaging sonar","volume":"35","author":"Guerneve","year":"2018","journal-title":"J. Field Robot."},{"unstructured":"Westman, E., Gkioulekas, I., and Kaess, M. (August, January 31). A volumetric albedo framework for 3d imaging sonar reconstruction. Proceedings of the IEEE International Conference on Robotics and Automation, Paris, France.","key":"ref_23"},{"doi-asserted-by":"crossref","unstructured":"Zerr, B., and Stage, B. (1996, January 19). Three-dimensional reconstruction of underwater objects from a sequence of sonar images. Proceedings of the 3rd IEEE International Conference on Image Processing, Lausanne, Switzerland.","key":"ref_24","DOI":"10.1109\/ICIP.1996.560946"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1109\/LRA.2021.3058911","article-title":"Elevation angle estimation in 2d acoustic images using pseudo front view","volume":"6","author":"Wang","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1109\/JOE.2015.2503818","article-title":"Modeling 2-D lens-based forward-scan sonar imagery for targets with diffuse reflectance","volume":"41","author":"Aykin","year":"2016","journal-title":"IEEE J. Ocean. Eng."},{"doi-asserted-by":"crossref","unstructured":"Wang, Y., Wu, C., Ji, Y., Tsuchiya, H., Asama, H., and Yamashita, A. (2023). 2d forward looking sonar simulation with ground echo modeling. arXiv.","key":"ref_27","DOI":"10.1109\/UR57808.2023.10202279"},{"doi-asserted-by":"crossref","unstructured":"Kraus, F., Scheiner, N., and Dietmayer, K. (2020, January 20\u201323). Using machine learning to detect ghost images in automotive radar. Proceedings of the IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC\u201920), Rhodes, Greece.","key":"ref_28","DOI":"10.1109\/ITSC45102.2020.9294631"},{"unstructured":"Kraus, F., Scheiner, N., Ritter, W., and Dietmayer, K. (October, January 27). The radar ghost dataset\u2014An evaluation of ghost objects in automotive radar data. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","key":"ref_29"},{"doi-asserted-by":"crossref","unstructured":"Liu, C., Liu, S., Zhang, C., Huang, Y., and Wang, H. (2020, January 4\u20136). Multipath propagation analysis and ghost target removal for FMCW automotive radars. Proceedings of the IET International Radar Conference, Online.","key":"ref_30","DOI":"10.1049\/icp.2021.0554"},{"doi-asserted-by":"crossref","unstructured":"Longman, O., Villeval, S., and Bilik, I. (2021, January 7\u201314). Multipath ghost targets mitigation in automotive environments. Proceedings of the IEEE Radar Conference, Atlanta, GA, USA.","key":"ref_31","DOI":"10.1109\/RadarConf2147009.2021.9455253"},{"unstructured":"(2024, October 05). Swl Marine Bronze Submersible Level Sensor. Available online: https:\/\/www.sensorsone.com\/swl-marine-bronze-submersible-level-sensor\/.","key":"ref_32"},{"unstructured":"(2024, October 05). Tdk-Tmrsensor. Available online: https:\/\/product.tdk.com\/en\/techlibrary\/productoverview\/tmr-angle-sensors.html\/.","key":"ref_33"},{"unstructured":"Barrault, G. (2001). Modeling the forward Look Sonar. [Master\u2019s Thesis, Florida Atlantic University].","key":"ref_34"},{"doi-asserted-by":"crossref","unstructured":"Choi, W.S., Olson, D., Davis, D., Zhang, M., Racson, A., Bingham, B., McCarrin, M., Vogt, C., and Herman, J. (2021). Physics-based modeling and simulation of multibeam echosounder perception for autonomous underwater manipulation. Front. Robot. AI, 8.","key":"ref_35","DOI":"10.3389\/frobt.2021.706646"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1080\/01691864.2021.1873845","article-title":"Cyclegan-based realistic image dataset generation for forward-looking sonar","volume":"35","author":"Liu","year":"2021","journal-title":"Adv. Robot."},{"unstructured":"Negahdaripour, S. (2005, January 17\u201323). Calibration of DIDSON forward-scan acoustic video camera. Proceedings of the OCEANS 2005 MTS\/IEEE, Washington, DC, USA.","key":"ref_37"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1023\/A:1008191222954","article-title":"A theory of shape by space carving","volume":"38","author":"Kutulakos","year":"2000","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/JOE.2016.2591738","article-title":"Three-dimensional target reconstruction from multiple 2-D forward-scan sonar views by space carving","volume":"42","author":"Aykin","year":"2017","journal-title":"IEEE J. Ocean. Eng."},{"unstructured":"Negahdaripour, S., Milenkovic, V.M., Salarieh, N., and Mirzargar, M. (2017, January 18\u201321). Refining 3-D object models constructed from multiple fs sonar images by space carving. Proceedings of the IEEE\/MTS Oceans Conference-Anchorage, Anchorage, AK, USA.","key":"ref_40"},{"unstructured":"Gu, J.-H., Joe, H.-G., and Yu, S.-C. (2013, January 23\u201327). Development of image sonar simulator for underwater object recognition. Proceedings of the OCEANS\u201913, San Diego, CA, USA.","key":"ref_41"},{"doi-asserted-by":"crossref","unstructured":"Kwak, S., Ji, Y., Yamashita, A., and Asama, H. (2015, January 10\u201313). Development of acoustic camera-imaging simulator based on novel model. Proceedings of the IEEE 15th International Conference on Environment and Electrical Engineering (EEEIC\u201915), Rome, Italy.","key":"ref_42","DOI":"10.1109\/EEEIC.2015.7165431"},{"doi-asserted-by":"crossref","unstructured":"Potokar, E., Lay, K., Norman, K., Benham, D., Neilsen, T.B., Kaess, M., and Mangelson, J.G. (2022, January 23\u201327). HoloOcean: Realistic sonar simulation. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Kyoto, Japan.","key":"ref_43","DOI":"10.1109\/IROS47612.2022.9981119"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE T. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modeling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1007\/s10589-014-9643-2","article-title":"Robust registration of point sets using iteratively reweighted least squares","volume":"58","author":"Edlund","year":"2014","journal-title":"Comput. Optim. Appl."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1007\/s11075-016-0170-3","article-title":"Robust registration of surfaces using a refined iterative closest point algorithm with a trust region approach","volume":"74","author":"Edlund","year":"2017","journal-title":"Numer. Algorithms"},{"unstructured":"Ruder, S. (2017). An overview of gradient descent optimization algorithms. arXiv.","key":"ref_48"},{"unstructured":"Azure Kinect DK (2024, October 05). Available online: https:\/\/www.microsoft.com\/en-us\/d\/azure-kinect-dk\/8pp5vxmd9nhq?activetab=pivot:overviewtab.","key":"ref_49"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/20\/3814\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:12:55Z","timestamp":1760112775000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/20\/3814"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,14]]},"references-count":49,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["rs16203814"],"URL":"https:\/\/doi.org\/10.3390\/rs16203814","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,10,14]]}}}