{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T14:21:14Z","timestamp":1769523674791,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,25]],"date-time":"2023-03-25T00:00:00Z","timestamp":1679702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005632","name":"National Centre for Research and Development (NCBR) of Poland","doi-asserted-by":"publisher","award":["LIDER\/4\/0026\/L-12\/20\/NCBR\/2021"],"award-info":[{"award-number":["LIDER\/4\/0026\/L-12\/20\/NCBR\/2021"]}],"id":[{"id":"10.13039\/501100005632","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005632","name":"National Centre for Research and Development (NCBR) of Poland","doi-asserted-by":"publisher","award":["09\/010\/RGJ22\/0067"],"award-info":[{"award-number":["09\/010\/RGJ22\/0067"]}],"id":[{"id":"10.13039\/501100005632","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007835","name":"Silesian University of Technology","doi-asserted-by":"publisher","award":["LIDER\/4\/0026\/L-12\/20\/NCBR\/2021"],"award-info":[{"award-number":["LIDER\/4\/0026\/L-12\/20\/NCBR\/2021"]}],"id":[{"id":"10.13039\/501100007835","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007835","name":"Silesian University of Technology","doi-asserted-by":"publisher","award":["09\/010\/RGJ22\/0067"],"award-info":[{"award-number":["09\/010\/RGJ22\/0067"]}],"id":[{"id":"10.13039\/501100007835","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The visualization of riverbeds and surface facilities on the banks is crucial for systems that analyze conditions, safety, and changes in this environment. Hence, in this paper, we propose collecting, and processing data from a variety of sensors\u2014sonar, LiDAR, multibeam echosounder (MBES), and camera\u2014to create a visualization for further analysis. For this purpose, we took measurements from sensors installed on an autonomous, unmanned hydrographic vessel, and then proposed a data fusion mechanism, to create a visualization using modules under and above the water. A fusion contains key-point analysis on classic images and sonars, augmentation\/reduction of point clouds, fitting data and mesh creation. Then, we also propose an analysis module that can be used to compare and extract information from created visualizations. The analysis module is based on artificial intelligence tools for the classification tasks, which helps in further comparison to archival data. Such a model was tested using various techniques to achieve the fastest and most accurate visualizations possible in simulation and real case studies.<\/jats:p>","DOI":"10.3390\/rs15071763","type":"journal-article","created":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T02:18:27Z","timestamp":1679883507000},"page":"1763","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Spatial Visualization Based on Geodata Fusion Using an Autonomous Unmanned Vessel"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7489-8437","authenticated-orcid":false,"given":"Marta","family":"W\u0142odarczyk-Sielicka","sequence":"first","affiliation":[{"name":"Faculty of Navigation, Maritime University of Szczecin, Waly Chrobrego 1-2, 70-500 Szczecin, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1972-5979","authenticated-orcid":false,"given":"Dawid","family":"Po\u0142ap","sequence":"additional","affiliation":[{"name":"Faculty of Applied Mathematics, Silesian University of Technology, Kaszubska 23, 44-100 Gliwice, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3830-6182","authenticated-orcid":false,"given":"Katarzyna","family":"Prokop","sequence":"additional","affiliation":[{"name":"Faculty of Applied Mathematics, Silesian University of Technology, Kaszubska 23, 44-100 Gliwice, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3916-6668","authenticated-orcid":false,"given":"Karolina","family":"Po\u0142ap","sequence":"additional","affiliation":[{"name":"Marine Technology Ltd., Roszczynialskiego 4\/6, 81-521 Gdynia, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4671-6827","authenticated-orcid":false,"given":"Andrzej","family":"Stateczny","sequence":"additional","affiliation":[{"name":"Department of Geodesy, Gda\u0144sk University of Technology, Gabriela Narutowicza 11-12, 80-233 Gda\u0144sk, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wawrzyniak, N., Hyla, T., and Bodus-Olkowska, I. (2022). Vessel identification based on automatic hull inscriptions recognition. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0270575"},{"key":"ref_2","first-page":"333","article-title":"Geospatial Data Integration: Panacea or Nightmare?","volume":"32","author":"Trigg","year":"1997","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Manoj, M., Dhilip Kumar, V., Arif, M., Bulai, E.R., Bulai, P., and Geman, O. (2022). State of the art techniques for water quality monitoring systems for fish ponds using iot and underwater sensors: A review. Sensors, 22.","DOI":"10.3390\/s22062088"},{"key":"ref_4","first-page":"5194","article-title":"Fusion of 3D point clouds with tir images for indoor scene reconstruction","volume":"42","author":"Hoegner","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_5","first-page":"74","article-title":"A feature extraction scheme for qualitative and quantitative analysis from hyperspectral data-data integration of hyperspectral data","volume":"32","author":"Fujimura","year":"1997","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_6","first-page":"2348","article-title":"Improvement of InSAR DEM accuracy using data and sensor fusion","volume":"Volume 5","author":"Honikel","year":"1998","journal-title":"International Geoscience and Remote Sensing Symposium"},{"key":"ref_7","first-page":"1","article-title":"Registration of Airborne LiDAR Bathymetry and Multibeam Echo Sounder Point Clouds","volume":"19","author":"Wang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Skovgaard Andersen, M., \u00d8bro Hansen, L., Al-Hamdani, Z., Schilling Hansen, S., Niederwieser, M., Baran, R., Steinbacher, F., and Brandbyge Ernstsen, V. (2021, January 19\u201330). Mapping shallow water bubbling reefs-a method comparison between topobathymetric lidar and multibeam echosounder. Proceedings of the EGU General Assembly Conference Abstracts, Online.","DOI":"10.5194\/egusphere-egu21-15899"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shang, X., Zhao, J., and Zhang, H. (2019). Obtaining high-resolution seabed topography and surface details by co-registration of side-scan sonar and multibeam echo sounder images. Remote Sens., 11.","DOI":"10.3390\/rs11121496"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2708","DOI":"10.1109\/TIE.2021.3070508","article-title":"OpenStreetMap-based autonomous navigation for the four wheel-legged robot via 3D-Lidar and CCD camera","volume":"69","author":"Li","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1002\/rob.21473","article-title":"Map building fusing acoustic and visual information using autonomous underwater vehicles","volume":"30","author":"Kunz","year":"2013","journal-title":"J. Field Robot."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xie, S., Pan, C., Peng, Y., Liu, K., and Ying, S. (2020). Large-scale place recognition based on camera-lidar fused descriptor. Sensors, 20.","DOI":"10.3390\/s20102870"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hartling, S., Sagan, V., Sidike, P., Maimaitijiang, M., and Carron, J. (2019). Urban tree species classification using a WorldView-2\/3 and LiDAR data fusion approach and deep learning. Sensors, 19.","DOI":"10.3390\/s19061284"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shin, Y.S., Park, Y.S., and Kim, A. (2018, January 21\u201325). Direct visual slam using sparse depth for camera-lidar system. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461102"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Subedi, D., Jha, A., Tyapin, I., and Hovland, G. (2020, January 9\u201313). Camera-lidar data fusion for autonomous mooring operation. Proceedings of the 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA), Kristiansand, Norway.","DOI":"10.1109\/ICIEA48937.2020.9248089"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, M., Wu, Z., Yang, F., Ma, Y., Wang, X.H., and Zhao, D. (2018). Multifeature extraction and seafloor classification combining LiDAR and MBES data around Yuanzhi Island in the South China Sea. Sensors, 18.","DOI":"10.3390\/s18113828"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"De Silva, V., Roche, J., and Kondoz, A. (2018). Robust fusion of LiDAR and wide-angle camera data for autonomous mobile robots. Sensors, 18.","DOI":"10.3390\/s18082730"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1109\/JSTARS.2019.2913206","article-title":"Hyperspectral and LiDAR data classification using kernel collaborative representation based residual fusion","volume":"12","author":"Ge","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"35503","DOI":"10.1007\/s11042-019-07870-0","article-title":"Road segmentation with image-LiDAR data fusion in deep neural network","volume":"79","author":"Liu","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_20","first-page":"611","article-title":"Mapping digital image texture onto 3D model from LiDAR data","volume":"37","author":"Hu","year":"2008","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_21","first-page":"1","article-title":"Representativeness of the groundwater monitoring results in the context of its methodology: Case study of a municipal landfill complex in Poland","volume":"77","author":"Witkowski","year":"2018","journal-title":"Environ. Earth Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Blachnik, M., So\u0142tysiak, M., and D\u0105browska, D. (2019). Predicting presence of amphibian species using features obtained from gis and satellite images. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8030123"},{"key":"ref_23","first-page":"320","article-title":"Performance analysis of the airborne integrated mapping system (AIMS)","volume":"32","author":"Toth","year":"1997","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_24","first-page":"192","article-title":"Object recognition and measurement from mobile mapping image sequences using Hopfield neural networks: Part II","volume":"32","author":"Li","year":"1997","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, Y., Hu, V.T., Gavves, E., Mensink, T., Mettes, P., Yang, P., and Snoek, C.G. (2020, January 23\u201328). Pointmixup: Augmentation for point clouds. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58580-8_20"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107680","DOI":"10.1016\/j.asoc.2021.107680","article-title":"Data augmentation by guided deep interpolation","volume":"111","author":"Szlobodnyik","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_27","unstructured":"Li, L., and Heizmann, M. (2021, January 22\u201325). 2.5D-VoteNet: Depth map based 3D object detection for real-time applications. Proceedings of the British Machine Vision Conference, Online."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, Q., Nevalainen, P., Pe\u00f1a Queralta, J., Heikkonen, J., and Westerlund, T. (2020). Localization in unstructured environments: Towards autonomous robots in forests with delaunay triangulation. Remote Sens., 12.","DOI":"10.3390\/rs12111870"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.1109\/TITS.2020.2972389","article-title":"Delaunay-triangulation-based variable neighborhood search to solve large-scale general colored traveling salesman problems","volume":"22","author":"Xu","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International conference on computer vision, Washington, DC, USA.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 International conference on computer vision, Washington, DC, USA.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_32","unstructured":"Zhang, H., Wohlfeil, J., and Grie\u00dfbach, D. (2016, January 12\u201319). Extension and evaluation of the AGAST feature detector. Proceedings of the XXIII ISPRS Congress Annals 2016, Prague, Czech Republic."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lindeberg, T. (2012). Scale Invariant Feature Transform, KTH Royal Institute of Technology.","DOI":"10.4249\/scholarpedia.10491"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1109\/LGRS.2016.2554606","article-title":"Unsupervised SAR image change detection based on SIFT keypoints and region information","volume":"13","author":"Wang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Villar, S.A., Rozenfeld, A., Acosta, G.G., Prados, R., and Garc\u00eda, R. (2015, January 29\u201331). Mosaic construction from side-scan sonar: A comparison of two approaches for beam interpolation. Proceedings of the 2015 IEEE\/OES Acoustics in Underwater Geosciences Symposium (RIO Acoustics), Rio de Janeiro, Brazil.","DOI":"10.1109\/RIOAcoustics.2015.7473618"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhan, W., Xiao, C., Wen, Y., Zhou, C., Yuan, H., Xiu, S., Zou, X., Xie, C., and Li, Q. (2020). Adaptive semantic segmentation for unmanned surface vehicle navigation. Electronics, 9.","DOI":"10.3390\/electronics9020213"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bala, R., and Braun, K.M. (2003, January 18). Color-to-grayscale conversion to maintain discriminability. Proceedings of the Color Imaging IX: Processing, Hardcopy, and Applications, San Jose, CA, USA.","DOI":"10.1117\/12.532192"},{"key":"ref_39","unstructured":"Kim, S., and Casper, R. (2013). Applications of Convolution in Image Processing with MATLAB, University of Washington."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0146-664X(82)90070-3","article-title":"A study of edge detection algorithms","volume":"20","author":"Peli","year":"1982","journal-title":"Comput. Graph. Image Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"82031","DOI":"10.1109\/ACCESS.2021.3086020","article-title":"U-net and its variants for medical image segmentation: A review of theory and applications","volume":"9","author":"Siddique","year":"2021","journal-title":"IEEE Access"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, T., Cheng, M., Yang, Y., Lv, X., and Xu, J. (2022, January 7\u20139). Tiny Object Detection based on YOLOv5. Proceedings of the 2022 the 5th International Conference on Image and Graphics Processing (ICIGP), Beijing, China.","DOI":"10.1145\/3512388.3512395"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.21105\/joss.01450","article-title":"PyVista: 3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)","volume":"4","author":"Sullivan","year":"2019","journal-title":"J. Open Source Softw."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1007\/s13246-021-01019-w","article-title":"Improved U-Net architecture with VGG-16 for brain tumor segmentation","volume":"44","author":"Ghosh","year":"2021","journal-title":"Phys. Eng. Sci. Med."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kanaeva, I., and Ivanova, J.A. (2021, January 12\u201314). Road pavement crack detection using deep learning with synthetic data. Proceedings of the IOP Conference Series: Materials Science and Engineering, Sanya, China.","DOI":"10.1088\/1757-899X\/1019\/1\/012036"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2018, January 4\u20136). Improved adam optimizer for deep neural networks. Proceedings of the 2018 IEEE\/ACM 26th International Symposium on Quality of Service (IWQoS), Banff, AB, Canada.","DOI":"10.1109\/IWQoS.2018.8624183"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1763\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:02:49Z","timestamp":1760122969000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1763"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,25]]},"references-count":46,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["rs15071763"],"URL":"https:\/\/doi.org\/10.3390\/rs15071763","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,25]]}}}