{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T01:20:22Z","timestamp":1776216022960,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Great Lakes Restoration Initiative"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mapping benthic habitats with bathymetric, acoustic, and spectral data requires georeferenced ground-truth information about habitat types and characteristics. New technologies like autonomous underwater vehicles (AUVs) collect tens of thousands of images per mission making image-based ground truthing particularly attractive. Two types of machine learning (ML) models, random forest (RF) and deep neural network (DNN), were tested to determine whether ML models could serve as an accurate substitute for manual classification of AUV images for substrate type interpretation. RF models were trained to predict substrate class as a function of texture, edge, and intensity metrics (i.e., features) calculated for each image. Models were tested using a manually classified image dataset with 9-, 6-, and 2-class schemes based on the Coastal and Marine Ecological Classification Standard (CMECS). Results suggest that both RF and DNN models achieve comparable accuracies, with the 9-class models being least accurate (~73\u201378%) and the 2-class models being the most accurate (~95\u201396%). However, the DNN models were more efficient to train and apply because they did not require feature estimation before training or classification. Integrating ML models into benthic habitat mapping process can improve our ability to efficiently and accurately ground-truth large areas of benthic habitat using AUV or similar images.<\/jats:p>","DOI":"10.3390\/rs16071264","type":"journal-article","created":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T08:42:34Z","timestamp":1712133754000},"page":"1264","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Classification of Lakebed Geologic Substrate in Autonomously Collected Benthic Imagery Using Machine Learning"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6783-7057","authenticated-orcid":false,"given":"Joseph K.","family":"Geisz","sequence":"first","affiliation":[{"name":"Michigan Technological University, Great Lakes Research Center, Contractor to the US Geological Survey, Houghton, MI 49931, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8902-5575","authenticated-orcid":false,"given":"Phillipe A.","family":"Wernette","sequence":"additional","affiliation":[{"name":"Michigan Technological University, Great Lakes Research Center, Contractor to the US Geological Survey, Houghton, MI 49931, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0085-903X","authenticated-orcid":false,"given":"Peter C.","family":"Esselman","sequence":"additional","affiliation":[{"name":"US Geological Survey, Great Lakes Science Center, Ann Arbor, MI 48105, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Valentine, P.C. (2019). Sediment Classification and the Characterization, Identification, and Mapping of Geologic Substrates for the Glaciated Gulf of Maine Seabed and Other Terrains, Providing a Physical Framework for Ecological Research and Seabed Management, U.S. Geological Survey. Scientific Investigations Report.","DOI":"10.3133\/sir20195073"},{"key":"ref_2","unstructured":"Gibbs, A.G., and Cochrane, S.A. (2009). Remote Sensing and Geospatial Technologies for Coastal Ecosystem Assessment and Management, Springer. Lecture Notes in Geoinformation and Cartography."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.ecss.2012.11.001","article-title":"Do Marine Substrates \u2018Look\u2019 and \u2018Sound\u2019 the Same? Supervised Classification of Multibeam Acoustic Data Using Autonomous Underwater Vehicle Images","volume":"117","author":"Lucieer","year":"2013","journal-title":"Estuar. Coast. Shelf Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Montereale Gavazzi, G., Kapasakali, D.A., Kerchof, F., Deleu, S., Degraer, S., and Van Lancker, V. (2021). Subtidal Natural Hard Substrate Quantitative Habitat Mapping: Interlinking Underwater Acoustics and Optical Imagery with Machine Learning. Remote Sens., 13.","DOI":"10.3390\/rs13224608"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Reif, M.K., Krumwiede, B.S., Brown, S.E., Theuerkauf, E.J., and Harwood, J.H. (2021). Nearshore Benthic Mapping in the Great Lakes: A Multi-Agency Data Integration Approach in Southwest Lake Michigan. Remote Sens., 13.","DOI":"10.3390\/rs13153026"},{"key":"ref_6","unstructured":"Mabrouk, A., Menza, C., and Sautter, W. (2022). Best Practices for Ground-Truthing and Accuracy Assessment of Lakebed Maps in the Great Lakes: A Case Study Offshore the Bayfield Peninsula in Lake Superior, Springer."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1111\/cobi.13312","article-title":"Monitoring Mosaic Biotopes in a Marine Conservation Zone by Autonomous Underwater Vehicle","volume":"33","author":"Benoist","year":"2019","journal-title":"Conserv. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mahmood, A., Ospina, A.G., Bennamoun, M., An, S., Sohel, F., Boussaid, F., Hovey, R., Fisher, R.B., and Kendrick, G.A. (2020). Automatic Hierarchical Classification of Kelps Using Deep Residual Features. Sensors, 20.","DOI":"10.3390\/s20020447"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mohamed, H., Nadaoka, K., and Nakamura, T. (2020). Semiautomated Mapping of Benthic Habitats and Seagrass Species Using a Convolutional Neural Network Framework in Shallow Water Environments. Remote Sens., 12.","DOI":"10.3390\/rs12234002"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mohamed, H., Nadaoka, K., and Nakamura, T. (2020). Towards Benthic Habitat 3D Mapping Using Machine Learning Algorithms and Structures from Motion Photogrammetry. Remote Sens., 12.","DOI":"10.3390\/rs12010127"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1086\/622910","article-title":"A Scale of Grade and Class Terms for Clastic Sediments","volume":"30","author":"Wentworth","year":"1922","journal-title":"J. Geol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"55","DOI":"10.2475\/ajs.248.1.55","article-title":"Classification of Sediments","volume":"248","author":"Trefethen","year":"1950","journal-title":"Am. J. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Schlee, J.S. (1973). Atlantic Continental Shelf and Slope of the United States: Sediment Texture of the Northeastern Part, US Geological Survey. Professional Paper.","DOI":"10.3133\/pp529L"},{"key":"ref_14","first-page":"151","article-title":"Nomenclature Based on Sand-Silt-Clay Ratios","volume":"24","author":"Shepard","year":"1954","journal-title":"J. Sediment. Res."},{"key":"ref_15","unstructured":"Folk, R.L. (1980). Petrology of Sedimentary Rocks, Hemphill Publishing Company."},{"key":"ref_16","unstructured":"(2022, June 06). United States. National Ocean Service and United States. Federal Geographic Data Committee. Coastal and Marine Ecological Classification Standard (CMECS), Available online: https:\/\/repository.library.noaa.gov\/view\/noaa\/27552."},{"key":"ref_17","unstructured":"Harter, S.L., Paxton, A.B., Winship, A.J., Hile, S.D., Taylor, J.C., Poti, M., and Menza, C. (2022). Workshop Report for Approaches to Mapping, Ground-Truthing, and Predictive Habitat Modeling of the Distribution and Abundance of Mesophotic and Deep Benthic Communities, National Oceanic and Atmospheric Administration."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Burns, C., Bollard, B., and Narayanan, A. (2022). Machine-Learning for Mapping and Monitoring Shallow Coral Reef Habitats. Remote Sens., 14.","DOI":"10.3390\/rs14112666"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"349","DOI":"10.5194\/esurf-10-349-2022","article-title":"Convolutional Neural Networks for Image-Based Sediment Detection Applied to a Large Terrestrial and Airborne Dataset","volume":"10","author":"Chen","year":"2022","journal-title":"Earth Surf. Dynam."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez-Rivero, M., Beijbom, O., Rodriguez-Ramirez, A., Bryant, D.E.P., Ganase, A., Gonzalez-Marrero, Y., Herrera-Reveles, A., Kennedy, E.V., Kim, C.J.S., and Lopez-Marcano, S. (2020). Monitoring of Coral Reefs Using Artificial Intelligence: A Feasible and Cost-Effective Approach. Remote Sens., 12.","DOI":"10.3390\/rs12030489"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s12518-020-00331-6","article-title":"Challenges in the Deep Learning-Based Semantic Segmentation of Benthic Communities from Ortho-Images","volume":"13","author":"Pavoni","year":"2021","journal-title":"Appl. Geomat."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Raphael, A., Dubinsky, Z., Iluz, D., and Netanyahu, N.S. (2020). Neural Network Recognition of Marine Benthos and Corals. Diversity, 12.","DOI":"10.3390\/d12010029"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Raphael, A., Dubinsky, Z., Netanyahu, N.S., and Iluz, D. (2021). Deep Neural Network Analysis for Environmental Study of Coral Reefs in the Gulf of Eilat (Aqaba). BDCC, 5.","DOI":"10.3390\/bdcc5020019"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"775433","DOI":"10.3389\/fmars.2021.775433","article-title":"A Deep Learning Model to Recognize and Quantitatively Analyze Cold Seep Substrates and the Dominant Associated Species","volume":"8","author":"Wang","year":"2021","journal-title":"Front. Mar. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107833","DOI":"10.1016\/j.ecss.2022.107833","article-title":"Classification of Underwater Photogrammetry Data for Temperate Benthic Rocky Reef Mapping","volume":"270","author":"Ternon","year":"2022","journal-title":"Estuar. Coast. Shelf Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.csr.2014.05.004","article-title":"Mapping Seabed Sediments: Comparison of Manual, Geostatistical, Object-Based Image Analysis and Machine Learning Approaches","volume":"84","author":"Diesing","year":"2014","journal-title":"Cont. Shelf Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mohamed, H., Nadaoka, K., and Nakamura, T. (2018). Assessment of Machine Learning Algorithms for Automatic Benthic Cover Monitoring and Mapping Using Towed Underwater Video Camera and High-Resolution Satellite Images. Remote Sens., 10.","DOI":"10.3390\/rs10050773"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wicaksono, P., Aryaguna, P.A., and Lazuardi, W. (2019). Benthic Habitat Mapping Model and Cross Validation Using Machine-Learning Classification Algorithms. Remote Sens., 11.","DOI":"10.3390\/rs11111279"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"107728","DOI":"10.1016\/j.apacoust.2020.107728","article-title":"Seafloor Habitat Mapping Using Multibeam Bathymetric and Backscatter Intensity Multi-Features SVM Classification Framework","volume":"174","author":"Cui","year":"2021","journal-title":"Appl. Acoust."},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_32","unstructured":"Geisz, J.K., Wernette, P.A., Esselman, P.C., and Morris, J.M. (2024). Autonomously Collected Benthic Imagery for Substrate Prediction, Lake Michigan 2020\u20132021, U.S. Geological Survey."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3074","DOI":"10.1093\/icesjms\/fsaa208","article-title":"Developing the Use of Convolutional Neural Networking in Benthic Habitat Classification and Species Distribution Modelling","volume":"77","author":"Fincham","year":"2020","journal-title":"ICES J. Mar. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.eswa.2018.10.010","article-title":"Towards Highly Accurate Coral Texture Images Classification Using Deep Convolutional Neural Networks and Data Augmentation","volume":"118","author":"Tabik","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_35","unstructured":"Elith, J. (2019). Quantitative Analyses in Wildlife Science, Johns Hopkins University Press. Wildlife Management and Conservation."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array Programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"ref_37","first-page":"122","article-title":"The OpenCV Library","volume":"120","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019s J. Softw. Tools"},{"key":"ref_38","unstructured":"The Pandas Development Team (2023, September 05). Pandas-Dev\/Pandas: Pandas 2020. Available online: https:\/\/zenodo.org\/records\/10697587."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"e453","DOI":"10.7717\/peerj.453","article-title":"Scikit-image: Image processing in Python","volume":"2","author":"Boulogne","year":"2014","journal-title":"PeerJ"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural Features for Image Classification","volume":"SMC-3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1016\/0031-3203(90)90135-8","article-title":"Texture Classification Using Texture Spectrum","volume":"23","author":"Wang","year":"1990","journal-title":"Pattern Recognit."},{"key":"ref_43","first-page":"250","article-title":"Wavelets","volume":"82","author":"Strang","year":"1994","journal-title":"Am. Sci."},{"key":"ref_44","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2015). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. arXiv."},{"key":"ref_45","unstructured":"(2023, September 05). Keras 2015. Available online: https:\/\/keras.io."},{"key":"ref_46","unstructured":"Zhang, L., Tanno, R., Xu, M.-C., Jin, C., Jacob, J., Ciccarelli, O., Barkhof, F., and Alexander, D.C. (2020, January 6\u201312). Disentangling Human Error from the Ground Truth in Segmentation of Medical Images. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Virtual."},{"key":"ref_47","unstructured":"(2023, September 05). Ontario Geological Survey 1:250 000 Scale Bedrock Geology of Ontario 2011, Available online: https:\/\/www.geologyontario.mndm.gov.on.ca\/mndmfiles\/pub\/data\/records\/MRD126-REV1.html."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Schruben, P.G., Arndt, R.E., Bawiec, W.J., King, P.B., and Beikman, H.M. (1998). Geology of the Conterminous United States at 1:2,500,000 Scale a Digital Representation of the 1974 P.B. King and H.M. Beikman Map, U.S. Geological Survey. Release 2, 1998.","DOI":"10.3133\/ds11"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1809","DOI":"10.3390\/rs5041809","article-title":"Image-Based Coral Reef Classification and Thematic Mapping","volume":"5","author":"Shihavuddin","year":"2013","journal-title":"Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"157","DOI":"10.4319\/lom.2009.7.157","article-title":"Automated Processing of Coral Reef Benthic Images: Coral Reef Benthic Imaging","volume":"7","author":"Stokes","year":"2009","journal-title":"Limnol. Oceanogr. Methods"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mohammed, R., Rawashdeh, J., and Abdullah, M. (2020, January 7\u20139). Machine Learning with Oversampling and Undersampling Techniques: Overview Study and Experimental Results. Proceedings of the 2020 11th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan.","DOI":"10.1109\/ICICS49469.2020.239556"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1016\/S0380-1330(95)71120-0","article-title":"Lake Trout Spawning Habitat in the Great Lakes\u2014A Review of Current Knowledge","volume":"21","author":"Casselman","year":"1995","journal-title":"J. Great Lakes Res."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.envsoft.2016.12.003","article-title":"Shallow Water Benthic Imaging and Substrate Characterization Using Recreational-Grade Sidescan-Sonar","volume":"89","author":"Buscombe","year":"2017","journal-title":"Environ. Model. Softw."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1002\/lom3.10483","article-title":"Predicting Dreissenid Mussel Abundance in Nearshore Waters Using Underwater Imagery and Deep Learning","volume":"20","author":"Galloway","year":"2022","journal-title":"Limnol. Ocean Methods"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/7\/1264\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:22:57Z","timestamp":1760106177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/7\/1264"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,3]]},"references-count":54,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["rs16071264"],"URL":"https:\/\/doi.org\/10.3390\/rs16071264","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,3]]}}}