{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T14:08:21Z","timestamp":1768486101432,"version":"3.49.0"},"reference-count":44,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T00:00:00Z","timestamp":1734566400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Rivers occupy less than 1% of the earth\u2019s surface and yet they perform ecosystem service functions that are crucial to civilisation. Global monitoring of this asset is within reach thanks to the development of big data portals such as Google Earth Engine (GEE) but several challenges relating to output quality and processing efficiency remain. In this technical note, we present a new deep learning pipeline that uses attention-based deep learning to perform state-of-the-art semantic classification of fluvial landscapes with Sentinel-2 imagery accessed via GEE. We train, validate and test the network on a multi-seasonal and multi-annual dataset drawn from a study site that covers 89% of the Earth\u2019s surface. F1-scores for independent test data not used in model training reach 92% for rivers and 96% for lakes. This is achieved without post-processing and significantly reduced computation times, thus making automated global monitoring of rivers achievable.<\/jats:p>","DOI":"10.3390\/rs16244747","type":"journal-article","created":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T10:54:20Z","timestamp":1734605660000},"page":"4747","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Global Semantic Classification of Fluvial Landscapes with Attention-Based Deep Learning"],"prefix":"10.3390","volume":"16","author":[{"given":"Patrice E.","family":"Carbonneau","sequence":"first","affiliation":[{"name":"Department of Geography, Durham University, Durham DH1 3LE, UK"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"229","DOI":"10.5268\/IW-2.4.502","article-title":"Global abundance and size distribution of streams and rivers","volume":"2","author":"Downing","year":"2012","journal-title":"Inland Waters"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2388","DOI":"10.4319\/lo.2006.51.5.2388","article-title":"The global abundance and size distribution of lakes, ponds, and impoundments","volume":"51","author":"Downing","year":"2006","journal-title":"Limnol. Oceanogr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1038\/nature09440","article-title":"Global threats to human water security and river biodiversity","volume":"467","author":"McIntyre","year":"2010","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1017\/S1464793105006950","article-title":"Freshwater biodiversity: Importance, threats, status and conservation challenges","volume":"81","author":"Dudgeon","year":"2006","journal-title":"Biol. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1017\/S037689290200022X","article-title":"Riverine flood plains: Present state and future trends","volume":"29","author":"Tockner","year":"2002","journal-title":"Environ. Conserv."},{"key":"ref_6","unstructured":"Zanaga, D., Van De Kerchove, R., Daems, D., De Keersmaecker, W., Brockmann, C., Kirches, G., Wevers, J., Cartus, O., Santoro, M., and Fritz, S. (2024, July 01). ESA WorldCover 10 m 2021 V200 2022. Available online: https:\/\/developers.google.com\/earth-engine\/datasets\/catalog\/ESA_WorldCover_v200."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1038\/s41597-022-01307-4","article-title":"Dynamic World, Near real-time global 10 m land use land cover mapping","volume":"9","author":"Brown","year":"2022","journal-title":"Sci. Data"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1038\/nature20584","article-title":"High-resolution mapping of global surface water and its long-term changes","volume":"540","author":"Pekel","year":"2016","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1109\/JSTARS.2023.3333969","article-title":"S1S2-Water: A Global Dataset for Semantic Segmentation of Water Bodies from Sentinel-1 and Sentinel-2 Satellite Images","volume":"17","author":"Wieland","year":"2023","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/esp.5739","article-title":"Global mapping of river sediment bars","volume":"49","author":"Carbonneau","year":"2023","journal-title":"Earth Surf. Process. Landf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1126\/science.aat0636","article-title":"Global extent of rivers and streams","volume":"361","author":"Allen","year":"2018","journal-title":"Science"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"024003","DOI":"10.1088\/1748-9326\/aad8e9","article-title":"A multidisciplinary framework to derive global river reach classifications at high spatial resolution","volume":"14","author":"Dallaire","year":"2019","journal-title":"Environ. Res. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1038\/s41467-023-37852-8","article-title":"Global scale analysis on the extent of river channel belts","volume":"14","author":"Nyberg","year":"2023","journal-title":"Nat. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1029\/2008EO100001","article-title":"New Global Hydrography Derived from Spaceborne Elevation Data","volume":"89","author":"Lehner","year":"2008","journal-title":"Eos Trans. Am. Geophys. Union"},{"key":"ref_15","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv."},{"key":"ref_16","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv."},{"key":"ref_17","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e453","DOI":"10.7717\/peerj.453","article-title":"Scikit-Image: Image Processing in Python","volume":"2","author":"Boulogne","year":"2014","journal-title":"PeerJ"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python","volume":"17","author":"Virtanen","year":"2020","journal-title":"Nat. Methods"},{"key":"ref_20","unstructured":"GDAL Dev (2018). Team GDAL\u2014Geospatial Data Abstraction Library, GD Arabia Ltd."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Carbonneau, P., and Bizzi, S. (2024, July 01). Seasonal Monitoring of River and Lake Water Surface Areas at Global Scale with Deep Learning. Available online: https:\/\/assets-eu.researchsquare.com\/files\/rs-2254580\/v2_covered.pdf?c=1670341515.","DOI":"10.5194\/egusphere-egu23-2803"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"19575","DOI":"10.1109\/JSTARS.2024.3487250","article-title":"ViT-UNet: A Vision Transformer Based UNet Model for Coastal Wetland Classification Based on High Spatial Resolution Imagery","volume":"17","author":"Zhou","year":"2024","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"120773","DOI":"10.1016\/j.jenvman.2024.120773","article-title":"STIRUnet: SwinTransformer and Inverted Residual Convolution Embedding in Unet for Sea\u2013Land Segmentation","volume":"357","author":"Tong","year":"2024","journal-title":"J. Environ. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, X., Wang, H., Liu, L., Zhang, Y., Liu, J., Qu, T., Tian, H., and Lu, Y. (2023). A Method for Extracting Lake Water Using ViTenc-UNet: Taking Typical Lakes on the Qinghai-Tibet Plateau as Examples. Remote Sens., 15.","DOI":"10.3390\/rs15164047"},{"key":"ref_25","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_26","unstructured":"Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., and Luo, P. (2021, January 6\u201314). SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. Proceedings of the Advances in Neural Information Processing Systems 34 (NeurIPS 2021), Virtual."},{"key":"ref_27","unstructured":"Wang, F., Silvestre, G., and Curran, K. (2024). MiTU-Net: A Fine-Tuned U-Net with SegFormer Backbone for Segmenting Pubic Symphysis-Fetal Head. arXiv."},{"key":"ref_28","unstructured":"Yeom, S.-K., and von Klitzing, J. (2023). U-MixFormer: UNet-like Transformer with Mix-Attention for Efficient Semantic Segmentation. arXiv."},{"key":"ref_29","unstructured":"Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xie, Z., Jin, J., Wang, J., Zhang, R., and Li, S. (2023). Application of Deep Learning Techniques in Water Level Measurement: Combining Improved SegFormer-UNet Model with Virtual Water Gauge. Appl. Sci., 13.","DOI":"10.3390\/app13095614"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.1029\/WR024i008p01317","article-title":"The Fractal Nature of River Networks","volume":"24","author":"Tarboton","year":"1988","journal-title":"Water Resour. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.inffus.2016.03.003","article-title":"A Review of Remote Sensing Image Fusion Methods","volume":"32","author":"Ghassemian","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1007\/s11831-022-09833-5","article-title":"From Conventional Approach to Machine Learning and Deep Learning Approach: An Experimental and Comprehensive Review of Image Fusion Techniques","volume":"30","author":"Choudhary","year":"2023","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"903","DOI":"10.14358\/PERS.74.7.903","article-title":"Decision-Based Fusion for Improved Fluvial Landscape Classification Using Digital Aerial Photographs and Forward Looking Infrared Images","volume":"74","author":"Smikrud","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"155753","DOI":"10.1109\/ACCESS.2020.3012701","article-title":"Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_36","unstructured":"Tomar, N. (2024, July 01). Nikhilroxtomar\/Semantic-Segmentation-Architecture 2024. Available online: https:\/\/github.com\/nikhilroxtomar\/Semantic-Segmentation-Architecture."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Li, F.-F. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_38","unstructured":"HuggingFace, H. (2024, July 01). Transformers: State-of-the-Art Machine Learning for JAX, PyTorch and TensorFlow 2024. Available online: https:\/\/github.com\/huggingface\/transformers."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal Loss for Dense Object Detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and Flexible Image Augmentations. Information, 11.","DOI":"10.3390\/info11020125"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1109\/LGRS.2019.2953261","article-title":"Seeing Through the Clouds with DeepWaterMap","volume":"17","author":"Isikdogan","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hao, M., Dong, X., Jiang, D., Yu, X., Ding, F., and Zhuo, J. (2024). Land-Use Classification Based on High-Resolution Remote Sensing Imagery and Deep Learning Models. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0300473"},{"key":"ref_44","unstructured":"Carbonneau, P.E. (2024). Global Scale Attention-Based Deep Learning for River Landscape Classification [Dataset], Durham University."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4747\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:55:54Z","timestamp":1760115354000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4747"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,19]]},"references-count":44,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["rs16244747"],"URL":"https:\/\/doi.org\/10.3390\/rs16244747","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,19]]}}}