{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T03:49:35Z","timestamp":1771904975098,"version":"3.50.1"},"reference-count":30,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2023,7,13]],"date-time":"2023-07-13T00:00:00Z","timestamp":1689206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of China","award":["U1811464"],"award-info":[{"award-number":["U1811464"]}]},{"name":"Natural Science Foundation of China","award":["U1811463"],"award-info":[{"award-number":["U1811463"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The effective representation of land surface hydrological models strongly relies on spatially varying parameters that require calibration. Well-calibrated physical models can effectively propagate observed information to unobserved variables, but traditional calibration methods often result in nonunique solutions. In this paper, we propose a hydrological parameter calibration training framework consisting of a transformer-based parameter learning model (ParaFormer) and a surrogate model based on LSTM. On the one hand, ParaFormer utilizes self-attention mechanisms to learn a global mapping from observed data to the parameters to be calibrated, which captures spatial correlations. On the other hand, the surrogate model takes the calibrated parameters as inputs and simulates the observable variables, such as soil moisture, overcoming the challenges of directly combining complex hydrological models with a deep learning (DL) platform in a hybrid training scheme. Using the variable infiltration capacity model as the reference, we test the performance of ParaFormer on datasets of different resolutions. The results demonstrate that, in predicting soil moisture and transferring calibrated parameters in the task of evapotranspiration prediction, ParaFormer learns more effective and robust parameter mapping patterns compared to traditional and state-of-the-art DL-based parameter calibration methods.<\/jats:p>","DOI":"10.3390\/rs15143536","type":"journal-article","created":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T00:39:41Z","timestamp":1689295181000},"page":"3536","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Transformer-Based Framework for Parameter Learning of a Land Surface Hydrological Process Model"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-9850-4560","authenticated-orcid":false,"given":"Klin","family":"Li","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China"}]},{"given":"Yutong","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.advwatres.2017.09.010","article-title":"Four decades of microwave satellite soil moisture observations: Part 2. Product validation and inter-satellite comparisons","volume":"109","author":"Karthikeyan","year":"2017","journal-title":"Adv. Water Resour."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.jhydrol.2004.03.033","article-title":"Calibration of a semi-distributed hydrologic model for streamflow estimation along a river system","volume":"298","author":"Ajami","year":"2004","journal-title":"J. Hydrol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7784","DOI":"10.1029\/2018WR024178","article-title":"In quest of calibration density and consistency in hydrologic modeling: Distributed parameter calibration against streamflow characteristics","volume":"55","author":"Yang","year":"2019","journal-title":"Water Resour. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"19491","DOI":"10.1029\/1999JD900154","article-title":"Parameter estimation of a land surface scheme using multicriteria methods","volume":"104","author":"Gupta","year":"1999","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_5","unstructured":"Price, K., Storn, R.M., and Lampinen, J.A. (2006). Differential Evolution: A Practical Approach to Global Optimization, Springer Science & Business Media."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"497","DOI":"10.2166\/hydro.2011.010","article-title":"Calibration of a conceptual rainfall\u2013runoff model using a genetic algorithm integrated with runoff estimation sensitivity to parameters","volume":"14","author":"Wu","year":"2012","journal-title":"J. Hydroinform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.envsoft.2014.09.013","article-title":"Evolutionary algorithms and other metaheuristics in water resources: Current status, research challenges and future directions","volume":"62","author":"Maier","year":"2014","journal-title":"Environ. Model. Softw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1029\/91WR02985","article-title":"Effective and efficient global optimization for conceptual rainfall-runoff models","volume":"28","author":"Duan","year":"1992","journal-title":"Water Resour. Res."},{"key":"ref_9","first-page":"971","article-title":"Calibration of parameters in soil moisture equation with shuffled complex evolution algorithm","volume":"37","author":"Li","year":"2013","journal-title":"Chin. J. Atmos. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1175\/BAMS-D-15-00104.1","article-title":"Automatic model calibration: A new way to improve numerical weather forecasting","volume":"98","author":"Duan","year":"2017","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"125019","DOI":"10.1016\/j.jhydrol.2020.125019","article-title":"A surrogate model for the Variable Infiltration Capacity model using deep learning artificial neural network","volume":"588","author":"Gu","year":"2020","journal-title":"J. Hydrol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.envsoft.2014.05.026","article-title":"An evaluation of adaptive surrogate modeling based optimization with two benchmark problems","volume":"60","author":"Wang","year":"2014","journal-title":"Environ. Model. Softw."},{"key":"ref_13","first-page":"139","article-title":"Surrogate model of numerical simulation model of groundwater based on wavelet neural network","volume":"35","author":"Wang","year":"2015","journal-title":"China Environ. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"126423","DOI":"10.1016\/j.jhydrol.2021.126423","article-title":"Can artificial intelligence and data-driven machine learning models match or even replace process-driven hydrologic models for streamflow simulation?: A case study of four watersheds with different hydro-climatic regions across the CONUS","volume":"598","author":"Kim","year":"2021","journal-title":"J. Hydrol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"115651","DOI":"10.1016\/j.geoderma.2021.115651","article-title":"An attention-aware LSTM model for soil moisture and soil temperature prediction","volume":"409","author":"Li","year":"2022","journal-title":"Geoderma"},{"key":"ref_16","first-page":"399","article-title":"Near-Real-Time Forecast of Satellite-Based Soil Moisture Using Long Short-Term Memory with an Adaptive Data Integration Kernel","volume":"21","author":"Fang","year":"2020","journal-title":"J. Hydrol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2221","DOI":"10.1109\/TGRS.2018.2872131","article-title":"The value of SMAP for long-term soil moisture estimation with the help of deep learning","volume":"57","author":"Fang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"11344","DOI":"10.1029\/2019WR026065","article-title":"Toward Improved Predictions in Ungauged Basins: Exploiting the Power of Machine Learning","volume":"55","author":"Kratzert","year":"2019","journal-title":"Water Resour. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e2019WR026793","DOI":"10.1029\/2019WR026793","article-title":"Enhancing streamflow forecast and extracting insights using long-short term memory networks with data integration at continental scales","volume":"56","author":"Feng","year":"2020","journal-title":"Water Resour. Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"(2019). Physics-Constrained Machine Learning of Evapotranspiration. Geophys. Res. Lett., 46, 14496\u201314507.","DOI":"10.1029\/2019GL085291"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1029\/2007WR006615","article-title":"A spatial regularization approach to parameter estimation for a distributed watershed model","volume":"44","author":"Pokhrel","year":"2008","journal-title":"Water Resour. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"8020","DOI":"10.1002\/2017WR020401","article-title":"Towards seamless large-domain parameter estimation for hydrologic models","volume":"53","author":"Mizukami","year":"2017","journal-title":"Water Resour. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5988","DOI":"10.1038\/s41467-021-26107-z","article-title":"From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling","volume":"12","author":"Tsai","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"14415","DOI":"10.1029\/94JD00483","article-title":"A simple hydrologically based model of land surface water and energy fluxes for general circulation models","volume":"99","author":"Liang","year":"1994","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/0921-8181(95)00046-1","article-title":"Surface soil moisture parameterization of the VIC-2L model: Evaluation and modification","volume":"13","author":"Liang","year":"1996","journal-title":"Glob. Planet. Chang."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3481","DOI":"10.5194\/gmd-11-3481-2018","article-title":"The Variable Infiltration Capacity model version 5 (VIC-5): Infrastructure improvements for new applications and reproducibility","volume":"11","author":"Hamman","year":"2018","journal-title":"Geosci. Model Dev."},{"key":"ref_27","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"11030","DOI":"10.1002\/2017GL075619","article-title":"Prolongation of SMAP to spatiotemporally seamless coverage of continental US using a deep learning neural network","volume":"44","author":"Fang","year":"2017","journal-title":"Geophys. Res. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1175\/1525-7541(2004)005<0430:GSMFSO>2.0.CO;2","article-title":"Global Soil Moisture from Satellite Observations, Land Surface Models, and Ground Data: Implications for Data Assimilation","volume":"5","author":"Reichle","year":"2004","journal-title":"J. Hydrometeorol."},{"key":"ref_30","first-page":"2015","article-title":"Three decades of the Shuffled Complex Evolution (SCE-UA) optimization algorithm: Review and applications","volume":"26","author":"Naeini","year":"2019","journal-title":"Sci. Iran."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3536\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:11:40Z","timestamp":1760127100000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3536"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,13]]},"references-count":30,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["rs15143536"],"URL":"https:\/\/doi.org\/10.3390\/rs15143536","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,13]]}}}