{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T08:26:22Z","timestamp":1765268782747,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,8,20]],"date-time":"2021-08-20T00:00:00Z","timestamp":1629417600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Portuguese Foundation for Science and Technology (FCT)","award":["UIDB\/04033\/2020"],"award-info":[{"award-number":["UIDB\/04033\/2020"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["810176"],"award-info":[{"award-number":["810176"]}]},{"name":"North Portugal Regional Operational Programme (NORTE 2020)","award":["NORTE-06-3559-FSE-000067"],"award-info":[{"award-number":["NORTE-06-3559-FSE-000067"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Agronomy"],"abstract":"<jats:p>Reliable estimations of parameter values and associated uncertainties are crucial for crop model applications in agro-environmental research. However, estimating many parameters simultaneously for different types of response variables is difficult. This becomes more complicated for grapevines with different phenotypes between varieties and training systems. Our study aims to evaluate how a standard least square approach can be used to calibrate a complex grapevine model for simulating both the phenology (flowering and harvest date) and yield of four different variety\u2013training systems in the Douro Demarcated Region, northern Portugal. An objective function is defined to search for the best-fit parameters that result in the minimum value of the unweighted sum of the normalized Root Mean Squared Error (nRMSE) of the studied variables. Parameter uncertainties are estimated as how a given parameter value can determine the total prediction variability caused by variations in the other parameter combinations. The results indicate that the best-estimated parameters show a satisfactory predictive performance, with a mean bias of \u22122 to 4 days for phenology and \u2212232 to 159 kg\/ha for yield. The corresponding variance in the observed data was generally well reproduced, except for one occasion. These parameters are a good trade-off to achieve results close to the best possible fit of each response variable. No parameter combinations can achieve minimum errors simultaneously for phenology and yield, where the best fit to one variable can lead to a poor fit to another. The proposed parameter uncertainty analysis is particularly useful to select the best-fit parameter values when several choices with equal performance occur. A global sensitivity analysis is applied where the fruit-setting parameters are identified as key determinants for yield simulations. Overall, the approach (including uncertainty analysis) is relatively simple and straightforward without specific pre-conditions (e.g., model continuity), which can be easily applied for other models and crops. However, a challenge has been identified, which is associated with the appropriate assumption of the model errors, where a combination of various calibration approaches might be essential to have a more robust parameter estimation.<\/jats:p>","DOI":"10.3390\/agronomy11081659","type":"journal-article","created":{"date-parts":[[2021,8,20]],"date-time":"2021-08-20T08:44:45Z","timestamp":1629449085000},"page":"1659","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Simultaneous Calibration of Grapevine Phenology and Yield with a Soil\u2013Plant\u2013Atmosphere System Model Using the Frequentist Method"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6079-8689","authenticated-orcid":false,"given":"Chenyao","family":"Yang","sequence":"first","affiliation":[{"name":"Centre for the Research and Technology of Agro-Environmental and Biological Sciences (CITAB), Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production (Inov4Agro), University of Tr\u00e1s-os-Montes and Alto Douro (UTAD), 5000-801 Vila Real, Portugal"}]},{"given":"Christoph","family":"Menz","sequence":"additional","affiliation":[{"name":"Potsdam Institute for Climate Impact Research, PIK, 14473 Potsdam, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7946-8786","authenticated-orcid":false,"given":"Helder","family":"Fraga","sequence":"additional","affiliation":[{"name":"Centre for the Research and Technology of Agro-Environmental and Biological Sciences (CITAB), Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production (Inov4Agro), University of Tr\u00e1s-os-Montes and Alto Douro (UTAD), 5000-801 Vila Real, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0509-6999","authenticated-orcid":false,"given":"Samuel","family":"Reis","sequence":"additional","affiliation":[{"name":"CoLAB VINES & WINES-National Collaborative Laboratory for the Portuguese Wine Sector, Associa\u00e7\u00e3o para o Desenvolvimento da Viticultura Duriense (ADVID), Edif\u00edcio Centro de Excel\u00eancia da Vinha e do Vinho, R\u00e9gia Douro Park, 5000-033 Vila Real, Portugal"}]},{"given":"Nelson","family":"Machado","sequence":"additional","affiliation":[{"name":"CoLAB VINES & WINES-National Collaborative Laboratory for the Portuguese Wine Sector, Associa\u00e7\u00e3o para o Desenvolvimento da Viticultura Duriense (ADVID), Edif\u00edcio Centro de Excel\u00eancia da Vinha e do Vinho, R\u00e9gia Douro Park, 5000-033 Vila Real, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6606-1787","authenticated-orcid":false,"given":"Aureliano C.","family":"Malheiro","sequence":"additional","affiliation":[{"name":"Centre for the Research and Technology of Agro-Environmental and Biological Sciences (CITAB), Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production (Inov4Agro), University of Tr\u00e1s-os-Montes and Alto Douro (UTAD), 5000-801 Vila Real, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8135-5078","authenticated-orcid":false,"given":"Jo\u00e3o A.","family":"Santos","sequence":"additional","affiliation":[{"name":"Centre for the Research and Technology of Agro-Environmental and Biological Sciences (CITAB), Institute for Innovation, Capacity Building and Sustainability of Agri-Food Production (Inov4Agro), University of Tr\u00e1s-os-Montes and Alto Douro (UTAD), 5000-801 Vila Real, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.pbi.2018.05.009","article-title":"Progress in modelling agricultural impacts of and adaptations to climate change","volume":"45","author":"Hoffmann","year":"2018","journal-title":"Curr. Opin. Plant Biol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.agrformet.2012.09.011","article-title":"The Agricultural Model Intercomparison and Improvement Project (AgMIP): Protocols and pilot studies","volume":"170","author":"Rosenzweig","year":"2013","journal-title":"Agric. For. Meteorol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"107851","DOI":"10.1016\/j.agrformet.2019.107851","article-title":"Why do crop models diverge substantially in climate impact projections? A comprehensive analysis based on eight barley crop models","volume":"281","author":"Tao","year":"2020","journal-title":"Agric. For. Meteorol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1038\/nclimate1916","article-title":"Uncertainty in simulating wheat yields under climate change","volume":"3","author":"Asseng","year":"2013","journal-title":"Nat. Clim. Chang."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"126195","DOI":"10.1016\/j.eja.2020.126195","article-title":"How well do crop modeling groups predict wheat phenology, given calibration data from the target population?","volume":"124","author":"Wallach","year":"2021","journal-title":"Eur. J. Agron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.envsoft.2014.11.024","article-title":"Accuracy, robustness and behavior of the STICS soil\u2013crop model for plant, water and nitrogen outputs: Evaluation over a wide range of agro-environmental conditions in France","volume":"64","author":"Coucheney","year":"2015","journal-title":"Environ. Model. Softw."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wallach, D., Palosuo, T., Thorburn, P., Hochman, Z., Gourdain, E., Andrianasolo, F., Asseng, S., Basso, B., Buis, S., and Crout, N. (2020). The chaos in calibrating crop models. bioRxiv.","DOI":"10.1101\/2020.09.12.294744"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.eja.2018.01.006","article-title":"Towards improved calibration of crop models\u2014Where are we now and where should we go?","volume":"94","author":"Seidel","year":"2018","journal-title":"Eur. J. Agron."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1016\/j.envsoft.2016.07.010","article-title":"Estimating model predic-tion error: Should you treat predictions as fixed or random?","volume":"84","author":"Wallach","year":"2016","journal-title":"Environ. Model. Softw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.eja.2016.05.013","article-title":"Accounting for both parameter and model structure uncertainty in crop model predictions of phenology: A case study on rice","volume":"88","author":"Wallach","year":"2017","journal-title":"Eur. J. Agron."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"A1","DOI":"10.1016\/j.eja.2017.06.001","article-title":"Estimating uncertainty in crop model predictions: Current situation and future prospects","volume":"88","author":"Wallach","year":"2017","journal-title":"Eur. J. Agron."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1214\/088342304000000116","article-title":"The interplay of Bayesian and frequentist analysis","volume":"19","author":"Bayarri","year":"2004","journal-title":"Stat. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.2134\/agronj2012.0038","article-title":"Assessing the Uncertainty when Using a Model to Compare Irrigation Strategies","volume":"104","author":"Wallach","year":"2012","journal-title":"Agron. J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.eja.2017.12.001","article-title":"Uncertainty in wheat phenology simulation induced by cultivar parameterization under climate warming","volume":"94","author":"Liu","year":"2018","journal-title":"Eur. J. Agron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.agsy.2014.01.008","article-title":"An evaluation of the statistical methods for testing the performance of crop models with observed data","volume":"127","author":"Yang","year":"2014","journal-title":"Agric. Syst."},{"key":"ref_16","unstructured":"Brisson, N., Launay, M., Mary, B., and Beaudoin, N. (2009). Conceptual Basis, Formalisations and Parameterization of the STICS Crop Model, Editions Quae."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/S1161-0301(02)00110-7","article-title":"An overview of the crop model stics","volume":"18","author":"Brisson","year":"2003","journal-title":"Eur. J. Agron."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3774","DOI":"10.1111\/gcb.13382","article-title":"Modelling climate change impacts on viticultural yield, phenology and stress conditions in Europe","volume":"22","author":"Fraga","year":"2016","journal-title":"Glob. Chang. Biol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Costa, R., Fraga, H., Fonseca, A., De Cort\u00e1zar-Atauri, I.G., Val, M.C., Carlos, C., Reis, S., and Santos, J.A. (2019). Grapevine phenology of cv. Touriga Franca and Touriga Nacional in the Douro wine region: Modelling and climate change projections. Agronomy, 9.","DOI":"10.3390\/agronomy9040210"},{"key":"ref_20","first-page":"142","article-title":"Multivariate clustering of viticultural terroirs in the Douro winemaking region","volume":"32","author":"Fraga","year":"2017","journal-title":"Cienc. Tec. Vitivinic."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"482","DOI":"10.5344\/ajev.2015.15031","article-title":"Modeling phenology, water status, and yield components of three Portuguese grapevines using the STICS crop model","volume":"66","author":"Fraga","year":"2015","journal-title":"Am. J. Enol. Vitic."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"108095","DOI":"10.1016\/j.agrformet.2020.108095","article-title":"Performance of seasonal forecasts of Douro and Port wine production","volume":"291","author":"Santos","year":"2020","journal-title":"Agric. For. Meteorol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1515\/opag-2019-0028","article-title":"Spectral and thermal data as a proxy for leaf protective energy dissipation under kaolin application in grapevine cultivars","volume":"4","author":"Tosin","year":"2019","journal-title":"Open Agric."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1111\/ajgw.12278","article-title":"Daily prediction of seasonal grapevine production in the Douro wine region based on favourable meteorological conditions","volume":"23","author":"Fraga","year":"2017","journal-title":"Aust. J. Grape Wine Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.envsoft.2010.09.004","article-title":"A package of parameter estimation methods and implementation for the STICS crop-soil model","volume":"26","author":"Wallach","year":"2011","journal-title":"Environ. Model. Softw."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Reis, S., Fraga, H., Carlos, C., Silvestre, J., Eiras-Dias, J., Rodrigues, P., and Santos, J.A. (2020). Grapevine phenology in four portuguese wine regions: Modeling and predictions. Appl. Sci., 10.","DOI":"10.3390\/app10113708"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Malheiro, A.C., Pires, M., Concei\u00e7\u00e3o, N., Claro, A.M., Dinis, L.T., and Moutinho-Pereira, J. (2020). Linking sap flow and trunk diameter measurements to assess water dynamics of touriga-nacional grapevines trained in cordon and guyot systems. Agriculture, 10.","DOI":"10.3390\/agriculture10080315"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"313","DOI":"10.21273\/HORTSCI.37.2.313","article-title":"Seasonal dry matter, starch, and nutrient distribution in \u201cConcord\u201d grapevine roots","volume":"37","author":"Bates","year":"2002","journal-title":"HortScience"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102844","DOI":"10.1016\/j.agsy.2020.102844","article-title":"Assessing the impacts of recent-past climatic constraints on potential wheat yield and adaptation options under Mediterranean climate in southern Portugal","volume":"182","author":"Yang","year":"2020","journal-title":"Agric. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s10584-019-02419-4","article-title":"Effects of climate change and adaptation options on winter wheat yield under rainfed Mediterranean conditions in southern Portugal","volume":"154","author":"Yang","year":"2019","journal-title":"Clim. Chang."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.agwat.2017.02.004","article-title":"Assessment of irrigated maize yield response to climate change scenarios in Portugal","volume":"184","author":"Yang","year":"2017","journal-title":"Agric. Water Manag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1071\/CP17428","article-title":"Modelling climate change impacts on early and late harvest grassland systems in Portugal","volume":"69","author":"Yang","year":"2018","journal-title":"Crop. Pasture Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"9391","DOI":"10.1029\/2017JD028200","article-title":"An Ensemble Version of the E-OBS Temperature and Precipitation Data Sets","volume":"123","author":"Cornes","year":"2018","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1002\/qj.3803","article-title":"The ERA5 global reanalysis","volume":"146","author":"Hersbach","year":"2020","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"ref_35","unstructured":"Allen, R.G., Pereira, L.S., Raes, D., and Smith, M. (1998). Crop Evapotranspiration\u2014Guidelines for Computing Crop Water Requirements\u2014FAO Irrigation and Drainage Paper 56, FAO."},{"key":"ref_36","unstructured":"LEAF (ex-CEAP) (2020, June 30). Declives de Portugal Continental. LEAF\/ISA\/ULisboa. Dispon\u00edvel. Available online: http:\/\/epic-webgis-portugal.isa.utl.pt\/."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"109132","DOI":"10.1016\/j.ecolmodel.2020.109132","article-title":"A consistent calibration across three wheat models to simulate wheat yield and phenology in China","volume":"430","author":"Liu","year":"2020","journal-title":"Ecol. Modell."},{"key":"ref_38","unstructured":"Garcia de Cortazar Atauri, I. (2006). Adaptation du Mod\u00e8le STICS \u00e0 la Vigne (Vitis vinifera L.): Utilisation dans le Cadre D\u2019une \u00c9tude D\u2019impact du Changement Climatique \u00e0 L\u2019\u00e9chelle de la France. [Ph.D. Thesis, Montpellier SupAgro]. (In French)."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1007\/s00484-009-0217-4","article-title":"Performance of several models for predicting budburst date of grapevine (Vitis vinifera L.)","volume":"53","author":"Brisson","year":"2009","journal-title":"Int. J. Biometeorol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"83","DOI":"10.20870\/oeno-one.2009.43.2.801","article-title":"Asynchronous dynamics of grapevine (\u201cVitis vinifera\u201d) maturation: Experimental study for a modelling approach","volume":"43","author":"Brisson","year":"2009","journal-title":"OENO One"},{"key":"ref_41","first-page":"395","article-title":"The STICS Crop Model and Associated Software for Analysis, Parameterization, and Evaluation","volume":"2","author":"Buis","year":"2011","journal-title":"Methods Introd. Syst. Model. Agric. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/0378-4290(91)90040-3","article-title":"A test of the computer simulation model ARCWHEAT1 on wheat crops grown in New Zealand","volume":"27","author":"Jamieson","year":"1991","journal-title":"F. Crop. Res."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Seber, G.A.F. (2015). Nonlinear Regression Models. The Linear Model and Hypothesis: A General Unifying Theory, Springer International Publishing.","DOI":"10.1007\/978-3-319-21930-1"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.eja.2015.11.009","article-title":"A global sensitivity analysis of cultivar trait parameters in a sugarcane growth model for contrasting production environments in Queensland, Australia","volume":"88","author":"Sexton","year":"2017","journal-title":"Eur. J. Agron."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.envsoft.2015.05.009","article-title":"Analysis and classification of data sets for calibration and validation of agro-ecosystem models","volume":"72","author":"Kersebaum","year":"2015","journal-title":"Environ. Model. Softw."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.envsoft.2017.07.001","article-title":"How sensitive is a vineyard crop model to the uncertainty of its runoff module?","volume":"97","author":"Roux","year":"2017","journal-title":"Environ. Model. Softw."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1002\/csc2.20016","article-title":"A new approach to crop model calibration: Phenotyping plus post-processing","volume":"60","author":"Casadebaig","year":"2020","journal-title":"Crop. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"13","DOI":"10.20870\/oeno-one.2009.43.1.806","article-title":"Modelling soil water content and grapevine growth and development with the stics crop-soil model under two different water management strategies","volume":"43","author":"Celette","year":"2009","journal-title":"OENO One"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Singh, R.K., Afonso, J., Nogueira, M., Oliveira, A.A., Cosme, F., and Falco, V. (2020). Silicates of Potassium and Aluminium (Kaolin); Comparative Foliar Mitigation Treatments and Biochemical Insight on Grape Berry Quality in Vitis vinifera L. (cv. Touriga National and Touriga Franca). Biology, 9.","DOI":"10.3390\/biology9030058"}],"container-title":["Agronomy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-4395\/11\/8\/1659\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:47:50Z","timestamp":1760165270000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-4395\/11\/8\/1659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,20]]},"references-count":49,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["agronomy11081659"],"URL":"https:\/\/doi.org\/10.3390\/agronomy11081659","relation":{},"ISSN":["2073-4395"],"issn-type":[{"type":"electronic","value":"2073-4395"}],"subject":[],"published":{"date-parts":[[2021,8,20]]}}}