{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T16:50:41Z","timestamp":1781801441480,"version":"3.54.5"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012703","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:00:00Z","timestamp":1761004800000}}],"reference-count":54,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T00:00:00Z","timestamp":1760313600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["NWA.1160.18.210"],"award-info":[{"award-number":["NWA.1160.18.210"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Background and aim<\/jats:title>\n                    <jats:p>To prevent the spread of infectious diseases, successful interventions require early detection. The timing of implementation of preventive measures is crucial, but as outbreaks are hard to anticipate, control efforts often start too late. This applies to mosquito-borne diseases, for which the multifaceted nature of transmission complicates surveillance. Resilience indicators have been studied as a generic, model-free early warning method. However, the large data requirements limit their use in practice. In the present study, we compare the performance of multivariate indicators of resilience, combining the information contained in multiple data sources, to the performance of univariate ones focusing on one single time series. Additionally, by comparing various monitoring scenarios, we aim to find which data sources are the most informative as early warnings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>West Nile virus was used as a case study due to its complex transmission cycle with different hosts and vectors interacting. A synthetic dataset was generated using a compartmental model under different monitoring scenarios, including data-poor scenarios. Multivariate indicators of resilience relied on different data reduction techniques such as principal component analysis (PCA) and Max Autocorrelation Factor analysis (MAF). Multivariate indicators outperformed univariate ones, especially in data-poor scenarios such as reduced resolution or observation probabilities. This finding held across the different monitoring scenarios investigated. In the explored system, species that were more involved in the transmission cycle or preferred by the mosquitoes were not more informative for early warnings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Implications<\/jats:title>\n                    <jats:p>Overall, these results indicate that combining multiple data sources into multivariate indicators can help overcome the challenges of data requirements for resilience indicators. The final decision should be based on whether the additional effort is worth the gain in prediction performance. Future studies should confirm these findings in real-world data and estimate the sensitivity, specificity, and lead time of multivariate resilience indicators.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pcbi.1012703","type":"journal-article","created":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T17:33:40Z","timestamp":1760376820000},"page":"e1012703","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Multivariate resilience indicators to anticipate vector-borne disease outbreaks: A West Nile virus case-study"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5583-6903","authenticated-orcid":true,"given":"Clara","family":"Delecroix","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Quirine","family":"ten Bosch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Egbert H.","family":"Van Nes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingrid A.","family":"van de Leemput","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,10,13]]},"reference":[{"issue":"182","key":"pcbi.1012703.ref001","doi-asserted-by":"crossref","first-page":"20210555","DOI":"10.1098\/rsif.2021.0555","article-title":"Early warning signals of infectious disease transitions: a review","volume":"18","author":"E Southall","year":"2021","journal-title":"J R Soc Interface"},{"issue":"10","key":"pcbi.1012703.ref002","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgph.0002253","article-title":"The potential of resilience indicators to anticipate infectious disease outbreaks, a systematic review and guide","volume":"3","author":"C Delecroix","year":"2023","journal-title":"PLOS Glob Public Health"},{"issue":"7260","key":"pcbi.1012703.ref003","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1038\/nature08227","article-title":"Early-warning signals for critical transitions","volume":"461","author":"M Scheffer","year":"2009","journal-title":"Nature"},{"issue":"6105","key":"pcbi.1012703.ref004","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1126\/science.1225244","article-title":"Anticipating critical transitions","volume":"338","author":"M Scheffer","year":"2012","journal-title":"Science"},{"issue":"1","key":"pcbi.1012703.ref005","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/BF00384470","article-title":"A universal law of the characteristic return time near thresholds","volume":"65","author":"C Wissel","year":"1984","journal-title":"Oecologia"},{"issue":"4","key":"pcbi.1012703.ref006","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1086\/522093","article-title":"Erratum: Slow recovery from perturbations as a generic indicator of a nearby catastrophic shift","volume":"170","author":"EH Van Nes","year":"2007","journal-title":"American Naturalist"},{"issue":"7","key":"pcbi.1012703.ref007","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0041010","article-title":"Methods for detecting early warnings of critical transitions in time series illustrated using simulated ecological data","volume":"7","author":"V Dakos","year":"2012","journal-title":"PLoS One"},{"issue":"9","key":"pcbi.1012703.ref008","doi-asserted-by":"crossref","first-page":"2147","DOI":"10.1175\/1520-0442(1997)010<2147:AMTETS>2.0.CO;2","article-title":"A method to estimate the statistical significance of a correlation when the data are serially correlated","volume":"10","author":"W Ebisuzaki","year":"1997","journal-title":"J Clim"},{"issue":"3","key":"pcbi.1012703.ref009","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/s12080-015-0285-5","article-title":"Leading indicators of mosquito-borne disease elimination","volume":"9","author":"SM O\u2019Regan","year":"2016","journal-title":"Theor Ecol"},{"issue":"3","key":"pcbi.1012703.ref010","doi-asserted-by":"crossref","DOI":"10.1098\/rsbl.2019.0713","article-title":"Early warning signals of malaria resurgence in Kericho, Kenya","volume":"16","author":"MJ Harris","year":"2020","journal-title":"Biol Lett"},{"issue":"10","key":"pcbi.1012703.ref011","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgph.0002253","article-title":"The potential of resilience indicators to anticipate infectious disease outbreaks, a systematic review and guide","volume":"3","author":"C Delecroix","year":"2023","journal-title":"PLOS Glob Public Health"},{"key":"pcbi.1012703.ref012","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.epidem.2014.10.001","article-title":"Eight challenges in modelling disease ecology in multi-host, multi-agent systems","volume":"10","author":"MG Buhnerkempe","year":"2015","journal-title":"Epidemics"},{"key":"pcbi.1012703.ref013","doi-asserted-by":"crossref","first-page":"10","DOI":"10.3390\/ijerph10104869","article-title":"European Surveillance for West Nile Virus in Mosquito Populations","volume":"10","author":"O Engler","year":"2013","journal-title":"Int J Environ Res Public Health"},{"issue":"7","key":"pcbi.1012703.ref014","doi-asserted-by":"crossref","first-page":"589","DOI":"10.3390\/pathogens9070589","article-title":"West Nile Virus: An Update on Pathobiology, Epidemiology, Diagnostics, Control and \u201cOne Health\u201d Implications","volume":"9","author":"G Habarugira","year":"2020","journal-title":"Pathogens"},{"issue":"1","key":"pcbi.1012703.ref015","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-021-87839-y","article-title":"Evaluating the performance of multivariate indicators of resilience loss","volume":"11","author":"E Weinans","year":"2021","journal-title":"Sci Rep"},{"issue":"18","key":"pcbi.1012703.ref016","doi-asserted-by":"crossref","first-page":"17605","DOI":"10.1007\/s11071-023-08727-w","article-title":"Anticipating epidemic transitions in metapopulations with multivariate spectral similarity","volume":"111","author":"A Ghadami","year":"2023","journal-title":"Nonlinear Dyn"},{"key":"pcbi.1012703.ref017","article-title":"Resilience, adaptability and transformability in social-ecological systems","volume":"9","author":"B Walker","year":"2004","journal-title":"Ecosystems"},{"issue":"1","key":"pcbi.1012703.ref018","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1111\/ele.13401","article-title":"Foreseeing the future of mutualistic communities beyond collapse","volume":"23","author":"JJ Lever","year":"2020","journal-title":"Ecol Lett"},{"key":"pcbi.1012703.ref019","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1038\/srep00888","article-title":"Changes in cross-correlations as an indicator for systemic risk","volume":"2","author":"Z Zheng","year":"2012","journal-title":"Sci Rep"},{"issue":"10","key":"pcbi.1012703.ref020","doi-asserted-by":"crossref","first-page":"1765","DOI":"10.1111\/ele.14293","article-title":"Five fundamental ways in which complex food webs may spiral out of control","volume":"26","author":"JJ Lever","year":"2023","journal-title":"Ecol Lett"},{"issue":"8","key":"pcbi.1012703.ref021","doi-asserted-by":"crossref","DOI":"10.1098\/rsos.200896","article-title":"Data-driven identification of reliable sensor species to predict regime shifts in ecological networks","volume":"7","author":"A Ghadami","year":"2020","journal-title":"R Soc Open Sci"},{"issue":"51","key":"pcbi.1012703.ref022","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2104732118","article-title":"Structure-based identification of sensor species for anticipating critical transitions","volume":"118","author":"A Aparicio","year":"2021","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"20","key":"pcbi.1012703.ref023","doi-asserted-by":"crossref","first-page":"21135","DOI":"10.2807\/1560-7917.ES2015.20.20.21135","article-title":"The challenge of West Nile virus in Europe: knowledge gaps and research priorities","volume":"20","author":"A Rizzoli","year":"2015","journal-title":"Euro Surveill"},{"issue":"2","key":"pcbi.1012703.ref024","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1089\/vbz.2014.1689","article-title":"Comparison of the efficiency and cost of West Nile virus surveillance methods in California","volume":"15","author":"JM Healy","year":"2015","journal-title":"Vector Borne Zoonotic Dis"},{"key":"pcbi.1012703.ref025","first-page":"38","article-title":"\u201cNeon needles\u201d in a haystack: The advantages of passive surveillance for West Nile virus.","volume-title":"Annals of the New York Academy of Sciences.","author":"M Eidson","year":"2001"},{"issue":"2","key":"pcbi.1012703.ref026","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.cimid.2014.01.004","article-title":"Evaluation of a West Nile virus surveillance and early warning system in Greece, based on domestic pigeons","volume":"37","author":"SC Chaintoutis","year":"2014","journal-title":"Comp Immunol Microbiol Infect Dis"},{"key":"pcbi.1012703.ref027","first-page":"693","article-title":"Citizen science and wildlife disease surveillance","volume-title":"EcoHealth","author":"B Lawson","year":"2015"},{"issue":"2","key":"pcbi.1012703.ref028","first-page":"375","article-title":"Quantifying West Nile virus circulation in the avian host population in Northern Italy","volume":"10","author":"A De Nardi","year":"2025","journal-title":"Infect Dis Model"},{"issue":"79","key":"pcbi.1012703.ref029","doi-asserted-by":"crossref","DOI":"10.1098\/rsif.2012.0804","article-title":"Dissecting a wildlife disease hotspot: The impact of multiple host species, environmental transmission and seasonality in migration, breeding and mortality","volume":"10","author":"VL Brown","year":"2013","journal-title":"J R Soc Interface"},{"key":"pcbi.1012703.ref030","doi-asserted-by":"crossref","unstructured":"de Wit MM, Beaun\u00e9e G, Dellar M, M\u00fcnger E, Krol L, Atama N, et al. Silent reservoirs are shaping disease emergence: the case of Usutu virus in the Netherlands [Internet]. 2024. Available from: http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2024.12.17.628855","DOI":"10.1101\/2024.12.17.628855"},{"key":"pcbi.1012703.ref031","doi-asserted-by":"crossref","DOI":"10.1016\/j.actatropica.2023.106832","article-title":"Invasive mosquito vectors in Europe: From bioecology to surveillance and management","volume":"239","author":"G Giunti","year":"2023","journal-title":"Acta Tropica"},{"issue":"10","key":"pcbi.1012703.ref032","article-title":"Exploring the influence of competition on arbovirus invasion risk in communities","volume":"17","author":"AD Martins","year":"2022","journal-title":"PLoS One"},{"key":"pcbi.1012703.ref033","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.prevetmed.2010.10.013","article-title":"Simulation of the seasonal cycles of bird, equine and human West Nile virus cases","volume":"98","author":"V Laperriere","year":"2011","journal-title":"Prev Vet Med"},{"issue":"3","key":"pcbi.1012703.ref034","doi-asserted-by":"crossref","first-page":"311","DOI":"10.3201\/eid0903.020628","article-title":"Experimental infection of North American birds with the New York 1999 strain of West Nile virus","volume":"9","author":"N Komar","year":"2003","journal-title":"Emerg Infect Dis"},{"issue":"2018","key":"pcbi.1012703.ref035","article-title":"Mechanistic models for West Nile virus transmission: a systematic review of features, aims and parametrization","volume":"291","author":"MM de Wit","year":"2024","journal-title":"Proc R Soc B Biol Sci"},{"key":"pcbi.1012703.ref036","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1146\/annurev.physchem.58.032806.104637","article-title":"Stochastic simulation of chemical kinetics","volume":"58","author":"DT Gillespie","year":"2007","journal-title":"Annu Rev Phys Chem"},{"issue":"12","key":"pcbi.1012703.ref037","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v091.i12","article-title":"Siminf: An R package for data-driven stochastic disease spread simulations","volume":"91","author":"S Widgren","year":"2019","journal-title":"J Stat Softw"},{"issue":"3","key":"pcbi.1012703.ref038","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1023\/A:1016599411804","article-title":"A brief history of R0 and a recipe for its calculation","volume":"50","author":"JAP Heesterbeek","year":"2002","journal-title":"Acta Biotheor"},{"issue":"8","key":"pcbi.1012703.ref039","doi-asserted-by":"crossref","first-page":"3543","DOI":"10.3390\/ijerph10083543","article-title":"Environmental drivers of West Nile fever epidemiology in Europe and Western Asia--a review","volume":"10","author":"S Paz","year":"2013","journal-title":"Int J Environ Res Public Health"},{"key":"pcbi.1012703.ref040","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198523963.001.0001","volume-title":"Applied smoothing techniques for data analysis: the kernel approach with S-Plus illustrations","author":"AW Bowman","year":"1997"},{"issue":"5","key":"pcbi.1012703.ref041","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.4269\/ajtmh.15-0809","article-title":"Supersuppression: Reservoir Competency and Timing of Mosquito Host Shifts Combine to Reduce Spillover of West Nile Virus","volume":"95","author":"RS Levine","year":"2016","journal-title":"Am J Trop Med Hyg"},{"issue":"159","key":"pcbi.1012703.ref042","doi-asserted-by":"crossref","first-page":"20190629","DOI":"10.1098\/rsif.2019.0629","article-title":"Finding the direction of lowest resilience in multivariate complex systems","volume":"16","author":"E Weinans","year":"2019","journal-title":"J R Soc Interface"},{"issue":"5","key":"pcbi.1012703.ref043","doi-asserted-by":"crossref","DOI":"10.1371\/journal.ppat.1006965","article-title":"Contributions from the silent majority dominate dengue virus transmission","volume":"14","author":"QA Ten Bosch","year":"2018","journal-title":"PLoS Pathog"},{"issue":"1","key":"pcbi.1012703.ref044","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1186\/s12976-017-0063-8","article-title":"Forecasting infectious disease emergence subject to seasonal forcing","volume":"14","author":"PB Miller","year":"2017","journal-title":"Theor Biol Med Model"},{"issue":"6","key":"pcbi.1012703.ref045","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1006204","article-title":"Anticipating epidemic transitions with imperfect data","volume":"14","author":"TS Brett","year":"2018","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1012703.ref046","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1890\/11-0889.1","article-title":"Robustness of variance and autocorrelation as indicators of critical slowing down","volume":"93","author":"V Dakos","year":"2012","journal-title":"Ecology"},{"key":"pcbi.1012703.ref047","doi-asserted-by":"crossref","DOI":"10.1016\/j.onehlt.2023.100507","article-title":"Rapid response screening for emerging zoonotic pathogens, barriers and opportunities: A study for enhanced preparedness of the Netherlands","volume":"16","author":"K Streng","year":"2023","journal-title":"One Health"},{"issue":"1","key":"pcbi.1012703.ref048","article-title":"West Nile virus spread in Europe: Phylogeographic pattern analysis and key drivers","volume":"20","author":"L Lu","year":"2024","journal-title":"PLoS Pathog"},{"issue":"12","key":"pcbi.1012703.ref049","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1003327","article-title":"Heterogeneity, mixing, and the spatial scales of mosquito-borne pathogen transmission","volume":"9","author":"TA Perkins","year":"2013","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1012703.ref050","doi-asserted-by":"crossref","DOI":"10.1016\/j.epidem.2022.100645","article-title":"Timeliness of reporting of SARS-CoV-2 seroprevalence results and their utility for infectious disease surveillance","volume":"41","author":"C Donnici","year":"2022","journal-title":"Epidemics"},{"issue":"9","key":"pcbi.1012703.ref051","article-title":"The increasing complexity of arbovirus serology: An in-depth systematic review on cross-reactivity","volume":"17","author":"LMR Kasbergen","year":"2023","journal-title":"PLoS Negl Trop Dis"},{"key":"pcbi.1012703.ref052","doi-asserted-by":"crossref","first-page":"105796","DOI":"10.1016\/j.actatropica.2020.105796","article-title":"Spring temperature shapes West Nile virus transmission in Europe","volume":"215","author":"G Marini","year":"2021","journal-title":"Acta Trop"},{"key":"pcbi.1012703.ref053","article-title":"Artificial intelligence to predict West Nile virus outbreaks with eco-climatic drivers","author":"Z Farooq","year":"2022","journal-title":"Available from"},{"key":"pcbi.1012703.ref054","doi-asserted-by":"crossref","DOI":"10.1016\/j.lanepe.2024.101149","article-title":"Short-term effect of temperature and precipitation on the incidence of West Nile neuroinvasive disease in Europe: a multi-country case-crossover analysis","volume":"48","author":"G Moirano","year":"2025","journal-title":"Lancet Regional Health - Europe"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012703","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:00:00Z","timestamp":1761004800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012703","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T17:45:41Z","timestamp":1761068741000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012703"}},"subtitle":[],"editor":[{"given":"Juliette","family":"Paireau","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,10,13]]},"references-count":54,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012703","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,13]]}}}