{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T06:55:01Z","timestamp":1776322501386,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010945","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T00:00:00Z","timestamp":1679961600000}}],"reference-count":66,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01-MH121410"],"award-info":[{"award-number":["R01-MH121410"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01-MH121410"],"award-info":[{"award-number":["R01-MH121410"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Deaths by suicide, as well as suicidal ideations, plans and attempts, have been increasing in the US for the past two decades. Deployment of effective interventions would require timely, geographically well-resolved estimates of suicide activity. In this study, we evaluated the feasibility of a two-step process for predicting suicide mortality: a) generation of <jats:italic>hindcasts<\/jats:italic>, mortality estimates for past months for which observational data would not have been available if forecasts were generated in real-time; and b) generation of forecasts with observational data augmented with hindcasts. Calls to crisis hotline services and online queries to the Google search engine for suicide-related terms were used as proxy data sources to generate hindcasts. The primary hindcast model (<jats:italic>auto<\/jats:italic>) is an Autoregressive Integrated Moving average model (ARIMA), trained on suicide mortality rates alone. Three regression models augment hindcast estimates from <jats:italic>auto<\/jats:italic> with call rates (<jats:italic>calls<\/jats:italic>), GHT search rates (<jats:italic>ght<\/jats:italic>) and both datasets together (<jats:italic>calls_ght<\/jats:italic>). The 4 forecast models used are ARIMA models trained with corresponding hindcast estimates. All models were evaluated against a <jats:italic>baseline<\/jats:italic> random walk with drift model. Rolling monthly 6-month ahead forecasts for all 50 states between 2012 and 2020 were generated. Quantile score (QS) was used to assess the quality of the forecast distributions. Median QS for <jats:italic>auto<\/jats:italic> was better than <jats:italic>baseline<\/jats:italic> (0.114 vs. 0.21. Median QS of augmented models were lower than <jats:italic>auto<\/jats:italic>, but not significantly different from each other (Wilcoxon signed-rank test, <jats:italic>p<\/jats:italic> &gt; .05). Forecasts from augmented models were also better calibrated. Together, these results provide evidence that proxy data can address delays in release of suicide mortality data and improve forecast quality. An operational forecast system of state-level suicide risk may be feasible with sustained engagement between modelers and public health departments to appraise data sources and methods as well as to continuously evaluate forecast accuracy.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010945","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T17:39:36Z","timestamp":1678729176000},"page":"e1010945","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["Hindcasts and forecasts of suicide mortality in US: A modeling study"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6248-9097","authenticated-orcid":true,"given":"Sasikiran","family":"Kandula","sequence":"first","affiliation":[]},{"given":"Mark","family":"Olfson","sequence":"additional","affiliation":[]},{"given":"Madelyn S.","family":"Gould","sequence":"additional","affiliation":[]},{"given":"Katherine M.","family":"Keyes","sequence":"additional","affiliation":[]},{"given":"Jeffrey","family":"Shaman","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2023,3,13]]},"reference":[{"key":"pcbi.1010945.ref001","author":"Centers for Disease Control and Prevention","year":"2021","journal-title":"National Center for Injury Prevention and ControlWeb-based Injury Statistics Query and Reporting System (WISQARS)"},{"key":"pcbi.1010945.ref002","article-title":"Suicide mortality in the United States, 1999-2019.","volume":"398","author":"H Hedegaard","year":"2021","journal-title":"NCHS Data Brief."},{"key":"pcbi.1010945.ref003","author":"Substance_Abuse_Mental_Health_Services_Administration","year":"2020","journal-title":"Key substance use and mental health indicators in the United States: results from the 2019 National Survey on Drug Use and Health"},{"issue":"2","key":"pcbi.1010945.ref004","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1037\/bul0000084","article-title":"Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research.","volume":"143","author":"JC Franklin","year":"2017","journal-title":"Psychological bulletin."},{"issue":"4","key":"pcbi.1010945.ref005","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1017\/S003329172000536X","article-title":"Suicide and the agent\u2013host\u2013environment triad: leveraging surveillance sources to inform prevention.","volume":"51","author":"KM Keyes","year":"2021","journal-title":"Psychological medicine."},{"issue":"8","key":"pcbi.1010945.ref006","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1176\/appi.ajp.2017.16111288","article-title":"Suicide following deliberate self-harm","volume":"174","author":"M Olfson","year":"2017","journal-title":"American Journal of Psychiatry"},{"issue":"11","key":"pcbi.1010945.ref007","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1001\/jamapsychiatry.2016.2035","article-title":"Short-term suicide risk after psychiatric hospital discharge","volume":"73","author":"M Olfson","year":"2016","journal-title":"JAMA psychiatry"},{"issue":"1","key":"pcbi.1010945.ref008","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00332747.2015.1006512","article-title":"Nonfatal suicidal behaviors in US Army administrative records, 2004\u20132009: Results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).","volume":"78","author":"RJ Ursano","year":"2015","journal-title":"Psychiatry."},{"key":"pcbi.1010945.ref009","author":"National Research Council","year":"2005","journal-title":"Firearms and violence: a critical review"},{"issue":"2","key":"pcbi.1010945.ref010","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1017\/S003329170500588X","article-title":"The association between suicide and the socio-economic characteristics of geographical areas: a systematic review.","volume":"36","author":"DH Rehkopf","year":"2006","journal-title":"Psychological medicine."},{"key":"pcbi.1010945.ref011","article-title":"The recent rise of suicide mortality in the United States.","volume":"43","author":"G Mart\u00ednez-Al\u00e9s","year":"2021","journal-title":"Annual review of public health."},{"key":"pcbi.1010945.ref012","doi-asserted-by":"crossref","first-page":"106734","DOI":"10.1016\/j.ypmed.2021.106734","article-title":"Implementing the national suicide prevention strategy: Time for action to flatten the curve.","volume":"152","author":"JK Iskander","year":"2021","journal-title":"Preventive medicine."},{"issue":"12","key":"pcbi.1010945.ref013","doi-asserted-by":"crossref","first-page":"e2030932","DOI":"10.1001\/jamanetworkopen.2020.30932","article-title":"Development of a machine learning model using multiple, heterogeneous data sources to estimate weekly US suicide fatalities.","volume":"3","author":"D Choi","year":"2020","journal-title":"JAMA network open."},{"issue":"4","key":"pcbi.1010945.ref014","doi-asserted-by":"crossref","first-page":"344","DOI":"10.30773\/pi.2017.10.15","article-title":"Advanced daily prediction model for national suicide numbers with social media data.","volume":"15","author":"KS Lee","year":"2018","journal-title":"Psychiatry investigation."},{"issue":"4","key":"pcbi.1010945.ref015","doi-asserted-by":"crossref","first-page":"e61809","DOI":"10.1371\/journal.pone.0061809","article-title":"Predicting national suicide numbers with social media data.","volume":"8","author":"H-H Won","year":"2013","journal-title":"PloS one"},{"key":"pcbi.1010945.ref016","volume-title":"Suicide Prevention and 988: Effectiveness of the National Suicide Prevention Lifeline","author":"MS Gould","year":"2021"},{"issue":"3","key":"pcbi.1010945.ref017","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1521\/suli.2007.37.3.338","article-title":"An evaluation of crisis hotline outcomes. Part 2: Suicidal callers","volume":"37","author":"MS Gould","year":"2007","journal-title":"Suicide and Life-Threatening Behavior"},{"issue":"1","key":"pcbi.1010945.ref018","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1111\/sltb.12339","article-title":"Follow-up with callers to the National Suicide Prevention Lifeline: Evaluation of callers\u2019 perceptions of care.","volume":"48","author":"MS Gould","year":"2018","journal-title":"Suicide and Life-Threatening Behavior"},{"key":"pcbi.1010945.ref019","doi-asserted-by":"crossref","DOI":"10.1145\/2858036.2858207","article-title":"Discovering shifts to suicidal ideation from mental health content in social media.","author":"M De Choudhury","year":"2016","journal-title":"Proceedings of the 2016 CHI conference on human factors in computing systems;"},{"issue":"44","key":"pcbi.1010945.ref020","doi-asserted-by":"crossref","first-page":"11203","DOI":"10.1073\/pnas.1802331115","article-title":"Facebook language predicts depression in medical records","volume":"115","author":"JC Eichstaedt","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1010945.ref021","article-title":"Tracking suicide risk factors through Twitter in the US.","author":"J Jashinsky","year":"2014","journal-title":"Crisis"},{"issue":"2","key":"pcbi.1010945.ref022","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.invent.2015.03.005","article-title":"Detecting suicidality on Twitter","volume":"2","author":"B O\u2019dea","year":"2015","journal-title":"Internet Intervention"},{"key":"pcbi.1010945.ref023","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jad.2019.11.014","article-title":"Search trends preceding increases in suicide: A cross-correlation study of monthly Google search volume and suicide rate using transfer function models","volume":"262","author":"J-Y Lee","year":"2020","journal-title":"Journal of affective disorders"},{"key":"pcbi.1010945.ref024","author":"National Center for Health Statistics","year":"2019","journal-title":"Detailed Mortality, All counties, 1999-2019 as compiled from data provided by the 57 vital statistics jurisdictions through the Vital Statistics Cooperative Program"},{"key":"pcbi.1010945.ref025","volume-title":"The International Statistical Classification of Diseases and Health Related Problems ICD-10: Tenth Revision.","author":"World Health Organization","year":"2004"},{"key":"pcbi.1010945.ref026","author":"National Center for Health Statistics","year":"2000","journal-title":"Bridged-race intercensal estimates of the resident population of the United States for"},{"key":"pcbi.1010945.ref027","author":"National Center for Health Statistics","year":"2010","journal-title":"Vintage 2020 Postcensal estimates of resident population of the United States for"},{"issue":"11","key":"pcbi.1010945.ref028","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1080\/10410236.2016.1224451","article-title":"Optimizing online suicide prevention: A search engine-based tailored approach.","volume":"32","author":"F Arendt","year":"2017","journal-title":"Health communication."},{"issue":"2","key":"pcbi.1010945.ref029","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1176\/appi.ps.201300211","article-title":"Google searches for suicide and risk of suicide.","volume":"65","author":"TA Bruckner","year":"2014","journal-title":"Psychiatric services."},{"issue":"2-3","key":"pcbi.1010945.ref030","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/j.jad.2012.11.004","article-title":"Using google searches on the internet to monitor suicidal behavior","volume":"148","author":"JF Gunn","year":"2013","journal-title":"Journal of affective disorders"},{"issue":"1","key":"pcbi.1010945.ref031","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s00406-011-0212-8","article-title":"Internet suicide searches and the incidence of suicide in young people in Japan","volume":"262","author":"A Hagihara","year":"2012","journal-title":"European archives of psychiatry clinical neuroscience"},{"key":"pcbi.1010945.ref032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1140\/epjds\/s13688-016-0094-0","article-title":"Estimating suicide occurrence statistics using Google Trends","volume":"5","author":"L Kristoufek","year":"2016","journal-title":"EPJ data science"},{"issue":"3","key":"pcbi.1010945.ref033","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1177\/2167702615593475","article-title":"Rethinking suicide surveillance: Google search data and self-reported suicidality differentially estimate completed suicide risk","volume":"4","author":"C Ma-Kellams","year":"2016","journal-title":"Clinical Psychological Science"},{"issue":"3","key":"pcbi.1010945.ref034","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.jad.2009.08.015","article-title":"Internet monitoring of suicide risk in the population","volume":"122","author":"MJ McCarthy","year":"2010","journal-title":"Journal of affective disorders"},{"issue":"12","key":"pcbi.1010945.ref035","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.3109\/00048674.2011.623660","article-title":"Surveillance of Australian suicidal behaviour using the internet?","volume":"45","author":"A Page","year":"2011","journal-title":"Australian New Zealand Journal of Psychiatry."},{"issue":"6","key":"pcbi.1010945.ref036","doi-asserted-by":"crossref","first-page":"7856","DOI":"10.4088\/JCP.v69n0601","article-title":"Googling suicide: surfing for suicide information on the Internet.","volume":"69","author":"PR Recupero","year":"2008","journal-title":"The Journal of clinical psychiatry"},{"issue":"4","key":"pcbi.1010945.ref037","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1111\/j.1440-1819.2011.02216.x","article-title":"Does the volume of Internet searches using suicide-related search terms influence the suicide death rate: Data from 2004 to 2009 in Japan","volume":"65","author":"H. Sueki","year":"2011","journal-title":"Psychiatry clinical neurosciences"},{"issue":"8","key":"pcbi.1010945.ref038","doi-asserted-by":"crossref","first-page":"20534","DOI":"10.4088\/JCP.13m08861","article-title":"Surfing for suicide methods and help: content analysis of websites retrieved with search engines in Austria and the United States.","volume":"75","author":"B Till","year":"2014","journal-title":"The Journal of clinical psychiatry"},{"issue":"8","key":"pcbi.1010945.ref039","doi-asserted-by":"crossref","first-page":"e0183149","DOI":"10.1371\/journal.pone.0183149","article-title":"Low validity of Google Trends for behavioral forecasting of national suicide rates.","volume":"12","author":"US Tran","year":"2017","journal-title":"PloS One"},{"issue":"1-2","key":"pcbi.1010945.ref040","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.jad.2011.01.019","article-title":"Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004\u20132009","volume":"132","author":"AC Yang","year":"2011","journal-title":"Journal of affective disorders"},{"issue":"1","key":"pcbi.1010945.ref041","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s10579-012-9185-0","article-title":"Lightweight methods to estimate influenza rates and alcohol sales volume from Twitter messages","volume":"47","author":"A. Culotta","year":"2013","journal-title":"Language resources evaluation"},{"issue":"11","key":"pcbi.1010945.ref042","doi-asserted-by":"crossref","first-page":"e7486","DOI":"10.2196\/jmir.7486","article-title":"Subregional nowcasts of seasonal influenza using search trends","volume":"19","author":"S Kandula","year":"2017","journal-title":"Journal of medical Internet research"},{"issue":"1","key":"pcbi.1010945.ref043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/srep12760","article-title":"Advances in nowcasting influenza-like illness rates using search query logs.","volume":"5","author":"V Lampos","year":"2015","journal-title":"Scientific reports."},{"key":"pcbi.1010945.ref044","article-title":"Provisional drug overdose death counts. National Center for Health Statistics","author":"F Ahmad","year":"2021","journal-title":"Statistics, Centers for Disease Control and Prevention (CDC);"},{"key":"pcbi.1010945.ref045","doi-asserted-by":"crossref","DOI":"10.1007\/b97391","volume-title":"Introduction to time series and forecasting","author":"PJ Brockwell","year":"2002"},{"key":"pcbi.1010945.ref046","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199641178.001.0001","volume-title":"Time series analysis by state space methods","author":"J Durbin","year":"2012"},{"key":"pcbi.1010945.ref047","author":"RJ Hyndman","year":"2018","journal-title":"Forecasting: principles and practice: OTexts"},{"key":"pcbi.1010945.ref048","article-title":"fable: Forecasting models for tidy time series.","volume":"2021","author":"M O\u2019Hara-Wild","year":"2021"},{"key":"pcbi.1010945.ref049","author":"R Core Team: A language environment for statistical computing","year":"2018","journal-title":"R Foundation for Statistical Computing: version 3.5. 0"},{"key":"pcbi.1010945.ref050","article-title":"forecast: Forecasting functions for time series and linear models","author":"R Hyndman","year":"2020"},{"issue":"683","key":"pcbi.1010945.ref051","doi-asserted-by":"crossref","first-page":"1924","DOI":"10.1002\/qj.2284","article-title":"Decomposition and graphical portrayal of the quantile score","volume":"140","author":"S Bentzien","year":"2014","journal-title":"Quarterly Journal of the Royal Meteorological Society"},{"key":"pcbi.1010945.ref052","author":"M Hollander","year":"1999","journal-title":"Nonparametric statistical methods"},{"key":"pcbi.1010945.ref053","author":"SY Wang","year":"2021","journal-title":"covidHubUtils: Utility functions for the COVID-19 forecast hub"},{"issue":"1","key":"pcbi.1010945.ref054","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.ijforecast.2020.06.008","article-title":"Recurrent neural networks for time series forecasting: Current status and future directions","volume":"37","author":"H Hewamalage","year":"2021","journal-title":"International Journal of Forecasting"},{"issue":"1","key":"pcbi.1010945.ref055","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.ijforecast.2019.03.017","article-title":"A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting","volume":"36","author":"S. Smyl","year":"2020","journal-title":"International Journal of Forecasting"},{"issue":"15","key":"pcbi.1010945.ref056","doi-asserted-by":"crossref","first-page":"e2113561119","DOI":"10.1073\/pnas.2113561119","article-title":"Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the United States","volume":"119","author":"EY Cramer","year":"2022","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"48","key":"pcbi.1010945.ref057","doi-asserted-by":"crossref","first-page":"24268","DOI":"10.1073\/pnas.1909865116","article-title":"An open challenge to advance probabilistic forecasting for dengue epidemics","volume":"116","author":"MA Johansson","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"8","key":"pcbi.1010945.ref058","doi-asserted-by":"crossref","first-page":"3146","DOI":"10.1073\/pnas.1812594116","article-title":"A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United States","volume":"116","author":"NG Reich","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"11","key":"pcbi.1010945.ref059","doi-asserted-by":"crossref","first-page":"e1007486","DOI":"10.1371\/journal.pcbi.1007486","article-title":"Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the US","volume":"15","author":"NG Reich","year":"2019","journal-title":"PLoS computational biology"},{"issue":"123","key":"pcbi.1010945.ref060","doi-asserted-by":"crossref","first-page":"20160410","DOI":"10.1098\/rsif.2016.0410","article-title":"Superensemble forecasts of dengue outbreaks","volume":"13","author":"TK Yamana","year":"2016","journal-title":"Journal of The Royal Society Interface"},{"issue":"11","key":"pcbi.1010945.ref061","doi-asserted-by":"crossref","first-page":"e1005801","DOI":"10.1371\/journal.pcbi.1005801","article-title":"Individual versus superensemble forecasts of seasonal influenza outbreaks in the United States","volume":"13","author":"TK Yamana","year":"2017","journal-title":"PLoS computational biology"},{"key":"pcbi.1010945.ref062","first-page":"19","volume-title":"Mathematical epidemiology","author":"Springer","year":"2008"},{"key":"pcbi.1010945.ref063","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvcm4gk0","volume-title":"Modeling infectious diseases in humans and animals","author":"MJ Keeling","year":"2011"},{"key":"pcbi.1010945.ref064","first-page":"S2468","article-title":"County-level estimates of suicide mortality in the USA: a modelling study","author":"S Kandula","year":"2023","journal-title":"Lancet Public Health"},{"issue":"1","key":"pcbi.1010945.ref065","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-244X-10-35","article-title":"Race\/ethnicity and potential suicide misclassification: window on a minority suicide paradox?","volume":"10","author":"IR Rockett","year":"2010","journal-title":"BMC psychiatry."},{"key":"pcbi.1010945.ref066","article-title":"Changes in suicide rates\u2014United States, 2019 and 2020","volume":"71","author":"DC Ehlman","year":"2022","journal-title":"Morbidity Mortality Weekly Report"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010945","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T00:00:00Z","timestamp":1679961600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010945","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T18:12:46Z","timestamp":1680027166000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010945"}},"subtitle":[],"editor":[{"given":"Lusha","family":"Zhu","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2023,3,13]]},"references-count":66,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010945","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1010945","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,13]]}}}