{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T21:35:49Z","timestamp":1772055349785,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012927","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T00:00:00Z","timestamp":1744070400000}}],"reference-count":47,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T00:00:00Z","timestamp":1743379200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["U01AI150753,"],"award-info":[{"award-number":["U01AI150753,"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U01AI141995"],"award-info":[{"award-number":["U01AI141995"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U19AI142742"],"award-info":[{"award-number":["U19AI142742"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute of Health","award":["U01AI187062"],"award-info":[{"award-number":["U01AI187062"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Systems vaccinology studies have been used to build computational models that predict individual vaccine responses and identify the factors contributing to differences in outcome. Comparing such models is challenging due to variability in study designs. To address this, we established a community resource to compare models predicting <jats:italic>B. pertussis<\/jats:italic> booster responses and generate experimental data for the explicit purpose of model evaluation. We here describe our second computational prediction challenge using this resource, where we benchmarked 49 algorithms from 53 scientists. We found that the most successful models stood out in their handling of nonlinearities, reducing large feature sets to representative subsets, and advanced data preprocessing. In contrast, we found that models adopted from literature that were developed to predict vaccine antibody responses in other settings performed poorly, reinforcing the need for purpose-built models. Overall, this demonstrates the value of purpose-generated datasets for rigorous and open model evaluations to identify features that improve the reliability and applicability of computational models in vaccine response prediction.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012927","type":"journal-article","created":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T20:55:45Z","timestamp":1743454545000},"page":"e1012927","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Putting computational models of immunity to the test\u2014An invited challenge to predict B.pertussis vaccination responses"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1071-2744","authenticated-orcid":true,"given":"Pramod","family":"Shinde","sequence":"first","affiliation":[]},{"given":"Lisa","family":"Willemsen","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Anderson","sequence":"additional","affiliation":[]},{"given":"Minori","family":"Aoki","sequence":"additional","affiliation":[]},{"given":"Saonli","family":"Basu","sequence":"additional","affiliation":[]},{"given":"Julie G.","family":"Burel","sequence":"additional","affiliation":[]},{"given":"Peng","family":"Cheng","sequence":"additional","affiliation":[]},{"given":"Souradipto","family":"Ghosh Dastidar","sequence":"additional","affiliation":[]},{"given":"Aidan","family":"Dunleavy","sequence":"additional","affiliation":[]},{"given":"Tal","family":"Einav","sequence":"additional","affiliation":[]},{"given":"Jamie","family":"Forschmiedt","sequence":"additional","affiliation":[]},{"given":"Slim","family":"Fourati","sequence":"additional","affiliation":[]},{"given":"Javier","family":"Garcia","sequence":"additional","affiliation":[]},{"given":"William","family":"Gibson","sequence":"additional","affiliation":[]},{"given":"Jason A.","family":"Greenbaum","sequence":"additional","affiliation":[]},{"given":"Leying","family":"Guan","sequence":"additional","affiliation":[]},{"given":"Weikang","family":"Guan","sequence":"additional","affiliation":[]},{"given":"Jeremy P.","family":"Gygi","sequence":"additional","affiliation":[]},{"given":"Brendan","family":"Ha","sequence":"additional","affiliation":[]},{"given":"Joe","family":"Hou","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1663-9365","authenticated-orcid":true,"given":"Jason","family":"Hsiao","sequence":"additional","affiliation":[]},{"given":"Yunda","family":"Huang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5683-2584","authenticated-orcid":true,"given":"Rick","family":"Jansen","sequence":"additional","affiliation":[]},{"given":"Bhargob","family":"Kakoty","sequence":"additional","affiliation":[]},{"given":"Zhiyu","family":"Kang","sequence":"additional","affiliation":[]},{"given":"James J.","family":"Kobie","sequence":"additional","affiliation":[]},{"given":"Mari","family":"Kojima","sequence":"additional","affiliation":[]},{"given":"Anna","family":"Konstorum","sequence":"additional","affiliation":[]},{"given":"Jiyeun","family":"Lee","sequence":"additional","affiliation":[]},{"given":"Sloan A.","family":"Lewis","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9319-8790","authenticated-orcid":true,"given":"Aixin","family":"Li","sequence":"additional","affiliation":[]},{"given":"Eric F.","family":"Lock","sequence":"additional","affiliation":[]},{"given":"Jarjapu","family":"Mahita","sequence":"additional","affiliation":[]},{"given":"Marcus","family":"Mendes","sequence":"additional","affiliation":[]},{"given":"Hailong","family":"Meng","sequence":"additional","affiliation":[]},{"given":"Aidan","family":"Neher","sequence":"additional","affiliation":[]},{"given":"Somayeh","family":"Nili","sequence":"additional","affiliation":[]},{"given":"Lars R\u00f8nn","family":"Olsen","sequence":"additional","affiliation":[]},{"given":"Shelby","family":"Orfield","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5139-5557","authenticated-orcid":true,"given":"James A.","family":"Overton","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0187-4407","authenticated-orcid":true,"given":"Nidhi","family":"Pai","sequence":"additional","affiliation":[]},{"given":"Cokie","family":"Parker","sequence":"additional","affiliation":[]},{"given":"Brian","family":"Qian","sequence":"additional","affiliation":[]},{"given":"Mikkel","family":"Rasmussen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8468-2840","authenticated-orcid":true,"given":"Joaquin","family":"Reyna","sequence":"additional","affiliation":[]},{"given":"Eve","family":"Richardson","sequence":"additional","affiliation":[]},{"given":"Sandra","family":"Safo","sequence":"additional","affiliation":[]},{"given":"Josey","family":"Sorenson","sequence":"additional","affiliation":[]},{"given":"Aparna","family":"Srinivasan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3495-6575","authenticated-orcid":true,"given":"Nicola","family":"Thrupp","sequence":"additional","affiliation":[]},{"given":"Rashmi","family":"Tippalagama","sequence":"additional","affiliation":[]},{"given":"Raphael","family":"Trevizani","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2229-9560","authenticated-orcid":true,"given":"Steffen","family":"Ventz","sequence":"additional","affiliation":[]},{"given":"Jiuzhou","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Cheng-Chang","family":"Wu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0708-6914","authenticated-orcid":true,"given":"Ferhat","family":"Ay","sequence":"additional","affiliation":[]},{"given":"Barry","family":"Grant","sequence":"additional","affiliation":[]},{"given":"Steven H.","family":"Kleinstein","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8457-6693","authenticated-orcid":true,"given":"Bjoern","family":"Peters","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2025,3,31]]},"reference":[{"issue":"1","key":"pcbi.1012927.ref001","doi-asserted-by":"crossref","first-page":"3402","DOI":"10.1038\/s41467-024-47463-6","article-title":"Multi-omics analysis reveals COVID-19 vaccine induced attenuation of inflammatory responses during breakthrough disease","volume":"15","author":"RE Drury","year":"2024","journal-title":"Nat Commun"},{"issue":"7949","key":"pcbi.1012927.ref002","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1038\/s41586-022-05670-5","article-title":"Influenza vaccination reveals sex dimorphic imprints of prior mild COVID-19","volume":"614","author":"R Sparks","year":"2023","journal-title":"Nature"},{"issue":"4","key":"pcbi.1012927.ref003","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1038\/s41591-020-0769-8","article-title":"Broad immune activation underlies shared set point signatures for vaccine responsiveness in healthy individuals and disease activity in patients with lupus","volume":"26","author":"Y Kotliarov","year":"2020","journal-title":"Nat Med"},{"issue":"1","key":"pcbi.1012927.ref004","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1038\/s41467-023-37176-7","article-title":"Predicting vaccine effectiveness against severe COVID-19 over time and against variants: a meta-analysis","volume":"14","author":"D Cromer","year":"2023","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1012927.ref005","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/S2213-2600(22)00266-1","article-title":"Does repeated influenza vaccination attenuate effectiveness? A systematic review and meta-analysis","volume":"11","author":"E Jones-Gray","year":"2023","journal-title":"Lancet Respir Med"},{"key":"pcbi.1012927.ref006","doi-asserted-by":"crossref","first-page":"eaal4656","DOI":"10.1126\/sciimmunol.aal4656","article-title":"Multicohort analysis reveals baseline transcriptional predictors of influenza vaccination responses","volume":"2","author":"HIPC-CHI Signatures Project Team, HIPC-I Consortium","year":"2017","journal-title":"Sci Immunol"},{"key":"pcbi.1012927.ref007","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1038\/s41590-022-01328-6","article-title":"Transcriptional atlas of the human immune response to 13 vaccines reveals a common predictor of vaccine-induced antibody responses","volume":"23","author":"T Hagan","year":"2022","journal-title":"Nature Immunology"},{"issue":"1","key":"pcbi.1012927.ref008","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1038\/s41597-022-01558-1","article-title":"A curated collection of human vaccination response signatures","volume":"9","author":"KC Smith","year":"2022","journal-title":"Sci Data"},{"issue":"3","key":"pcbi.1012927.ref009","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1038\/ng749","article-title":"Replication validity of genetic association studies","volume":"29","author":"JP Ioannidis","year":"2001","journal-title":"Nat Genet"},{"issue":"3","key":"pcbi.1012927.ref010","doi-asserted-by":"crossref","first-page":"100731","DOI":"10.1016\/j.crmeth.2024.100731","article-title":"A multi-omics systems vaccinology resource to develop and test computational models of immunity","volume":"4","author":"P Shinde","year":"2024","journal-title":"Cell Rep Methods"},{"issue":"7","key":"pcbi.1012927.ref011","doi-asserted-by":"crossref","first-page":"e141023","DOI":"10.1172\/jci.insight.141023","article-title":"A system-view of Bordetella pertussis booster vaccine responses in adults primed with whole-cell versus acellular vaccine in infancy","volume":"6","author":"R da Silva Antunes","year":"2021","journal-title":"JCI Insight"},{"key":"pcbi.1012927.ref012","doi-asserted-by":"crossref","first-page":"826734","DOI":"10.3389\/fneur.2022.826734","article-title":"A Decentralized ComBat Algorithm and Applications to Functional Network Connectivity","volume":"13","author":"B Bostami","year":"2022","journal-title":"Front Neurol"},{"issue":"1","key":"pcbi.1012927.ref013","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1186\/s12859-018-2263-6","article-title":"Alternative empirical Bayes models for adjusting for batch effects in genomic studies","volume":"19","author":"Y Zhang","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"pcbi.1012927.ref014","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1038\/s41590-022-01329-5","article-title":"Pan-vaccine analysis reveals innate immune endotypes predictive of antibody responses to vaccination","volume":"23","author":"S Fourati","year":"2022","journal-title":"Nature Immunology"},{"key":"pcbi.1012927.ref015","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.it.2020.04.001","article-title":"Improving vaccine-induced immunity: Can baseline predict outcome?","volume":"41","author":"J Tsang","year":"2020","journal-title":"Trends in Immunology"},{"issue":"1","key":"pcbi.1012927.ref016","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1186\/s13059-020-02015-1","article-title":"MOFA+: a statistical framework for comprehensive integration of multi-modal single-cell data","volume":"21","author":"R Argelaguet","year":"2020","journal-title":"Genome Biol"},{"issue":"3","key":"pcbi.1012927.ref017","article-title":"ComBat-seq: batch effect adjustment for RNA-seq count data","volume":"2","author":"Y Zhang","year":"2020","journal-title":"NAR Genom Bioinform"},{"issue":"1","key":"pcbi.1012927.ref018","doi-asserted-by":"crossref","DOI":"10.1093\/bioinformatics\/btaf015","article-title":"nipalsMCIA: flexible multi-block dimensionality reduction in R via nonlinear iterative partial least squares","volume":"41","author":"M Mattessich","year":"2024","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1012927.ref019","first-page":"1","article-title":"The R package JMbayes for fitting joint models for longitudinal and time-to-event data using MCMC","volume":"72","author":"D Rizopoulos","year":"2016","journal-title":"Journal of Statistical Software"},{"issue":"1","key":"pcbi.1012927.ref020","doi-asserted-by":"crossref","first-page":"e8124","DOI":"10.15252\/msb.20178124","article-title":"Multi-Omics Factor Analysis-a framework for unsupervised integration of multi-omics data sets","volume":"14","author":"R Argelaguet","year":"2018","journal-title":"Molecular Systems Biology"},{"issue":"1","key":"pcbi.1012927.ref021","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization Paths for Generalized Linear Models via Coordinate Descent","volume":"33","author":"J Friedman","year":"2010","journal-title":"J Stat Softw"},{"issue":"1","key":"pcbi.1012927.ref022","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1186\/s40537-020-00369-8","article-title":"CatBoost for big data: an interdisciplinary review","volume":"7","author":"JT Hancock","year":"2020","journal-title":"J Big Data"},{"key":"pcbi.1012927.ref023","doi-asserted-by":"crossref","first-page":"31","DOI":"10.17849\/insm-47-01-31-39.1","article-title":"Random forest","volume":"47","author":"SJ Rigatti","year":"2017","journal-title":"Journal of Insurance Medicine"},{"key":"pcbi.1012927.ref024","first-page":"785","article-title":"XGBoost: A Scalable Tree Boosting System. in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"T Chen","year":"2016"},{"issue":"4","key":"pcbi.1012927.ref025","first-page":"403","article-title":"Studies on whooping cough\u00a0: i. type-specific (S) and dissociation (R) forms of hemophilus pertussis","volume":"60","author":"GS Shibley","year":"1934","journal-title":"J Exp Med"},{"issue":"11","key":"pcbi.1012927.ref026","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1056\/NEJMoa1200850","article-title":"Waning protection after fifth dose of acellular pertussis vaccine in children","volume":"367","author":"NP Klein","year":"2012","journal-title":"N Engl J Med"},{"issue":"3","key":"pcbi.1012927.ref027","doi-asserted-by":"crossref","first-page":"e20153326","DOI":"10.1542\/peds.2015-3326","article-title":"Waning Tdap Effectiveness in Adolescents","volume":"137","author":"NP Klein","year":"2016","journal-title":"Pediatrics"},{"issue":"5","key":"pcbi.1012927.ref028","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1001\/jama.2012.6364","article-title":"Number and order of whole cell pertussis vaccines in infancy and disease protection","volume":"308","author":"SL Sheridan","year":"2012","journal-title":"JAMA"},{"issue":"9","key":"pcbi.1012927.ref029","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1093\/cid\/cit046","article-title":"Reduced risk of pertussis among persons ever vaccinated with whole cell pertussis vaccine compared to recipients of acellular pertussis vaccines in a large US cohort","volume":"56","author":"MA Witt","year":"2013","journal-title":"Clin Infect Dis"},{"issue":"4","key":"pcbi.1012927.ref030","doi-asserted-by":"crossref","first-page":"e1004138","DOI":"10.1371\/journal.pcbi.1004138","article-title":"A change in vaccine efficacy and duration of protection explains recent rises in pertussis incidence in the United States","volume":"11","author":"M Gambhir","year":"2015","journal-title":"PLoS Comput Biol"},{"issue":"9","key":"pcbi.1012927.ref031","doi-asserted-by":"crossref","first-page":"3853","DOI":"10.1172\/JCI121309","article-title":"Th1\/Th17 polarization persists following whole-cell pertussis vaccination despite repeated acellular boosters","volume":"128","author":"R da Silva Antunes","year":"2018","journal-title":"J Clin Invest"},{"key":"pcbi.1012927.ref032","doi-asserted-by":"crossref","first-page":"8202067","DOI":"10.1155\/2020\/8202067","article-title":"Development and Validation of a Bordetella pertussis Whole-Genome Screening Strategy","volume":"2020","author":"R da Silva Antunes","year":"2020","journal-title":"J Immunol Res"},{"issue":"1","key":"pcbi.1012927.ref033","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/22221751.2018.1564630","article-title":"Immunization with whole cell but not acellular pertussis vaccines primes CD4 TRM cells that sustain protective immunity against nasal colonization with Bordetella pertussis","volume":"8","author":"MM Wilk","year":"2019","journal-title":"Emerg Microbes Infect"},{"issue":"4","key":"pcbi.1012927.ref034","doi-asserted-by":"crossref","first-page":"e1003264","DOI":"10.1371\/journal.ppat.1003264","article-title":"Relative contribution of Th1 and Th17 cells in adaptive immunity to Bordetella pertussis: towards the rational design of an improved acellular pertussis vaccine","volume":"9","author":"PJ Ross","year":"2013","journal-title":"PLoS Pathog"},{"issue":"2","key":"pcbi.1012927.ref035","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1080\/21645515.2019.1697110","article-title":"Methods for predicting vaccine immunogenicity and reactogenicity","volume":"16","author":"P Gonzalez-Dias","year":"2020","journal-title":"Hum Vaccin Immunother"},{"key":"pcbi.1012927.ref036","doi-asserted-by":"crossref","first-page":"12300","DOI":"10.1073\/pnas.1400476111","article-title":"Systems vaccinology: probing humanity\u2019s diverse immune systems with vaccines","volume":"111","author":"B Pulendran","year":"2014","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"pcbi.1012927.ref037","doi-asserted-by":"crossref","first-page":"e00084-18","DOI":"10.1128\/CMR.00084-18","article-title":"Factors That Influence the Immune Response to Vaccination","volume":"32","author":"P Zimmermann","year":"2019","journal-title":"Clin Microbiol Rev"},{"issue":"6","key":"pcbi.1012927.ref038","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1038\/ni.2039","article-title":"Immunological mechanisms of vaccination","volume":"12","author":"B Pulendran","year":"2011","journal-title":"Nat Immunol"},{"issue":"1","key":"pcbi.1012927.ref039","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1084\/jem.20081571","article-title":"The induction of antibody production by IL-6 is indirectly mediated by IL-21 produced by CD4+ T cells","volume":"206","author":"O Dienz","year":"2009","journal-title":"J Exp Med"},{"issue":"1","key":"pcbi.1012927.ref040","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1038\/mi.2017.41","article-title":"IFN-\u03b3 increases susceptibility to influenza A infection through suppression of group II innate lymphoid cells","volume":"11","author":"D Califano","year":"2018","journal-title":"Mucosal Immunol"},{"issue":"3","key":"pcbi.1012927.ref041","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1038\/mi.2012.2","article-title":"Essential role of IL-6 in protection against H1N1 influenza virus by promoting neutrophil survival in the lung","volume":"5","author":"O Dienz","year":"2012","journal-title":"Mucosal Immunol"},{"issue":"1","key":"pcbi.1012927.ref042","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1093\/bioinformatics\/bts635","article-title":"STAR: ultrafast universal RNA-seq aligner","volume":"29","author":"A Dobin","year":"2013","journal-title":"Bioinformatics"},{"issue":"6","key":"pcbi.1012927.ref043","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1093\/bioinformatics\/btr026","article-title":"Quality control and preprocessing of metagenomic datasets","volume":"27","author":"R Schmieder","year":"2011","journal-title":"Bioinformatics"},{"key":"pcbi.1012927.ref044","doi-asserted-by":"crossref","first-page":"2078","DOI":"10.1093\/bioinformatics\/btp352","article-title":"The sequence alignment\/map format and SAMtools","volume":"25","author":"H Li","year":"2009","journal-title":"Bioinformatics"},{"issue":"22","key":"pcbi.1012927.ref045","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1093\/bioinformatics\/btt656","article-title":"featureCounts: an efficient general purpose program for assigning sequence reads to genomic features","volume":"30","author":"Y Liao","year":"2014","journal-title":"Bioinformatics"},{"key":"pcbi.1012927.ref046","article-title":"Th1 polarization in Bordetella pertussis vaccine responses is maintained through a positive feedback loop","author":"L Willemsen","year":"2024","journal-title":"bioRxiv"},{"issue":"1","key":"pcbi.1012927.ref047","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1186\/s12874-023-02008-1","article-title":"Sample size requirements are not being considered in studies developing prediction models for binary outcomes: a systematic review","volume":"23","author":"P Dhiman","year":"2023","journal-title":"BMC Med Res Methodol"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012927","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T00:00:00Z","timestamp":1744070400000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012927","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T18:44:34Z","timestamp":1744137874000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012927"}},"subtitle":[],"editor":[{"given":"Jessica M.","family":"Conway","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2025,3,31]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3,31]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012927","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1012927","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,31]]}}}