{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T21:46:05Z","timestamp":1790718365416,"version":"4.1.0"},"reference-count":53,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T00:00:00Z","timestamp":1725580800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["UM1AI068635"],"award-info":[{"award-number":["UM1AI068635"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"U.S. National Library of Medicine","doi-asserted-by":"publisher","award":["R25LM014210"],"award-info":[{"award-number":["R25LM014210"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Combination monoclonal broadly neutralizing antibodies (bnAbs) are currently being developed for preventing HIV-1 acquisition. Recent work has focused on predicting in vitro neutralization potency of both individual bnAbs and combination regimens against HIV-1 pseudoviruses using Env sequence features. To predict in vitro combination regimen neutralization potency against a given HIV-1 pseudovirus, previous approaches have applied mathematical models to combine individual-bnAb neutralization and have predicted this combined neutralization value; we call this the combine-then-predict (CP) approach. However, prediction performance for some individual bnAbs has exceeded that for the combination, leading to another possibility: combining the individual-bnAb predicted values and using these to predict combination regimen neutralization; we call this the predict-then-combine (PC) approach. We explore both approaches in both simulated data and data from the Los Alamos National Laboratory\u2019s Compile, Neutralize, and Tally NAb Panels repository. The CP approach is superior to the PC approach when the neutralization outcome of interest is binary (e.g., neutralization susceptibility, defined as inhibitory 80% concentration &lt; 1 \u03bcg\/mL). For continuous outcomes, the CP approach performs nearly as well as the PC approach when the individual-bnAb prediction algorithms have strong performance, and is superior to the PC approach when the individual-bnAb prediction algorithms have poor performance. This knowledge may be used when building prediction models for novel antibody combinations in the absence of in vitro neutralization data for the antibody combination; this, in turn, will aid in the evaluation and down-selection of these antibody combinations into prevention efficacy trials.<\/jats:p>","DOI":"10.1371\/journal.pone.0310042","type":"journal-article","created":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T13:54:09Z","timestamp":1725630849000},"page":"e0310042","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Predicting neutralization susceptibility to combination HIV-1 monoclonal broadly neutralizing antibody regimens"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7024-548X","authenticated-orcid":true,"given":"Brian D.","family":"Williamson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liana","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunda","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron","family":"Hudson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter B.","family":"Gilbert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,9,6]]},"reference":[{"issue":"3","key":"pone.0310042.ref001","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1093\/infdis\/jiaa377","article-title":"Clinical trials of broadly neutralizing monoclonal antibodies for human immunodeficiency virus prevention: a review","volume":"223","author":"S Mahomed","year":"2021","journal-title":"The Journal of Infectious Diseases"},{"key":"pone.0310042.ref002","first-page":"101475","volume-title":"Seminars in Immunology","author":"B Julg","year":"2021"},{"key":"pone.0310042.ref003","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1146\/annurev-med-110118-045506","article-title":"Broadly neutralizing antibodies for HIV prevention","volume":"71","author":"ST Karuna","year":"2020","journal-title":"Annual Review of Medicine"},{"key":"pone.0310042.ref004","doi-asserted-by":"crossref","first-page":"712122","DOI":"10.3389\/fimmu.2021.712122","article-title":"Broadly neutralizing antibodies for HIV-1 prevention","volume":"12","author":"SR Walsh","year":"2021","journal-title":"Frontiers in Immunology"},{"issue":"11","key":"pone.0310042.ref005","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1056\/NEJMoa2031738","article-title":"Two randomized trials of neutralizing antibodies to prevent HIV-1 acquisition","volume":"384","author":"L Corey","year":"2021","journal-title":"New England Journal of Medicine"},{"issue":"3","key":"pone.0310042.ref006","doi-asserted-by":"crossref","first-page":"e1005520","DOI":"10.1371\/journal.ppat.1005520","article-title":"Optimal combinations of broadly neutralizing antibodies for prevention and treatment of HIV-1 clade C infection","volume":"12","author":"K Wagh","year":"2016","journal-title":"PLoS Pathogens"},{"issue":"6","key":"pone.0310042.ref007","doi-asserted-by":"crossref","first-page":"3393","DOI":"10.1128\/JVI.06745-11","article-title":"HIV-1 neutralization coverage is improved by combining monoclonal antibodies that target independent epitopes","volume":"86","author":"NA Doria-Rose","year":"2012","journal-title":"Journal of Virology"},{"issue":"6","key":"pone.0310042.ref008","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1084\/jem.20130221","article-title":"Restricting HIV-1 pathways for escape using rationally designed anti-HIV-1 antibodies","volume":"210","author":"R Diskin","year":"2013","journal-title":"Journal of Experimental Medicine"},{"issue":"9","key":"pone.0310042.ref009","doi-asserted-by":"crossref","first-page":"e1003842","DOI":"10.1371\/journal.pcbi.1003842","article-title":"IDEPI: rapid prediction of HIV-1 antibody epitopes and other phenotypic features from sequence data using a flexible machine learning platform","volume":"10","author":"NL Hepler","year":"2014","journal-title":"PLoS Computational Biology"},{"issue":"10","key":"pone.0310042.ref010","doi-asserted-by":"crossref","first-page":"1710","DOI":"10.3390\/ijms17101710","article-title":"Learning the relationship between the primary structure of HIV envelope glycoproteins and neutralization activity of particular antibodies by using artificial neural networks","volume":"17","author":"C Buiu","year":"2016","journal-title":"International Journal of Molecular Sciences"},{"issue":"10","key":"pone.0310042.ref011","doi-asserted-by":"crossref","first-page":"e1005789","DOI":"10.1371\/journal.pcbi.1005789","article-title":"Prediction of HIV-1 sensitivity to broadly neutralizing antibodies shows a trend towards resistance over time","volume":"13","author":"A Hake","year":"2017","journal-title":"PLoS Computational Biology"},{"issue":"1","key":"pone.0310042.ref012","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.chom.2018.12.001","article-title":"HIV-1 neutralizing antibody signatures and application to epitope-targeted vaccine design","volume":"25","author":"CA Bricault","year":"2019","journal-title":"Cell Host & Microbe"},{"issue":"1","key":"pone.0310042.ref013","doi-asserted-by":"crossref","first-page":"14696","DOI":"10.1038\/s41598-019-50635-w","article-title":"Accurate prediction for antibody resistance of clinical HIV-1 isolates","volume":"9","author":"R Rawi","year":"2019","journal-title":"Scientific Reports"},{"issue":"4","key":"pone.0310042.ref014","doi-asserted-by":"crossref","first-page":"e1006954","DOI":"10.1371\/journal.pcbi.1006954","article-title":"Estimation of the breadth of CD4bs targeting HIV antibodies by molecular modeling and machine learning","volume":"15","author":"S Conti","year":"2019","journal-title":"PLoS Computational Biology"},{"issue":"17","key":"pone.0310042.ref015","article-title":"Predicting the broadly neutralizing antibody susceptibility of the HIV reservoir","volume":"4","author":"WH Yu","year":"2019","journal-title":"JCI Insight"},{"issue":"4","key":"pone.0310042.ref016","doi-asserted-by":"crossref","first-page":"e1006952","DOI":"10.1371\/journal.pcbi.1006952","article-title":"Prediction of VRC01 neutralization sensitivity by HIV-1 gp160 sequence features","volume":"15","author":"C Magaret","year":"2019","journal-title":"PLoS Computational Biology"},{"issue":"18","key":"pone.0310042.ref017","doi-asserted-by":"crossref","first-page":"4278","DOI":"10.1093\/bioinformatics\/btac530","article-title":"Prediction of HIV sensitivity to monoclonal antibodies using aminoacid sequences and deep learning","volume":"38","author":"VR D\u0103n\u0103il\u0103","year":"2022","journal-title":"Bioinformatics"},{"issue":"22","key":"pone.0310042.ref018","doi-asserted-by":"crossref","first-page":"4187","DOI":"10.1093\/bioinformatics\/btab398","article-title":"Super LeArner Prediction of NAb Panels (SLAPNAP): a containerized tool for predicting combination monoclonal broadly neutralizing antibody sensitivity","volume":"37","author":"BD Williamson","year":"2021","journal-title":"Bioinformatics"},{"issue":"W1","key":"pone.0310042.ref019","doi-asserted-by":"crossref","first-page":"W213","DOI":"10.1093\/nar\/gkv404","article-title":"CATNAP: a tool to compile, analyze, and tally neutralizing antibody panels","volume":"43","author":"H Yoon","year":"2015","journal-title":"Nucleic Acids Research"},{"issue":"3","key":"pone.0310042.ref020","doi-asserted-by":"crossref","first-page":"e1006860","DOI":"10.1371\/journal.ppat.1006860","article-title":"Potential of conventional & bispecific broadly neutralizing antibodies for prevention of HIV-1 subtype A, C & D infections","volume":"14","author":"K Wagh","year":"2018","journal-title":"PLoS Pathogens"},{"issue":"9","key":"pone.0310042.ref021","doi-asserted-by":"crossref","DOI":"10.1016\/j.isci.2023.107595","article-title":"Application of the SLAPNAP statistical learning tool to broadly neutralizing antibody HIV prevention research","volume":"26","author":"BD Williamson","year":"2023","journal-title":"iScience"},{"issue":"9","key":"pone.0310042.ref022","doi-asserted-by":"crossref","first-page":"1924","DOI":"10.1038\/s41591-022-01953-6","article-title":"Neutralization titer biomarker for antibody-mediated prevention of HIV-1 acquisition","volume":"28","author":"PB Gilbert","year":"2022","journal-title":"Nature Medicine"},{"key":"pone.0310042.ref023","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","author":"R Tibshirani","year":"1996","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"pone.0310042.ref024","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"L Breiman","year":"2001","journal-title":"Machine Learning"},{"issue":"3","key":"pone.0310042.ref025","first-page":"61","article-title":"Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods","volume":"10","author":"J Platt","year":"1999","journal-title":"Advances in Large Margin Classifiers"},{"key":"pone.0310042.ref026","doi-asserted-by":"crossref","unstructured":"Barron A. Statistical properties of artificial neural networks. In: Proceedings of the 28th IEEE Conference on Decision and Control. IEEE; 1989. p. 280\u2013285.","DOI":"10.1109\/CDC.1989.70117"},{"issue":"3","key":"pone.0310042.ref027","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: The two cultures","volume":"16","author":"L Breiman","year":"2001","journal-title":"Statistical Science"},{"issue":"1","key":"pone.0310042.ref028","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1309","article-title":"Super Learner","volume":"6","author":"M van der Laan","year":"2007","journal-title":"Statistical Applications in Genetics and Molecular Biology"},{"issue":"4","key":"pone.0310042.ref029","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1093\/comjnl\/14.4.422","article-title":"An algorithm with guaranteed convergence for finding a zero of a function","volume":"14","author":"RP Brent","year":"1971","journal-title":"The Computer Journal"},{"key":"pone.0310042.ref030","article-title":"A general framework for inference on algorithm-agnostic variable importance","author":"B Williamson","year":"2021","journal-title":"Journal of the American Statistical Association (Theory & Methods)"},{"key":"pone.0310042.ref031","article-title":"Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates","author":"E LeDell","year":"2015","journal-title":"Electronic Journal of Statistics"},{"issue":"239","key":"pone.0310042.ref032","first-page":"2","article-title":"Docker: lightweight linux containers for consistent development and deployment","volume":"2014","author":"D Merkel","year":"2014","journal-title":"Linux Journal"},{"key":"pone.0310042.ref033","unstructured":"R Core Team. R: A Language and Environment for Statistical Computing; 2024. Available from: https:\/\/www.R-project.org\/."},{"key":"pone.0310042.ref034","unstructured":"M\u00fcller K. here: A Simpler Way to Find Your Files; 2020. Available from: https:\/\/CRAN.R-project.org\/package=here."},{"key":"pone.0310042.ref035","unstructured":"Wickham H, Hester J, Bryan J. readr: Read Rectangular Text Data; 2024. Available from: https:\/\/CRAN.R-project.org\/package=readr."},{"key":"pone.0310042.ref036","unstructured":"Firke S. janitor: Simple Tools for Examining and Cleaning Dirty Data; 2023. Available from: https:\/\/CRAN.R-project.org\/package=janitor."},{"issue":"1","key":"pone.0310042.ref037","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization Paths for Generalized Linear Models via Coordinate Descent","volume":"33","author":"J Friedman","year":"2010","journal-title":"Journal of Statistical Software"},{"issue":"1","key":"pone.0310042.ref038","first-page":"1","article-title":"Elastic Net Regularization Paths for All Generalized Linear Models","volume":"106","author":"JK Tay","year":"2023","journal-title":"Journal of Statistical Software"},{"key":"pone.0310042.ref039","unstructured":"Barrett T, Dowle M, Srinivasan A, Gorecki J, Chirico M, Hocking T. data.table: Extension of \u2018data.frame\u2019; 2024. Available from: https:\/\/CRAN.R-project.org\/package=data.table."},{"key":"pone.0310042.ref040","unstructured":"Wickham H, Fran\u00e7ois R, Henry L, M\u00fcller K, Vaughan D. dplyr: A Grammar of Data Manipulation; 2023. Available from: https:\/\/CRAN.R-project.org\/package=dplyr."},{"key":"pone.0310042.ref041","unstructured":"Wickham H, Vaughan D, Girlich M. tidyr: Tidy Messy Data; 2024. Available from: https:\/\/CRAN.R-project.org\/package=tidyr."},{"key":"pone.0310042.ref042","unstructured":"Microsoft, Weston S. foreach: Provides Foreach Looping Construct; 2022. Available from: https:\/\/CRAN.R-project.org\/package=foreach."},{"key":"pone.0310042.ref043","unstructured":"Corporation M, Weston S. doParallel: Foreach Parallel Adaptor for the \u2018parallel\u2019 Package; 2022. Available from: https:\/\/CRAN.R-project.org\/package=doParallel."},{"key":"pone.0310042.ref044","unstructured":"LeDell E, Petersen M, van der Laan M. cvAUC: Cross-Validated Area Under the ROC Curve Confidence Intervals; 2022. Available from: https:\/\/CRAN.R-project.org\/package=cvAUC."},{"key":"pone.0310042.ref045","unstructured":"Williamson BD. vimp: Perform Inference on Algorithm-Agnostic Variable Importance; 2023. Available from: https:\/\/CRAN.R-project.org\/package=vimp."},{"key":"pone.0310042.ref046","doi-asserted-by":"crossref","unstructured":"Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York; 2016. Available from: https:\/\/ggplot2.tidyverse.org.","DOI":"10.1007\/978-3-319-24277-4_9"},{"key":"pone.0310042.ref047","unstructured":"Wilke CO. cowplot: Streamlined Plot Theme and Plot Annotations for \u2018ggplot2\u2019; 2024. Available from: https:\/\/CRAN.R-project.org\/package=cowplot."},{"key":"pone.0310042.ref048","unstructured":"Auguie B. gridExtra: Miscellaneous Functions for \u201cGrid\u201d Graphics; 2017. Available from: https:\/\/CRAN.R-project.org\/package=gridExtra."},{"issue":"2","key":"pone.0310042.ref049","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1093\/biostatistics\/kxw043","article-title":"Statistical methods for down-selection of treatment regimens based on multiple endpoints, with application to HIV vaccine trials","volume":"18","author":"Y Huang","year":"2017","journal-title":"Biostatistics"},{"issue":"29","key":"pone.0310042.ref050","doi-asserted-by":"crossref","first-page":"4374","DOI":"10.1002\/sim.7927","article-title":"Reliably picking the best endpoint","volume":"37","author":"D Follmann","year":"2018","journal-title":"Statistics in Medicine"},{"issue":"692","key":"pone.0310042.ref051","doi-asserted-by":"crossref","first-page":"eade9078","DOI":"10.1126\/scitranslmed.ade9078","article-title":"Comparing antibody assays as correlates of protection against COVID-19 in the COVE mRNA-1273 vaccine efficacy trial","volume":"15","author":"D Benkeser","year":"2023","journal-title":"Science Translational Medicine"},{"issue":"7","key":"pone.0310042.ref052","doi-asserted-by":"crossref","first-page":"1783","DOI":"10.1016\/j.cell.2018.03.061","article-title":"Identification of near-pan-neutralizing antibodies against HIV-1 by deconvolution of plasma humoral responses","volume":"173","author":"MM Sajadi","year":"2018","journal-title":"Cell"},{"issue":"2","key":"pone.0310042.ref053","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"D Wolpert","year":"1992","journal-title":"Neural Networks"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0310042","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T16:28:19Z","timestamp":1732724899000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0310042"}},"subtitle":[],"editor":[{"given":"Roland","family":"Zahn","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,9,6]]},"references-count":53,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9,6]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0310042","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.12.14.571616","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,6]]}}}