{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T12:49:35Z","timestamp":1790426975711,"version":"4.1.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1008873","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,9,8]],"date-time":"2021-09-08T00:00:00Z","timestamp":1631059200000}}],"reference-count":46,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2021,8,26]],"date-time":"2021-08-26T00:00:00Z","timestamp":1629936000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"horizon 2020 framework programme","doi-asserted-by":"publisher","award":["634650 Virogenesis project"],"award-info":[{"award-number":["634650 Virogenesis project"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"agence nationale de la recherche","doi-asserted-by":"publisher","award":["ANR-19-P3IA-0001, PIA3 programme, PRAIRIE project"],"award-info":[{"award-number":["ANR-19-P3IA-0001, PIA3 programme, PRAIRIE project"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"UK Medical Research Council","doi-asserted-by":"crossref","award":["164587"],"award-info":[{"award-number":["164587"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"crossref"}]},{"name":"European Research Council","award":["757688"],"award-info":[{"award-number":["757688"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Drug resistance mutations (DRMs) appear in HIV under treatment pressure. DRMs are commonly transmitted to naive patients. The standard approach to reveal new DRMs is to test for significant frequency differences of mutations between treated and naive patients. However, we then consider each mutation individually and cannot hope to study interactions between several mutations. Here, we aim to leverage the ever-growing quantity of high-quality sequence data and machine learning methods to study such interactions (i.e. epistasis), as well as try to find new DRMs.<\/jats:p>\n                  <jats:p>\n                    We trained classifiers to discriminate between Reverse Transcriptase Inhibitor (RTI)-experienced and RTI-naive samples on a large HIV-1 reverse transcriptase (RT) sequence dataset from the UK (\n                    <jats:italic>n<\/jats:italic>\n                    \u2248 55, 000), using all observed mutations as binary representation features. To assess the robustness of our findings, our classifiers were evaluated on independent data sets, both from the UK and Africa. Important representation features for each classifier were then extracted as potential DRMs. To find novel DRMs, we repeated this process by removing either features or samples associated to known DRMs.\n                  <\/jats:p>\n                  <jats:p>When keeping all known resistance signal, we detected sufficiently prevalent known DRMs, thus validating the approach. When removing features corresponding to known DRMs, our classifiers retained some prediction accuracy, and six new mutations significantly associated with resistance were identified. These six mutations have a low genetic barrier, are correlated to known DRMs, and are spatially close to either the RT active site or the regulatory binding pocket. When removing both known DRM features and sequences containing at least one known DRM, our classifiers lose all prediction accuracy. These results likely indicate that all mutations directly conferring resistance have been found, and that our newly discovered DRMs are accessory or compensatory mutations. Moreover, apart from the accessory nature of the relationships we found, we did not find any significant signal of further, more subtle epistasis combining several mutations which individually do not seem to confer any resistance.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008873","type":"journal-article","created":{"date-parts":[[2021,9,8]],"date-time":"2021-09-08T13:36:20Z","timestamp":1631108180000},"page":"e1008873","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":30,"title":["Using machine learning and big data to explore the drug resistance landscape in HIV"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6598-7673","authenticated-orcid":true,"given":"Luc","family":"Blassel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Tostevin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9928-3968","authenticated-orcid":true,"given":"Christian Julian","family":"Villabona-Arenas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martine","family":"Peeters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8580-6905","authenticated-orcid":true,"given":"St\u00e9phane","family":"Hu\u00e9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9412-9723","authenticated-orcid":true,"given":"Olivier","family":"Gascuel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"On behalf of the UK HIV Drug Resistance Database","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,8,26]]},"reference":[{"issue":"3","key":"pcbi.1008873.ref001","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1086\/315301","article-title":"Resistance Profiles in Patients with Viral Rebound on Potent Antiretroviral Therapy","volume":"181","author":"AC Lepri","year":"2000","journal-title":"The Journal of Infectious Diseases"},{"issue":"9","key":"pcbi.1008873.ref002","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1002\/jmv.20950","article-title":"Detection of Drug Resistance Mutations as a Predictor of Subsequent Virological Failure in Patients with HIV-1 Viral Rebounds of Less than 1,000 RNA Copies\/Ml","volume":"79","author":"C Verhofstede","year":"2007","journal-title":"Journal of Medical Virology"},{"issue":"6","key":"pcbi.1008873.ref003","doi-asserted-by":"crossref","first-page":"2645","DOI":"10.1128\/JVI.01556-08","article-title":"Demonstration of Sustained Drug-Resistant Human Immunodeficiency Virus Type 1 Lineages Circulating among Treatment-Na\u00efve Individuals","volume":"83","author":"S Hu\u00e9","year":"2009","journal-title":"Journal of Virology"},{"issue":"15","key":"pcbi.1008873.ref004","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.1097\/QAD.0000000000000768","article-title":"A Phylotype-Based Analysis Highlights the Role of Drug-Naive HIV-Positive Individuals in the Transmission of Antiretroviral Resistance in the UK","volume":"29","author":"R Mourad","year":"2015","journal-title":"Aids"},{"issue":"suppl_9","key":"pcbi.1008873.ref005","doi-asserted-by":"crossref","first-page":"S820","DOI":"10.1093\/infdis\/jix411","article-title":"The Role of Phylogenetics as a Tool to Predict the Spread of Resistance","volume":"216","author":"A Zhukova","year":"2017","journal-title":"The Journal of Infectious Diseases"},{"issue":"3","key":"pcbi.1008873.ref006","doi-asserted-by":"crossref","first-page":"e4724","DOI":"10.1371\/journal.pone.0004724","article-title":"Drug Resistance Mutations for Surveillance of Transmitted HIV-1 Drug-Resistance: 2009 Update","volume":"4","author":"DE Bennett","year":"2009","journal-title":"PLOS ONE"},{"key":"pcbi.1008873.ref007","first-page":"11136","article-title":"Mutations in Retroviral Genes Associated with Drug Resistance","author":"J Hammond","year":"1998","journal-title":"Human retroviruses and AIDS"},{"issue":"4, 4","key":"pcbi.1008873.ref008","first-page":"132","article-title":"2017 Update of the Drug Resistance Mutations in HIV-1., 2017 Update of the Drug Resistance Mutations in HIV-1","volume":"24","author":"AM Wensing","year":"2016","journal-title":"Topics in antiviral medicine, Topics in Antiviral Medicine"},{"key":"pcbi.1008873.ref009","article-title":"Multiple Testing Procedures with Applications to Genomics","author":"S Dudoit","year":"2007","journal-title":"Springer Science & Business Media"},{"issue":"17","key":"pcbi.1008873.ref010","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1097\/QAD.0000000000001233","article-title":"In-Depth Analysis of HIV-1 Drug Resistance Mutations in HIV-Infected Individuals Failing First-Line Regimens in West and Central Africa","volume":"30","author":"CJ Villabona-Arenas","year":"2016","journal-title":"AIDS"},{"issue":"1","key":"pcbi.1008873.ref011","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1093\/sysbio\/syu070","article-title":"The Unsolved Challenge to Phylogenetic Correlation Tests for Categorical Characters","volume":"64","author":"WP Maddison","year":"2015","journal-title":"Systematic Biology"},{"issue":"5","key":"pcbi.1008873.ref012","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1038\/nrg3706","article-title":"Statistical Power and Significance Testing in Large-Scale Genetic Studies","volume":"15","author":"PC Sham","year":"2014","journal-title":"Nature Reviews Genetics"},{"issue":"10","key":"pcbi.1008873.ref013","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1038\/nrmicro1477","article-title":"Bioinformatics-Assisted Anti-HIV Therapy","volume":"4","author":"T Lengauer","year":"2006","journal-title":"Nature Reviews Microbiology"},{"issue":"4","key":"pcbi.1008873.ref014","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1097\/01.qai.0000147526.64863.53","article-title":"Comparison of the Precision and Sensitivity of the Antivirogram and PhenoSense HIV Drug Susceptibility Assays","volume":"38","author":"J Zhang","year":"2005","journal-title":"JAIDS Journal of Acquired Immune Deficiency Syndromes"},{"issue":"13","key":"pcbi.1008873.ref015","doi-asserted-by":"crossref","first-page":"3850","DOI":"10.1093\/nar\/gkg575","article-title":"Geno2pheno: Estimating Phenotypic Drug Resistance from HIV-1 Genotypes","volume":"31","author":"N Beerenwinkel","year":"2003","journal-title":"Nucleic Acids Research"},{"issue":"8","key":"pcbi.1008873.ref016","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1186\/s12859-016-1114-6","article-title":"Automated Prediction of HIV Drug Resistance from Genotype Data","volume":"17","author":"C Shen","year":"2016","journal-title":"BMC Bioinformatics"},{"issue":"5","key":"pcbi.1008873.ref017","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1186\/1471-2164-15-S5-S1","article-title":"Prediction of HIV Drug Resistance from Genotype with Encoded Three-Dimensional Protein Structure","volume":"15","author":"X Yu","year":"2014","journal-title":"BMC Genomics"},{"issue":"1","key":"pcbi.1008873.ref018","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1186\/s12859-017-1782-x","article-title":"Improving Fold Resistance Prediction of HIV-1 against Protease and Reverse Transcriptase Inhibitors Using Artificial Neural Networks","volume":"18","author":"O Sheik Amamuddy","year":"2017","journal-title":"BMC Bioinformatics"},{"issue":"6","key":"pcbi.1008873.ref019","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/5254.972080","article-title":"Geno2pheno: Interpreting Genotypic HIV Drug Resistance Tests","volume":"16","author":"N Beerenwinkel","year":"2001","journal-title":"IEEE Intelligent Systems"},{"issue":"1","key":"pcbi.1008873.ref020","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1080\/00359190909519238","article-title":"Support Vector Machine Prediction of HIV-1 Drug Resistance Using the Viral Nucleotide Patterns","volume":"64","author":"ST Araya","year":"2009","journal-title":"Transactions of the Royal Society of South Africa"},{"issue":"1","key":"pcbi.1008873.ref021","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s13040-016-0089-1","article-title":"Exploiting HIV-1 Protease and Reverse Transcriptase Cross-Resistance Information for Improved Drug Resistance Prediction by Means of Multi-Label Classification","volume":"9","author":"M Riemenschneider","year":"2016","journal-title":"BioData Mining"},{"issue":"16","key":"pcbi.1008873.ref022","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1093\/bioinformatics\/btt331","article-title":"Multilabel Classification for Exploiting Cross-Resistance Information in HIV-1 Drug Resistance Prediction","volume":"29","author":"D Heider","year":"2013","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1008873.ref023","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1093\/bioinformatics\/19.1.98","article-title":"Predicting HIV Drug Resistance with Neural Networks","volume":"19","author":"S Dr\u0103ghici","year":"2003","journal-title":"Bioinformatics"},{"issue":"5","key":"pcbi.1008873.ref024","doi-asserted-by":"crossref","first-page":"560","DOI":"10.3390\/v12050560","article-title":"Drug Resistance Prediction Using Deep Learning Techniques on HIV-1 Sequence Data","volume":"12","author":"MC Steiner","year":"2020","journal-title":"Viruses"},{"issue":"7","key":"pcbi.1008873.ref025","doi-asserted-by":"crossref","first-page":"2368","DOI":"10.1007\/s10461-018-2155-9","article-title":"Beyond Social Desirability Bias: Investigating Inconsistencies in Self-Reported HIV Testing and Treatment Behaviors Among HIV-Positive Adults in North West Province, South Africa","volume":"22","author":"AC Mooney","year":"2018","journal-title":"AIDS and Behavior"},{"issue":"1","key":"pcbi.1008873.ref026","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression Shrinkage and Selection Via the Lasso","volume":"58","author":"R Tibshirani","year":"1996","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"issue":"1","key":"pcbi.1008873.ref027","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","article-title":"Verification of Forecasts Expressed in Terms of Probability","volume":"78","author":"GW Brier","year":"1950","journal-title":"Monthly Weather Review"},{"issue":"05","key":"pcbi.1008873.ref028","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1142\/S0218001498000336","article-title":"Twelve Numerical, Symbolic and Hybrid Supervised Classification Methods","volume":"12","author":"O Gascuel","year":"1998","journal-title":"International Journal of Pattern Recognition and Artificial Intelligence"},{"issue":"11","key":"pcbi.1008873.ref029","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1002\/sim.6082","article-title":"Multiple Hypothesis Testing in Genomics","volume":"33","author":"JJ Goeman","year":"2014","journal-title":"Statistics in Medicine"},{"key":"pcbi.1008873.ref030","unstructured":"Rennie JD, Shih L, Teevan J, Karger DR. Tackling the Poor Assumptions of Naive Bayes Text Classifiers. In: Proceedings of the 20th International Conference on Machine Learning (ICML-03); 2003. p. 616\u2013623."},{"issue":"1","key":"pcbi.1008873.ref031","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"L Breiman","year":"2001","journal-title":"Machine Learning"},{"key":"pcbi.1008873.ref032","first-page":"7775","volume-title":"Advances in Neural Information Processing Systems","author":"D Alvarez Melis","year":"2018"},{"key":"pcbi.1008873.ref033","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"T Hastie","year":"2009","edition":"2"},{"key":"pcbi.1008873.ref034","doi-asserted-by":"crossref","unstructured":"Zhang Q, Wu YN, Zhu SC. Interpretable Convolutional Neural Networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2018. p. 8827\u20138836.","DOI":"10.1109\/CVPR.2018.00920"},{"key":"pcbi.1008873.ref035","doi-asserted-by":"crossref","unstructured":"Brodersen KH, Ong CS, Stephan KE, Buhmann JM. The Balanced Accuracy and Its Posterior Distribution. In: 2010 20th International Conference on Pattern Recognition; 2010. p. 3121\u20133124.","DOI":"10.1109\/ICPR.2010.764"},{"key":"pcbi.1008873.ref036","first-page":"18","article-title":"Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance","volume":"11","author":"NX Vinh","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"pcbi.1008873.ref037","unstructured":"Schr\u00f6dinger, LLC. The PyMOL Molecular Graphics System, Version 1.8; 2015."},{"issue":"3","key":"pcbi.1008873.ref038","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1016\/j.jmb.2008.10.071","article-title":"Structure and Function of HIV-1 Reverse Transcriptase: Molecular Mechanisms of Polymerization and Inhibition","volume":"385","author":"SG Sarafianos","year":"2009","journal-title":"Journal of molecular biology"},{"issue":"5","key":"pcbi.1008873.ref039","doi-asserted-by":"crossref","first-page":"e87","DOI":"10.1371\/journal.pcbi.0030087","article-title":"HIV-1 Subtype B Protease and Reverse Transcriptase Amino Acid Covariation","volume":"3","author":"SY Rhee","year":"2007","journal-title":"PLOS Computational Biology"},{"issue":"11","key":"pcbi.1008873.ref040","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1086\/522231","article-title":"Improved Interpretation of Genotypic Changes in the HIV-1 Reverse Transcriptase Coding Region That Determine the Virological Response to Didanosine","volume":"196","author":"A De Luca","year":"2007","journal-title":"The Journal of Infectious Diseases"},{"key":"pcbi.1008873.ref041","first-page":"8","article-title":"Impact of HIV-1 Reverse Transcriptase Polymorphism at Codons 211 and 228 on Virological Response to Didanosine","author":"AG Marcelin","year":"2006","journal-title":"Antiviral Therapy"},{"issue":"22","key":"pcbi.1008873.ref042","doi-asserted-by":"crossref","first-page":"10269","DOI":"10.1128\/JVI.74.22.10269-10273.2000","article-title":"Reduced Susceptibility of Human Immunodeficiency Virus Type 1 (HIV-1) from Patients with Primary HIV Infection to Nonnucleoside Reverse Transcriptase Inhibitors Is Associated with Variation at Novel Amino Acid Sites","volume":"74","author":"AJL Brown","year":"2000","journal-title":"Journal of Virology"},{"issue":"7","key":"pcbi.1008873.ref043","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1097\/01.aids.0000222069.14878.44","article-title":"Reverse Transcriptase Mutations 118I, 208Y, and 215Y Cause HIV-1 Hypersusceptibility to Non-Nucleoside Reverse Transcriptase Inhibitors","volume":"20","author":"SA Clark","year":"2006","journal-title":"AIDS"},{"issue":"5","key":"pcbi.1008873.ref044","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1093\/jac\/dkm067","article-title":"Emergence of the H208Y Mutation in the Reverse Transcriptase (RT) of HIV-1 in Association with Nucleoside RT Inhibitor Therapy","volume":"59","author":"G Nebbia","year":"2007","journal-title":"Journal of Antimicrobial Chemotherapy"},{"issue":"1","key":"pcbi.1008873.ref045","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1002\/jmv.20500","article-title":"Impact of Unreported HIV-1 Reverse Transcriptase Mutations on Phenotypic Resistance to Nucleoside and Non-Nucleoside Inhibitors","volume":"78","author":"A Saracino","year":"2006","journal-title":"Journal of Medical Virology"},{"issue":"6","key":"pcbi.1008873.ref046","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1093\/bioinformatics\/btp041","article-title":"Genome-Wide Association Analysis by Lasso Penalized Logistic Regression","volume":"25","author":"TT Wu","year":"2009","journal-title":"Bioinformatics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1008873","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,9,8]],"date-time":"2021-09-08T00:00:00Z","timestamp":1631059200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008873","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T21:42:42Z","timestamp":1725745362000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008873"}},"subtitle":[],"editor":[{"given":"Alison L.","family":"Hill","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,8,26]]},"references-count":46,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8,26]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008873","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.03.15.435398","asserted-by":"object"},{"id-type":"doi","id":"10.1101\/2021.03.16.435621","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,26]]}}}