{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T00:06:14Z","timestamp":1784333174074,"version":"3.55.0"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["R01AI141810"],"award-info":[{"award-number":["R01AI141810"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2013998"],"award-info":[{"award-number":["2013998"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000199","name":"United States Department of Agriculture","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000199","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute of Food and Agriculture, Agriculture and Food Research Initiative","award":["2019-67017-29110"],"award-info":[{"award-number":["2019-67017-29110"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,3,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Antimicrobial resistance (AMR) is a growing threat to public health and farming at large. In clinical and veterinary practice, timely characterization of the antibiotic susceptibility profile of bacterial infections is a crucial step in optimizing treatment. High-throughput sequencing is a promising option for clinical point-of-care and ecological surveillance, opening the opportunity to develop genotyping-based AMR determination as a possibly faster alternative to phenotypic testing. In the present work, we compare the performance of state-of-the-art methods for detection of AMR using high-throughput sequencing data from clinical settings. We consider five computational approaches based on alignment (AMRPlusPlus), deep learning (DeepARG), k-mer genomic signatures (KARGA, ResFinder) or hidden Markov models (Meta-MARC). We use an extensive collection of 585 isolates with available AMR resistance profiles determined by phenotypic tests across nine antibiotic classes. We show how the prediction landscape of AMR classifiers is highly heterogeneous, with balanced accuracy varying from 0.40 to 0.92. Although some algorithms\u2014ResFinder, KARGA and AMRPlusPlus\u2014exhibit overall better balanced accuracy than others, the high per-AMR-class variance and related findings suggest that: (1) all algorithms might be subject to sampling bias both in data repositories used for training and experimental\/clinical settings; and (2) a portion of clinical samples might contain uncharacterized AMR genes that the algorithms\u2014mostly trained on known AMR genes\u2014fail to generalize upon. These results lead us to formulate practical advice for software configuration and application, and give suggestions for future study designs to further develop AMR prediction tools from proof-of-concept to bedside.<\/jats:p>","DOI":"10.1093\/bib\/bbac020","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T07:08:37Z","timestamp":1643094517000},"source":"Crossref","is-referenced-by-count":15,"title":["Towards routine employment of computational tools for antimicrobial resistance determination via high-throughput sequencing"],"prefix":"10.1093","volume":"23","author":[{"given":"Simone","family":"Marini","sequence":"first","affiliation":[{"name":"Department of Epidemiology , University of Florida, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rodrigo A","family":"Mora","sequence":"additional","affiliation":[{"name":"Department of Epidemiology , University of Florida, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christina","family":"Boucher","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science and Engineering , University of Florida, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Noelle","family":"Robertson Noyes","sequence":"additional","affiliation":[{"name":"Department of Veterinary Population Medicine , University of Minnesota, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mattia","family":"Prosperi","sequence":"additional","affiliation":[{"name":"Department of Epidemiology , University of Florida, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"3903","DOI":"10.2147\/IDR.S234610","article-title":"Antimicrobial resistance: implications and costs","volume":"12","author":"Dadgostar","year":"2019","journal-title":"Infection and drug resistance"},{"issue":"1","key":"2023022501095535100_","first-page":"36","article-title":"Global contributors to antibiotic resistance","author":"Chokshi","year":"2019","journal-title":"J Glob Infect"},{"issue":"Supplement_3","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"S331","DOI":"10.1093\/infdis\/jiz151","article-title":"From the pipeline to the bedside: advances and challenges in clinical metagenomics","volume":"221","author":"Dulanto Chiang","year":"2020","journal-title":"J Infect Dis"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1128\/AAC.01812-12","article-title":"Rapid isolation and susceptibility testing of leptospira susing a new solid medium, lvw agar","volume":"57","author":"Wuthiekanun","year":"2013","journal-title":"Antimicrob Agents Chemother"},{"issue":"D1","key":"2023022501095535100_","first-page":"D517","article-title":"Card 2020: antibiotic resistome surveillance with the comprehensive antibiotic resistance database","volume":"48","author":"Alcock","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"D443","DOI":"10.1093\/nar\/gkn656","article-title":"Ardb-antibiotic resistance genes database","volume":"37, suppl_1","author":"Liu","year":"2009","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"2023022501095535100_","first-page":"D606","article-title":"The patric bioinformatics resource center: expanding data and analysis capabilities","volume":"48","author":"Davis","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"27930","DOI":"10.1038\/srep27930","article-title":"Antimicrobial resistance prediction in patric and rast","volume":"6","author":"Davis","year":"2016","journal-title":"Sci Rep"},{"issue":"D1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"D561","DOI":"10.1093\/nar\/gkz1010","article-title":"Megares 2.0: a database for classification of antimicrobial drug, biocide and metal resistance determinants in metagenomic sequence data","volume":"48","author":"Doster","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbab313","article-title":"A genomic data resource for predicting antimicrobial resistance from laboratory-derived antimicrobial susceptibility phenotypes","author":"VanOeffelen","year":"2021","journal-title":"Brief Bioinform"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s42003-019-0545-9","article-title":"Hierarchical hidden markov models enable accurate and diverse detection of antimicrobial resistance sequences","volume":"2","author":"Lakin","year":"2019","journal-title":"Communications Biology"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40168-018-0401-z","article-title":"Deeparg: a deep learning approach for predicting antibiotic resistance genes from metagenomic data","volume":"6","author":"Arango-Argoty","year":"2018","journal-title":"Microbiome"},{"key":"2023022501095535100_","first-page":"1","volume-title":"Karga: Multi-platform toolkit for k-mer-based antibiotic resistance gene analysis of high-throughput sequencing data","author":"Prosperi","year":"2021"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1038\/s41564-018-0292-6","article-title":"Prediction of the intestinal resistome by a three-dimensional structure-based method","volume":"4","author":"Rupp\u00e9","year":"2019","journal-title":"Nat Microbiol"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"26","DOI":"10.3389\/fgene.2021.564186","article-title":"Exploring prediction of antimicrobial resistance based on protein solvent accessibility variation","volume":"12","author":"Marini","year":"2021","journal-title":"Front Genet"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1887","DOI":"10.3389\/fmicb.2016.01887","article-title":"Evaluation of machine learning and rules-based approaches for predicting antimicrobial resistance profiles in gram-negative bacilli from whole genome sequence data","volume":"7","author":"Pesesky","year":"2016","journal-title":"Front Microbiol"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1007511","article-title":"Vampr: Variant mapping and prediction of antibiotic resistance via explainable features and machine learning","volume":"16","author":"Kim","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"578795","DOI":"10.3389\/fmicb.2020.578795","article-title":"``Parmap: A pan-genome-based computational framework for predicting antimicrobial resistance,''","volume":"11","year":"2020","journal-title":"Frontiers in microbiology"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1099\/mgen.0.000335","article-title":"Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: An inter-laboratory study","volume":"6","author":"Doyle","year":"2020","journal-title":"Microbial Genomics"},{"key":"2023022501095535100_","article-title":"Assessing putative bias in prediction of anti-microbial resistance from real-world genotyping data under explicit causal assumptions","author":"Prosperi","year":"2021"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1145\/3307339.3342138","article-title":"Unexpected predictors of antibiotic resistance in housekeeping genes of staphylococcus aureus","volume-title":"Proceedings of the 10th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics","author":"Prosperi","year":"2019"},{"issue":"7","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"2245","DOI":"10.1128\/JCM.00495-13","article-title":"Fluoroquinolone and macrolide resistance-associated mutations in mycoplasma genitalium","volume":"51","author":"Tagg","year":"2013","journal-title":"J Clin Microbiol"},{"key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1038\/s41564-021-00920-0","article-title":"Probiotics impact the antibiotic resistance gene reservoir along the human gi tract in a person-specific and antibiotic-dependent manner","volume":"6","author":"Montassier","year":"2021","journal-title":"Nat Microbiol"},{"issue":"12","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"3491","DOI":"10.1093\/jac\/dkaa345","article-title":"Resfinder 4.0 for predictions of phenotypes from genotypes","volume":"75","author":"Bortolaia","year":"2020","journal-title":"Journal of Antimicrobial Chemotherapy"},{"issue":"5","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1093\/bioinformatics\/btp698","article-title":"Fast and accurate long-read alignment with burrows\u2013wheeler transform","volume":"26","author":"Li","year":"2010","journal-title":"Bioinformatics"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-018-2336-6","article-title":"Rapid and precise alignment of raw reads against redundant databases with kma","volume":"19","author":"Clausen","year":"2018","journal-title":"BMC bioinformatics"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"e02011","DOI":"10.1128\/mBio.02011-17","article-title":"Genomic analysis of hospital plumbing reveals diverse reservoir of bacterial plasmids conferring carbapenem resistance","volume":"9","author":"Weingarten","year":"2018","journal-title":"MBio"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13073-017-0397-1","article-title":"Whole genome sequencing reveals high-resolution epidemiological links between clinical and environmental klebsiella pneumoniae","volume":"9","author":"Runcharoen","year":"2017","journal-title":"Genome Med"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1038\/ng.3147","article-title":"Emergence of scarlet fever streptococcus pyogenes emm 12 clones in hong kong is associated with toxin acquisition and multidrug resistance","volume":"47","author":"Davies","year":"2015","journal-title":"Nat Genet"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1741-7007-12-49","article-title":"Variable recombination dynamics during the emergence, transmission and \u2018disarming\u2019 of a multidrug-resistant pneumococcal clone","volume":"12","author":"Croucher","year":"2014","journal-title":"BMC Biol"},{"issue":"1","key":"2023022501095535100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-021-22849-y","article-title":"Variability of plasmid fitness effects contributes to plasmid persistence in bacterial communities","volume":"12","author":"Alonso-del Valle","year":"2021","journal-title":"Nat Commun"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbac020\/42980913\/bbac020.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbac020\/42980913\/bbac020.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T02:22:25Z","timestamp":1700101345000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbac020\/6536119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,10]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbac020","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.11.03.467126","asserted-by":"object"}]},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,3]]},"published":{"date-parts":[[2022,2,25]]},"article-number":"bbac020"}}