{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T12:47:46Z","timestamp":1793018866014,"version":"4.5.0"},"reference-count":47,"publisher":"Microbiology Society","issue":"2","license":[{"start":{"date-parts":[[2020,2,1]],"date-time":"2020-02-01T00:00:00Z","timestamp":1580515200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014132","name":"European Metrology Programme for Innovation and Research","doi-asserted-by":"crossref","award":["HLT07"],"award-info":[{"award-number":["HLT07"]}],"id":[{"id":"10.13039\/100014132","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100007601","name":"EU Horizon 2020","doi-asserted-by":"crossref","award":["675412"],"award-info":[{"award-number":["675412"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,1]]},"abstract":"<jats:p>Antimicrobial resistance (AMR) poses a threat to public health. Clinical microbiology laboratories typically rely on culturing bacteria for antimicrobial-susceptibility testing (AST). As the implementation costs and technical barriers fall, whole-genome sequencing (WGS) has emerged as a \u2018one-stop\u2019 test for epidemiological and predictive AST results. Few published comparisons exist for the myriad analytical pipelines used for predicting AMR. To address this, we performed an inter-laboratory study providing sets of participating researchers with identical short-read WGS data from clinical isolates, allowing us to assess the reproducibility of the bioinformatic prediction of AMR between participants, and identify problem cases and factors that lead to discordant results. We produced ten WGS datasets of varying quality from cultured carbapenem-resistant organisms obtained from clinical samples sequenced on either an Illumina NextSeq or HiSeq instrument. Nine participating teams (\u2018participants\u2019) were provided these sequence data without any other contextual information. Each participant used their choice of pipeline to determine the species, the presence of resistance-associated genes, and to predict susceptibility or resistance to amikacin, gentamicin, ciprofloxacin and cefotaxime. We found participants predicted different numbers of AMR-associated genes and different gene variants from the same clinical samples. The quality of the sequence data, choice of bioinformatic pipeline and interpretation of the results all contributed to discordance between participants. Although much of the inaccurate gene variant annotation did not affect genotypic resistance predictions, we observed low specificity when compared to phenotypic AST results, but this improved in samples with higher read depths. Had the results been used to predict AST and guide treatment, a different antibiotic would have been recommended for each isolate by at least one participant. These challenges, at the final analytical stage of using WGS to predict AMR, suggest the need for refinements when using this technology in clinical settings. Comprehensive public resistance sequence databases, full recommendations on sequence data quality and standardization in the comparisons between genotype and resistance phenotypes will all play a fundamental role in the successful implementation of AST prediction using WGS in clinical microbiology laboratories.<\/jats:p>","DOI":"10.1099\/mgen.0.000335","type":"journal-article","created":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T09:13:31Z","timestamp":1581498811000},"source":"Crossref","is-referenced-by-count":84,"title":["Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: an inter-laboratory study"],"prefix":"10.1099","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5001-1945","authenticated-orcid":false,"given":"Ronan M.","family":"Doyle","sequence":"first","affiliation":[{"name":"Clinical Research Department, London School of Hygiene and Tropical Medicine, London, UK"},{"name":"Microbiology Department, Great Ormond Street Hospital NHS Foundation Trust, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8915-7984","authenticated-orcid":false,"given":"Denise M.","family":"O'Sullivan","sequence":"additional","affiliation":[{"name":"Molecular and Cell Biology Team, National Measurement Laboratory, Queens Road, Teddington, Middlesex, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2128-2652","authenticated-orcid":false,"given":"Sean D.","family":"Aller","sequence":"additional","affiliation":[{"name":"Institute for Infection and Immunity, St George\u2019s, University of London, Cranmer Terrace, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8721-5386","authenticated-orcid":false,"given":"Sebastian","family":"Bruchmann","sequence":"additional","affiliation":[{"name":"Pathogen Genomics, Wellcome Sanger Institute, Wellcome Genome Campus, Hinxton, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8985-9265","authenticated-orcid":false,"given":"Taane","family":"Clark","sequence":"additional","affiliation":[{"name":"Department of Infection Biology, London School of Hygiene and Tropical Medicine, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreu","family":"Coello Pelegrin","sequence":"additional","affiliation":[{"name":"Vaccine and Infectious Disease Institute, Laboratory of Medical Microbiology, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium"},{"name":"Clinical Unit, bioM\u00e9rieux, La Balme Les Grottes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8023-1882","authenticated-orcid":false,"given":"Martin","family":"Cormican","sequence":"additional","affiliation":[{"name":"National University of Ireland Galway, Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4313-4290","authenticated-orcid":false,"given":"Ernest","family":"Diez Benavente","sequence":"additional","affiliation":[{"name":"Department of Infection Biology, London School of Hygiene and Tropical Medicine, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0656-3360","authenticated-orcid":false,"given":"Matthew J.","family":"Ellington","sequence":"additional","affiliation":[{"name":"NIS Laboratories, National Infection Service, Public Health England, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elaine","family":"McGrath","sequence":"additional","affiliation":[{"name":"Carbapenemase-Producing Enterobacterales Reference Laboratory, Department of Medical Microbiology, University Hospital Galway, Galway, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1289-6919","authenticated-orcid":false,"given":"Yair","family":"Motro","sequence":"additional","affiliation":[{"name":"School of Public Health, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thi","family":"Phuong Thuy Nguyen","sequence":"additional","affiliation":[{"name":"Department of BiNano Technology, College of BiNano Technology, Gachon University, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8323-7019","authenticated-orcid":false,"given":"Jody","family":"Phelan","sequence":"additional","affiliation":[{"name":"Department of Infection Biology, London School of Hygiene and Tropical Medicine, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7332-0820","authenticated-orcid":false,"given":"Liam P.","family":"Shaw","sequence":"additional","affiliation":[{"name":"Nuffield Department of Medicine, University of Oxford, John Radcliffe Hospital, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2402-6630","authenticated-orcid":false,"given":"Richard A.","family":"Stabler","sequence":"additional","affiliation":[{"name":"AMR Centre, London School of Hygiene and Tropical Medicine, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"van Belkum","sequence":"additional","affiliation":[{"name":"Clinical Unit, bioM\u00e9rieux, La Balme Les Grottes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6211-2310","authenticated-orcid":false,"given":"Lucy","family":"van Dorp","sequence":"additional","affiliation":[{"name":"UCL Genetics Institute, Department of Genetics, Evolution and Environment, University College London, Gower Street, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Woodford","sequence":"additional","affiliation":[{"name":"NIS Laboratories, National Infection Service, Public Health England, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9134-050X","authenticated-orcid":false,"given":"Jacob","family":"Moran-Gilad","sequence":"additional","affiliation":[{"name":"School of Public Health, Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer Sheva, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jim F.","family":"Huggett","sequence":"additional","affiliation":[{"name":"School of Biosciences and Medicine, Faculty of Health and Medical Science, University of Surrey, Guildford, UK"},{"name":"Molecular and Cell Biology Team, National Measurement Laboratory, Queens Road, Teddington, Middlesex, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3807-9749","authenticated-orcid":false,"given":"Kathryn A.","family":"Harris","sequence":"additional","affiliation":[{"name":"Microbiology Department, Great Ormond Street Hospital NHS Foundation Trust, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"345","reference":[{"key":"R1","volume-title":"Tackling Drug-Resistant Infections Globally: Final Report and Recommendations","author":"O\u2019Neill","year":"2016"},{"key":"R2","volume-title":"Global Action Plan on Antimicrobial Resistance (http:\/\/www.who.int\/iris\/bitstream\/10665\/193736\/1\/9789241509763_eng.pdf)","year":"2015"},{"key":"R3","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1093\/clinids\/2.1.129","article-title":"Classics in infectious diseases: on the antibacterial action of cultures of a Penicillium, with special reference to their use in the isolation of B. influenzae by Alexander Fleming, reprinted from the British Journal of Experimental Pathology 10:226-236, 1929","volume":"2","author":"Fleming","year":"1980","journal-title":"Rev Infect Dis"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1128\/AAC.34.9.1720"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1128\/JCM.02214-10"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1007\/s10096-019-03492-4"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1038\/s41579-018-0098-9"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dks247"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dks496"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmi.2016.11.012"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1007\/s10096-017-3024-6"},{"key":"R12","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.cmi.2017.11.001","article-title":"Practical issues in implementing whole-genome-sequencing in routine diagnostic microbiology","volume":"24","author":"Rossen","year":"2018","journal-title":"Clin Microbiol Infect"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.2807\/1560-7917.ES.2019.24.4.1900068"},{"key":"R14","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1128\/JCM.02483-16","article-title":"Same-day diagnostic and surveillance data for tuberculosis via whole-genome sequencing of direct respiratory samples","volume":"55","author":"Votintseva","year":"2017","journal-title":"J Clin Microbiol"},{"key":"R15","doi-asserted-by":"crossref","DOI":"10.1128\/JCM.00666-18","article-title":"Direct whole-genome sequencing of sputum accurately identifies drug-resistant Mycobacterium tuberculosis faster than MGIT culture sequencing","volume":"56","author":"Doyle","year":"2018","journal-title":"J Clin Microbiol"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1038\/s41587-019-0156-5"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2019.00242"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dks261"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dkw184"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1099\/mgen.0.000131"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dkt180"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dkv186"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1128\/JCM.01069-17"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1099\/mgen.0.000213"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1800474"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1128\/JCM.44.2.619-621.2006"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1128\/JCM.02242-16"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2014-15-3-r46"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-018-1568-0"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-016-0997-x"},{"key":"R31","doi-asserted-by":"crossref","first-page":"1721","DOI":"10.1101\/gr.210641.116","article-title":"Centrifuge: rapid and sensitive classification of metagenomic sequences","volume":"26","author":"Kim","year":"2016","journal-title":"Genome Res"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1089\/cmb.2012.0021"},{"key":"R33","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005595"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0042304"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkw1004"},{"key":"R36","article-title":"SSTAR, a stand-alone easy-to-use antimicrobial resistance gene predictor","volume":"1","author":"de","year":"2016","journal-title":"mSphere"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1186\/s13073-014-0090-6"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1128\/AAC.01310-13"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1128\/JCM.01815-17"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.3390\/molecules22122267"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0080278"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2740"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000002"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-15-107"},{"key":"R45","doi-asserted-by":"crossref","DOI":"10.1128\/AAC.00483-19","article-title":"Validating the AMRFinder tool and resistance gene database by using antimicrobial resistance genotype-phenotype correlations in a collection of isolates","volume":"63","author":"Feldgarden","year":"2019","journal-title":"Antimicrob Agents Chemother"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.01354-2017"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.1016\/j.tim.2018.08.004"}],"container-title":["Microbial Genomics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.microbiologyresearch.org\/content\/journal\/mgen\/10.1099\/mgen.0.000335?crawler=true&mimetype=application\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T22:30:39Z","timestamp":1702593039000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.microbiologyresearch.org\/content\/journal\/mgen\/10.1099\/mgen.0.000335"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,1]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,2,1]]}},"URL":"https:\/\/doi.org\/10.1099\/mgen.0.000335","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/793885","asserted-by":"object"}],"is-referenced-by":[{"id-type":"doi","id":"10.1038\/s41598-025-05863-8","asserted-by":"object"}]},"ISSN":["2057-5858"],"issn-type":[{"value":"2057-5858","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,1]]}}}