{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T20:05:55Z","timestamp":1762459555282,"version":"3.37.3"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T00:00:00Z","timestamp":1512518400000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100011102","name":"European Union Seventh Framework Programme","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011102","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,5,21]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>High-throughput next-generation shotgun sequencing of pathogenic bacteria is growing in clinical relevance, especially for chromosomal DNA-based taxonomic identification and for antibiotic resistance prediction. Genetic exchange is facilitated for extrachromosomal DNA, e.g. plasmid-borne antibiotic resistance genes. Consequently, accurate identification of plasmids from whole-genome sequencing (WGS) data remains one of the major challenges for sequencing-based precision medicine in infectious diseases. Here, we assess the heterogeneity of four state-of-the-art tools (cBar, PlasmidFinder, plasmidSPAdes and Recycler) for the in silico prediction of plasmid-derived sequences from WGS data. Heterogeneity, sensitivity and precision were evaluated by reference-independent and reference-dependent benchmarking using 846 Gram-negative clinical isolates. Interestingly, the majority of predicted sequences were tool-specific, resulting in a pronounced heterogeneity across tools for the reference-independent assessment. In the reference-dependent assessment, sensitivity and precision values were found to substantially vary between tools and across taxa, with cBar exhibiting the highest median sensitivity (87.45%) but a low median precision (27.05%). Furthermore, integrating the individual tools into an ensemble approach showed increased sensitivity (95.55%) while reducing the precision (25.62%). CBar and plasmidSPAdes exhibited the strongest concordance with respect to identified antibiotic resistance factors. Moreover, false-positive plasmid predictions typically contained only few antibiotic resistance factors. In conclusion, while high degrees of heterogeneity and variation in sensitivity and precision were observed across the different tools and taxa, existing tools are valuable for investigating the plasmid-borne resistome. Nevertheless, additional studies on representative clinical data sets will be necessary to translate in silico plasmid prediction approaches from research to clinical application.<\/jats:p>","DOI":"10.1093\/bib\/bbx162","type":"journal-article","created":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T18:20:01Z","timestamp":1511979601000},"page":"857-865","source":"Crossref","is-referenced-by-count":19,"title":["Assessing the heterogeneity of in silico plasmid predictions based on whole-genome-sequenced clinical isolates"],"prefix":"10.1093","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1100-1282","authenticated-orcid":false,"given":"Cedric C","family":"Laczny","sequence":"first","affiliation":[{"name":"Chair for Clinical Bioinformatics at Saarland University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4541-427X","authenticated-orcid":false,"given":"Valentina","family":"Galata","sequence":"additional","affiliation":[{"name":"Chair for Clinical Bioinformatics at Saarland University"}]},{"given":"Achim","family":"Plum","sequence":"additional","affiliation":[{"name":"Ares Genetics GmbH and Curetis GmbH"}]},{"given":"Andreas E","family":"Posch","sequence":"additional","affiliation":[{"name":"Ares Genetics GmbH"}]},{"given":"Andreas","family":"Keller","sequence":"additional","affiliation":[{"name":"Chair for Clinical Bioinformatics at Saarland University"}]}],"member":"286","published-online":{"date-parts":[[2017,12,5]]},"reference":[{"issue":"6","key":"2019071506055601000_bbx162-B1","doi-asserted-by":"publisher","first-page":"2227","DOI":"10.1128\/AAC.01707-08","article-title":"Resistance plasmid families in Enterobacteriaceae","volume":"53","author":"Carattoli","year":"2009","journal-title":"Antimicrob Agents Chemother"},{"issue":"9","key":"2019071506055601000_bbx162-B2","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1038\/nrmicro1235","article-title":"Mobile genetic elements: the agents of open source evolution","volume":"3","author":"Frost","year":"2005","journal-title":"Nat Rev Microbiol"},{"issue":"1","key":"2019071506055601000_bbx162-B3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1128\/MMBR.48.1.1-23.1984","article-title":"Regulation of plasmid replication","volume":"48","author":"Scott","year":"1984","journal-title":"Microbiol Rev"},{"issue":"2","key":"2019071506055601000_bbx162-B4","doi-asserted-by":"publisher","first-page":"434","DOI":"10.2172\/98\/$04.0010","article-title":"Replication and control of circular bacterial plasmids","volume":"62","author":"del Solar","year":"1998","journal-title":"Microbiol Mol Biol Rev"},{"key":"2019071506055601000_bbx162-B5","doi-asserted-by":"publisher","first-page":"e000085","DOI":"10.1128\/mBio.00742-16","article-title":"Plasmid dynamics in KPC-positive Klebsiella pneumoniae during long-term patient colonization","volume":"2","author":"Conlan","year":"2016","journal-title":"MBio"},{"key":"2019071506055601000_bbx162-B6","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/S1473-3099(15)00424-7","article-title":"Emergence of plasmid-mediated colistin resistance mechanism MCR-1 in animals and human beings in China: a microbiological and molecular biological study","volume":"16","author":"Liu","year":"2016","journal-title":"Lancet Infect Dis"},{"key":"2019071506055601000_bbx162-B7","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1016\/S1473-3099(16)00063-3","article-title":"Dissemination of the mcr-1 colistin resistance gene","volume":"16","author":"Zhi","year":"2016","journal-title":"Lancet Infect Dis"},{"issue":"3","key":"2019071506055601000_bbx162-B8","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1128\/MMBR.52.3.375-395.1988","article-title":"Identification and classification of bacterial plasmids","volume":"52","author":"Couturier","year":"1988","journal-title":"Microbiol Rev"},{"issue":"3","key":"2019071506055601000_bbx162-B9","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/j.mimet.2005.03.018","article-title":"Identification of plasmids by PCR-based replicon typing","volume":"63","author":"Carattoli","year":"2005","journal-title":"J Microbiol Methods"},{"issue":"1","key":"2019071506055601000_bbx162-B10","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.femsre.2003.09.001","article-title":"A classification scheme for mobilization regions of bacterial plasmids","volume":"28","author":"Francia","year":"2004","journal-title":"FEMS Microbiol Rev"},{"issue":"7","key":"2019071506055601000_bbx162-B11","doi-asserted-by":"publisher","first-page":"e40438.","DOI":"10.1371\/journal.pone.0040438","article-title":"A degenerate primer MOB typing (DPMT) method to classify gamma-proteobacterial plasmids in clinical and environmental settings","volume":"7","author":"Alvarado","year":"2012","journal-title":"PLoS One"},{"key":"2019071506055601000_bbx162-B12","doi-asserted-by":"publisher","first-page":"182","DOI":"10.3389\/fmicb.2017.00182","article-title":"Plasmid classification in an era of whole-genome sequencing: application in studies of antibiotic resistance epidemiology","volume":"8","author":"Orlek","year":"2017","journal-title":"Front Microbiol"},{"key":"2019071506055601000_bbx162-B13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1099\/mgen.0.000128","article-title":"On the (im)possibility of reconstructing plasmids from whole-genome short-read sequencing data","author":"Arredondo-Alonso","year":"2017","journal-title":"Microb Genomics"},{"issue":"7","key":"2019071506055601000_bbx162-B14","doi-asserted-by":"publisher","first-page":"3895","DOI":"10.1128\/AAC.02412-14","article-title":"In silico detection and typing of plasmids using PlasmidFinder and plasmid multilocus sequence typing","volume":"58","author":"Carattoli","year":"2014","journal-title":"Antimicrob Agents Chemother"},{"issue":"16","key":"2019071506055601000_bbx162-B15","doi-asserted-by":"publisher","first-page":"2051","DOI":"10.1093\/bioinformatics\/btq299","article-title":"cBar: a computer program to distinguish plasmid-derived from chromosome-derived sequence fragments in metagenomics data","volume":"26","author":"Zhou","year":"2010","journal-title":"Bioinformatics"},{"key":"2019071506055601000_bbx162-B16","doi-asserted-by":"publisher","first-page":"3380","DOI":"10.1093\/bioinformatics\/btw493","article-title":"plasmidSPAdes: assembling plasmids from whole genome sequencing data","volume":"32","author":"Antipov","year":"2016","journal-title":"Bioinformatics"},{"key":"2019071506055601000_bbx162-B17","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1093\/bioinformatics\/btw651","article-title":"Recycler: an algorithm for detecting plasmids from de novo assembly graphs","volume":"33","author":"Rozov","year":"2016","journal-title":"Bioinformatics"},{"issue":"11","key":"2019071506055601000_bbx162-B18","doi-asserted-by":"publisher","first-page":"e47768","DOI":"10.1371\/journal.pone.0047768","article-title":"Mind the gap: upgrading genomes with Pacific Biosciences RS long-read sequencing technology","volume":"7","author":"English","year":"2012","journal-title":"PLoS One"},{"issue":"9","key":"2019071506055601000_bbx162-B19","doi-asserted-by":"publisher","first-page":"e000085","DOI":"10.1099\/mgen.0.000085","article-title":"Comparison of bacterial genome assembly software for MinION data and their applicability to medical microbiology","volume":"2","author":"Reuter","year":"2016","journal-title":"Microb Genomics"},{"issue":"8","key":"2019071506055601000_bbx162-B20","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1099\/mgen.0.000118","article-title":"Resolving plasmid structures in Enterobacteriaceae using the MinION nanopore sequencer: assessment of MinION and MinION\/Illumina hybrid data assembly approaches","volume":"3","author":"George","year":"2017","journal-title":"Microb Genomics"},{"issue":"6","key":"2019071506055601000_bbx162-B21","doi-asserted-by":"publisher","first-page":"e1005595","DOI":"10.1371\/journal.pcbi.1005595","article-title":"Unicycler: resolving bacterial genome assemblies from short and long sequencing reads","volume":"13","author":"Wick","year":"2017","journal-title":"PLoS Comput Biol"},{"key":"2019071506055601000_bbx162-B22","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbw122","article-title":"Comparing genome versus proteome-based identification of clinical bacterial isolates","author":"Galata","year":"2016","journal-title":"Brief Bioinform"},{"issue":"15","key":"2019071506055601000_bbx162-B23","doi-asserted-by":"publisher","first-page":"2114","DOI":"10.1093\/bioinformatics\/btu170","article-title":"Trimmomatic: a flexible trimmer for Illumina sequence data","volume":"30","author":"Bolger","year":"2014","journal-title":"Bioinformatics"},{"issue":"5","key":"2019071506055601000_bbx162-B24","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1089\/cmb.2012.0021","article-title":"SPAdes: a new genome assembly algorithm and its applications to single-cell sequencing","volume":"19","author":"Bankevich","year":"2012","journal-title":"J Comput Biol"},{"issue":"14","key":"2019071506055601000_bbx162-B25","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1093\/bioinformatics\/btp324","article-title":"Fast and accurate short read alignment with Burrows-Wheeler transform","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"journal-title":"arXiv","article-title":"Aligning sequence reads, clone sequences and assembly contigs with BWA-MEM","author":"Li","key":"2019071506055601000_bbx162-B26"},{"issue":"16","key":"2019071506055601000_bbx162-B27","doi-asserted-by":"publisher","first-page":"2078","DOI":"10.1093\/bioinformatics\/btp352","article-title":"The sequence alignment\/map format and SAMtools","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"issue":"23","key":"2019071506055601000_bbx162-B28","doi-asserted-by":"publisher","first-page":"3150","DOI":"10.1093\/bioinformatics\/bts565","article-title":"CD-HIT: accelerated for clustering the next-generation sequencing data","volume":"28","author":"Fu","year":"2012","journal-title":"Bioinformatics"},{"issue":"13","key":"2019071506055601000_bbx162-B29","doi-asserted-by":"publisher","first-page":"1658","DOI":"10.1093\/bioinformatics\/btl158","article-title":"Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences","volume":"22","author":"Li","year":"2006","journal-title":"Bioinformatics"},{"issue":"5","key":"2019071506055601000_bbx162-B30","doi-asserted-by":"publisher","first-page":"27","DOI":"10.21105\/joss.00027","article-title":"sourmash: a library for MinHash sketching of DNA","volume":"1","author":"Titus Brown","year":"2016","journal-title":"J Open Source Softw"},{"year":"2017","author":"Oksanen","key":"2019071506055601000_bbx162-B31"},{"issue":"3","key":"2019071506055601000_bbx162-B32","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/S0022-2836(05)80360-2","article-title":"Basic local alignment search tool","volume":"215","author":"Altschul","year":"1990","journal-title":"J Mol Biol"},{"issue":"14","key":"2019071506055601000_bbx162-B33","doi-asserted-by":"publisher","first-page":"2068","DOI":"10.1093\/bioinformatics\/btu153","article-title":"Prokka: rapid prokaryotic genome annotation","volume":"30","author":"Seemann","year":"2014","journal-title":"Bioinformatics"},{"issue":"9","key":"2019071506055601000_bbx162-B34","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1093\/bioinformatics\/14.9.755","article-title":"Profile hidden Markov models","volume":"14","author":"Eddy","year":"1998","journal-title":"Bioinformatics"},{"issue":"1","key":"2019071506055601000_bbx162-B35","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1038\/ismej.2014.106","article-title":"Improved annotation of antibiotic resistance determinants reveals microbial resistomes cluster by ecology","volume":"9","author":"Gibson","year":"2015","journal-title":"Isme J"},{"volume-title":"R: A Language and Environment for Statistical Computing","year":"2016","author":"R Core Team","key":"2019071506055601000_bbx162-B36"},{"key":"2019071506055601000_bbx162-B37","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-98141-3","volume-title":"ggplot2: Elegant Graphics for Data Analysis","author":"Wickham","year":"2009"},{"issue":"6252","key":"2019071506055601000_bbx162-B38","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.1126\/science.aac4812","article-title":"Growth dynamics of gut microbiota in health and disease inferred from single metagenomic samples","volume":"349","author":"Korem","year":"2015","journal-title":"Science"},{"issue":"1","key":"2019071506055601000_bbx162-B39","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1186\/s13073-016-0326-8","article-title":"Next-generation sequencing diagnostics of bacteremia in septic patients","volume":"8","author":"Grumaz","year":"2016","journal-title":"Genome Med"},{"issue":"14","key":"2019071506055601000_bbx162-B40","doi-asserted-by":"publisher","first-page":"1502","DOI":"10.1001\/jama.2013.3231","article-title":"A culture-independent sequence-based metagenomics approach to the investigation of an outbreak of Shiga-toxigenic Escherichia coli O104: H4","volume":"309","author":"Loman","year":"2013","journal-title":"Jama"},{"key":"2019071506055601000_bbx162-B41","doi-asserted-by":"publisher","first-page":"1250","DOI":"10.3389\/fmicb.2015.01250","article-title":"Characterization of a CTX-M-15 producing Klebsiella pneumoniae outbreak strain assigned to a novel sequence type (1427)","volume":"6","author":"Zhou","year":"2015","journal-title":"Front Microbiol"},{"issue":"6","key":"2019071506055601000_bbx162-B42","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1128\/AEM.53.6.1385-1386.1987","article-title":"Construction of Streptococcus lactis subsp. lactis strains with a single plasmid associated with mucoid phenotype","volume":"53","author":"von Wright","year":"1987","journal-title":"Appl Environ Microbiol"},{"issue":"15","key":"2019071506055601000_bbx162-B43","doi-asserted-by":"publisher","first-page":"4652","DOI":"10.1128\/JB.183.15.4652-4658.2001","article-title":"Virulence plasmid-borne spvB and spvC genes can replace the 90-kilobase plasmid in conferring virulence to Salmonella enterica serovar typhimurium in subcutaneously inoculated mice","volume":"183","author":"Matsui","year":"2001","journal-title":"J Bacteriol"},{"issue":"4","key":"2019071506055601000_bbx162-B44","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1111\/j.1758-2229.2012.00353.x","article-title":"The pYV virulence plasmids of Yersinia pseudotuberculosis and Y. pestis contain a conserved DNA region responsible for the mobilization by the self-transmissible plasmid pYE854","volume":"4","author":"Hammerl","year":"2012","journal-title":"Environ Microbiol Rep"},{"issue":"1","key":"2019071506055601000_bbx162-B45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1574-6968.1994.tb07253.x","article-title":"Plasmid-mediated virulence genes in non-typhoid Salmonella serovars","volume":"124","author":"Guiney","year":"1994","journal-title":"FEMS Microbiol Lett"},{"issue":"4","key":"2019071506055601000_bbx162-B46","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1016\/j.gpb.2014.05.001","article-title":"Complete sequence of pABTJ2, a plasmid from Acinetobacter baumannii MDR-TJ, carrying many phage-like elements","volume":"12","author":"Huang","year":"2014","journal-title":"Genomics Proteomics Bioinformatics"},{"issue":"30","key":"2019071506055601000_bbx162-B47","doi-asserted-by":"publisher","first-page":"9442","DOI":"10.1073\/pnas.1502966112","article-title":"A multidrug resistance plasmid contains the molecular switch for type VI secretion in Acinetobacter baumannii","volume":"112","author":"Weber","year":"2015","journal-title":"Proc Natl Acad Sci USA"},{"issue":"1","key":"2019071506055601000_bbx162-B48","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1093\/jac\/dkv293","article-title":"A small Acinetobacter plasmid carrying the tet39 tetracycline resistance determinant","volume":"71","author":"Hamidian","year":"2016","journal-title":"J Antimicrob Chemother"},{"key":"2019071506055601000_bbx162-B49","article-title":"PlasmidTron: assembling the cause of phenotypes from NGS data","author":"Page","year":"2017","journal-title":"bioRxiv"},{"key":"2019071506055601000_bbx162-B50","doi-asserted-by":"publisher","first-page":"e1004766","DOI":"10.1371\/journal.pgen.1004766","article-title":"Plasmid flux in Escherichia coli ST131 sublineages, analyzed by plasmid constellation network (PLACNET), a new method for plasmid reconstruction from whole genome sequences","volume":"10","author":"Lanza","year":"2014","journal-title":"PLoS Genet"},{"issue":"1","key":"2019071506055601000_bbx162-B51","doi-asserted-by":"publisher","first-page":"22.","DOI":"10.1186\/2047-217X-3-22","article-title":"A reference bacterial genome dataset generated on the MinIONTM portable single-molecule nanopore sequencer","volume":"3","author":"Quick","year":"2014","journal-title":"Gigascience"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/20\/3\/857\/28935426\/bbx162.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T05:34:30Z","timestamp":1603431270000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/20\/3\/857\/4696344"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,5]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,12,5]]},"published-print":{"date-parts":[[2019,5,21]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbx162","relation":{},"ISSN":["1477-4054"],"issn-type":[{"type":"electronic","value":"1477-4054"}],"subject":[],"published-other":{"date-parts":[[2019,5]]},"published":{"date-parts":[[2017,12,5]]}}}