{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T00:59:18Z","timestamp":1783040358485,"version":"3.54.6"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T00:00:00Z","timestamp":1595894400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T00:00:00Z","timestamp":1595894400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31772707"],"award-info":[{"award-number":["31772707"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31972642"],"award-info":[{"award-number":["31972642"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Construction of Biology Peak Discipline in Anhui Province","award":["03019001"],"award-info":[{"award-number":["03019001"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Shotgun metagenomics based on untargeted sequencing can explore the taxonomic profile and the function of unknown microorganisms in samples, and complement the shortage of amplicon sequencing. Binning assembled sequences into individual groups, which represent microbial genomes, is the key step and a major challenge in metagenomic research. Both supervised and unsupervised machine learning methods have been employed in binning. Genome binning belonging to unsupervised method clusters contigs into individual genome bins by machine learning methods without the assistance of any reference databases. So far\u00a0a lot of genome binning tools have emerged. Evaluating these genome tools is of great significance to microbiological research. In this study, we evaluate 15 genome binning tools containing 12 original binning tools and 3 refining binning tools by comparing the performance of these tools on chicken gut metagenomic datasets and the first CAMI\u00a0challenge datasets.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>For chicken gut metagenomic datasets, original genome binner MetaBat, Groopm2 and Autometa performed better than other original binner, and MetaWrap combined the binning results of them generated the most high-quality genome bins. For CAMI datasets, Groopm2 achieved the highest purity (&gt;\u20090.9) with good completeness (&gt;\u20090.8), and reconstructed the most high-quality genome bins among original genome binners. Compared with Groopm2, MetaBat2 had similar performance with higher completeness and lower purity. Genome refining binners DASTool predicated the most high-quality genome bins among all genomes binners. Most genome binner performed well for unique strains. Nonetheless, reconstructing common strains still is a substantial challenge for all genome binner.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>In conclusion, we tested a set of currently available, state-of-the-art metagenomics hybrid binning tools and provided a guide for selecting tools for metagenomic binning by comparing range of purity, completeness, adjusted rand index, and the number of high-quality reconstructed bins. Furthermore, available information for future binning strategy were concluded.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12859-020-03667-3","type":"journal-article","created":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T12:02:53Z","timestamp":1595937773000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":94,"title":["Evaluating metagenomics tools for genome binning with real metagenomic datasets and CAMI datasets"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6520-7171","authenticated-orcid":false,"given":"Yi","family":"Yue","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6803-3210","authenticated-orcid":false,"given":"Hao","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhao","family":"Qi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui-Min","family":"Dou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin-Yi","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tian-Fei","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang-Jun","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"You-Hua","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian","family":"Tu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,7,28]]},"reference":[{"key":"3667_CR1","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1128\/mr.59.1.143-169.1995","volume":"59","author":"RI Amann","year":"1995","unstructured":"Amann RI, Ludwig W, Schleifer K-H. Phylogenetic identification and in situ detection of individual microbial cells without cultivation. Microbiol Rev. 1995;59:143\u201369.","journal-title":"Microbiol Rev"},{"key":"3667_CR2","doi-asserted-by":"publisher","first-page":"2460","DOI":"10.1093\/bioinformatics\/btq461","volume":"26","author":"RC Edgar","year":"2010","unstructured":"Edgar RC. Search and clustering orders of magnitude faster than BLAST. Bioinformatics. 2010;26:2460\u20131.","journal-title":"Bioinformatics."},{"key":"3667_CR3","doi-asserted-by":"publisher","first-page":"7537","DOI":"10.1128\/AEM.01541-09","volume":"75","author":"PD Schloss","year":"2009","unstructured":"Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, et al. Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol. 2009;75:7537\u201341.","journal-title":"Appl Environ Microbiol"},{"key":"3667_CR4","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1038\/nmeth.3869","volume":"13","author":"BJ Callahan","year":"2016","unstructured":"Callahan BJ, McMurdie PJ, Rosen MJ, Han AW, Johnson AJA, Holmes SP. DADA2: high-resolution sample inference from Illumina amplicon data. Nat Methods. 2016;13:581.","journal-title":"Nat Methods"},{"key":"3667_CR5","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1038\/s41587-019-0209-9","volume":"37","author":"E Bolyen","year":"2019","unstructured":"Bolyen E, Rideout JR, Dillon MR, Bokulich NA, Abnet CC, Al-Ghalith GA, et al. Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2. Nat Biotechnol. 2019;37:852\u20137.","journal-title":"Nat Biotechnol"},{"key":"3667_CR6","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1038\/nbt.2676","volume":"31","author":"MG Langille","year":"2013","unstructured":"Langille MG, Zaneveld J, Caporaso JG, McDonald D, Knights D, Reyes JA, et al. Predictive functional profiling of microbial communities using 16S rRNA marker gene sequences. Nat Biotechnol. 2013;31:814.","journal-title":"Nat Biotechnol"},{"key":"3667_CR7","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1038\/nature14486","volume":"523","author":"CT Brown","year":"2015","unstructured":"Brown CT, Hug LA, Thomas BC, Sharon I, Castelle CJ, Singh A, et al. Unusual biology across a group comprising more than 15% of domain bacteria. Nature. 2015;523:208.","journal-title":"Nature."},{"key":"3667_CR8","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1038\/nbt.3935","volume":"35","author":"C Quince","year":"2017","unstructured":"Quince C, Walker AW, Simpson JT, Loman NJ, Segata N. Shotgun metagenomics, from sampling to analysis. Nat Biotechnol. 2017;35:833\u201344.","journal-title":"Nat Biotechnol"},{"key":"3667_CR9","doi-asserted-by":"publisher","first-page":"2465","DOI":"10.1038\/ismej.2015.57","volume":"9","author":"E Cardenas","year":"2015","unstructured":"Cardenas E, Kranabetter JM, Hope G, Maas KR, Hallam S, Mohn WW. Forest harvesting reduces the soil metagenomic potential for biomass decomposition. ISME J. 2015;9:2465\u201376.","journal-title":"ISME J."},{"key":"3667_CR10","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1186\/s40168-018-0590-5","volume":"6","author":"P Huang","year":"2018","unstructured":"Huang P, Zhang Y, Xiao K, Jiang F, Wang H, Tang D, et al. The chicken gut metagenome and the modulatory effects of plant-derived benzylisoquinoline alkaloids. Microbiome. 2018;6:211.","journal-title":"Microbiome."},{"key":"3667_CR11","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1126\/science.1212665","volume":"335","author":"V Iverson","year":"2012","unstructured":"Iverson V, Morris RM, Frazar CD, Berthiaume CT, Morales RL, Armbrust EV. Untangling genomes from metagenomes: revealing an uncultured class of marine Euryarchaeota. Science. 2012;335:587\u201390.","journal-title":"Science."},{"key":"3667_CR12","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.1038\/s41564-019-0426-5","volume":"4","author":"L Wu","year":"2019","unstructured":"Wu L, Ning D, Zhang B, Li Y, Zhang P, Shan X, et al. Global diversity and biogeography of bacterial communities in wastewater treatment plants. Nat Microbiol. 2019;4:1183\u201395.","journal-title":"Nat Microbiol"},{"key":"3667_CR13","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1038\/nature24621","volume":"551","author":"LR Thompson","year":"2017","unstructured":"Thompson LR, Sanders JG, McDonald D, Amir A, Ladau J, Locey KJ, et al. A communal catalogue reveals Earth\u2019s multiscale microbial diversity. Nature. 2017;551:457\u201363.","journal-title":"Nature."},{"key":"3667_CR14","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1038\/nrmicro3400","volume":"13","author":"MDJ Lynch","year":"2015","unstructured":"Lynch MDJ, Neufeld JD. Ecology and exploration of the rare biosphere. Nat Rev Microbiol. 2015;13:217\u201329.","journal-title":"Nat Rev Microbiol"},{"key":"3667_CR15","doi-asserted-by":"publisher","first-page":"2407","DOI":"10.1038\/ismej.2017.122","volume":"11","author":"PS Adam","year":"2017","unstructured":"Adam PS, Borrel G, Brochier-Armanet C, Gribaldo S. The growing tree of Archaea: new perspectives on their diversity, evolution and ecology. ISME J. 2017;11:2407\u201325.","journal-title":"ISME J"},{"key":"3667_CR16","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1093\/dnares\/dsm018","volume":"14","author":"K Kurokawa","year":"2007","unstructured":"Kurokawa K, Itoh T, Kuwahara T, Oshima K, Toh H, Toyoda A, et al. Comparative metagenomics revealed commonly enriched gene sets in human gut microbiomes. DNA Res. 2007;14:169\u201381.","journal-title":"DNA Res"},{"key":"3667_CR17","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1038\/s41564-017-0072-8","volume":"3","author":"PI Costea","year":"2018","unstructured":"Costea PI, Hildebrand F, Arumugam M, B\u00e4ckhed F, Blaser MJ, Bushman FD, et al. Enterotypes in the landscape of gut microbial community composition. Nat Microbiol. 2018;3:8\u201316.","journal-title":"Nat Microbiol"},{"key":"3667_CR18","volume":"1510","author":"H Soueidan","year":"2015","unstructured":"Soueidan H, Nikolski M. Machine learning for metagenomics: methods and tools. arXiv preprint arXiv. 2015;1510:06621.","journal-title":"Machine learning for metagenomics: methods and tools. arXiv preprint arXiv."},{"key":"3667_CR19","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1038\/nbt.3375","volume":"33","author":"CT Brown","year":"2015","unstructured":"Brown CT. Strain recovery from metagenomes. Nat Biotechnol. 2015;33:1041\u20133.","journal-title":"Nat Biotechnol"},{"key":"3667_CR20","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1186\/s40168-016-0154-5","volume":"4","author":"N Sangwan","year":"2016","unstructured":"Sangwan N, Xia F, Gilbert JA. Recovering complete and draft population genomes from metagenome datasets. Microbiome. 2016;4:8.","journal-title":"Microbiome."},{"key":"3667_CR21","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/S0022-2836(05)80360-2","volume":"215","author":"SF Altschul","year":"1990","unstructured":"Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool. J Mol Biol. 1990;215:403\u201310.","journal-title":"J Mol Biol"},{"key":"3667_CR22","doi-asserted-by":"publisher","first-page":"R25","DOI":"10.1186\/gb-2009-10-3-r25","volume":"10","author":"B Langmead","year":"2009","unstructured":"Langmead B, Trapnell C, Pop M, Salzberg SL. Ultrafast and memory-efficient alignment of short DNA sequences to the human genome. Genome Biol. 2009;10:R25.","journal-title":"Genome Biol"},{"key":"3667_CR23","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1093\/bioinformatics\/btp698","volume":"26","author":"H Li","year":"2010","unstructured":"Li H, Durbin R. Fast and accurate long-read alignment with burrows-wheeler transform. Bioinformatics. 2010;26:589\u201395.","journal-title":"Bioinformatics."},{"key":"3667_CR24","doi-asserted-by":"publisher","first-page":"3094","DOI":"10.1093\/bioinformatics\/bty191","volume":"34","author":"H Li","year":"2018","unstructured":"Li H. Minimap2: pairwise alignment for nucleotide sequences. Bioinformatics. 2018;34:3094\u2013100.","journal-title":"Bioinformatics."},{"key":"3667_CR25","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.csbj.2016.11.005","volume":"15","author":"K Sedlar","year":"2017","unstructured":"Sedlar K, Kupkova K, Provaznik I. Bioinformatics strategies for taxonomy independent binning and visualization of sequences in shotgun metagenomics. Comput Structural Biotechnol J. 2017;15:48\u201355.","journal-title":"Comput Structural Biotechnol J"},{"key":"3667_CR26","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1093\/bib\/bbs054","volume":"13","author":"SS Mande","year":"2012","unstructured":"Mande SS, Mohammed MH, Ghosh TS. Classification of metagenomic sequences: methods and challenges. Brief Bioinform. 2012;13:669\u201381.","journal-title":"Brief Bioinform."},{"key":"3667_CR27","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/S0168-9525(00)89076-9","volume":"11","author":"S Karlin","year":"1995","unstructured":"Karlin S, Burge C. Dinucleotide relative abundance extremes: a genomic signature. Trends Genet. 1995;11:283\u201390.","journal-title":"Trends Genet"},{"key":"3667_CR28","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1186\/s12864-017-4294-1","volume":"18","author":"B Papudeshi","year":"2017","unstructured":"Papudeshi B, Haggerty JM, Doane M, Morris MM, Walsh K, Beattie DT, et al. Optimizing and evaluating the reconstruction of Metagenome-assembled microbial genomes. BMC Genomics. 2017;18:915.","journal-title":"BMC Genomics"},{"key":"3667_CR29","doi-asserted-by":"publisher","first-page":"1144","DOI":"10.1038\/nmeth.3103","volume":"11","author":"J Alneberg","year":"2014","unstructured":"Alneberg J, Bjarnason BS, de Bruijn I, Schirmer M, Quick J, Ijaz UZ, et al. Binning metagenomic contigs by coverage and composition. Nat Methods. 2014;11:1144\u20136.","journal-title":"Nat Methods"},{"key":"3667_CR30","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1186\/s12859-017-1967-3","volume":"18","author":"D Herath","year":"2017","unstructured":"Herath D, Tang S-L, Tandon K, Ackland D, Halgamuge SK. CoMet: a workflow using contig coverage and composition for binning a metagenomic sample with high precision. BMC Bioinformatics. 2017;18:571.","journal-title":"BMC Bioinformatics."},{"key":"3667_CR31","first-page":"17","volume-title":"In Annual International Conference on Research in Computational Molecular Biology","author":"S Chatterji","year":"2008","unstructured":"Chatterji S, Yamazaki I, Bai Z, Eisen JA. CompostBin: A DNA Composition-Based Algorithm for Binning Environmental Shotgun Reads. In: In Annual International Conference on Research in Computational Molecular Biology. Berlin, Heidelberg: Springer; 2008. p. 17\u201328."},{"key":"3667_CR32","doi-asserted-by":"publisher","first-page":"e603","DOI":"10.7717\/peerj.603","volume":"2","author":"M Imelfort","year":"2014","unstructured":"Imelfort M, Parks D, Woodcroft BJ, Dennis P, Hugenholtz P, Tyson GW. GroopM: an automated tool for the recovery of population genomes from related metagenomes. PeerJ. 2014;2:e603.","journal-title":"PeerJ."},{"key":"3667_CR33","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1093\/bioinformatics\/btv638","volume":"32","author":"Y-W Wu","year":"2016","unstructured":"Wu Y-W, Simmons BA, Singer SW. MaxBin 2.0: an automated binning algorithm to recover genomes from multiple metagenomic datasets. Bioinformatics. 2016;32:605\u20137.","journal-title":"Bioinformatics"},{"key":"3667_CR34","doi-asserted-by":"crossref","unstructured":"Lu YY, Chen T, Fuhrman JA, Sun F. COCACOLA: binning metagenomic contigs using sequence COmposition, read CoverAge, CO-alignment and paired-end read LinkAge. Bioinformatics. 2017;33:791-98.","DOI":"10.1093\/bioinformatics\/btw290"},{"key":"3667_CR35","doi-asserted-by":"publisher","first-page":"e7359","DOI":"10.7717\/peerj.7359","volume":"7","author":"DD Kang","year":"2019","unstructured":"Kang DD, Li F, Kirton E, Thomas A, Egan R, An H, et al. MetaBAT 2: an adaptive binning algorithm for robust and efficient genome reconstruction from metagenome assemblies. PeerJ. 2019;7:e7359.","journal-title":"PeerJ."},{"key":"3667_CR36","unstructured":"Critical Assessment of Metagenome Interpretation (CAMI). https:\/\/data.cami-challenge.org\/. Accessed 10 Oct 2019."},{"key":"3667_CR37","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1186\/s13059-019-1646-y","volume":"20","author":"F Meyer","year":"2019","unstructured":"Meyer F, Bremges A, Belmann P, Janssen S, McHardy AC, Koslicki D. Assessing taxonomic metagenome profilers with OPAL. Genome Biol. 2019;20:51.","journal-title":"Genome Biol."},{"key":"3667_CR38","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1038\/nmeth.4458","volume":"14","author":"A Sczyrba","year":"2017","unstructured":"Sczyrba A, Hofmann P, Belmann P, Koslicki D, Janssen S, Dr\u00f6ge J, et al. Critical assessment of Metagenome interpretation\u2014a benchmark of metagenomics software. Nat Methods. 2017;14:1063\u201371.","journal-title":"Nat Methods"},{"issue":"21","key":"3667_CR39","doi-asserted-by":"publisher","first-page":"4229","DOI":"10.1093\/bioinformatics\/btz253","volume":"35","author":"Z Wang","year":"2019","unstructured":"Wang Z, Wang Z, Lu YY, Sun F, Zhu S. SolidBin: improving metagenome binning with semi-supervised normalized cut. Bioinformatics. 2019;35(21):4229\u201338.","journal-title":"Bioinformatics."},{"key":"3667_CR40","doi-asserted-by":"crossref","unstructured":"Nissen JN, S\u00f8nderby CK, Armenteros JJA, Gr\u00f8nbech CH, Bj\u00f8rn Nielsen H, Petersen TN, et al. Binning microbial genomes using deep learning. bioRxiv. 2018;490078.","DOI":"10.1101\/490078"},{"key":"3667_CR41","doi-asserted-by":"publisher","first-page":"410","DOI":"10.3389\/fmicb.2012.00410","volume":"3","author":"M Strous","year":"2012","unstructured":"Strous M, Kraft B, Bisdorf R, Tegetmeyer HE. The binning of metagenomic Contigs for microbial physiology of mixed cultures. Front Microbiol. 2012;3:410.","journal-title":"Front Microbiol"},{"key":"3667_CR42","doi-asserted-by":"publisher","first-page":"e3035","DOI":"10.7717\/peerj.3035","volume":"5","author":"ED Graham","year":"2017","unstructured":"Graham ED, Heidelberg JF, Tully BJ. BinSanity: unsupervised clustering of environmental microbial assemblies using coverage and affinity propagation. PeerJ. 2017;5:e3035.","journal-title":"PeerJ."},{"key":"3667_CR43","doi-asserted-by":"publisher","first-page":"e57","DOI":"10.1093\/nar\/gkz148","volume":"47","author":"IJ Miller","year":"2019","unstructured":"Miller IJ, Rees ER, Ross J, Miller I, Baxa J, Lopera J, et al. Autometa: automated extraction of microbial genomes from individual shotgun metagenomes. Nucleic Acids Res. 2019;47:e57.","journal-title":"Nucleic Acids Res"},{"key":"3667_CR44","doi-asserted-by":"crossref","first-page":"4172","DOI":"10.1093\/bioinformatics\/bty519","volume":"34","author":"G Yu","year":"2018","unstructured":"Yu G, Jiang Y, Wang J, Zhang H, Luo H. BMC3C: binning metagenomic contigs using codon usage, sequence composition and read coverage. Bioinformatics. 2018;34:4172\u20139.","journal-title":"Bioinformatics."},{"key":"3667_CR45","doi-asserted-by":"publisher","first-page":"24175","DOI":"10.1038\/srep24175","volume":"6","author":"H-H Lin","year":"2016","unstructured":"Lin H-H, Liao Y-C. Accurate binning of metagenomic contigs via automated clustering sequences using information of genomic signatures and marker genes. Sci Rep. 2016;6:24175.","journal-title":"Sci Rep"},{"key":"3667_CR46","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1186\/s40168-018-0541-1","volume":"6","author":"GV Uritskiy","year":"2018","unstructured":"Uritskiy GV, DiRuggiero J, Taylor J. MetaWRAP\u2014a flexible pipeline for genome-resolved metagenomic data analysis. Microbiome. 2018;6:158.","journal-title":"Microbiome."},{"key":"3667_CR47","doi-asserted-by":"publisher","first-page":"1873","DOI":"10.1093\/bioinformatics\/btx086","volume":"33","author":"W-Z Song","year":"2017","unstructured":"Song W-Z, Thomas T. Binning_refiner: improving genome bins through the combination of different binning programs. Bioinformatics. 2017;33:1873\u20135.","journal-title":"Bioinformatics."},{"key":"3667_CR48","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1038\/s41564-018-0171-1","volume":"3","author":"CMK Sieber","year":"2018","unstructured":"Sieber CMK, Probst AJ, Sharrar A, Thomas BC, Hess M, Tringe SG, et al. Recovery of genomes from metagenomes via a dereplication, aggregation and scoring strategy. Nat Microbiol. 2018;3:836\u201343.","journal-title":"Nat Microbiol"},{"key":"3667_CR49","unstructured":"Critical Assessment of Metagenome Interpretation (CAMI II). https:\/\/data.cami-challenge.org\/cami2. Accessed 10 Oct 2019."},{"key":"3667_CR50","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1016\/j.cell.2019.07.010","volume":"178","author":"SH Ye","year":"2019","unstructured":"Ye SH, Siddle KJ, Park DJ, Sabeti PC. Benchmarking Metagenomics tools for taxonomic classification. Cell. 2019;178:779\u201394.","journal-title":"Cell."},{"key":"3667_CR51","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1016\/j.jinf.2019.03.012","volume":"78","author":"Y Wang","year":"2019","unstructured":"Wang Y, Hu Y, Cao J, Bi Y, Lv N, Liu F, et al. Antibiotic resistance gene reservoir in live poultry markets. J Infect. 2019;78:445\u201353.","journal-title":"J Infect"},{"key":"3667_CR52","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1101\/gr.213959.116","volume":"27","author":"S Nurk","year":"2017","unstructured":"Nurk S, Meleshko D, Korobeynikov A, Pevzner PA. metaSPAdes: a new versatile metagenomic assembler. Genome Res. 2017;27:824\u201334.","journal-title":"Genome Res"},{"key":"3667_CR53","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1101\/gr.186072.114","volume":"25","author":"DH Parks","year":"2015","unstructured":"Parks DH, Imelfort M, Skennerton CT, Hugenholtz P, Tyson GW. CheckM: assessing the quality of microbial genomes recovered from isolates, single cells, and metagenomes. Genome Res. 2015;25:1043\u201355.","journal-title":"Genome Res"},{"key":"3667_CR54","doi-asserted-by":"publisher","first-page":"3210","DOI":"10.1093\/bioinformatics\/btv351","volume":"31","author":"FA Sim\u00e3o","year":"2015","unstructured":"Sim\u00e3o FA, Waterhouse RM, Ioannidis P, Kriventseva EV, Zdobnov EM. BUSCO: assessing genome assembly and annotation completeness with single-copy orthologs. Bioinformatics. 2015;31:3210\u20132.","journal-title":"Bioinformatics."},{"key":"3667_CR55","doi-asserted-by":"publisher","first-page":"i884","DOI":"10.1093\/bioinformatics\/bty560","volume":"34","author":"S Chen","year":"2018","unstructured":"Chen S, Zhou Y, Chen Y, Gu J. Fastp: an ultra-fast all-in-one FASTQ preprocessor. Bioinformatics. 2018;34:i884\u201390.","journal-title":"Bioinformatics."},{"key":"3667_CR56","doi-asserted-by":"publisher","first-page":"giy069","DOI":"10.1093\/gigascience\/giy069","volume":"7","author":"F Meyer","year":"2018","unstructured":"Meyer F, Hofmann P, Belmann P, Garrido-Oter R, Fritz A, Sczyrba A, et al. AMBER: assessment of metagenome binners. GigaScience. 2018;7:giy069.","journal-title":"GigaScience"},{"key":"3667_CR57","doi-asserted-by":"publisher","first-page":"2567","DOI":"10.1073\/pnas.0409727102","volume":"102","author":"KT Konstantinidis","year":"2005","unstructured":"Konstantinidis KT, Tiedje JM. Genomic insights that advance the species definition for prokaryotes. Proc Natl Acad Sci. 2005;102:2567\u201372.","journal-title":"Proc Natl Acad Sci"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03667-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-020-03667-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03667-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T23:22:23Z","timestamp":1696461743000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-020-03667-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,28]]},"references-count":57,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["3667"],"URL":"https:\/\/doi.org\/10.1186\/s12859-020-03667-3","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,28]]},"assertion":[{"value":"2 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 July 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no conflict of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"334"}}