{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T00:51:59Z","timestamp":1792803119891,"version":"4.5.0"},"reference-count":76,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T00:00:00Z","timestamp":1674604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Microbiol."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>As new computational tools for detecting phage in metagenomes are being rapidly developed, a critical need has emerged to develop systematic benchmarks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this study, we surveyed 19 metagenomic phage detection tools, 9 of which could be installed and run at scale. Those 9 tools were assessed on several benchmark challenges. Fragmented reference genomes are used to assess the effects of fragment length, low viral content, phage taxonomy, robustness to eukaryotic contamination, and computational resource usage. Simulated metagenomes are used to assess the effects of sequencing and assembly quality on the tool performances. Finally, real human gut metagenomes and viromes are used to assess the differences and similarities in the phage communities predicted by the tools.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We find that the various tools yield strikingly different results. Generally, tools that use a homology approach (VirSorter, MARVEL, viralVerify, VIBRANT, and VirSorter2) demonstrate low false positive rates and robustness to eukaryotic contamination. Conversely, tools that use a sequence composition approach (VirFinder, DeepVirFinder, Seeker), and MetaPhinder, have higher sensitivity, including to phages with less representation in reference databases. These differences led to widely differing predicted phage communities in human gut metagenomes, with nearly 80% of contigs being marked as phage by at least one tool and a maximum overlap of 38.8% between any two tools. While the results were more consistent among the tools on viromes, the differences in results were still significant, with a maximum overlap of 60.65%. Discussion: Importantly, the benchmark datasets developed in this study are publicly available and reusable to enable the future comparability of new tools developed.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fmicb.2023.1078760","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T02:25:43Z","timestamp":1674527143000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["Evaluation of computational phage detection tools for metagenomic datasets"],"prefix":"10.3389","volume":"14","author":[{"suffix":"III","given":"Kenneth E.","family":"Schackart","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica B.","family":"Graham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alise J.","family":"Ponsero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bonnie L.","family":"Hurwitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,1,25]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1109\/ICCES.2018.8639400","article-title":"VirNet: Deep attention model for viral reads identification","author":"Abdelkareem","year":"2018","journal-title":"Proceedings of the 2018 13th international conference on computer engineering and systems (ICCES)"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2018.00304","article-title":"MARVEL, a tool for prediction of bacteriophage sequences in metagenomic bins.","volume":"9","author":"Amgarten","year":"2018","journal-title":"Front. Genet."},{"key":"B3","author":"Andrews","year":"2010","journal-title":"FastQC: A quality control tool for high throughput sequence data."},{"key":"B4","doi-asserted-by":"publisher","first-page":"4126","DOI":"10.1093\/bioinformatics\/btaa490","article-title":"Metaviral SPAdes: Assembly of viruses from metagenomic data.","volume":"36","author":"Antipov","year":"2020","journal-title":"Bioinformatics"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkaa856","article-title":"Seeker: Alignment-free identification of bacteriophage genomes by deep learning.","volume":"48","author":"Auslander","year":"2020","journal-title":"Nucleic Acids Res."},{"key":"B6","year":"2022","journal-title":"\u201cTrim Galore!\u201d."},{"key":"B7","doi-asserted-by":"publisher","first-page":"4264","DOI":"10.1093\/bioinformatics\/btac509","article-title":"Identification of bacteriophage genome sequences with representation learning.","volume":"38","author":"Bai","year":"2022","journal-title":"Bioinformatics"},{"key":"B8","doi-asserted-by":"publisher","first-page":"3119","DOI":"10.1038\/s41396-021-01012-x","article-title":"Community context matters for bacteria-phage ecology and evolution.","volume":"15","author":"Blazanin","year":"2021","journal-title":"ISME J."},{"key":"B9","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.tim.2005.04.003","article-title":"Here a virus, there a virus, everywhere the same virus?","volume":"13","author":"Breitbart","year":"2005","journal-title":"Trends Microbiol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1038\/s41564-018-0166-y","article-title":"Phage puppet masters of the marine microbial realm.","volume":"3","author":"Breitbart","year":"2018","journal-title":"Nat. Microbiol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"14250","DOI":"10.1073\/pnas.202488399","article-title":"Genomic analysis of uncultured marine viral communities.","volume":"99","author":"Breitbart","year":"2002","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1098","DOI":"10.1016\/j.cell.2021.01.029","article-title":"Massive expansion of human gut bacteriophage diversity.","volume":"184","author":"Camarillo-Guerrero","year":"2021","journal-title":"Cell"},{"key":"B13","year":"2022","journal-title":"CyVerse the open science workspace for collaborative data-driven discovery."},{"key":"B14","doi-asserted-by":"publisher","first-page":"2580","DOI":"10.1093\/bioinformatics\/btx192","article-title":"BioContainers: an open-source and community-driven framework for software standardization.","volume":"33","author":"da Veiga Leprevost","year":"2017","journal-title":"Bioinformatics"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1101\/169672","article-title":"PhaMers identifies novel bacteriophage sequences from thermophilic hot springs.","author":"Deaton","year":"2017","journal-title":"BioRxiv"},{"key":"B16","year":"2022","journal-title":"Docker hub container image library | app containerization."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.3402\/jom.v7.27423","article-title":"Bacteriophage and their potential roles in the human oral cavity.","volume":"7","author":"Edlund","year":"2015","journal-title":"J. Oral Microbiol."},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giz066","article-title":"PPR-Meta: A tool for identifying phages and plasmids from metagenomic fragments using deep learning.","volume":"8","author":"Fang","year":"2019","journal-title":"Gigascience"},{"key":"B19","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1097\/MPG.0000000000002140","article-title":"Enteric virome and bacterial microbiota in children with ulcerative colitis and crohn disease.","volume":"68","author":"Fernandes","year":"2019","journal-title":"J. Pediatr. Gastroenterol. Nutr."},{"key":"B20","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1038\/21119","article-title":"Marine viruses and their biogeochemical and ecological effects.","volume":"399","author":"Fuhrman","year":"1999","journal-title":"Nature"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.6695","article-title":"virMine: Automated detection of viral sequences from complex metagenomic samples.","volume":"7","author":"Garretto","year":"2019","journal-title":"PeerJ"},{"key":"B22","article-title":"Datasheets for datasets.","author":"Gebru","year":"2021","journal-title":"ArXiv"},{"key":"B23","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1093\/bioinformatics\/bty630","article-title":"Simulating illumina metagenomic data with InSilicoSeq.","volume":"35","author":"Gourl\u00e9","year":"2019","journal-title":"Bioinformatics"},{"key":"B24","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1016\/j.chom.2020.08.003","article-title":"The gut virome database reveals age-dependent patterns of virome diversity in the human gut","volume":"28","author":"Gregory","year":"2020","journal-title":"Cell Host Microbe"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1186\/s40168-020-00990-y","article-title":"VirSorter2: A multi-classifier, expert-guided approach to detect diverse DNA and RNA viruses.","volume":"9","author":"Guo","year":"2021","journal-title":"Microbiome"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1016\/j.watres.2022.118484","article-title":"A snapshot of the global drinking water virome: Diversity and metabolic potential vary with residual disinfectant use.","volume":"218","author":"Hegarty","year":"2022","journal-title":"Water Res."},{"key":"B27","article-title":"Comprehensive benchmarking of tools to identify phages in metagenomic shotgun sequencing data.","author":"Ho","year":"2021","journal-title":"bioRxiv"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1101\/2021.04.12.438782","article-title":"Gauge your phage: Benchmarking of bacteriophage identification tools in metagenomic sequencing data.","author":"Ho","year":"2022","journal-title":"bioRxiv"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1101\/2021.10.26.466018","article-title":"DeepMicrobeFinder Sorts metagenomes into prokaryotes, eukaryotes and viruses, with marine applications.","author":"Hou","year":"2021","journal-title":"bioRxiv"},{"key":"B30","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.mib.2016.04.002","article-title":"Viral metabolic reprogramming in marine ecosystems.","volume":"31","author":"Hurwitz","year":"2016","journal-title":"Curr. Opin. Microbiol."},{"key":"B31","doi-asserted-by":"publisher","first-page":"3094","DOI":"10.1038\/s41396-021-00994-y","article-title":"Diversity and distribution of viruses inhabiting the deepest ocean on Earth.","volume":"15","author":"Jian","year":"2021","journal-title":"ISME J."},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-28581-5","article-title":"Genome binning of viral entities from bulk metagenomics data.","volume":"13","author":"Johansen","year":"2022","journal-title":"Nat. Commun."},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1128\/mra.00107-22","article-title":"virMine 2.0: Identifying viral sequences in microbial communities.","volume":"11","author":"Johnson","year":"2022","journal-title":"Microbiol. Resour. Announc."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0163111","article-title":"MetaPhinder-identifying bacteriophage sequences in metagenomic data sets.","volume":"11","author":"Jurtz","year":"2016","journal-title":"PLoS One"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.7359","article-title":"MetaBAT 2: An adaptive binning algorithm for robust and efficient genome reconstruction from metagenome assemblies.","volume":"7","author":"Kang","year":"2019","journal-title":"PeerJ"},{"key":"B36","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/0967-0645(96)00005-7","article-title":"The Hawaii ocean time-series (HOT) program: Background, Rationale and field implementation.","volume":"43","author":"Karl","year":"1996","journal-title":"Deep Sea Res. II Top. Stud. Oceanogr."},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1186\/s40168-020-00867-0","article-title":"VIBRANT: Automated recovery, annotation and curation of microbial viruses, and evaluation of viral community function from genomic sequences.","volume":"8","author":"Kieft","year":"2020","journal-title":"Microbiome"},{"key":"B38","doi-asserted-by":"publisher","first-page":"2520","DOI":"10.1093\/bioinformatics\/bts480","article-title":"Snakemake\u2013a scalable bioinformatics workflow engine.","volume":"28","author":"K\u00f6ster","year":"2012","journal-title":"Bioinformatics"},{"key":"B39","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/nmeth.1923","article-title":"Fast gapped-read alignment with Bowtie 2.","volume":"9","author":"Langmead","year":"2012","journal-title":"Nat. Methods"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1674","DOI":"10.1093\/bioinformatics\/btv033","article-title":"MEGAHIT: An ultra-fast single-node solution for large and complex metagenomics assembly via succinct de Bruijn graph.","volume":"31","author":"Li","year":"2015","journal-title":"Bioinformatics"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1084\/jem.20201044","article-title":"The dark side of the gut: Virome-host interactions in intestinal homeostasis and disease.","volume":"218","author":"Li","year":"2021","journal-title":"J. Exp. Med."},{"key":"B42","doi-asserted-by":"publisher","first-page":"1840","DOI":"10.1109\/TCBB.2020.3044575","article-title":"VirSeeker: A deep learning method for identification of short viral sequences from metagenomes.","volume":"19","author":"Liu","year":"2022","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2022.3161135","article-title":"virSearcher: Identifying bacteriophages from metagenomes by combining convolutional neural network and gene information.","author":"Liu","year":"2022","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.104","article-title":"Bracken: Estimating species abundance in metagenomics data.","volume":"3","author":"Lu","year":"2017","journal-title":"PeerJ Comput. Sci."},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.3390\/v9060141","article-title":"The human gut phage community and its implications for health and disease.","volume":"9","author":"Manrique","year":"2017","journal-title":"Viruses"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giac110","article-title":"What the phage: A scalable workflow for the identification and analysis of phage sequences.","volume":"11","author":"Marquet","year":"2022","journal-title":"Gigascience"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2164-13-74","article-title":"GemSIM: General, error-model based simulator of next-generation sequencing data.","volume":"13","author":"McElroy","year":"2012","journal-title":"BMC Genomics"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-019-1646-y","article-title":"Assessing taxonomic metagenome profilers with OPAL.","volume":"20","author":"Meyer","year":"2019","journal-title":"Genome Biol."},{"key":"B49","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1038\/s41587-020-00774-7","article-title":"CheckV assesses the quality and completeness of metagenome-assembled viral genomes.","volume":"39","author":"Nayfach","year":"","journal-title":"Nat. Biotechnol."},{"key":"B50","doi-asserted-by":"publisher","first-page":"960","DOI":"10.1038\/s41564-021-00928-6","article-title":"Metagenomic compendium of 189,680 DNA viruses from the human gut microbiome.","volume":"6","author":"Nayfach","year":"","journal-title":"Nat. Microbiol."},{"key":"B51","doi-asserted-by":"publisher","first-page":"1260","DOI":"10.1016\/j.cell.2017.10.045","article-title":"Contemporary phage biology: From classic models to new insights.","volume":"172","author":"Ofir","year":"2018","journal-title":"Cell"},{"key":"B52","doi-asserted-by":"publisher","first-page":"D733","DOI":"10.1093\/nar\/gkv1189","article-title":"Reference sequence (RefSeq) database at NCBI: Current status, taxonomic expansion, and functional annotation.","volume":"44","author":"O\u2019Leary","year":"2016","journal-title":"Nucleic Acids Res."},{"key":"B53","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.1038\/nprot.2017.063","article-title":"Nontargeted virus sequence discovery pipeline and virus clustering for metagenomic data.","volume":"12","author":"Paez-Espino","year":"2017","journal-title":"Nat. Protoc."},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.3389\/fmicb.2019.00806","article-title":"The Promises and pitfalls of machine learning for detecting viruses in aquatic metagenomes.","volume":"10","author":"Ponsero","year":"2019","journal-title":"Front. Microbiol."},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.11447","article-title":"Expanding standards in viromics: In silico evaluation of dsDNA viral genome identification, classification, and auxiliary metabolic gene curation.","volume":"9","author":"Pratama","year":"2021","journal-title":"PeerJ"},{"key":"B56","doi-asserted-by":"publisher","first-page":"ii56","DOI":"10.1093\/bioinformatics\/btac468","article-title":"3CAC: Improving the classification of phages and plasmids in metagenomic assemblies using assembly graphs.","volume":"38","author":"Pu","year":"2022","journal-title":"Bioinformatics"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1186\/s40168-017-0283-5","article-title":"VirFinder: A novel k-mer based tool for identifying viral sequences from assembled metagenomic data.","volume":"5","author":"Ren","year":"2017","journal-title":"Microbiome"},{"key":"B58","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1007\/s40484-019-0187-4","article-title":"Identifying viruses from metagenomic data using deep learning.","volume":"8","author":"Ren","year":"2020","journal-title":"Quant. Biol."},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0003373","article-title":"MetaSim: A sequencing simulator for genomics and metagenomics.","volume":"3","author":"Richter","year":"2008","journal-title":"PLoS One"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.54449.2","article-title":"Philympics 2021: Prophage predictions perplex programs.","volume":"10","author":"Roach","year":"2022","journal-title":"F1000Res."},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.985","article-title":"VirSorter: Mining viral signal from microbial genomic data.","volume":"3","author":"Roux","year":"2015","journal-title":"PeerJ"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1186\/2049-2618-2-17","article-title":"The Amazon continuum dataset: Quantitative metagenomic and metatranscriptomic inventories of the Amazon River plume, June 2010.","volume":"2","author":"Satinsky","year":"2014","journal-title":"Microbiome"},{"key":"B63","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1038\/nmeth.4458","article-title":"Critical assessment of metagenome interpretation-a benchmark of metagenomics software.","volume":"14","author":"Sczyrba","year":"2017","journal-title":"Nat. Methods"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbac258","article-title":"Accurate identification of bacteriophages from metagenomic data using transformer.","volume":"23","author":"Shang","year":"2022","journal-title":"Brief. Bioinform."},{"key":"B65","doi-asserted-by":"publisher","first-page":"42","DOI":"10.3934\/microbiol.2018.1.42","article-title":"Oral microbiome and health.","volume":"4","author":"Sharma","year":"2018","journal-title":"AIMS Microbiol."},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0222271","article-title":"ViraMiner: Deep learning on raw DNA sequences for identifying viral genomes in human samples.","volume":"14","author":"Tampuu","year":"2019","journal-title":"PLoS One"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1093\/ve\/veaa100","article-title":"Cenote-taker 2 democratizes virus discovery and sequence annotation.","volume":"7","author":"Tisza","year":"2020","journal-title":"Virus Evol."},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.3390\/v13030506","article-title":"Roadmap for genome-based phage taxonomy.","volume":"13","author":"Turner","year":"2021","journal-title":"Viruses"},{"key":"B69","doi-asserted-by":"publisher","first-page":"427","DOI":"10.4056\/sigs.2945050","article-title":"VIROME: A standard operating procedure for analysis of viral metagenome sequences.","volume":"6","author":"Wommack","year":"2012","journal-title":"Stand. Genomic Sci."},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-019-1891-0","article-title":"Improved metagenomic analysis with Kraken 2.","volume":"20","author":"Wood","year":"2019","journal-title":"Genome Biol."},{"key":"B71","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1007\/10968987_3","article-title":"SLURM: Simple linux utility for resource management","author":"Yoo","year":"2003","journal-title":"Job scheduling strategies for parallel processing"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-020-03665-5","article-title":"SimuSCoP: Reliably simulate illumina sequencing data based on position and context dependent profiles.","volume":"21","author":"Yu","year":"2020","journal-title":"BMC Bioinformatics"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.15252\/msb.20145645","article-title":"Potential of fecal microbiota for early-stage detection of colorectal cancer.","volume":"10","author":"Zeller","year":"2014","journal-title":"Mol. Syst. Biol."},{"key":"B74","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.virol.2017.01.005","article-title":"VirusSeeker, a computational pipeline for virus discovery and virome composition analysis.","volume":"503","author":"Zhao","year":"2017","journal-title":"Virology"},{"key":"B75","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1093\/bfgp\/elw012","article-title":"Systematic review of next-generation sequencing simulators: Computational tools, features and perspectives.","volume":"16","author":"Zhao","year":"2017","journal-title":"Brief. Funct. Genomics"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1186\/s40168-019-0657-y","article-title":"Mining, analyzing, and integrating viral signals from metagenomic data.","volume":"7","author":"Zheng","year":"2019","journal-title":"Microbiome"}],"container-title":["Frontiers in Microbiology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmicb.2023.1078760\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T02:25:47Z","timestamp":1674527147000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmicb.2023.1078760\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,25]]},"references-count":76,"alternative-id":["10.3389\/fmicb.2023.1078760"],"URL":"https:\/\/doi.org\/10.3389\/fmicb.2023.1078760","relation":{},"ISSN":["1664-302X"],"issn-type":[{"value":"1664-302X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,25]]},"article-number":"1078760"}}