{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T06:45:08Z","timestamp":1776840308649,"version":"3.51.2"},"reference-count":48,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T00:00:00Z","timestamp":1776816000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioinform."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Selecting appropriate bioinformatics tools is critical for accurate and reproducible analysis, particularly in support of genomic surveillance and molecular biomarker monitoring. The importance of these analyses is underscored by the need for effective public health responses to emerging diseases like SARS-CoV-2.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>By using the detection of SARS-CoV-2 subgenomic RNAs (sgRNAs) as a case study, we show the importance of systematic benchmarking in selecting optimal workflows. We generated 25 synthetic Illumina datasets simulating both shotgun and amplicon sequencing strategies, along with a real-world wastewater dataset. Using these datasets, we assessed the influence of key variables including mutation profiles, read lengths, aligner choice, and primer design for targeted sequencing.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Our results revealed substantial performance variability: common tools developed to identify sgRNAs struggled with shotgun data and were sensitive to mutations depending on the chosen aligner, while amplicon sequencing improved detection sensitivity, with aligners and primer design choices still significantly impacting outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Our results highlight the need for benchmarking steps and analyses to inform workflow selection. Without such evaluations, researchers risk drawing inaccurate conclusions from suboptimal workflows. This case study underscores the value of context-aware tool selection and encourages standardised benchmarking practices to ensure reproducibility and reliability in bioinformatics analysis, particularly in evidence-based decision-making environments such as public health and policymaking.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fbinf.2026.1803237","type":"journal-article","created":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T05:47:50Z","timestamp":1776836870000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["How benchmarking of bioinformatics tools is essential for informed workflow selection: a case study on SARS-CoV-2 subgenomic RNA detection"],"prefix":"10.3389","volume":"6","author":[{"given":"Gabriele","family":"Leoni","sequence":"first","affiliation":[{"name":"European Commission, Joint Research Centre (JRC)","place":["Ispra, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mauro","family":"Petrillo","sequence":"additional","affiliation":[{"name":"Seidor Italy S.r.l.","place":["Milan, Italy"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Man-Hung Eric","family":"Tang","sequence":"additional","affiliation":[{"name":"Department of Sequencing and Bioinformatics, Statens Serum Institut","place":["Copenhagen, Denmark"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Soren","family":"Alexandersen","sequence":"additional","affiliation":[{"name":"Department of Animal and Veterinary Sciences, AU-Viborg, Research Centre Foulum, Aarhus University","place":["Tjele, Denmark"]},{"name":"School of Medicine, Deakin University","place":["Geelong, VIC, Australia"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,4,22]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"6059","DOI":"10.1038\/s41467-020-19883-7","article-title":"SARS-CoV-2 genomic and subgenomic RNAs in diagnostic samples are not an indicator of active replication","volume":"11","author":"Alexandersen","year":"2020","journal-title":"Nat. Commun."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1293","DOI":"10.1128\/jvi.76.3.1293-1308.2002","article-title":"Transcription regulatory sequences and mRNA expression levels in the coronavirus transmissible gastroenteritis virus","volume":"76","author":"Alonso","year":"2002","journal-title":"J. Virology"},{"key":"B3","doi-asserted-by":"publisher","first-page":"e82","DOI":"10.1093\/nar\/gkae687","article-title":"Improved sub-genomic RNA prediction with the ARTIC protocol","volume":"52","author":"Baudeau","year":"2024","journal-title":"Nucleic Acids Res."},{"key":"B4","doi-asserted-by":"publisher","first-page":"veaa075","DOI":"10.1093\/ve\/veaa075","article-title":"Evaluation of NGS-based approaches for SARS-CoV-2 whole genome characterisation","volume":"6","author":"Charre","year":"2020","journal-title":"Virus Evol."},{"key":"B5","doi-asserted-by":"publisher","first-page":"e00776","DOI":"10.1128\/spectrum.00776-23","article-title":"Unambiguous detection of SARS-CoV-2 subgenomic mRNAs with single-cell RNA sequencing","volume":"11","author":"Cohen","year":"2023","journal-title":"Microbiol. Spectr."},{"key":"B6","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1016\/j.future.2017.01.012","article-title":"Scientific workflows for computational reproducibility in the life sciences: status, challenges and opportunities","volume":"75","author":"Cohen-Boulakia","year":"2017","journal-title":"Future Gener. Comput. Syst."},{"key":"B7","doi-asserted-by":"publisher","first-page":"430","DOI":"10.3390\/v16030430","article-title":"Recommendations for uniform variant calling of SARS-CoV-2 genome sequence across bioinformatic workflows","volume":"16","author":"Connor","year":"2024","journal-title":"Viruses"},{"key":"B8","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1186\/s13073-020-00763-0","article-title":"Characterisation of the transcriptome and proteome of SARS-CoV-2 reveals a cell passage induced in-frame deletion of the furin-like cleavage site from the spike glycoprotein","volume":"12","author":"Davidson","year":"2020","journal-title":"Genome Med."},{"key":"B9","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1261\/rna.078969.121","article-title":"sgDI-tector: defective interfering viral genome bioinformatics for detection of coronavirus subgenomic RNAs","volume":"28","author":"Di Gioacchino","year":"2022","journal-title":"RNA"},{"key":"B10","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1038\/nbt.3820","article-title":"Nextflow enables reproducible computational workflows","volume":"35","author":"Di Tommaso","year":"2017","journal-title":"Nat. Biotechnol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"giac045","DOI":"10.1093\/gigascience\/giac045","article-title":"Analysis of SARS-CoV-2 known and novel subgenomic mRNAs in cell culture, animal model, and clinical samples using LeTRS, a bioinformatic tool to identify unique sequence identifiers","volume":"11","author":"Dong","year":"2022","journal-title":"Gigascience"},{"key":"B13","doi-asserted-by":"publisher","first-page":"e0334009","DOI":"10.1371\/journal.pone.0334009","article-title":"SARS-CoV-2 sequencing artifacts associated with targeted PCR enrichment and read mapping","volume":"20","author":"Ellegaard","year":"2025","journal-title":"PLOS ONE"},{"key":"B14","doi-asserted-by":"publisher","article-title":"SARS-CoV-2 sgRNA in silico dataset","year":"2026","DOI":"10.2905\/JRC.1RYH4D0"},{"key":"B15","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1038\/s41586-020-2739-1","article-title":"The coding capacity of SARS-CoV-2","volume":"589","author":"Finkel","year":"2021","journal-title":"Nature"},{"key":"B16","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1093\/bioinformatics\/bty630","article-title":"Simulating illumina metagenomic data with InSilicoSeq","volume":"35","author":"Gourl\u00e9","year":"2019","journal-title":"Bioinformatics"},{"key":"B17","doi-asserted-by":"publisher","first-page":"100617","DOI":"10.1016\/j.onehlt.2023.100617","article-title":"Developing one health surveillance systems","volume":"17","author":"Hayman","year":"2023","journal-title":"One Health"},{"key":"B18","doi-asserted-by":"publisher","first-page":"6219","DOI":"10.1128\/JVI.69.10.6219-6227.1995","article-title":"Investigation of the control of coronavirus subgenomic mRNA transcription by using T7-generated negative-sense RNA transcripts","volume":"69","author":"Hiscox","year":"1995","journal-title":"J. Virol."},{"key":"B19","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1038\/s41587-019-0201-4","article-title":"Graph-based genome alignment and genotyping with HISAT2 and HISAT-genotype","volume":"37","author":"Kim","year":"2019","journal-title":"Nat. Biotechnol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"914","DOI":"10.1016\/j.cell.2020.04.011","article-title":"The architecture of SARS-CoV-2 transcriptome","volume":"181","author":"Kim","year":"2020","journal-title":"Cell"},{"key":"B21","doi-asserted-by":"publisher","first-page":"121223","DOI":"10.1016\/j.watres.2024.121223","article-title":"Results from the SARS-CoV-2 wastewater-based surveillance system in Denmark, July 2021 to June 2022","volume":"252","author":"Krogsgaard","year":"2024","journal-title":"Water Res."},{"key":"B22","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1016\/0042-6822(92)90774-j","article-title":"Coronavirus mRNA synthesis: identification of novel transcription initiation signals which are differentially regulated by different leader sequences","volume":"188","author":"La Monica","year":"1992","journal-title":"Virology"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e202302017","DOI":"10.26508\/lsa.202302017","article-title":"Comparative analysis of bioinformatics tools to characterize SARS-CoV-2 subgenomic RNAs","volume":"6","author":"Lavezzari","year":"2023","journal-title":"Life Sci. Alliance"},{"key":"B24","doi-asserted-by":"publisher","first-page":"27","DOI":"10.20411\/pai.v6i2.460","article-title":"Generation of a novel SARS-CoV-2 Sub-genomic RNA due to the R203K\/G204R variant in nucleocapsid: homologous recombination has potential to change SARS-CoV-2 at both protein and RNA level: SARS-CoV-2 variant changes protein and RNA level","volume":"6","author":"Leary","year":"2021","journal-title":"Pathogens Immun."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1093\/bioinformatics\/btp324","article-title":"Fast and accurate short read alignment with burrows\u2013wheeler transform","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"key":"B26","doi-asserted-by":"publisher","first-page":"btaf102","DOI":"10.1093\/bioinformatics\/btaf102","article-title":"PathoSeq-QC: a decision support bioinformatics workflow for robust genomic surveillance","volume":"41","author":"Leoni","year":"2025","journal-title":"Bioinformatics"},{"key":"B27","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1038\/s41579-020-0421-0","article-title":"Genomics and epidemiological surveillance","volume":"18","author":"Lo","year":"2020","journal-title":"Nat. Rev. Microbiol."},{"key":"B28","doi-asserted-by":"publisher","first-page":"1923","DOI":"10.3390\/v13101923","article-title":"SARS-CoV-2 subgenomic RNAs: characterization, utility, and perspectives","volume":"13","author":"Long","year":"2021","journal-title":"Viruses."},{"key":"B29","doi-asserted-by":"publisher","first-page":"e3000333","DOI":"10.1371\/journal.pbio.3000333","article-title":"Challenges and recommendations to improve the installability and archival stability of omics computational tools","volume":"17","author":"Mangul","year":"2019","journal-title":"PLOS Biol."},{"key":"B30","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/S0065-3527(06)66005-3","article-title":"The molecular biology of coronaviruses","volume":"66","author":"Masters","year":"2006","journal-title":"Adv. Virus Res."},{"key":"B31","doi-asserted-by":"publisher","first-page":"100008","DOI":"10.1016\/j.amolm.2023.100008","article-title":"sgRNAs: a SARS-CoV-2 emerging issue","volume":"1","author":"Mori","year":"2023","journal-title":"Aspects Mol. Med."},{"key":"B32","doi-asserted-by":"publisher","first-page":"7362","DOI":"10.1128\/JVI.75.16.7362-7374.2001","article-title":"Downstream sequences influence the choice between a naturally occurring noncanonical and closely positioned upstream canonical heptameric fusion motif during bovine coronavirus subgenomic mRNA synthesis","volume":"75","author":"Ozdarendeli","year":"2001","journal-title":"J. Virology"},{"key":"B33","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1101\/gr.268110.120","article-title":"Subgenomic RNA identification in SARS-CoV-2 genomic sequencing data","volume":"31","author":"Parker","year":"2021","journal-title":"Genome Res."},{"key":"B34","doi-asserted-by":"publisher","first-page":"100029","DOI":"10.1016\/j.xgen.2021.100029","article-title":"GA4GH: international policies and standards for data sharing across genomic research and healthcare","volume":"1","author":"Rehm","year":"2021","journal-title":"Cell Genom"},{"key":"B35","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/nbt.1754","article-title":"Integrative genomics viewer","volume":"29","author":"Robinson","year":"2011","journal-title":"Nat. Biotechnology"},{"key":"B36","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1007\/978-1-4615-1899-0_79","article-title":"Coronaviruses use discontinuous extension for synthesis of subgenome-length negative strands","volume-title":"Corona- and related viruses: current concepts in molecular biology and pathogenesis","author":"Sawicki","year":"1995"},{"key":"B37","doi-asserted-by":"publisher","first-page":"14","DOI":"10.26904\/RF-143-3232581013","article-title":"The Nagoya protocol and access and benefit sharing (ABS) - responsibilities for users of biological materials","volume":"143","author":"Scholz","year":"2022","journal-title":"Res. Featur."},{"key":"B38","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1146\/annurev-virology-100114-055218","article-title":"Continuous and discontinuous RNA synthesis in coronaviruses","volume":"2","author":"Sola","year":"2015","journal-title":"Annu. Rev. Virol."},{"key":"B39","first-page":"2020.03.05.976167","article-title":"Direct RNA sequencing and early evolution of SARS-CoV-2","author":"Taiaroa","year":"2020","journal-title":"BioRxiv"},{"key":"B40","doi-asserted-by":"publisher","first-page":"104669","DOI":"10.1016\/j.ebiom.2023.104669","article-title":"Comparative subgenomic mRNA profiles of SARS-CoV-2 alpha, Delta and omicron BA.1, BA.2 and BA.5 sub-lineages using Danish COVID-19 genomic surveillance data","volume":"93","author":"Tang","year":"2023","journal-title":"eBioMedicine"},{"key":"B41","doi-asserted-by":"publisher","first-page":"e29703","DOI":"10.1016\/j.heliyon.2024.e29703","article-title":"Variations in the persistence of 5\u2032-end genomic and subgenomic SARS-CoV-2 RNAs in wastewater from aircraft, airports and wastewater treatment plants","volume":"10","author":"Tang","year":"2024","journal-title":"Heliyon"},{"key":"B42","doi-asserted-by":"publisher","first-page":"2305","DOI":"10.1099\/vir.0.19424-0","article-title":"Mechanisms and enzymes involved in SARS coronavirus genome expression","volume":"84","author":"Thiel","year":"2003","journal-title":"J. General Virology"},{"key":"B43","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1038\/s41586-021-04352-y","article-title":"Evolution of enhanced innate immune evasion by SARS-CoV-2","volume":"602","author":"Thorne","year":"2022","journal-title":"Nature"},{"key":"B44","doi-asserted-by":"publisher","first-page":"7851","DOI":"10.1128\/JVI.69.12.7851-7856.1995","article-title":"Regulation of coronavirus mRNA transcription","volume":"69","author":"van Marle","year":"1995","journal-title":"J. Virology"},{"key":"B45","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1186\/s13059-019-1738-8","article-title":"Essential guidelines for computational method benchmarking","volume":"20","author":"Weber","year":"2019","journal-title":"Genome Biol."},{"key":"B46","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1038\/s41597-025-04451-9","article-title":"Applying the FAIR principles to computational workflows","volume":"12","author":"Wilkinson","year":"2025","journal-title":"Sci. Data"},{"key":"B47","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1038\/s41586-020-2196-x","article-title":"Virological assessment of hospitalized patients with COVID-2019","volume":"581","author":"W\u00f6lfel","year":"2020","journal-title":"Nature"},{"key":"B48","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1038\/s43856-021-00034-y","article-title":"Reduced subgenomic RNA expression is a molecular indicator of asymptomatic SARS-CoV-2 infection","volume":"1","author":"Wong","year":"2021","journal-title":"Commun. Med. (Lond)."},{"key":"B49","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1038\/s41586-020-2008-3","article-title":"A new coronavirus associated with human respiratory disease in China","volume":"579","author":"Wu","year":"2020","journal-title":"Nature"}],"container-title":["Frontiers in Bioinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2026.1803237\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T05:47:51Z","timestamp":1776836871000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2026.1803237\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,22]]},"references-count":48,"alternative-id":["10.3389\/fbinf.2026.1803237"],"URL":"https:\/\/doi.org\/10.3389\/fbinf.2026.1803237","relation":{},"ISSN":["2673-7647"],"issn-type":[{"value":"2673-7647","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,22]]},"article-number":"1803237"}}