{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T22:04:22Z","timestamp":1776809062155,"version":"3.51.2"},"reference-count":73,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T00:00:00Z","timestamp":1672012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U01 CA235493"],"award-info":[{"award-number":["U01 CA235493"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,1,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Background: Global or untargeted metabolomics is widely used to comprehensively investigate metabolic profiles under various pathophysiological conditions such as inflammations, infections, responses to exposures or interactions with microbial communities. However, biological interpretation of global metabolomics data remains a daunting task. Recent years have seen growing applications of pathway enrichment analysis based on putative annotations of liquid chromatography coupled with mass spectrometry (LC\u2013MS) peaks for functional interpretation of LC\u2013MS-based global metabolomics data. However, due to intricate peak-metabolite and metabolite-pathway relationships, considerable variations are observed among results obtained using different approaches. There is an urgent need to benchmark these approaches to inform the best practices. Results: We have conducted a benchmark study of common peak annotation approaches and pathway enrichment methods in current metabolomics studies. Representative approaches, including three peak annotation methods and four enrichment methods, were selected and benchmarked under different scenarios. Based on the results, we have provided a set of recommendations regarding peak annotation, ranking metrics and feature selection. The overall better performance was obtained for the mummichog approach. We have observed that a\u2009~30% annotation rate is sufficient to achieve high recall (~90% based on mummichog), and using semi-annotated data improves functional interpretation. Based on the current platforms and enrichment methods, we further propose an identifiability index to indicate the possibility of a pathway being reliably identified. Finally, we evaluated all methods using 11 COVID-19 and 8 inflammatory bowel diseases (IBD) global metabolomics datasets.<\/jats:p>","DOI":"10.1093\/bib\/bbac553","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T03:51:30Z","timestamp":1672113090000},"source":"Crossref","is-referenced-by-count":151,"title":["Comprehensive investigation of pathway enrichment methods for functional interpretation of LC\u2013MS global metabolomics data"],"prefix":"10.1093","volume":"24","author":[{"given":"Yao","family":"Lu","sequence":"first","affiliation":[{"name":"Department of Microbiology and Immunology, McGill University , Quebec, Canada"}]},{"given":"Zhiqiang","family":"Pang","sequence":"additional","affiliation":[{"name":"Institute of Parasitology, McGill University , Quebec, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2040-2624","authenticated-orcid":false,"given":"Jianguo","family":"Xia","sequence":"additional","affiliation":[{"name":"Department of Microbiology and Immunology, McGill University , Quebec, Canada"},{"name":"Institute of Parasitology, McGill University , Quebec, Canada"}]}],"member":"286","published-online":{"date-parts":[[2022,12,26]]},"reference":[{"key":"2023011917133659600_ref1","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1038\/nrm.2016.25","article-title":"Metabolomics: beyond biomarkers and towards mechanisms","volume":"17","author":"Johnson","year":"2016","journal-title":"Nat Rev Mol Cell Biol"},{"key":"2023011917133659600_ref2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.cell.2020.05.032","article-title":"Proteomic and metabolomic characterization of COVID-19 patient sera","volume":"182","author":"Shen","year":"2020","journal-title":"Cell"},{"key":"2023011917133659600_ref3","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1038\/s41588-020-00751-5","article-title":"A cross-platform approach identifies genetic regulators of human metabolism and health","volume":"53","author":"Lotta","year":"2021","journal-title":"Nat Genet"},{"key":"2023011917133659600_ref4","doi-asserted-by":"crossref","DOI":"10.1038\/s41591-022-01980-3","article-title":"Metabolomic profiles predict individual multidisease outcomes","volume":"28","author":"Buergel","year":"2022","journal-title":"Nat Med"},{"key":"2023011917133659600_ref5","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.copbio.2018.07.010","article-title":"Challenges, progress and promises of metabolite annotation for LC-MS-based metabolomics","volume":"55","author":"Chaleckis","year":"2019","journal-title":"Curr Opin Biotechnol"},{"key":"2023011917133659600_ref6","doi-asserted-by":"crossref","first-page":"D480","DOI":"10.1093\/nar\/gkm882","article-title":"KEGG for linking genomes to life and the environment","volume":"36","author":"Kanehisa","year":"2008","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref7","doi-asserted-by":"crossref","first-page":"D445","DOI":"10.1093\/nar\/gkz862","article-title":"The MetaCyc database of metabolic pathways and enzymes - a 2019 update","volume":"48","author":"Caspi","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref8","doi-asserted-by":"crossref","first-page":"3710","DOI":"10.1093\/bioinformatics\/bth456","article-title":"GO::TermFinder--open source software for accessing Gene Ontology information and finding significantly enriched Gene Ontology terms associated with a list of genes","volume":"20","author":"Boyle","year":"2004","journal-title":"Bioinformatics"},{"key":"2023011917133659600_ref9","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"Subramanian","year":"2005","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2023011917133659600_ref10","doi-asserted-by":"crossref","first-page":"e1009105","DOI":"10.1371\/journal.pcbi.1009105","article-title":"Pathway analysis in metabolomics: Recommendations for the use of over-representation analysis","volume":"17","author":"Wieder","year":"2021","journal-title":"PLoS Comput Biol"},{"key":"2023011917133659600_ref11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-017-2006-0","article-title":"Evaluation and comparison of bioinformatic tools for the enrichment analysis of metabolomics data","volume":"19","author":"Marco-Ramell","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"2023011917133659600_ref12","doi-asserted-by":"crossref","first-page":"e1003123","DOI":"10.1371\/journal.pcbi.1003123","article-title":"Predicting network activity from high throughput metabolomics","volume":"9","author":"Li","year":"2013","journal-title":"PLoS Comput Biol"},{"key":"2023011917133659600_ref13","doi-asserted-by":"crossref","first-page":"W388","DOI":"10.1093\/nar\/gkab382","article-title":"MetaboAnalyst 5.0: narrowing the gap between raw spectra and functional insights","volume":"49","author":"Pang","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref14","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1038\/s41596-022-00710-w","article-title":"Using MetaboAnalyst 5.0 for LC-HRMS spectra processing, multi-omics integration and covariate adjustment of global metabolomics data","volume":"17","author":"Pang","year":"2022","journal-title":"Nat Protoc"},{"key":"2023011917133659600_ref15","doi-asserted-by":"crossref","first-page":"W486","DOI":"10.1093\/nar\/gky310","article-title":"MetaboAnalyst 4.0: towards more transparent and integrative metabolomics analysis","volume":"46","author":"Chong","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref16","doi-asserted-by":"crossref","first-page":"W71","DOI":"10.1093\/nar\/gkq329","article-title":"MSEA: a web-based tool to identify biologically meaningful patterns in quantitative metabolomic data","volume":"38","author":"Xia","year":"2010","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref17","doi-asserted-by":"crossref","first-page":"2342","DOI":"10.1093\/bioinformatics\/btq418","article-title":"MetPA: a web-based metabolomics tool for pathway analysis and visualization","volume":"26","author":"Xia","year":"2010","journal-title":"Bioinformatics"},{"key":"2023011917133659600_ref18","doi-asserted-by":"crossref","DOI":"10.3390\/metabo9030057","article-title":"MetaboAnalystR 2.0: From Raw Spectra to Biological Insights","volume":"9","author":"Chong","year":"2019","journal-title":"Metabolites"},{"key":"2023011917133659600_ref19","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.cbpa.2017.01.001","article-title":"How close are we to complete annotation of metabolomes?","volume":"36","author":"Viant","year":"2017","journal-title":"Curr Opin Chem Biol"},{"key":"2023011917133659600_ref20","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11306-007-0082-2","article-title":"Proposed minimum reporting standards for chemical analysis Chemical Analysis Working Group (CAWG) Metabolomics Standards Initiative (MSI)","volume":"3","author":"Sumner","year":"2007","journal-title":"Metabolomics"},{"key":"2023011917133659600_ref21","doi-asserted-by":"crossref","first-page":"9226","DOI":"10.1021\/acs.analchem.6b02479","article-title":"Enabling efficient and confident annotation of LC-MS metabolomics data through MS1 spectrum and time prediction","volume":"88","author":"Broeckling","year":"2016","journal-title":"Anal Chem"},{"key":"2023011917133659600_ref22","doi-asserted-by":"crossref","first-page":"13097","DOI":"10.1021\/acs.analchem.7b02162","article-title":"Biologically consistent annotation of metabolomics data","volume":"89","author":"Alden","year":"2017","journal-title":"Anal Chem"},{"key":"2023011917133659600_ref23","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1021\/acs.analchem.7b03929","article-title":"Annotation: a computational solution for streamlining metabolomics analysis","volume":"90","author":"Domingo-Almenara","year":"2018","journal-title":"Anal Chem"},{"key":"2023011917133659600_ref24","doi-asserted-by":"crossref","first-page":"115324","DOI":"10.1016\/j.trac.2018.11.022","article-title":"From mass to metabolite in human untargeted metabolomics: Recent advances in annotation of metabolites applying liquid chromatography-mass spectrometry data","volume":"120","author":"Nash","year":"2019","journal-title":"TrAC Trends Anal Chem"},{"key":"2023011917133659600_ref25","doi-asserted-by":"crossref","first-page":"22","DOI":"10.3389\/fbioe.2015.00022","article-title":"Open-access metabolomics databases for natural product research: present capabilities and future potential","volume":"3","author":"Johnson","year":"2015","journal-title":"Front Bioeng Biotechnol"},{"key":"2023011917133659600_ref26","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/B978-0-12-385013-3.00002-1","volume-title":"Essentials in Modern HPLC Separations","author":"Moldoveanu","year":"2013"},{"key":"2023011917133659600_ref27","doi-asserted-by":"crossref","DOI":"10.1007\/s00216-021-03828-0","article-title":"N-Alkylpyridinium sulfonates for retention time indexing in reversed-phase-liquid chromatography-mass spectrometry-based metabolomics","volume":"414","author":"Stoffel","year":"2022","journal-title":"Anal Bioanal Chem"},{"key":"2023011917133659600_ref28","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1002\/hlca.19580410703","article-title":"Gas-chromatographische Charakterisierung organischer Verbindungen. Teil 1: Retentionsindices aliphatischer halogenide, alkohole, aldehyde und ketone","volume":"41","author":"Kov\u00e1ts","year":"1958","journal-title":"Helv Chim Acta"},{"key":"2023011917133659600_ref29","doi-asserted-by":"crossref","first-page":"10038","DOI":"10.1021\/ac9019522","article-title":"FiehnLib: mass spectral and retention index libraries for metabolomics based on quadrupole and time-of-flight gas chromatography\/mass spectrometry","volume":"81","author":"Kind","year":"2009","journal-title":"Anal Chem"},{"key":"2023011917133659600_ref30","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1007\/s11306-014-0727-x","article-title":"Predicting retention time in hydrophilic interaction liquid chromatography mass spectrometry and its use for peak annotation in metabolomics","volume":"11","author":"Cao","year":"2015","journal-title":"Metabolomics"},{"key":"2023011917133659600_ref31","doi-asserted-by":"crossref","first-page":"5811","DOI":"10.1038\/s41467-019-13680-7","article-title":"The METLIN small molecule dataset for machine learning-based retention time prediction","volume":"10","author":"Domingo-Almenara","year":"2019","journal-title":"Nat Commun"},{"key":"2023011917133659600_ref32","doi-asserted-by":"crossref","first-page":"2764","DOI":"10.1093\/bioinformatics\/btu370","article-title":"MetAssign: probabilistic annotation of metabolites from LC-MS data using a Bayesian clustering approach","volume":"30","author":"Daly","year":"2014","journal-title":"Bioinformatics"},{"key":"2023011917133659600_ref33","doi-asserted-by":"crossref","first-page":"12799","DOI":"10.1021\/acs.analchem.9b02354","article-title":"Integrated probabilistic annotation: a bayesian-based annotation method for metabolomic profiles integrating biochemical connections, isotope patterns, and adduct relationships","volume":"91","author":"Del Carratore","year":"2019","journal-title":"Anal Chem"},{"key":"2023011917133659600_ref34","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1038\/s41592-020-0933-6","article-title":"Feature-based molecular networking in the GNPS analysis environment","volume":"17","author":"Nothias","year":"2020","journal-title":"Nat Methods"},{"key":"2023011917133659600_ref35","doi-asserted-by":"crossref","first-page":"1516","DOI":"10.1038\/s41467-019-09550-x","article-title":"Metabolic reaction network-based recursive metabolite annotation for untargeted metabolomics","volume":"10","author":"Shen","year":"2019","journal-title":"Nat Commun"},{"key":"2023011917133659600_ref36","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1038\/s41592-021-01303-3","article-title":"Metabolite discovery through global annotation of untargeted metabolomics data","volume":"18","author":"Chen","year":"2021","journal-title":"Nat Methods"},{"key":"2023011917133659600_ref37","doi-asserted-by":"crossref","first-page":"e1002375","DOI":"10.1371\/journal.pcbi.1002375","article-title":"Ten years of pathway analysis: current approaches and outstanding challenges","volume":"8","author":"Khatri","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"2023011917133659600_ref38","doi-asserted-by":"crossref","first-page":"e0189012","DOI":"10.1371\/journal.pone.0189012","article-title":"Null diffusion-based enrichment for metabolomics data","volume":"12","author":"Picart-Armada","year":"2017","journal-title":"PLoS One"},{"key":"2023011917133659600_ref39","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1093\/bioinformatics\/btm051","article-title":"Analyzing gene expression data in terms of gene sets: methodological issues","volume":"23","author":"Goeman","year":"2007","journal-title":"Bioinformatics"},{"key":"2023011917133659600_ref40","doi-asserted-by":"crossref","first-page":"2502","DOI":"10.1093\/bioinformatics\/btg363","article-title":"Characterizing gene sets with FuncAssociate","volume":"19","author":"Berriz","year":"2003","journal-title":"Bioinformatics"},{"key":"2023011917133659600_ref41","doi-asserted-by":"crossref","first-page":"R70","DOI":"10.1186\/gb-2003-4-10-r70","article-title":"Identifying biological themes within lists of genes with EASE","volume":"4","author":"Hosack","year":"2003","journal-title":"Genome Biol"},{"key":"2023011917133659600_ref42","article-title":"An algorithm for fast preranked gene set enrichment analysis using cumulative statistic calculation","author":"Sergushichev"},{"key":"2023011917133659600_ref43","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbac143","article-title":"On the influence of several factors on pathway enrichment analysis","volume":"23","author":"Mubeen","year":"2022","journal-title":"Brief Bioinform"},{"key":"2023011917133659600_ref44","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.compbiolchem.2017.09.009","article-title":"Signaling pathway impact analysis by incorporating the importance and specificity of genes (SPIA-IS)","volume":"71","author":"Fang","year":"2017","journal-title":"Comput Biol Chem"},{"key":"2023011917133659600_ref45","doi-asserted-by":"crossref","first-page":"e0191154","DOI":"10.1371\/journal.pone.0191154","article-title":"A critical comparison of topology-based pathway analysis methods","volume":"13","author":"Ihnatova","year":"2018","journal-title":"PLoS One"},{"key":"2023011917133659600_ref46","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s13040-018-0166-8","article-title":"Gene set analysis methods: a systematic comparison","volume":"11","author":"Mathur","year":"2018","journal-title":"BioData Min"},{"key":"2023011917133659600_ref47","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1186\/s12859-019-3146-1","article-title":"A comparative study of topology-based pathway enrichment analysis methods","volume":"20","author":"Ma","year":"2019","journal-title":"BMC Bioinformatics"},{"key":"2023011917133659600_ref48","article-title":"KEGGREST: Client-side REST access to the Kyoto Encyclopedia of Genes and Genomes (KEGG)","author":"TDM","year":"2022","journal-title":"R package version 1.38.0"},{"key":"2023011917133659600_ref49","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1186\/s12864-021-07502-8","article-title":"Pathway size matters: the influence of pathway granularity on over-representation (enrichment analysis) statistics","volume":"22","author":"Karp","year":"2021","journal-title":"BMC Genomics"},{"key":"2023011917133659600_ref50","doi-asserted-by":"crossref","first-page":"D109","DOI":"10.1093\/nar\/gkr988","article-title":"KEGG for integration and interpretation of large-scale molecular data sets","volume":"40","author":"Kanehisa","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref51","doi-asserted-by":"crossref","first-page":"e79217","DOI":"10.1371\/journal.pone.0079217","article-title":"A comparison of gene set analysis methods in terms of sensitivity, prioritization and specificity","volume":"8","author":"Tarca","year":"2013","journal-title":"PLoS One"},{"key":"2023011917133659600_ref52","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/s40246-019-0226-2","article-title":"Size matters: how sample size affects the reproducibility and specificity of gene set analysis","volume":"13","author":"Maleki","year":"2019","journal-title":"Hum Genomics"},{"key":"2023011917133659600_ref53","doi-asserted-by":"crossref","DOI":"10.3390\/metabo11020103","article-title":"Ranking metabolite sets by their activity levels","volume":"11","author":"McLuskey","year":"2021","journal-title":"Metabolites"},{"key":"2023011917133659600_ref54","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1186\/1471-2105-13-136","article-title":"Down-weighting overlapping genes improves gene set analysis","volume":"13","author":"Tarca","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023011917133659600_ref55","doi-asserted-by":"crossref","DOI":"10.1093\/nar\/gkac376","article-title":"OmicsNet 2.0: a web-based platform for multi-omics integration and network visual analytics","volume":"50","author":"Zhou","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2023011917133659600_ref56","doi-asserted-by":"crossref","DOI":"10.1126\/scisignal.abf8483","article-title":"Kynurenic acid may underlie sex-specific immune responses to COVID-19","author":"Cai","year":"2021"},{"key":"2023011917133659600_ref57","doi-asserted-by":"crossref","first-page":"111308","DOI":"10.1016\/j.nut.2021.111308","article-title":"Altered tryptophan absorption and metabolism could underlie long-term symptoms in survivors of coronavirus disease 2019 (COVID-19)","volume":"90","author":"Ero\u011flu","year":"2021","journal-title":"Nutrition"},{"key":"2023011917133659600_ref58","doi-asserted-by":"crossref","first-page":"110121","DOI":"10.1016\/j.cellsig.2021.110121","article-title":"A novel hypothesis for COVID-19 pathogenesis: Retinol depletion and retinoid signaling disorder","volume":"87","author":"Sarohan","year":"2021","journal-title":"Cell Signal"},{"key":"2023011917133659600_ref59","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.nutos.2022.05.007","article-title":"Retinol depletion in COVID-19","volume":"43","author":"Sarohan","year":"2022","journal-title":"Clin Nutr Open Sci"},{"key":"2023011917133659600_ref60","doi-asserted-by":"crossref","DOI":"10.1007\/s12020-022-03140-6","article-title":"COVID-19 patients with altered steroid hormone levels are more likely to have higher disease severity","volume":"78","author":"Sezer","year":"2022","journal-title":"Endocrine"},{"key":"2023011917133659600_ref61","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1038\/s41419-022-04861-2","article-title":"Sex differences in global metabolomic profiles of COVID-19 patients","volume":"13","author":"Escarcega","year":"2022","journal-title":"Cell Death Dis"},{"key":"2023011917133659600_ref62","doi-asserted-by":"crossref","DOI":"10.3390\/ijms22115460","article-title":"Possible beneficial actions of caffeine in SARS-CoV-2","volume":"22","author":"Romero-Martinez","year":"2021","journal-title":"Int J Mol Sci"},{"key":"2023011917133659600_ref63","doi-asserted-by":"crossref","first-page":"562051","DOI":"10.3389\/fnut.2020.562051","article-title":"Potential role of vitamin B6 in ameliorating the severity of COVID-19 and its complications","volume":"7","author":"Kumrungsee","year":"2020","journal-title":"Front Nutr"},{"key":"2023011917133659600_ref64","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1038\/s41564-018-0306-4","article-title":"Gut microbiome structure and metabolic activity in inflammatory bowel disease","volume":"4","author":"Franzosa","year":"2019","journal-title":"Nat Microbiol"},{"key":"2023011917133659600_ref65","doi-asserted-by":"crossref","first-page":"14966","DOI":"10.1039\/C6RA28715H","article-title":"Emerging role and recent applications of metabolomics biomarkers in obesity disease research","volume":"7","author":"Zhang","year":"2017","journal-title":"RSC Adv"},{"key":"2023011917133659600_ref66","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1038\/nature11708","article-title":"Metabolic phenotyping in clinical and surgical environments","volume":"491","author":"Nicholson","year":"2012","journal-title":"Nature"},{"key":"2023011917133659600_ref67","doi-asserted-by":"crossref","first-page":"2","DOI":"10.4155\/ebo.13.339","volume-title":"Global Metabolic Profiling: Clinical Applications","author":"Nicholls","year":"2014"},{"key":"2023011917133659600_ref68","first-page":"12","article-title":"The potential of metabolomics in biomedical applications","author":"Gonzalez-Covarrubias","year":"2022","journal-title":"Metabolites"},{"key":"2023011917133659600_ref69","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1038\/s41580-019-0108-4","article-title":"Identification of bioactive metabolites using activity metabolomics","volume":"20","author":"Rinschen","year":"2019","journal-title":"Nat Rev Mol Cell Biol"},{"key":"2023011917133659600_ref70","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1093\/bib\/bbz158","article-title":"Toward a gold standard for benchmarking gene set enrichment analysis","volume":"22","author":"Geistlinger","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023011917133659600_ref71","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1186\/s12859-015-0751-5","article-title":"Comparative study on gene set and pathway topology-based enrichment methods","volume":"16","author":"Bayerlova","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2023011917133659600_ref72","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1093\/bib\/bbv069","article-title":"Gene set analysis approaches for RNA-seq data: performance evaluation and application guideline","volume":"17","author":"Rahmatallah","year":"2016","journal-title":"Brief Bioinform"},{"key":"2023011917133659600_ref73","doi-asserted-by":"crossref","DOI":"10.3390\/metabo10050183","article-title":"Pathway-activity likelihood analysis and metabolite annotation for untargeted metabolomics using probabilistic modeling","volume":"10","author":"Hosseini","year":"2020","journal-title":"Metabolites"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/24\/1\/bbac553\/48783261\/bbac553.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/24\/1\/bbac553\/48783261\/bbac553.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,19]],"date-time":"2023-01-19T17:41:51Z","timestamp":1674150111000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbac553\/6960976"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,26]]},"references-count":73,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1,19]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbac553","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,1]]},"published":{"date-parts":[[2022,12,26]]},"article-number":"bbac553"}}