{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T14:13:26Z","timestamp":1775916806351,"version":"3.50.1"},"reference-count":116,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T00:00:00Z","timestamp":1660176000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Pathway enrichment analysis (PEA) is a computational biology method that identifies biological functions that are overrepresented in a group of genes more than would be expected by chance and ranks these functions by relevance. The relative abundance of genes pertinent to specific pathways is measured through statistical methods, and associated functional pathways are retrieved from online bioinformatics databases. In the last decade, along with the spread of the internet, higher availability of computational resources made PEA software tools easy to access and to use for bioinformatics practitioners worldwide. Although it became easier to use these tools, it also became easier to make mistakes that could generate inflated or misleading results, especially for beginners and inexperienced computational biologists. With this article, we propose nine quick tips to avoid common mistakes and to out a complete, sound, thorough PEA, which can produce relevant and robust results. We describe our nine guidelines in a simple way, so that they can be understood and used by anyone, including students and beginners. Some tips explain what to do before starting a PEA, others are suggestions of how to correctly generate meaningful results, and some final guidelines indicate some useful steps to properly interpret PEA results. Our nine tips can help users perform better pathway enrichment analyses and eventually contribute to a better understanding of current biology.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010348","type":"journal-article","created":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T17:26:51Z","timestamp":1660238811000},"page":"e1010348","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":75,"title":["Nine quick tips for pathway enrichment analysis"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9655-7142","authenticated-orcid":true,"given":"Davide","family":"Chicco","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2868-7732","authenticated-orcid":true,"given":"Giuseppe","family":"Agapito","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,8,11]]},"reference":[{"issue":"2","key":"pcbi.1010348.ref001","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1038\/s41596-018-0103-9","article-title":"Pathway enrichment analysis and visualization of omics data using g:Profiler, GSEA, Cytoscape and EnrichmentMap.","volume":"14","author":"J Reimand","year":"2019","journal-title":"Nat Protoc."},{"issue":"1","key":"pcbi.1010348.ref002","first-page":"1","article-title":"Beyond the genome (BTG) is a (PGDB) pathway genome database: HumanCyc.","volume":"11","author":"M Trupp","year":"2010","journal-title":"Genome Biol"},{"key":"pcbi.1010348.ref003","first-page":"1","article-title":"LIPEA: lipid pathway enrichment analysis.","volume":"274969","author":"A Acevedo","year":"2018","journal-title":"bioRxiv"},{"issue":"1\u20132","key":"pcbi.1010348.ref004","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S0303-2647(98)00017-3","article-title":"Computation with the KEGG pathway database.","volume":"47","author":"H Ogata","year":"1998","journal-title":"Biosystems"},{"issue":"suppl 1","key":"pcbi.1010348.ref005","first-page":"D428","article-title":"Reactome: a knowledgebase of biological pathways","volume":"33","author":"G Joshi-Tope","year":"2005","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref006","doi-asserted-by":"crossref","first-page":"D661","DOI":"10.1093\/nar\/gkx1064","article-title":"WikiPathways: a multifaceted pathway database bridging metabolomics to other omics research","volume":"46","author":"DN Slenter","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref007","doi-asserted-by":"crossref","first-page":"D330","DOI":"10.1093\/nar\/gky1055","article-title":"The Gene Ontology resource: 20 years and still GOing strong.","volume":"47","author":"The Gene Ontology Consortium","year":"2019","journal-title":"Nucleic Acids Res"},{"issue":"suppl 2","key":"pcbi.1010348.ref008","doi-asserted-by":"crossref","first-page":"W193","DOI":"10.1093\/nar\/gkm226","article-title":"g:Profiler\u2014a web-based toolset for functional profiling of gene lists from large-scale experiments","volume":"35","author":"J Reimand","year":"2007","journal-title":"Nucleic Acids Res"},{"issue":"suppl 2","key":"pcbi.1010348.ref009","doi-asserted-by":"crossref","first-page":"W307","DOI":"10.1093\/nar\/gkr378","article-title":"g:Profiler\u2014a web server for functional interpretation of gene lists (2011 update).","volume":"39","author":"J Reimand","year":"2011","journal-title":"Nucleic Acids Res"},{"issue":"W1","key":"pcbi.1010348.ref010","doi-asserted-by":"crossref","first-page":"W83","DOI":"10.1093\/nar\/gkw199","article-title":"g:Profiler\u2014a web server for functional interpretation of gene lists (2016 update).","volume":"44","author":"J Reimand","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1010348.ref011","doi-asserted-by":"crossref","DOI":"10.12688\/f1000research.24956.2","article-title":"gprofiler2\u2013an R package for gene list functional enrichment analysis and namespace conversion toolset g:Profiler.","volume":"9","author":"L Kolberg","year":"2020","journal-title":"F1000Res"},{"issue":"1","key":"pcbi.1010348.ref012","doi-asserted-by":"crossref","first-page":"87","DOI":"10.2307\/2340521","article-title":"On the interpretation of \u03c7 2 from contingency tables, and the calculation of P.","volume":"85","author":"RA Fisher","year":"1922","journal-title":"J R Stat Soc"},{"issue":"3","key":"pcbi.1010348.ref013","doi-asserted-by":"crossref","first-page":"395","DOI":"10.2307\/2982890","article-title":"Fisher\u2019s exact test.","volume":"155","author":"GJ Upton","year":"1992","journal-title":"J R Stat Soc Ser A Stat Soc"},{"key":"pcbi.1010348.ref014","first-page":"35","article-title":"When to use Fisher\u2019s exact test.","volume":"2","author":"KM Bower","year":"2003","journal-title":"American Society for Quality, Six Sigma Forum Magazine"},{"issue":"1","key":"pcbi.1010348.ref015","first-page":"58","article-title":"Fisher\u2019s exact test.","volume":"25","author":"LM Connelly","year":"2016","journal-title":"MedSurg Nursing"},{"key":"pcbi.1010348.ref016","unstructured":"g:Profiler. Welcome to g:Profiler; 2022. Available from: https:\/\/biit.cs.ut.ee\/gprofiler\/page\/docs#significance_threhshold [cited 2022 Feb 2]."},{"issue":"1","key":"pcbi.1010348.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-015-0761-7","article-title":"Multiple sources of bias confound functional enrichment analysis of global-omics data","volume":"16","author":"JA Timmons","year":"2015","journal-title":"Genome Biol"},{"issue":"1","key":"pcbi.1010348.ref018","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1177\/0962280212460441","article-title":"The limitations of simple gene set enrichment analysis assuming gene independence","volume":"25","author":"P Tamayo","year":"2016","journal-title":"Stat Methods Med Res"},{"issue":"10","key":"pcbi.1010348.ref019","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1093\/bioinformatics\/btv023","article-title":"Bias in microRNA functional enrichment analysis","volume":"31","author":"T Bleazard","year":"2015","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010348.ref020","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-017-1571-6","article-title":"Avoiding the pitfalls of gene set enrichment analysis with SetRank","volume":"18","author":"C Simillion","year":"2017","journal-title":"BMC Bioinformatics"},{"issue":"3","key":"pcbi.1010348.ref021","doi-asserted-by":"crossref","first-page":"e1009935","DOI":"10.1371\/journal.pcbi.1009935","article-title":"Urgent need for consistent standards in functional enrichment analysis.","volume":"18","author":"K Wijesooriya","year":"2022","journal-title":"PLoS Comput Biol."},{"issue":"3","key":"pcbi.1010348.ref022","doi-asserted-by":"crossref","first-page":"bbac143","DOI":"10.1093\/bib\/bbac143","article-title":"On the influence of several factors on pathway enrichment analysis","volume":"23","author":"S Mubeen","year":"2022","journal-title":"Brief Bioinform"},{"issue":"9","key":"pcbi.1010348.ref023","doi-asserted-by":"crossref","first-page":"e1009105","DOI":"10.1371\/journal.pcbi.1009105","article-title":"Pathway analysis in metabolomics: recommendations for the use of over-representation analysis.","volume":"17","author":"C Wieder","year":"2021","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1010348.ref024","doi-asserted-by":"crossref","first-page":"e1002375","DOI":"10.1371\/journal.pcbi.1002375","article-title":"Ten years of pathway analysis: current approaches and outstanding challenges.","volume":"8","author":"P Khatri","year":"2012","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"pcbi.1010348.ref025","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1038\/ng1180","article-title":"PGC-1\u03b1-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes","volume":"34","author":"VK Mootha","year":"2003","journal-title":"Nat Genet"},{"issue":"43","key":"pcbi.1010348.ref026","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"A Subramanian","year":"2005","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"23","key":"pcbi.1010348.ref027","doi-asserted-by":"crossref","first-page":"3251","DOI":"10.1093\/bioinformatics\/btm369","article-title":"GSEA-P: a desktop application for Gene Set Enrichment Analysis","volume":"23","author":"A Subramanian","year":"2007","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010348.ref028","first-page":"1","article-title":"Enrichr: interactive and collaborative HTML5 gene list enrichment analysis tool","volume":"14","author":"EY Chen","year":"2013","journal-title":"BMC Bioinformatics"},{"issue":"W1","key":"pcbi.1010348.ref029","doi-asserted-by":"crossref","first-page":"W90","DOI":"10.1093\/nar\/gkw377","article-title":"Enrichr: a comprehensive gene set enrichment analysis web server 2016 update","volume":"44","author":"MV Kuleshov","year":"2016","journal-title":"Nucleic Acids Res"},{"issue":"3","key":"pcbi.1010348.ref030","doi-asserted-by":"crossref","first-page":"e90","DOI":"10.1002\/cpz1.90","article-title":"Gene set knowledge discovery with Enrichr","volume":"1","author":"Z Xie","year":"2021","journal-title":"Curr Protoc"},{"issue":"1","key":"pcbi.1010348.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13040-018-0166-8","article-title":"Gene set analysis methods: a systematic comparison","volume":"11","author":"R Mathur","year":"2018","journal-title":"BioData Mining"},{"key":"pcbi.1010348.ref032","article-title":"Gene set analysis: challenges, opportunities, and future research.","volume":"654","author":"F Maleki","year":"2020","journal-title":"Front Genet."},{"issue":"17","key":"pcbi.1010348.ref033","doi-asserted-by":"crossref","first-page":"2176","DOI":"10.1093\/bioinformatics\/btq401","article-title":"ROAST: rotation gene set tests for complex microarray experiments","volume":"26","author":"D Wu","year":"2010","journal-title":"Bioinformatics"},{"issue":"4","key":"pcbi.1010348.ref034","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1093\/bib\/bbt002","article-title":"Gene set analysis methods: statistical models and methodological differences","volume":"15","author":"H. Maciejewski","year":"2014","journal-title":"Brief Bioinform"},{"issue":"15","key":"pcbi.1010348.ref035","doi-asserted-by":"crossref","first-page":"4377","DOI":"10.1093\/bioinformatics\/btaa529","article-title":"BioPAX-Parser: parsing and enrichment analysis of BioPAX pathways","volume":"36","author":"G Agapito","year":"2020","journal-title":"Bioinformatics"},{"issue":"D1","key":"pcbi.1010348.ref036","doi-asserted-by":"crossref","first-page":"D419","DOI":"10.1093\/nar\/gkw1082","article-title":"pathDIP: an annotated resource for known and predicted human gene-pathway associations and pathway enrichment analysis","volume":"45","author":"S Rahmati","year":"2017","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref037","first-page":"D479","article-title":"pathDIP 4: an extended pathway annotations and enrichment analysis resource for human, model organisms and domesticated species","volume":"48","author":"S Rahmati","year":"2020","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"pcbi.1010348.ref038","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1093\/bioinformatics\/btn577","article-title":"A novel signaling pathway impact analysis","volume":"25","author":"AL Tarca","year":"2009","journal-title":"Bioinformatics"},{"issue":"5","key":"pcbi.1010348.ref039","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1093\/bioinformatics\/btt008","article-title":"CePa: an R package for finding significant pathways weighted by multiple network centralities","volume":"29","author":"Z Gu","year":"2013","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010348.ref040","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1751-0473-7-10","article-title":"PathNet: a tool for pathway analysis using topological information.","volume":"7","author":"B Dutta","year":"2012","journal-title":"Source Code Biol Med"},{"issue":"1","key":"pcbi.1010348.ref041","first-page":"1","article-title":"Identifying significantly impacted pathways: a comprehensive review and assessment","volume":"20","author":"TM Nguyen","year":"2019","journal-title":"Genome Biol"},{"issue":"1","key":"pcbi.1010348.ref042","first-page":"1","article-title":"A comparative study of topology-based pathway enrichment analysis methods","volume":"20","author":"J Ma","year":"2019","journal-title":"BMC Bioinformatics"},{"issue":"1","key":"pcbi.1010348.ref043","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1093\/bib\/bbx091","article-title":"Pathway enrichment analysis approach based on topological structure and updated annotation of pathway","volume":"20","author":"Q Yang","year":"2019","journal-title":"Brief Bioinform"},{"issue":"5","key":"pcbi.1010348.ref044","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1038\/nbt.1630","article-title":"GREAT improves functional interpretation of cis-regulatory regions","volume":"28","author":"CY McLean","year":"2010","journal-title":"Nat Biotechnol"},{"key":"pcbi.1010348.ref045","first-page":"1","article-title":"BEHST: genomic set enrichment analysis enhanced through integration of chromatin long-range interactions.","volume":"168427","author":"D Chicco","year":"2019","journal-title":"bioRxiv"},{"issue":"1","key":"pcbi.1010348.ref046","doi-asserted-by":"crossref","first-page":"lqaa006","DOI":"10.1093\/nargab\/lqaa006","article-title":"Poly-Enrich: count-based methods for gene set enrichment testing with genomic regions.","volume":"2","author":"CT Lee","year":"2020","journal-title":"NAR Genome Bioinform"},{"issue":"13","key":"pcbi.1010348.ref047","first-page":"1","article-title":"Using BioPAX-Parser (BiP) to enrich lists of genes or proteins with pathway data.","volume":"22","author":"G Agapito","year":"2021","journal-title":"BMC Bioinformatics"},{"issue":"23","key":"pcbi.1010348.ref048","doi-asserted-by":"crossref","first-page":"17561","DOI":"10.1007\/s00500-020-05243-6","article-title":"cPEA: a parallel method to perform pathway enrichment analysis using multiple pathways databases","volume":"24","author":"G Agapito","year":"2020","journal-title":"Soft Comput"},{"issue":"1","key":"pcbi.1010348.ref049","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2105-9-552","article-title":"GeneTrailExpress: a web-based pipeline for the statistical evaluation of microarray experiments","volume":"9","author":"A Keller","year":"2008","journal-title":"BMC Bioinformatics"},{"issue":"suppl 2","key":"pcbi.1010348.ref050","doi-asserted-by":"crossref","first-page":"W186","DOI":"10.1093\/nar\/gkm323","article-title":"GeneTrail\u2014advanced gene set enrichment analysis","volume":"35","author":"C Backes","year":"2007","journal-title":"Nucleic Acids Res"},{"issue":"10","key":"pcbi.1010348.ref051","doi-asserted-by":"crossref","first-page":"1502","DOI":"10.1093\/bioinformatics\/btv770","article-title":"Multi-omics enrichment analysis using the GeneTrail2 web service","volume":"32","author":"D St\u00f6ckel","year":"2016","journal-title":"Bioinformatics"},{"issue":"W1","key":"pcbi.1010348.ref052","doi-asserted-by":"crossref","first-page":"W515","DOI":"10.1093\/nar\/gkaa306","article-title":"GeneTrail 3: advanced high-throughput enrichment analysis","volume":"48","author":"N Gerstner","year":"2020","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"pcbi.1010348.ref053","first-page":"1","article-title":"NoRCE: non-coding RNA sets cis enrichment tool","volume":"22","author":"G Olgun","year":"2021","journal-title":"BMC Bioinformatics"},{"issue":"4","key":"pcbi.1010348.ref054","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1080\/15366367.2011.632338","article-title":"Garbage in, garbage out: having useful data is everything.","volume":"9","author":"LT Rose","year":"2011","journal-title":"Measurement Interdiscip Res Perspect"},{"issue":"3","key":"pcbi.1010348.ref055","first-page":"103","article-title":"Data quality:\u201cGarbage in\u2013garbage out\u201d.","volume":"47","author":"MF Kilkenny","year":"2018","journal-title":"Health Inf Manag J"},{"key":"pcbi.1010348.ref056","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/978-1-4939-9744-2_16","article-title":"Review of batch effects prevention, diagnostics, and correction approaches","author":"J \u010cuklina","year":"2020","journal-title":"Mass Spectrometry Data Analysis in Proteomics"},{"issue":"2","key":"pcbi.1010348.ref057","doi-asserted-by":"crossref","first-page":"e17238","DOI":"10.1371\/journal.pone.0017238","article-title":"Removing batch effects in analysis of expression microarray data: an evaluation of six batch adjustment methods.","volume":"6","author":"C Chen","year":"2011","journal-title":"PLoS ONE"},{"issue":"8","key":"pcbi.1010348.ref058","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1093\/bioinformatics\/14.8.656","article-title":"GeneCards: a novel functional genomics compendium with automated data mining and query reformulation support","volume":"14","author":"M Rebhan","year":"1998","journal-title":"Bioinformatics"},{"key":"pcbi.1010348.ref059","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baq020","article-title":"GeneCards version 3: the human gene integrator","volume":"2010","author":"M Safran","year":"2010","journal-title":"Database"},{"issue":"1","key":"pcbi.1010348.ref060","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/cpbi.5","article-title":"The GeneCards suite: from gene data mining to disease genome sequence analyses","volume":"54","author":"G Stelzer","year":"2016","journal-title":"Curr Protoc Bioinform"},{"issue":"9","key":"pcbi.1010348.ref061","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1038\/nbt.1666","article-title":"The BioPAX community standard for pathway data sharing","volume":"28","author":"E Demir","year":"2010","journal-title":"Nat Biotechnol"},{"issue":"suppl 1","key":"pcbi.1010348.ref062","first-page":"D685","article-title":"Pathway Commons, a web resource for biological pathway data","volume":"39","author":"EG Cerami","year":"2010","journal-title":"Nucleic Acids Res"},{"issue":"4","key":"pcbi.1010348.ref063","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1093\/bib\/bbw134","article-title":"Top considerations for creating bioinformatics software documentation","volume":"19","author":"M Karimzadeh","year":"2018","journal-title":"Brief Bioinform"},{"issue":"7","key":"pcbi.1010348.ref064","doi-asserted-by":"crossref","first-page":"e1000424","DOI":"10.1371\/journal.pcbi.1000424","article-title":"A quick guide to organizing computational biology projects","volume":"5","author":"WS Noble","year":"2009","journal-title":"PLoS Comput Biol"},{"issue":"9","key":"pcbi.1010348.ref065","doi-asserted-by":"crossref","first-page":"e1004385","DOI":"10.1371\/journal.pcbi.1004385","article-title":"simple rules for a computational biologist\u2019s laboratory notebook","volume":"11","author":"S Schnell","year":"2015","journal-title":"PLoS Comput Biol"},{"issue":"10","key":"pcbi.1010348.ref066","doi-asserted-by":"crossref","first-page":"e1003285","DOI":"10.1371\/journal.pcbi.1003285","article-title":"Ten simple rules for reproducible computational research.","volume":"9","author":"GK Sandve","year":"2013","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1010348.ref067","doi-asserted-by":"crossref","first-page":"e1006649","DOI":"10.1371\/journal.pcbi.1006649","article-title":"Ten simple rules on how to create open access and reproducible molecular simulations of biological systems.","volume":"15","author":"A Elofsson","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"9","key":"pcbi.1010348.ref068","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1038\/nmeth.3963","article-title":"Impact of outdated gene annotations on pathway enrichment analysis","volume":"13","author":"L Wadi","year":"2016","journal-title":"Nat Methods"},{"issue":"9","key":"pcbi.1010348.ref069","doi-asserted-by":"crossref","first-page":"2343","DOI":"10.3390\/cancers12092343","article-title":"Hypoxia predicts poor prognosis in neuroblastoma patients and associates with biological mechanisms involved in telomerase activation and tumor microenvironment reprogramming.","volume":"12","author":"D Cangelosi","year":"2020","journal-title":"Cancers."},{"issue":"4","key":"pcbi.1010348.ref070","first-page":"604","article-title":"Why, when and how to adjust your P values?","volume":"20","author":"M Jafari","year":"2019","journal-title":"Cell J (Yakhteh)."},{"key":"pcbi.1010348.ref071","unstructured":"Cornellius Yudha Wijaya. Multiple hypothesis testing correction for data scientist; 2022. Available from: https:\/\/towardsdatascience.com\/multiple-hypothesis-testing-correction-for-data-scientist-46d3a3d1611d [cited 2022 Jun 1]."},{"key":"pcbi.1010348.ref072","first-page":"40","article-title":"What is the Bonferroni correction?","author":"MA Napierala","year":"2012","journal-title":"AAOS Now."},{"issue":"1","key":"pcbi.1010348.ref073","doi-asserted-by":"crossref","first-page":"77","DOI":"10.3102\/10769986027001077","article-title":"Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons.","volume":"27","author":"D Thissen","year":"2002","journal-title":"J Educ Behav Stat"},{"key":"pcbi.1010348.ref074","doi-asserted-by":"crossref","first-page":"e48175","DOI":"10.7554\/eLife.48175","article-title":"Science forum: ten common statistical mistakes to watch out for when writing or reviewing a manuscript.","volume":"8","author":"TR Makin","year":"2019","journal-title":"eLife"},{"issue":"1","key":"pcbi.1010348.ref075","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1038\/s41562-017-0189-z","article-title":"Redefine statistical significance.","volume":"2","author":"DJ Benjamin","year":"2018","journal-title":"Nat Hum Behav"},{"issue":"8","key":"pcbi.1010348.ref076","doi-asserted-by":"crossref","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false.","volume":"2","author":"JP Ioannidis","year":"2005","journal-title":"PLoS Med."},{"issue":"9","key":"pcbi.1010348.ref077","doi-asserted-by":"crossref","first-page":"e190","DOI":"10.1371\/journal.pcbi.0030190","article-title":"Reply to \u201cTen simple rules for getting published\u201d.","volume":"3","author":"E. Grosch","year":"2007","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010348.ref078","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4471-6497-5","volume-title":"Scientific visualization.","author":"CD Hansen","year":"2014"},{"issue":"1","key":"pcbi.1010348.ref079","doi-asserted-by":"crossref","first-page":"e1002833","DOI":"10.1371\/journal.pcbi.1002833","article-title":"Visual data mining of biological networks: one size does not fit all.","volume":"9","author":"C Pastrello","year":"2013","journal-title":"PLoS Comput Biol"},{"issue":"11","key":"pcbi.1010348.ref080","doi-asserted-by":"crossref","first-page":"e13984","DOI":"10.1371\/journal.pone.0013984","article-title":"Enrichment Map: a network-based method for gene-set enrichment visualization and interpretation.","volume":"5","author":"D Merico","year":"2010","journal-title":"PLoS ONE."},{"key":"pcbi.1010348.ref081","unstructured":"Yu, Guangchuang. Biomedical knowledge mining using GOSemSim and clusterProfiler: enrichplot; 2022. Available from: https:\/\/bioc.ism.ac.jp\/packages\/3.7\/bioc\/vignettes\/enrichplot\/inst\/doc\/enrichplot.html [cited 2022 Feb 3]."},{"key":"pcbi.1010348.ref082","doi-asserted-by":"crossref","first-page":"1717","DOI":"10.12688\/f1000research.9090.1","article-title":"AutoAnnotate: a Cytoscape app for summarizing networks with semantic annotations.","volume":"5","author":"M Kucera","year":"2016","journal-title":"F1000Res"},{"issue":"7","key":"pcbi.1010348.ref083","doi-asserted-by":"crossref","first-page":"e21800","DOI":"10.1371\/journal.pone.0021800","article-title":"REVIGO summarizes and visualizes long lists of Gene Ontology terms","volume":"6","author":"F Supek","year":"2011","journal-title":"PLoS ONE"},{"issue":"1","key":"pcbi.1010348.ref084","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-019-2671-2","article-title":"CirGO: an alternative circular way of visualising Gene Ontology terms","volume":"20","author":"I Kuznetsova","year":"2019","journal-title":"BMC Bioinformatics"},{"issue":"D1","key":"pcbi.1010348.ref085","doi-asserted-by":"crossref","first-page":"D536","DOI":"10.1093\/nar\/gkv1115","article-title":"Integrated interactions database: tissue-specific view of the human and model organism interactomes","volume":"44","author":"M Kotlyar","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1010348.ref086","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/978-1-4939-9873-9_10","article-title":"Informed use of protein\u2013protein interaction data: a focus on the integrated interactions database (IID).","author":"C Pastrello","year":"2020","journal-title":"Protein-Protein Interaction Networks."},{"issue":"D1","key":"pcbi.1010348.ref087","doi-asserted-by":"crossref","first-page":"D581","DOI":"10.1093\/nar\/gky1037","article-title":"IID 2018 update: context-specific physical protein\u2013protein interactions in human, model organisms and domesticated species","volume":"47","author":"M Kotlyar","year":"2019","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref088","doi-asserted-by":"crossref","first-page":"D640","DOI":"10.1093\/nar\/gkab1034","article-title":"IID 2021: towards context-specific protein interaction analyses by increased coverage, enhanced annotation and enrichment analysis","volume":"50","author":"M Kotlyar","year":"2022","journal-title":"Nucleic Acids Res"},{"issue":"suppl 1","key":"pcbi.1010348.ref089","doi-asserted-by":"crossref","first-page":"D358","DOI":"10.1093\/nar\/gkl825","article-title":"STRING 7\u2014Recent developments in the integration and prediction of protein interactions","volume":"35","author":"C Von Mering","year":"2007","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref090","doi-asserted-by":"crossref","first-page":"D808","DOI":"10.1093\/nar\/gks1094","article-title":"STRING v9.1: protein-protein interaction networks, with increased coverage and integration","volume":"41","author":"A Franceschini","year":"2012","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref091","doi-asserted-by":"crossref","first-page":"D447","DOI":"10.1093\/nar\/gku1003","article-title":"STRING v10: protein\u2013protein interaction networks, integrated over the tree of life","volume":"43","author":"D Szklarczyk","year":"2015","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"pcbi.1010348.ref092","doi-asserted-by":"crossref","first-page":"D607","DOI":"10.1093\/nar\/gky1131","article-title":"STRING v11: protein-protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets","volume":"47","author":"D Szklarczyk","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"pcbi.1010348.ref093","first-page":"1","article-title":"GeneMANIA: a real-time multiple association network integration algorithm for predicting gene function","volume":"9","author":"S Mostafavi","year":"2008","journal-title":"Genome Biol"},{"issue":"suppl 2","key":"pcbi.1010348.ref094","doi-asserted-by":"crossref","first-page":"W214","DOI":"10.1093\/nar\/gkq537","article-title":"The GeneMANIA prediction server: biological network integration for gene prioritization and predicting gene function","volume":"38","author":"D Warde-Farley","year":"2010","journal-title":"Nucleic Acids Research"},{"issue":"W1","key":"pcbi.1010348.ref095","doi-asserted-by":"crossref","first-page":"W115","DOI":"10.1093\/nar\/gkt533","article-title":"GeneMANIA prediction server 2013 update","volume":"41","author":"K Zuberi","year":"2013","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1010348.ref096","doi-asserted-by":"crossref","first-page":"153","DOI":"10.12688\/f1000research.4572.1","article-title":"GeneMANIA: Fast gene network construction and function prediction for Cytoscape","volume":"3","author":"J Montojo","year":"2014","journal-title":"F1000Res."},{"issue":"W1","key":"pcbi.1010348.ref097","doi-asserted-by":"crossref","first-page":"W60","DOI":"10.1093\/nar\/gky311","article-title":"GeneMANIA update 2018","volume":"46","author":"M Franz","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"suppl 1","key":"pcbi.1010348.ref098","first-page":"D691","article-title":"Reactome: a database of reactions, pathways and biological processes","volume":"39","author":"D Croft","year":"2010","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1010348.ref099","article-title":"ReactomeFIViz: a Cytoscape app for pathway and network-based data analysis.","volume":"3","author":"G Wu","year":"2014","journal-title":"F1000Res"},{"issue":"4","key":"pcbi.1010348.ref100","first-page":"1","article-title":"Gene-interaction-sensitive enrichment analysis in congenital heart disease","volume":"15","author":"AA Woodwarda","year":"2022","journal-title":"BioData Mining"},{"key":"pcbi.1010348.ref101","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/978-1-0716-0947-7_11","article-title":"Brief survey on machine learning in epistasis.","author":"D Chicco","year":"2021","journal-title":"Epistasis."},{"key":"pcbi.1010348.ref102","article-title":"pathfindR: an R package for comprehensive identification of enriched pathways in omics data through active subnetworks","volume":"858","author":"E Ulgen","year":"2019","journal-title":"Front Genet"},{"issue":"10","key":"pcbi.1010348.ref103","doi-asserted-by":"crossref","first-page":"3283","DOI":"10.1093\/bioinformatics\/btaa077","article-title":"netGO: R-Shiny package for network-integrated pathway enrichment analysis","volume":"36","author":"J Kim","year":"2020","journal-title":"Bioinformatics"},{"key":"pcbi.1010348.ref104","unstructured":"Google. Google Scholar; 2022. Available from: https:\/\/scholar.google.com [cited 2022 Jan 31]."},{"key":"pcbi.1010348.ref105","unstructured":"US National Library of Medicine (NLM). PubMed; 2022. Available from: https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/ [cited 2022 Jan 31]."},{"key":"pcbi.1010348.ref106","unstructured":"bioRxiv. The preprint server for biology; 2022. Available from: https:\/\/www.biorxiv.org [cited 2022 Jan 31]."},{"key":"pcbi.1010348.ref107","unstructured":"arXiv q-bio. arXiv. Quant Biol; 2022. Available from: https:\/\/arxiv.org\/archive\/q-bio [cited 2022 Jan 31]."},{"issue":"35","key":"pcbi.1010348.ref108","first-page":"1","article-title":"Ten quick tips for machine learning in computational biology","volume":"10","author":"D. Chicco","year":"2017","journal-title":"BioData Min"},{"issue":"10","key":"pcbi.1010348.ref109","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2347736.2347755","article-title":"A few useful things to know about machine learning","volume":"55","author":"P. Domingos","year":"2012","journal-title":"Commun ACM."},{"issue":"11","key":"pcbi.1010348.ref110","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1038\/s41580-019-0176-5","article-title":"Setting the standards for machine learning in biology","volume":"20","author":"DT Jones","year":"2019","journal-title":"Nature Reviews Molecular Cell Biology"},{"issue":"1","key":"pcbi.1010348.ref111","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1038\/s41598-018-36873-4","article-title":"Stratification of amyotrophic lateral sclerosis patients: a crowdsourcing approach.","volume":"9","author":"R Kueffner","year":"2019","journal-title":"Sci Rep."},{"issue":"10","key":"pcbi.1010348.ref112","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1038\/s41592-021-01205-4","article-title":"DOME: Recommendations for supervised machine learning validation in biology","volume":"18","author":"I Walsh","year":"2021","journal-title":"Nat Methods"},{"issue":"1","key":"pcbi.1010348.ref113","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1002\/ehf2.13073","article-title":"Machine learning vs. conventional statistical models for predicting heart failure readmission and mortality","volume":"8","author":"S Shin","year":"2021","journal-title":"ESC Heart Fail"},{"key":"pcbi.1010348.ref114","doi-asserted-by":"crossref","first-page":"104510","DOI":"10.1016\/j.ijmedinf.2021.104510","article-title":"The need to separate the wheat from the chaff in medical informatics: introducing a comprehensive checklist for the (self)-assessment of medical AI studies.","volume":"153","author":"F Cabitza","year":"2021","journal-title":"Int J Med Inform"},{"key":"pcbi.1010348.ref115","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1038\/s41576-021-00434-9","article-title":"Navigating the pitfalls of applying machine learning in genomics","volume":"23","author":"S Whalen","year":"2021","journal-title":"Nat Rev Genet"},{"issue":"3","key":"pcbi.1010348.ref116","doi-asserted-by":"crossref","first-page":"e1009803","DOI":"10.1371\/journal.pcbi.1009803","article-title":"Ten quick tips for deep learning in biology","volume":"18","author":"BD Lee","year":"2022","journal-title":"PLoS Comput Biol"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,25]],"date-time":"2023-11-25T14:39:03Z","timestamp":1700923143000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010348"}},"subtitle":[],"editor":[{"given":"Francis","family":"Ouellette","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,8,11]]},"references-count":116,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8,11]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010348","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,11]]}}}