{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T21:15:17Z","timestamp":1777583717797,"version":"3.51.4"},"reference-count":14,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2018,9,18]],"date-time":"2018-09-18T00:00:00Z","timestamp":1537228800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute of Health","award":["LM010098"],"award-info":[{"award-number":["LM010098"]}]},{"name":"National Institute of Health","award":["LM012601"],"award-info":[{"award-number":["LM012601"]}]},{"name":"National Institute of Health","award":["GM121312"],"award-info":[{"award-number":["GM121312"]}]},{"name":"National Institute of Health","award":["GM103456"],"award-info":[{"award-number":["GM103456"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,4,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Relief is a family of machine learning algorithms that uses nearest-neighbors to select features whose association with an outcome may be due to epistasis or statistical interactions with other features in high-dimensional data. Relief-based estimators are non-parametric in the statistical sense that they do not have a parameterized model with an underlying probability distribution for the estimator, making it difficult to determine the statistical significance of Relief-based attribute estimates. Thus, a statistical inferential formalism is needed to avoid imposing arbitrary thresholds to select the most important features. We reconceptualize the Relief-based feature selection algorithm to create a new family of STatistical Inference Relief (STIR) estimators that retains the ability to identify interactions while incorporating sample variance of the nearest neighbor distances into the attribute importance estimation. This variance permits the calculation of statistical significance of features and adjustment for multiple testing of Relief-based scores. Specifically, we develop a pseudo t-test version of Relief-based algorithms for case-control data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We demonstrate the statistical power and control of type I error of the STIR family of feature selection methods on a panel of simulated data that exhibits properties reflected in real gene expression data, including main effects and network interaction effects. We compare the performance of STIR when the adaptive radius method is used as the nearest neighbor constructor with STIR when the fixed-k nearest neighbor constructor is used. We apply STIR to real RNA-Seq data from a study of major depressive disorder and discuss STIR\u2019s straightforward extension to genome-wide association studies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>Code and data available at http:\/\/insilico.utulsa.edu\/software\/STIR.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Supplementary information<\/jats:title>\n                    <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty788","type":"journal-article","created":{"date-parts":[[2018,9,17]],"date-time":"2018-09-17T07:15:19Z","timestamp":1537168519000},"page":"1358-1365","source":"Crossref","is-referenced-by-count":57,"title":["STatistical Inference Relief (STIR) feature selection"],"prefix":"10.1093","volume":"35","author":[{"given":"Trang T","family":"Le","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, Institute for Biomedical Informatics, University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryan J","family":"Urbanowicz","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, Institute for Biomedical Informatics, University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason H","family":"Moore","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Epidemiology and Informatics, Institute for Biomedical Informatics, University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brett A","family":"McKinney","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Tulsa, Tulsa, OK, USA"},{"name":"Tandy School of Computer Science, University of Tulsa, Tulsa, OK, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,9,18]]},"reference":[{"key":"2023012808140003800_bty788-B1","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/S0166-4328(01)00297-2","article-title":"Controlling the false discovery rate in behavior genetics research","volume":"125","author":"Benjamini","year":"2001","journal-title":"Behav. Brain Res"},{"key":"2023012808140003800_bty788-B2","doi-asserted-by":"crossref","first-page":"5.","DOI":"10.1186\/1756-0381-2-5","article-title":"Spatially Uniform ReliefF (SURF) for computationally-efficient filtering of gene-gene interactions","volume":"2","author":"Greene","year":"2009","journal-title":"BioData Min"},{"key":"2023012808140003800_bty788-B3","first-page":"129","volume-title":"Proceedings Tenth National Conference on Artificial Intelligence","author":"Kira","year":"1992"},{"key":"2023012808140003800_bty788-B4","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1023\/A:1008280620621","article-title":"Overcoming the myopia of inductive learning algorithms with RELIEFF","volume":"7","author":"Kononenko","year":"1997","journal-title":"Appl. Intell"},{"key":"2023012808140003800_bty788-B5","doi-asserted-by":"crossref","first-page":"5.","DOI":"10.1186\/s13040-015-0040-x","article-title":"Differential co-expression network centrality and machine learning feature selection for identifying susceptibility hubs in networks with scale-free structure","volume":"8","author":"Lareau","year":"2015","journal-title":"BioData Min"},{"key":"2023012808140003800_bty788-B6","doi-asserted-by":"crossref","first-page":"2906","DOI":"10.1093\/bioinformatics\/btx298","article-title":"Differential privacy-based evaporative cooling feature selection and classification with relief-f and random forests","volume":"33","author":"Le","year":"2017","journal-title":"Bioinformatics"},{"key":"2023012808140003800_bty788-B7","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1038\/s41398-018-0234-3","article-title":"Identification and replication of RNA-Seq gene network modules associated with depression severity","volume":"8","author":"Le","year":"2018","journal-title":"Transl. Psychiatry"},{"key":"2023012808140003800_bty788-B8","first-page":"109.","article-title":"Six degrees of epistasis: statistical network models for GWAS","volume":"2","author":"McKinney","year":"2011","journal-title":"Front. Genet"},{"key":"2023012808140003800_bty788-B9","doi-asserted-by":"crossref","first-page":"e1000432.","DOI":"10.1371\/journal.pgen.1000432","article-title":"Capturing the spectrum of interaction effects in genetic association studies by simulated evaporative cooling network analysis","volume":"5","author":"McKinney","year":"2009","journal-title":"PLoS Genet"},{"key":"2023012808140003800_bty788-B10","doi-asserted-by":"crossref","first-page":"e81527.","DOI":"10.1371\/journal.pone.0081527","article-title":"ReliefSeq: a gene-wise adaptive-K nearest-neighbor feature selection tool for finding gene-gene interactions and main effects in mRNA-Seq gene expression data","volume":"8","author":"McKinney","year":"2013","journal-title":"PLoS One"},{"key":"2023012808140003800_bty788-B11","doi-asserted-by":"crossref","first-page":"645.","DOI":"10.1038\/msb.2013.2","article-title":"Epigenetic epistatic interactions constrain the evolution of gene expression","volume":"9","author":"Park","year":"2013","journal-title":"Mol. Syst. Biol"},{"key":"2023012808140003800_bty788-B12","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1023\/A:1025667309714","article-title":"Theoretical and empirical analysis of relieff and rrelieff","volume":"53","author":"Robnik-\u0160ikonja","year":"2003","journal-title":"Mach. Learn"},{"key":"2023012808140003800_bty788-B13","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.jbi.2018.07.015","article-title":"Benchmarking relief-based feature selection methods for bioinformatics data mining","volume":"85","author":"Urbanowicz","year":"2018","journal-title":"J. Biomed. Informat"},{"key":"2023012808140003800_bty788-B14","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.jbi.2018.07.014","article-title":"Relief-based feature selection: introduction and review","volume":"85","author":"Urbanowicz","year":"2018","journal-title":"J. Biomed. Informat"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/8\/1358\/48940715\/bioinformatics_35_8_1358.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/8\/1358\/48940715\/bioinformatics_35_8_1358.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T03:36:10Z","timestamp":1674876970000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/35\/8\/1358\/5100883"}},"subtitle":[],"editor":[{"given":"Inanc","family":"Birol","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2018,9,18]]},"references-count":14,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2019,4,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty788","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/359224","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,4,15]]},"published":{"date-parts":[[2018,9,18]]}}}