{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T17:12:20Z","timestamp":1782493940001,"version":"3.54.5"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T00:00:00Z","timestamp":1616630400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T00:00:00Z","timestamp":1616630400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IGERT 1144807"],"award-info":[{"award-number":["IGERT 1144807"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1452718"],"award-info":[{"award-number":["IIS-1452718"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Large-scale biological data sets are often contaminated by noise, which can impede accurate inferences about underlying processes. Such measurement noise can arise from endogenous biological factors like cell cycle and life history variation, and from exogenous technical factors like sample preparation and instrument variation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We describe a general method for automatically reducing noise in large-scale biological data sets. This method uses an interaction network to identify groups of correlated or anti-correlated measurements that can be combined or \u201cfiltered\u201d to better recover an underlying biological signal. Similar to the process of denoising an image, a single network filter may be applied to an entire system, or the system may be first decomposed into distinct modules and a different filter applied to each. Applied to synthetic data with known network structure and signal, network filters accurately reduce noise across a wide range of noise levels and structures. Applied to a machine learning task of predicting changes in human protein expression in healthy and cancerous tissues, network filtering prior to training increases accuracy up to 43% compared to using unfiltered data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Network filters are a general way to denoise biological data and can account for both correlation and anti-correlation between different measurements. Furthermore, we find that partitioning a network prior to filtering can significantly reduce errors in networks with heterogenous data and correlation patterns, and this approach outperforms existing diffusion based methods. Our results on proteomics data indicate the broad potential utility of network filters to applications in systems biology.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-021-04075-x","type":"journal-article","created":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T06:02:30Z","timestamp":1616652150000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Denoising large-scale biological data using network filters"],"prefix":"10.1186","volume":"22","author":[{"given":"Andrew J.","family":"Kavran","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3529-8746","authenticated-orcid":false,"given":"Aaron","family":"Clauset","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,25]]},"reference":[{"issue":"4","key":"4075_CR1","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1038\/nrg.2016.159","volume":"18","author":"MB Woodworth","year":"2017","unstructured":"Woodworth MB, Girskis KM, Walsh CA. Building a lineage from single cells: genetic techniques for cell lineage tracking. Nat Rev Genet. 2017;18(4):230.","journal-title":"Nat Rev Genet"},{"issue":"12","key":"4075_CR2","doi-asserted-by":"publisher","first-page":"169730","DOI":"10.1242\/dev.169730","volume":"146","author":"A McKenna","year":"2019","unstructured":"McKenna A, Gagnon JA. Recording development with single cell dynamic lineage tracing. Development. 2019;146(12):169730.","journal-title":"Development"},{"key":"4075_CR3","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.tcb.2018.12.001","volume":"29","author":"I Pastushenko","year":"2018","unstructured":"Pastushenko I, Blanpain C. Emt transition states during tumor progression and metastasis. Trends Cell Biol. 2018;29:212\u201326.","journal-title":"Trends Cell Biol"},{"issue":"6","key":"4075_CR4","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1016\/j.cell.2015.07.061","volume":"162","author":"W Hugo","year":"2015","unstructured":"Hugo W, Shi H, Sun L, Piva M, Song C, Kong X, Moriceau G, Hong A, Dahlman KB, Johnson DB, et al. Non-genomic and immune evolution of melanoma acquiring mapki resistance. Cell. 2015;162(6):1271\u201385.","journal-title":"Cell"},{"issue":"2","key":"4075_CR5","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1016\/j.ccr.2011.12.024","volume":"21","author":"T Muranen","year":"2012","unstructured":"Muranen T, Selfors LM, Worster DT, Iwanicki MP, Song L, Morales FC, Gao S, Mills GB, Brugge JS. Inhibition of pi3k\/mtor leads to adaptive resistance in matrix-attached cancer cells. Cancer Cell. 2012;21(2):227\u201339.","journal-title":"Cancer Cell"},{"issue":"9458","key":"4075_CR6","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1016\/S0140-6736(05)17866-0","volume":"365","author":"S Michiels","year":"2005","unstructured":"Michiels S, Koscielny S, Hill C. Prediction of cancer outcome with microarrays: a multiple random validation strategy. The Lancet. 2005;365(9458):488\u201392.","journal-title":"The Lancet"},{"issue":"5","key":"4075_CR7","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","volume":"14","author":"KS Button","year":"2013","unstructured":"Button KS, Ioannidis JP, Mokrysz C, Nosek BA, Flint J, Robinson ES, Munaf\u00f2 MR. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14(5):365.","journal-title":"Nat Rev Neurosci"},{"issue":"3","key":"4075_CR8","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1038\/ng1180","volume":"34","author":"VK Mootha","year":"2003","unstructured":"Mootha VK, Lindgren CM, Eriksson KF, Subramanian A, Sihag S, Lehar J, Puigserver P, Carlsson E, Ridderstrale M, Laurila E, Houstis N, Daly MJ, Patterson N, Mesirov JP, Golub TR, Tamayo P, Spiegelman B, Lander ES, Hirschhorn JN, Altshuler D, Groop LC. PGC-1\u03b1-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat Genet. 2003;34(3):267\u201373.","journal-title":"Nat Genet"},{"issue":"7269","key":"4075_CR9","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1038\/nature08460","volume":"462","author":"DA Barbie","year":"2009","unstructured":"Barbie DA, Tamayo P, Boehm JS, Kim SY, Moody SE, Dunn IF, Schinzel AC, Sandy P, Meylan E, Scholl C, et al. Systematic rna interference reveals that oncogenic kras-driven cancers require tbk1. Nature. 2009;462(7269):108.","journal-title":"Nature"},{"issue":"432","key":"4075_CR10","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1126\/scisignal.aad1932","volume":"9","author":"T Ronan","year":"2016","unstructured":"Ronan T, Qi Z, Naegle KM. Avoiding common pitfalls when clustering biological data. Sci Signal. 2016;9(432):6.","journal-title":"Sci Signal"},{"issue":"19","key":"4075_CR11","doi-asserted-by":"publisher","first-page":"10869","DOI":"10.1073\/pnas.191367098","volume":"98","author":"T S\u00f8rlie","year":"2001","unstructured":"S\u00f8rlie T, Perou CM, Tibshirani R, Aas T, Geisler S, Johnsen H, Hastie T, Eisen MB, Van De Rijn M, Jeffrey SS, et al. Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implications. Proc Natl Acad Sci USA. 2001;98(19):10869\u201374.","journal-title":"Proc Natl Acad Sci USA"},{"key":"4075_CR12","doi-asserted-by":"crossref","unstructured":"Gupta A, Wang H, Ganapathiraju M. Learning structure in gene expression data using deep architectures, with an application to gene clustering. In: 2015 IEEE international conference on bioinformatics and biomedicine (BIBM), 2015; p. 1328\u201335. IEEE.","DOI":"10.1109\/BIBM.2015.7359871"},{"key":"4075_CR13","unstructured":"Tan J, Ung M, Cheng C, Greene CS. Unsupervised feature construction and knowledge extraction from genome-wide assays of breast cancer with denoising autoencoders. In: Pacific Symposium on Biocomputing, 2015; p. 132\u201343."},{"key":"4075_CR14","doi-asserted-by":"crossref","unstructured":"Ronen J, Akalin A. netsmooth: Network-smoothing based imputation for single cell rna-seq. F1000Research 2018;7.","DOI":"10.12688\/f1000research.13511.1"},{"key":"4075_CR15","doi-asserted-by":"crossref","unstructured":"D\u00f8rum G, Snipen L, Solheim M, Saebo S. Smoothing gene expression data with network information improves consistency of regulated genes. Stat Appl Genet Mol Biol 2011;10(1):37.","DOI":"10.2202\/1544-6115.1618"},{"issue":"2","key":"4075_CR16","doi-asserted-by":"publisher","first-page":"026126","DOI":"10.1103\/PhysRevE.67.026126","volume":"67","author":"MEJ Newman","year":"2003","unstructured":"Newman MEJ. Mixing patterns in networks. Phys Rev E. 2003;67(2):026126.","journal-title":"Phys Rev E"},{"issue":"suppl-1","key":"4075_CR17","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1093\/bioinformatics\/18.suppl_1.S233","volume":"18","author":"T Ideker","year":"2002","unstructured":"Ideker T, Ozier O, Schwikowski B, Siegel AF. Discovering regulatory and signalling circuits in molecular interaction networks. Bioinformatics. 2002;18(suppl-1):233\u201340.","journal-title":"Bioinformatics"},{"issue":"12","key":"4075_CR18","doi-asserted-by":"publisher","first-page":"2376","DOI":"10.1101\/gr.142281.112","volume":"22","author":"A Goncalves","year":"2012","unstructured":"Goncalves A, Leigh-Brown S, Thybert D, Stefflova K, Turro E, Flicek P, Brazma A, Odom DT, Marioni JC. Extensive compensatory cis\u2013trans regulation in the evolution of mouse gene expression. Genome Res. 2012;22(12):2376\u201384.","journal-title":"Genome Res"},{"issue":"17","key":"4075_CR19","doi-asserted-by":"publisher","first-page":"14841","DOI":"10.1074\/jbc.M211926200","volume":"278","author":"PM Bauer","year":"2003","unstructured":"Bauer PM, Fulton D, Bo YC, Sorescu GP, Kemp BE, Jo H, Sessa WC. Compensatory phosphorylation and protein\u2013protein interactions revealed by loss of function and gain of function mutants of multiple serine phosphorylation sites in endothelial nitric-oxide synthase. J Biol Chem. 2003;278(17):14841\u20139.","journal-title":"J Biol Chem"},{"issue":"16","key":"4075_CR20","doi-asserted-by":"publisher","first-page":"4057","DOI":"10.1073\/pnas.1713019115","volume":"115","author":"L Peel","year":"2018","unstructured":"Peel L, Delvenne J-C, Lambiotte R. Multiscale mixing patterns in networks. Proc Natl Acad Sci USA. 2018;115(16):4057\u201362.","journal-title":"Proc Natl Acad Sci USA"},{"issue":"6","key":"4075_CR21","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1016\/j.cels.2016.11.005","volume":"3","author":"JD Rudolph","year":"2016","unstructured":"Rudolph JD, de Graauw M, van de Water B, Geiger T, Sharan R. Elucidation of signaling pathways from large-scale phosphoproteomic data using protein interaction networks. Cell Syst. 2016;3(6):585\u201393.","journal-title":"Cell Syst"},{"key":"4075_CR22","unstructured":"Mansourpour M, Rajabi M, Blais J. Effects and performance of speckle noise reduction filters on active radar and sar images. In: Proceeding of ISPRS, 2006; vol. 36, p. 41."},{"issue":"10","key":"4075_CR23","doi-asserted-by":"publisher","first-page":"10008","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","volume":"2008","author":"VD Blondel","year":"2008","unstructured":"Blondel VD, Guillaume J-L, Lambiotte R, Lefebvre E. Fast unfolding of communities in large networks. J Stat Mech Theory Exp. 2008;2008(10):10008.","journal-title":"J Stat Mech Theory Exp"},{"key":"4075_CR24","first-page":"849","volume":"14","author":"A Ng","year":"2001","unstructured":"Ng A, Jordan M, Weiss Y. On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst. 2001;14:849\u201356.","journal-title":"Adv Neural Inf Process Syst"},{"issue":"1","key":"4075_CR25","doi-asserted-by":"publisher","first-page":"016107","DOI":"10.1103\/PhysRevE.83.016107","volume":"83","author":"B Karrer","year":"2011","unstructured":"Karrer B, Newman MEJ. Stochastic blockmodels and community structure in networks. Phys Rev E. 2011;83(1):016107.","journal-title":"Phys Rev E"},{"key":"4075_CR26","doi-asserted-by":"publisher","first-page":"11863","DOI":"10.1038\/ncomms11863","volume":"7","author":"MEJ Newman","year":"2016","unstructured":"Newman MEJ, Clauset A. Structure and inference in annotated networks. Nat Commun. 2016;7:11863.","journal-title":"Nat Commun"},{"issue":"9","key":"4075_CR27","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1109\/TKDE.2019.2911585","volume":"32","author":"A Ghasemian","year":"2019","unstructured":"Ghasemian A, Hosseinmardi H, Clauset A. Evaluating overfit and underfit in models of network community structure. IEEE Trans Knowl Data Eng. 2019;32(9):1722\u201335.","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"4075_CR28","doi-asserted-by":"crossref","unstructured":"Jeh G, Widom J. Scaling personalized web search. In: Proceedings of the 12th international conference on world wide web, 2003; p. 271\u20139. ACM.","DOI":"10.1145\/775152.775191"},{"issue":"11","key":"4075_CR29","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1186\/gb-2006-7-11-120","volume":"7","author":"GT Hart","year":"2006","unstructured":"Hart GT, Ramani AK, Marcotte EM. How complete are current yeast and human protein-interaction networks? Genome Biol. 2006;7(11):120.","journal-title":"Genome Biol"},{"issue":"9","key":"4075_CR30","doi-asserted-by":"publisher","first-page":"3192","DOI":"10.1073\/pnas.0409515102","volume":"102","author":"M Middendorf","year":"2005","unstructured":"Middendorf M, Ziv E, Wiggins CH. Inferring network mechanisms: The Drosophila melanogaster protein interaction network. Proc Natl Acad Sci. 2005;102(9):3192\u20137.","journal-title":"Proc Natl Acad Sci"},{"issue":"2","key":"4075_CR31","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1158\/1940-6207.CAPR-16-0024","volume":"9","author":"JD Campbell","year":"2016","unstructured":"Campbell JD, Mazzilli SA, Reid ME, Dhillon SS, Platero S, Beane J, Spira AE. The case for a pre-cancer genome atlas (pcga). Cancer Prevent Res. 2016;9(2):119\u201324.","journal-title":"Cancer Prevent Res"},{"issue":"7","key":"4075_CR32","doi-asserted-by":"publisher","first-page":"1510","DOI":"10.1158\/0008-5472.CAN-16-2346","volume":"77","author":"A Spira","year":"2017","unstructured":"Spira A, Yurgelun MB, Alexandrov L, Rao A, Bejar R, Polyak K, Giannakis M, Shilatifard A, Finn OJ, Dhodapkar M, et al. Precancer atlas to drive precision prevention trials. Cancer Res. 2017;77(7):1510\u201341.","journal-title":"Cancer Res"},{"issue":"6220","key":"4075_CR33","doi-asserted-by":"publisher","first-page":"1260419","DOI":"10.1126\/science.1260419","volume":"347","author":"M Uhl\u00e9n","year":"2015","unstructured":"Uhl\u00e9n M, Fagerberg L, Hallstr\u00f6m BM, Lindskog C, Oksvold P, Mardinoglu A, Sivertsson \u00c5, Kampf C, Sj\u00f6stedt E, Asplund A, et al. Tissue-based map of the human proteome. Science. 2015;347(6220):1260419.","journal-title":"Science"},{"issue":"1","key":"4075_CR34","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s00428-015-1829-1","volume":"468","author":"M Vyberg","year":"2016","unstructured":"Vyberg M, Nielsen S. Proficiency testing in immunohistochemistry\u2014experiences from nordic immunohistochemical quality control (nordiqc). Virchows Archiv. 2016;468(1):19\u201329.","journal-title":"Virchows Archiv"},{"issue":"1","key":"4075_CR35","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1186\/1752-0509-6-92","volume":"6","author":"J Das","year":"2012","unstructured":"Das J, Yu H. Hint: High-quality protein interactomes and their applications in understanding human disease. BMC Syst Biol. 2012;6(1):92.","journal-title":"BMC Syst Biol"},{"key":"4075_CR36","unstructured":"Motwani MC, Gadiya MC, Motwani RC, Harris FC. Survey of image denoising techniques. In: Proceedings of GSPX, 2004; p. 27\u201330."},{"key":"4075_CR37","unstructured":"Agostinelli F, Anderson MR, Lee H. Adaptive multi-column deep neural networks with application to robust image denoising. In: Advances in neural information processing systems, 2013; p. 1493\u2013501."},{"issue":"1","key":"4075_CR38","doi-asserted-by":"publisher","first-page":"042472","DOI":"10.1155\/2007\/42472","volume":"2007","author":"R \u00d6ktem","year":"2007","unstructured":"\u00d6ktem R, Egiazarian K, Lukin VV, Ponomarenko NN, Tsymbal OV. Locally adaptive dct filtering for signal-dependent noise removal. EURASIP J Adv Signal Process. 2007;2007(1):042472.","journal-title":"EURASIP J Adv Signal Process"},{"key":"4075_CR39","unstructured":"Deng G, Cahill L. An adaptive Gaussian filter for noise reduction and edge detection. In: 1993 IEEE conference record nuclear science symposium and medical imaging conference, 1993; p. 1615\u20139. IEEE."},{"issue":"5","key":"4075_CR40","doi-asserted-by":"publisher","first-page":"1602548","DOI":"10.1126\/sciadv.1602548","volume":"3","author":"L Peel","year":"2017","unstructured":"Peel L, Larremore DB, Clauset A. The ground truth about metadata and community detection in networks. Sci Adv. 2017;3(5):1602548.","journal-title":"Sci Adv"},{"issue":"1","key":"4075_CR41","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1080\/10586458.2001.10504428","volume":"10","author":"W Aiello","year":"2001","unstructured":"Aiello W, Chung F, Lu L. A random graph model for power law graphs. Exp Math. 2001;10(1):53\u201366.","journal-title":"Exp Math"},{"key":"4075_CR42","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/PL00012580","volume":"6","author":"F Chung","year":"2002","unstructured":"Chung F, Lu L. Connected components in random graphs with given expected degree sequences. Ann Combin. 2002;6:125\u201345.","journal-title":"Ann Combin"},{"key":"4075_CR43","doi-asserted-by":"crossref","unstructured":"Alam M, Khan M, Vullikanti A, Marathe M. An efficient and scalable algorithmic method for generating large-scale random graphs. In: SC\u201916: Proceedings of the international conference for high performance computing, networking, storage and analysis, 2016; p. 372\u201383. IEEE.","DOI":"10.1109\/SC.2016.31"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04075-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12859-021-04075-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04075-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T16:20:36Z","timestamp":1724689236000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-021-04075-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,25]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["4075"],"URL":"https:\/\/doi.org\/10.1186\/s12859-021-04075-x","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.03.12.989244","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.3.rs-66071\/v1","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.3.rs-66071\/v2","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,25]]},"assertion":[{"value":"25 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"157"}}