{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:10:58Z","timestamp":1772165458546,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T00:00:00Z","timestamp":1588118400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T00:00:00Z","timestamp":1588118400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1022688"],"award-info":[{"award-number":["1022688"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010909","name":"Young Scientists Fund","doi-asserted-by":"publisher","award":["11450110409"],"award-info":[{"award-number":["11450110409"]}],"id":[{"id":"10.13039\/501100010909","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Network motifs are connectivity structures that occur with significantly higher frequency than chance, and are thought to play important roles in complex biological networks, for example in gene regulation, interactomes, and metabolomes. Network motifs may also become pivotal in the rational design and engineering of complex biological systems underpinning the field of synthetic biology. Distinguishing true motifs from arbitrary substructures, however, remains a challenge.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Here we demonstrate both theoretically and empirically that implicit assumptions present in mainstream methods for motif identification do not necessarily hold, with the ramification that motif studies using these mainstream methods are less able to effectively differentiate between spurious results and events of true statistical significance than is often presented. We show that these difficulties cannot be overcome without revising the methods of statistical analysis used to identify motifs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Present-day methods for the discovery of network motifs, and, indeed, even the methods for defining what they are, are critically reliant on a set of incorrect assumptions, casting a doubt on the scientific validity of motif-driven discoveries. The implications of these findings are therefore far-reaching across diverse areas of biology.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-020-3441-x","type":"journal-article","created":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T15:03:17Z","timestamp":1588172597000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Intrinsic limitations in mainstream methods of identifying network motifs in biology"],"prefix":"10.1186","volume":"21","author":[{"given":"James","family":"Fodor","sequence":"first","affiliation":[]},{"given":"Michael","family":"Brand","sequence":"additional","affiliation":[]},{"given":"Rebecca J.","family":"Stones","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2943-9044","authenticated-orcid":false,"given":"Ashley M.","family":"Buckle","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,4,29]]},"reference":[{"key":"3441_CR1","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1126\/science.298.5594.824","volume":"298","author":"R Milo","year":"2002","unstructured":"Milo R, Shen-Orr S, Itzkovitz S, Kashtan N, Chklovskii D, et al. Network motifs: simple building blocks of complex networks. Science. 2002;298:824\u20137.","journal-title":"Science"},{"key":"3441_CR2","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1038\/ng881","volume":"31","author":"SS Shen-Orr","year":"2002","unstructured":"Shen-Orr SS, Milo R, Mangan S, Alon U. Network motifs in the transcriptional regulation network of Escherichia coli. Nat Genet. 2002;31:64\u20138.","journal-title":"Nat Genet"},{"key":"3441_CR3","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1038\/nrg2102","volume":"8","author":"U Alon","year":"2007","unstructured":"Alon U. Network motifs: theory and experimental approaches. Nat Rev Genet. 2007;8:450\u201361.","journal-title":"Nat Rev Genet"},{"key":"3441_CR4","first-page":"136","volume":"24","author":"C Li","year":"2007","unstructured":"Li C, Chen L, Aihara K. A systems biology perspective on signal processing in genetic network motifs [life sciences]. IEEE Signal Process Mag. 2007;24:136\u201347.","journal-title":"IEEE Signal Process Mag"},{"key":"3441_CR5","doi-asserted-by":"crossref","unstructured":"Schw\u00f6rbbermeyer H. Network motifs. In: Junker BH, Schreiber F, editors. Analysis of biological networks: Somerset:\u00a0Wiley; 2008. p. 85\u2013111.","DOI":"10.1002\/9780470253489.ch5"},{"key":"3441_CR6","doi-asserted-by":"crossref","unstructured":"Chen J, Hsu W, Lee ML, Ng S-K. Labeling network motifs in protein interactomes for protein function prediction: 2007 IEEE 23rd International Conference on Data Engineering, Istanbul 2007. p. 546\u201355.","DOI":"10.1109\/ICDE.2007.367900"},{"key":"3441_CR7","doi-asserted-by":"crossref","unstructured":"Gargouri M, Park J-J, Holguin FO, Kim M-J, Wang H, et al. Identification of regulatory network hubs that control lipid metabolism in Chlamydomonas reinhardtii. J Exp Bot. 2015;66:4551\u201366.","DOI":"10.1093\/jxb\/erv217"},{"key":"3441_CR8","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.1093\/bioinformatics\/bth163","volume":"20","author":"N Kashtan","year":"2004","unstructured":"Kashtan N, Itzkovitz S, Milo R, Alon U. Efficient sampling algorithm for estimating subgraph concentrations and detecting network motifs. Bioinformatics. 2004;20:1746\u201358.","journal-title":"Bioinformatics"},{"key":"3441_CR9","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1093\/bib\/bbr033","volume":"13","author":"E Wong","year":"2011","unstructured":"Wong E, Baur B, Quader S, Huang C-H. Biological network motif detection: principles and practice. Brief Bioinform. 2011;13:202\u201315.","journal-title":"Brief Bioinform"},{"key":"3441_CR10","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1093\/bioinformatics\/btl038","volume":"22","author":"S Wernicke","year":"2006","unstructured":"Wernicke S, Rasche F. FANMOD: a tool for fast network motif detection. Bioinformatics. 2006;22:1152\u20133.","journal-title":"Bioinformatics"},{"key":"3441_CR11","doi-asserted-by":"publisher","first-page":"3572","DOI":"10.1093\/bioinformatics\/bti556","volume":"21","author":"F Schreiber","year":"2005","unstructured":"Schreiber F, Schw\u00f6bbermeyer H. MAVisto: a tool for the exploration of network motifs. Bioinformatics. 2005;21:3572\u20134.","journal-title":"Bioinformatics"},{"key":"3441_CR12","doi-asserted-by":"publisher","first-page":"11938","DOI":"10.1038\/srep11938","volume":"5","author":"H Zhao","year":"2015","unstructured":"Zhao H, Liu T, Liu L, Zhang G, Pang L, et al. Chromatin states modify network motifs contributing to cell-specific functions. Sci Rep. 2015;5:11938.","journal-title":"Sci Rep"},{"key":"3441_CR13","doi-asserted-by":"publisher","first-page":"1356","DOI":"10.1261\/rna.042754.113","volume":"20","author":"R Mitra","year":"2014","unstructured":"Mitra R, Edmonds MD, Sun J, Zhao M, Yu H, et al. Reproducible combinatorial regulatory networks elucidate novel oncogenic microRNAs in non-small cell lung cancer. RNA. 2014;20:1356\u201368.","journal-title":"RNA"},{"key":"3441_CR14","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1038\/nmeth.2733","volume":"11","author":"A Vinayagam","year":"2014","unstructured":"Vinayagam A, Zirin J, Roesel C, Hu Y, Yilmazel B, et al. Integrating protein-protein interaction networks with phenotypes reveals signs of interactions. Nat Methods. 2014;11:94\u20139.","journal-title":"Nat Methods"},{"key":"3441_CR15","doi-asserted-by":"publisher","first-page":"3028","DOI":"10.1039\/c2mb25279a","volume":"8","author":"L Antiqueira","year":"2012","unstructured":"Antiqueira L, Janga SC, da Fontoura Costa L. Extensive cross-talk and global regulators identified from an analysis of the integrated transcriptional and signaling network in Escherichia coli. Mol BioSyst. 2012;8:3028\u201335.","journal-title":"Mol BioSyst"},{"key":"3441_CR16","doi-asserted-by":"publisher","first-page":"1274","DOI":"10.1016\/j.cell.2012.04.040","volume":"150","author":"S Neph","year":"2012","unstructured":"Neph S, Stergachis AB, Reynolds A, Sandstrom R, Borenstein E, et al. Circuitry and dynamics of human transcription factor regulatory networks. Cell. 2012;150:1274\u201386.","journal-title":"Cell"},{"key":"3441_CR17","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1039\/c2mb25346a","volume":"9","author":"ER Shellman","year":"2013","unstructured":"Shellman ER, Burant CF, Schnell S. Network motifs provide signatures that characterize metabolism. Mol BioSyst. 2013;9:352\u201360.","journal-title":"Mol BioSyst"},{"key":"3441_CR18","doi-asserted-by":"publisher","first-page":"632","DOI":"10.3390\/metabo2030632","volume":"2","author":"N Sonnenschein","year":"2012","unstructured":"Sonnenschein N, Marr C, H\u00fctt M-T. A topological characterization of medium-dependent essential metabolic reactions. Metabolites. 2012;2:632\u201347.","journal-title":"Metabolites"},{"key":"3441_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1089\/cmb.2007.0137","volume":"15","author":"F Picard","year":"2008","unstructured":"Picard F, Daudin J-J, Koskas M, Schbath S, Robin S. Assessing the exceptionality of network motifs. J Comput Biol. 2008;15:1\u201320.","journal-title":"J Comput Biol"},{"key":"3441_CR20","doi-asserted-by":"publisher","first-page":"S5","DOI":"10.1186\/1752-0509-5-S3-S5","volume":"5","author":"W Kim","year":"2011","unstructured":"Kim W, Li M, Wang J, Pan Y. Biological network motif detection and evaluation. BMC Syst Biol. 2011;5:S5.","journal-title":"BMC Syst Biol"},{"key":"3441_CR21","doi-asserted-by":"publisher","first-page":"056708","DOI":"10.1103\/PhysRevE.72.056708","volume":"72","author":"Y Artzy-Randrup","year":"2005","unstructured":"Artzy-Randrup Y, Stone L. Generating uniformly distributed random networks. Phys Rev E. 2005;72:056708.","journal-title":"Phys Rev E"},{"key":"3441_CR22","doi-asserted-by":"publisher","first-page":"011921","DOI":"10.1103\/PhysRevE.82.011921","volume":"82","author":"R Ginoza","year":"2010","unstructured":"Ginoza R, Mugler A. Network motifs come in sets: correlations in the randomization process. Phys Rev E. 2010;82:011921.","journal-title":"Phys Rev E"},{"key":"3441_CR23","doi-asserted-by":"publisher","first-page":"6480","DOI":"10.1093\/nar\/gky468","volume":"46","author":"J Defoort","year":"2018","unstructured":"Defoort J, Van de Peer Y, Vermeirssen V. Function, dynamics and evolution of network motif modules in integrated gene regulatory networks of worm and plant. Nucleic Acids Res. 2018;46:6480\u2013503.","journal-title":"Nucleic Acids Res"},{"key":"3441_CR24","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.biosystems.2006.01.004","volume":"85","author":"PD Kuo","year":"2006","unstructured":"Kuo PD, Banzhaf W, Leier A. Network topology and the evolution of dynamics in an artificial genetic regulatory network model created by whole genome duplication and divergence. Biosystems. 2006;85:177\u2013200.","journal-title":"Biosystems"},{"key":"3441_CR25","doi-asserted-by":"publisher","first-page":"026107","DOI":"10.1103\/PhysRevE.72.026107","volume":"72","author":"S Valverde","year":"2005","unstructured":"Valverde S, Sol\u00e9 RV. Network motifs in computational graphs: a case study in software architecture. Phys Rev E. 2005;72:026107.","journal-title":"Phys Rev E"},{"key":"3441_CR26","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1098\/rsif.2007.1108","volume":"5","author":"RV Sol\u00e9","year":"2007","unstructured":"Sol\u00e9 RV, Valverde S. Spontaneous emergence of modularity in cellular networks. J R Soc Interface. 2007;5:129\u201333.","journal-title":"J R Soc Interface"},{"key":"3441_CR27","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1016\/j.tree.2006.05.013","volume":"21","author":"RV Sol\u00e9","year":"2006","unstructured":"Sol\u00e9 RV, Valverde S. Are network motifs the spandrels of cellular complexity? Trends Ecol Evol. 2006;21:419\u201322.","journal-title":"Trends Ecol Evol"},{"key":"3441_CR28","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1093\/bfgp\/eln015","volume":"7","author":"G Ciriello","year":"2008","unstructured":"Ciriello G, Guerra C. A review on models and algorithms for motif discovery in protein\u2013protein interaction networks. Brief Funct Genomic Proteomic. 2008;7:147\u201356.","journal-title":"Brief Funct Genomic Proteomic"},{"key":"3441_CR29","doi-asserted-by":"publisher","first-page":"i241","DOI":"10.1093\/bioinformatics\/btn163","volume":"24","author":"N Alon","year":"2008","unstructured":"Alon N, Dao P, Hajirasouliha I, Hormozdiari F, Sahinalp SC. Biomolecular network motif counting and discovery by color coding. Bioinformatics. 2008;24:i241\u20139.","journal-title":"Bioinformatics"},{"key":"3441_CR30","doi-asserted-by":"crossref","unstructured":"Li X, Stones RJ, Wang H, Deng H, Liu X, et al. Netmode: network motif detection without Nauty. PLoS One. 2012;7:e50093.","DOI":"10.1371\/journal.pone.0050093"},{"key":"3441_CR31","doi-asserted-by":"publisher","first-page":"D98","DOI":"10.1093\/nar\/gkq1110","volume":"39","author":"S Gama-Castro","year":"2010","unstructured":"Gama-Castro S, Salgado H, Peralta-Gil M, Santos-Zavaleta A, Muniz-Rascado L, et al. RegulonDB version 7.0: transcriptional regulation of Escherichia coli K-12 integrated within genetic sensory response units (Gensor units). Nucleic Acids Res. 2010;39:D98\u2013D105.","journal-title":"Nucleic Acids Res"},{"key":"3441_CR32","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1186\/1471-2105-10-318","volume":"10","author":"ZRM Kashani","year":"2009","unstructured":"Kashani ZRM, Ahrabian H, Elahi E, Nowzari-Dalini A, Ansari ES, et al. Kavosh: a new algorithm for finding network motifs. BMC Bioinformatics. 2009;10:318.","journal-title":"BMC Bioinformatics"},{"key":"3441_CR33","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1093\/nar\/27.1.29","volume":"27","author":"H Ogata","year":"1999","unstructured":"Ogata H, Goto S, Sato K, Fujibuchi W, Bono H, et al. KEGG: Kyoto encyclopedia of genes and genomes. Nucleic Acids Res. 1999;27:29\u201334.","journal-title":"Nucleic Acids Res"},{"key":"3441_CR34","doi-asserted-by":"crossref","unstructured":"Wernicke S. A faster algorithm for detecting network motifs.\u00a0In: Casadio R., Myers G. (eds) Algorithms in Bioinformatics. WABI 2005. Lecture Notes in Computer Science, vol 3692. Springer, Berlin, Heidelberg.","DOI":"10.1007\/11557067_14"},{"key":"3441_CR35","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1109\/TCBB.2006.51","volume":"3","author":"S Wernicke","year":"2006","unstructured":"Wernicke S. Efficient detection of network motifs. IEEE\/ACM Trans Comput Biol Bioinform. 2006;3:347\u201359.","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"3441_CR36","doi-asserted-by":"crossref","unstructured":"Ribeiro P, Silva F. G-tries: an efficient data structure for discovering network motifs.\u00a0Proceedings of the 2010 ACM Symposium on Applied Computing. Sierre, Switzerland: Association for Computing Machinery. pp. 1559\u20131566.","DOI":"10.1145\/1774088.1774422"},{"key":"3441_CR37","unstructured":"Chen J, Hsu W, Lee ML, Ng S-K. NeMoFinder: dissecting genome-wide protein-protein interactions with meso-scale network motifs.\u00a0Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. Philadelphia, PA, USA: Association for Computing Machinery. pp. 106\u2013115."},{"key":"3441_CR38","doi-asserted-by":"publisher","first-page":"1479","DOI":"10.1093\/bioinformatics\/bti240","volume":"21","author":"HS Moon","year":"2004","unstructured":"Moon HS, Bhak J, Lee KH, Lee D. Architecture of basic building blocks in protein and domain structural interaction networks. Bioinformatics. 2004;21:1479\u201386.","journal-title":"Bioinformatics"},{"key":"3441_CR39","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1266\/ggs.84.385","volume":"84","author":"S Omidi","year":"2009","unstructured":"Omidi S, Schreiber F, Masoudi-Nejad A. MODA: an efficient algorithm for network motif discovery in biological networks. Genes Genet Syst. 2009;84:385\u201395.","journal-title":"Genes Genet Syst"},{"key":"3441_CR40","first-page":"53","volume-title":"Book of Abstracts for Journ\u00e9es Ouvertes Biologie Informatique Math\u00e9matiques (JOBIM)","author":"M Koskas","year":"2011","unstructured":"Koskas M, Grasseau G, Birmel\u00e9 E, Schbath S, Robin S. NeMo: fast count of network motifs. In: Book of Abstracts for Journ\u00e9es Ouvertes Biologie Informatique Math\u00e9matiques (JOBIM), vol. 2011; 2011. p. 53\u201360."},{"key":"3441_CR41","doi-asserted-by":"crossref","unstructured":"Marcus D, Shavitt Y. Efficient counting of network motifs:\u00a02010 IEEE 30th International Conference on Distributed Computing Systems Workshops, Genova, 2010, pp. 92-98.","DOI":"10.1109\/ICDCSW.2010.41"},{"key":"3441_CR42","doi-asserted-by":"crossref","unstructured":"Marcus D, Shavitt Y. RAGE\u2013a rapid graphlet enumerator for large networks. Comput Netw. 2012;56:810\u20139.","DOI":"10.1016\/j.comnet.2011.08.019"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-3441-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-020-3441-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-3441-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,28]],"date-time":"2021-04-28T19:09:00Z","timestamp":1619636940000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-020-3441-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,29]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["3441"],"URL":"https:\/\/doi.org\/10.1186\/s12859-020-3441-x","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/272401","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,29]]},"assertion":[{"value":"9 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests. Otzma Analytics played no role in the analysis presented in this paper, and has no competing interests in this work.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"165"}}