{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T05:55:18Z","timestamp":1675317318295},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":2685,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/uk\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,6,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: A variety of algorithms have been developed to predict transcription factor binding sites (TFBSs) within the genome by exploiting the evolutionary information implicit in multiple alignments of the genomes of related species. One such approach uses an extension of the standard position-specific motif model that incorporates phylogenetic information via a phylogenetic tree and a model of evolution. However, these phylogenetic motif models (PMMs) have never been rigorously benchmarked in order to determine whether they lead to better prediction of TFBSs than obtained using simple position weight matrix scanning.<\/jats:p>\n               <jats:p>Results: We evaluate three PMM-based prediction algorithms, each of which uses a different treatment of gapped alignments, and we compare their prediction accuracy with that of a non-phylogenetic motif scanning approach. Surprisingly, all of these algorithms appear to be inferior to simple motif scanning, when accuracy is measured using a gold standard of validated yeast TFBSs. However, the PMM scanners perform much better than simple motif scanning when we abandon the gold standard and consider the number of statistically significant sites predicted, using column-shuffled \u2018random\u2019 motifs to measure significance. These results suggest that the common practice of measuring the accuracy of binding site predictors using collections of known sites may be dangerously misleading since such collections may be missing \u2018weak\u2019 sites, which are exactly the type of sites needed to discriminate among predictors. We then extend our previous theoretical model of the statistical power of PMM-based prediction algorithms to allow for loss of binding sites during evolution, and show that it gives a more accurate upper bound on scanner accuracy. Finally, utilizing our theoretical model, we introduce a new method for predicting the number of real binding sites in a genome. The results suggest that the number of true sites for a yeast TF is in general several times greater than the number of known sites listed in the Saccharomyces cerevisiae Database (SCPD). Among the three scanning algorithms that we test, the MONKEY algorithm has the highest accuracy for predicting yeast TFBSs.<\/jats:p>\n               <jats:p>Contact: \u00a0j.hawkins@imb.uq.edu.au<\/jats:p>","DOI":"10.1093\/bioinformatics\/btp201","type":"journal-article","created":{"date-parts":[[2009,5,28]],"date-time":"2009-05-28T15:48:54Z","timestamp":1243525734000},"page":"i339-i347","source":"Crossref","is-referenced-by-count":14,"title":["Assessing phylogenetic motif models for predicting transcription factor binding sites"],"prefix":"10.1093","volume":"25","author":[{"given":"John","family":"Hawkins","sequence":"first","affiliation":[{"name":"1 Institute for Molecular Bioscience, University of Queensland, Qld 4072, Australia, 2Department of Genome Sciences and 3Department of Computer Science and Engineering, University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles","family":"Grant","sequence":"additional","affiliation":[{"name":"1 Institute for Molecular Bioscience, University of Queensland, Qld 4072, Australia, 2Department of Genome Sciences and 3Department of Computer Science and Engineering, University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William Stafford","family":"Noble","sequence":"additional","affiliation":[{"name":"1 Institute for Molecular Bioscience, University of Queensland, Qld 4072, Australia, 2Department of Genome Sciences and 3Department of Computer Science and Engineering, University of Washington, Seattle, WA, USA"},{"name":"1 Institute for Molecular Bioscience, University of Queensland, Qld 4072, Australia, 2Department of Genome Sciences and 3Department of Computer Science and Engineering, University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy L.","family":"Bailey","sequence":"additional","affiliation":[{"name":"1 Institute for Molecular Bioscience, University of Queensland, Qld 4072, Australia, 2Department of Genome Sciences and 3Department of Computer Science and Engineering, University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2009,5,27]]},"reference":[{"key":"2023013112015165700_B1","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1073\/pnas.231608898","article-title":"Exploiting transcription factor binding site clustering to identify cis-regulatory modules involved in pattern formation in the Drosophila genome","volume":"99","author":"Berman","year":"2002","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112015165700_B2","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1101\/gr.1933104","article-title":"Aligning multiple genomic sequences with the threaded blockset aligner","volume":"14","author":"Blanchette","year":"2004","journal-title":"Genome Res."},{"key":"2023013112015165700_B3","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1126\/science.1081331","article-title":"Phylogenetic shadowing of primate sequences to find functional regions of the human genome","volume":"299","author":"Boffelli","year":"2003","journal-title":"Science"},{"key":"2023013112015165700_B4","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1126\/science.1140748","article-title":"Divergence of transcription factor binding sites across related yeast species","volume":"317","author":"Borneman","year":"2007","journal-title":"Science"},{"key":"2023013112015165700_B5","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1101\/gr.926603","article-title":"Lagan and multi-lagan: efficient tools for large-scale multiple alignment of genomic DNA","volume":"13","author":"Brudno","year":"2003","journal-title":"Genome Res."},{"key":"2023013112015165700_B6","doi-asserted-by":"crossref","first-page":"3497","DOI":"10.1093\/nar\/gkg500","article-title":"Multiple sequence alignment with the clustal series of programs","volume":"31","author":"Chenna","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"2023013112015165700_B7","doi-asserted-by":"crossref","first-page":"e99","DOI":"10.1371\/journal.pcbi.0030099","article-title":"Frequent gain and loss of functional transcription factor binding sites","volume":"3","author":"Doniger","year":"2007","journal-title":"PLoS Comput. Biol."},{"key":"2023013112015165700_B8","doi-asserted-by":"crossref","first-page":"e10","DOI":"10.1371\/journal.pbio.0030010","article-title":"A model of the statistical power of comparative genome sequence analysis","volume":"3","author":"Eddy","year":"2005","journal-title":"PLoS Biol."},{"key":"2023013112015165700_B9","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/BF01734359","article-title":"Evolutionary trees from DNA sequences: a maximum likelihood approach","volume":"17","author":"Felsenstein","year":"1981","journal-title":"J. Mol. Evol."},{"key":"2023013112015165700_B10","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1038\/nature07521","article-title":"Analysis of combinatorial cis-regulation in synthetic and genomic promoters","volume":"457","author":"Gertz","year":"2008","journal-title":"Nature"},{"key":"2023013112015165700_B11","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1038\/ncb1434","article-title":"Myc-binding-site recognition in the human genome is determined by chromatin context","volume":"8","author":"Guccione","year":"2006","journal-title":"Nat. Cell Biol."},{"key":"2023013112015165700_B12","doi-asserted-by":"crossref","first-page":"3585","DOI":"10.1093\/nar\/gkl372","article-title":"Computational identification of transcriptional regulatory elements in DNA sequence","volume":"34","author":"GuhaThakurta","year":"2006","journal-title":"Nucleic Acids Res."},{"key":"2023013112015165700_B13","first-page":"4919","article-title":"Phylogenetic footprinting reveals a nuclear protein which binds to silencer sequences in the human gamma and epsilon globin genes","volume":"12","author":"Gumucio","year":"1992","journal-title":"Mol. Cell Biol."},{"key":"2023013112015165700_B14","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1093\/oxfordjournals.molbev.a025995","article-title":"Evolutionary distances for protein-coding sequences: modeling site-specific residue frequencies","volume":"15","author":"Halpern","year":"1998","journal-title":"Mol. Biol. Evol."},{"key":"2023013112015165700_B15","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1007\/BF02101694","article-title":"Dating of the human-ape splitting by a molecular clock of mitochondrial DNA","volume":"22","author":"Hasegawa","year":"1985","journal-title":"J. Mol. Evol."},{"key":"2023013112015165700_B16","first-page":"112","article-title":"The statistical power of phylogenetic motif models","volume-title":"12th Annual International Conference on Computational Biology.","author":"Hawkins","year":"2008"},{"key":"2023013112015165700_B17","doi-asserted-by":"crossref","first-page":"3059","DOI":"10.1093\/nar\/gkf436","article-title":"Mafft: a novel method for rapid multiple sequence alignment based on fast fourier transform","volume":"30","author":"Katoh","year":"2002","journal-title":"Nucleic Acids Res."},{"key":"2023013112015165700_B18","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1038\/nature01644","article-title":"Sequencing and comparison of yeast species to identify genes and regulatory elements","volume":"423","author":"Kellis","year":"2003","journal-title":"Nature"},{"key":"2023013112015165700_B19","doi-asserted-by":"crossref","first-page":"1919","DOI":"10.1101\/gr.7090407","article-title":"Reliable prediction of regulator targets using 12 Drosophila genomes","volume":"17","author":"Kheradpour","year":"2007","journal-title":"Genome Res."},{"key":"2023013112015165700_B20","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1016\/j.cell.2007.02.005","article-title":"Chromatin modifications and their function","volume":"128","author":"Kouzarides","year":"2007","journal-title":"Cell"},{"key":"2023013112015165700_B21","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1038\/nature01763","article-title":"Transcription regulation and animal diversity","volume":"424","author":"Levine","year":"2003","journal-title":"Nature"},{"key":"2023013112015165700_B22","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1101\/gr.5655606","article-title":"Whole-genome comparison of Leu3 binding in vitro and in vivo reveals the importance of nucleosome occupancy in target site selection","volume":"16","author":"Liu","year":"2006","journal-title":"Genome Res."},{"key":"2023013112015165700_B23","doi-asserted-by":"crossref","first-page":"R98","DOI":"10.1186\/gb-2004-5-12-r98","article-title":"MONKEY: identifying conserved transcription-factor binding sites in multiple alignments using a binding site-specific evolutionary model","volume":"5","author":"Moses","year":"2004","journal-title":"Genome Biol."},{"key":"2023013112015165700_B24","doi-asserted-by":"crossref","first-page":"e130","DOI":"10.1371\/journal.pcbi.0020130","article-title":"Large-scale turnover of functional transcription factor binding sites in drosophila","volume":"2","author":"Moses","year":"2006","journal-title":"PLoS Comput. Biol."},{"key":"2023013112015165700_B25","doi-asserted-by":"crossref","first-page":"e215","DOI":"10.1371\/journal.pcbi.0030215","article-title":"A nucleosome-guided map of transcription factor binding sites in yeast","volume":"3","author":"Narlikar","year":"2007","journal-title":"PLos Comput. Biol."},{"key":"2023013112015165700_B26","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/0076-6879(90)83014-Z","article-title":"Searching for patterns in protein and nucleic acid sequences","volume":"183","author":"Staden","year":"1990","journal-title":"Methods Enzymol."},{"key":"2023013112015165700_B27","author":"Storey","year":"2002","journal-title":"A direct approach to false discovery rates."},{"key":"2023013112015165700_B28","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1093\/bioinformatics\/16.1.16","article-title":"DNA binding sites: representation and discovery","volume":"16","author":"Stormo","year":"2000","journal-title":"Bioinformatics"},{"key":"2023013112015165700_B29","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1126\/science.3287615","article-title":"Measuring the accuracy of diagnostic systems","volume":"240","author":"Swets","year":"1988","journal-title":"Science"},{"key":"2023013112015165700_B30","doi-asserted-by":"crossref","first-page":"e38","DOI":"10.1371\/journal.pbio.0060038","article-title":"The evolution of combinatorial gene regulation in fungi","volume":"6","author":"Tuch","year":"2008","journal-title":"PLoS Biol."},{"key":"2023013112015165700_B31","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1038\/nrg1315","article-title":"Applied bioinformatics for the identification of regulatory elements","volume":"5","author":"Wasserman","year":"2004","journal-title":"Nat. Rev. Genet."},{"key":"2023013112015165700_B32","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1093\/nar\/gkn866","article-title":"High-throughput chromatin information enables accurate tissue-specific prediction of transcription factor binding sites","volume":"37","author":"Whitington","year":"2008","journal-title":"Nucleic Acids Res."},{"key":"2023013112015165700_B33","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1093\/bioinformatics\/15.7.607","article-title":"SCPD: a promoter database of the yeast Saccharomyces cerevisiae","volume":"15","author":"Zhu","year":"1999","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/12\/i339\/48993494\/bioinformatics_25_12_i339.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/12\/i339\/48993494\/bioinformatics_25_12_i339.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T21:09:47Z","timestamp":1675199387000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/25\/12\/i339\/188769"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,5,27]]},"references-count":33,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2009,6,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btp201","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2009,6,15]]},"published":{"date-parts":[[2009,5,27]]}}}