{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T09:07:51Z","timestamp":1772096871492,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>The ever-increasing number of sequenced and annotated genomes has made management of their annotations a significant undertaking, especially for large eukaryotic genomes containing many thousands of genes. Typically, changes in gene and transcript numbers are used to summarize changes from release to release, but these measures say nothing about changes to individual annotations, nor do they provide any means to identify annotations in need of manual review.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>In response, we have developed a suite of quantitative measures to better characterize changes to a genome's annotations between releases, and to prioritize problematic annotations for manual review. We have applied these measures to the annotations of five eukaryotic genomes over multiple releases \u2013 <jats:italic>H. sapiens<\/jats:italic>, <jats:italic>M. musculus<\/jats:italic>, <jats:italic>D. melanogaster<\/jats:italic>, <jats:italic>A. gambiae<\/jats:italic>, and <jats:italic>C. elegans<\/jats:italic>.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Our results provide the first detailed, historical overview of how these genomes' annotations have changed over the years, and demonstrate the usefulness of these measures for genome annotation management.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-10-67","type":"journal-article","created":{"date-parts":[[2009,2,24]],"date-time":"2009-02-24T07:24:09Z","timestamp":1235460249000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":141,"title":["Quantitative measures for the management and comparison of annotated genomes"],"prefix":"10.1186","volume":"10","author":[{"given":"Karen","family":"Eilbeck","sequence":"first","affiliation":[]},{"given":"Barry","family":"Moore","sequence":"additional","affiliation":[]},{"given":"Carson","family":"Holt","sequence":"additional","affiliation":[]},{"given":"Mark","family":"Yandell","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2009,2,23]]},"reference":[{"key":"2797_CR1","doi-asserted-by":"crossref","unstructured":"Liolios K, Tavernarakis N, Hugenholtz P, Kyrpides NC: The Genomes On Line Database (GOLD) v.2: a monitor of genome projects worldwide. Nucleic acids research 2006, (34 Database):D332\u2013334. 10.1093\/nar\/gkj145","DOI":"10.1093\/nar\/gkj145"},{"issue":"5","key":"2797_CR2","doi-asserted-by":"publisher","first-page":"R44","DOI":"10.1186\/gb-2005-6-5-r44","volume":"6","author":"K Eilbeck","year":"2005","unstructured":"Eilbeck K, Lewis SE, Mungall CJ, Yandell M, Stein L, Durbin R, Ashburner M: The Sequence Ontology: a tool for the unification of genome annotations. Genome biology 2005, 6(5):R44. 10.1186\/gb-2005-6-5-r44","journal-title":"Genome biology"},{"key":"2797_CR3","unstructured":"Generic Model Organism Database[http:\/\/www.gmod.org]"},{"issue":"13","key":"2797_CR4","doi-asserted-by":"publisher","first-page":"i337","DOI":"10.1093\/bioinformatics\/btm189","volume":"23","author":"CJ Mungall","year":"2007","unstructured":"Mungall CJ, Emmert DB: A Chado case study: an ontology-based modular schema for representing genome-associated biological information. Bioinformatics (Oxford, England) 2007, 23(13):i337\u2013346. 10.1093\/bioinformatics\/btm189","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2797_CR5","unstructured":"Generic Feature Format 3[http:\/\/www.sequenceontology.org\/gff3.shtml]"},{"key":"2797_CR6","doi-asserted-by":"crossref","unstructured":"Robb SM, Ross E, Alvarado AS: SmedGD: the Schmidtea mediterranea genome database. Nucleic Acids Res (36 Database):D599\u2013606.","DOI":"10.1093\/nar\/gkm684"},{"issue":"12","key":"2797_CR7","doi-asserted-by":"publisher","first-page":"RESEARCH0083","DOI":"10.1186\/gb-2002-3-12-research0083","volume":"3","author":"S Misra","year":"2002","unstructured":"Misra S, Crosby MA, Mungall CJ, Matthews BB, Campbell KS, Hradecky P, Huang Y, Kaminker JS, Millburn GH, Prochnik SE, et al.: Annotation of the Drosophila melanogaster euchromatic genome: a systematic review. Genome biology 2002, 3(12):RESEARCH0083. 10.1186\/gb-2002-3-12-research0083","journal-title":"Genome biology"},{"issue":"5461","key":"2797_CR8","doi-asserted-by":"publisher","first-page":"2204","DOI":"10.1126\/science.287.5461.2204","volume":"287","author":"GM Rubin","year":"2000","unstructured":"Rubin GM, Yandell MD, Wortman JR, Gabor Miklos GL, Nelson CR, Hariharan IK, Fortini ME, Li PW, Apweiler R, Fleischmann W, et al.: Comparative genomics of the eukaryotes. Science 2000, 287(5461):2204\u20132215. 10.1126\/science.287.5461.2204","journal-title":"Science"},{"issue":"5507","key":"2797_CR9","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1126\/science.1058040","volume":"291","author":"JC Venter","year":"2001","unstructured":"Venter JC, Adams MD, Myers EW, Li PW, Mural RJ, Sutton GG, Smith HO, Yandell M, Evans CA, Holt RA, et al.: The sequence of the human genome. Science 2001, 291(5507):1304\u20131351. 10.1126\/science.1058040","journal-title":"Science"},{"issue":"3","key":"2797_CR10","doi-asserted-by":"publisher","first-page":"e15","DOI":"10.1371\/journal.pcbi.0020015","volume":"2","author":"M Yandell","year":"2006","unstructured":"Yandell M, Mungall CJ, Smith C, Prochnik S, Kaminker J, Hartzell G, Lewis S, Rubin GM: Large-scale trends in the evolution of gene structures within 11 animal genomes. PLoS Comput Biol 2006, 2(3):e15. 10.1371\/journal.pcbi.0020015","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"2797_CR11","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1093\/nar\/gkg029","volume":"31","author":"C Lee","year":"2003","unstructured":"Lee C, Atanelov L, Modrek B, Xing Y: ASAP: the Alternative Splicing Annotation Project. Nucleic acids research 2003, 31(1):101\u2013105. 10.1093\/nar\/gkg029","journal-title":"Nucleic acids research"},{"issue":"10","key":"2797_CR12","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1093\/bioinformatics\/btl067","volume":"22","author":"H Nagasaki","year":"2006","unstructured":"Nagasaki H, Arita M, Nishizawa T, Suwa M, Gotoh O: Automated classification of alternative splicing and transcriptional initiation and construction of visual database of classified patterns. Bioinformatics (Oxford, England) 2006, 22(10):1211\u20131216. 10.1093\/bioinformatics\/btl067","journal-title":"Bioinformatics (Oxford, England)"},{"issue":"3","key":"2797_CR13","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1006\/geno.1996.0298","volume":"34","author":"M Burset","year":"1996","unstructured":"Burset M, Guigo R: Evaluation of gene structure prediction programs. Genomics 1996, 34(3):353\u2013367. 10.1006\/geno.1996.0298","journal-title":"Genomics"},{"issue":"4","key":"2797_CR14","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1101\/gr.10.4.483","volume":"10","author":"MG Reese","year":"2000","unstructured":"Reese MG, Hartzell G, Harris NL, Ohler U, Abril JF, Lewis SE: Genome annotation assessment in Drosophila melanogaster. Genome research 2000, 10(4):483\u2013501. 10.1101\/gr.10.4.483","journal-title":"Genome research"},{"issue":"8","key":"2797_CR15","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1038\/nmeth0805-575","volume":"2","author":"R Guigo","year":"2005","unstructured":"Guigo R, Reese MG: EGASP: collaboration through competition to find human genes. Nature methods 2005, 2(8):575\u2013577. 10.1038\/nmeth0805-575","journal-title":"Nature methods"},{"key":"2797_CR16","doi-asserted-by":"publisher","first-page":"S1.1","DOI":"10.1186\/gb-2006-7-s1-s1","volume":"7 Suppl 1","author":"MG Reese","year":"2006","unstructured":"Reese MG, Guigo R: EGASP: Introduction. Genome biology 2006, 7 Suppl 1: S1.1-S1.3. 10.1186\/gb-2006-7-s1-s1","journal-title":"Genome biology"},{"key":"2797_CR17","doi-asserted-by":"crossref","unstructured":"Crosby MA, Goodman JL, Strelets VB, Zhang P, Gelbart WM: FlyBase: genomes by the dozen. Nucleic acids research 2007, (35 Database):D486\u2013491. 10.1093\/nar\/gkl827","DOI":"10.1093\/nar\/gkl827"},{"key":"2797_CR18","doi-asserted-by":"crossref","unstructured":"Bieri T, Blasiar D, Ozersky P, Antoshechkin I, Bastiani C, Canaran P, Chan J, Chen N, Chen WJ, Davis P, et al.: WormBase: new content and better access. Nucleic acids research 2007, (35 Database):D506\u2013510. 10.1093\/nar\/gkl818","DOI":"10.1093\/nar\/gkl818"},{"key":"2797_CR19","doi-asserted-by":"crossref","unstructured":"Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Wheeler DL: GenBank. Nucleic acids research 2007, (35 Database):D21\u201325. 10.1093\/nar\/gkl986","DOI":"10.1093\/nar\/gkl986"},{"key":"2797_CR20","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1146\/annurev.genom.4.070802.110323","volume":"4","author":"SE Celniker","year":"2003","unstructured":"Celniker SE, Rubin GM: The Drosophila melanogaster genome. Annual review of genomics and human genetics 2003, 4: 89\u2013117. 10.1146\/annurev.genom.4.070802.110323","journal-title":"Annual review of genomics and human genetics"},{"issue":"12","key":"2797_CR21","doi-asserted-by":"publisher","first-page":"RESEARCH0079","DOI":"10.1186\/gb-2002-3-12-research0079","volume":"3","author":"SE Celniker","year":"2002","unstructured":"Celniker SE, Wheeler DA, Kronmiller B, Carlson JW, Halpern A, Patel S, Adams M, Champe M, Dugan SP, Frise E, et al.: Finishing a whole-genome shotgun: release 3 of the Drosophila melanogaster euchromatic genome sequence. Genome biology 2002, 3(12):RESEARCH0079. 10.1186\/gb-2002-3-12-research0079","journal-title":"Genome biology"},{"key":"2797_CR22","doi-asserted-by":"crossref","unstructured":"Pruitt KD, Tatusova T, Maglott DR: NCBI Reference Sequence (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic acids research 2005, (33 Database):D501\u2013504.","DOI":"10.1093\/nar\/gki025"},{"issue":"Suppl 1","key":"2797_CR23","doi-asserted-by":"publisher","first-page":"S2","DOI":"10.1186\/gb-2006-7-s1-s2","volume":"7","author":"R Guigo","year":"2006","unstructured":"Guigo R, Flicek P, Abril JF, Reymond A, Lagarde J, Denoeud F, Antonarakis S, Ashburner M, Bajic VB, Birney E, et al.: EGASP: the human ENCODE Genome Annotation Assessment Project. Genome biology 2006, 7(Suppl 1):S2. 1\u201331 1\u201331 10.1186\/gb-2006-7-s1-s2","journal-title":"Genome biology"},{"issue":"6","key":"2797_CR24","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1016\/S0092-8674(00)80878-8","volume":"101","author":"D Schmucker","year":"2000","unstructured":"Schmucker D, Clemens JC, Shu H, Worby CA, Xiao J, Muda M, Dixon JE, Zipursky SL: Drosophila Dscam is an axon guidance receptor exhibiting extraordinary molecular diversity. Cell 2000, 101(6):671\u2013684. 10.1016\/S0092-8674(00)80878-8","journal-title":"Cell"},{"issue":"4","key":"2797_CR25","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1101\/gr.4236606","volume":"16","author":"DB Malko","year":"2006","unstructured":"Malko DB, Makeev VJ, Mironov AA, Gelfand MS: Evolution of exon-intron structure and alternative splicing in fruit flies and malarial mosquito genomes. Genome research 2006, 16(4):505\u2013509. 10.1101\/gr.4236606","journal-title":"Genome research"},{"key":"2797_CR26","unstructured":"Spearman's rank correlation coefficient[http:\/\/en.wikipedia.org\/wiki\/Spearman's_rank_correlation_coefficient]"},{"key":"2797_CR27","unstructured":"National Center for Biotechnology Information[http:\/\/www.ncbi.nlm.nih.gov\/genome\/guide\/human\/release_notes.html]"},{"issue":"5","key":"2797_CR28","doi-asserted-by":"publisher","first-page":"1566","DOI":"10.1073\/pnas.0409421102","volume":"102","author":"M Yandell","year":"2005","unstructured":"Yandell M, Bailey AM, Misra S, Shu S, Wiel C, Evans-Holm M, Celniker SE, Rubin GM: A computational and experimental approach to validating annotations and gene predictions in the Drosophila melanogaster genome. Proceedings of the National Academy of Sciences of the United States of America 2005, 102(5):1566\u20131571. 10.1073\/pnas.0409421102","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"4","key":"2797_CR29","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1101\/gr.3329005","volume":"15","author":"C Wei","year":"2005","unstructured":"Wei C, Lamesch P, Arumugam M, Rosenberg J, Hu P, Vidal M, Brent MR: Closing in on the C. elegans ORFeome by cloning TWINSCAN predictions. Genome Res 2005, 15(4):577\u2013582. 10.1101\/gr.3329005","journal-title":"Genome Res"},{"issue":"10","key":"2797_CR30","doi-asserted-by":"publisher","first-page":"2544","DOI":"10.1093\/nar\/gkg355","volume":"31","author":"TA Thanaraj","year":"2003","unstructured":"Thanaraj TA, Clark F, Muilu J: Conservation of human alternative splice events in mouse. Nucleic Acids Res 2003, 31(10):2544\u20132552. 10.1093\/nar\/gkg355","journal-title":"Nucleic Acids Res"},{"issue":"11","key":"2797_CR31","doi-asserted-by":"publisher","first-page":"1313","DOI":"10.1093\/hmg\/ddg137","volume":"12","author":"RN Nurtdinov","year":"2003","unstructured":"Nurtdinov RN, Artamonova II, Mironov AA, Gelfand MS: Low conservation of alternative splicing patterns in the human and mouse genomes. Hum Mol Genet 2003, 12(11):1313\u20131320. 10.1093\/hmg\/ddg137","journal-title":"Hum Mol Genet"},{"issue":"1","key":"2797_CR32","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1038\/ng0102-13","volume":"30","author":"B Modrek","year":"2002","unstructured":"Modrek B, Lee C: A genomic view of alternative splicing. Nature genetics 2002, 30(1):13\u201319. 10.1038\/ng0102-13","journal-title":"Nature genetics"},{"issue":"5","key":"2797_CR33","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1006\/jmbi.2000.5197","volume":"314","author":"M Remm","year":"2001","unstructured":"Remm M, Storm CE, Sonnhammer EL: Automatic clustering of orthologs and in-paralogs from pairwise species comparisons. J Mol Biol 2001, 314(5):1041\u20131052. 10.1006\/jmbi.2000.5197","journal-title":"J Mol Biol"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-10-67.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T21:42:09Z","timestamp":1630446129000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-10-67"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2,23]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["2797"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-10-67","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,2,23]]},"assertion":[{"value":"20 October 2008","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2009","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2009","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"67"}}