{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T02:15:52Z","timestamp":1781144152775,"version":"3.54.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2013,2,2]],"date-time":"2013-02-02T00:00:00Z","timestamp":1359763200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"},{"start":{"date-parts":[[2013,2,2]],"date-time":"2013-02-02T00:00:00Z","timestamp":1359763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This paper presents GATE Teamware\u2014an open-source, web-based, collaborative text annotation framework. It enables users to carry out complex corpus annotation projects, involving distributed annotator teams. Different user roles are provided (annotator, manager, administrator) with customisable user interface functionalities, in order to support the complex workflows and user interactions that occur in corpus annotation projects. Documents may be pre-processed automatically, so that human annotators can begin with text that has already been pre-annotated and thus making them more efficient. The user interface is simple to learn, aimed at non-experts, and runs in an ordinary web browser, without need of additional software installation. GATE Teamware has been evaluated through the creation of several gold standard corpora and internal projects, as well as through external evaluation in commercial and EU text annotation projects. It is available as on-demand service on GateCloud.net, as well as open-source for self-installation.<\/jats:p>","DOI":"10.1007\/s10579-013-9215-6","type":"journal-article","created":{"date-parts":[[2013,2,1]],"date-time":"2013-02-01T16:31:47Z","timestamp":1359736307000},"page":"1007-1029","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["GATE Teamware: a web-based, collaborative text annotation framework"],"prefix":"10.1007","volume":"47","author":[{"given":"Kalina","family":"Bontcheva","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hamish","family":"Cunningham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Roberts","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angus","family":"Roberts","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin","family":"Tablan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niraj","family":"Aswani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Genevieve","family":"Gorrell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2013,2,2]]},"reference":[{"key":"9215_CR1","unstructured":"ACE. (2004). Annotation guidelines for event detection and characterization (EDC). Available at http:\/\/www.ldc.upenn.edu\/Projects\/ACE\/."},{"key":"9215_CR2","doi-asserted-by":"crossref","unstructured":"Agatonovic, M., Aswani, N., Bontcheva, K., Cunningham, H., Heitz, T., Li, Y., et al. (2008). Large-scale, parallel automatic patent annotation. In Proceedings of the 1st ACM workshop on patent information retrieval (PaIR \u201908), pp. 1\u20138.","DOI":"10.1145\/1458572.1458574"},{"key":"9215_CR3","unstructured":"Berck, P., & Russel, A. (2006). Annex a web-based framework for exploiting annotated media resources. In Proceedings of the fifth international conference on language resources and evaluation."},{"key":"9215_CR4","unstructured":"Brugman, H., & Russel, A. (2004). Annotating multi-media\/multi-modal resources with elan. In Proceedings of the fourth international conference on language resources and evaluation."},{"key":"9215_CR5","unstructured":"Brugman, H., Crasborn, O., & Russel, A. (2004). Collaborative annotation of sign language data with peer-to-peer technology. In Proceedings of LREC."},{"issue":"4","key":"9215_CR6","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/s10579-006-9001-9","volume":"39","author":"J. Carletta","year":"2005","unstructured":"Carletta, J., Evert, S., Heid, U., & Kilgour, J. (2005). The nite xml toolkit: Data model and query language. Language Resources and Evaluation, 39(4), 313\u2013334.","journal-title":"Language Resources and Evaluation"},{"key":"9215_CR7","unstructured":"Cunningham, H., Maynard, D., Bontcheva, K., & Tablan, V. (2002). Gate: An architecture for development of robust hlt applications. In Proceedings of the 40th annual meeting on association for computational linguistics, pp. 168\u2013175."},{"key":"9215_CR8","unstructured":"Cunningham, H., Fuhr, N., & Stein, B. (Eds). (2011a). Challenges in document mining\u2014report from Dagstuhl seminar 11171. Dagstuhl reports. Dagstuhl, Germany: Leibniz-Zerntrum f\u00fcr Informatik."},{"key":"9215_CR9","unstructured":"Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V., Aswani, N., Roberts, I., et\u00a0al. (2011b). Text processing with GATE (version 6). The University of Sheffield. http:\/\/tinyurl.com\/gatebook."},{"key":"9215_CR10","doi-asserted-by":"crossref","unstructured":"Day, D., Aberdeen, J., Hirschman, L., Kozierok, R., Robinson, P., & Vilain, M. (1997). Mixed-initiative development of language processing systems. In Proceedings of the 5th conference on applied natural language processing (ANLP-97).","DOI":"10.3115\/974557.974608"},{"key":"9215_CR11","unstructured":"Day, D., McHenry, C., Kozierok, R., & Riek, L. (2004) Callisto: A configurable annotation workbench. In International conference on language resources and evaluation."},{"issue":"3\u20134","key":"9215_CR12","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1017\/S1351324904003523","volume":"10","author":"D. Ferrucci","year":"2004","unstructured":"Ferrucci, D., & Lally, A. (2004). UIMA: An architectural approach to unstructured information processing in the corporate research environment. Natural Language Engineering, 10(3\u20134), 327\u2013348.","journal-title":"Natural Language Engineering"},{"key":"9215_CR13","unstructured":"Hovy, E. (2010). Annotation. In Tutorial Abstracts of ACL."},{"key":"9215_CR14","doi-asserted-by":"crossref","unstructured":"Hovy, E., Marcus, M. P., Palmer, M., Ramshaw, L. A., & Weischedel, R. M. (2006). Ontonotes: The 90\u00a0% solution. In Proceedings of HLT-NAACL.","DOI":"10.3115\/1614049.1614064"},{"key":"9215_CR15","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1017\/S135132490400350X","volume":"10","author":"N. Ide","year":"2004","unstructured":"Ide N., & Romary, L. (2004) Standards for language resources. Natural Language Engineering, 10, 211\u2013225.","journal-title":"Natural Language Engineering"},{"key":"9215_CR16","unstructured":"Ide, N., & Suderman, K. (2005). Integrating linguistic resources: The american national corpus model. In Proceedings of human language technology conference\/conference on empirical methods in natural language processing HLT\/EMNLP 2005, Vancouver, B.C., Canada."},{"key":"9215_CR17","unstructured":"Ide, N., Bonhomme, P., & Romary, L. (2000) XCES: An XML-based standard for Linguistic Corpora. In Proceedings of the second international conference on language resources and evaluation (LREC 2000), 30 May\u20142 Jun 2000, Athens, Greece, pp. 825\u2013830. http:\/\/www.lrec-conf.org\/proceedings\/lrec2000\/pdf\/172.pdf."},{"key":"9215_CR18","unstructured":"Kiryakov, A. (2006) OWLIM: Balancing between scalable repository and light-weight reasoner. In Proceedings of the 15th international world wide web conference (WWW2006), 23\u201326 May 2010, Edinburgh, Scotland. http:\/\/www.ontotext.com\/sites\/default\/files\/publications\/Kiryakov_OWLIM_www2006.pdf."},{"key":"9215_CR19","unstructured":"Maeda, K., & Strassel, S. (2004). Annotation tools for large-scale corpus development: Using AGTK at the linguistic data consortium. In Proceedings of 4th language resources and evaluation conference (LREC\u20192004)."},{"key":"9215_CR20","unstructured":"Maeda, K., Lee, H., Medero, S., Medero, J., Parker, R., & Strassel, S. (2008). Annotation tool development for large-scale corpus creation projects at the linguistic data consortium. In Proceedings of the sixth international language resources and evaluation (LREC\u201908)."},{"key":"9215_CR21","unstructured":"Maynard, D., Funk, A., & Peters, W. (2009). SPRAT: A tool for automatic semantic pattern-based ontology population. In International conference for digital libraries and the semantic web, Trento, Italy."},{"key":"9215_CR22","unstructured":"Meurs, M. J., Murphy, C., Naderi, N., Morgenstern, I., Cantu, C., & Semarjit, S., et\u00a0al. (2011). Towards evaluating the impact of semantic support for curating the fungus scientific literature. In The 3rd Canadian semantic web symposium (CSWS2011), Vancouver, B.C., Canada."},{"key":"9215_CR23","first-page":"197","volume-title":"Corpus technology and language pedagogy: New resources, new tools, new methods","author":"C. M\u00fcller","year":"2006","unstructured":"M\u00fcller, C., & Strube, M. (2006). Multi-level annotation of linguistic data with MMAX2. In S. Braun, K. Kohn, & J. Mukherjee (Eds.) Corpus technology and language pedagogy: New resources, new tools, new methods (pp. 197\u2013214). Germany: Peter Lang, Frankfurt a.M."},{"key":"9215_CR24","doi-asserted-by":"crossref","unstructured":"Ogren, P. (2006). Knowtator: A Protege plug-in for annotated corpus construction. In HLT-NAACL\u2014Demos.","DOI":"10.3115\/1225785.1225791"},{"key":"9215_CR25","doi-asserted-by":"crossref","unstructured":"Poesio, M., Diewald, N., St\u00fchrenberg, M., Chamberlain, J., Jettka D., Goecke, D., et\u00a0al. (2012). Markup infrastructure for the anaphoric bank: Supporting web collaboration. In A. Mehler, K. U. K\u00fchnberger, H. Lobin, H. L\u00fcngen, A. Storrer, & A. Witt (Eds.), Modeling, learning, and processing of text technological data structures, studies in computational intelligence (Vol. 370, pp. 175\u2013195). Berlin, Heidelberg: Springer.","DOI":"10.1007\/978-3-642-22613-7_10"},{"key":"9215_CR26","unstructured":"Tablan, V., Ursu, C., Bontcheva, K., Cunningham, H., Maynard, D., Hamza, O., et\u00a0al. (2002). A unicode-based environment for creation and use of language resources. In Proceedings of the 3rd language resources and evaluation conference."},{"key":"9215_CR27","doi-asserted-by":"publisher","unstructured":"Tablan, V., Roberts, I., Cunningham, H., & Bontcheva, K. (2013). GATECloud. net: a platform for large-scale, open-source text processing on the cloud. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 371(1983). doi:10.1098\/rsta.2012.0071.","DOI":"10.1098\/rsta.2012.0071"},{"issue":"2\u20133","key":"9215_CR28","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/s10579-005-7880-9","volume":"39","author":"J. Wiebe","year":"2005","unstructured":"Wiebe, J., Wilson, T., & Cardie, C. (2005). Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, 39(2\u20133), 165\u2013210.","journal-title":"Language Resources and Evaluation"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-013-9215-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-013-9215-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-013-9215-6","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-013-9215-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T21:52:53Z","timestamp":1630533173000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-013-9215-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,2,2]]},"references-count":28,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["9215"],"URL":"https:\/\/doi.org\/10.1007\/s10579-013-9215-6","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,2,2]]},"assertion":[{"value":"2 February 2013","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}