{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T23:49:26Z","timestamp":1773013766146,"version":"3.50.1"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["CR30I1 162758"],"award-info":[{"award-number":["CR30I1 162758"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013348","name":"Innosuisse - Schweizerische Agentur f\u00fcr Innovationsf\u00f6rderung","doi-asserted-by":"publisher","award":["25587.2 PFES-ES"],"award-info":[{"award-number":["25587.2 PFES-ES"]}],"id":[{"id":"10.13039\/501100013348","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Named Entity Recognition (NER) and Normalisation (NEN) are core components of any text-mining system for biomedical texts. In a traditional concept-recognition pipeline, these tasks are combined in a serial way, which is inherently prone to error propagation from NER to NEN. We propose a parallel architecture, where both NER and NEN are modeled as a sequence-labeling task, operating directly on the source text. We examine different harmonisation strategies for merging the predictions of the two classifiers into a single output sequence.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We test our approach on the recent Version\u00a04 of the CRAFT corpus. In all 20 annotation sets of the concept-annotation task, our system outperforms the pipeline system reported as a baseline in the CRAFT shared task, a competition of the BioNLP Open Shared Tasks 2019. We further refine the systems from the shared task by optimising the harmonisation strategy separately for each annotation set.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Our analysis shows that the strengths of the two classifiers can be combined in a fruitful way. However, prediction harmonisation requires individual calibration on a development set for each annotation set. This allows achieving a good trade-off between established knowledge (training set) and novel information (unseen concepts).<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-021-04511-y","type":"journal-article","created":{"date-parts":[[2022,3,25]],"date-time":"2022-03-25T11:36:16Z","timestamp":1648208176000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Parallel sequence tagging for concept recognition"],"prefix":"10.1186","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1841-8731","authenticated-orcid":false,"given":"Lenz","family":"Furrer","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joseph","family":"Cornelius","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5718-5462","authenticated-orcid":false,"given":"Fabio","family":"Rinaldi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,3,24]]},"reference":[{"issue":"1","key":"4511_CR1","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1186\/1471-2105-14-54","volume":"14","author":"D Campos","year":"2013","unstructured":"Campos D, Matos S, Oliveira JL. Gimli: open source and high-performance biomedical name recognition. BMC Bioinformatics. 2013;14(1):54. https:\/\/doi.org\/10.1186\/1471-2105-14-54.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btw503","author":"D Xu","year":"2016","unstructured":"Xu D, Zhang M, Xie Y, Wang F, Chen M, Zhu KQ, Wei J. DTMiner: identification of potential disease targets through biomedical literature mining. Bioinformatics. 2016. https:\/\/doi.org\/10.1093\/bioinformatics\/btw503.","journal-title":"Bioinformatics"},{"issue":"1","key":"4511_CR3","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1093\/bioinformatics\/btz528","volume":"36","author":"L Weber","year":"2019","unstructured":"Weber L, M\u00fcnchmeyer J, Rockt\u00e4schel T, Habibi M, Leser U. HUNER: improving biomedical NER with pretraining. Bioinformatics. 2019;36(1):295\u2013302. https:\/\/doi.org\/10.1093\/bioinformatics\/btz528.","journal-title":"Bioinformatics"},{"issue":"1","key":"4511_CR4","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1093\/bioinformatics\/btz504","volume":"36","author":"JM Giorgi","year":"2019","unstructured":"Giorgi JM, Bader GD. Towards reliable named entity recognition in the biomedical domain. Bioinformatics. 2019;36(1):280\u20136. https:\/\/doi.org\/10.1093\/bioinformatics\/btz504.","journal-title":"Bioinformatics"},{"key":"4511_CR5","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/s12859-020-3393-1","volume":"21","author":"SK Hong","year":"2020","unstructured":"Hong SK, Lee J-G. DTranNER: biomedical named entity recognition with deep learning-based label-label transition model. BMC Bioinformatics. 2020;21:53. https:\/\/doi.org\/10.1186\/s12859-020-3393-1.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR6","doi-asserted-by":"publisher","unstructured":"Beltagy I, Lo K, Cohan A. SciBERT: a pretrained language model for scientific text. In Proceedings of EMNLP-IJCNLP, 2019; p. 3615\u201320. https:\/\/doi.org\/10.18653\/v1\/D19-1371.","DOI":"10.18653\/v1\/D19-1371"},{"key":"4511_CR7","doi-asserted-by":"publisher","first-page":"73729","DOI":"10.1109\/ACCESS.2019.2920708","volume":"7","author":"D Kim","year":"2019","unstructured":"Kim D, Lee J, So CH, Jeon H, Jeong M, Choi Y, Yoon W, Sung M, Kang J. A neural named entity recognition and multi-type normalization tool for biomedical text mining. IEEE Access. 2019;7:73729\u201340. https:\/\/doi.org\/10.1109\/ACCESS.2019.2920708.","journal-title":"IEEE Access"},{"key":"4511_CR8","doi-asserted-by":"publisher","unstructured":"Yu X, Hu W, Lu S, Sun X, Yuan Z. BioBERT based named entity recognition in electronic medical record. In: Proceedings of the 10th international conference on information technology in medicine and education (ITME), 2019; p. 49\u201352. https:\/\/doi.org\/10.1109\/ITME.2019.00022.","DOI":"10.1109\/ITME.2019.00022"},{"key":"4511_CR9","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1186\/1471-2105-14-281","volume":"14","author":"D Campos","year":"2013","unstructured":"Campos D, Matos S, Oliveira JL. A modular framework for biomedical concept recognition. BMC Bioinformatics. 2013;14:281. https:\/\/doi.org\/10.1186\/1471-2105-14-281.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR10","doi-asserted-by":"publisher","unstructured":"D\u2019Souza J, Ng V. Sieve-based entity linking for the biomedical domain. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (Volume 2: Short Papers), 2015; p. 297\u2013302 . https:\/\/doi.org\/10.3115\/v1\/P15-2049.","DOI":"10.3115\/v1\/P15-2049"},{"issue":"22","key":"4511_CR11","doi-asserted-by":"publisher","first-page":"2909","DOI":"10.1093\/bioinformatics\/btt474","volume":"29","author":"R Leaman","year":"2013","unstructured":"Leaman R, Islamaj Do\u011fan R, Lu Z. DNorm: disease name normalization with pairwise learning to rank. Bioinformatics. 2013;29(22):2909\u201317. https:\/\/doi.org\/10.1093\/bioinformatics\/btt474.","journal-title":"Bioinformatics"},{"issue":"1","key":"4511_CR12","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1186\/s12859-019-2678-8","volume":"20","author":"\u0130 Karadeniz","year":"2019","unstructured":"Karadeniz \u0130, \u00d6zg\u00fcr A. Linking entities through an ontology using word embeddings and syntactic re-ranking. BMC Bioinformatics. 2019;20(1):156. https:\/\/doi.org\/10.1186\/s12859-019-2678-8.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR13","doi-asserted-by":"publisher","unstructured":"Hailu ND, Bada M, Hadgu AT, Hunter LE. Biomedical concept recognition using deep neural sequence models. bioRxiv 2019. https:\/\/doi.org\/10.1101\/530337.","DOI":"10.1101\/530337"},{"issue":"1","key":"4511_CR14","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1186\/s13321-019-0344-9","volume":"11","author":"S Pletscher-Frankild","year":"2019","unstructured":"Pletscher-Frankild S, Jensen LJ. Design, implementation, and operation of a rapid, robust named entity recognition web service. J Cheminformatics. 2019;11(1):19. https:\/\/doi.org\/10.1186\/s13321-019-0344-9.","journal-title":"J. Cheminformatics"},{"issue":"1","key":"4511_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-015-0871-y","volume":"17","author":"E Tseytlin","year":"2016","unstructured":"Tseytlin E, Mitchell K, Legowski E, Corrigan J, Chavan G, Jacobson RS. NOBLE\u2014flexible concept recognition for large-scale biomedical natural language processing. BMC Bioinformatics. 2016;17(1):1\u201315. https:\/\/doi.org\/10.1186\/s12859-015-0871-y.","journal-title":"BMC Bioinformatics"},{"issue":"1","key":"4511_CR16","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1186\/s13321-018-0326-3","volume":"11","author":"L Furrer","year":"2019","unstructured":"Furrer L, Jancso A, Colic N, Rinaldi F. OGER++: hybrid multi-type entity recognition. J Cheminformatics. 2019;11(1):7. https:\/\/doi.org\/10.1186\/s13321-018-0326-3.","journal-title":"J Cheminformatics"},{"key":"4511_CR17","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.jbi.2017.05.016","volume":"71","author":"J Cuzzola","year":"2017","unstructured":"Cuzzola J, Jovanovi\u0107 J, Bagheri E. RysannMD: a biomedical semantic annotator balancing speed and accuracy. J Biomed Inform. 2017;71:91\u2013109. https:\/\/doi.org\/10.1016\/j.jbi.2017.05.016.","journal-title":"J Biomed Inform"},{"issue":"18","key":"4511_CR18","doi-asserted-by":"publisher","first-page":"2839","DOI":"10.1093\/bioinformatics\/btw343","volume":"32","author":"R Leaman","year":"2016","unstructured":"Leaman R, Lu Z. TaggerOne: joint named entity recognition and normalization with semi-Markov Models. Bioinformatics. 2016;32(18):2839. https:\/\/doi.org\/10.1093\/bioinformatics\/btw343.","journal-title":"Bioinformatics"},{"key":"4511_CR19","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1007\/978-3-319-59888-8_15","volume-title":"Joint entity recognition and linking in technical domains using undirected probabilistic graphical models","author":"H ter Horst","year":"2017","unstructured":"ter Horst H, Hartung M, Cimiano P. Joint entity recognition and linking in technical domains using undirected probabilistic graphical models, vol. 10318. Cham: Springer; 2017. p. 166\u201380. https:\/\/doi.org\/10.1007\/978-3-319-59888-8_15."},{"issue":"15","key":"4511_CR20","doi-asserted-by":"publisher","first-page":"2363","DOI":"10.1093\/bioinformatics\/btx172","volume":"33","author":"Y Lou","year":"2017","unstructured":"Lou Y, Zhang Y, Qian T, Li F, Xiong S, Ji D. A transition-based joint model for disease named entity recognition and normalization. Bioinformatics. 2017;33(15):2363\u201371. https:\/\/doi.org\/10.1093\/bioinformatics\/btx172.","journal-title":"Bioinformatics"},{"key":"4511_CR21","doi-asserted-by":"publisher","unstructured":"Zhao S, Liu T, Zhao S, Wang F: A neural multi-task learning framework to jointly model medical named entity recognition and normalization. In: Proceedings of the thirty-third AAAI conference on artificial intelligence (AAAI-19), 2019; p. 817\u201324. https:\/\/doi.org\/10.1609\/aaai.v33i01.3301817.","DOI":"10.1609\/aaai.v33i01.3301817"},{"issue":"1","key":"4511_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-13-161","volume":"13","author":"M Bada","year":"2012","unstructured":"Bada M, Eckert M, Evans D, Garcia K, Shipley K, Sitnikov D, Baumgartner WA, Cohen KB, Verspoor K, Blake JA, Hunter LE. Concept annotation in the CRAFT corpus. BMC Bioinformatics. 2012;13(1):1\u201320. https:\/\/doi.org\/10.1186\/1471-2105-13-161.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR23","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1007\/978-94-024-0881-2_53","volume-title":"The Colorado Richly Annotated Full Text (CRAFT) Corpus: Multi-Model Annotation in the Biomedical Domain","author":"KB Cohen","year":"2017","unstructured":"Cohen KB, Verspoor K, Fort K, Funk C, Bada M, Palmer M, Hunter LE. The Colorado Richly Annotated Full Text (CRAFT) Corpus: Multi-Model Annotation in the Biomedical Domain. Dordrecht: Springer; 2017. p. 1379\u201394. https:\/\/doi.org\/10.1007\/978-94-024-0881-2_53."},{"issue":"suppl-1","key":"4511_CR24","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1093\/nar\/gkm791","volume":"36","author":"K Degtyarenko","year":"2008","unstructured":"Degtyarenko K, de Matos P, Ennis M, Hastings J, Zbinden M, McNaught A, Alc\u00e1ntara R, Darsow M, Guedj M, Ashburner M. ChEBI: a database and ontology for chemical entities of biological interest. Nucleic Acids Res. 2008;36(suppl-1):344\u201350. https:\/\/doi.org\/10.1093\/nar\/gkm791.","journal-title":"Nucleic Acids Res"},{"issue":"2","key":"4511_CR25","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/gb-2005-6-2-r21","volume":"6","author":"J Bard","year":"2005","unstructured":"Bard J, Rhee SY, Ashburner M. An ontology for cell types. Genome Biol. 2005;6(2):21. https:\/\/doi.org\/10.1186\/gb-2005-6-2-r21.","journal-title":"Genome Biol"},{"issue":"1","key":"4511_CR26","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/75556","volume":"25","author":"M Ashburner","year":"2000","unstructured":"Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G. Gene ontology: tool for the unification of biology. Nat Genet. 2000;25(1):25\u20139. https:\/\/doi.org\/10.1038\/75556.","journal-title":"Nat Genet"},{"key":"4511_CR27","unstructured":"Molecular Process Ontology. Processes at the molecular level. http:\/\/obofoundry.org\/ontology\/mop.html. Accessed 13 Sep 2021."},{"issue":"D1","key":"4511_CR28","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1093\/nar\/gkr1178","volume":"40","author":"S Federhen","year":"2012","unstructured":"Federhen S. The NCBI Taxonomy database. Nucleic Acids Res. 2012;40(D1):136\u201343. https:\/\/doi.org\/10.1093\/nar\/gkr1178.","journal-title":"Nucleic Acids Res"},{"issue":"suppl-1","key":"4511_CR29","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1093\/nar\/gkq907","volume":"39","author":"DA Natale","year":"2011","unstructured":"Natale DA, Arighi CN, Barker WC, Blake JA, Bult CJ, Caudy M, Drabkin HJ, D\u2019Eustachio P, Evsikov AV, Huang H, Nchoutmboube J, Roberts NV, Smith B, Zhang J, Wu CH. The Protein Ontology: a structured representation of protein forms and complexes. Nucleic Acids Res. 2011;39(suppl-1):539\u201345. https:\/\/doi.org\/10.1093\/nar\/gkq907.","journal-title":"Nucleic Acids Res"},{"issue":"5","key":"4511_CR30","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1186\/gb-2005-6-5-r44","volume":"6","author":"K Eilbeck","year":"2005","unstructured":"Eilbeck K, Lewis SE, Mungall CJ, Yandell M, Stein L, Durbin R, Ashburner M. The sequence ontology: a tool for the unification of genome annotations. Genome Biol. 2005;6(5):44. https:\/\/doi.org\/10.1186\/gb-2005-6-5-r44.","journal-title":"Genome Biol"},{"issue":"1","key":"4511_CR31","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/gb-2012-13-1-r5","volume":"13","author":"CJ Mungall","year":"2012","unstructured":"Mungall CJ, Torniai C, Gkoutos GV, Lewis SE, Haendel MA. Uberon, an integrative multi-species anatomy ontology. Genome Biol. 2012;13(1):5. https:\/\/doi.org\/10.1186\/gb-2012-13-1-r5.","journal-title":"Genome Biol"},{"key":"4511_CR32","doi-asserted-by":"publisher","unstructured":"Baumgartner W, Bada M, Pyysalo S, Ciosici MR, Hailu N, Pielke-Lombardo H, Regan M, Hunter L: CRAFT shared tasks 2019 overview\u2014integrated structure, semantics, and coreference. In: Proceedings of the 5th workshop on BioNLP open shared tasks, 2019; p. 174\u201384. https:\/\/doi.org\/10.18653\/v1\/D19-5725.","DOI":"10.18653\/v1\/D19-5725"},{"issue":"1","key":"4511_CR33","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1186\/1471-2105-13-207","volume":"13","author":"K Verspoor","year":"2012","unstructured":"Verspoor K, Cohen KB, Lanfranchi A, Warner C, Johnson HL, Roeder C, Choi JD, Funk C, Malenkiy Y, Eckert M, Xue N, Baumgartner WA, Bada M, Palmer M, Hunter LE. A corpus of full-text journal articles is a robust evaluation tool for revealing differences in performance of biomedical natural language processing tools. BMC Bioinformatics. 2012;13(1):207. https:\/\/doi.org\/10.1186\/1471-2105-13-207.","journal-title":"BMC Bioinformatics"},{"issue":"1","key":"4511_CR34","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1186\/s12859-017-1776-8","volume":"18","author":"G Crichton","year":"2017","unstructured":"Crichton G, Pyysalo S, Chiu B, Korhonen A. A neural network multi-task learning approach to biomedical named entity recognition. BMC Bioinformatics. 2017;18(1):368. https:\/\/doi.org\/10.1186\/s12859-017-1776-8.","journal-title":"BMC Bioinformatics"},{"issue":"3","key":"4511_CR35","doi-asserted-by":"publisher","first-page":"0119091","DOI":"10.1371\/journal.pone.0119091","volume":"10","author":"T Groza","year":"2015","unstructured":"Groza T, Verspoor K. Assessing the impact of case sensitivity and term information gain on biomedical concept recognition. PLoS ONE. 2015;10(3):0119091. https:\/\/doi.org\/10.1371\/journal.pone.0119091.","journal-title":"PLoS ONE"},{"key":"4511_CR36","unstructured":"Hailu ND. Investigation of traditional and deep neural sequence models for biomedical concept recognition. PhD thesis, University of Colorado at Denver, Anschutz Medical Campus (2019)."},{"issue":"1","key":"4511_CR37","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1186\/s13326-017-0157-6","volume":"8","author":"M Basaldella","year":"2017","unstructured":"Basaldella M, Furrer L, Tasso C, Rinaldi F. Entity recognition in the biomedical domain using a hybrid approach. J Biomed Semant. 2017;8(1):51. https:\/\/doi.org\/10.1186\/s13326-017-0157-6.","journal-title":"J Biomed Semant"},{"key":"4511_CR38","doi-asserted-by":"publisher","unstructured":"Yang C-J, Chiang J-H. Gene ontology concept recognition using named concept: understanding the various presentations of the gene functions in biomedical literature. Database 2018; https:\/\/doi.org\/10.1093\/database\/bay115.","DOI":"10.1093\/database\/bay115"},{"key":"4511_CR39","unstructured":"standoff2conll. Conversion from brat-flavored standoff to CoNLL format. https:\/\/github.com\/spyysalo\/standoff2conll. Accessed 3 July 2020."},{"key":"4511_CR40","unstructured":"standoff2conll. Forked from spyysalo\/standoff2conll. https:\/\/github.com\/lfurrer\/standoff2conll. Accessed 3 July 2020."},{"key":"4511_CR41","unstructured":"CRAFT shared task evaluation. Code and scripts used for evaluation of the CRAFT Shared Tasks 2019. https:\/\/github.com\/UCDenver-ccp\/craft-shared-tasks. Accessed 3 July 2020."},{"key":"4511_CR42","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682","author":"J Lee","year":"2019","unstructured":"Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, Kang J. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2019. https:\/\/doi.org\/10.1093\/bioinformatics\/btz682.","journal-title":"Bioinformatics"},{"key":"4511_CR43","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT 2019, 2019; p. 4171\u201386 . https:\/\/doi.org\/10.18653\/v1\/N19-1423.","DOI":"10.18653\/v1\/N19-1423"},{"key":"4511_CR44","unstructured":"Furrer L, Rinaldi F. OGER: OntoGene\u2019s entity recogniser in the BeCalm TIPS task. In: Proceedings of the BioCreative V.5 Challenge Evaluation Workshop, 2017; p. 175\u2013182"},{"issue":"1","key":"4511_CR45","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1186\/1471-2105-9-402","volume":"9","author":"S Sohn","year":"2008","unstructured":"Sohn S, Comeau DC, Kim W, Wilbur WJ. Abbreviation definition identification based on automatic precision estimates. BMC Bioinformatics. 2008;9(1):402. https:\/\/doi.org\/10.1186\/1471-2105-9-402.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR46","doi-asserted-by":"publisher","unstructured":"Furrer L, Cornelius J, Rinaldi F. UZH@CRAFT-ST: a sequence-labeling approach to concept recognition. In: Proceedings of the 5th workshop on BioNLP open shared tasks, 2019; p. 185\u2013195. https:\/\/doi.org\/10.18653\/v1\/D19-5726.","DOI":"10.18653\/v1\/D19-5726"},{"key":"4511_CR47","unstructured":"Makhoul J, Kubala F, Schwartz R, Weischedel R. Performance measures for information extraction. In: Proceedings of DARPA broadcast news workshop, 1999; p. 249\u201352"},{"key":"4511_CR48","unstructured":"Bossy R, Golik W, Ratkovic Z, Bessi\u00e8res P, N\u00e9dellec C. BioNLP shared task 2013\u2014an overview of the bacteria biotope task. In: Proceedings of the BioNLP shared task 2013 workshop, 2013; p. 161\u20139."},{"issue":"10","key":"4511_CR49","doi-asserted-by":"publisher","first-page":"1274","DOI":"10.1093\/bioinformatics\/btm087","volume":"23","author":"JZ Wang","year":"2007","unstructured":"Wang JZ, Du Z, Payattakool R, Yu PS, Chen C-F. A new method to measure the semantic similarity of GO terms. Bioinformatics. 2007;23(10):1274\u201381. https:\/\/doi.org\/10.1093\/bioinformatics\/btm087.","journal-title":"Bioinformatics"},{"issue":"1","key":"4511_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-15-59","volume":"15","author":"C Funk","year":"2014","unstructured":"Funk C, Baumgartner WA, Garcia B, Roeder C, Bada M, Cohen KB, Hunter LE, Verspoor K. Large-scale biomedical concept recognition: an evaluation of current automatic annotators and their parameters. BMC Bioinformatics. 2014;15(1):1\u201329. https:\/\/doi.org\/10.1186\/1471-2105-15-59.","journal-title":"BMC Bioinformatics"},{"key":"4511_CR51","doi-asserted-by":"publisher","unstructured":"Boguslav M, Cohen KB, Baumgartner WA Jr, Hunter LE. Improving precision in concept normalization. In: Pacific symposium on biocomputing 2018, 2018; p. 566\u2013577 . https:\/\/doi.org\/10.1142\/9789813235533_0052.","DOI":"10.1142\/9789813235533_0052"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04511-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-021-04511-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04511-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,8]],"date-time":"2023-12-08T18:04:12Z","timestamp":1702058652000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-021-04511-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,24]]},"references-count":51,"journal-issue":{"issue":"S1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["4511"],"URL":"https:\/\/doi.org\/10.1186\/s12859-021-04511-y","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,24]]},"assertion":[{"value":"29 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"623"}}