{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T20:27:55Z","timestamp":1767731275703,"version":"build-2238731810"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"S8","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2011,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>\n                      We participated, as Team 81, in the\n                      <jats:italic>Article Classification<\/jats:italic>\n                      and the\n                      <jats:italic>Interaction Method<\/jats:italic>\n                      subtasks (ACT and IMT, respectively) of the\n                      <jats:italic>Protein-Protein Interaction<\/jats:italic>\n                      task of the BioCreative III Challenge. For the ACT, we pursued an extensive testing of available Named Entity Recognition and dictionary tools, and used the most promising ones to extend our Variable Trigonometric Threshold linear classifier. Our main goal was to exploit the power of available named entity recognition and dictionary tools to aid in the classification of documents relevant to Protein-Protein Interaction (PPI). For the IMT, we focused on obtaining evidence in support of the interaction methods used, rather than on tagging the document with the method identifiers. We experimented with a primarily statistical approach, as opposed to employing a deeper natural language processing strategy. In a nutshell, we exploited classifiers, simple pattern matching for potential PPI methods within sentences, and ranking of candidate matches using statistical considerations. Finally, we also studied the benefits of integrating the method extraction approach that we have used for the IMT into the ACT pipeline.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      For the ACT, our linear article classifier leads to a ranking and classification performance significantly higher than all the reported submissions to the challenge in terms of\n                      <jats:italic>Area Under the Interpolated Precision and Recall Curve<\/jats:italic>\n                      ,\n                      <jats:italic>Mathew\u2019s Correlation Coefficient<\/jats:italic>\n                      , and\n                      <jats:italic>F-Score<\/jats:italic>\n                      . We observe that the most useful Named Entity Recognition and Dictionary tools for classification of articles relevant to protein-protein interaction are: ABNER, NLPROT, OSCAR 3 and the PSI-MI ontology. For the IMT, our results are comparable to those of other systems, which took very different approaches. While the performance is not very high, we focus on providing evidence for potential interaction detection methods. A significant majority of the evidence sentences, as evaluated by independent annotators, are relevant to PPI detection methods.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>For the ACT, we show that the use of named entity recognition tools leads to a substantial improvement in the ranking and classification of articles relevant to protein-protein interaction. Thus, we show that our substantially expanded linear classifier is a very competitive classifier in this domain. Moreover, this classifier produces interpretable surfaces that can be understood as \u201crules\u201d for human understanding of the classification. We also provide evidence supporting certain named entity recognition tools as beneficial for protein-interaction article classification, or demonstrating that some of the tools are not beneficial for the task. In terms of the IMT task, in contrast to other participants, our approach focused on identifying sentences that are likely to bear evidence for the application of a PPI detection method, rather than on classifying a document as relevant to a method. As BioCreative III did not perform an evaluation of the evidence provided by the system, we have conducted a separate assessment, where multiple independent annotators manually evaluated the evidence produced by one of our runs. Preliminary results from this experiment are reported here and suggest that the majority of the evaluators agree that our tool is indeed effective in detecting relevant evidence for PPI detection methods. Regarding the integration of both tasks, we note that the time required for running each pipeline is realistic within a curation effort, and that we can, without compromising the quality of the output, reduce the time necessary to extract entities from text for the ACT pipeline by pre-selecting candidate relevant text using the IMT pipeline.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/1471-2105-12-s8-s12","type":"journal-article","created":{"date-parts":[[2011,10,4]],"date-time":"2011-10-04T20:44:23Z","timestamp":1317761063000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A linear classifier based on entity recognition tools and a statistical approach to method extraction in the protein-protein interaction literature"],"prefix":"10.1186","volume":"12","author":[{"given":"An\u00e1lia","family":"Louren\u00e7o","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Conover","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Wong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Azadeh","family":"Nematzadeh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fengxia","family":"Pan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hagit","family":"Shatkay","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis M","family":"Rocha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,10,3]]},"reference":[{"key":"4806_CR1","volume-title":"BioCreative III, PPI Task","author":"M. Krallinger","year":"2010","unstructured":"Krallinger M., Valencia A: BioCreative III, PPI Task.2010. [http:\/\/www.biocreative.org\/tasks\/biocreative-iii\/ppi\/]"},{"key":"4806_CR2","doi-asserted-by":"publisher","first-page":"3191","DOI":"10.1093\/bioinformatics\/bti475","volume":"21","author":"B Settles","year":"2005","unstructured":"Settles B: ABNER: an open source tool for automatically tagging genes, proteins and other entity names in text. Bioinformatics 2005, 21: 3191\u20133192. 10.1093\/bioinformatics\/bti475","journal-title":"Bioinformatics"},{"key":"4806_CR3","volume-title":"Genome Biology","author":"A Abi-Haidar","year":"2008","unstructured":"Abi-Haidar A, Kaur J, Maguitman A, Radivojac P, Retchsteiner A, Verspoor K, Wang Z, Rocha LM: Uncovering protein interaction in abstracts and text using a novel linear model and word proximity networks. Genome Biology 2008."},{"key":"4806_CR4","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1109\/TCBB.2010.55","volume":"7","author":"A Kolchinsky","year":"2010","unstructured":"Kolchinsky A, Abi-Haidar A, Kaur J, Hamed AA, Rocha LM: Classification of protein-protein interaction full-text documents using text and citation network features. IEEE\/ACM Trans Comput Biol Bioinform 2010, 7: 400\u2013411.","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"4806_CR5","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1109\/TCBB.2010.61","volume":"7","author":"F Leitner","year":"2010","unstructured":"Leitner F, Mardis SA, Krallinger M, Cesareni G, Hirschman LA, Valencia A: An Overview of BioCreative II.5. IEEE\/ACM Trans Comput Biol Bioinform 2010, 7: 385\u2013399.","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"issue":"BioCreative Sup","key":"4806_CR6","first-page":"S6","volume":"12","author":"X Wang","year":"2011","unstructured":"Wang X, Rafal Rak R, Restificar A, Nobata C, Rupp C, Batista-Navarro R, Nawaz R, Ananiadou S: Detecting Experimental Techniques and Selecting Relevant Documents for Protein-Protein Interactions from Biomedical Literature. BMC Bioinformatics 2011, 12(BioCreative Supplement):S6.","journal-title":"BMC Bioinformatics"},{"issue":"BioCreative Sup","key":"4806_CR7","first-page":"S9","volume":"12","author":"F Rinaldi","year":"2011","unstructured":"Rinaldi F, Schneider G, Clematide S, Romacker M, Vachon T: Detection of Interaction Articles and Experimental Methods in Biomedical Literature. BMC Bioinformatics 2011, 12(BioCreative Supplement):S9.","journal-title":"BMC Bioinformatics"},{"issue":"BioCreative Sup","key":"4806_CR8","first-page":"S15","volume":"12","author":"M Krallinger","year":"2011","unstructured":"Krallinger M, Vasquez M, Leitner F, Salgado D, Chatraryamontri A, Winter A, Perfetto L, Briganti L, Licata L, Iannuccelli M, Castagnoli L, Cesareni G, Tyers M, Schneider G, Rinaldi F, Leaman R, Gonzalez G, Matos S, Kim S, Wilbur WJ, Rocha LM, Shatkay H, Tendulkar AV, Agarwal S, Liu F, Wang X, Rak R, Noto K, Elkan C, Lu Z, Islamaj Dogan R, Fontaine J, Andrade-Navarro MA, Valencia A: The Protein-Protein Interaction Tasks of BioCreative III: Classification\/Ranking of Articles and Linking Bio-Ontology Concepts to Full Text. BMC Bioinformatics 2011, 12(BioCreative Supplement):S15.","journal-title":"BMC Bioinformatics"},{"key":"4806_CR9","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1108\/eb046814","volume":"14","author":"MF Porter","year":"1980","unstructured":"Porter MF: An algorithm for suffix stripping. Program 1980, 14: 130\u2013137. 10.1108\/eb046814","journal-title":"Program"},{"key":"4806_CR10","doi-asserted-by":"publisher","first-page":"104","DOI":"10.3115\/1567594.1567618","volume-title":"International Joint Workshop on Natural Language Processing in Biomedicine and its Applications (NLPBA)","author":"B Settles","year":"2004","unstructured":"Settles B: Biomedical Named Entity Recognition Using Conditional Random Fields and Rich Feature Sets. International Joint Workshop on Natural Language Processing in Biomedicine and its Applications (NLPBA) 2004, 104\u2013107."},{"key":"4806_CR11","doi-asserted-by":"publisher","first-page":"W634","DOI":"10.1093\/nar\/gkh427","volume":"32","author":"S Mika","year":"2004","unstructured":"Mika S, Rost B: NLProt: extracting protein names and sequences from papers. Nucleic Acids Res 2004, 32: W634-W637. 10.1093\/nar\/gkh427","journal-title":"Nucleic Acids Res"},{"key":"4806_CR12","first-page":"45","volume-title":"the 45th Annual Meeting of the Association for Computational Linguistics","author":"C Batchelor","year":"2007","unstructured":"Batchelor C, Corbett P: Semantic enrichment of journal articles using chemical named entity recognition. In the 45th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics; 2007:45\u201348."},{"key":"4806_CR13","doi-asserted-by":"publisher","first-page":"57","DOI":"10.3115\/1572392.1572403","volume-title":"BioNLP 2007: Biological, translational, and clinical language processing","author":"P Corbett","year":"2007","unstructured":"Corbett P, Batchelor C, Teufel S: Annotation of chemical named entities. BioNLP 2007: Biological, translational, and clinical language processing 2007, 57\u201364."},{"key":"4806_CR14","doi-asserted-by":"publisher","first-page":"D511","DOI":"10.1093\/nar\/gkl972","volume":"35","author":"J Barthelmes","year":"2007","unstructured":"Barthelmes J, Ebeling C, Chang A, Schomburg I, Schomburg D: BRENDA, AMENDA and FRENDA: the enzyme information system in 2007. Nucleic Acids Res 2007, 35: D511-D514. 10.1093\/nar\/gkl972","journal-title":"Nucleic Acids Res"},{"key":"4806_CR15","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1093\/nar\/30.1.47","volume":"30","author":"I Schomburg","year":"2002","unstructured":"Schomburg I, Chang A, Schomburg D: BRENDA, enzyme data and metabolic information. Nucleic Acids Research 2002, 30: 47\u201349. 10.1093\/nar\/30.1.47","journal-title":"Nucleic Acids Research"},{"key":"4806_CR16","doi-asserted-by":"publisher","first-page":"D344","DOI":"10.1093\/nar\/gkm791","volume":"36","author":"K Degtyarenko","year":"2008","unstructured":"Degtyarenko K, De Matos P, Ennis M, Hastings J, Zbinden M, McNaught A, Alcantara R, Darsow M, Guedj M, Ashburner M: ChEBI: a database and ontology for chemical entities of biological interest. Nucleic Acids Research 2008, 36: D344-D350.","journal-title":"Nucleic Acids Research"},{"issue":"Suppl 2","key":"4806_CR17","doi-asserted-by":"publisher","first-page":"S5","DOI":"10.1186\/gb-2008-9-s2-s5","volume":"9","author":"A Chatr-aryamontri","year":"2008","unstructured":"Chatr-aryamontri A, Kerrien S, Khadake J, Orchard S, Ceol A, Licata L, Castagnoli L, Costa S, Derow C, Huntley R, Aranda B, Leroy C, Thorneycroft D, Apweiler R, Cesareni G, Hermjakob H: MINT and IntAct contribute to the Second BioCreative challenge: serving the text-mining community with high quality molecular interaction data. Genome Biol 2008, 9(Suppl 2):S5. 10.1186\/gb-2008-9-s2-s5","journal-title":"Genome Biol"},{"key":"4806_CR18","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.febslet.2004.07.055","volume":"573","author":"R Breitling","year":"2004","unstructured":"Breitling R, Armengaud P, Amtmann A, Herzyk P: Rank products: a simple, yet powerful, new method to detect differentially regulated genes in replicated microarray experiments. Febs Letters 2004, 573: 83\u201392. 10.1016\/j.febslet.2004.07.055","journal-title":"Febs Letters"},{"issue":"BioCreative Sup","key":"4806_CR19","first-page":"S16","volume":"12","author":"S Kim","year":"2011","unstructured":"Kim S, Wilbur WJ: Classifying protein-protein interaction articles using word and syntactic features. BMC Bioinformatics 2011, 12(BioCreative Supplement):S16.","journal-title":"BMC Bioinformatics"},{"key":"4806_CR20","doi-asserted-by":"publisher","first-page":"2086","DOI":"10.1093\/bioinformatics\/btn381","volume":"24","author":"H Shatkay","year":"2008","unstructured":"Shatkay H, Pan FX, Rzhetsky A, Wilbur WJ: Multi-dimensional classification of biomedical text: Toward automated, practical provision of high-utility text to diverse users. Bioinformatics 2008, 24: 2086\u20132093. 10.1093\/bioinformatics\/btn381","journal-title":"Bioinformatics"},{"key":"4806_CR21","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1186\/1471-2105-7-356","volume":"7","author":"WJ Wilbur","year":"2006","unstructured":"Wilbur WJ, Rzhetsky A, Shatkay H: New directions in biomedical text annotation: definitions, guidelines and corpus construction. BMC Bioinformatics 2006, 7: 356. 10.1186\/1471-2105-7-356","journal-title":"BMC Bioinformatics"},{"key":"4806_CR22","volume-title":"LIBSVM: A Library for Support Vector Machines","author":"C Chang","year":"2001","unstructured":"Chang C, Lin C: LIBSVM: A Library for Support Vector Machines.2001. [http:\/\/www.csie.ntu.edu.tw\/~cjlin\/libsvm]"},{"key":"4806_CR23","volume-title":"CPAN module Lingua-EN-Sentence","author":"S Yona","year":"2010","unstructured":"Yona S: CPAN module Lingua-EN-Sentence.2010. [http:\/\/search.cpan.org\/~shlomoy\/Lingua-EN-Sentence0.25\/lib\/Lingua\/EN\/Sentence.pm]"},{"key":"4806_CR24","unstructured":"HUPO Proteomics Standards Initiatives (PSI), Molecular Interaction (MI)2010. [http:\/\/psidev.sourceforge.net\/mi\/rel25\/data\/psi-mi25.obo]"},{"key":"4806_CR25","volume-title":"CPAN module ONTO-PERL","author":"E Antezana","year":"2010","unstructured":"Antezana E: CPAN module ONTO-PERL.2010. [http:\/\/search.cpan.org\/~easr\/ONTO-PERL-1.23\/]"},{"key":"4806_CR26","volume-title":"CPAN module Lingua-Stem","author":"B Franz","year":"2010","unstructured":"Franz B: CPAN module Lingua-Stem.2010. [http:\/\/search.cpan.org\/~snowhare\/Lingua-Stem-0.84\/]"},{"key":"4806_CR27","volume-title":"CPAN module Text-Ngramize","author":"J Kubina","year":"2010","unstructured":"Kubina J: CPAN module Text-Ngramize.2010. [http:\/\/search.cpan.org\/~kubina\/Text-Ngramize-1.03\/lib\/Text\/Ngramize.pm]"},{"key":"4806_CR28","volume-title":"CPAN module Text-RewriteRules","author":"A Sim\u00f5es","year":"2010","unstructured":"Sim\u00f5es A: CPAN module Text-RewriteRules.2010. [http:\/\/search.cpan.org\/~ambs\/Text-RewriteRules-0.23\/lib\/Text\/RewriteRules.pm]"},{"key":"4806_CR29","volume-title":"CPAN module Lingua::StopWords","author":"M Humphrey","year":"2010","unstructured":"Humphrey M: CPAN module Lingua::StopWords.2010. [http:\/\/search.cpan.org\/dist\/Lingua-StopWords\/]"}],"updated-by":[{"DOI":"10.1186\/1471-2105-13-180","type":"erratum","label":"Erratum","source":"publisher","updated":{"date-parts":[[2012,7,27]],"date-time":"2012-07-27T00:00:00Z","timestamp":1343347200000}}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-12-S8-S12.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T12:35:00Z","timestamp":1630499700000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-12-S8-S12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,10,3]]},"references-count":29,"journal-issue":{"issue":"S8","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["4806"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-12-s8-s12","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,10,3]]},"assertion":[{"value":"3 October 2011","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"S12"}}