{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T01:04:06Z","timestamp":1790039046252,"version":"4.0.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,6,13]],"date-time":"2019-06-13T00:00:00Z","timestamp":1560384000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,6,13]],"date-time":"2019-06-13T00:00:00Z","timestamp":1560384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000092","name":"U.S. National Library of Medicine","doi-asserted-by":"publisher","award":["T15LM007442"],"award-info":[{"award-number":["T15LM007442"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"U.S. National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM011969"],"award-info":[{"award-number":["R01LM011969"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["R01HL064541"],"award-info":[{"award-number":["R01HL064541"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>To improve the outcomes of biological pathway analysis, a better way of integrating pathway data is needed. Ontologies can be used to organize data from disparate sources, and we leverage the Pathway Ontology as a unifying ontology for organizing pathway data. We aim to associate pathway instances from different databases to the appropriate class in the Pathway Ontology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Using a supervised machine learning approach, we trained neural networks to predict mappings between Reactome pathways and Pathway Ontology (PW) classes. For 2222 Reactome classes, the neural network (NN) model generated 10,952 class recommendations. We compared against a baseline bag-of-words (BOW) model for predicting correct PW classes. A 5% subset of Reactome pathways (111 pathways) was randomly selected, and the corresponding class recommendations from both models were evaluated by two curators. The precision of the BOW model was higher (0.49 for BOW and 0.39 for NN), but the recall was lower (0.42 for BOW and 0.78 for NN). Around 78% of Reactome pathways received pertinent recommendations from the NN model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The neural predictive model produced meaningful class recommendations that assisted PW curators in selecting appropriate class mappings for Reactome pathways. Our methods can be used to reduce the manual effort associated with ontology curation, and more broadly, for augmenting the curators\u2019 ability to organize and integrate data from pathway databases using the Pathway Ontology.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13326-019-0202-8","type":"journal-article","created":{"date-parts":[[2019,6,13]],"date-time":"2019-06-13T10:47:14Z","timestamp":1560422834000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Predicting instances of pathway ontology classes for pathway integration"],"prefix":"10.1186","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8752-6635","authenticated-orcid":false,"given":"Lucy Lu","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G.","family":"Thomas Hayman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer R.","family":"Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monika","family":"Tutaj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary E.","family":"Shimoyama","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John H.","family":"Gennari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,6,13]]},"reference":[{"issue":"43","key":"202_CR1","doi-asserted-by":"publisher","first-page":"15545","DOI":"10.1073\/pnas.0506580102","volume":"102","author":"A Subramanian","year":"2005","unstructured":"Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, et al.Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. PNAS. 2005; 102(43):15545\u201350.","journal-title":"PNAS"},{"key":"202_CR2","doi-asserted-by":"crossref","unstructured":"Shojaie A, Michailidis G. Network enrichment analysis in complex experiments. Stat Appl Genet Mol Biol. 2010; 9(1).","DOI":"10.2202\/1544-6115.1483"},{"issue":"12","key":"202_CR3","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1093\/bioinformatics\/btr260","volume":"27","author":"A Liberzon","year":"2011","unstructured":"Liberzon A, Subramanian A, Pinchback R, Thorvaldsd\u00f3ttir H, Tamayo P, Mesirov JP. Molecular signatures database (MSigDB) 3.0. Bioinformatics. 2011; 27(12):1739\u201340.","journal-title":"Bioinformatics"},{"issue":"Database issue","key":"202_CR4","doi-asserted-by":"publisher","first-page":"D685","DOI":"10.1093\/nar\/gkq1039","volume":"39","author":"EG Cerami","year":"2011","unstructured":"Cerami EG, Gross BE, Demir E, Rodchenkov I, Babur O, Anwar N, et al.Pathway Commons, a web resource for biological pathway data. Nucleic Acids Res. 2011; 39(Database issue):D685\u2013690.","journal-title":"Nucleic Acids Res"},{"issue":"Database issue","key":"202_CR5","doi-asserted-by":"publisher","first-page":"D623","DOI":"10.1093\/nar\/gkn698","volume":"37","author":"A Kamburov","year":"2009","unstructured":"Kamburov A, Wierling C, Lehrach H, Herwig R. ConsensusPathDB \u2013 a database for integrating human functional interaction networks. Nucleic Acids Res. 2009; 37(Database issue):D623\u2013628.","journal-title":"Nucleic Acids Res"},{"key":"202_CR6","doi-asserted-by":"crossref","unstructured":"Belinky F, Nativ N, Stelzer G, Zimmerman S, Iny Stein T, Safran M, et al. PathCards: multi-source consolidation of human biological pathways. Database (Oxford). 2015;2015(bav006).","DOI":"10.1093\/database\/bav006"},{"issue":"8","key":"202_CR7","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1089\/omi.2012.0083","volume":"17","author":"Juan C. Vivar","year":"2013","unstructured":"Vivar JC, Pemu P, McPherson R, Ghosh S. Redundancy Control in Pathway Databases (ReCiPa): An Application for Improving Gene-Set Enrichment Analysis in Omics Studies and \u201cBig Data\u201d Biology. OMICS. 2013; 17(8):414\u201322.","journal-title":"OMICS: A Journal of Integrative Biology"},{"issue":"1","key":"202_CR8","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1186\/1471-2105-14-112","volume":"14","author":"Tomer Altman","year":"2013","unstructured":"Altman T, Travers M, Kothari A, Caspi R, Karp P. A systematic comparison of the MetaCyc and KEGG pathway databases. BMC Bioinformatics. 2013;14(112).","journal-title":"BMC Bioinformatics"},{"issue":"bau126","key":"202_CR9","first-page":"1","volume":"2015","author":"S Chowdhury","year":"2015","unstructured":"Chowdhury S, Sarkar R. Comparison of human cell signaling pathway databases \u2013 evolution, drawbacks and challenges. Database. 2015; 2015(bau126):1\u201325.","journal-title":"Database"},{"key":"202_CR10","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1186\/1752-0509-5-165","volume":"5","author":"MD Stobbe","year":"2011","unstructured":"Stobbe MD, Houten SM, Jansen GA. Kampen AHCv, Moerland PD. Critical assessment of human metabolic pathway databases: a stepping stone for future integration. BMC Syst Biol. 2011; 5:165\u201383.","journal-title":"BMC Syst Biol"},{"issue":"3","key":"202_CR11","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1093\/bib\/bbs060","volume":"15","author":"MD Stobbe","year":"2014","unstructured":"Stobbe MD, Jansen GA, Moerland PD, Kampen AHv. Knowledge representation in metabolic pathway databases. Brief Bioinform. 2014; 15(3):455\u201370.","journal-title":"Brief Bioinform"},{"key":"202_CR12","first-page":"1747","volume":"2016","author":"LL Wang","year":"2016","unstructured":"Wang LL, Gennari JH, Abernethy NF. An analysis of differences in biological pathway resources. Int Conf Biomed Ontol BioCreative (ICBO BioCreative. 2016; 2016:1747.","journal-title":"Int Conf Biomed Ontol BioCreative (ICBO BioCreative"},{"issue":"9","key":"202_CR13","doi-asserted-by":"publisher","first-page":"935","DOI":"10.1038\/nbt.1666","volume":"28","author":"E Demir","year":"2010","unstructured":"Demir E, Cary MP, Paley S, Fukuda K, Lemer C, Vastrik I, et al.The BioPAX community standard for pathway data sharing. Nat Biotechnol. 2010; 28(9):935\u201342.","journal-title":"Nat Biotechnol"},{"issue":"4","key":"202_CR14","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1093\/bioinformatics\/btg015","volume":"19","author":"M Hucka","year":"2003","unstructured":"Hucka M, Finney A, Sauro HM, Bolouri H, Doyle JC, Kitano H, et al.The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics. 2003; 19(4):524\u201331.","journal-title":"Bioinformatics"},{"key":"202_CR15","doi-asserted-by":"publisher","first-page":"1471","DOI":"10.1186\/1471-2105-9-399","volume":"9","author":"MP van Iersel","year":"2008","unstructured":"van Iersel MP, Kelder T, Pico AR, Hanspers K, Coort S, Conklin BR, et al.Presenting and exploring biological pathways with PathVisio. BMC Bioinformatics. 2008; 9:1471\u20132105.","journal-title":"BMC Bioinformatics"},{"key":"202_CR16","doi-asserted-by":"publisher","first-page":"1471","DOI":"10.1186\/s12859-015-0559-3","volume":"16","author":"KM Livingston","year":"2015","unstructured":"Livingston KM, Bada M, Baumgartner WA, Hunter LE. KaBOB: ontology-based semantic integration of biomedical databases. BMC Bioinformatics. 2015; 16:1471\u20132105.","journal-title":"BMC Bioinformatics"},{"key":"202_CR17","doi-asserted-by":"publisher","first-page":"D712","DOI":"10.1093\/nar\/gkw1128","volume":"45","author":"CJ Mungall","year":"2016","unstructured":"Mungall CJ, McMurry JA, K\u00f6hler S, Balhoff JP, Borromeo C, Brush M, et al.The Monarch Initiative: an integrative data and analytic platform connecting phenotypes to genotypes across species. Nucleic Acids Res. 2016; 45:D712\u201322.","journal-title":"Nucleic Acids Res"},{"key":"202_CR18","doi-asserted-by":"publisher","first-page":"27497","DOI":"10.3402\/jev.v4.27497","volume":"4","author":"SL Subramanian","year":"2015","unstructured":"Subramanian SL, Kitchen RR, Alexander R, Carter BS, Cheung KH, Laurent LC, et al.Integration of extracellular RNA profiling data using metadata, biomedical ontologies and Linked Data technologies. J Extracellular Veh. 2015; 4:27497.","journal-title":"J Extracellular Veh"},{"key":"202_CR19","doi-asserted-by":"publisher","first-page":"2041","DOI":"10.1186\/2041-1480-5-7","volume":"5","author":"V Petri","year":"2014","unstructured":"Petri V, Jayaraman P, Tutaj M, Hayman GT, Smith JR, De Pons J, et al.The pathway ontology \u2013 updates and applications. J Biomed Semant. 2014; 5:2041\u20131480.","journal-title":"J Biomed Semant"},{"key":"202_CR20","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/75556","volume":"25","author":"M Ashburner","year":"2000","unstructured":"Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, et al.Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet. 2000; 25:25\u201329.","journal-title":"Nat Genet"},{"issue":"2","key":"202_CR21","first-page":"75","volume":"20","author":"C Biemann","year":"2005","unstructured":"Biemann C. Ontology Learning from Text: A Survey of Methods. LDV Forum. 2005; 20(2):75\u201393.","journal-title":"LDV Forum"},{"issue":"2","key":"202_CR22","doi-asserted-by":"publisher","first-page":"949","DOI":"10.1016\/j.eswa.2014.08.032","volume":"42","author":"L Otero-Cerdeira","year":"2015","unstructured":"Otero-Cerdeira L, Rodr\u00edguez-Mart\u00ednez FJ, G\u00f3mez-Rodr\u00edguez A. Ontology matching: A literature review. Expert Syst Appl. 2015; 42(2):949\u201371.","journal-title":"Expert Syst Appl"},{"issue":"Database issue","key":"202_CR23","first-page":"D472","volume":"42","author":"D Croft","year":"2013","unstructured":"Croft D, Mundo AF, Haw R, Milacic M, Weiser J, Wu G, et al.The Reactome pathway knowledgebase. Nucleic Acids Res. 2013; 42(Database issue):D472\u2013477.","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"202_CR24","doi-asserted-by":"publisher","first-page":"D459","DOI":"10.1093\/nar\/gkt1103","volume":"42","author":"R Caspi","year":"2014","unstructured":"Caspi R, Altman T, Billington R, Dreher K, Foerster H, Fulcher CA, et al.The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of Pathway\/Genome Databases. Nucleic Acids Res. 2014; 42(D1):D459\u201371.","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"202_CR25","doi-asserted-by":"publisher","first-page":"D488","DOI":"10.1093\/nar\/gkv1024","volume":"44","author":"M Kutmon","year":"2016","unstructured":"Kutmon M, Riutta A, Nunes N, Hanspers K, Willighagen EL, Bohler A, et al.WikiPathways: capturing the full diversity of pathway knowledge. Nucleic Acids Res. 2016; 44(D1):D488\u201394.","journal-title":"Nucleic Acids Res"},{"issue":"Database issue","key":"202_CR26","doi-asserted-by":"publisher","first-page":"D267","DOI":"10.1093\/nar\/gkh061","volume":"32","author":"O Bodenreider","year":"2004","unstructured":"Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004; 32(Database issue):D267\u201370.","journal-title":"Nucleic Acids Res"},{"key":"202_CR27","first-page":"360","volume":"2002","author":"S Abney","year":"2002","unstructured":"Abney S. Bootstrapping. Proc 40th Annu Meet Assoc Comput Linguist (ACL). 2002; 2002:360\u20137.","journal-title":"Proc 40th Annu Meet Assoc Comput Linguist (ACL)"},{"key":"202_CR28","unstructured":"Mikolov T, Chen K, Corrado GS, Dean J. Effic ient Estimation of Word Representations in Vector Space. CoRR. 2013;abs\/1301.3781."},{"key":"202_CR29","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl_a_00051","volume":"5","author":"P Bojanowski","year":"2017","unstructured":"Bojanowski P, Grave E, Joulin A, Mikolov T. Enriching Word Vectors with Subword Information. Trans Assoc Comput Linguist. 2017; 5:135\u201346.","journal-title":"Trans Assoc Comput Linguist"},{"issue":"8","key":"202_CR30","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"Sepp Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Comput. 1997; 9(8):1735\u201380.","journal-title":"Neural Computation"},{"issue":"1","key":"202_CR31","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1038\/msb.2009.47","volume":"5","author":"A Bauer-Mehren","year":"2009","unstructured":"Bauer-Mehren A, Furlong LI, Sanz F. Pathway databases and tools for their exploitation: benefits, current limitations and challenges. Mol Syst Biol. 2009; 5(1):290.","journal-title":"Mol Syst Biol"},{"key":"202_CR32","unstructured":"Wang LL, Gennari JH. Similarity metrics for determining overlap among biological pathways. Int Conf Biol Ontol. (ICBO 2017). 2017;2137."}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-019-0202-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13326-019-0202-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-019-0202-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:20:54Z","timestamp":1790036454000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13326-019-0202-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,13]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["202"],"URL":"https:\/\/doi.org\/10.1186\/s13326-019-0202-8","relation":{},"ISSN":["2041-1480"],"issn-type":[{"value":"2041-1480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,13]]},"assertion":[{"value":"2 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Ethics"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Consent for publication","group":{"name":"EthicsHeading","label":"Ethics"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"11"}}