{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T22:37:49Z","timestamp":1781908669388,"version":"3.54.5"},"reference-count":37,"publisher":"Cambridge University Press (CUP)","issue":"1","license":[{"start":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T00:00:00Z","timestamp":1694649600000},"content-version":"unspecified","delay-in-days":256,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Clin. Trans. Sci."],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title>\n\t  <jats:p>Knowledge graphs have become a common approach for knowledge representation. Yet, the application of graph methodology is elusive due to the sheer number and complexity of knowledge sources. In addition, semantic incompatibilities hinder efforts to harmonize and integrate across these diverse sources. As part of The Biomedical Translator Consortium, we have developed a knowledge graph\u2013based question-answering system designed to augment human reasoning and accelerate translational scientific discovery: the Translator system. We have applied the Translator system to answer biomedical questions in the context of a broad array of diseases and syndromes, including Fanconi anemia, primary ciliary dyskinesia, multiple sclerosis, and others. A variety of collaborative approaches have been used to research and develop the Translator system. One recent approach involved the establishment of a monthly \u201cQuestion-of-the-Month (QotM) Challenge\u201d series. Herein, we describe the structure of the QotM Challenge; the six challenges that have been conducted to date on drug-induced liver injury, cannabidiol toxicity, coronavirus infection, diabetes, psoriatic arthritis, and <jats:italic>ATP1A3<\/jats:italic>-related phenotypes; the scientific insights that have been gleaned during the challenges; and the technical issues that were identified over the course of the challenges and that can now be addressed to foster further development of the prototype Translator system. We close with a discussion on Large Language Models such as ChatGPT and highlight differences between those models and the Translator system.<\/jats:p>","DOI":"10.1017\/cts.2023.619","type":"journal-article","created":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T15:30:32Z","timestamp":1694705432000},"source":"Crossref","is-referenced-by-count":7,"title":["An approach for collaborative development of a federated biomedical knowledge graph-based question-answering system: Question-of-the-Month challenges"],"prefix":"10.1017","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6704-9306","authenticated-orcid":false,"given":"Karamarie","family":"Fecho","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9491-7674","authenticated-orcid":false,"given":"Chris","family":"Bizon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0842-7335","authenticated-orcid":false,"given":"Tursynay","family":"Issabekova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8719-7760","authenticated-orcid":false,"given":"Sierra","family":"Moxon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2908-3327","authenticated-orcid":false,"given":"Anne E.","family":"Thessen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2444-0014","authenticated-orcid":false,"given":"Shervin","family":"Abdollahi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0067-194X","authenticated-orcid":false,"given":"Sergio E.","family":"Baranzini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Basazin","family":"Belhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4730-5293","authenticated-orcid":false,"given":"William E.","family":"Byrd","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6823-9275","authenticated-orcid":false,"given":"Lawrence","family":"Chung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3499-6902","authenticated-orcid":false,"given":"Andrew","family":"Crouse","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3884-6680","authenticated-orcid":false,"given":"Marc P.","family":"Duby","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3172-8347","authenticated-orcid":false,"given":"Stephen","family":"Ferguson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1035-3294","authenticated-orcid":false,"given":"Aleksandra","family":"Foksinska","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Forero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Friedman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vicki","family":"Gardner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8060-5955","authenticated-orcid":false,"given":"Gw\u00eanlyn","family":"Glusman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6103-7606","authenticated-orcid":false,"given":"Jennifer","family":"Hadlock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5410-599X","authenticated-orcid":false,"given":"Kristina","family":"Hanspers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8045-7083","authenticated-orcid":false,"given":"Eugene","family":"Hinderer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3964-5952","authenticated-orcid":false,"given":"Charlotte","family":"Hobbs","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5608-5224","authenticated-orcid":false,"given":"Gregory","family":"Hyde","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3545-4665","authenticated-orcid":false,"given":"Sui","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0640-954X","authenticated-orcid":false,"given":"David","family":"Koslicki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6620-0457","authenticated-orcid":false,"given":"Philip","family":"Mease","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5998-3003","authenticated-orcid":false,"given":"Sandrine","family":"Muller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6601-2165","authenticated-orcid":false,"given":"Christopher J.","family":"Mungall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2168-5403","authenticated-orcid":false,"given":"Stephen A.","family":"Ramsey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4524-0107","authenticated-orcid":false,"given":"Jared","family":"Roach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2377-3498","authenticated-orcid":false,"given":"Irit","family":"Rubin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9133-7906","authenticated-orcid":false,"given":"Shepherd H.","family":"Schurman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2869-7228","authenticated-orcid":false,"given":"Anath","family":"Shalev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2586-5014","authenticated-orcid":false,"given":"Brett","family":"Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3490-9306","authenticated-orcid":false,"given":"Karthik","family":"Soman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Stemann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9859-4104","authenticated-orcid":false,"given":"Andrew I.","family":"Su","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4679-805X","authenticated-orcid":false,"given":"Casey","family":"Ta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9541-8917","authenticated-orcid":false,"given":"Paul B.","family":"Watkins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8020-916X","authenticated-orcid":false,"given":"Mark D.","family":"Williams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2629-6124","authenticated-orcid":false,"given":"Chunlei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2975-882X","authenticated-orcid":false,"given":"Colleen H.","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"The Biomedical Data Translator Consortium","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2023,9,14]]},"reference":[{"key":"S2059866123006192_ref21","doi-asserted-by":"publisher","DOI":"10.1002\/hep.23891"},{"key":"S2059866123006192_ref37","doi-asserted-by":"publisher","DOI":"10.1145\/3571730"},{"key":"S2059866123006192_ref15","unstructured":"15. National Library of Medicine, National Center for Biotechnology Information. PPARG peroxisome proliferator activated receptor gamma [Homo sapiens (human)], Gene ID: 5468. Last updated June 21, 2023. https:\/\/www.ncbi.nlm.nih.gov\/gene\/5468. Accessed July 10, 2023."},{"key":"S2059866123006192_ref5","doi-asserted-by":"publisher","DOI":"10.1111\/cts.13021"},{"key":"S2059866123006192_ref20","unstructured":"20. Jazz Pharmaceuticals, Inc. EPIDIOLEX\u00ae (cannabidiol) oral solution: prescribing information. Last revised January 2023. https:\/\/pp.jazzpharma.com\/pi\/epidiolex.en.USPI.pdf. Accessed July 10, 2023."},{"key":"S2059866123006192_ref19","unstructured":"19. National Library of Medicine. DailyMed. The DailyMed database contains 145958 labels submitted to the US Food and Drug Administration by companies, undated. https:\/\/dailymed.nlm.nih.gov\/dailymed\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref28","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18"},{"key":"S2059866123006192_ref32","unstructured":"32. National Center for Advancing Translational Sciences. NCATS BioPlanet: A Resource for Discovery. Last updated March 23, 2022. https:\/\/ncats.nih.gov\/pubs\/features\/bioplanet. Accessed July 10, 2023."},{"key":"S2059866123006192_ref6","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkx1037"},{"key":"S2059866123006192_ref4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103325"},{"key":"S2059866123006192_ref1","unstructured":"1. The Alan Turing Institute, Interest Group. Knowledge graphs. How do we encode knowledge to use at scale in open, evolving, decentralized systems? 2023. https:\/\/www.turing.ac.uk\/research\/interest-groups\/knowledge-graphs. Accessed July 10, 2023."},{"key":"S2059866123006192_ref11","doi-asserted-by":"publisher","DOI":"10.1111\/cts.13302"},{"key":"S2059866123006192_ref13","unstructured":"13. National Library of Medicine, National Center for Biotechnology Information. ALAS1 5\u02bc-aminolevulinate synthase 1 [Homo sapiens (human)], Gene ID: 211. Last updated March 29, 2023. https:\/\/www.ncbi.nlm.nih.gov\/gene\/211. Accessed July 10, 2023."},{"key":"S2059866123006192_ref2","first-page":"91","article-title":"Toward a universal biomedical data translator","volume":"12","year":"2019","journal-title":"Clini Translat Sci"},{"key":"S2059866123006192_ref23","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmet.2020.07.002"},{"key":"S2059866123006192_ref27","unstructured":"27. DrugBank Online. Botulinum toxin type A. Last updated July 7, 2023. https:\/\/go.drugbank.com\/drugs\/DB00083. Accessed July 10, 2023."},{"key":"S2059866123006192_ref31","unstructured":"31. WikiPathways. WikiPathways is an open science platform for biological pathways contributed, updated, and used by the research community. Last updated July 10, 2023. https:\/\/www.wikipathways.org\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref14","unstructured":"14. National Institute of Diabetes and Digestive Disorders. Porphyria. Last reviewed July 2020. https:\/\/www.niddk.nih.gov\/health-information\/liver-disease\/porphyria. Accessed July 10, 2023"},{"key":"S2059866123006192_ref12","doi-asserted-by":"publisher","DOI":"10.1111\/cts.12592"},{"key":"S2059866123006192_ref10","unstructured":"10. NCATS Translator, Reasoner API. Tranlsator Reasoner Application Programming Interface (TRAPI) defines a standard HTTP Aaplication Programming Interface schema for communication across Translator components by leveraging a graph-based query structure and applying Biolink Model to precisely describe the semantics of biological entities and their relationships. 2023. https:\/\/github.com\/NCATSTranslator\/ReasonerAPI. Accessed July 10, 2023."},{"key":"S2059866123006192_ref18"},{"key":"S2059866123006192_ref36","volume-title":"Beyond \"Justification\": dimensions of epistemic evaluation","author":"Alston","year":"2005"},{"key":"S2059866123006192_ref25","unstructured":"25. DrugBank Online. Clozapine. Last updated July 7, 2023. https:\/\/go.drugbank.com\/drugs\/DB00363. Accessed July 10, 2023."},{"key":"S2059866123006192_ref8","unstructured":"8. MONDO. The Mondo Disease Ontology (MONDO) aims to harmonize disease definitions across biomedical disciplines. 2023. https:\/\/mondo.monarchinitiative.org\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref16","unstructured":"16. WebMD LLC. Beta-Sitosterol \u2013 Uses, Side Effects, and More. 2005-2023. https:\/\/www.webmd.com\/vitamins\/ai\/ingredientmono-939\/beta-sitosterol. Accessed July 10, 2023."},{"key":"S2059866123006192_ref34","unstructured":"34. ThinkML. What are the Natural Language Processing Challenges, and How to Fix them? June 4, 2022. https:\/\/thinkml.ai\/what-are-the-natural-language-processing-challenges-and-how-to-fix-them\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref24","unstructured":"24. DrugBank Online. Flunarizine. Last updated July 7, 2023. https:\/\/go.drugbank.com\/drugs\/DB04841. Accessed July 10, 2023."},{"key":"S2059866123006192_ref29","unstructured":"29. Node Normalization. Node Normalization is a Translator service that, when provided with an input compact uniform resource identifier (CURIE) for an entity, returns the Translator-preferred CURIE, a list of equivalent CURIEs, and the Biolink Model\u2013defined semantic types for that entity. https:\/\/nodenormalization-sri.renci.org\/docs. Accessed July 10, 2023."},{"key":"S2059866123006192_ref7","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkac833"},{"key":"S2059866123006192_ref17","unstructured":"17. NORD: National Organization for Rare Disorders. Sitosterolemia. Last updated October 4, 2021. https:\/\/rarediseases.org\/rare-diseases\/sitosterolemia\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref26","unstructured":"26. DrugBank Online. Haloperidol. Last updated July 7, 2023. https:\/\/go.drugbank.com\/drugs\/DB00502. Accessed July 10, 2023."},{"key":"S2059866123006192_ref9","unstructured":"9. GO.The Gene Ontology (GO) knowledgebase is the world\u2019s largest source of information on the functions of genes. This knowledge is both human-readable and machine-readable, and is a foundation for computational analysis of large-scale molecular biology and genetics experiments in biomedical research. 1999-2023. http:\/\/geneontology.org\/. Accessed July 10, 2023."},{"key":"S2059866123006192_ref22","doi-asserted-by":"publisher","DOI":"10.1093\/toxsci\/kfz154"},{"key":"S2059866123006192_ref30","unstructured":"30. Name Resolver. Name Resolver is a Translator service that, when provided with an input lexical string for an entity, returns the mapped CURIEs for that entity after first normalizing the CURIEs using the Node Normalization Service. https:\/\/name-resolution-sri.renci.org\/docs. Accessed July 10, 2023."},{"key":"S2059866123006192_ref33","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bts591"},{"key":"S2059866123006192_ref35","unstructured":"35. OpenAI. GPT-4. GPT-4 is OpenAI\u2019s most advanced system, producing safer and more useful responses. 2015-2023. https:\/\/openai.com\/gpt-4. Accessed July 10, 2023."},{"key":"S2059866123006192_ref3","doi-asserted-by":"publisher","DOI":"10.1111\/cts.13301"}],"container-title":["Journal of Clinical and Translational Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S2059866123006192","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T10:52:17Z","timestamp":1697799137000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S2059866123006192\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023]]}},"alternative-id":["S2059866123006192"],"URL":"https:\/\/doi.org\/10.1017\/cts.2023.619","relation":{},"ISSN":["2059-8661"],"issn-type":[{"value":"2059-8661","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023]]},"article-number":"e214"}}