{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T22:30:10Z","timestamp":1793485810681,"version":"4.5.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"DOI":"10.1038\/s41746-024-01081-0","type":"journal-article","created":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T08:01:49Z","timestamp":1713859309000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":80,"title":["Augmented non-hallucinating large language models as medical information curators"],"prefix":"10.1038","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1997-1689","authenticated-orcid":false,"given":"Stephen","family":"Gilbert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jakob Nikolas","family":"Kather","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9482-1982","authenticated-orcid":false,"given":"Aidan","family":"Hogan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,23]]},"reference":[{"key":"1081_CR1","doi-asserted-by":"crossref","unstructured":"Schulze-Kremer, S. & Smith, B. Ontologies for the life sciences in Encyclopedia of Genetics, Genomics, Proteomics and Bioinformatics, Vol. 4 (John Wiley and Sons, New York and London, 2005).","DOI":"10.1002\/047001153X.g408213"},{"key":"1081_CR2","unstructured":"Hu, X. In Computational Systems Biology (eds. Kriete, A. & Eils, R.) Ch. 3 (Academic Press, Burlington, 2006)."},{"key":"1081_CR3","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1093\/jamia\/ocaa325","volume":"28","author":"AJ Moy","year":"2021","unstructured":"Moy, A. J. et al. Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review. J. Am. Med. Inform. Assoc. 28, 998\u20131008 (2021).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"1081_CR4","doi-asserted-by":"publisher","first-page":"e50158","DOI":"10.2196\/50158","volume":"25","author":"C Welzel","year":"2023","unstructured":"Welzel, C. et al. Holistic human-serving digitization of health care needs integrated automated system-level assessment tools. J. Med. Internet Res. 25, e50158 (2023).","journal-title":"J. Med. Internet Res."},{"key":"1081_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-019-0158-1","volume":"2","author":"M Lehne","year":"2019","unstructured":"Lehne, M., Sass, J., Essenwanger, A., Schepers, J. & Thun, S. Why digital medicine depends on interoperability. npj Digit. Med. 2, 1\u20135 (2019).","journal-title":"npj Digit. Med."},{"key":"1081_CR6","first-page":"279","volume":"121","author":"K Donnelly","year":"2006","unstructured":"Donnelly, K. SNOMED-CT: The advanced terminology and coding system for eHealth. Stud. Health Technol. Inform. 121, 279\u2013290 (2006).","journal-title":"Stud. Health Technol. Inform."},{"key":"1081_CR7","doi-asserted-by":"publisher","first-page":"D1207","DOI":"10.1093\/nar\/gkaa1043","volume":"49","author":"S K\u00f6hler","year":"2021","unstructured":"K\u00f6hler, S. et al. The human phenotype ontology in 2021. Nucleic Acids Res. 49, D1207\u2013D1217 (2021).","journal-title":"Nucleic Acids Res."},{"key":"1081_CR8","doi-asserted-by":"publisher","first-page":"1073313","DOI":"10.3389\/fmed.2023.1073313","volume":"10","author":"M Kreuzthaler","year":"2023","unstructured":"Kreuzthaler, M., Brochhausen, M., Zayas, C., Blobel, B. & Schulz, S. Linguistic and ontological challenges of multiple domains contributing to transformed health ecosystems. Front. Med. 10, 1073313 (2023).","journal-title":"Front. Med."},{"key":"1081_CR9","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1093\/jamia\/ocaa269","volume":"28","author":"D Newman-Griffis","year":"2020","unstructured":"Newman-Griffis, D. et al. Ambiguity in medical concept normalization: an analysis of types and coverage in electronic health record datasets. J. Am. Med. Inform. Assoc. 28, 516\u2013532 (2020).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"1081_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3447772","volume":"54","author":"A Hogan","year":"2021","unstructured":"Hogan, A. et al. Knowledge graphs. ACM Comput. Surv. 54, 1\u201371 (2021).","journal-title":"ACM Comput. Surv."},{"key":"1081_CR11","unstructured":"Chen, J. et al. Knowledge graphs for the life sciences: recent developments, challenges and opportunities. arXiv 5, 1\u20135 (2023)."},{"key":"1081_CR12","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1055\/s-0040-1702001","volume":"29","author":"U Hahn","year":"2020","unstructured":"Hahn, U. & Oleynik, M. Medical information extraction in the age of deep learning. Yearb Med. Inform. 29, 208\u2013220 (2020).","journal-title":"Yearb Med. Inform."},{"key":"1081_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3605943","volume":"56","author":"B Min","year":"2024","unstructured":"Min, B. et al. Recent advances in natural language processing via large pre-trained language models: a survey. ACM Comput. Surv. 56, 1\u201340 (2024).","journal-title":"ACM Comput. Surv."},{"key":"1081_CR14","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-023-06160-y","volume":"619","author":"LY Jiang","year":"2023","unstructured":"Jiang, L. Y. et al. Health system-scale language models are all-purpose prediction engines. Nature 619, 357\u2013362 (2023).","journal-title":"Nature"},{"key":"1081_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s43856-023-00370-1","volume":"3","author":"J Clusmann","year":"2023","unstructured":"Clusmann, J. et al. The future landscape of large language models in medicine. Commun. Med. 3, 1\u20138 (2023).","journal-title":"Commun. Med."},{"key":"1081_CR16","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1162\/daed_a_01905","volume":"151","author":"CD Manning","year":"2022","unstructured":"Manning, C. D. Human language understanding & reasoning. Daedalus 151, 127\u2013138 (2022).","journal-title":"Daedalus"},{"key":"1081_CR17","doi-asserted-by":"crossref","unstructured":"Liao, L., Yang, G. H. & Shah, C. Proactive conversational agents in the post-chatGPT world. in Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval 3452\u20133455 (Association for Computing Machinery, NY, 2023).","DOI":"10.1145\/3539618.3594250"},{"key":"1081_CR18","doi-asserted-by":"publisher","first-page":"2983","DOI":"10.1038\/s41591-023-02594-z","volume":"29","author":"D Truhn","year":"2023","unstructured":"Truhn, D., Reis-Filho, J. S. & Kather, J. N. Large language models should be used as scientific reasoning engines, not knowledge databases. Nat. Med. 29, 2983\u20132984 (2023).","journal-title":"Nat. Med."},{"key":"1081_CR19","doi-asserted-by":"crossref","unstructured":"Truhn, D. et al. Extracting structured information from unstructured histopathology reports using generative pre-trained transformer 4 (GPT-4). J. Pathol. 265, 310\u2013319 (2023).","DOI":"10.1002\/path.6232"},{"key":"1081_CR20","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-47500-2","volume":"13","author":"D Truhn","year":"2023","unstructured":"Truhn, D. et al. A pilot study on the efficacy of GPT-4 in providing orthopedic treatment recommendations from MRI reports. Sci. Rep. 13, 20159 (2023).","journal-title":"Sci. Rep."},{"key":"1081_CR21","first-page":"00835","volume":"S1542-3565","author":"M Giuffr\u00e8","year":"2023","unstructured":"Giuffr\u00e8, M., You, K. & Shung, D. L. Evaluating chatGPT in medical contexts: the imperative to guard against hallucinations and partial accuracies. Clin. Gastroenterol. Hepatol. S1542-3565, 00835\u20132 (2023).","journal-title":"Clin. Gastroenterol. Hepatol."},{"key":"1081_CR22","doi-asserted-by":"crossref","unstructured":"Gilbert, S., Harvey, H., Melvin, T., Vollebregt, E. & Wicks, P. Large language model AI chatbots require approval as medical devices. Nat. Med. 29, 2396\u20132398 (2023).","DOI":"10.1038\/s41591-023-02412-6"},{"key":"1081_CR23","doi-asserted-by":"publisher","unstructured":"Munn, L., Magee, L. & Arora, V. Truth machines: synthesizing veracity in AI language models. AI & Soc. https:\/\/doi.org\/10.1007\/s00146-023-01756-4 (2023).","DOI":"10.1007\/s00146-023-01756-4"},{"key":"1081_CR24","doi-asserted-by":"publisher","unstructured":"Pan, J. Z. et al. Large language models and knowledge graphs: opportunities and challenges. In Special Issue on Trends in Graph Data and Knowledge. Transactions on Graph Data and Knowledge (TGDK). 1, 2:1-2:38, Schloss Dagstuhl \u2013 Leibniz-Zentrum f\u00fcr Informatik (2023) https:\/\/doi.org\/10.4230\/TGDK.1.1.2 (2023).","DOI":"10.4230\/TGDK.1.1.2"},{"key":"1081_CR25","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-34981-4","volume":"13","author":"G Cenikj","year":"2023","unstructured":"Cenikj, G. et al. From language models to large-scale food and biomedical knowledge graphs. Sci. Rep. 13, 7815 (2023).","journal-title":"Sci. Rep."},{"key":"1081_CR26","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-023-01960-3","volume":"10","author":"P Chandak","year":"2023","unstructured":"Chandak, P., Huang, K. & Zitnik, M. Building a knowledge graph to enable precision medicine. Sci. Data. 10, 67 (2023).","journal-title":"Sci. Data."},{"key":"1081_CR27","doi-asserted-by":"publisher","unstructured":"Rajabi, E. & Etminani, K. Knowledge-graph-based explainable AI: a systematic review. J. Inf. Sci. https:\/\/doi.org\/10.1177\/01655515221112844 (2022).","DOI":"10.1177\/01655515221112844"},{"key":"1081_CR28","doi-asserted-by":"publisher","first-page":"8548","DOI":"10.1002\/int.22955","volume":"37","author":"Q Guo","year":"2022","unstructured":"Guo, Q., Cao, S. & Yi, Z. A medical question answering system using large language models and knowledge graphs. Int. J. Intelligent Syst. 37, 8548\u20138564 (2022).","journal-title":"Int. J. Intelligent Syst."},{"key":"1081_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-023-00879-8","volume":"6","author":"M Wornow","year":"2023","unstructured":"Wornow, M. et al. The shaky foundations of large language models and foundation models for electronic health records. npj Digit. Med. 6, 1\u201310 (2023).","journal-title":"npj Digit. Med."},{"key":"1081_CR30","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1001\/jama.2023.25057","volume":"331","author":"MD Howell","year":"2024","unstructured":"Howell, M. D., Corrado, G. S. & DeSalvo, K. B. Three epochs of artificial intelligence in health care. JAMA 331, 242\u2013244 (2024).","journal-title":"JAMA"},{"key":"1081_CR31","doi-asserted-by":"publisher","unstructured":"Zakka, C. et al. Almanac\u2014retrieval-augmented language models for clinical medicine. NEJM AI. https:\/\/doi.org\/10.21203\/rs.3.rs-2883198\/v1 (2024).","DOI":"10.21203\/rs.3.rs-2883198\/v1"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01081-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01081-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01081-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T08:20:25Z","timestamp":1713860425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01081-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,23]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1081"],"URL":"https:\/\/doi.org\/10.1038\/s41746-024-01081-0","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,23]]},"assertion":[{"value":"18 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"S.G. declares a nonfinancial interest as an Advisory Group member of the EY-coordinated \u201cStudy on Regulatory Governance and Innovation in the field of Medical Devices\u201d conducted on behalf of the DG SANTE of the European Commission. S.G. declares the following competing financial interests: he has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd., Flo Ltd, Thymia Ltd., FORUM Institut f\u00fcr Management GmbH, High-Tech Gr\u00fcnderfonds Management GmbH, and Ada Health GmbH and holds share options in Ada Health GmbH. S.G. is a News and Views Editor for npj Digital Medicine. S.G. played no role in the internal review or decision to publish this News and Views article. J.N.K. declares consulting services for Owkin, France; DoMore Diagnostics, Norway and Panakeia, UK, he holds shares in StratifAI GmbH and he has received honoraria for lectures or consulting fees by AstraZeneca, Bayer, Eisai, MSD, BMS, Roche, Pfizer and Fresenius. A.H. declares no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"100"}}