{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T06:37:58Z","timestamp":1776148678559,"version":"3.50.1"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T00:00:00Z","timestamp":1699660800000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100008460","name":"National Center for Complementary and Integrative Health","doi-asserted-by":"publisher","award":["R01AT009457"],"award-info":[{"award-number":["R01AT009457"]}],"id":[{"id":"10.13039\/100008460","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institution on Aging","award":["R01AG078154"],"award-info":[{"award-number":["R01AG078154"]}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To construct an exhaustive Complementary and Integrative Health (CIH) Lexicon (CIHLex) to help better represent the often underrepresented physical and psychological CIH approaches in standard terminologies, and to also apply state-of-the-art natural language processing (NLP) techniques to help recognize them in the biomedical literature.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>We constructed the CIHLex by integrating various resources, compiling and integrating data from biomedical literature and relevant sources of knowledge. The Lexicon encompasses 724 unique concepts with 885 corresponding unique terms. We matched these concepts to the Unified Medical Language System (UMLS), and we developed and utilized BERT models comparing their efficiency in CIH named entity recognition to well-established models including MetaMap and CLAMP, as well as the large language model GPT3.5-turbo.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Of the 724 unique concepts in CIHLex, 27.2% could be matched to at least one term in the UMLS. About 74.9% of the mapped UMLS Concept Unique Identifiers were categorized as \u201cTherapeutic or Preventive Procedure.\u201d Among the models applied to CIH named entity recognition, BLUEBERT delivered the highest macro-average F1-score of 0.91, surpassing other models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Our CIHLex significantly augments representation of CIH approaches in biomedical literature. Demonstrating the utility of advanced NLP models, BERT notably excelled in CIH entity recognition. These results highlight promising strategies for enhancing standardization and recognition of CIH terminology in biomedical contexts.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad216","type":"journal-article","created":{"date-parts":[[2023,11,12]],"date-time":"2023-11-12T10:06:00Z","timestamp":1699783560000},"page":"426-434","source":"Crossref","is-referenced-by-count":19,"title":["Complementary and Integrative Health Information in the literature: its lexicon and named entity recognition"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6524-5506","authenticated-orcid":false,"given":"Huixue","family":"Zhou","sequence":"first","affiliation":[{"name":"Institute for Health Informatics, University of Minnesota , Minneapolis, MN, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1993-4623","authenticated-orcid":false,"given":"Robin","family":"Austin","sequence":"additional","affiliation":[{"name":"School of Nursing, University of Minnesota , Minneapolis, MN, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sheng-Chieh","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Symptom Research, The University of Texas MD Anderson Cancer Center , Houston, TX, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Greg Marc","family":"Silverman","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Minnesota , Minneapolis, MN, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuqi","family":"Zhou","sequence":"additional","affiliation":[{"name":"Institute for Health Informatics, University of Minnesota , Minneapolis, MN, United States"},{"name":"Department of Pharmaceutical Care & Health Systems, University of Minnesota , Minneapolis, MN, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3987-9393","authenticated-orcid":false,"given":"Halil","family":"Kilicoglu","sequence":"additional","affiliation":[{"name":"School of Information Sciences, University of Illinois Urbana-Champaign , Champaign, IL, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hua","family":"Xu","sequence":"additional","affiliation":[{"name":"Section of Biomedical Informatics and Data Science, School of Medicine, Yale University , New Haven, CT, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8258-3585","authenticated-orcid":false,"given":"Rui","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Minnesota , Minneapolis, MN, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,11,10]]},"reference":[{"key":"2024011907303696400_ocad216-B1","author":"National Center for Complementary and Integrative Health (NCCIH)."},{"issue":"3","key":"2024011907303696400_ocad216-B2","first-page":"177","volume":"14","author":"Tick"},{"key":"2024011907303696400_ocad216-B3","first-page":"1","article-title":"Trends in the use of complementary health approaches among adults: United States, 2002-2012","volume":"79","author":"Clarke","year":"2015","journal-title":"Natl Health Stat Report"},{"issue":"S6","key":"2024011907303696400_ocad216-B4","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1186\/s12911-021-01534-6","article-title":"ICD-11: an international classification of diseases for the twenty-first century","volume":"21","author":"Harrison","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"key":"2024011907303696400_ocad216-B5"},{"issue":"8","key":"2024011907303696400_ocad216-B6","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1089\/jicm.2022.0748","article-title":"Documentation of complementary and integrative health therapies in the electronic health record: a scoping review","volume":"29","author":"Austin","year":"2023","journal-title":"J Integr Complement Med"},{"issue":"7","key":"2024011907303696400_ocad216-B7","doi-asserted-by":"crossref","first-page":"e012006","DOI":"10.1136\/bmjopen-2016-012006","article-title":"Referrals to integrative medicine in a tertiary hospital: findings from electronic health record data and qualitative interviews","volume":"6","author":"Griffin","year":"2016","journal-title":"BMJ Open"},{"key":"2024011907303696400_ocad216-B8","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.ctim.2016.03.008","article-title":"Use of electronic personal health records (PHRs) for complementary and alternative medicine (CAM) disclosure: implications for integrative health care","volume":"26","author":"Yeo","year":"2016","journal-title":"Complement Ther Med"},{"issue":"9-10","key":"2024011907303696400_ocad216-B9","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1089\/acm.2018.0141","article-title":"Absent and discordant electronic health record documentation of complementary and alternative medicine in cancer care","volume":"24","author":"Stan","year":"2018","journal-title":"J Altern Complement Med"},{"issue":"Database issue","key":"2024011907303696400_ocad216-B10","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"issue":"10","key":"2024011907303696400_ocad216-B11","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1093\/jamia\/ocaa128","article-title":"Assessing the enrichment of dietary supplement coverage in the Unified Medical Language System","volume":"27","author":"Vasilakes","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907303696400_ocad216-B12","first-page":"801","article-title":"Integration of a standard gastrointestinal endoscopy terminology in the UMLS Metathesaurus","author":"Tringali","year":"2002","journal-title":"Proc AMIA Symp"},{"issue":"10","key":"2024011907303696400_ocad216-B13","doi-asserted-by":"crossref","first-page":"e31980","DOI":"10.2196\/31980","article-title":"Expressiveness of an international semantic standard for wound care: mapping a standardized item set for leg ulcers to the systematized nomenclature of medicine-clinical terms","volume":"9","author":"H\u00fcsers","year":"2021","journal-title":"JMIR Med Inform"},{"key":"2024011907303696400_ocad216-B14","first-page":"17","author":"Aronson","year":"2001"},{"issue":"3","key":"2024011907303696400_ocad216-B15","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1093\/jamia\/ocx132","article-title":"CLAMP\u2014a toolkit for efficiently building customized clinical natural language processing pipelines","volume":"25","author":"Soysal","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907303696400_ocad216-B16","first-page":"2","author":"Devlin","year":"2019"},{"key":"2024011907303696400_ocad216-B17","author":"Alsentzer"},{"issue":"11","key":"2024011907303696400_ocad216-B18","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1093\/jamia\/ocz096","article-title":"Enhancing clinical concept extraction with contextual embeddings","volume":"26","author":"Si","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907303696400_ocad216-B19","author":"OpenAI","year":"2023"},{"issue":"2","key":"2024011907303696400_ocad216-B20","doi-asserted-by":"crossref","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","article-title":"Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models","volume":"2","author":"Kung","year":"2023","journal-title":"PLoS Digit Health"},{"key":"2024011907303696400_ocad216-B21","author":"Hu","year":"2023"},{"issue":"4","key":"2024011907303696400_ocad216-B22","doi-asserted-by":"crossref","first-page":"ooab081","DOI":"10.1093\/jamiaopen\/ooab081","article-title":"Deep learning models in detection of dietary supplement adverse event signals from Twitter","volume":"4","author":"Wang","year":"2021","journal-title":"JAMIA Open"},{"issue":"3","key":"2024011907303696400_ocad216-B23","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1093\/jamia\/ocaa218","article-title":"Deep learning approaches for extracting adverse events and indications of dietary supplements from clinical text","volume":"28","author":"Fan","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907303696400_ocad216-B24","first-page":"513","author":"Zhou","year":"2021"},{"key":"2024011907303696400_ocad216-B25","author":"Natural Medicines"},{"key":"2024011907303696400_ocad216-B26","volume-title":"Mayo Clinic Guide to Integrative Medicine","author":"Bauer","year":"2021"},{"key":"2024011907303696400_ocad216-B27","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1093\/med\/9780199860739.001.0001","volume-title":"Integrative Nursing","author":"Kreitzer","year":"2014"},{"key":"2024011907303696400_ocad216-B28","volume-title":"The Duke Encyclopedia of New Medicine: Conventional and Alternative Medicine for All Ages","author":"Duke Center for Integrative Medicine","year":"2006"},{"key":"2024011907303696400_ocad216-B29","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1891\/9780826144348","volume-title":"Complementary and Alternative Therapies in Nursing","author":"Lindquist","year":"2018","edition":"8th ed"},{"key":"2024011907303696400_ocad216-B30","author":"National Center for Biotechnology Information National Institutes of Health"},{"issue":"2","key":"2024011907303696400_ocad216-B31","first-page":"50","article-title":"Development and classification of an operational definition of complementary and alternative medicine for the Cochrane collaboration","volume":"17","author":"Wieland","year":"2011","journal-title":"Altern Ther Health Med"},{"key":"2024011907303696400_ocad216-B32","volume-title":"Mapping the Pathway to Research on Whole Person Health.","author":"National Center for Complementary and Integrative Health"},{"key":"2024011907303696400_ocad216-B33","author":"National Library of Medicine. Lexical Tools"},{"issue":"W1","key":"2024011907303696400_ocad216-B34","doi-asserted-by":"crossref","first-page":"W5","DOI":"10.1093\/nar\/gkaa333","article-title":"TeamTat: a collaborative text annotation tool","volume":"48","author":"Islamaj","year":"2020","journal-title":"Nucleic Acids Res"},{"issue":"4","key":"2024011907303696400_ocad216-B35","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2024011907303696400_ocad216-B36","author":"Huang","year":"2020"},{"issue":"1","key":"2024011907303696400_ocad216-B37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3458754","article-title":"Domain-specific language model pretraining for biomedical natural language processing","volume":"3","author":"Gu","year":"2022","journal-title":"ACM Trans Comput Healthcare"},{"key":"2024011907303696400_ocad216-B38","author":"Peng"},{"issue":"1","key":"2024011907303696400_ocad216-B39","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1093\/jamia\/ocz166","article-title":"2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records","volume":"27","author":"Henry","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2024011907303696400_ocad216-B40","author":"Dong","year":"2023"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/2\/426\/56209557\/ocad216.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/2\/426\/56209557\/ocad216.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,19]],"date-time":"2024-01-19T07:32:47Z","timestamp":1705649567000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/2\/426\/7407972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,10]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,11,10]]},"published-print":{"date-parts":[[2024,1,18]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad216","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,2,1]]},"published":{"date-parts":[[2023,11,10]]}}}