{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T19:42:37Z","timestamp":1785354157605,"version":"3.55.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,3,17]],"date-time":"2025-03-17T00:00:00Z","timestamp":1742169600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>Knowledge graphs have revolutionized the organization and retrieval of real-world knowledge, prompting interest in automatic natural language processing approaches for extracting medical knowledge from texts. However, the availability of high-quality Chinese medical knowledge remains limited, posing challenges for constructing Chinese medical knowledge graphs. As large language models like ChatGPT show promise in zero-shot learning for many natural language processing downstream tasks, their potential on constructing Chinese medical knowledge graphs remains uncertain. In this study, we create a Chinese medical knowledge graph by manually annotating textual data and using ChatGPT to automatically generate the graph. We refine the results using filtering and mapping rules to align with our schema. The manually generated graph serves as the ground truth for evaluation, and we explore different methods to enhance its accuracy through knowledge graph completion techniques. As a result, we emphasize the potential of employing ChatGPT for automated knowledge graph construction within the Chinese medical domain. While ChatGPT successfully identifies a larger number of entities, further enhancements are required to improve its performance in extracting more qualified relations.<\/jats:p>","DOI":"10.1145\/3657305","type":"journal-article","created":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T12:26:11Z","timestamp":1712751971000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Zero-Shot Construction of Chinese Medical Knowledge Graph with GPT-3.5-turbo and GPT-4"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-8259-2200","authenticated-orcid":false,"given":"Ling-I","family":"Wu","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6886-5173","authenticated-orcid":false,"given":"Yuxin","family":"Su","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9005-7112","authenticated-orcid":false,"given":"Guoqiang","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,3,17]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","unstructured":"Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su Bryan Wilie Holy Lovenia Ziwei Ji Tiezheng Yu Willy Chung Quyet V. Do Yan Xu and Pascale Fung. 2023. A multitask multilingual multimodal evaluation of ChatGPT on reasoning hallucination and interactivity. arxiv:cs.CL\/2302.04023 (2023).","DOI":"10.18653\/v1\/2023.ijcnlp-main.45"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh061"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5363-6"},{"key":"e_1_3_2_5_2","first-page":"2787","volume-title":"Proceedings of the 27th Annual Conference on Neural Information Processing Systems (NeurIPS\u201913)","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 27th Annual Conference on Neural Information Processing Systems (NeurIPS\u201913). 2787\u20132795. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2013\/file\/1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2005.04.006"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkn580"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n19-1423"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816754"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkr777"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d18-2024"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.26726"},{"key":"e_1_3_2_13_2","unstructured":"Kexin Huang Jaan Altosaar and Rajesh Ranganath. 2020. ClinicalBERT: Modeling clinical notes and predicting hospital readmission. arxiv:cs.CL\/1904.05342 (2020)."},{"key":"e_1_3_2_14_2","unstructured":"Wenxiang Jiao Wenxuan Wang Jen Tse Huang Xing Wang Shuming Shi and Zhaopeng Tu. 2023. Is ChatGPT a good translator? Yes with GPT-4 as the engine. arxiv:cs.CL\/2301.08745 (2023)."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00065"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.03.086"},{"key":"e_1_3_2_17_2","unstructured":"Zeljko Kraljevic Anthony Shek Daniel Bean Rebecca Bendayan James Teo and Richard Dobson. 2021. MedGPT: Medical concept prediction from clinical narratives. arxiv:cs.CL\/2107.03134 (2021)."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/743"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1038\/msb.2009.98"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/p15-1065"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K17-1034"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101817"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-00680-8"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3297280.3297282"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2014.05.006"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-017-9197-z"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463113"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkn892"},{"key":"e_1_3_2_31_2","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving Language Understanding by Generative Pre-training. Retrieved April 17 2024 from https:\/\/openai.com\/research\/language-unsupervised"},{"key":"e_1_3_2_32_2","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language Models Are Unsupervised Multitask Learners. Retrieved April 17 2024 from https:\/\/openai.com\/research\/better-language-models"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-05778-z"},{"key":"e_1_3_2_34_2","volume-title":"Proceedings of the 2021 AAAI Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE\u201921)","volume":"2846","author":"Roy Kaushik","year":"2021","unstructured":"Kaushik Roy, Usha Lokala, Vedant Khandelwal, and Amit P. Sheth. 2021. \u201cIs depression related to cannabis?\u201d: A knowledge-infused model for entity and relation extraction with limited supervision. In Proceedings of the 2021 AAAI Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE\u201921), Vol. 2846. https:\/\/ceur-ws.org\/Vol-2846\/paper9.pdf"},{"key":"e_1_3_2_35_2","unstructured":"Ruixiang Tang Xiaotian Han Xiaoqian Jiang and Xia Hu. 2023. Does synthetic data generation of LLMs help clinical text mining?arxiv:cs.CL\/2303.04360 (2023)."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/749"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-020-00810-1"},{"key":"e_1_3_2_38_2","first-page":"2071","volume-title":"Proceedings of the 33rd International Conference on Machine Learning (ICML\u201916)","volume":"48","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c9ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In Proceedings of the 33rd International Conference on Machine Learning (ICML\u201916), Vol. 48. 2071\u20132080. http:\/\/proceedings.mlr.press\/v48\/trouillon16.html"},{"key":"e_1_3_2_39_2","first-page":"5998","volume-title":"Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NeurIPS\u201917)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NeurIPS\u201917). 5998\u20136008. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16565"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.295"},{"key":"e_1_3_2_42_2","unstructured":"Lucy Lu Wang Kyle Lo Yoganand Chandrasekhar Russell Reas Jiangjiang Yang Doug Burdick Darrin Eide Kathryn Funk Yannis Katsis Rodney Kinney Yunyao Li Ziyang Liu William Merrill Paul Mooney Dewey Murdick Devvret Rishi Jerry Sheehan Zhihong Shen Brandon Stilson Alex Wade Kuansan Wang Nancy Xin Ru Wang Chris Wilhelm Boya Xie Douglas Raymond Daniel S. Weld Oren Etzioni and Sebastian Kohlmeier. 2020. CORD-19: The COVID-19 Open Research Dataset. arxiv:cs.DL\/2004.10706 (2020)."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p16-1124"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","unstructured":"Shusen Wang Bosen Zhang Yajing Xu Yanan Wu and Bo Xiao. 2022. RCL: Relation contrastive learning for zero-shot relation extraction. In Findings of the 2022 Association for Computational Linguistics: NAACL 2022. Association for Computational Linguistics Seattle WA USA 2456\u20132468. 10.18653\/v1\/2022.findings-naacl.188","DOI":"10.18653\/v1\/2022.findings-naacl.188"},{"issue":"2","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3293318","article-title":"A survey of zero-shot learning: Settings, methods, and applications","volume":"10","author":"Wang Wei","year":"2019","unstructured":"Wei Wang, Vincent W. Zheng, Han Yu, and Chunyan Miao. 2019. A survey of zero-shot learning: Settings, methods, and applications. ACM Transactions on Intelligent Systems and Technology 10, 2 (2019), 1\u201337.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkj067"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.328"},{"key":"e_1_3_2_49_2","unstructured":"Bishan Yang Wen Tau Yih Xiaodong He Jianfeng Gao and Li Deng. 2015. Embedding entities and relations for learning and inference in knowledge bases. arxiv:cs.CL\/1412.6575 (2015)."},{"key":"e_1_3_2_50_2","unstructured":"Liang Yao Chengsheng Mao and Yuan Luo. 2019. KG-BERT: BERT for knowledge graph completion.. arxiv:cs.CL\/1909.03193 (2019)."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d15-1027"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.bionlp-1.7"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2021.103696"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102324"},{"key":"e_1_3_2_55_2","unstructured":"Qihuang Zhong Liang Ding Juhua Liu Bo Du and Dacheng Tao. 2023. Can ChatGPT understand too? A comparative study on ChatGPT and fine-tuned BERT. arxiv:cs.CL\/2302.10198 (2023)."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2022.107220"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bth060"}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3657305","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3657305","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:39Z","timestamp":1750295859000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3657305"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,17]]},"references-count":56,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3657305"],"URL":"https:\/\/doi.org\/10.1145\/3657305","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,17]]},"assertion":[{"value":"2023-12-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}