{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:05:24Z","timestamp":1750309524934,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,6,11]],"date-time":"2025-06-11T00:00:00Z","timestamp":1749600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,25]]},"DOI":"10.1145\/3713081.3731748","type":"proceedings-article","created":{"date-parts":[[2025,6,6]],"date-time":"2025-06-06T17:20:36Z","timestamp":1749230436000},"page":"174-177","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Best practice for supply chain in LLM-assisted medical applications"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-5035-2206","authenticated-orcid":false,"given":"Shengming","family":"Zhao","sequence":"first","affiliation":[{"name":"University of Alberta, Edmonton, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7367-823X","authenticated-orcid":false,"given":"Jiawei","family":"Wang","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}]}],"member":"320","published-online":{"date-parts":[[2025,6,11]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/jpm14010107"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1227\/neu.0000000000002551"},{"key":"e_1_3_2_1_3_1","unstructured":"Zhijie Bao Wei Chen Shengze Xiao Kuang Ren Jiaao Wu Cheng Zhong Jiajie Peng Xuanjing Huang and Zhongyu Wei. 2023. DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation. arXiv:2308.14346 [cs.CL]"},{"key":"e_1_3_2_1_4_1","volume-title":"Lisa Soleymani Lehmann, et al","author":"Bedi Suhana","year":"2024","unstructured":"Suhana Bedi, Yutong Liu, Lucy Orr-Ewing, Dev Dash, Sanmi Koyejo, Alison Callahan, Jason A Fries, Michael Wornow, Akshay Swaminathan, Lisa Soleymani Lehmann, et al. 2024. Testing and evaluation of health care applications of large language models: a systematic review. JAMA (2024)."},{"key":"e_1_3_2_1_5_1","volume-title":"An extensive benchmark study on biomedical text generation and mining with ChatGPT. Bioinformatics 39, 9","author":"Chen Qijie","year":"2023","unstructured":"Qijie Chen, Haotong Sun, Haoyang Liu, Yinghui Jiang, Ting Ran, Xurui Jin, Xianglu Xiao, Zhimin Lin, Hongming Chen, and Zhangmin Niu. 2023. An extensive benchmark study on biomedical text generation and mining with ChatGPT. Bioinformatics 39, 9 (2023), btad557."},{"key":"e_1_3_2_1_6_1","volume-title":"The potential for artificial intelligence in healthcare. Future healthcare journal 6, 2","author":"Davenport Thomas","year":"2019","unstructured":"Thomas Davenport and Ravi Kalakota. 2019. The potential for artificial intelligence in healthcare. Future healthcare journal 6, 2 (2019), 94\u201398."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Hamish Fraser Daven Crossland Ian Bacher Megan Ranney Tracy Madsen Ross Hilliard et al. 2023. Comparison of diagnostic and triage accuracy of Ada health and WebMD symptom checkers ChatGPT and physicians for patients in an emergency department: clinical data analysis study. JMIR mHealth and uHealth 11 1 (2023) e49995.","DOI":"10.2196\/49995"},{"volume-title":"Artificial intelligence in healthcare","author":"Gerke Sara","key":"e_1_3_2_1_8_1","unstructured":"Sara Gerke, Timo Minssen, and Glenn Cohen. 2020. Ethical and legal challenges of artificial intelligence-driven healthcare. In Artificial intelligence in healthcare. Elsevier, 295\u2013336."},{"key":"e_1_3_2_1_9_1","volume-title":"Eliezer M Van Allen, David Kim, et al.","author":"Johri Shreya","year":"2025","unstructured":"Shreya Johri, Jaehwan Jeong, Benjamin A Tran, Daniel I Schlessinger, Shannon Wongvibulsin, Leandra A Barnes, Hong-Yu Zhou, Zhuo Ran Cai, Eliezer M Van Allen, David Kim, et al. 2025. An evaluation framework for clinical use of large language models in patient interaction tasks. Nature Medicine (2025), 1\u201310."},{"key":"e_1_3_2_1_10_1","first-page":"79410","article-title":"Mdagents: An adaptive collaboration of llms for medical decision-making","volume":"37","author":"Kim Yubin","year":"2024","unstructured":"Yubin Kim, Chanwoo Park, Hyewon Jeong, Yik Siu Chan, Xuhai Xu, Daniel McDuff, Hyeonhoon Lee, Marzyeh Ghassemi, Cynthia Breazeal, Hae Park, et al. 2024. Mdagents: An adaptive collaboration of llms for medical decision-making. Advances in Neural Information Processing Systems 37 (2024), 79410\u201379452.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07618-3"},{"key":"e_1_3_2_1_12_1","volume-title":"BioGPT: generative pre-trained transformer for biomedical text generation and mining. Briefings in bioinformatics 23, 6","author":"Luo Renqian","year":"2022","unstructured":"Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, and Tie-Yan Liu. 2022. BioGPT: generative pre-trained transformer for biomedical text generation and mining. Briefings in bioinformatics 23, 6 (2022), bbac409."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2019.21579"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Xiangbin Meng Xiangyu Yan Kuo Zhang Da Liu Xiaojuan Cui Yaodong Yang Muhan Zhang Chunxia Cao Jingjia Wang Xuliang Wang et al. 2024. The application of large language models in medicine: A scoping review. Iscience 27 5 (2024).","DOI":"10.1016\/j.isci.2024.109713"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae074"},{"key":"e_1_3_2_1_16_1","volume-title":"Holistic Evaluation of Large Language Models for Medical Applications. https:\/\/hai.stanford.edu\/news\/holistic-evaluation-of-large-language-models-for-medical-applications Accessed","author":"Stanford HAI.","year":"2025","unstructured":"Stanford HAI. 2024. Holistic Evaluation of Large Language Models for Medical Applications. https:\/\/hai.stanford.edu\/news\/holistic-evaluation-of-large-language-models-for-medical-applications Accessed: April 07, 2025."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Tao Tu Anil Palepu Mike Schaekermann Khaled Saab Jan Freyberg Ryutaro Tanno Amy Wang Brenna Li Mohamed Amin Nenad Tomasev et al. 2024. Towards conversational diagnostic AI. arXiv preprint arXiv:2401.05654 (2024).","DOI":"10.1038\/s41586-025-08866-7"},{"key":"e_1_3_2_1_18_1","volume-title":"Large language model supply chain: A research agenda. ACM Transactions on Software Engineering and Methodology","author":"Wang Shenao","year":"2024","unstructured":"Shenao Wang, Yanjie Zhao, Xinyi Hou, and Haoyu Wang. 2024. Large language model supply chain: A research agenda. ACM Transactions on Software Engineering and Methodology (2024)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.2196\/49324"},{"key":"e_1_3_2_1_20_1","volume-title":"ProAI: Proactive Multi-Agent Conversational AI with Structured Knowledge Base for Psychiatric Diagnosis. arXiv preprint arXiv:2502.20689","author":"Wu Yuqi","year":"2025","unstructured":"Yuqi Wu, Guangya Wan, Jingjing Li, Shengming Zhao, Lingfeng Ma, Tianyi Ye, Ion Pop, Yanbo Zhang, and Jie Chen. 2025. ProAI: Proactive Multi-Agent Conversational AI with Structured Knowledge Base for Psychiatric Diagnosis. arXiv preprint arXiv:2502.20689 (2025)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.743"},{"key":"e_1_3_2_1_22_1","volume-title":"AI co-pilot bronchoscope robot. Nature communications 15, 1","author":"Zhang Jingyu","year":"2024","unstructured":"Jingyu Zhang, Lilu Liu, Pingyu Xiang, Qin Fang, Xiuping Nie, Honghai Ma, Jian Hu, Rong Xiong, Yue Wang, and Haojian Lu. 2024. AI co-pilot bronchoscope robot. Nature communications 15, 1 (2024), 241."},{"key":"e_1_3_2_1_23_1","unstructured":"Hongjian Zhou Fenglin Liu Boyang Gu Xinyu Zou Jinfa Huang Jinge Wu Yiru Li Sam S Chen Peilin Zhou Junling Liu et al. 2023. A survey of large language models in medicine: Progress application and challenge. arXiv preprint arXiv:2311.05112 (2023)."}],"event":{"name":"ISSTA Companion '25: 34th ACM SIGSOFT International Symposium on Software Testing and Analysis","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"Clarion Hotel Trondheim Trondheim Norway","acronym":"ISSTA Companion '25"},"container-title":["Proceedings of the 34th ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3713081.3731748","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:09Z","timestamp":1750295889000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3713081.3731748"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,11]]},"references-count":23,"alternative-id":["10.1145\/3713081.3731748","10.1145\/3713081"],"URL":"https:\/\/doi.org\/10.1145\/3713081.3731748","relation":{},"subject":[],"published":{"date-parts":[[2025,6,11]]},"assertion":[{"value":"2025-06-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}