{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T17:57:52Z","timestamp":1767117472708,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":114,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,4,25]],"date-time":"2025-04-25T00:00:00Z","timestamp":1745539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,4,26]]},"DOI":"10.1145\/3706598.3713613","type":"proceedings-article","created":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T03:17:03Z","timestamp":1745464623000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Comparative Analysis of Information Gathering by Chatbots, Questionnaires, and Humans in Clinical Pre-Consultation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3692-243X","authenticated-orcid":false,"given":"Brenna","family":"Li","sequence":"first","affiliation":[{"name":"Computer Science, University of Toronto, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0631-4512","authenticated-orcid":false,"given":"Saba","family":"Tauseef","sequence":"additional","affiliation":[{"name":"Independent Researcher, Brampton, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0774-5964","authenticated-orcid":false,"given":"Khai N.","family":"Truong","sequence":"additional","affiliation":[{"name":"Computer Science, University of Toronto, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9986-3345","authenticated-orcid":false,"given":"Alex","family":"Mariakakis","sequence":"additional","affiliation":[{"name":"Computer Science, University of Toronto, Toronto, Ontario, Canada"}]}],"member":"320","published-online":{"date-parts":[[2025,4,25]]},"reference":[{"key":"e_1_3_3_3_2_2","doi-asserted-by":"crossref","unstructured":"Alaa Abd-Alrazaq Zeineb Safi Mohannad Alajlani Jim Warren Mowafa Househ and Kerstin Denecke. 2020. Technical metrics used to evaluate health care chatbots: scoping review. Journal of medical Internet research 22 6 (2020) e18301.","DOI":"10.2196\/18301"},{"key":"e_1_3_3_3_3_2","unstructured":"Bhashithe Abeysinghe and Ruhan Circi. 2024. The Challenges of Evaluating LLM Applications: An Analysis of Automated Human and LLM-Based Approaches. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2406.03339 (2024)."},{"key":"e_1_3_3_3_4_2","doi-asserted-by":"crossref","unstructured":"Farah Ahmad Wendy Lou Yogendra Shakya Liane Ginsburg Peggy\u00a0T Ng Meb Rashid Serban Dinca-Panaitescu Cliff Ledwos and Kwame McKenzie. 2017. Preconsult interactive computer-assisted client assessment survey for common mental disorders in a community health centre: a randomized controlled trial. Canadian Medical Association Open Access Journal 5 1 (2017) E190\u2013E197.","DOI":"10.9778\/cmajo.20160118"},{"key":"e_1_3_3_3_5_2","doi-asserted-by":"crossref","unstructured":"Akke Albada Sandra van Dulmen Margreet\u00a0GEM Ausems and Jozien\u00a0M Bensing. 2012. A pre-visit website with question prompt sheet for counselees facilitates communication in the first consultation for breast cancer genetic counseling: findings from a randomized controlled trial. Genetics in Medicine 14 5 (2012) 535\u2013542.","DOI":"10.1038\/gim.2011.42"},{"key":"e_1_3_3_3_6_2","doi-asserted-by":"crossref","unstructured":"Daniel Angus Bernadette Watson Andrew Smith Cindy Gallois and Janet Wiles. 2012. Visualising conversation structure across time: Insights into effective doctor-patient consultations. PloS one 7 6 (2012) e38014.","DOI":"10.1371\/journal.pone.0038014"},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"crossref","unstructured":"Joshua Au\u00a0Yeung Zeljko Kraljevic Akish Luintel Alfred Balston Esther Idowu Richard\u00a0J Dobson and James\u00a0T Teo. 2023. AI chatbots not yet ready for clinical use. Frontiers in Digital Health 5 (2023) 60.","DOI":"10.3389\/fdgth.2023.1161098"},{"key":"e_1_3_3_3_8_2","first-page":"65","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization, Jade Goldstein, Alon Lavie, Chin-Yew Lin, and Clare Voss (Eds.). Association for Computational Linguistics, Ann Arbor, Michigan, 65\u201372. https:\/\/aclanthology.org\/W05-0909"},{"key":"e_1_3_3_3_9_2","doi-asserted-by":"crossref","unstructured":"Julian Barratt and Nicola Thomas. 2019. Nurse practitioner consultations in primary health care: a case study-based survey of patients\u2019 pre-consultation expectations and post-consultation satisfaction and enablement. Primary health care research & development 20 (2019) e36.","DOI":"10.1017\/S1463423618000415"},{"key":"e_1_3_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376718"},{"key":"e_1_3_3_3_11_2","doi-asserted-by":"crossref","unstructured":"Niv Ben-Shabat Gal Sharvit Ben Meimis Daniel\u00a0Ben Joya Ariel Sloma David Kiderman Aviv Shabat Avishai\u00a0M Tsur Abdulla Watad and Howard Amital. 2022. Assessing data gathering of chatbot based symptom checkers-a clinical vignettes study. International Journal of Medical Informatics 168 (2022) 104897.","DOI":"10.1016\/j.ijmedinf.2022.104897"},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Jozien\u00a0M Bensing William Verheul and AM Van\u00a0Dulmen. 2008. Patient anxiety in the medical encounter: a study of verbal and nonverbal communication in general practice. Health education 108 5 (2008) 373\u2013383.","DOI":"10.1108\/09654280810899993"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"crossref","unstructured":"Parvathy Bowes Fiona Stevenson Sanjiv Ahluwalia and Elizabeth Murray. 2012. \u2018I need her to be a doctor\u2019: patients\u2019 experiences of presenting health information from the internet in GP consultations. British Journal of General Practice 62 604 (2012) e732\u2013e738.","DOI":"10.3399\/bjgp12X658250"},{"key":"e_1_3_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70284-1_30"},{"key":"e_1_3_3_3_15_2","doi-asserted-by":"crossref","unstructured":"Wanling Cai Yucheng Jin and Li Chen. 2022. Task-oriented user evaluation on critiquing-based recommendation chatbots. IEEE Transactions on Human-Machine Systems 52 3 (2022) 354\u2013366.","DOI":"10.1109\/THMS.2021.3131674"},{"key":"e_1_3_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Kevin Campbell Philip Louie Brett Levine and Jeremy Gililland. 2020. Using patient engagement platforms in the postoperative management of patients. Current reviews in musculoskeletal medicine 13 (2020) 479\u2013484.","DOI":"10.1007\/s12178-020-09638-8"},{"key":"e_1_3_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395035.3425319"},{"key":"e_1_3_3_3_18_2","unstructured":"William\u00a0A Challener\u00a0Jr. 1949. The Doctor-Patient Relationship and the Right to Privacy. U. Pitt. L. Rev. 11 (1949) 624."},{"key":"e_1_3_3_3_19_2","doi-asserted-by":"publisher","unstructured":"Ana\u00a0Paula Chaves and Marco\u00a0Aurelio Gerosa. 2021. How Should My Chatbot Interact? A Survey on Social Characteristics in Human\u2013Chatbot Interaction Design. International Journal of Human\u2013Computer Interaction 37 8 (2021) 729\u2013758. 10.1080\/10447318.2020.1841438","DOI":"10.1080\/10447318.2020.1841438"},{"key":"e_1_3_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2912574"},{"key":"e_1_3_3_3_21_2","doi-asserted-by":"crossref","unstructured":"Clint Cuffy Nao Hagiwara Scott Vrana and Bridget\u00a0T McInnes. 2020. Measuring the quality of patient\u2013physician communication. Journal of biomedical informatics 112 (2020) 103589.","DOI":"10.1016\/j.jbi.2020.103589"},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"crossref","unstructured":"Kate Daley Ines Hungerbuehler Kate Cavanagh Helo\u00edsa\u00a0Garcia Claro Paul\u00a0Alan Swinton and Michael Kapps. 2020. Preliminary evaluation of the engagement and effectiveness of a mental health chatbot. Frontiers in digital health 2 (2020) 576361.","DOI":"10.3389\/fdgth.2020.576361"},{"key":"e_1_3_3_3_23_2","doi-asserted-by":"crossref","unstructured":"Rosaline De\u00a0Koning Abdullah Egiz Jay Kotecha Ana\u00a0Catinca Ciuculete Setthasorn Zhi\u00a0Yang Ooi Nourou Dine\u00a0Adeniran Bankole Joshua Erhabor George Higginbotham Mehdi Khan David\u00a0Ulrich Dalle et\u00a0al. 2021. Survey fatigue during the COVID-19 pandemic: an analysis of neurosurgery survey response rates. Frontiers in Surgery 8 (2021) 690680.","DOI":"10.3389\/fsurg.2021.690680"},{"key":"e_1_3_3_3_24_2","doi-asserted-by":"crossref","unstructured":"Kerstin Denecke Alaa Abd-Alrazaq and Mowafa Househ. 2021. Artificial intelligence for chatbots in mental health: opportunities and challenges. Multiple perspectives on artificial intelligence in healthcare: Opportunities and challenges (2021) 115\u2013128.","DOI":"10.1007\/978-3-030-67303-1_10"},{"key":"e_1_3_3_3_25_2","doi-asserted-by":"crossref","unstructured":"Tim Dwyer Graeme Hoit David Burns James Higgins Justin Chang Daniel Whelan Irene Kiroplis and Jaskarndip Chahal. 2023. Use of an artificial intelligence conversational agent (chatbot) for hip arthroscopy patients following surgery. Arthroscopy Sports Medicine and Rehabilitation 5 2 (2023) e495\u2013e505.","DOI":"10.1016\/j.asmr.2023.01.020"},{"key":"e_1_3_3_3_26_2","doi-asserted-by":"crossref","unstructured":"Carlos El-Haddad Iman Hegazi and Wendy Hu. 2020. Understanding patient expectations of health care: a qualitative study. Journal of patient experience 7 6 (2020) 1724\u20131731.","DOI":"10.1177\/2374373520921692"},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"crossref","unstructured":"Ronald\u00a0M Epstein and Richard\u00a0L Street. 2011. The values and value of patient-centered care. 100\u2013103\u00a0pages.","DOI":"10.1370\/afm.1239"},{"key":"e_1_3_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Magda Eriksson-Liebon Susanne Roos and Ingrid Hellstr\u00f6m. 2021. Patients\u2019 expectations and experiences of being involved in their own care in the emergency department: A qualitative interview study. Journal of clinical nursing 30 13-14 (2021) 1942\u20131952.","DOI":"10.1111\/jocn.15746"},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"crossref","unstructured":"Xiangmin Fan Daren Chao Zhan Zhang Dakuo Wang Xiaohua Li and Feng Tian. 2021. Utilization of self-diagnosis health chatbots in real-world settings: case study. Journal of medical Internet research 23 1 (2021) e19928.","DOI":"10.2196\/19928"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"crossref","unstructured":"Caitlin\u00a0M Fausey and Lera Boroditsky. 2010. Subtle linguistic cues influence perceived blame and financial liability. Psychonomic bulletin & review 17 5 (2010) 644\u2013650.","DOI":"10.3758\/PBR.17.5.644"},{"key":"e_1_3_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-29056-5_14"},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3342775.3342784"},{"key":"e_1_3_3_3_33_2","doi-asserted-by":"crossref","unstructured":"Shiphra Ginsburg Glenn Regehr Lorelei Lingard and Kevin\u00a0W Eva. 2015. Reading between the lines: faculty interpretations of narrative evaluation comments. Medical Education 49 3 (2015) 296\u2013306.","DOI":"10.1111\/medu.12637"},{"key":"e_1_3_3_3_34_2","unstructured":"Herbert\u00a0Paul Grice. 1975. Logic and conversation. Syntax and semantics 3 (1975) 43\u201358."},{"key":"e_1_3_3_3_35_2","doi-asserted-by":"crossref","unstructured":"Randall\u00a0W Grout Erika\u00a0R Cheng Matthew\u00a0C Aalsma and Stephen\u00a0M Downs. 2019. Let them speak for themselves: improving adolescent self-report rate on pre-visit screening. Academic pediatrics 19 5 (2019) 581\u2013588.","DOI":"10.1016\/j.acap.2019.04.010"},{"key":"e_1_3_3_3_36_2","doi-asserted-by":"crossref","unstructured":"Benjamin\u00a0M Gyori Charles\u00a0Tapley Hoyt and Albert Steppi. 2022. Gilda: biomedical entity text normalization with machine-learned disambiguation as a service. Bioinformatics Advances 2 1 (2022) vbac034.","DOI":"10.1093\/bioadv\/vbac034"},{"key":"e_1_3_3_3_37_2","doi-asserted-by":"crossref","unstructured":"Steven\u00a0R Hahn David\u00a0S Friedman Harry\u00a0A Quigley Sameer Kotak Elizabeth Kim Meaghan Onofrey Corey Eagan and Jack Mardekian. 2010. Effect of patient-centered communication training on discussion and detection of nonadherence in glaucoma. Ophthalmology 117 7 (2010) 1339\u20131347.","DOI":"10.1016\/j.ophtha.2009.11.026"},{"key":"e_1_3_3_3_38_2","unstructured":"M\u00a0Jawad Hashim. 2017. Patient-centered communication: basic skills. American family physician 95 1 (2017) 29\u201334."},{"key":"e_1_3_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642379"},{"key":"e_1_3_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/DT.2019.8813473"},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196735"},{"key":"e_1_3_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581503"},{"key":"e_1_3_3_3_43_2","first-page":"17","volume-title":"Proceedings of the Student Research Workshop associated with RANLP","author":"Jwalapuram Prathyusha","year":"2017","unstructured":"Prathyusha Jwalapuram. 2017. Evaluating dialogs based on Grice\u2019s maxims. In Proceedings of the Student Research Workshop associated with RANLP. 17\u201324."},{"key":"e_1_3_3_3_44_2","unstructured":"Lianna Karp. 2015. Can empathy be taught? Reflections from a medical student active-listening workshop. Rhode Island medical journal 98 6 (2015)."},{"key":"e_1_3_3_3_45_2","doi-asserted-by":"crossref","unstructured":"Karin Kee Reinie\u00a0G Gerrits Nelleke de Meij Lieke\u00a0HHM Boonen and Paul Willems. 2023. \u2019What you suggest is not what I expected\u2019: How pre-consultation expectations affect shared decision-making in patients with low back pain. Patient education and counseling 106 (2023) 85\u201391.","DOI":"10.1016\/j.pec.2022.10.001"},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640543.3645200"},{"key":"e_1_3_3_3_47_2","unstructured":"Hyuhng\u00a0Joon Kim Youna Kim Cheonbok Park Junyeob Kim Choonghyun Park Kang\u00a0Min Yoo Sang-goo Lee and Taeuk Kim. 2024. Aligning Language Models to Explicitly Handle Ambiguity. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2404.11972 (2024)."},{"key":"e_1_3_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300316"},{"key":"e_1_3_3_3_49_2","doi-asserted-by":"crossref","unstructured":"Zalika Klemenc-Ketis Andrej Kravos Tonka Poplas-Susi\u010d Igor \u0160vab and Janko Kersnik. 2014. New tool for patient evaluation of nurse practitioner in primary care settings. Journal of clinical nursing 23 9-10 (2014) 1323\u20131331.","DOI":"10.1111\/jocn.12377"},{"key":"e_1_3_3_3_50_2","first-page":"552","volume-title":"AMIA Annual Symposium Proceedings","volume":"2019","author":"Kocielnik Rafal","year":"2019","unstructured":"Rafal Kocielnik, Elena Agapie, Alexander Argyle, Dennis\u00a0T Hsieh, Kabir Yadav, Breena Taira, and Gary Hsieh. 2019. HarborBot: a chatbot for social needs screening. In AMIA Annual Symposium Proceedings , Vol.\u00a02019. American Medical Informatics Association, AMIA, 552. https:\/\/pubmed.ncbi.nlm.nih.gov\/32308849\/"},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"crossref","unstructured":"Jon\u00a0A Krosnick and Duane\u00a0F Alwin. 1987. An evaluation of a cognitive theory of response-order effects in survey measurement. Public opinion quarterly 51 2 (1987) 201\u2013219.","DOI":"10.1086\/269029"},{"key":"e_1_3_3_3_52_2","doi-asserted-by":"crossref","unstructured":"Wojciech Kulesza Dariusz Dolinski Avia Huisman and Robert Majewski. 2014. The echo effect: The power of verbal mimicry to influence prosocial behavior. Journal of Language and Social Psychology 33 2 (2014) 183\u2013201.","DOI":"10.1177\/0261927X13506906"},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"crossref","unstructured":"Tiffany\u00a0H Kung Morgan Cheatham Arielle Medenilla Czarina Sillos Lorie De\u00a0Leon Camille Elepa\u00f1o Maria Madriaga Rimel Aggabao Giezel Diaz-Candido James Maningo et\u00a0al. 2023. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS digital health 2 2 (2023) e0000198.","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_3_3_54_2","doi-asserted-by":"crossref","unstructured":"Marta Kutas and Steven\u00a0A Hillyard. 1980. Reading between the lines: Event-related brain potentials during natural sentence processing. Brain and language 11 2 (1980) 354\u2013373.","DOI":"10.1016\/0093-934X(80)90133-9"},{"key":"e_1_3_3_3_55_2","first-page":"100493","volume-title":"Healthcare","author":"Lai Lucinda","year":"2020","unstructured":"Lucinda Lai, Kelley\u00a0A Wittbold, Farah\u00a0Z Dadabhoy, Rintaro Sato, Adam\u00a0B Landman, Lee\u00a0H Schwamm, Shuhan He, Rajesh Patel, Nancy Wei, Gianna Zuccotti, et\u00a0al. 2020. Digital triage: novel strategies for population health management in response to the COVID-19 pandemic. In Healthcare , Vol.\u00a08. Elsevier, 100493."},{"key":"e_1_3_3_3_56_2","doi-asserted-by":"crossref","unstructured":"Forrest Lang Michael\u00a0R Floyd and Kathleen\u00a0L Beine. 2000. Clues to patients\u2019 explanations and concerns about their illnesses: A call for active listening. Archives of family medicine 9 3 (2000) 222.","DOI":"10.1001\/archfami.9.3.222"},{"key":"e_1_3_3_3_57_2","unstructured":"Patrick Lewis Ethan Perez Aleksandra Piktus Fabio Petroni Vladimir Karpukhin Naman Goyal Heinrich K\u00fcttler Mike Lewis Wen-tau Yih Tim Rockt\u00e4schel et\u00a0al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems 33 (2020) 9459\u20139474."},{"key":"e_1_3_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641913"},{"key":"e_1_3_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581014"},{"key":"e_1_3_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613905.3651891"},{"key":"e_1_3_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3571884.3604305"},{"key":"e_1_3_3_3_62_2","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, Barcelona, Spain, 74\u201381. https:\/\/aclanthology.org\/W04-1013"},{"key":"e_1_3_3_3_63_2","doi-asserted-by":"crossref","unstructured":"Riley\u00a0J Lyons Sruthi\u00a0R Arepalli Ollya Fromal Jinho\u00a0D Choi and Nieraj Jain. 2024. Artificial intelligence chatbot performance in triage of ophthalmic conditions. Canadian Journal of Ophthalmology 59 4 (2024) e301\u2013e308.","DOI":"10.1016\/j.jcjo.2023.07.016"},{"key":"e_1_3_3_3_64_2","doi-asserted-by":"crossref","unstructured":"Elizabeth Magnan Melissa Gosdin Daniel Tancredi and Anthony Jerant. 2021. Pilot randomized controlled trial Protocol: Life context-informed pre-visit planning to improve care plans for primary care patients with multiple chronic conditions including diabetes. Journal of Multimorbidity and Comorbidity 11 (2021) 26335565211062387.","DOI":"10.1177\/26335565211062387"},{"key":"e_1_3_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Mason Marks and Claudia\u00a0E Haupt. 2023. AI chatbots health privacy and challenges to HIPAA compliance. Jama (2023).","DOI":"10.1001\/jama.2023.9458"},{"key":"e_1_3_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3323771.3323824"},{"key":"e_1_3_3_3_67_2","doi-asserted-by":"crossref","unstructured":"Jing Miao Charat Thongprayoon Supawadee Suppadungsuk Pajaree Krisanapan Yeshwanter Radhakrishnan and Wisit Cheungpasitporn. 2024. Chain of thought utilization in large language models and application in nephrology. Medicina 60 1 (2024) 148.","DOI":"10.3390\/medicina60010148"},{"key":"e_1_3_3_3_68_2","doi-asserted-by":"crossref","unstructured":"Tala Mirzaei Leila Amini and Pouyan Esmaeilzadeh. 2024. Clinician voices on ethics of LLM integration in healthcare: a thematic analysis of ethical concerns and implications. BMC Medical Informatics and Decision Making 24 1 (2024) 250.","DOI":"10.1186\/s12911-024-02656-3"},{"key":"e_1_3_3_3_69_2","doi-asserted-by":"crossref","unstructured":"Mairead Murphy Chris Salisbury Anne Scott Lucia Sollazzi-Davies and Geoff Wong. 2022. The person-based development and realist evaluation of a pre-consultation form for GP consultations. NIHR Open Research 2 (2022).","DOI":"10.3310\/nihropenres.13249.1"},{"key":"e_1_3_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-6989-5_4"},{"key":"e_1_3_3_3_71_2","doi-asserted-by":"crossref","unstructured":"Krishna\u00a0Kumar Nirala Nikhil\u00a0Kumar Singh and Vinay\u00a0Shivshanker Purani. 2022. A survey on providing customer and public administration based services using AI: chatbot. Multimedia Tools and Applications 81 16 (2022) 22215\u201322246.","DOI":"10.1007\/s11042-021-11458-y"},{"key":"e_1_3_3_3_72_2","doi-asserted-by":"crossref","unstructured":"Ai Nishida and Osamu Ogawa. 2022. The Effect of a Pre-consultation Tablet-Based Questionnaire on Changes in Consultation Time for First-Visit Patients With Diabetes: A Single-Case Design Preliminary Study. Cureus 14 11 (2022).","DOI":"10.7759\/cureus.31624"},{"key":"e_1_3_3_3_73_2","unstructured":"Julian Oates W\u00a0Wayne Weston John Jordan et\u00a0al. 2000. The impact of patient-centered care on outcomes. Fam Pract 49 9 (2000) 796\u2013804."},{"key":"e_1_3_3_3_74_2","unstructured":"Takuma Okuda and Sanae Shoda. 2018. AI-based chatbot service for financial industry. Fujitsu Scientific and Technical Journal 54 2 (2018) 4\u20138."},{"key":"e_1_3_3_3_75_2","doi-asserted-by":"crossref","unstructured":"Vikas\u00a0N O\u2019Reilly-Shah. 2017. Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey. PeerJ 5 (2017) e3785.","DOI":"10.7717\/peerj.3785"},{"key":"e_1_3_3_3_76_2","doi-asserted-by":"crossref","unstructured":"Clifford\u00a0D Packer and Clifford\u00a0D Packer. 2019. Pertinent Positives and Negatives. Presenting Your Case: A Concise Guide for Medical Students (2019) 57\u201371.","DOI":"10.1007\/978-3-030-13792-2_5"},{"key":"e_1_3_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642785"},{"key":"e_1_3_3_3_79_2","doi-asserted-by":"crossref","unstructured":"Kaya\u00a0J Peerdeman Chris Hinnen Liesbeth\u00a0M van Vliet and Andrea\u00a0WM Evers. 2021. Pre-consultation information about one\u2019s physician can affect trust and treatment outcome expectations. Patient Education and Counseling 104 2 (2021) 427\u2013431.","DOI":"10.1016\/j.pec.2020.07.021"},{"key":"e_1_3_3_3_80_2","doi-asserted-by":"crossref","unstructured":"Kay\u00a0T Pham Amir Nabizadeh and Salih Selek. 2022. Artificial intelligence and chatbots in psychiatry. Psychiatric Quarterly 93 1 (2022) 249\u2013253.","DOI":"10.1007\/s11126-022-09973-8"},{"key":"e_1_3_3_3_81_2","doi-asserted-by":"crossref","unstructured":"Stephen\u00a0R Porter Michael\u00a0E Whitcomb and William\u00a0H Weitzer. 2004. Multiple surveys of students and survey fatigue. New directions for institutional research 2004 121 (2004) 63\u201373.","DOI":"10.1002\/ir.101"},{"key":"e_1_3_3_3_82_2","doi-asserted-by":"crossref","unstructured":"Marc Queudot \u00c9ric Charton and Marie-Jean Meurs. 2020. Improving access to justice with legal chatbots. Stats 3 3 (2020) 356\u2013375.","DOI":"10.3390\/stats3030023"},{"key":"e_1_3_3_3_83_2","first-page":"363","volume-title":"International Conference on Applied Technologies","author":"Quiroz\u00a0Martinez Miguel\u00a0Angel","year":"2020","unstructured":"Miguel\u00a0Angel Quiroz\u00a0Martinez, Segundo\u00a0Estuardo Mayorga\u00a0Plua, Monica\u00a0Daniela Gomez\u00a0Rios, Maikel\u00a0Yelandi Leyva\u00a0V\u00e1zquez, and Daniel\u00a0Humberto Plua\u00a0Moran. 2020. Chatbot for Technical Support, Analysis of Critical Success Factors Using Fuzzy Cognitive Maps. In International Conference on Applied Technologies. Springer, 363\u2013375."},{"key":"e_1_3_3_3_84_2","unstructured":"Kathryn Robertson. 2005. Active listening: more than just paying attention. Australian family physician 34 12 (2005)."},{"key":"e_1_3_3_3_85_2","doi-asserted-by":"crossref","unstructured":"Jeffrey\u00a0D Robinson and John Heritage. 2006. Physicians\u2019 opening questions and patients\u2019 satisfaction. Patient education and counseling 60 3 (2006) 279\u2013285.","DOI":"10.1016\/j.pec.2005.11.009"},{"key":"e_1_3_3_3_86_2","doi-asserted-by":"crossref","unstructured":"Ragnhild\u00a0Klingenberg R\u00f8ed Gunn\u00a0Astrid Baugerud Syed\u00a0Zohaib Hassan Saeed\u00a0S Sabet Pegah Salehi Martine\u00a0B Powell Michael\u00a0A Riegler P\u00e5l Halvorsen and Miriam\u00a0S Johnson. 2023. Enhancing questioning skills through child avatar chatbot training with feedback. Frontiers in Psychology 14 (2023).","DOI":"10.3389\/fpsyg.2023.1198235"},{"key":"e_1_3_3_3_87_2","doi-asserted-by":"crossref","unstructured":"Mindy\u00a0K Ross Sarah Friedman Ilana Radparvar and Gery Ryan. 2022. Partnered decision support: Parental perspectives of completing a pre-visit pediatric asthma questionnaire via the patient portal. Pediatric Pulmonology 57 1 (2022) 100\u2013108.","DOI":"10.1002\/ppul.25735"},{"key":"e_1_3_3_3_88_2","doi-asserted-by":"crossref","unstructured":"Debra Roter and Susan Larson. 2002. The Roter interaction analysis system (RIAS): utility and flexibility for analysis of medical interactions. Patient education and counseling 46 4 (2002) 243\u2013251.","DOI":"10.1016\/S0738-3991(02)00012-5"},{"key":"e_1_3_3_3_89_2","doi-asserted-by":"crossref","unstructured":"Ryan\u00a0M Schuetzler G\u00a0Mark Grimes and Justin Scott\u00a0Giboney. 2020. The impact of chatbot conversational skill on engagement and perceived humanness. Journal of Management Information Systems 37 3 (2020) 875\u2013900.","DOI":"10.1080\/07421222.2020.1790204"},{"key":"e_1_3_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-4011"},{"key":"e_1_3_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.eval4nlp-1.3"},{"key":"e_1_3_3_3_92_2","doi-asserted-by":"crossref","unstructured":"Thibault Sellam Dipanjan Das and Ankur\u00a0P Parikh. 2020. BLEURT: Learning robust metrics for text generation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2004.04696 (2020).","DOI":"10.18653\/v1\/2020.acl-main.704"},{"key":"e_1_3_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501972"},{"key":"e_1_3_3_3_94_2","unstructured":"Karan Singhal Shekoofeh Azizi Tao Tu S\u00a0Sara Mahdavi Jason Wei Hyung\u00a0Won Chung Nathan Scales Ajay Tanwani Heather Cole-Lewis Stephen Pfohl et\u00a0al. 2023. Large language models encode clinical knowledge. Nature (2023) 1\u20139."},{"key":"e_1_3_3_3_95_2","unstructured":"Christine\u00a0A Sinsky Thomas\u00a0A Sinsky and Ellie Rajcevich. 2015. Putting pre-visit planning into practice. Family Practice Management 22 6 (2015) 30\u201338."},{"key":"e_1_3_3_3_96_2","doi-asserted-by":"crossref","unstructured":"Trista\u00a0J Stankowski-Drengler Jennifer\u00a0L Tucholka Jordan\u00a0G Bruce Nicole\u00a0M Steffens Jessica\u00a0R Schumacher Caprice\u00a0C Greenberg Lee\u00a0G Wilke Bret Hanlon Jennifer Steiman and Heather\u00a0B Neuman. 2019. A randomized controlled trial evaluating the impact of pre-consultation information on Patients\u2019 perception of information conveyed and satisfaction with the decision-making process. Annals of surgical oncology 26 (2019) 3275\u20133281.","DOI":"10.1245\/s10434-019-07535-0"},{"key":"e_1_3_3_3_97_2","doi-asserted-by":"crossref","unstructured":"Mark Stevenson and Yikun Guo. 2010. Disambiguation in the biomedical domain: the role of ambiguity type. Journal of biomedical informatics 43 6 (2010) 972\u2013981.","DOI":"10.1016\/j.jbi.2010.08.009"},{"key":"e_1_3_3_3_98_2","unstructured":"Moira\u00a0A Stewart. 1995. Effective physician-patient communication and health outcomes: a review. CMAJ: Canadian medical association journal 152 9 (1995) 1423."},{"key":"e_1_3_3_3_99_2","doi-asserted-by":"crossref","unstructured":"Tianjun Sun Alan\u00a0R Dennis Michelle Zhou et\u00a0al. 2024. Perception is reality? Understanding user perceptions of chatbot-inferred versus self-reported personality traits. Computers in Human Behavior: Artificial Humans 2 1 (2024) 100057.","DOI":"10.1016\/j.chbah.2024.100057"},{"key":"e_1_3_3_3_100_2","doi-asserted-by":"crossref","unstructured":"Mariska\u00a0E Te\u00a0Pas Werner\u00a0GMM Rutten R\u00a0Arthur Bouwman and Marc\u00a0P Buise. 2020. User experience of a chatbot questionnaire versus a regular computer questionnaire: prospective comparative study. JMIR Medical Informatics 8 12 (2020) e21982.","DOI":"10.2196\/21982"},{"key":"e_1_3_3_3_101_2","doi-asserted-by":"crossref","unstructured":"Arun\u00a0James Thirunavukarasu Darren Shu\u00a0Jeng Ting Kabilan Elangovan Laura Gutierrez Ting\u00a0Fang Tan and Daniel Shu\u00a0Wei Ting. 2023. Large language models in medicine. Nature medicine 29 8 (2023) 1930\u20131940.","DOI":"10.1038\/s41591-023-02448-8"},{"key":"e_1_3_3_3_102_2","doi-asserted-by":"crossref","unstructured":"Andrew Reyner\u00a0Wibowo Tjiptomongsoguno Audrey Chen Hubert\u00a0Michael Sanyoto Edy Irwansyah and Bayu Kanigoro. 2020. Medical chatbot techniques: a review. Software Engineering Perspectives in Intelligent Systems: Proceedings of 4th Computational Methods in Systems and Software 2020 Vol. 1 4 (2020) 346\u2013356.","DOI":"10.1007\/978-3-030-63322-6_28"},{"key":"e_1_3_3_3_103_2","doi-asserted-by":"crossref","unstructured":"Lidewij\u00a0Eva Vat Mike Warren Susan Goold Everard Davidge Nicole Porter Tjerk\u00a0Jan Schuitmaker-Warnaar Jacqueline\u00a0EW Broerse and Holly Etchegary. 2020. Giving patients a voice: a participatory evaluation of patient engagement in Newfoundland and Labrador Health Research. Research Involvement and Engagement 6 (2020) 1\u201314.","DOI":"10.1186\/s40900-020-00206-5"},{"key":"e_1_3_3_3_104_2","unstructured":"Anu Venkatesh Chandra Khatri Ashwin Ram Fenfei Guo Raefer Gabriel Ashish Nagar Rohit Prasad Ming Cheng Behnam Hedayatnia Angeliki Metallinou et\u00a0al. 2018. On evaluating and comparing open domain dialog systems. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1801.03625 (2018)."},{"key":"e_1_3_3_3_105_2","doi-asserted-by":"crossref","unstructured":"Jonathan\u00a0S Wald Alexandra Businger Tejal\u00a0K Gandhi Richard\u00a0W Grant Eric\u00a0G Poon Jeffrey\u00a0L Schnipper Lynn\u00a0A Volk and Blackford Middleton. 2010. Implementing practice-linked pre-visit electronic journals in primary care: patient and physician use and satisfaction. Journal of the American Medical Informatics Association 17 5 (2010) 502\u2013506.","DOI":"10.1136\/jamia.2009.001362"},{"key":"e_1_3_3_3_106_2","unstructured":"Zihao Wang Anji Liu Haowei Lin Jiaqi Li Xiaojian Ma and Yitao Liang. 2024. Rat: Retrieval augmented thoughts elicit context-aware reasoning in long-horizon generation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2403.05313 (2024)."},{"key":"e_1_3_3_3_107_2","unstructured":"Jing Wei Sungdong Kim Hyunhoon Jung and Young-Ho Kim. 2023. Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data. arxiv:https:\/\/arXiv.org\/abs\/2301.05843\u00a0[cs.HC]"},{"key":"e_1_3_3_3_108_2","doi-asserted-by":"crossref","unstructured":"Lee Wilson and Mariana Marasoiu. 2022. The development and use of chatbots in public health: scoping review. JMIR human factors 9 4 (2022) e35882.","DOI":"10.2196\/35882"},{"key":"e_1_3_3_3_109_2","doi-asserted-by":"crossref","unstructured":"Ziang Xiao Susu Zhang Vivian Lai and Q\u00a0Vera Liao. 2023. Evaluating evaluation metrics: A framework for analyzing NLG evaluation metrics using measurement theory. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.14889 (2023).","DOI":"10.18653\/v1\/2023.emnlp-main.676"},{"key":"e_1_3_3_3_110_2","doi-asserted-by":"publisher","unstructured":"Ziang Xiao Michelle\u00a0X. Zhou Q.\u00a0Vera Liao Gloria Mark Changyan Chi Wenxi Chen and Huahai Yang. 2020. Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions. ACM Trans. Comput.-Hum. Interact. 27 3 Article 15 (jun 2020) 37\u00a0pages. 10.1145\/3381804","DOI":"10.1145\/3381804"},{"key":"e_1_3_3_3_111_2","doi-asserted-by":"crossref","unstructured":"Yi Xie Ishith Seth Warren\u00a0M Rozen and David\u00a0J Hunter-Smith. 2023. Evaluation of the artificial intelligence chatbot on breast reconstruction and its efficacy in surgical research: a case study. Aesthetic Plastic Surgery 47 6 (2023) 2360\u20132369.","DOI":"10.1007\/s00266-023-03443-7"},{"key":"e_1_3_3_3_112_2","doi-asserted-by":"publisher","unstructured":"Yue You Chun-Hua Tsai Yao Li Fenglong Ma Christopher Heron and Xinning Gui. 2023. Beyond Self-diagnosis: How a Chatbot-based Symptom Checker Should Respond. ACM Trans. Comput.-Hum. Interact. 30 4 Article 64 (Sept. 2023) 44\u00a0pages. 10.1145\/3589959","DOI":"10.1145\/3589959"},{"key":"e_1_3_3_3_113_2","doi-asserted-by":"crossref","unstructured":"Claudia Zanini Paolo Maino Jens\u00a0Carsten M\u00f6ller Claudio Gobbi Monika Raimondi and Sara Rubinelli. 2016. Enhancing clinical decisions about care through a pre-consultation sheet that captures patients\u2019 views on their health conditions and treatments: A qualitative study in the field of chronic pain. Patient education and counseling 99 5 (2016) 747\u2013753.","DOI":"10.1016\/j.pec.2015.11.029"},{"key":"e_1_3_3_3_114_2","unstructured":"Yadong Zhang Shaoguang Mao Tao Ge Xun Wang Adrian de Wynter Yan Xia Wenshan Wu Ting Song Man Lan and Furu Wei. 2024. LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2404.01230 (2024)."},{"key":"e_1_3_3_3_115_2","doi-asserted-by":"crossref","unstructured":"Ronggang Zhou Xiaorui Wang Leyuan Zhang and Haiyan Guo. 2017. Who tends to answer open-ended questions in an e-service survey? The contribution of closed-ended answers. Behaviour & Information Technology 36 12 (2017) 1274\u20131284.","DOI":"10.1080\/0144929X.2017.1381165"}],"event":{"name":"CHI 2025: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Yokohama Japan","acronym":"CHI '25"},"container-title":["Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3713613","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706598.3713613","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T04:59:04Z","timestamp":1751605144000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3713613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,25]]},"references-count":114,"alternative-id":["10.1145\/3706598.3713613","10.1145\/3706598"],"URL":"https:\/\/doi.org\/10.1145\/3706598.3713613","relation":{},"subject":[],"published":{"date-parts":[[2025,4,25]]},"assertion":[{"value":"2025-04-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}