{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T00:18:21Z","timestamp":1783383501058,"version":"3.54.6"},"publisher-location":"Cham","reference-count":49,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032295316","type":"print"},{"value":"9783032295323","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T00:00:00Z","timestamp":1783123200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T00:00:00Z","timestamp":1783123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2027]]},"DOI":"10.1007\/978-3-032-29532-3_12","type":"book-chapter","created":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T08:40:24Z","timestamp":1783068024000},"page":"154-168","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Zoom In Disparities in\u00a0Healthcare LLM Q&A"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5037-2203","authenticated-orcid":false,"given":"Ipek Baris","family":"Schlicht","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6804-127X","authenticated-orcid":false,"given":"Burcu","family":"Sayin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3060-269X","authenticated-orcid":false,"given":"Zhixue","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frederik M.","family":"Labont\u00e9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5568-6166","authenticated-orcid":false,"given":"Cesare","family":"Barbera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2274-9050","authenticated-orcid":false,"given":"Marco","family":"Viviani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8922-1242","authenticated-orcid":false,"given":"Paolo","family":"Rosso","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5995-8454","authenticated-orcid":false,"given":"Lucie","family":"Flek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,4]]},"reference":[{"key":"12_CR1","unstructured":"Abacha, A.B., Agichtein, E., Pinter, Y., Demner-Fushman, D.: Overview of the medical question answering task at TREC 2017 liveqa. In: TREC. NIST Special Publication, vol. 500-324. NIST (2017)"},{"key":"12_CR2","unstructured":"Abacha, A.B., Mrabet, Y., Sharp, M., Goodwin, T.R., Shooshan, S.E., Demner-Fushman, D.: Bridging the gap between consumers\u2019 medication questions and trusted answers. In: MedInfo. Studies in Health Technology and Informatics, vol. 264, pp. 25\u201329. IOS Press (2019)"},{"key":"12_CR3","unstructured":"Achiam, J., et al.: Gpt-4 technical report (2023). arXiv:2303.08774"},{"key":"12_CR4","unstructured":"Agarwal, V., Jin, Y., Chandra, M., De Choudhury, M., Kumar, S., Sastry, N.: Medhalu: hallucinations in responses to healthcare queries by large language models (2024). arXiv:2409.19492"},{"key":"12_CR5","doi-asserted-by":"publisher","unstructured":"Conneau, A., et al.: Unsupervised cross-lingual representation learning at scale. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 8440\u20138451. Association for Computational Linguistics, Online (2020). https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.747, https:\/\/aclanthology.org\/2020.acl-main.747\/","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"12_CR6","unstructured":"Dang, J., et al.: Aya expanse: combining research breakthroughs for a new multilingual frontier (2024). arXiv:2412.04261"},{"issue":"1","key":"12_CR7","doi-asserted-by":"publisher","DOI":"10.2196\/ijmr.6732","volume":"6","author":"M Davaris","year":"2017","unstructured":"Davaris, M., Barnett, S., Abouassaly, R., Lawrentschuk, N., et al.: Thoracic surgery information on the internet: a multilingual quality assessment. Interact J. Med. Res. 6(1), e6732 (2017)","journal-title":"Interact J. Med. Res."},{"key":"12_CR8","doi-asserted-by":"crossref","unstructured":"Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: ACL, pp. 4171\u20134186. ACL, Minneapolis, Minnesota (2019)","DOI":"10.18653\/v1\/N19-1423"},{"key":"12_CR9","unstructured":"Dubey, A., et al.: The llama 3 herd of models (2024). arXiv:2407.21783"},{"key":"12_CR10","doi-asserted-by":"publisher","unstructured":"Es, S., James, J., Espinosa Anke, L., Schockaert, S.: RAGAs: automated evaluation of retrieval augmented generation. In: EACL: System Demonstrations, pp. 150\u2013158. St. Julians, Malta (2024). https:\/\/doi.org\/10.18653\/v1\/2024.eacl-demo.16","DOI":"10.18653\/v1\/2024.eacl-demo.16"},{"issue":"4","key":"12_CR11","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1111\/j.1744-6570.2004.014_24.x","volume":"57","author":"JM Ford","year":"2004","unstructured":"Ford, J.M.: Content analysis: an introduction to its methodology. Pers. Psychol. 57(4), 1110 (2004)","journal-title":"Pers. Psychol."},{"key":"12_CR12","unstructured":"Grattafiori, A., et al.: The Llama 3 Herd of Models (2024). arXiv:2407.21783"},{"key":"12_CR13","doi-asserted-by":"publisher","unstructured":"Gu, J., et al.: A survey on LLM-as-a-judge. The. Innovation (2026). https:\/\/doi.org\/10.1016\/j.xinn.2025.101253","DOI":"10.1016\/j.xinn.2025.101253"},{"issue":"8081","key":"12_CR14","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1038\/s41586-025-09422-z","volume":"645","author":"D Guo","year":"2025","unstructured":"Guo, D., et al.: Deepseek-r1 incentivizes reasoning in LLMs through reinforcement learning. Nature 645(8081), 633\u2013638 (2025)","journal-title":"Nature"},{"key":"12_CR15","doi-asserted-by":"crossref","unstructured":"Gupta, A., Mehta, M., Xu, Z., Srikumar, V.: Found in translation: measuring multilingual LLM consistency as simple as translate then evaluate (2025). arXiv:2505.21999","DOI":"10.18653\/v1\/2025.ijcnlp-long.185"},{"key":"12_CR16","unstructured":"Hurst, A., et al.: GPT-4o System Card (2024). arXiv:2410.21276"},{"key":"12_CR17","doi-asserted-by":"crossref","unstructured":"Jin, Y., Chandra, M., Verma, G., Hu, Y., De Choudhury, M., Kumar, S.: Better to ask in English: cross-lingual evaluation of large language models for healthcare queries. In: The Web Conference, pp. 2627\u20132638. ACM, New York, NY, USA (2024)","DOI":"10.1145\/3589334.3645643"},{"key":"12_CR18","doi-asserted-by":"crossref","unstructured":"Kaur, N., Choudhury, M., Pruthi, D.: Evaluating large language models for health-related queries with presuppositions. In: Findings of the ACL, pp. 14308\u201314331. ACL, Bangkok, Thailand (2024)","DOI":"10.18653\/v1\/2024.findings-acl.850"},{"key":"12_CR19","unstructured":"Kim, Y., et al.: Medical hallucinations in foundation models and their impact on healthcare (2025). arXiv:2503.05777"},{"key":"12_CR20","doi-asserted-by":"crossref","unstructured":"Koopman, B., Zuccon, G.: Dr ChatGPT tell me what I want to hear: how different prompts impact health answer correctness. In: EMNLP, pp. 15012\u201315022. ACL, Singapore (2023)","DOI":"10.18653\/v1\/2023.emnlp-main.928"},{"key":"12_CR21","unstructured":"Kwon, W., et al.: Efficient memory management for large language model serving with pagedattention. In: ACM SIGOPS (2023)"},{"key":"12_CR22","unstructured":"Lawrentschuk, N., Abouassaly, R., Hewitt, E., Mulcahy, A., Bolton, D., Jobling, T.: Health information quality on the internet in gynecological oncology: a multilingual evaluation. Eur. J. Gynaecol. Oncol. 37(4) (2016)"},{"key":"12_CR23","unstructured":"Lewis, P., et al.: Retrieval-augmented generation for knowledge-intensive NLP tasks. In: NIPS. NIPS \u201920, Curran Associates Inc., Red Hook, NY, USA (2020)"},{"key":"12_CR24","unstructured":"Liu, Y., et al.: Roberta: a robustly optimized Bert pretraining approach (2019). arXiv:1907.11692"},{"key":"12_CR25","unstructured":"L\u00f9, X.H.: Bm25s: orders of magnitude faster lexical search via eager sparse scoring (2024). arXiv:2407.03618"},{"key":"12_CR26","unstructured":"Nigatu, H.H., Abdelkadir, N.A., Tewelde, F., Chancellor, S., Wilkinson, D.: Into the void: understanding online health information in low-web data languages (2025). arXiv:2509.20245"},{"key":"12_CR27","unstructured":"OpenAI: Introducing gpt-5 (2025). https:\/\/openai.com\/index\/introducing-gpt-5\/. Accessed 29 Sept 2025"},{"key":"12_CR28","doi-asserted-by":"crossref","unstructured":"Park, C.Y., Yan, X., Field, A., Tsvetkov, Y.: Multilingual contextual affective analysis of LGBT people portrayals in Wikipedia. In: ICWSM vol. 15, pp. 479\u2013490 (2021)","DOI":"10.1609\/icwsm.v15i1.18077"},{"key":"12_CR29","doi-asserted-by":"crossref","unstructured":"Ranathunga, S., de Silva, N.: Some languages are more equal than others: probing deeper into the linguistic disparity in the NLP world. In: AACL-IJCNLP (Volume 1: Long Papers), pp. 823\u2013848. ACL, Online (2022)","DOI":"10.18653\/v1\/2022.aacl-main.62"},{"key":"12_CR30","doi-asserted-by":"crossref","unstructured":"Restrepo, D., et al.: Multi-ophthalingua: a multilingual benchmark for assessing and debiasing LLM ophthalmological QA in LMICS. In: AAAI vo. 39, pp. 28321\u201328330 (2025)","DOI":"10.1609\/aaai.v39i27.35053"},{"key":"12_CR31","doi-asserted-by":"crossref","unstructured":"Ross, A., Willson, V.L.: Paired samples t-test. In: Basic and Advanced Statistical Tests: Writing Results Sections and Creating Tables and Figures, pp. 17\u201319. Springer (2017)","DOI":"10.1007\/978-94-6351-086-8_4"},{"key":"12_CR32","doi-asserted-by":"crossref","unstructured":"Samir, F., Park, C.Y., Field, A., Shwartz, V., Tsvetkov, Y.: Locating information gaps and narrative inconsistencies across languages: a case study of LGBT people portrayals on Wikipedia. In: EMNLP 2024, pp. 6747\u20136762. ACL, Miami, Florida, USA (2024)","DOI":"10.18653\/v1\/2024.emnlp-main.384"},{"key":"12_CR33","unstructured":"Sayin, B., Minervini, P., Staiano, J., Passerini, A.: Can LLMs correct physicians, yet? investigating effective interaction methods in the medical domain. In: The 6th Clinical NLP, pp. 218\u2013237. ACL, Mexico City, Mexico (2024)"},{"issue":"3","key":"12_CR34","first-page":"2009","volume":"15","author":"IB Schlicht","year":"2024","unstructured":"Schlicht, I.B., Fernandez, E., Chulvi, B., Rosso, P.: Automatic detection of health misinformation: a systematic review. J. AIHC 15(3), 2009\u20132021 (2024)","journal-title":"J. AIHC"},{"key":"12_CR35","doi-asserted-by":"crossref","unstructured":"Schlicht, I.B., Zhao, Z., Sayin, B., Flek, L., Rosso, P.: Do LLMs provide consistent answers to health-related questions across languages? In: ECIR, pp. 314\u2013322. Springer Nature Switzerland (2025)","DOI":"10.1007\/978-3-031-88714-7_30"},{"issue":"7972","key":"12_CR36","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","volume":"620","author":"K Singhal","year":"2023","unstructured":"Singhal, K., et al.: Large language models encode clinical knowledge. Nature 620(7972), 172\u2013180 (2023)","journal-title":"Nature"},{"key":"12_CR37","doi-asserted-by":"crossref","unstructured":"Tierney, A.A., Reed, M.E., Grant, R.W., Doo, F.X., Pay\u00e1n, D.D., Liu, V.X.: Health Equity in the era of large language? models. Am. J. Managed Care 31(3) (2025)","DOI":"10.37765\/ajmc.2025.89695"},{"key":"12_CR38","unstructured":"Wang, Z., Zhang, Y., Yoon, D., Vincent, N., Samir, F., Shwartz, V.: Wikigap: promoting epistemic equity by surfacing knowledge gaps between English wikipedia and other language editions (2025). arXiv:2505.24195"},{"issue":"8","key":"12_CR39","doi-asserted-by":"publisher","first-page":"1482","DOI":"10.1038\/sj.bjc.6602168","volume":"91","author":"C Weissenberger","year":"2004","unstructured":"Weissenberger, C., et al.: Breast cancer: patient information needs reflected in English and German web sites. British J. of Cancer 91(8), 1482\u20131487 (2004)","journal-title":"British J. of Cancer"},{"issue":"558","key":"12_CR40","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1126\/science.22.558.309","volume":"22","author":"C Wissler","year":"1905","unstructured":"Wissler, C.: The spearman correlation formula. Science 22(558), 309\u2013311 (1905)","journal-title":"Science"},{"key":"12_CR41","doi-asserted-by":"crossref","unstructured":"Wolf, T., et al.: Transformers: state-of-the-art natural language processing. In: EMNLP (Demos), pp. 38\u201345. ACL (2020)","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"12_CR42","unstructured":"Xu, F., Li, J.J., Choi, E.: How do we answer complex questions: discourse structure of long-form answers. In: ACL (Volume 1: Long Papers), pp. 3556\u20133572. Dublin, Ireland (2022)"},{"key":"12_CR43","unstructured":"Yagnik, N., Jhaveri, J., Sharma, V., Pila, G.: Medlm: exploring language models for medical question answering systems (2024). arXiv:2401.11389"},{"key":"12_CR44","unstructured":"Yang, A., et al.: Qwen3 technical report. arXiv:2505.09388 (2025)"},{"key":"12_CR45","doi-asserted-by":"publisher","DOI":"10.1075\/dt.25015.yan","author":"T Yang","year":"2025","unstructured":"Yang, T., Valdez, S.: How machine translation is used in healthcare. Digit. Transl. (2025). https:\/\/doi.org\/10.1075\/dt.25015.yan","journal-title":"Digit. Transl."},{"key":"12_CR46","doi-asserted-by":"crossref","unstructured":"Yu, H., Yu, C., Wang, Z., Zou, D., Qin, H.: Enhancing healthcare through large language models: a study on medical question answering. In: ICPICS, pp. 895\u2013900. IEEE (2024)","DOI":"10.1109\/ICPICS62053.2024.10797141"},{"key":"12_CR47","doi-asserted-by":"crossref","unstructured":"Zha, Y., Yang, Y., Li, R., Hu, Z.: AlignScore: evaluating factual consistency with a unified alignment function. In: ACL, pp. 11328\u201311348. ACL, Toronto, Canada (2023)","DOI":"10.18653\/v1\/2023.acl-long.634"},{"key":"12_CR48","unstructured":"Zhang, Y., et al.: Siren\u2019s song in the AI ocean: a survey on hallucination in large language models. Comput. Linguistics, 1\u201346 (2025)"},{"key":"12_CR49","doi-asserted-by":"crossref","unstructured":"Zhu, M., Ahuja, A., Wei, W., Reddy, C.K.: A hierarchical attention retrieval model for healthcare question answering. In: WWW, pp. 2472\u20132482. ACM (2019)","DOI":"10.1145\/3308558.3313699"}],"container-title":["Lecture Notes in Computer Science","Natural Language Processing and Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-29532-3_12","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T00:07:28Z","timestamp":1783382848000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-29532-3_12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,4]]},"ISBN":["9783032295316","9783032295323"],"references-count":49,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-29532-3_12","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,4]]},"assertion":[{"value":"4 July 2026","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"All analyses used publicly available Wikipedia data. Therefore, no private, sensitive, or personally identifiable health information was accessed or processed. All evaluations were performed solely for research purposes, and none of the LLMs analyzed should be solely used to provide a medical device. We acknowledge that the disparities observed across languages and Wikipedia may reflect broader inequities in global health communication and data representation. Through this analysis, we aim to promote more equitable and fair multilingual health-care applications.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Statement"}},{"value":"NLDB","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Applications of Natural Language to Information Systems","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Trondheim","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Norway","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2026","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"17 June 2026","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19 June 2026","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"31","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"nldb2026","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/www.ntnu.edu\/nldb2026","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}