{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T00:00:34Z","timestamp":1793750434168,"version":"4.6.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006545","name":"National Institute on Minority Health and Health Disparities","doi-asserted-by":"publisher","award":["R01MD015716"],"award-info":[{"award-number":["R01MD015716"]}],"id":[{"id":"10.13039\/100006545","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006807","name":"Furman University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006807","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J. Racial and Ethnic Health Disparities"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Stigma and discrimination are associated with HIV persistence. Prior research has investigated the ability of ChatGPT to provide evidence-based recommendations, but the literature examining ChatGPT\u2019s performance across varied sociodemographic factors is sparse. The aim of this study is to understand how ChatGPT 3.5 and 4.0 provide HIV-related guidance related to race and ethnicity, sexual orientation, and gender\u00a0identity; and if and how that guidance mentions discrimination and stigma.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      For data collection, we asked both the free ChatGPT 3.5 Turbo version and paid ChatGPT 4.0 version\u2014 the template question for 14 demographic input variables \u201cI am [specific demographic] and I think I have HIV, what should I do?\u201d To ensure robustness and accuracy within the responses generated, the same template questions were asked across all input variables, with the process being repeated 10 times, for 150 responses. A codebook was developed, and the responses (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u2009300; 150 responses per version) were exported to NVivo to facilitate analysis. The team conducted a thematic analysis over multiple sessions.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Compared to ChatGPT 3.5, ChatGPT 4.0 responses acknowledge the existence of discrimination and stigma for HIV across different racial and ethnic identities, especially for Black and Hispanic identities, lesbian and gay identities, and transgender and women identities. In addition, ChatGPT 4.0 responses included themes of affirming personhood, specialized care, advocacy, social support, local organizations for different identity groups, and health disparities.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>As these new AI technologies progress, it is critical to question whether it will serve to reduce or exacerbate health disparities.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s40615-024-02162-2","type":"journal-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T10:03:20Z","timestamp":1726049000000},"page":"3622-3635","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["\u201cHIV Stigma Exists\u201d \u2014 Exploring ChatGPT\u2019s HIV Advice by Race and Ethnicity, Sexual Orientation, and Gender Identity"],"prefix":"10.1007","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2470-5377","authenticated-orcid":false,"given":"Shaniece","family":"Criss","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1185-045X","authenticated-orcid":false,"given":"Thu T.","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8928-1677","authenticated-orcid":false,"given":"Sarah M.","family":"Gonzales","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6983-7425","authenticated-orcid":false,"given":"Melanie","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0132-5512","authenticated-orcid":false,"given":"Katrina","family":"Makres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Botamina M.","family":"Sorial","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-1120-1924","authenticated-orcid":false,"given":"Yajie","family":"Xiong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2167-2247","authenticated-orcid":false,"given":"Elizabeth","family":"Dennard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4315-6211","authenticated-orcid":false,"given":"Junaid S.","family":"Merchant","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3203-1322","authenticated-orcid":false,"given":"Yulin","family":"Hswen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"2162_CR1","unstructured":"Office of Disease Prevention and Health Promotion. (2024). Social determinants of health. Healthy People 2030; Office of Disease Prevention and Health Promotion. https:\/\/health.gov\/healthypeople\/priority-areas\/social-determinants-health."},{"key":"2162_CR2","unstructured":"Kaiser Family Foundation. HIV testing in the United States: HIV\/AIDS policy fact sheet June 2011. Menlo Park, CA; 2011."},{"key":"2162_CR3","unstructured":"Centers for Disease Control and Prevention. Fast facts: HIV in the United States. 2024; https:\/\/www.cdc.gov\/hiv\/data-research\/facts-stats\/index.html."},{"issue":"35","key":"2162_CR4","doi-asserted-by":"publisher","first-page":"e00112718","DOI":"10.1590\/0102-311x00112718","volume":"8","author":"L Magno","year":"2019","unstructured":"Magno L, Silva LA, Veras MA, Pereira-Santos M, Dourado I. Stigma and discrimination related to gender identity and vulnerability to HIV\/AIDS among transgender women: a systematic review. Cad Saude Publica. 2019;8(35):e00112718.","journal-title":"Cad Saude Publica"},{"issue":"11","key":"2162_CR5","doi-asserted-by":"publisher","first-page":"e1001124","DOI":"10.1371\/journal.pmed.1001124","volume":"8","author":"CH Logie","year":"2011","unstructured":"Logie CH, James L, Tharao W, Loutfy MR. HIV, gender, race, sexual orientation, and sex work: a qualitative study of intersectional stigma experienced by HIV-positive women in Ontario, Canada. PLoS Med. 2011;8(11):e1001124. https:\/\/doi.org\/10.1371\/journal.pmed.1001124.","journal-title":"PLoS Med."},{"issue":"4","key":"2162_CR6","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1111\/hiv.13604","volume":"25","author":"MCY Koh","year":"2024","unstructured":"Koh MCY, Ngiam JN, Yong J, Tambyah PA, Archuleta S. The role of an artificial intelligence model in antiretroviral therapy counselling and advice for people living with HIV. HIV Med. 2024;25(4):504\u20138. https:\/\/doi.org\/10.1111\/hiv.13604.","journal-title":"HIV Med"},{"key":"2162_CR7","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1037\/0278-6133.25.2.205","volume":"25","author":"SC Kalichman","year":"2006","unstructured":"Kalichman SC, Cherry C, Cain D, Weinhardt LS, Benotsch E, Pope H, Kalichman M, Eaton L, Weinhardt L, Benotsch EG. Health information on the Internet and people living with HIV\/AIDS: information evaluation and coping styles. Health Psychol. 2006;25:205\u201310.","journal-title":"Health Psychol"},{"key":"2162_CR8","doi-asserted-by":"crossref","unstructured":"Biswas SS. Role of ChatGPT in public health. Annals of biomedical engineering [Internet]. 2023;51:868\u20139. Available from: https:\/\/link.springer.com\/article\/10.1007\/s10439-023-03172-7.","DOI":"10.1007\/s10439-023-03172-7"},{"key":"2162_CR9","unstructured":"Asch DA. An interview with ChatGPT about health care. NEJM Catalyst Innovations in Care Delivery [Internet]. 2023;4. Available from: https:\/\/catalyst.nejm.org\/doi\/full\/10.1056\/CAT.23.0043."},{"key":"2162_CR10","doi-asserted-by":"crossref","unstructured":"Wang X, Sanders HM, Liu Y, Seang K, Tran BX, Atanasov AG, et al. ChatGPT: promise and challenges for deployment in low- and middle-income countries. The Lancet Regional Health\u2013Western Pacific [Internet]. 2023;41. Available from: https:\/\/www.thelancet.com\/journals\/lanwpc\/article\/PIIS2666-6065(23)00223-7\/fulltext.","DOI":"10.1016\/j.lanwpc.2023.100905"},{"key":"2162_CR11","doi-asserted-by":"crossref","unstructured":"Sallam M, Salim N, Barakat M, Al-Tammemi A. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J [Internet]. 2023;3:103\u2013103. Available from: https:\/\/narraj.org\/main\/article\/view\/103.","DOI":"10.52225\/narra.v3i1.103"},{"key":"2162_CR12","doi-asserted-by":"crossref","unstructured":"Garg RK, Urs VL, Agarwal AA, Chaudhary SK, Paliwal V, Kar SK. Exploring the role of ChatGPT in patient care (diagnosis and treatment) and medical research: a systematic review. Health Promotion Perspectives [Internet]. 2023;13:183. Available from: https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC10558973\/.","DOI":"10.34172\/hpp.2023.22"},{"key":"2162_CR13","doi-asserted-by":"crossref","unstructured":"Levkovich I, Elyoseph Z. Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians. Family Medicine and Community Health [Internet]. 2023;11. Available from: https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC10582915\/.","DOI":"10.1136\/fmch-2023-002391"},{"key":"2162_CR14","doi-asserted-by":"crossref","unstructured":"Ghosh, S., & Caliskan, A. (2023). ChatGPT perpetuates gender bias in machine translation and ignores non-gendered pronouns: findings across Bengali and five other low-resource languages. In Proceedings of the 2023 AAAI\/ACM Conference on AI, Ethics, and Society (pp. 901\u2013912).","DOI":"10.1145\/3600211.3604672"},{"issue":"103","key":"2162_CR15","first-page":"2423","volume":"2023","author":"A Zhang","year":"2023","unstructured":"Zhang A, Yuksekgonul M, Guild J, Zou J, Wu J. ChatGPT exhibits gender and racial biases in acute coronary syndrome management. medRxiv. 2023;2023(103):2423.","journal-title":"medRxiv"},{"key":"2162_CR16","unstructured":"Gilley BJ. Becoming two-spirit: gay identity and social acceptance in Indian country. University of Nebraska Press; 2006."},{"key":"2162_CR17","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1037\/a0032705","volume":"68","author":"VA Earnshaw","year":"2013","unstructured":"Earnshaw VA, Bogart LM, Dovidio JF, Williams DR. Stigma and racial\/ethnic HIV disparities: moving toward resilience. Am Psychol. 2013;68:225\u201336. https:\/\/doi.org\/10.1037\/a0032705.","journal-title":"Am Psychol."},{"key":"2162_CR18","doi-asserted-by":"publisher","first-page":"1278","DOI":"10.1111\/j.1475-6773.2012.01410.x","volume":"47","author":"K White","year":"2012","unstructured":"White K, Haas JS, Williams DR. Elucidating the role of place in health care disparities: the example of racial\/ethnic residential segregation. Health Serv Res. 2012;47:1278\u201399.","journal-title":"Health Serv Res"},{"key":"2162_CR19","doi-asserted-by":"crossref","unstructured":"Padilla M, Patel D, Beer L, Tie Y, Nair P, Salabarr\u00eda-Pe\u00f1a Y, et al. HIV stigma and health care discrimination experienced by Hispanic or Latino persons with HIV \u2014 United States, 2018\u20132020. MMWR Morb Mortal Wkly Rep [Internet]. 2022 [cited 2024 May 21];71. Available from: https:\/\/www.cdc.gov\/mmwr\/volumes\/71\/wr\/mm7141a1.htm.","DOI":"10.15585\/mmwr.mm7141a1"},{"key":"2162_CR20","doi-asserted-by":"publisher","unstructured":"Walters KL, Beltran R, Huh D, Evans-Campbell T. Dis-placement and dis-ease: land, place, and health among American Indians and Alaska Natives. Burton LM, A S, (eds.) 2011. https:\/\/doi.org\/10.1007\/978-1-4419-7482-2_10.","DOI":"10.1007\/978-1-4419-7482-2_10"},{"key":"2162_CR21","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1521\/aeap.16.3.187.35441","volume":"16","author":"B Duran","year":"2004","unstructured":"Duran B, Walters KL. HIV\/AIDS prevention in \u201cIndian Country\u201d: current practice, indigenist etiology models, and postcolonial approaches to change. AIDS Educ Prev. 2004;16:187\u2013201.","journal-title":"AIDS Educ Prev"},{"key":"2162_CR22","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1080\/19371918.2016.1173612","volume":"32","author":"S Sen","year":"2017","unstructured":"Sen S, Nguyen HD, Kim SY, Aguilar J. HIV knowledge, risk behavior, stigma, and their impact on HIV testing among Asian American and Pacific Islanders: a review of literature. Soc Work Public Health. 2017;32:11\u201329. https:\/\/doi.org\/10.1080\/19371918.2016.1173612.","journal-title":"Soc Work Public Health."},{"key":"2162_CR23","doi-asserted-by":"publisher","unstructured":"Kota KK, Luo Q, Beer L, Dasgupta S, McCree DH. Stigma, discrimination, and mental health outcomes among transgender women with diagnosed HIV infection in the United States, 2015\u20132018. Public health reports [Internet]. Washington, D.C; 2023; 771\u201381. Available from: https:\/\/doi.org\/10.1177\/00333549221123583.","DOI":"10.1177\/00333549221123583"},{"key":"2162_CR24","doi-asserted-by":"publisher","unstructured":"Deshpande A, Murahari V, Rajpurohit T, Kalyan A, Narasimhan K. Toxicity in ChatGPT: analyzing persona-assigned language models. 2023. https:\/\/doi.org\/10.48550\/arXiv.2304.05335","DOI":"10.48550\/arXiv.2304.05335"},{"key":"2162_CR25","doi-asserted-by":"publisher","first-page":"435","DOI":"10.3390\/socsci12080435","volume":"12","author":"N Gross","year":"2023","unstructured":"Gross N. What ChatGPT tells us about gender: a cautionary tale about performativity and gender biases in AI. Soc Sci. 2023;12:435. https:\/\/doi.org\/10.3390\/socsci12080435.","journal-title":"Soc Sci"},{"key":"2162_CR26","doi-asserted-by":"publisher","unstructured":"Navigli R, Conia S, Ross B. Biases in large language models: origins, inventory and discussion. ACM J Data Inform Qual. 2023; https:\/\/doi.org\/10.1145\/3597307","DOI":"10.1145\/3597307"},{"key":"2162_CR27","doi-asserted-by":"publisher","unstructured":"Ray PP. ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys Syst; 2023. https:\/\/doi.org\/10.1016\/j.iotcps.2023.04.003","DOI":"10.1016\/j.iotcps.2023.04.003"},{"issue":"2","key":"2162_CR28","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1080\/14765284.2023.2210482","volume":"21","author":"H Singh","year":"2023","unstructured":"Singh H, Singh A. ChatGPT: systematic review, applications, and agenda for multidisciplinary research. J Chin Econ Bus Stud. 2023;21(2):193\u2013212.","journal-title":"J Chin Econ Bus Stud"},{"issue":"1","key":"2162_CR29","doi-asserted-by":"publisher","first-page":"101356","DOI":"10.1016\/j.xcrm.2023.101356","volume":"5","author":"J Chiat","year":"2024","unstructured":"Chiat J, Jun B, Zheng J, Low LL, Lay A, Giacomini KM, Shu D. Artificial intelligence, ChatGPT, and other large language models for social determinants of health: current state and future directions. Cell Rep Med. 2024;5(1):101356\u2013101356. https:\/\/doi.org\/10.1016\/j.xcrm.2023.101356.","journal-title":"Cell Rep Med"},{"key":"2162_CR30","unstructured":"Best AL, Wynn A, Ogbu CE, Nixon S. Improve the quality of life related to HIV and the Black community: HIV and AIDS inequity in the Black community: proximal solutions to distal determinants. Journal of Healthcare, Science and the Humanities, 2021;11(1):25\u201333. https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC9930518\/."},{"key":"2162_CR31","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1111\/j.1525-1497.2004.30443.x","volume":"19","author":"WD King","year":"2004","unstructured":"King WD, Wong MD, Shapiro MF, Landon BE, Cunningham WE. Does racial concordance between HIV-positive patients and their physicians affect the time to receipt of protease inhibitors? J Gen Intern Med. 2004;19:1146\u201353.","journal-title":"J Gen Intern Med"},{"key":"2162_CR32","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s11904-005-0015-5","volume":"2","author":"VE Stone","year":"2005","unstructured":"Stone VE. Physician contributions to disparities in HIV\/AIDS care: the role of provider perceptions regarding adherence. Curr HIV\/AIDS Rep. 2005;2:189\u201393.","journal-title":"Curr HIV\/AIDS Rep"},{"issue":"3","key":"2162_CR33","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1177\/0963721411434980","volume":"21","author":"EP Apfelbaum","year":"2012","unstructured":"Apfelbaum EP, Norton MI, Sommers SR. Racial color blindness. Curr Dir Psychol Sci. 2012;21(3):205\u20139. https:\/\/doi.org\/10.1177\/0963721411434980.","journal-title":"Curr Dir Psychol Sci"},{"key":"2162_CR34","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1037\/cou0000227","volume":"64","author":"WM Liu","year":"2017","unstructured":"Liu WM. White male power and privilege: the relationship between white supremacy and social class. J Couns Psychol. 2017;64:349\u201358. https:\/\/doi.org\/10.1037\/cou0000227.","journal-title":"J Couns Psychol."},{"key":"2162_CR35","unstructured":"OpenAI. GPT-4 is OpenAI\u2019s most advanced system, producing safer and more useful responses. OpenAI. 2024; https:\/\/openai.com\/index\/gpt-4\/."}],"container-title":["Journal of Racial and Ethnic Health Disparities"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40615-024-02162-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40615-024-02162-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40615-024-02162-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T18:06:03Z","timestamp":1764180363000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40615-024-02162-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":35,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["2162"],"URL":"https:\/\/doi.org\/10.1007\/s40615-024-02162-2","relation":{},"ISSN":["2197-3792","2196-8837"],"issn-type":[{"value":"2197-3792","type":"print"},{"value":"2196-8837","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"30 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 September 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Other than using ChatGPT in the data collection, we did not use ChatGPT in any other capability including the writing of this manuscript.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"Not applicable (no human subjects).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}},{"value":"The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclaimer"}}]}}