{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T22:50:53Z","timestamp":1791586253643,"version":"4.3.4"},"reference-count":28,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Generative artificial intelligence (GAI) chatbots are frequently used for mental health\u2013related questions, including suicide-related queries. User interfaces (UIs) may include additional safety controls not present in direct application programming interface (API) access (eg, moderation rules that flag or block harmful content, crisis refusal templates, or system-level instructions).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This observational cross-sectional study aimed to examine how frequently AI chatbots provide direct responses to suicide-related prompts across access modes and whether response patterns differ between consumer-facing UI and API access across models and prompt risk levels.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We evaluated how five widely used consumer AI models (ChatGPT, Claude, Gemini, Grok, and Llama) responded to 30 previously vetted suicide-related prompts spanning five clinician-assigned risk levels. Each prompt was submitted 100 times through both public-facing UI and direct API access, yielding 30,000 total responses. The primary outcome was whether a response directly answered the prompt (ie, provided specific information or guidance related to the question asked). AI responses were categorized using a blinded large language model\u2013based classifier (GPT-4o mini), validated against independent human coding (289\/300, 96.3% agreement; Cohen \u03ba=0.89). We estimated mixed-effects logistic regression models that predicted a direct response. The primary predictors were the AI model, access mode (UI vs API), and prompt risk category.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Of the 30,000 responses, 69.8% (n=20,934) were direct. Direct responses were more common through APIs than UIs (n=11,609, 77.4%, vs n=9325, 62.2%); however, Gemini had slightly higher direct response rates via UIs than APIs (n=2301, 76.7%, vs n=2131, 71.0%). Differences in the likelihood of a direct response were most pronounced for higher-risk prompts: For very-high-risk prompts, 24.8% (n=743) of API responses were direct compared with 4.6% (n=138) of UI responses, whereas for high-risk prompts, 80.1% (n=2002) of API responses were direct compared with 48.4% (n=1209) of UI responses. Claude and Gemini had the highest direct response rates (n=4688, 78.1%, and n=4432, 73.9%, respectively) across UI and API access modes, whereas ChatGPT, Grok, and Llama had lower rates (n=3878, 64.6%; n=3870, 64.5%; and n=4066, 67.8%, respectively). In mixed-effects models, UI access was associated with lower odds of a direct response than API access (odds ratio 0.09, 95% CI 0.08-0.10). Higher prompt risk was associated with lower direct response probability, and access mode differences varied by risk level and model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>AI safety depends on how users access the model. Safety observed in a UI should not be assumed to generalize to API access or apps built on APIs. Evaluations and policies should consider access modes to ensure safety protections for individuals interacting with AI chatbots.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/97968","type":"journal-article","created":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T19:50:09Z","timestamp":1785441009000},"page":"e97968","source":"Crossref","is-referenced-by-count":0,"title":["Suicide-Related Responses From AI Chatbots Through Application Programming Interfaces and Consumer-Facing Apps: Observational Cross-Sectional Comparative Study"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4468-833X","authenticated-orcid":false,"given":"Jonathan","family":"Cantor","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3155-9455","authenticated-orcid":false,"given":"Ellice","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9468-2513","authenticated-orcid":false,"given":"Li Ang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8035-6968","authenticated-orcid":false,"given":"Adrian","family":"Salas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8282-8738","authenticated-orcid":false,"given":"Fang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0482-729X","authenticated-orcid":false,"given":"Alyssa","family":"Burnett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0767-6623","authenticated-orcid":false,"given":"Andrew","family":"Lohn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1879-7340","authenticated-orcid":false,"given":"Pat","family":"Pataranutaporn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6095-0193","authenticated-orcid":false,"given":"Benjamin","family":"Rader","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6169-4243","authenticated-orcid":false,"given":"Hao","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0073-0348","authenticated-orcid":false,"given":"Ryan K","family":"McBain","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,10,9]]},"reference":[{"key":"ref1","unstructured":"Suicide data and statistics. Suicide preventionCenters for Disease Control and Prevention20252026-02-12https:\/\/www.cdc.gov\/suicide\/facts\/data.html"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/j.genhosppsych.2021.02.001"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.43054"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.41383"},{"key":"ref5","unstructured":"MooreOThe top 100 gen AI consumer apps \u2014 6th editionAndreessen Horowitz20262026-03-14https:\/\/a16z.com\/100-gen-ai-apps-6\/"},{"key":"ref6","unstructured":"AI as a healthcare allyOpenAI20262026-02-12https:\/\/cdn.openai.com\/pdf\/2cb29276-68cd-4ec6-a5f4-c01c5e7a36e9\/OpenAI-AI-as-a-Healthcare-Ally-Jan-2026.pdf"},{"key":"ref7","unstructured":"How people use claude for support, advice, and companionshipAnthropic20252026-03-14https:\/\/www.anthropic.com\/news\/how-people-use-claude-for-support-advice-and-companionship"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1093\/bmb\/ldaf017"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1126\/science.aec8352"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2025.4116"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2026.0032"},{"key":"ref12","unstructured":"Preventing suicide: a resource for media professionals, update 2023World Health Organization20232026-06-04https:\/\/www.who.int\/publications\/i\/item\/9789240076846"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2025.39022"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.2196\/67891"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.20250086"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-025-11389-2"},{"key":"ref17","unstructured":"LipphardtFAliMFeldmannAGosainDDual standards: examining content moderation disparities between API and WebUI interfaces in large language modelsFree and Open Communications on the Internet20262026-03-18https:\/\/petsymposium.org\/foci\/2026\/foci-2026-0004.php"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-54975-5_10"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.34190\/ecgbl.18.1.3104"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1007\/978-3-031-70245-7_10","author":"Garc\u00eda, B","year":"2024","journal-title":"Quality of Information and Communications Technology"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1002\/jcpy.1393"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2507.19672"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-02333-3"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.2196\/69534"},{"key":"ref25","unstructured":"xai-org\/grok-promptsGitHub20262026-03-22https:\/\/github.com\/xai-org\/grok-prompts"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1109\/access.2024.3482107"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2509.10655"},{"key":"ref28","unstructured":"HuangERANDCorporation\/mh-llm-eval-publicGitHub20262026-07-28https:\/\/github.com\/RANDCorporation\/mh-llm-eval-public"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2026\/1\/e97968","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T22:15:08Z","timestamp":1791584108000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e97968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,9]]},"references-count":28,"URL":"https:\/\/doi.org\/10.2196\/97968","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.97968","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,9]]}}}