{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:54:12Z","timestamp":1776084852880,"version":"3.50.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE2140739"],"award-info":[{"award-number":["DGE2140739"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006374","name":"Centers for Disease Control and Prevention","doi-asserted-by":"publisher","award":["1NU17CE924973"],"award-info":[{"award-number":["1NU17CE924973"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>Drug overdose deaths, including those due to prescription opioids, represent a critical public health issue in the United States and worldwide. Artificial intelligence (AI) approaches have been developed and deployed to help prescribers assess a patient's risk for overdose-related death, but it is unknown whether public health experts can leverage similar predictions to make local resource allocation decisions more effectively. In this work, we evaluated how AI-based overdose risk assessment could be used to inform local public health decisions using a working prototype system. Experts from three health departments, of varying locations and sizes with respect to staff and population served, were receptive to the potential benefits of algorithmic risk prediction and of using AI-augmented visualization to connect across data sources. However, they also expressed concerns about whether the risk prediction model's formulation and underlying data would match the state of the overdose epidemic as it evolved in their specific locations. Our findings extend those of other studies on algorithmic systems in the public sector, and they present opportunities for future human-AI collaborative tools to support decision-making in local, time-varying contexts.<\/jats:p>","DOI":"10.1145\/3711072","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T11:36:19Z","timestamp":1747740979000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Static Algorithm, Evolving Epidemic: Understanding the Potential of Human-AI Risk Assessment to Support Regional Overdose Prevention"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6965-3961","authenticated-orcid":false,"given":"Venkatesh","family":"Sivaraman","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4582-8938","authenticated-orcid":false,"given":"Yejun","family":"Kwak","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9137-0928","authenticated-orcid":false,"suffix":"PhD, MPH","given":"Courtney","family":"Kuza","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7125-9867","authenticated-orcid":false,"given":"Qingnan","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6695-4059","authenticated-orcid":false,"given":"Kayleigh","family":"Adamson","sequence":"additional","affiliation":[{"name":"Univeristy of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8977-1850","authenticated-orcid":false,"given":"Katie","family":"Suda","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6143-9314","authenticated-orcid":false,"given":"Lu","family":"Tang","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6992-5197","authenticated-orcid":false,"given":"Walid","family":"Gellad","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8369-3847","authenticated-orcid":false,"given":"Adam","family":"Perer","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Brandon Adkins B. Levi Bolin William Bundy Louis Canales Jenna Curammeng Eric Dawson Monica Fileger Steve Gorelik Joy Griffin Angela G. Huskey Kelly Olson Steven D. Passik Fabi Selvaraj Ian Smith Javier Velasco and Penn Whitley. 2024. The \u201dFourth Wave\u201d: The Rise of Stimulants and the evolution of Polysubstance Use in America's Fentanyl Crisis. Technical Report. Millennium Health. 1--17 pages. https:\/\/resource.millenniumhealth.com\/signalsreportvol6"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1526--4637.2011.01128.xnolinkurl10.1111\/j.1526--4637.2011.01128.x"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300760"},{"key":"e_1_2_1_4_1","unstructured":"Allegheny County Rhema Vaithianathan Nan Jiang Tim Maloney Parma Nand Emily Putnam-Hornstein Tim Dare and Eileen Gambrill. 2019. Developing predictive risk models to support child maltreatment hotline screening decisions. (2019)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0157734nolinkurl10.1371\/journal.pone.0157734"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000016nolinkurl10.1371\/journal.pdig.0000016"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449114nolinkurl10.1145\/3449114"},{"key":"e_1_2_1_8_1","volume-title":"Machine Bias: There's software used across the country to predict future criminals. And it's biased against blacks. Technical Report.","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias: There's software used across the country to predict future criminals. And it's biased against blacks. Technical Report."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2022.104051nolinkurl10.1016\/j.jbi.2022.104051"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702328"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376718nolinkurl10.1145\/3313831.3376718"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/296165.296174nolinkurl10.1145\/296165.296174"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2017.05.023nolinkurl10.1016\/j.drugalcdep.2017.05.023"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-publhealth-040617-014746nolinkurl10.1146\/annurev-publhealth-040617-014746"},{"key":"e_1_2_1_15_1","volume-title":"Sketching User Experiences: Getting the Design Right and the Right Design","author":"Buxton Bill","unstructured":"Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359206nolinkurl10.1145\/3359206"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2014.04.006nolinkurl10.1016\/j.jbi.2014.04.006"},{"key":"e_1_2_1_18_1","volume-title":"Drug Overdose Deaths Remained High","author":"Centers for Disease Control and Prevention. 2023.","year":"2021","unstructured":"Centers for Disease Control and Prevention. 2023. Drug Overdose Deaths Remained High in 2021. https:\/\/www.cdc.gov\/drugoverdose\/deaths\/index.html"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-01000--9nolinkurl10.1038\/s41562-020-01000--9"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445308nolinkurl10.1145\/3411764.3445308"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300789"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-022--10304--3nolinkurl10.1007\/s10462-022--10304--3"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/1476-072X-6--53nolinkurl10.1186\/1476-072X-6--53"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2019.07.026nolinkurl10.1016\/j.amepre.2019.07.026"},{"key":"e_1_2_1_25_1","volume-title":"Information Dashboard Design","author":"Few Stephen","unstructured":"Stephen Few. 2003. Information Dashboard Design. O'Reilly Media."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-022--14422-znolinkurl10.1186\/s12889-022--14422-z"},{"key":"e_1_2_1_27_1","unstructured":"Centers for Disease Control and Prevention. 2021. Leveraging Prescription Drug Monitoring Program (PDMP) Data in Overdose Prevention and Response. Technical Report."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2023.109856nolinkurl10.1016\/j.drugalcdep.2023.109856"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2589--7500(21)00208--9nolinkurl10.1016\/S2589--7500(21)00208--9"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2021.100873nolinkurl10.1016\/j.softx.2021.100873"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449084nolinkurl10.1145\/3449084"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312719860202nolinkurl10.1177\/0306312719860202"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419249.3420149nolinkurl10.1145\/3419249.3420149"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445901nolinkurl10.1145\/3442188.3445901"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376219"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517439"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3532106.3533556nolinkurl10.1145\/3532106.3533556"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580882nolinkurl10.1145\/3544548.3580882"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594087"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319-07293--7_5nolinkurl10.1007\/978--3--319-07293--7_5"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610218nolinkurl10.1145\/3610218"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415227nolinkurl10.1145\/3415227"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.2020.305728nolinkurl10.2105\/AJPH.2020.305728"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.0968nolinkurl10.1001\/jamanetworkopen.2019.0968"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Scott","unstructured":"Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 4768--4777."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2011.04.002nolinkurl10.1016\/j.jvlc.2011.04.002"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00776-0nolinkurl10.1038\/s41746-023-00776-0"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864913nolinkurl10.1109\/TVCG.2018.2864913"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1289\/ehp.02110947nolinkurl10.1289\/ehp.02110947"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","unstructured":"Jason D. Morgenstern Laura C. Rosella Mark J. Daley Vivek Goel Holger J. Sch\u00fcnemann and Thomas Piggott. 2021. \u201dAI's gonna have an impact on everything in society so it has to have an impact on public health\u201d: a fundamental qualitative descriptive study of the implications of artificial intelligence for public health. BMC Public Health Vol. 21 1 (2021) 1--14. https:\/\/doi.org\/10.1186\/s12889-020--10030-xdoi:nolinkurl10.1186\/s12889-020--10030-x","DOI":"10.1186\/s12889-020--10030-xnolinkurl10.1186\/s12889-020--10030-x"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641022"},{"key":"e_1_2_1_52_1","volume-title":"Science","volume":"366","author":"Obermeyer Ziad","year":"2019","unstructured":"Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science, Vol. 366, 6464 (2019), 447--453."},{"key":"e_1_2_1_53_1","unstructured":"Prescription Drug Monitoring Program Center of Excellence at Brandeis. 2014. Mandating PDMP Participation by Medical Providers: Current Status and Experience in Selected States. Technical Report."},{"key":"e_1_2_1_54_1","unstructured":"World Health Organization. 2023. Opioid overdose. https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/opioid-overdose"},{"key":"e_1_2_1_55_1","unstructured":"Pennsylvania Department of Health. 2023. Prescribing Guidelines for CNS Stimulants in Adults. https:\/\/www.health.pa.gov\/topics\/Documents\/Opioids\/Prescribing%20Guidelines%20for%20CNS%20Stimulants%20in%20Adults.pdf"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13891nolinkurl10.1111\/cgf.13891"},{"key":"e_1_2_1_57_1","unstructured":"Prescription Drug Monitoring Program Training and Technical Assistance Center. 2018. History of Prescription Drug Monitoring Programs. Technical Report. Brandeis University. https:\/\/www.pdmpassist.org\/Content\/Documents\/pdf\/PDMP_admin\/TAG_History_PDMPs_final20180314.pdf"},{"key":"e_1_2_1_58_1","unstructured":"Eric Ries. 2011. The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses. Crown."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab218nolinkurl10.1093\/jamia\/ocab218"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1559\/152304005775194700nolinkurl10.1559\/152304005775194700"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3331846nolinkurl10.1109\/TPAMI.2023.3331846"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581308"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534631"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372827"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392875nolinkurl10.1145\/3392875"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581075"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517537"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579475nolinkurl10.1145\/3579475"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604678"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1808.09123"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501868"},{"key":"e_1_2_1_72_1","volume-title":"IUI '21","author":"Wang Xinru","year":"2020","unstructured":"Xinru Wang and Ming Yin. 2020. Are explanations helpful? A comparative study of the Effects of Explanations in AI-assisted Decision Making. Intelligent User Interfaces, IUI '21, April 14--17, 2021, College Station, TX, USA (2020), 318--328."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476071"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517491"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641896"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.5210\/ojphi.v9i2.8000nolinkurl10.5210\/ojphi.v9i2.8000"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0--12--821259--2.00022--3nolinkurl10.1016\/B978-0--12--821259--2.00022--3"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445381nolinkurl10.1145\/3411764.3445381arxiv:"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114864nolinkurl10.1109\/TVCG.2021.3114864"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711072","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:31:21Z","timestamp":1755768681000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":80,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3711072"],"URL":"https:\/\/doi.org\/10.1145\/3711072","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}