{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T17:13:14Z","timestamp":1790097194415,"version":"4.0.1"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2023,5,17]],"date-time":"2023-05-17T00:00:00Z","timestamp":1684281600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["T32DA007233"],"award-info":[{"award-number":["T32DA007233"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["R01DA046620"],"award-info":[{"award-number":["R01DA046620"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,10,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Prior applications of machine learning to population health have relied on conventional model assessment criteria, limiting the utility of models as decision support tools for public health practitioners. To facilitate practitioners\u2019 use of machine learning as a decision support tool for area-level intervention, we developed and applied 4 practice-based predictive model evaluation criteria (implementation capacity, preventive potential, health equity, and jurisdictional practicalities). We used a case study of overdose prevention in Rhode Island to illustrate how these criteria could inform public health practice and health equity promotion. We used Rhode Island overdose mortality records from January 2016\u2013June 2020 (n\u00a0=\u00a01,408) and neighborhood-level US Census data. We employed 2 disparate machine learning models, Gaussian process and random forest, to illustrate the comparative utility of our criteria to guide interventions. Our models predicted 7.5%\u201336.4% of overdose deaths during the test period, illustrating the preventive potential of overdose interventions assuming 5%\u201320% statewide implementation capacities for neighborhood-level resource deployment. We describe the health equity implications of use of predictive modeling to guide interventions along the lines of urbanicity, racial\/ethnic composition, and poverty. We then discuss considerations to complement predictive model evaluation criteria and inform the prevention and mitigation of spatially dynamic public health problems across the breadth of practice.<\/jats:p>\n               <jats:p>This article is part of a Special Collection on Mental Health.<\/jats:p>","DOI":"10.1093\/aje\/kwad119","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T12:29:52Z","timestamp":1684499392000},"page":"1659-1668","source":"Crossref","is-referenced-by-count":15,"title":["Translating Predictive Analytics for Public Health Practice: A Case Study of Overdose Prevention in Rhode Island"],"prefix":"10.1093","volume":"192","author":[{"given":"Bennett","family":"Allen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel B","family":"Neill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert C","family":"Schell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Ahern","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin D","family":"Hallowell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maxwell","family":"Krieger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victoria A","family":"Jent","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William C","family":"Goedel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abigail R","family":"Cartus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jesse L","family":"Yedinak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claire","family":"Pratty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brandon D L","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Magdalena","family":"Cerd\u00e1","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,5,17]]},"reference":[{"issue":"5","key":"2023100619200121400_ref1","doi-asserted-by":"crossref","first-page":"e262","DOI":"10.1016\/S1470-2045(19)30149-4","article-title":"Big data and machine learning algorithms for health-care delivery","volume":"20","author":"Ngiam","year":"2019","journal-title":"Lancet Oncol."},{"key":"2023100619200121400_ref2","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1146\/annurev-publhealth-040617-014208","article-title":"Big data in public health: terminology, machine learning, and privacy","volume":"39","author":"Mooney","year":"2018","journal-title":"Annu Rev Public Health."},{"issue":"4","key":"2023100619200121400_ref3","doi-asserted-by":"crossref","DOI":"10.2196\/12286","article-title":"Applications of machine learning in real-life digital health interventions: review of the literature","volume":"21","author":"Triantafyllidis","year":"2019","journal-title":"J Med Internet Res."},{"key":"2023100619200121400_ref4","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"Hastie","year":"2009"},{"issue":"1","key":"2023100619200121400_ref5","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s40163-020-00116-7","article-title":"A systematic review on spatial crime forecasting","volume":"9","author":"Kounadi","year":"2020","journal-title":"Crime Sci."},{"key":"2023100619200121400_ref6","doi-asserted-by":"crossref","DOI":"10.3389\/phrs.2021.1604023","article-title":"The emergence and future of public health data science","volume":"42","author":"Goldsmith","year":"2021","journal-title":"Public Health Rev."},{"issue":"426","key":"2023100619200121400_ref7","first-page":"1","article-title":"Drug overdose deaths in the United States, 1999\u20132020","author":"Hedegaard","year":"2021","journal-title":"NCHS Data Brief."},{"issue":"6","key":"2023100619200121400_ref8","doi-asserted-by":"crossref","first-page":"202","DOI":"10.15585\/mmwr.mm7006a4","article-title":"Trends and geographic patterns in drug and synthetic opioid overdose deaths\u2014United States, 2013\u20132019","volume":"70","author":"Mattson","year":"2021","journal-title":"MMWR Morb Mortal Wkly Rep."},{"key":"2023100619200121400_ref9","article-title":"Reorganization of substance use treatment and harm reduction services during the COVID-19 pandemic: a global survey","volume":"12","author":"Radfar","year":"2021","journal-title":"Front Psych."},{"issue":"3","key":"2023100619200121400_ref10","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2022.3418","article-title":"Forecasted and observed drug overdose deaths in the US during the COVID-19 pandemic in 2020","volume":"5","author":"Cartus","year":"2022","journal-title":"JAMA Netw Open."},{"key":"2023100619200121400_ref11","volume-title":"U.S. Department of Health and Human Services Overdose Prevention Strategy","author":"Haffajee","year":"2021"},{"issue":"1 suppl","key":"2023100619200121400_ref12","doi-asserted-by":"crossref","first-page":"24s","DOI":"10.1177\/0033354918793627","article-title":"A public health strategy for the opioid crisis","volume":"133","author":"Saloner","year":"2018","journal-title":"Public Health Rep."},{"key":"2023100619200121400_ref13","doi-asserted-by":"crossref","first-page":"E33","DOI":"10.5888\/pcd16.180405","article-title":"A spatial exploration of changes in drug overdose mortality in the United States, 2000\u20132016","volume":"16","author":"Wilt","year":"2019","journal-title":"Prev Chronic Dis."},{"issue":"6","key":"2023100619200121400_ref14","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.4269\/ajtmh.16-0427","article-title":"What is a hotspot anyway?","volume":"96","author":"Lessler","year":"2017","journal-title":"Am J Trop Med Hyg."},{"issue":"1","key":"2023100619200121400_ref15","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1080\/15228835.2017.1416511","article-title":"Machine learning for drug overdose surveillance","volume":"36","author":"Neill","year":"2018","journal-title":"J Technol Hum Serv."},{"issue":"6","key":"2023100619200121400_ref16","doi-asserted-by":"crossref","first-page":"e403","DOI":"10.1016\/S2589-7500(22)00097-8","article-title":"Opportunities for opioid overdose prediction: building a population health approach","volume":"4","author":"Allen","year":"2022","journal-title":"Lancet Digit Health."},{"key":"2023100619200121400_ref17","author":"US Census Bureau","year":"2021"},{"issue":"2","key":"2023100619200121400_ref18","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1056\/NEJM200107123450205","article-title":"Neighborhood of residence and incidence of coronary heart disease","volume":"345","author":"Diez Roux","year":"2001","journal-title":"N Engl J Med."},{"issue":"7","key":"2023100619200121400_ref19","first-page":"25","article-title":"State unintentional drug overdose reporting surveillance: opioid overdose deaths and characteristics in Rhode Island","volume":"101","author":"Jiang","year":"2018","journal-title":"R I Med J (2013)."},{"issue":"3","key":"2023100619200121400_ref20","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2019.0968","article-title":"Evaluation of machine-learning algorithms for predicting opioid overdose risk among Medicare beneficiaries with opioid prescriptions","volume":"2","author":"Lo-Ciganic","year":"2019","journal-title":"JAMA Netw Open."},{"issue":"3","key":"2023100619200121400_ref21","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1093\/aje\/kwab279","article-title":"Identifying predictors of opioid overdose death at a neighborhood level with machine learning","volume":"191","author":"Schell","year":"2022","journal-title":"Am J Epidemiol."},{"key":"2023100619200121400_ref22","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3206.001.0001","volume-title":"Gaussian Processes for Machine Learning","author":"Rasmussen","year":"2005"},{"issue":"2","key":"2023100619200121400_ref23","doi-asserted-by":"crossref","DOI":"10.1098\/rsos.201795","article-title":"Understanding spatial patterns in rape reporting delays","volume":"8","author":"Klemmer","year":"2021","journal-title":"R Soc Open Sci."},{"key":"2023100619200121400_ref24","first-page":"425","volume-title":"Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics","author":"Herlands","year":"2018"},{"issue":"1","key":"2023100619200121400_ref25","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn."},{"key":"2023100619200121400_ref26","first-page":"161","volume-title":"ICML 2006: Proceedings, Twenty-Third International Conference on Machine Learning","author":"Caruana","year":"2006"},{"issue":"4","key":"2023100619200121400_ref27","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1198\/tast.2009.08199","article-title":"Variable importance assessment in regression: linear regression versus random forest","volume":"63","author":"Gr\u00f6mping","year":"2009","journal-title":"Am Stat."},{"key":"2023100619200121400_ref28","volume-title":"An Analysis of Rhode Island Land Use","author":"Rhode Island Statewide Planning Program","year":"1999"},{"issue":"2","key":"2023100619200121400_ref29","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/0022250X.1971.9989795","article-title":"A note on the measurement of racial integration of schools by means of informational concepts","volume":"1","author":"Theil","year":"1971","journal-title":"J Math Sociol."},{"key":"2023100619200121400_ref30","author":"US Census Bureau","year":"2021.   23, 2023"},{"issue":"1","key":"2023100619200121400_ref31","doi-asserted-by":"crossref","first-page":"4413","DOI":"10.1038\/s41598-021-83926-2","article-title":"Infectious disease outbreak prediction using media articles with machine learning models","volume":"11","author":"Kim","year":"2021","journal-title":"Sci Rep."},{"issue":"1","key":"2023100619200121400_ref32","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1097\/JOM.0000000000001162","article-title":"Applying machine learning to workers\u2019 compensation data to identify industry-specific ergonomic and safety prevention priorities: Ohio, 2001 to 2011","volume":"60","author":"Meyers","year":"2018","journal-title":"J Occup Environ Med."},{"issue":"10","key":"2023100619200121400_ref33","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2020.20664","article-title":"Estimating nonfatal gunshot injury locations with natural language processing and machine learning models","volume":"3","author":"Parker","year":"2020","journal-title":"JAMA Netw Open."},{"key":"2023100619200121400_ref34","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1146\/annurev-publhealth-040617-014746","article-title":"Building capacity for evidence-based public health: reconciling the pulls of practice and the push of research","volume":"39","author":"Brownson","year":"2018","journal-title":"Annu Rev Public Health."},{"issue":"4","key":"2023100619200121400_ref35","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1111\/add.15731","article-title":"Preventing Overdose Using Information and Data from the Environment (PROVIDENT): protocol for a randomized, population-based, community intervention trial","volume":"117","author":"Marshall","year":"2022","journal-title":"Addiction."},{"issue":"suppl 3","key":"2023100619200121400_ref36","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1177\/00333549131286S303","article-title":"What can public health programs do to improve health equity?","volume":"128","author":"Sadana","year":"2013","journal-title":"Public Health Rep."},{"issue":"9","key":"2023100619200121400_ref37","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1038\/s41591-019-0548-6","article-title":"Do no harm: a roadmap for responsible machine learning for health care","volume":"25","author":"Wiens","year":"2019","journal-title":"Nat Med."},{"key":"2023100619200121400_ref38","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1146\/annurev-publhealth-040119-094119","article-title":"Addressing health equity in public health practice: frameworks, promising strategies, and measurement considerations","volume":"41","author":"Liburd","year":"2020","journal-title":"Annu Rev Public Health."},{"issue":"2","key":"2023100619200121400_ref39","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1377\/hlthaff.2021.01287","article-title":"The potential for bias in machine learning and opportunities for health insurers to address it","volume":"41","author":"Gervasi","year":"2022","journal-title":"Health Aff (Millwood)."},{"issue":"5","key":"2023100619200121400_ref40","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1097\/PHH.0000000000000446","article-title":"Politics and public health\u2014engaging the third rail","volume":"22","author":"Hunter","year":"2016","journal-title":"J Public Health Manag Pract."},{"issue":"7","key":"2023100619200121400_ref41","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1097\/MLR.0000000000001131","article-title":"The social determinants of health? Time to focus on the political determinants of health!","volume":"57","author":"Mishori","year":"2019","journal-title":"Med Care."},{"key":"2023100619200121400_ref42","author":"Centers for Disease Control and Prevention","year":"25, 2022"},{"issue":"11","key":"2023100619200121400_ref43","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.2105\/AJPH.2017.304007","article-title":"Development of a statewide, publicly accessible drug overdose surveillance and information system","volume":"107","author":"Marshall","year":"2017","journal-title":"Am J Public Health."},{"issue":"5","key":"2023100619200121400_ref44","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1007\/s13524-016-0499-1","article-title":"Spatial variation in the quality of American Community Survey estimates","volume":"53","author":"Folch","year":"2016","journal-title":"Demography."}],"container-title":["American Journal of Epidemiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/aje\/advance-article-pdf\/doi\/10.1093\/aje\/kwad119\/51030535\/kwad119.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/aje\/article-pdf\/192\/10\/1659\/51841201\/kwad119.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/aje\/article-pdf\/192\/10\/1659\/51841201\/kwad119.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,6]],"date-time":"2023-10-06T19:20:59Z","timestamp":1696620059000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/aje\/article\/192\/10\/1659\/7170032"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,17]]},"references-count":44,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5,17]]},"published-print":{"date-parts":[[2023,10,10]]}},"URL":"https:\/\/doi.org\/10.1093\/aje\/kwad119","relation":{},"ISSN":["0002-9262","1476-6256"],"issn-type":[{"value":"0002-9262","type":"print"},{"value":"1476-6256","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,10]]},"published":{"date-parts":[[2023,5,17]]}}}