{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T02:54:50Z","timestamp":1781232890241,"version":"3.54.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011376","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000}}],"reference-count":27,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T00:00:00Z","timestamp":1691971200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Digital Health CRC"},{"DOI":"10.13039\/100000092","name":"U.S. National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM013362"],"award-info":[{"award-number":["R01LM013362"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Background<\/jats:title>\n<jats:p>Treatment of surgical pain is a common reason for opioid prescriptions. Being able to predict which patients are at risk for opioid abuse, dependence, and overdose (opioid-related adverse outcomes [OR-AE]) could help physicians make safer prescription decisions. We aimed to develop a machine-learning algorithm to predict the risk of OR-AE following surgery using Medicaid data with external validation across states.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Methods<\/jats:title>\n<jats:p>Five machine learning models were developed and validated across seven US states (90\u201310 data split). The model output was the risk of OR-AE 6-months following surgery. The models were evaluated using standard metrics and area under the receiver operating characteristic curve (AUC) was used for model comparison. We assessed calibration for the top performing model and generated bootstrap estimations for standard deviations. Decision curves were generated for the top-performing model and logistic regression.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Results<\/jats:title>\n<jats:p>We evaluated 96,974 surgical patients aged 15 and 64. During the 6-month period following surgery, 10,464 (10.8%) patients had an OR-AE. Outcome rates were significantly higher for patients with depression (17.5%), diabetes (13.1%) or obesity (11.1%). The random forest model achieved the best predictive performance (AUC: 0.877; F1-score: 0.57; recall: 0.69; precision:0.48). An opioid disorder diagnosis prior to surgery was the most important feature for the model, which was well calibrated and had good discrimination.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec004\">\n<jats:title>Conclusions<\/jats:title>\n<jats:p>A machine learning models to predict risk of OR-AE following surgery performed well in external validation. This work could be used to assist pain management following surgery for Medicaid beneficiaries and supports a precision medicine approach to opioid prescribing.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pcbi.1011376","type":"journal-article","created":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T17:28:25Z","timestamp":1692034105000},"page":"e1011376","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["Prediction of opioid-related outcomes in a medicaid surgical population: Evidence to guide postoperative opiate therapy and monitoring"],"prefix":"10.1371","volume":"19","author":[{"given":"Oualid","family":"El Hajouji","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ran S.","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2524-1113","authenticated-orcid":true,"given":"Alban","family":"Zammit","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keith","family":"Humphreys","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven M.","family":"Asch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Carroll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine M.","family":"Curtin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6553-3455","authenticated-orcid":true,"given":"Tina","family":"Hernandez-Boussard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2023,8,14]]},"reference":[{"key":"pcbi.1011376.ref001","unstructured":"Abuse S. Key substance use and mental health indicators in the United States: results from the 2019 National Survey on Drug Use and Health. 2020."},{"issue":"50\u201351","key":"pcbi.1011376.ref002","doi-asserted-by":"crossref","first-page":"1378","DOI":"10.15585\/mmwr.mm6450a3","article-title":"Increases in Drug and Opioid Overdose Deaths\u2014United States, 2000\u20132014","volume":"64","author":"RA Rudd","year":"2016","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"10","key":"pcbi.1011376.ref003","doi-asserted-by":"crossref","first-page":"265","DOI":"10.15585\/mmwr.mm6610a1","article-title":"Characteristics of Initial Prescription Episodes and Likelihood of Long-Term Opioid Use\u2014United States, 2006\u20132015","volume":"66","author":"A Shah","year":"2017","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"6","key":"pcbi.1011376.ref004","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1097\/ALN.0000000000003265","article-title":"Persistent Postoperative Opioid Use: A Systematic Literature Search of Definitions and Population-based Cohort Study","volume":"132","author":"NK Jivraj","year":"2020","journal-title":"Anesthesiology"},{"issue":"12","key":"pcbi.1011376.ref005","doi-asserted-by":"crossref","first-page":"1859","DOI":"10.1111\/j.1526-4637.2010.00983.x","article-title":"Causes and consequences of inadequate management of acute pain","volume":"11","author":"R Sinatra","year":"2010","journal-title":"Pain Med"},{"issue":"5","key":"pcbi.1011376.ref006","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1001\/archinternmed.2011.1827","article-title":"Long-term analgesic use after low-risk surgery: a retrospective cohort study","volume":"172","author":"A Alam","year":"2012","journal-title":"Arch Intern Med"},{"issue":"6","key":"pcbi.1011376.ref007","doi-asserted-by":"crossref","first-page":"e170504","DOI":"10.1001\/jamasurg.2017.0504","article-title":"New Persistent Opioid Use After Minor and Major Surgical Procedures in US Adults","volume":"152","author":"CM Brummett","year":"2017","journal-title":"JAMA Surg"},{"key":"pcbi.1011376.ref008","doi-asserted-by":"crossref","first-page":"j5790","DOI":"10.1136\/bmj.j5790","article-title":"Postsurgical prescriptions for opioid naive patients and association with overdose and misuse: retrospective cohort study","volume":"360","author":"GA Brat","year":"2018","journal-title":"BMJ"},{"issue":"10324","key":"pcbi.1011376.ref009","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1016\/S0140-6736(21)02252-2","article-title":"Responding to the opioid crisis in North America and beyond: recommendations of the Stanford-Lancet Commission","volume":"399","author":"K Humphreys","year":"2022","journal-title":"Lancet"},{"issue":"6","key":"pcbi.1011376.ref010","doi-asserted-by":"crossref","first-page":"e207367","DOI":"10.1001\/jamanetworkopen.2020.7367","article-title":"Rate and Risk Factors Associated With Prolonged Opioid Use After Surgery: A Systematic Review and Meta-analysis","volume":"3","author":"OD Lawal","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"8","key":"pcbi.1011376.ref011","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1002\/pds.5067","article-title":"Incidence rates of and risk factors for opioid overdose in new users of prescription opioids among US Medicaid enrollees: A cohort study","volume":"29","author":"YH Nam","year":"2020","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"4","key":"pcbi.1011376.ref012","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1016\/j.jpain.2015.12.006","article-title":"Risk Factors of Prescription Opioid Overdose Among Colorado Medicaid Beneficiaries","volume":"17","author":"P Dilokthornsakul","year":"2016","journal-title":"J Pain"},{"key":"pcbi.1011376.ref013","article-title":"Prescription Quantity and Duration Predict Progression from Acute to Chronic Opioid Use in Opioid-Na\u00efve Medicaid Patients","author":"D Johnson","year":"2022","journal-title":"PLOS Digital Health"},{"key":"pcbi.1011376.ref014","doi-asserted-by":"crossref","first-page":"108261","DOI":"10.1016\/j.drugalcdep.2020.108261","article-title":"Utilization of treatment by Medicaid enrollees with opioid use disorder and co-occurring substance use disorders","volume":"217","author":"P O\u2019Brien","year":"2020","journal-title":"Drug Alcohol Depend"},{"key":"pcbi.1011376.ref015","unstructured":"Orgera K, Tolbert J. Key facts about uninsured adults with opioid use disorder. KFF; 2019."},{"key":"pcbi.1011376.ref016","article-title":"MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care","author":"T Hernandez-Boussard","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"pcbi.1011376.ref017","doi-asserted-by":"crossref","first-page":"e186558","DOI":"10.1001\/jamanetworkopen.2018.6558","article-title":"US National Trends in Pediatric Deaths From Prescription and Illicit Opioids, 1999\u20132016","volume":"1","author":"JR Gaither","year":"2018","journal-title":"JAMA Netw Open"},{"key":"pcbi.1011376.ref018","doi-asserted-by":"crossref","first-page":"104739","DOI":"10.1016\/j.ijmedinf.2022.104739","article-title":"Opioid2MME: Standardizing opioid prescriptions to morphine milligram equivalents from electronic health records","volume":"162","author":"JA Lossio-Ventura","year":"2022","journal-title":"Int J Med Inform"},{"key":"pcbi.1011376.ref019","unstructured":"Elixhauser A, Steiner C, Palmer L. Clinical classifications software (CCS). Rockville, MD: Agency for Healthcare Research and Quality,; 2014."},{"key":"pcbi.1011376.ref020","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.jclinepi.2015.12.005","article-title":"A calibration hierarchy for risk models was defined: from utopia to empirical data","volume":"74","author":"B Van Calster","year":"2016","journal-title":"J Clin Epidemiol"},{"key":"pcbi.1011376.ref021","first-page":"10282","article-title":"Efficient nonparametric statistical inference on population feature importance using Shapley values","volume":"119","author":"BD Williamson","year":"2020","journal-title":"Proc Mach Learn Res"},{"issue":"6","key":"pcbi.1011376.ref022","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1016\/j.injury.2012.10.003","article-title":"Health related quality of life, reoperation rate and function in patients with diabetes mellitus and hip fracture\u2014a 2 year follow-up study","volume":"44","author":"W Ekstr\u00f6m","year":"2013","journal-title":"Injury"},{"issue":"5","key":"pcbi.1011376.ref023","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1111\/j.1399-6576.2004.00387.x","article-title":"The analgesic effect of morphine on postoperative pain in diabetic patients","volume":"48","author":"A Karci","year":"2004","journal-title":"Acta Anaesthesiol Scand"},{"issue":"1","key":"pcbi.1011376.ref024","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1002\/ags3.12049","article-title":"Obesity as a surgical risk factor","volume":"2","author":"M Ri","year":"2018","journal-title":"Ann Gastroenterol Surg"},{"key":"pcbi.1011376.ref025","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/s12893-016-0120-y","article-title":"Depression and postoperative complications: an overview","volume":"16","author":"MM Ghoneim","year":"2016","journal-title":"BMC Surg"},{"issue":"3","key":"pcbi.1011376.ref026","first-page":"96","article-title":"Association of diabetes mellitus with postoperative opioid consumption in patients undergoing primary unilateral hip arthroplasty","volume":"31","author":"SM Regnier","year":"2021","journal-title":"J Perioper Pract"},{"issue":"2","key":"pcbi.1011376.ref027","doi-asserted-by":"crossref","first-page":"e0210575","DOI":"10.1371\/journal.pone.0210575","article-title":"Predicting inadequate postoperative pain management in depressed patients: A machine learning approach","volume":"14","author":"A Parthipan","year":"2019","journal-title":"PLoS One"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011376","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011376","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T17:55:38Z","timestamp":1692899738000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011376"}},"subtitle":[],"editor":[{"given":"Benjamin","family":"Althouse","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,8,14]]},"references-count":27,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8,14]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011376","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1011376","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,14]]}}}