{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T07:38:55Z","timestamp":1763105935202,"version":"3.41.2"},"reference-count":53,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T00:00:00Z","timestamp":1678406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Benzodiazepines are the most commonly prescribed psychotropic medications, but they may place users at risk of serious adverse effects. Developing a method to predict benzodiazepine prescriptions could assist in prevention efforts.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The present study applies machine learning methods to de-identified electronic health record data, in order to develop algorithms for predicting benzodiazepine prescription receipt (yes\/no) and number of benzodiazepine prescriptions (0, 1, 2+) at a given encounter. Support-vector machine (SVM) and random forest (RF) approaches were applied to outpatient psychiatry, family medicine, and geriatric medicine data from a large academic medical center. The training sample comprised encounters taking place between January 2020 and December 2021 (<jats:italic>N<\/jats:italic> = 204,723 encounters); the testing sample comprised data from encounters taking place between January and March 2022 (<jats:italic>N<\/jats:italic> = 28,631 encounters). The following empirically-supported features were evaluated: anxiety and sleep disorders (primary anxiety diagnosis, any anxiety diagnosis, primary sleep diagnosis, any sleep diagnosis), demographic characteristics (age, gender, race), medications (opioid prescription, number of opioid prescriptions, antidepressant prescription, antipsychotic prescription), other clinical variables (mood disorder, psychotic disorder, neurocognitive disorder, prescriber specialty), and insurance status (any insurance, type of insurance). We took a step-wise approach to developing a prediction model, wherein Model 1 included only anxiety and sleep diagnoses, and each subsequent model included an additional group of features.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>For predicting benzodiazepine prescription receipt (yes\/no), all models showed good to excellent overall accuracy and area under the receiver operating characteristic curve (AUC) for both SVM (Accuracy = 0.868\u20130.883; AUC = 0.864\u20130.924) and RF (Accuracy = 0.860\u20130.887; AUC = 0.877\u20130.953). Overall accuracy was also high for predicting number of benzodiazepine prescriptions (0, 1, 2+) for both SVM (Accuracy = 0.861\u20130.877) and RF (Accuracy = 0.846\u20130.878).<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Results suggest SVM and RF algorithms can accurately classify individuals who receive a benzodiazepine prescription and can separate patients by the number of benzodiazepine prescriptions received at a given encounter. If replicated, these predictive models could inform system-level interventions to reduce the public health burden of benzodiazepines.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fpsyt.2023.1087879","type":"journal-article","created":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T04:25:23Z","timestamp":1678422323000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Predicting benzodiazepine prescriptions: A proof-of-concept machine learning approach"],"prefix":"10.3389","volume":"14","author":[{"given":"Kerry L.","family":"Kinney","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yufeng","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew C.","family":"Morris","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julie A.","family":"Schumacher","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saurabh B.","family":"Bhardwaj","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James K.","family":"Rowlett","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"p. 1","DOI":"10.1097\/JCP.0b013e318209cf05","author":"Greenblatt","year":"2011","journal-title":"Psychotropic drug prescribing in the United States: extent, costs, and expenditures."},{"key":"B2","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1176\/appi.ps.201800321","article-title":"Benzodiazepine use and misuse among adults in the United States.","volume":"70","author":"Maust","year":"2019","journal-title":"Psychiatr Serv."},{"key":"B3","doi-asserted-by":"publisher","first-page":"25","DOI":"10.2165\/00003495-199448010-00004","article-title":"Guidelines for the rational use of benzodiazepines.","volume":"48","author":"Ashton","year":"1994","journal-title":"Drugs."},{"key":"B4","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1016\/j.genhosppsych.2006.05.008","article-title":"Outcome of new benzodiazepine prescriptions to older adults in primary care.","volume":"28","author":"Simon","year":"2006","journal-title":"Gen Hosp Psychiatry."},{"key":"B5","doi-asserted-by":"publisher","first-page":"2086","DOI":"10.1111\/j.1360-0443.2011.03563.x","article-title":"Benzodiazepines revisited\u2013will we ever learn?","volume":"106","author":"Lader","year":"2011","journal-title":"Addiction."},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.3390\/jcm7020017","article-title":"Benzodiazepines I: upping the care on downers: the evidence of risks, benefits and alternatives.","volume":"7","author":"Guina","year":"2018","journal-title":"J Clin Med."},{"key":"B7","article-title":"Questionable prescribing for elderly patients in Quebec.","volume":"150","author":"Tamblyn","year":"1994","journal-title":"CMAJ."},{"key":"B8","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1007\/s40266-013-0056-1","article-title":"Benzodiazepine use among older adults with chronic obstructive pulmonary disease.","volume":"30","author":"Vozoris","year":"2013","journal-title":"Drugs Aging."},{"key":"B9","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1001\/jamainternmed.2018.6721","article-title":"Assessment of racial\/ethnic and income disparities in the prescription of opioids and other controlled medications in California.","volume":"179","author":"Friedman","year":"2019","journal-title":"JAMA Intern Med."},{"key":"B10","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.drugalcdep.2018.02.011","article-title":"Examining racial\/ethnic differences in patterns of benzodiazepine prescription and misuse.","volume":"187","author":"Cook","year":"2018","journal-title":"Drug Alcohol Depend."},{"key":"B11","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1007\/s40615-021-01224-z","article-title":"Racial-ethnic disparities in benzodiazepine prescriptions for anxiety in US emergency departments.","volume":"10","author":"Ribas Roca","year":"2022","journal-title":"J Racial Ethn Health Disparities."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1007\/s11606-016-3740-0","article-title":"Benzodiazepines are prescribed more frequently to patients already at risk for benzodiazepine-related adverse events in primary care.","volume":"31","author":"Kroll","year":"2016","journal-title":"J Gen Intern Med."},{"key":"B13","first-page":"1","article-title":"Physician office visits at which benzodiazepines were prescribed: findings from 2014-2016 national ambulatory medical care survey.","volume":"137","author":"Santo","year":"2020","journal-title":"Natl Health Stat Rep."},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2018.7399","article-title":"Patterns in outpatient benzodiazepine prescribing in the United States.","volume":"2","author":"Agarwal","year":"2019","journal-title":"JAMA Netw Open."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1007\/s00127-020-01989-4","article-title":"The influence of prescriber and patient gender on the prescription of benzodiazepines: evidence for stereotypes and biases?","volume":"56","author":"McIntyre","year":"2021","journal-title":"Soc Psychiatry Psychiatr Epidemiol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.healthpol.2010.03.008","article-title":"Patterns in the use of benzodiazepines in British Columbia: examining the impact of increasing research and guideline cautions against long-term use.","volume":"97","author":"Cunningham","year":"2010","journal-title":"Health Policy."},{"key":"B17","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.jpsychires.2020.05.020","article-title":"Benzodiazepine misuse among adults receiving psychiatric treatment.","volume":"128","author":"McHugh","year":"2020","journal-title":"J Psychiatr Res."},{"key":"B18","doi-asserted-by":"publisher","first-page":"908","DOI":"10.1176\/ps.62.8.pss6208_0908","article-title":"Benzodiazepine use among patients with schizophrenia in Taiwan: a nationwide population-based survey.","volume":"62","author":"Wu","year":"2011","journal-title":"Psychiatr Serv."},{"key":"B19","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1017\/S1041610219000358","article-title":"Benzodiazepine use among older adults with schizophrenia spectrum disorder: prevalence and associated factors in a multicenter study.","volume":"32","author":"Schuster","year":"2020","journal-title":"Int Psychogeriatr."},{"key":"B20","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.addbeh.2018.08.010","article-title":"Nonmedical prescription sedative\/tranquilizer use in alcohol and opioid use disorders.","volume":"88","author":"Votaw","year":"2019","journal-title":"Addict Behav."},{"key":"B21","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.drugalcdep.2019.02.033","article-title":"The epidemiology of benzodiazepine misuse: a systematic review.","volume":"200","author":"Votaw","year":"2019","journal-title":"Drug Alcohol Depend."},{"key":"B22","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1002\/gps.2143","article-title":"Use of benzodiazepines, depressive symptoms and cognitive function in old age.","volume":"24","author":"van Vliet","year":"2009","journal-title":"Int J Geriatr Psychiatry."},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2021.108854","article-title":"Opioid deaths involving concurrent benzodiazepine use: assessing risk factors through the analysis of prescription drug monitoring data and postmortem toxicology.","volume":"225","author":"Bannon","year":"2021","journal-title":"Drug Alcohol Depend."},{"key":"B24","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1016\/j.amepre.2015.03.040","article-title":"Emergency department visits and overdose deaths from combined use of opioids and benzodiazepines.","volume":"49","author":"Jones","year":"2015","journal-title":"Am J Prev Med."},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h2698","article-title":"Benzodiazepine prescribing patterns and deaths from drug overdose among US veterans receiving opioid analgesics: case-cohort study.","volume":"350","author":"Park","year":"2015","journal-title":"BMJ."},{"key":"B26","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1001\/archinternmed.2011.117","article-title":"Opioid dose and drug-related mortality in patients with nonmalignant pain.","volume":"171","author":"Gomes","year":"2011","journal-title":"Arch Intern Med."},{"key":"B27","article-title":"Alcohol involvement in opioid pain reliever and benzodiazepine drug abuse\u2013related emergency department visits and drug-related deaths\u2014United States, 2010.","volume":"63","author":"Jones","year":"2014","journal-title":"Morb Mortal Wkly Rep."},{"key":"B28","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1093\/pm\/pny179","article-title":"Correlates of benzodiazepine use and adverse outcomes among patients with chronic pain prescribed long-term opioid therapy.","volume":"20","author":"Yarborough","year":"2019","journal-title":"Pain Med."},{"key":"B29","doi-asserted-by":"publisher","first-page":"247","DOI":"10.2165\/00002018-199106040-00003","article-title":"Benzodiazepine poisoning.","volume":"6","author":"Gaudreault","year":"1991","journal-title":"Drug Saf."},{"key":"B30","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1053\/j.gastro.2019.09.009","article-title":"Validation of a machine learning model that outperforms clinical risk scoring systems for upper gastrointestinal bleeding.","volume":"158","author":"Shung","year":"2020","journal-title":"Gastroenterology."},{"key":"B31","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1609\/aimag.v33i4.2438","article-title":"Machine learning for personalized medicine: predicting primary myocardial infarction from electronic health records.","volume":"33","author":"Weiss","year":"2012","journal-title":"Ai Mag."},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1177\/2470547017747553","article-title":"Data science in the research domain criteria era: relevance of machine learning to the study of stress pathology, recovery, and resilience.","volume":"2","author":"Galatzer-Levy","year":"2018","journal-title":"Chronic Stress."},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2022.790343","article-title":"A risk scoring system utilizing machine learning methods for hepatotoxicity prediction one year after the initiation of tyrosine kinase inhibitors.","volume":"12","author":"Han","year":"2022","journal-title":"Front Oncol."},{"key":"B34","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1016\/j.spinee.2019.01.009","article-title":"Machine learning for prediction of sustained opioid prescription after anterior cervical discectomy and fusion.","volume":"19","author":"Karhade","year":"2019","journal-title":"Spine J."},{"key":"B35","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2019.0968","article-title":"Evaluation of machine-learning algorithms for predicting opioid overdose risk among medicare beneficiaries with opioid prescriptions.","volume":"2","author":"Lo-Ciganic","year":"2019","journal-title":"JAMA Netw Open."},{"journal-title":"Center for Informatics and Analytics Patient Cohort Explorer (PCE) (Version 2) figshare Software.","year":"2020","key":"B36"},{"key":"B37","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1109\/TKDE.2005.50","article-title":"Using AUC and accuracy in evaluating learning algorithms.","volume":"17","author":"Huang","year":"2005","journal-title":"IEEE Trans knowl Data Eng."},{"key":"B38","doi-asserted-by":"publisher","first-page":"1638","DOI":"10.1016\/j.surg.2015.12.029","article-title":"ROC-ing along: evaluation and interpretation of receiver operating characteristic curves.","volume":"159","author":"Carter","year":"2016","journal-title":"Surgery."},{"key":"B39","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve.","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology."},{"key":"B40","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition.","volume":"2","author":"Burges","year":"1998","journal-title":"Data Min Knowl Discov."},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","author":"Hastie","year":"2009","journal-title":"The elements of statistical learning: data mining, inference, and prediction."},{"key":"B42","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests.","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn."},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-6849-3","author":"Kuhn","year":"2013","journal-title":"Applied predictive modeling."},{"key":"B44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12933-022-01672-9","article-title":"Risk factors for cardiovascular disease in patients with metabolic-associated fatty liver disease: a machine learning approach.","volume":"21","author":"Dro\u017cd\u017c","year":"2022","journal-title":"Cardiovasc Diabetol."},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1201\/9781315108230","author":"Kuhn","year":"2019","journal-title":"Recursive feature elimination| feature engineering and selection: a practical approach for predictive models."},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1117\/12.2620105","author":"Zheng","year":"2022","journal-title":"Adolescent behavioral risk analysis and prediction using machine learning: a foundation for precision suicide prevention. Multimodal image exploitation and learning 2022."},{"key":"B47","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s13748-016-0094-0","article-title":"Learning from imbalanced data: open challenges and future directions.","volume":"5","author":"Krawczyk","year":"2016","journal-title":"Prog Artif Intell."},{"key":"B48","doi-asserted-by":"publisher","first-page":"621","DOI":"10.4088\/JCP.v69n0415","article-title":"Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials.","volume":"69","author":"Hofmann","year":"2008","journal-title":"J Clin Psychiatry."},{"key":"B49","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/j.psc.2010.04.002","article-title":"Efficacy of cognitive behavioral therapy for anxiety disorders: a review of meta-analytic findings.","volume":"33","author":"Olatunji","year":"2010","journal-title":"Psychiatr Clin North Am."},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1016\/j.smrv.2019.08.002","article-title":"Cognitive behavioral therapy for insomnia: a meta-analysis of long-term effects in controlled studies.","volume":"48","author":"van der Zweerde","year":"2019","journal-title":"Sleep Med Rev."},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2296-13-40","article-title":"Comparative effectiveness of cognitive behavioral therapy for insomnia: a systematic review.","volume":"13","author":"Mitchell","year":"2012","journal-title":"BMC Fam Pract."},{"key":"B52","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/S0278-5846(02)00338-X","article-title":"Role of selective serotonin reuptake inhibitors in psychiatric disorders: a comprehensive review.","volume":"27","author":"Vaswani","year":"2003","journal-title":"Prog Neuropsychopharmacol Biol Psychiatry."},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2019.00161","article-title":"Predicting opioid use disorder (OUD) using a random forest.","author":"Wadekar","year":"2019","journal-title":"Proceedings of the 2019 IEEE 43rd annual computer software and applications conference (COMPSAC)."}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2023.1087879\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T04:25:30Z","timestamp":1678422330000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2023.1087879\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,10]]},"references-count":53,"alternative-id":["10.3389\/fpsyt.2023.1087879"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2023.1087879","relation":{},"ISSN":["1664-0640"],"issn-type":[{"type":"electronic","value":"1664-0640"}],"subject":[],"published":{"date-parts":[[2023,3,10]]},"article-number":"1087879"}}