{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T04:15:30Z","timestamp":1782188130991,"version":"3.54.5"},"reference-count":41,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,1,31]],"date-time":"2020-01-31T00:00:00Z","timestamp":1580428800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the research fund of Dankook University in 2019","award":["R201900778"],"award-info":[{"award-number":["R201900778"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>(1) Medical research has shown an increasing interest in machine learning, permitting massive multivariate data analysis. Thus, we developed drug intoxication mortality prediction models, and compared machine learning models and traditional logistic regression. (2) Categorized as drug intoxication, 8,937 samples were extracted from the Korea Centers for Disease Control and Prevention (2008-2017). We trained, validated, and tested each model through data and compared their performance using three measures: Brier score, calibration slope, and calibration-in-the-large. (3) A chi-square test demonstrated that mortality risk statistically significantly differed according to severity, intent, toxic substance, age, and sex. The multilayer perceptron model (MLP) had the highest area under the curve (AUC), and lowest Brier score in training and validation phases, while the logistic regression model (LR) showed the highest AUC (0.827) and lowest Brier score (0.0307) in the testing phase. MLP also had the second-highest AUC (0.816) and second-lowest Brier score (0.003258) in the testing phase, demonstrating better performance than the decision-making tree model. (4) Given the complexity of choosing tuning parameters, LR proved competitive when using medical datasets, which require strict accuracy.<\/jats:p>","DOI":"10.3390\/ijerph17030897","type":"journal-article","created":{"date-parts":[[2020,1,31]],"date-time":"2020-01-31T11:55:56Z","timestamp":1580471756000},"page":"897","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Comparing Logistic Regression Models with Alternative Machine Learning Methods to Predict the Risk of Drug Intoxication Mortality"],"prefix":"10.3390","volume":"17","author":[{"given":"YoungJin","family":"Choi","sequence":"first","affiliation":[{"name":"Department of Healthcare Administration, Eulji University, Seongnam 13135, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7703-3407","authenticated-orcid":false,"given":"YooKyung","family":"Boo","sequence":"additional","affiliation":[{"name":"Department of Health Administration, Dankook University,  Cheonan 31116, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,31]]},"reference":[{"key":"ref_1","first-page":"441","article-title":"Comparative analysis of acute drug intoxication between 1980s and 1990s","volume":"10","author":"Han","year":"1999","journal-title":"J. Korean Soc. Emerg. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1080\/15287394.2016.1172529","article-title":"The characteristics of emergency department presentations related to acute herbicide or insecticide poisoning in South Korea between 2011 and 2014","volume":"79","author":"Moon","year":"2016","journal-title":"J. Toxicol. Environ. Health"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"49","DOI":"10.2105\/AJPH.2014.302244","article-title":"Confronting death from drug self-intoxication (DDSI): Prevention through a better definition","volume":"104","author":"Rockett","year":"2014","journal-title":"Am. J. Public Health"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Descamps, A.K., Vandijck, D.M., Buylaert, W.A., Mostin, M.A., and Paepe, P. (2019). Characteristics and costs in adults with acute poisoning admitted to the emergency department of a university hospital in Belgium. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0223479"},{"key":"ref_5","first-page":"168","article-title":"Intoxication with therapeutic and illicit drug substances and hospital admission to a Dutch university hospital","volume":"61","author":"Vermes","year":"2003","journal-title":"Neth. J. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1002\/ams2.403","article-title":"Intentional or unintentional drug poisoning in elderly people: Retrospective observational study in a tertiary care hospital in Japan","volume":"6","author":"Haoka","year":"2019","journal-title":"Acute Med. Surgery"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1002\/bsl.2396","article-title":"Validation of the Poisoning Severity Score (PSS) in suicidal behavior by self-poisonin","volume":"37","author":"Conner","year":"2019","journal-title":"Behav. Sci. Law"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"205","DOI":"10.3109\/15563659809028940","article-title":"Poisoning severity score. Grading of acute poisoning","volume":"36","author":"Persson","year":"1998","journal-title":"J. Toxicol. C. Toxicol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1378\/chest.08-2591","article-title":"Mortality probability model III and simplified acute physiology score II: Assessing their value in predicting length of stay and comparison to APACHE IV","volume":"136","author":"Vasilevskis","year":"2009","journal-title":"Chest"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2006","DOI":"10.1097\/CCM.0000000000002706","article-title":"Impact of Missing Physiologic Data on Performance of the Simplified Acute Physiology Score 3 Risk-Prediction Model","volume":"45","author":"Engerstrom","year":"2017","journal-title":"Crit. Care Med."},{"key":"ref_11","first-page":"25","article-title":"Using Tablet Computers to Increase Patient Engagement With Electronic Personal Health Records: Protocol For a Prospective, Randomized Interventional Study","volume":"18","author":"Rosenthal","year":"2019","journal-title":"J. Med. Internet Res."},{"key":"ref_12","first-page":"18","article-title":"Scalable and accurate deep learning for electronic health records","volume":"1","author":"Rajkomar","year":"2018","journal-title":"Dig. Med."},{"key":"ref_13","first-page":"225","article-title":"Trauma and Injury Severity Score modification for predicting survival of trauma in one regional emergency medical center in Korea: Construction of Trauma and Injury Severity Score coefficient model, Hong Kong","volume":"26","author":"Kang","year":"2019","journal-title":"J. Emerg. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.jclinepi.2014.06.018","article-title":"A new framework to enhance the interpretation of external validation studies of clinical prediction models","volume":"68","author":"Debray","year":"2015","journal-title":"J. Clin. Epidemiol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Harrell, F.E. (2001). Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis, Springer.","DOI":"10.1007\/978-1-4757-3462-1"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Helmreich, J.E. (2016). Regression Modeling Strategies with Applications to Linear Models, Logistic and Ordinal Regression and Survival Analysis (2nd Edition). J. Stat. Soft., 70.","DOI":"10.18637\/jss.v070.b02"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","article-title":"Assessing the performance of prediction models: A framework for traditional and novel measures","volume":"21","author":"Steyerberg","year":"2010","journal-title":"Epidemiology"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e003482","DOI":"10.1136\/bmjopen-2013-003482","article-title":"Predicting risk of emergency admission to hospital using primary care data: Derivation and validation of QAdmissions score","volume":"3","author":"Coupland","year":"2013","journal-title":"BMJ Open"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"232","DOI":"10.4258\/hir.2011.17.4.232","article-title":"A comparison of intensive care unit mortality prediction models through the use of data mining techniques","volume":"17","author":"Kim","year":"2011","journal-title":"Healthc Inform. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1307","DOI":"10.1111\/acem.13009","article-title":"Machine learning for predicting sepsis in-hospital mortality: An important start","volume":"23","author":"Scott","year":"2016","journal-title":"Acad Emerg. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1097\/CCM.0000000000001571","article-title":"Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards","volume":"44","author":"Churpek","year":"2016","journal-title":"Crit. Care Med."},{"key":"ref_22","first-page":"660","article-title":"Decision trees for predicting risk of mortality using routinely collected data","volume":"6","author":"Badriyah","year":"2012","journal-title":"Int. J. Soc. Hum. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.compbiomed.2015.05.015","article-title":"Prediction of mortality after radical cystectomy for bladder cancer by machine learning techniques","volume":"63","author":"Wang","year":"2015","journal-title":"Comput. Biol. Med."},{"key":"ref_24","first-page":"468","article-title":"Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: A 5-year multicentre prospective registry analysis","volume":"52","author":"Motwani","year":"2016","journal-title":"Eur. Heart. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1016\/j.burns.2015.03.016","article-title":"Mortality risk prediction in burn injury: Comparison of logistic regression with machine learning approaches","volume":"41","author":"Stylianou","year":"2015","journal-title":"Burns"},{"key":"ref_26","unstructured":"Colombet, I., Ruelland, A., Chatellier, G., Gueyffier, F., Degoulet, P., and Jaulent, M.C. (2000). Models to predict cardiovascular risk: Comparison of CART, multilayer perceptron and logistic regression. Proc. AMIA Symp., 156\u2013160. PMC2244093."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1515","DOI":"10.1016\/j.jvs.2016.04.026","article-title":"The use of machine learning for the identification of peripheral artery disease and future mortality risk","volume":"64","author":"Ross","year":"2016","journal-title":"J. Vasc. Surg."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e0127428","DOI":"10.1371\/journal.pone.0127428","article-title":"Personalized Mortality Prediction Driven by Electronic Medical Data and a Patient Similarity Metric","volume":"10","author":"Lee","year":"2015","journal-title":"PLoS ONE"},{"key":"ref_29","first-page":"883","article-title":"The Dependence of Machine Learning on Electronic Medical Record Quality","volume":"Volume 2017","author":"Ho","year":"2017","journal-title":"Proceedings of the AMIA Annual Symposium"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tsao, H.Y., Chan, P.Y., and Su, E.C.Y. (2018). Predicting diabetic retinopathy and identifying interpretable biomedical features using machine learning algorithms. BMC Bioinforma., 19.","DOI":"10.1186\/s12859-018-2277-0"},{"key":"ref_31","first-page":"111","article-title":"Performance analysis of various activation functions in generalized MLP architectures of neural networks","volume":"1","year":"2011","journal-title":"Inter. J. Art. Int. Exp. Sys."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Isa, I., Saad, Z., Omar, S., Osman, M., Ahmad, K., and Sakim, H.M. (2010, January 28\u201330). Suitable MLP network activation functions for breast cancer and thyroid disease detection. Proceedings of the IEEE, Tuban, Indonesia.","DOI":"10.1109\/CIMSiM.2010.93"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/S0893-6080(05)80056-5","article-title":"Scaled Conjugate Gradient Algorithm for Fast Supervised Learning","volume":"6","author":"Moller","year":"1993","journal-title":"Neural Netw."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Khemphila, A., and Boonjing, V. (2010, January 8\u201310). Comparing performances of logistic regression, decision trees, and neural networks for classifying heart disease patients. Proceedings of the International conference on Computer Information Systems and Industrial Management Applications (CISIM), Krakow, Poland.","DOI":"10.1109\/CISIM.2010.5643666"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1136\/pgmj.2004.024794","article-title":"Acute poisoning: Understanding 90% of cases in a nutshell","volume":"81","author":"Greene","year":"2005","journal-title":"Postgrad. Med. J."},{"key":"ref_36","first-page":"642","article-title":"Neurologic complications of substance abuse","volume":"20","author":"Brust","year":"2014","journal-title":"CONTINUUM"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1111\/j.1365-3156.2012.03096.x","article-title":"Economic burden of acute pesticide poisoning in South Korea","volume":"17","author":"Choi","year":"2012","journal-title":"Trop. Med. Int. Health"},{"key":"ref_38","first-page":"1","article-title":"Clinical Review In Geriatric Trauma Patients","volume":"13","author":"Ahn","year":"2002","journal-title":"J. Korean Soc. Emerg. Med."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1111\/j.1532-5415.2010.02744.x","article-title":"Trends in the health status of older Koreans","volume":"58","author":"Jang","year":"2010","journal-title":"J. American Ger. Soc."},{"key":"ref_40","first-page":"77","article-title":"Association of prescribed drug intoxication and neuropsychiatric history","volume":"9","author":"Kim","year":"2011","journal-title":"J. Korean. Soc. Clin. Toxicol."},{"key":"ref_41","first-page":"878","article-title":"Is a psychiatric consultation necessary for the non-suicidal intentional drug ingestion patient in an emergency department","volume":"21","author":"Min","year":"2010","journal-title":"J. Korean Soc. Emerg. Med."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/3\/897\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:53:33Z","timestamp":1760172813000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/3\/897"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,31]]},"references-count":41,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["ijerph17030897"],"URL":"https:\/\/doi.org\/10.3390\/ijerph17030897","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,31]]}}}