{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T14:01:43Z","timestamp":1788357703983,"version":"build-2803163510"},"reference-count":25,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,25]],"date-time":"2022-12-25T00:00:00Z","timestamp":1671926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Faculty of Medicine, Prince of Songkla University"},{"name":"National Science, Research, and Innovation Fund (NSRF) and Prince of Songkla University"},{"name":"Kasikornthai Foundation and the SCG Foundation through the Division of Digital Innovation and Data Analytics (DIDA), Faculty of Medicine, Prince of Songkla University"},{"name":"Research and Development Office (RDO) and Faculty of Medicine, Prince of Songkla University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Over time, large amounts of clinical data have accumulated in electronic health records (EHRs), making it difficult for healthcare professionals to navigate and make patient-centered decisions. This underscores the need for healthcare recommendation systems that help medical professionals make faster and more accurate decisions. This study addresses drug recommendation systems that generate an appropriate list of drugs that match patients\u2019 diagnoses. Currently, recommendations are manually prepared by physicians, but this is difficult for patients with multiple comorbidities. We explored approaches to drug recommendations based on elderly patients with diabetes, hypertension, and cardiovascular disease who visited primary-care clinics and often had multiple conditions. We examined both collaborative filtering approaches and traditional machine-learning classifiers. The hybrid model between the two yielded a recall at 5 of 76.61%, a precision at 5 of 46.20%, a macro-averaged area under the curve of 74.52%, and an average physician agreement of 47.50%. Although collaborative filtering is widely used in recommendation systems, our results showed that it consistently underperformed traditional classification. Collaborative filtering was sensitive to class imbalances and favored the more popular classes. This study highlighted challenges that need to be addressed when developing recommendation systems in EHRs.<\/jats:p>","DOI":"10.3390\/ijerph20010309","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T04:40:39Z","timestamp":1672116039000},"page":"309","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Drug Recommendation from Diagnosis Codes: Classification vs. Collaborative Filtering Approaches"],"prefix":"10.3390","volume":"20","author":[{"given":"Apichat","family":"Sae-Ang","sequence":"first","affiliation":[{"name":"College of Digital Science, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4629-3924","authenticated-orcid":false,"given":"Sawrawit","family":"Chairat","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences and Biomedical Engineering, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4776-9610","authenticated-orcid":false,"given":"Natchada","family":"Tansuebchueasai","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1084-1837","authenticated-orcid":false,"given":"Orapan","family":"Fumaneeshoat","sequence":"additional","affiliation":[{"name":"Department of Family and Preventive Medicine, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"},{"name":"Research Center for Medical Data Analytics, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8894-3817","authenticated-orcid":false,"given":"Thammasin","family":"Ingviya","sequence":"additional","affiliation":[{"name":"Department of Family and Preventive Medicine, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"},{"name":"Research Center for Medical Data Analytics, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3159-7925","authenticated-orcid":false,"given":"Sitthichok","family":"Chaichulee","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences and Biomedical Engineering, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"},{"name":"Research Center for Medical Data Analytics, Faculty of Medicine, Prince of Songkla University, Songkhla 90110, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.1056\/NEJMra1109345","article-title":"Noncommunicable Diseases","volume":"369","author":"Hunter","year":"2013","journal-title":"N. Engl. J. Med."},{"key":"ref_2","unstructured":"GBD 2015 Risk Factors Collaborators (2016). Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990\u20132015: A systematic analysis for the Global Burden of Disease Study 2015. Lancet, 388, 1659\u20131724."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1161\/01.HYP.37.4.1053","article-title":"Diabetes, Hypertension, and Cardiovascular Disease","volume":"37","author":"Sowers","year":"2001","journal-title":"Hypertension"},{"key":"ref_4","first-page":"20","article-title":"Non-communicable diseases in the Asia-Pacific region: Prevalence, risk factors and community-based prevention","volume":"28","author":"Low","year":"2014","journal-title":"Int. J. Occup. Med. Environ. Health"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hao, F., and Blair, R.H. (2016). A comparative study: Classification vs. user-based collaborative filtering for clinical prediction. BMC Med. Res. Methodol., 16.","DOI":"10.1186\/s12874-016-0261-9"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1186\/2041-1480-3-14","article-title":"GalenOWL: Ontology-based drug recommendations discovery","volume":"3","author":"Doulaverakis","year":"2012","journal-title":"J. Biomed. Semant."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez, A., Jim\u00e9nez, E., Fern\u00e1ndez, J., Eccius, M., G\u00f3mez, J.M., Alor-Hernandez, G., Posada-Gomez, R., and Laufer, C. (2009, January 20\u201325). SemMed: Applying Semantic Web to Medical Recommendation Systems. Proceedings of the 2009 First International Conference on Intensive Applications and Services, Valencia, Spain.","DOI":"10.1109\/INTENSIVE.2009.12"},{"key":"ref_8","unstructured":"Bajor, J.M., and Lasko, T.A. (2017, January 24\u201326). Predicting Medications from Diagnostic Codes with Recurrent Neural Networks. Proceedings of the ICLR, Toulon, France."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Chen, R., Tang, J., Stewart, W.F., and Sun, J. (2017, January 13\u201317). LEAP. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.","DOI":"10.1145\/3097983.3098109"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, L., Zhang, W., He, X., and Zha, H. (2018). Personalized Prescription for Comorbidity. Database Systems for Advanced Applications, Springer International Publishing.","DOI":"10.1007\/978-3-319-91458-9_1"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"100174","DOI":"10.1016\/j.bdr.2020.100174","article-title":"SMR: Medical Knowledge Graph Embedding for Safe Medicine Recommendation","volume":"23","author":"Gong","year":"2021","journal-title":"Big Data Res."},{"key":"ref_12","first-page":"1126","article-title":"GAMENet: Graph Augmented MEmory Networks for Recommending Medication Combination","volume":"33","author":"Shang","year":"2019","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, C., Xiao, C., Ma, F., Glass, L., and Sun, J. (2021, January 19\u201327). SafeDrug: Dual Molecular Graph Encoders for Recommending Effective and Safe Drug Combinations. Proceedings of the 30th International Joint Conference on Artificial Intelligence, IJCAI 2021, Montreal, QC, USA.","DOI":"10.24963\/ijcai.2021\/514"},{"key":"ref_14","unstructured":"Wu, Z., Yao, H., Su, Z., Liebovitz, D.M., Glass, L.M., Zou, J., Finn, C., and Sun, J. (2022). Knowledge-Driven New Drug Recommendation. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci. Data"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1007\/s10618-009-0156-z","article-title":"Time to CARE: A collaborative engine for practical disease prediction","volume":"20","author":"Davis","year":"2009","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1007\/s10257-014-0242-7","article-title":"A recommendation engine for disease prediction","volume":"13","author":"Folino","year":"2014","journal-title":"Inf. Syst. E-Bus. Manag."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hassan, S., and Syed, Z. (2010, January 11\u201312). From netflix to heart attacks. Proceedings of the ACM International Conference on Health Informatics\u2014IHI\u201910, Arlington, VA, USA.","DOI":"10.1145\/1882992.1883012"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e37233","DOI":"10.2196\/37233","article-title":"Drug Recommendation System for Diabetes Using a Collaborative Filtering and Clustering Approach: Development and Performance Evaluation","volume":"24","author":"Morales","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"ref_20","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_21","first-page":"1871","article-title":"LIBLINEAR: A Library for Large Linear Classification","volume":"9","author":"Fan","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_23","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Singh, A.P., and Gordon, G.J. (2008, January 24\u201327). Relational learning via collective matrix factorization. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining\u2014KDD 08, Las Vegas, NV, USA.","DOI":"10.1145\/1401890.1401969"},{"key":"ref_25","unstructured":"Cortes, D. (2018). Cold-start recommendations in Collective Matrix Factorization. arXiv."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/1\/309\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:50:37Z","timestamp":1760147437000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/1\/309"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,25]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["ijerph20010309"],"URL":"https:\/\/doi.org\/10.3390\/ijerph20010309","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,25]]}}}