{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T14:29:26Z","timestamp":1781533766958,"version":"3.54.5"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T00:00:00Z","timestamp":1779148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","award":["RS-2023-00248913"],"award-info":[{"award-number":["RS-2023-00248913"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]},{"award":["RS-2023-00248913"],"award-info":[{"award-number":["RS-2023-00248913"]}],"id":[{"id":"https:\/\/ror.org\/013aysd81","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Unattended scheduled appointments (\u201cpatient no-shows\u201d henceforth) adversely affect healthcare providers and patients\u2019 health, disrupting the continuity of care, operational efficiency, and allocation of medical resources. Therefore, accurate predictive modeling is needed to reduce the impact of patient no-shows. Although machine learning methods, such as logistic regression, random forests, and decision trees, are widely used to predict patient no-shows, they often rely on hard decision splits and static feature importance, limiting adaptability to complex patient behaviors. To address this limitation, we propose a hybrid multi-head attention soft random forest (MHASRF) model that integrates attention mechanisms into a random forest using probabilistic soft splitting. It assigns attention weights across the trees, enabling attention on specific patient behaviors. The MHASRF model exhibited an accuracy of 88.24%, specificity of 91.21%, precision of 81.60%, recall of 82.01%, F1-score of 81.81%, and area under the receiver operating characteristic curve of 94.07%, demonstrating high and balanced performance across metrics. It could also identify key predictors of patient no-shows at two feature-importance levels (tree and attention mechanism), providing deeper insights into patient no-shows. Thus, the proposed MHASRF model is a robust, adaptable, and interpretable method for predicting patient no-shows that can help healthcare providers optimize resources.<\/jats:p>","DOI":"10.3390\/systems14050576","type":"journal-article","created":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T15:45:34Z","timestamp":1779291934000},"page":"576","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Multi-Head Attention Soft Random Forest for Interpretable Patient No-Show Prediction"],"prefix":"10.3390","volume":"14","author":[{"given":"Ninda Nurseha","family":"Amalina","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, Kumoh National Institute of Technology, Gumi City 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1077-4750","authenticated-orcid":false,"given":"Heungjo","family":"An","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Kumoh National Institute of Technology, Gumi City 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e2160","DOI":"10.1002\/hsr2.2160","article-title":"Evaluation of no-show rate in outpatient clinics with open access scheduling system: A systematic review","volume":"7","author":"Abadi","year":"2024","journal-title":"Health Sci. Rep."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kheirkhah, P., Feng, Q., Travis, L.M., Tavakoli-Tabasi, S., and Sharafkhaneh, A. (2016). Prevalence, predictors and economic consequences of no-shows. BMC Health Serv. Res., 16.","DOI":"10.1186\/s12913-015-1243-z"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"350","DOI":"10.4300\/JGME-D-10-00199.1","article-title":"Missed Appointments in Resident Continuity Clinic: Patient Characteristics and Health Care Outcomes","volume":"3","author":"Nguyen","year":"2011","journal-title":"J. Grad. Med. Educ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.clinimag.2018.12.007","article-title":"Telephone reminders reduce no-shows: A quality initiative at a breast imaging center","volume":"54","author":"Drabkin","year":"2019","journal-title":"Clin. Imaging"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.eswa.2018.02.022","article-title":"Optimizing outpatient appointment system using machine learning algorithms and scheduling rules: A prescriptive analytics framework","volume":"102","author":"Srinivas","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1007\/s11695-018-3480-9","article-title":"Predicting Patient No-show Behavior: A Study in a Bariatric Clinic","volume":"29","author":"Dantas","year":"2019","journal-title":"Obes. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1093\/jamia\/ocy002","article-title":"Designing risk prediction models for ambulatory no-shows across different specialties and clinics","volume":"25","author":"Ding","year":"2018","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"101472","DOI":"10.1016\/j.imu.2024.101472","article-title":"The utilization of AI in healthcare to predict no-shows for dental appointments: A case study conducted in Saudi Arabia","volume":"46","author":"Almutairi","year":"2024","journal-title":"Inform. Med. Unlocked"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"113398","DOI":"10.1016\/j.dss.2020.113398","article-title":"Improving healthcare access management by predicting patient no-show behaviour","volume":"138","author":"Ferro","year":"2020","journal-title":"Decis. Support Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Valero-Bover, D., Gonz\u00e1lez, P., Carot-Sans, G., Cano, I., Saura, P., Otermin, P., Garcia, C., G\u00e1lvez, M., Lupi\u00e1\u00f1ez-Villanueva, F., and Piera-Jim\u00e9nez, J. (2022). Reducing non-attendance in outpatient appointments: Predictive model development, validation, and clinical assessment. BMC Health Serv. Res., 22.","DOI":"10.1186\/s12913-022-07865-y"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s10729-022-09626-z","article-title":"Predicting no-show appointments in a pediatric hospital in Chile using machine learning","volume":"26","author":"Dunstan","year":"2023","journal-title":"Health Care Manag. Sci."},{"key":"ref_12","first-page":"234","article-title":"Developing a predictive model of predicting appointment no-show by using machine learning algorithms","volume":"12","author":"Alshammari","year":"2021","journal-title":"J. Adv. Inf. Technol."},{"key":"ref_13","first-page":"533","article-title":"The Prediction of Outpatient No-Show Visits by Using Deep Neural Network from Large Data","volume":"11","author":"Alshammari","year":"2020","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1038\/s41746-022-00594-w","article-title":"Machine learning approaches to predicting no-shows in pediatric medical appointment","volume":"5","author":"Liu","year":"2022","journal-title":"npj Digit. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/3465055","article-title":"An Attentive Survey of Attention Models","volume":"12","author":"Chaudhari","year":"2021","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","article-title":"Methods for interpreting and understanding deep neural networks","volume":"73","author":"Montavon","year":"2018","journal-title":"Digit. Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"29","DOI":"10.4258\/hir.2018.24.1.29","article-title":"Comparison of models for the prediction of medical costs of spinal fusion in Taiwan diagnosis-related groups by machine learning algorithms","volume":"24","author":"Kuo","year":"2018","journal-title":"Healthc. Inform. Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, J., Shi, J., Chen, J., Du, Z., and Huang, L. (2023). Self-attention random forest for breast cancer image classification. Front. Oncol., 13.","DOI":"10.3389\/fonc.2023.1043463"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.neunet.2022.07.029","article-title":"Attention-based random forest and contamination model","volume":"154","author":"Utkin","year":"2022","journal-title":"Neural Netw."},{"key":"ref_20","unstructured":"Frosst, N., and Hinton, G. (2017). Distilling a Neural Network Into a Soft Decision Tree. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"373","DOI":"10.5144\/0256-4947.2019.373","article-title":"Prediction of hospital no-show appointments through artificial intelligence algorithms","volume":"39","author":"AlMuhaideb","year":"2019","journal-title":"Ann. Saudi Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/20479700.2019.1698864","article-title":"A predictive model for decreasing clinical no-show rates in a primary care setting","volume":"14","author":"Ahmad","year":"2021","journal-title":"Int. J. Healthc. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Batool, T., Abuelnoor, M., El Boutari, O., Aloul, F., and Sagahyroon, A. (2021). Predicting Hospital No-Shows Using Machine Learning. Proceedings of the IoTaIS 2020\u2014Proceedings: 2020 IEEE International Conference on Internet of Things and Intelligence Systems, Institute of Electrical and Electronics Engineers Inc.","DOI":"10.1109\/IoTaIS50849.2021.9359692"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e1708","DOI":"10.7205\/MILMED-D-16-00345","article-title":"Modeling patient no-show history and predicting future outpatient appointment behavior in the veterans health administration","volume":"182","author":"Goffman","year":"2017","journal-title":"Mil. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/s10479-017-2489-0","article-title":"Predicting pediatric clinic no-shows: A decision analytic framework using elastic net and Bayesian belief network","volume":"263","author":"Topuz","year":"2018","journal-title":"Ann. Oper. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2150132718811692","DOI":"10.1177\/2150132718811692","article-title":"Data Analytics and Modeling for Appointment No-show in Community Health Centers","volume":"9","author":"Mohammadi","year":"2018","journal-title":"J. Prim. Care Community Health"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"169","DOI":"10.21315\/mjms2023.30.5.14","article-title":"Machine Learning Predictions on Outpatient No-Show Appointments in a Malaysia Major Tertiary Hospital","volume":"30","author":"Hamdan","year":"2023","journal-title":"Malays. J. Med. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Abushaaban, E., and Agaoglu, M. (2022). Medical Appointment No-Show Prediction Using Machine Learning Techniques. Proceedings of the 2022 2nd International Conference on Computing and Machine Intelligence, ICMI 2022\u2014Proceedings, Institute of Electrical and Electronics Engineers Inc.","DOI":"10.1109\/ICMI55296.2022.9873652"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.dsm.2021.06.002","article-title":"Machine learning-based prediction models for patients no-show in online outpatient appointments","volume":"2","author":"Fan","year":"2021","journal-title":"Data Sci. Manag."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1080\/24725579.2019.1649764","article-title":"A metaheuristic-based stacking model for predicting the risk of patient no-show and late cancellation for neurology appointments","volume":"9","author":"Ahmadi","year":"2019","journal-title":"IISE Trans. Healthc. Syst. Eng."},{"key":"ref_32","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv."},{"key":"ref_33","unstructured":"Nadaraya, E.A. (2026, May 14). On Estimating Regression. Available online: https:\/\/www.mathnet.ru\/eng\/tvp356."},{"key":"ref_34","first-page":"359","article-title":"Smooth regression analysis","volume":"26","author":"Watson","year":"1961","journal-title":"Sankhya Ser. A 1961\u20132002"},{"key":"ref_35","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s13748-023-00301-0","article-title":"Attention and self-attention in random forests","volume":"12","author":"Utkin","year":"2023","journal-title":"Prog. Artif. Intell."},{"key":"ref_37","unstructured":"Zhu, D., Yao, H., Jiang, B., and Yu, P. (2018). Negative Log Likelihood Ratio Loss for Deep Neural Network Classification. arXiv."},{"key":"ref_38","unstructured":"Amalina, N.N. (2026). Prediction-Driven Adaptive Double-Booking Strategy for Outpatient Scheduling: A Multi-Objective Reinforcement Learning Approach. [Master\u2019s Thesis, Kumoh National Institute of Technology]."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/5\/576\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T04:28:50Z","timestamp":1779337730000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/5\/576"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,19]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["systems14050576"],"URL":"https:\/\/doi.org\/10.3390\/systems14050576","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,19]]}}}