{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T16:59:23Z","timestamp":1781369963273,"version":"3.54.1"},"reference-count":46,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T00:00:00Z","timestamp":1764288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Hospitals must allocate beds and staff effectively under volatile arrival patterns, where scheduling errors can cause preventable harm. This study introduces a fairness-aware, forecast-informed reinforcement learning framework for hospital scheduling, explicitly integrating fairness constraints, short-term demand forecasts, and SHAP-based explainability. The state fuses patient and system context with short-horizon demand forecasts, mean arrivals (\u03bb^), and volatility (\u03c3^2). The reward jointly optimizes efficiency, equity, and safety by penalizing waiting, diversions\/transfers, ICU misuse, overtime, and cross-ward disparity. Using a benchmark-aligned synthetic cohort (60k visits over one year), the approach is compared against First-Come-First-Served (FCFS) and ablations without forecast features. The learned policy halves the mean waiting time (from 215.3 to 102.5 min), reduces diversions\/transfers (from 27.6% to 7.8%), improves ICU match accuracy (from 93.4% to 95.1%), raises the fairness index by 45%, and cuts staff overtime by 56%. Adding forecast signals yields further gains over forecast-naive DQN (9% shorter waits; 28% fewer diversions\/transfers), with robustness under demand surges and triage-mix shifts. By unifying equity constraints, anticipatory context, and explanation, the method turns reactive queues into proactive, auditable control and is extensible to perioperative flow, disaster triage, and outpatient capacity management.<\/jats:p>","DOI":"10.3390\/info16121039","type":"journal-article","created":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T08:13:49Z","timestamp":1764576829000},"page":"1039","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Fairness-Aware Intelligent Reinforcement (FAIR): An AI-Powered Hospital Scheduling Framework"],"prefix":"10.3390","volume":"16","author":[{"given":"Ruba","family":"Abualrous","sequence":"first","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hala","family":"Zouzou","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6301-8783","authenticated-orcid":false,"given":"Rita","family":"Zgheib","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alaa","family":"Hasan","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bilal","family":"Hijazi","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6494-414X","authenticated-orcid":false,"given":"Arash","family":"Kermani","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Computational Sciences, Canadian University Dubai, Dubai 117781, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,28]]},"reference":[{"key":"ref_1","unstructured":"U.S. Centers for Disease Control and Prevention (CDC) (2022). Emergency Department Visits: Annual Report."},{"key":"ref_2","unstructured":"American Hospital Association (AHA) (2023). Hospital Statistics: Workforce and Capacity Trends, American Hospital Association (AHA)."},{"key":"ref_3","unstructured":"Organisation for Economic Co-operation and Development (OECD) (2023). Health at a Glance 2023: OECD Indicators, Organisation for Economic Co-operation and Development (OECD)."},{"key":"ref_4","unstructured":"World Health Organization (WHO) (2022). Global Strategy on Human Resources for Health: Workforce 2030 (Update)."},{"key":"ref_5","unstructured":"OECD\/WHO (2022). Hospital capacity, beds, and occupancy, OECD Health Data."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1038\/s41591-018-0213-5","article-title":"The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care","volume":"24","author":"Komorowski","year":"2018","journal-title":"Nat. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s10479-009-0569-5","article-title":"Clinic scheduling models with overbooking for patients with heterogeneous no-show probabilities","volume":"178","author":"Zhang","year":"2010","journal-title":"Ann. Oper. Res."},{"key":"ref_8","first-page":"652","article-title":"Operating theatre planning with mixed integer programming","volume":"147","author":"Guinet","year":"2003","journal-title":"Eur. J. Oper. Res."},{"key":"ref_9","first-page":"7551","article-title":"Fairness-aware reinforcement learning for healthcare queues","volume":"33","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_10","unstructured":"Suresh, H., Venkatasubramanian, S., Guttag, J., and Barocas, S. (2022, January 21\u201324). Fairness in ICU resource allocation: Reinforcement learning approaches. Proceedings of the ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea."},{"key":"ref_11","first-page":"102289","article-title":"Multi-agent reinforcement learning for hospital resource coordination","volume":"128","author":"Wang","year":"2022","journal-title":"Artif. Intell. Med."},{"key":"ref_12","unstructured":"Lundberg, S.M., and Lee, S.-I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_13","first-page":"102108","article-title":"Reinforcement learning in healthcare: A survey","volume":"117","author":"Liu","year":"2021","journal-title":"Artif. Intell. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3477600","article-title":"Reinforcement learning in healthcare: A survey","volume":"55","author":"Yu","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1093\/bib\/bbx044","article-title":"Deep learning for healthcare: Review, opportunities and challenges","volume":"19","author":"Miotto","year":"2018","journal-title":"Briefings Bioinform."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1589","DOI":"10.1109\/JBHI.2017.2767063","article-title":"Deep EHR: A survey of recent advances in deep learning techniques for electronic health record analysis","volume":"22","author":"Shickel","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_17","unstructured":"Agency for Healthcare Research and Quality (AHRQ) (2022). Using Data to Reduce Emergency Department Crowding."},{"key":"ref_18","unstructured":"American College of Emergency Physicians (ACEP) (2023). Boarding and ED Crowding: Policy Statement."},{"key":"ref_19","unstructured":"Box, R.A., Jenkins, G., Reinsel, G.M., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, Wiley. [5th ed.]."},{"key":"ref_20","unstructured":"Hyndman, R.J., and Athanasopoulos, G. (2021). Forecasting: Principles and Practice, OTexts. [3rd ed.]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v027.i03","article-title":"Automatic time series forecasting: The forecast package for R","volume":"27","author":"Hyndman","year":"2008","journal-title":"J. Stat. Softw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.ijforecast.2006.03.001","article-title":"Another look at measures of forecast accuracy","volume":"22","author":"Hyndman","year":"2006","journal-title":"Int. J. Forecast."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Durbin, J., and Koopman, S.J. (2012). Time Series Analysis by State Space Methods, Oxford University Press. [2nd ed.].","DOI":"10.1093\/acprof:oso\/9780199641178.001.0001"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1016\/0304-4076(86)90063-1","article-title":"Generalized autoregressive conditional heteroskedasticity","volume":"31","author":"Bollerslev","year":"1986","journal-title":"J. Econom."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"987","DOI":"10.2307\/1912773","article-title":"Autoregressive conditional heteroscedasticity with estimates of the variance of UK inflation","volume":"50","author":"Engle","year":"1982","journal-title":"Econometrica"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"L\u00fctkepohl, H. (2005). New Introduction to Multiple Time Series Analysis, Springer.","DOI":"10.1007\/978-3-540-27752-1"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_28","unstructured":"Lundberg, S.M., Erion, G., and Lee, S.-I. (2018). Consistent individualized feature attribution for tree ensembles. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_29","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_30","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_32","unstructured":"Chollet, F. (2015). Keras, GitHub repository."},{"key":"ref_33","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2025, November 02). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_34","unstructured":"Jain, R. (1984). A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer Systems, Eastern Research Laboratory, Digital Equipment Corporation. Digital Equipment Corporation Technical Report DEC-TR-301."},{"key":"ref_35","unstructured":"Rao, A., and Wang, J. (2018, January 17\u201320). Quantifying fairness in AI systems: A survey of metrics and applications. Proceedings of the IEEE International Conference on Data Mining Workshops, Singapore."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e84","DOI":"10.1136\/medethics-2020-106815","article-title":"How can we decide a fair allocation of healthcare resources during a pandemic?","volume":"47","author":"Roadevin","year":"2021","journal-title":"J. Med Ethics"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","article-title":"The Ethics of AI Ethics: An Evaluation of Guidelines","volume":"30","author":"Hagendorff","year":"2020","journal-title":"Minds Mach."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, Y., Mao, C., Huang, K., Wang, H., Yu, Z., Wang, M., and Luo, Y. (2025, January 16\u201322). Deep Reinforcement Learning for Efficient and Fair Allocation of Healthcare Resources. Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.","DOI":"10.24963\/ijcai.2025\/1088"},{"key":"ref_39","unstructured":"Suresh, H., Guttag, J., and Horowitz, M. (2021, January 2\u20139). Clinical allocation via constrained reinforcement learning. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual Event."},{"key":"ref_40","unstructured":"Candel, A., Parmar, V., LeDell, E., and Arora, A. (2016). Deep Learning with H2O, H2O.ai."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13\u201317). Why should I trust you? Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_42","first-page":"17","article-title":"A hybrid tabu search algorithm for patient-to-room assignment in hospitals","volume":"59","author":"Demeester","year":"2010","journal-title":"Comput. Ind. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1007\/s10729-023-09652-5","article-title":"Combining machine learning and optimization for the operational patient-bed assignment problem","volume":"26","author":"Walther","year":"2023","journal-title":"Health Care Manag. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D graphics environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comput. Sci. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MCSE.2011.37","article-title":"The NumPy array: A structure for efficient numerical computation","volume":"13","author":"Colbert","year":"2011","journal-title":"Comput. Sci. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: Fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen","year":"2020","journal-title":"Nat. Methods"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/12\/1039\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T09:07:58Z","timestamp":1764666478000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/12\/1039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,28]]},"references-count":46,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["info16121039"],"URL":"https:\/\/doi.org\/10.3390\/info16121039","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,28]]}}}