{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T13:52:21Z","timestamp":1750859541144,"version":"3.37.3"},"reference-count":83,"publisher":"Wiley","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004054","name":"King Abdulaziz University","doi-asserted-by":"publisher","award":["DF-458-156-1441"],"award-info":[{"award-number":["DF-458-156-1441"]}],"id":[{"id":"10.13039\/501100004054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientific Programming"],"published-print":{"date-parts":[[2020,11,27]]},"abstract":"<jats:p>Diseases can have a huge impact on the quality of life of the human population. Humans have always been in the quest to find strategies to avoid diseases that are life-threatening or affect the quality of life of humans. Effective use of resources available to human to control different diseases has always been critical. Researchers are recently more interested to find AI-based solutions to control the human population from diseases due to the overwhelming popularity of deep learning. There are many supervised techniques that have always been applied for disease diagnosis. However, the main problem of supervised based solutions is the availability of data, which is not always possible or not always complete. For instance, we do not have enough data that shows the different states of humans and different states of environments, and how all different actions taken by humans or viruses have ultimately resulted in a disease that eventually takes the lives of humans. Therefore, there is a need to find unsupervised based solutions or some techniques that do not have a dependency on the underlying dataset. In this paper, we have explored the reinforcement learning approach. We have tried different reinforcement learning algorithms to research different solutions for the prevention of diseases in the simulation of the human population. We have explored different techniques for controlling the transmission of diseases and its effects on health in the human population simulated in an environment. Our algorithms have found out policies that are best for the human population to protect themselves from the transmission and infection of malaria. The paper concludes that deep learning-based algorithms such as Deep Deterministic Policy Gradient (DDPG) have outperformed traditional algorithms such as Q-Learning or SARSA.<\/jats:p>","DOI":"10.1155\/2020\/7627290","type":"journal-article","created":{"date-parts":[[2020,11,28]],"date-time":"2020-11-28T19:05:19Z","timestamp":1606590319000},"page":"1-13","source":"Crossref","is-referenced-by-count":9,"title":["Optimal Policy Learning for Disease Prevention Using Reinforcement Learning"],"prefix":"10.1155","volume":"2020","author":[{"given":"Zahid","family":"Alam Khan","sequence":"first","affiliation":[{"name":"China West Normal University, Nanchong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhengyong","family":"Feng","sequence":"additional","affiliation":[{"name":"China West Normal University, Nanchong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1355-3881","authenticated-orcid":true,"given":"M. Irfan","family":"Uddin","sequence":"additional","affiliation":[{"name":"Institute of Computing, Kohat University of Science and Technology, Kohat, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noor","family":"Mast","sequence":"additional","affiliation":[{"name":"Institute of Computing, Kohat University of Science and Technology, Kohat, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4275-9731","authenticated-orcid":true,"given":"Syed Atif","family":"Ali Shah","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and Information Technology, Northern University, Nowshera, Pakistan"},{"name":"Faculty of Computer and Information Technology, Al-Madinah International University, Kuala Lumpur, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Imtiaz","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science, University of Swabi, Swabi, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1698-0237","authenticated-orcid":true,"given":"Mahmoud Ahmad","family":"Al-Khasawneh","sequence":"additional","affiliation":[{"name":"Faculty of Computer and Information Technology, Al-Madinah International University, Kuala Lumpur, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0787-8225","authenticated-orcid":true,"given":"Marwan","family":"Mahmoud","sequence":"additional","affiliation":[{"name":"King Abdulaziz University, Jeddah, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1136\/jech.50.2.149","article-title":"The effects of illness on quality of life: findings from a survey of households in great britain","volume":"50","author":"A. Bowling","year":"1996","journal-title":"Journal of Epidemiology and Community Health"},{"key":"2","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1093\/fampra\/17.2.159","article-title":"The impact of chronic diseases on the health-related quality of life (HRQOL) of Chinese patients in primary care","volume":"17","author":"C. L. Lam","year":"2000","journal-title":"Family Practice"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/2525941"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1002\/ps.5460"},{"key":"5","doi-asserted-by":"crossref","first-page":"261","DOI":"10.2174\/156652406776055203","article-title":"Prevention of malaria using ITNs: potential for achieving the millennium development goals","volume":"6","author":"F. Binka","year":"2006","journal-title":"Current Molecular Medicine"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1186\/s12936-016-1652-4"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1186\/s13071-019-3683-5"},{"key":"8","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1016\/S1473-3099(19)30222-1","article-title":"Malaria vaccination: a major milestone","volume":"19","author":"T. L. I. Diseases","year":"2019","journal-title":"The Lancet Infectious Diseases"},{"key":"9","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.chom.2018.06.008","article-title":"Malaria vaccines: Recent advances and new horizons","volume":"24","author":"S. J. Draper","year":"2018","journal-title":"Cell Host & Microbe"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.14569\/ijacsa.2018.091064"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.14569\/ijacsa.2018.090973"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1038\/s41524-019-0221-0"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1016\/s1470-2045(19)30149-4"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1136\/leader-2018-000071"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1136\/svn-2017-000101"},{"key":"16","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1109\/TKDE.2010.152","article-title":"\u201cA machine learning approach for identifying disease-treatment relations in short texts","volume":"23","author":"O. Frunza","year":"2011","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1016\/s2589-7500(19)30123-2"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.5822"},{"author":"Y. Liu","key":"19","article-title":"\u201cDeep reinforcement learning for dynamic treatment regimes on medical registry data"},{"key":"20","doi-asserted-by":"crossref","DOI":"10.1561\/9781680835397","volume-title":"An Introduction to Deep Reinforce-Ment Learning","author":"V. Franc\u0327ois-Lavet","year":"2018"},{"volume-title":"Reinforcement Learning and Video Games","author":"Y. Zheng","key":"21"},{"volume-title":"Reinforcement Learning in Games","author":"I. Szita","key":"22","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-27645-3_17"},{"article-title":"Deep reinforcement learning for general video game AI","author":"R. R. Torrado","key":"23","doi-asserted-by":"crossref","DOI":"10.1109\/CIG.2018.8490422"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1186\/s41479-019-0064-y"},{"article-title":"Model-based reinforcement learning for sepsis treatment","year":"2018","author":"A. Raghu","key":"25"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2011.01222.x"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.7603\/s40601-014-0021-9"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/msp.2017.2743240"},{"volume-title":"Factor Models for Non-Stationary Series: Estimates of Monthly U.S. GDP","year":"2017","author":"M. Hengge","key":"29"},{"key":"30","article-title":"Thirty years of evidence on the efficacy of drug treatments for chronic heart failure with reduced ejection fraction","volume":"10","author":"H. Burnett","year":"2017","journal-title":"Circulation: Heart Failure"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.316.7131.567"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1177\/1094342015584495"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1093\/molbev\/msy088"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1111\/nyas.12462"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000003"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4809(76)90001-x"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-016-0369-1"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0191-0"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.7702"},{"first-page":"24","article-title":"Sequential decision-making in healthcare IOT: real-time health monitoring, treatments and interven- tions","author":"D. Zois","key":"40"},{"key":"41","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1177\/0272989X09353194","article-title":"\u201cMarkov decision processes: a tool for sequential decision mak- ing under uncertainty,\u201d Medical decision making","volume":"30","author":"O. Alagoz","year":"2010","journal-title":"An International Journal of the Society for Medical Decision Making"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2012.12.003"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/5843932"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/1373087"},{"article-title":"Long-term visitation value for deep exploration in sparse reward reinforcement learning","year":"2020","author":"S. Parisi","key":"45"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.1109\/access.2017.2694446"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph15081596"},{"first-page":"1","article-title":"Classification accuracies of malaria infected cells using deep convolutional neural networks based on decompressed images","author":"Y. Dong","key":"48"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.4568"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1142\/s0129065709001987"},{"key":"51","doi-asserted-by":"crossref","first-page":"1422","DOI":"10.1111\/j.1541-0420.2011.01572.x","article-title":"Reinforcement learning strategies for clinical trials in nonsmall cell lung cancer","volume":"67","author":"Y. Zhao","year":"2011","journal-title":"Biometrics"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7994"},{"first-page":"2447","article-title":"Supervised reinforcement learning with recurrent neural network for dynamic treatment recommendation","author":"L. Wang","key":"53"},{"first-page":"161","article-title":"Classification accuracies of malaria infected cells using deep convolutional neural networks based on decompressed imagesreinforcement learning with action-derived rewards for chemotherapy and clinical trial dosing regimen selection","author":"G. Yauney","key":"54"},{"article-title":"A reinforcement learning system to encourage physical activity in diabetes patients","year":"2016","author":"I. Hochberg","key":"55"},{"volume-title":"Representation and Reinforcement Learning for Person-Alized Glycemic Control in Septic Patients","year":"2017","author":"W.-H. Weng","key":"56"},{"article-title":"Learning optimal policies from observational data","year":"2018","author":"O. Atan","key":"57"},{"volume-title":"Novel Exploration Techniques (Nets) for Malaria Policy Interventions","year":"2017","author":"O. Bent","key":"58"},{"volume-title":"Evaluating Reinforcement Learning Algorithms in Observational Health Settings","year":"2018","author":"O. Gottesman","key":"59"},{"volume-title":"Reinforcement Learning in Healthcare: A Survey","year":"2019","author":"C. Yu","key":"60"},{"author":"H.-C. Kao","key":"61","article-title":"Context-aware symptom checking for disease diagnosis using hierarchical reinforcement learning"},{"key":"62","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1159\/000492670","article-title":"Deep reinforcement learning in medicine","volume":"5","author":"A. Jonsson","year":"2018","journal-title":"Kidney Diseases"},{"volume-title":"Policy Learning for Malaria Control","year":"2019","author":"V. B. Nguyen","key":"63"},{"key":"64","doi-asserted-by":"publisher","DOI":"10.1109\/access.2017.2694446"},{"key":"65","doi-asserted-by":"publisher","DOI":"10.1109\/41.538609"},{"first-page":"2951","article-title":"Practical bayesian optimization of machine learning algorithms","author":"J. Snoek","key":"66"},{"key":"67","doi-asserted-by":"publisher","DOI":"10.1186\/s12936-018-2442-y"},{"key":"68","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3458775"},{"key":"69","doi-asserted-by":"publisher","DOI":"10.1109\/SECON.2017.7925268"},{"key":"70","doi-asserted-by":"publisher","DOI":"10.3390\/bdcc2020013"},{"key":"71","doi-asserted-by":"publisher","DOI":"10.5897\/jphe2018.1070"},{"key":"72","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/7607612"},{"key":"73","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/9135196"},{"key":"74","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/5941096"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"R. S. Sutton","key":"75"},{"volume-title":"Learning from Delayed Rewards","author":"C. Watkins","key":"76"},{"first-page":"703","article-title":"Convergence of stochastic iterative dynamic programming algo- rithms","author":"T. Jaakkola","key":"77"},{"volume-title":"A Tutorial on Reinforcement Learning Techniques","author":"C. H. C. Ribeiro","key":"78"},{"key":"79","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI.2016.7849837"},{"key":"80","doi-asserted-by":"crossref","first-page":"2315","DOI":"10.1587\/transinf.2017EDP7278","article-title":"Deep reinforcement learning with sarsa and Q-learning: a hybrid approach","volume":"E101","author":"Z.-x. Xu","year":"2018","journal-title":"IEICE Transactions on Information and Systems"},{"key":"81","doi-asserted-by":"publisher","DOI":"10.3390\/en12183461"},{"key":"82","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2019.2921159"},{"article-title":"A theoretical analysis of deep Q-learning","year":"2020","author":"J. Fan","key":"83"}],"container-title":["Scientific Programming"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2020\/7627290.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2020\/7627290.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2020\/7627290.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,28]],"date-time":"2020-11-28T19:05:25Z","timestamp":1606590325000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/sp\/2020\/7627290\/"}},"subtitle":[],"editor":[{"given":"Shaukat","family":"Ali","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":83,"alternative-id":["7627290","7627290"],"URL":"https:\/\/doi.org\/10.1155\/2020\/7627290","relation":{},"ISSN":["1875-919X","1058-9244"],"issn-type":[{"type":"electronic","value":"1875-919X"},{"type":"print","value":"1058-9244"}],"subject":[],"published":{"date-parts":[[2020,11,27]]}}}