{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:22:02Z","timestamp":1792790522758,"version":"4.5.0"},"reference-count":257,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T00:00:00Z","timestamp":1637625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Hongkong Scholar Program","award":["XJ2017028"],"award-info":[{"award-number":["XJ2017028"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,1,31]]},"abstract":"<jats:p>\n                    As a subfield of machine learning,\n                    <jats:italic>reinforcement learning<\/jats:italic>\n                    (RL) aims at optimizing decision making by using interaction samples of an agent with its environment and the potentially delayed feedbacks. In contrast to traditional supervised learning that typically relies on one-shot, exhaustive, and supervised reward signals, RL tackles sequential decision-making problems with sampled, evaluative, and delayed feedbacks simultaneously. Such a distinctive feature makes RL techniques a suitable candidate for developing powerful solutions in various healthcare domains, where diagnosing decisions or treatment regimes are usually characterized by a prolonged period with delayed feedbacks. By first briefly examining theoretical foundations and key methods in RL research, this survey provides an extensive overview of RL applications in a variety of healthcare domains, ranging from dynamic treatment regimes in chronic diseases and critical care, automated medical diagnosis, and many other control or scheduling problems that have infiltrated every aspect of the healthcare system. In addition, we discuss the challenges and open issues in the current research and highlight some potential solutions and directions for future research.\n                  <\/jats:p>","DOI":"10.1145\/3477600","type":"journal-article","created":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T12:36:59Z","timestamp":1637671019000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":502,"title":["Reinforcement Learning in Healthcare: A Survey"],"prefix":"10.1145","volume":"55","author":[{"given":"Chao","family":"Yu","sequence":"first","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiming","family":"Liu","sequence":"additional","affiliation":[{"name":"Hong Kong Baptist University, Kowloon Tong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shamim","family":"Nemati","sequence":"additional","affiliation":[{"name":"UC San Diego, La Jolla, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guosheng","family":"Yin","sequence":"additional","affiliation":[{"name":"The University of Hong Kong, Pokfulam, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,11,23]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"David Abel John Salvatier Andreas Stuhlm\u00fcller and Owain Evans. 2017. Agent-agnostic human-in-the-loop reinforcement learning. arXiv:1701.04079. Retrieved from https:\/\/arxiv.org\/abs\/1701.04079."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2013.2262913"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3934\/mbe.2004.1.223"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.biosystems.2011.07.005"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.5555\/3120007.3120018"},{"key":"e_1_3_2_7_2","first-page":"1245","volume-title":"IEEE Transactions on Medical Imaging","author":"Al Walid Abdullah","year":"2019","unstructured":"Walid Abdullah Al and Il Dong Yun. 2019. Partial policy-based reinforcement learning for anatomical landmark localization in 3d medical images. IEEE Transactions on Medical Imaging 39, 4 (2019), 1245\u20131255."},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Amir Alansary Loic Le Folgoc Ghislain Vaillant Ozan Oktay Yuanwei Li Wenjia Bai Jonathan Passerat-Palmbach Ricardo Guerrero Konstantinos Kamnitsas Benjamin Hou et\u00a0al. 2018. Automatic view planning with multi-scale deep reinforcement learning agents. In International Conference on Medical Image Computing and Computer-Assisted Intervention . Springer 277\u2013285.","DOI":"10.1007\/978-3-030-00928-1_32"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Amir Alansary Ozan Oktay Yuanwei Li Loic Le Folgoc Benjamin Hou Ghislain Vaillant Ben Glocker Bernhard Kainz and Daniel Rueckert. 2018. Evaluating reinforcement learning agents for anatomical landmark detection. Medical Image Analysis 53 (2018) 156\u2013164.","DOI":"10.1016\/j.media.2019.02.007"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.2337\/diab.23.5.397"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2011.2154384"},{"key":"e_1_3_2_12_2","unstructured":"Hideki Asoh Masanori Shiro1 Shotaro Akaho Toshihiro Kamishima Koiti Hasida Eiji Aramaki and Takahide Kohro. 2013. An application of inverse reinforcement learning to medical records of diabetes treatment. In Proceedings of the Workshop on Reinforcement Learning with Generalized Feedback (ECMLPKDD\u201913) . 1\u20138."},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the ICML\u201913 Workshop on Role of Machine Learning in Transforming Healthcare","author":"Asoh Hideki","year":"2013","unstructured":"Hideki Asoh, Masanori Shiro, Shotaro Akaho, Toshihiro Kamishima, K. Hashida, Eiji Aramaki, and Takahide Kohro. 2013. Modeling medical records of diabetes using Markov decision processes. In Proceedings of the ICML\u201913 Workshop on Role of Machine Learning in Transforming Healthcare."},{"issue":"5","key":"e_1_3_2_14_2","article-title":"Machine learning methods for estimating heterogeneous causal effects","volume":"1050","author":"Athey Susan","year":"2015","unstructured":"Susan Athey and Guido W. Imbens. 2015. Machine learning methods for estimating heterogeneous causal effects. stat 1050, 5 (2015).","journal-title":"stat"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/URAI.2018.8441801"},{"key":"e_1_3_2_16_2","first-page":"1187","volume-title":"Proceedings of the IIE Annual Conference","author":"Baniya Abiral","year":"2017","unstructured":"Abiral Baniya, Stephen Herrmann, Qiquan Qiao, and Huitian Lu. 2017. Adaptive interventions treatment modelling and regimen optimization using sequential multiple assignment randomized trials (SMART) and Q-learning. In Proceedings of the IIE Annual Conference. 1187\u20131192."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/3327144.3327175"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157096.3157262"},{"key":"e_1_3_2_19_2","volume-title":"Dynamic Programming","author":"Bellman Richard","year":"2013","unstructured":"Richard Bellman. 2013. Dynamic Programming. Courier Corporation."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/538693"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.2309945"},{"key":"e_1_3_2_22_2","unstructured":"Surya Bhupatiraju Kumar Krishna Agrawal and Rishabh Singh. 2018. Towards mixed optimization for reinforcement learning with program synthesis. arXiv:1807.00403. Retrieved from https:\/\/arxiv.org\/abs\/1807.00403."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2011.15"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1586\/17434440.2013.827515"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-014-5458-8"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.5555\/2984093.2984115"},{"key":"e_1_3_2_27_2","article-title":"Incorporating patient preferences into estimation of optimal individualized treatment rules","author":"Butler Emily L.","year":"2017","unstructured":"Emily L. Butler, Eric B. Laber, Sonia M. Davis, and Michael R. Kosorok. 2017. Incorporating patient preferences into estimation of optimal individualized treatment rules. Biometrics (2017).","journal-title":"Biometrics"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.3233\/IDT-170285"},{"key":"e_1_3_2_29_2","volume-title":"Statistical Reinforcement Learning","author":"Chakraborty Bibhas","year":"2013","unstructured":"Bibhas Chakraborty and Erica E. M. Moodie. 2013. Statistical Reinforcement Learning. Springer, New York. 31\u201352 pages."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1177\/0962280209105013"},{"key":"e_1_3_2_31_2","volume-title":"Proceedings of the Workshop on Model Uncertainty and Risk in Reinforcement Learning (NIPS\u201908)","author":"Chakraborty Bibhas","year":"2008","unstructured":"Bibhas Chakraborty, Victor Strecher, and S. A. Murphy. 2008. Bias correction and confidence intervals for fitted Q-iteration. In Proceedings of the Workshop on Model Uncertainty and Risk in Reinforcement Learning (NIPS\u201908). Citeseer."},{"key":"e_1_3_2_32_2","unstructured":"Chun-Hao Chang Mingjie Mai and Anna Goldenberg. 2018. Dynamic measurement scheduling for adverse event forecasting using deep RL. arXiv:1812.00268. Retrieved from https:\/\/arxiv.org\/abs\/1812.00268."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132635.3132637"},{"key":"e_1_3_2_34_2","unstructured":"Zhengping Che Sanjay Purushotham Robinder Khemani and Yan Liu. 2015. Distilling knowledge from deep networks with applications to healthcare domain. arXiv:1512.03542. Retrieved from https:\/\/arxiv.org\/abs\/1512.03542."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICACI.2016.7449855"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Li-Fang Cheng Niranjani Prasad and Barbara E. Engelhardt. 2018. An optimal policy for patient laboratory tests in intensive care units. arXiv:1808.04679. Retrieved from https:\/\/arxiv.org\/abs\/1808.04679.","DOI":"10.1142\/9789813279827_0029"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/2034063.2034096"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"Travers Ching Daniel S. Himmelstein Brett K. Beaulieu-Jones Alexandr A. Kalinin Brian T. Do Gregory P. Way Enrico Ferrero Paul-Michael Agapow Michael Zietz Michael M Hoffman et\u00a0al. 2018. Opportunities and obstacles for deep learning in biology and medicine. Journal of The Royal Society Interface 15 141 (2018) 20170387.","DOI":"10.1098\/rsif.2017.0387"},{"key":"e_1_3_2_39_2","first-page":"978524","volume-title":"Medical Imaging 2016: Computer-Aided Diagnosis","author":"Chu Tianshu","year":"2016","unstructured":"Tianshu Chu, Jie Wang, and Jiayu Chen. 2016. An adaptive online learning framework for practical breast cancer diagnosis. In Medical Imaging 2016: Computer-Aided Diagnosis, Vol. 9785. International Society for Optics and Photonics, 978524."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2013.6610293"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","unstructured":"Elena Daskalaki Luca Scarnato Peter Diem and Stavroula G. Mougiakakou. 2010. Preliminary results of a novel approach for glucose regulation using an Actor-Critic learning based controller. IET 1\u20135.","DOI":"10.1049\/ic.2010.0287"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-017-4982-y"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1561\/2300000021"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2014.8"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11886-013-0441-8"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-05258-3_5"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1088690"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2006.377527"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.6859"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIDM.2011.5949442"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0316-z"},{"key":"e_1_3_2_52_2","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1007\/978-3-030-00889-5_29","volume-title":"Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support","author":"Etcheverry Mayalen","year":"2018","unstructured":"Mayalen Etcheverry, Bogdan Georgescu, Benjamin Odry, Thomas J. Re, Shivam Kaushik, Bernhard Geiger, Nadar Mariappan, Sasa Grbic, and Dorin Comaniciu. 2018. Nonlinear adaptively learned optimization for object localization in 3D medical images. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Springer, 254\u2013262."},{"issue":"23","key":"e_1_3_2_53_2","first-page":"2526","article-title":"Acute respiratory distress syndrome","volume":"307","author":"Force ARDS Definition Task","year":"2012","unstructured":"ARDS Definition Task Force, V. M. Ranieri, G. D. Rubenfeld, et\u00a0al. 2012. Acute respiratory distress syndrome. J. Am. Assoc. 307, 23 (2012), 2526\u20132533.","journal-title":"J. Am. Assoc."},{"key":"e_1_3_2_54_2","first-page":"1","article-title":"Can the artificial intelligence technique of reinforcement learning use continuously-monitored digital data to optimize treatment for weight loss?","author":"Forman Evan M.","year":"2018","unstructured":"Evan M. Forman, Stephanie G. Kerrigan, Meghan L. Butryn, Adrienne S. Juarascio, Stephanie M. Manasse, Santiago Onta\u00f1\u00f3n, Diane H. Dallal, Rebecca J. Crochiere, and Danielle Moskow. 2018. Can the artificial intelligence technique of reinforcement learning use continuously-monitored digital data to optimize treatment for weight loss?J. Behav. Med. (2018), 1\u201315.","journal-title":"J. Behav. Med."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-012-5313-8"},{"key":"e_1_3_2_56_2","unstructured":"Joseph Futoma Anthony Lin Mark Sendak Armando Bedoya Meredith Clement Cara O\u2019Brien and Katherine Heller. 2018. Learning to treat sepsis with multi-output gaussian process deep recurrent Q-Networks. https:\/\/openreview.net\/forum."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886795"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.020"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2005.40"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2005.1556455"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2006.260685"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-015-0801-4"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-014-3406-5"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2018.06.007"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46726-9_27"},{"key":"e_1_3_2_66_2","article-title":"Multi-scale deep reinforcement learning for real-time 3D-landmark detection in CT scans","author":"Ghesu Florin Cristian","year":"2017","unstructured":"Florin Cristian Ghesu, Bogdan Georgescu, Yefeng Zheng, Sasa Grbic, Andreas Maier, Joachim Hornegger, and Dorin Comaniciu. 2017. Multi-scale deep reinforcement learning for real-time 3D-landmark detection in CT scans. IEEE Trans. Pattern Anal. Mach. Intell. (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113420"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOS968"},{"key":"e_1_3_2_69_2","unstructured":"Tiago Salgado Magalh\u00e3es Taveira Gomes. 2017. Reinforcement learning for primary care and appointment scheduling. Faculdade de Engenharia da Universidade do Porto Mestrado de Engenharia da Informa\u00e7\u00e3o."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969125"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983819"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0310-5"},{"key":"e_1_3_2_73_2","unstructured":"Omer Gottesman Fredrik Johansson Joshua Meier Jack Dent Donghun Lee Srivatsan Srinivasan Linying Zhang Yi Ding David Wihl Xuefeng Peng et\u00a0al. 2018. Evaluating reinforcement learning algorithms in observational health settings. arXiv:1805.12298. Retrieved from https:\/\/arxiv.org\/abs\/1805.12298."},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2000.10473924"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2012.2218595"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.5555\/1622434.1622447"},{"key":"e_1_3_2_77_2","volume-title":"Adaptive Control of Epileptic Seizures Using Reinforcement Learning","author":"Guez Arthur","year":"2010","unstructured":"Arthur Guez. 2010. Adaptive Control of Epileptic Seizures Using Reinforcement Learning. Ph.D. Dissertation. McGill University Library."},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.5555\/1620138.1620148"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSSE.2010.5551776"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0307-0"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2018.09.007"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_9"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_4"},{"key":"e_1_3_2_84_2","first-page":"9","article-title":"Distilling the knowledge in a neural network","volume":"1050","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. stat 1050 (2015), 9.","journal-title":"stat"},{"key":"e_1_3_2_85_2","unstructured":"Irit Hochberg Guy Feraru Mark Kozdoba Shie Mannor Moshe Tennenholtz and Elad Yom-Tov. 2016. A reinforcement learning system to encourage physical activity in diabetes patients. arXiv:1605.04070. Retrieved from https:\/\/arxiv.org\/abs\/1605.04070."},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40708-016-0042-6"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02353793"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2010.09.002"},{"key":"e_1_3_2_89_2","unstructured":"Pierre Humbert Julien Audiffren Cl\u00e9ment Dubost and Laurent Oudre. Learning from an expert. In Porceedings of 30th Conference on Neural Information Processing Systems (NIPS) . 1\u20135."},{"key":"e_1_3_2_90_2","unstructured":"Kyle Humphrey. 2017. Using reinforcement learning to personalize dosing strategies in a simulated cancer trial with high dimensional data. Master\u2019s Theses The University of Arizona."},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2009.090517"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.5555\/2998687.2998730"},{"key":"e_1_3_2_93_2","unstructured":"Abhyuday Jagannatha Philip Thomas and Hong Yu. 2018. Towards high confidence off-policy reinforcement learning for clinical applications. In CausalML Workshop . ICML."},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2017.2700395"},{"key":"e_1_3_2_95_2","first-page":"1","article-title":"Multi-objective optimization of radiotherapy: Distributed Q-learning and agent-based simulation","author":"Jalalimanesh Ammar","year":"2017","unstructured":"Ammar Jalalimanesh, Hamidreza Shahabi Haghighi, Abbas Ahmadi, Hossein Hejazian, and Madjid Soltani. 2017. Multi-objective optimization of radiotherapy: Distributed Q-learning and agent-based simulation. J. Exp. Theoret. Artif. Intell. (2017), 1\u201316.","journal-title":"J. Exp. Theoret. Artif. Intell."},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.matcom.2016.05.008"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.ogx.0000472121.21647.38"},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(70)90103-3"},{"key":"e_1_3_2_99_2","unstructured":"Russell Jeter Christopher Josef Supreeth Shashikumar and Shamim Nemati. 2019. Does the \u201cArtificial Intelligence Clinician\u201d learn optimal treatment strategies for sepsis in intensive care?arXiv:1902.03271. Retrieved from https:\/\/arxiv.org\/abs\/1902.03271."},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1136\/svn-2017-000101"},{"key":"e_1_3_2_101_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2501978"},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"issue":"6","key":"e_1_3_2_103_2","first-page":"1","article-title":"Use of machine-learning approaches to predict clinical deterioration in critically ill patients: A systematicreview","volume":"6","author":"Kamio Tadashi","year":"2017","unstructured":"Tadashi Kamio, Tomoaki Van, and Ken Masamune. 2017. Use of machine-learning approaches to predict clinical deterioration in critically ill patients: A systematicreview. Int. J. Med. Res. Health Sci. 6, 6 (2017), 1\u20137.","journal-title":"Int. J. Med. Res. Health Sci."},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504316"},{"key":"e_1_3_2_105_2","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016145"},{"key":"e_1_3_2_106_2","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.64.6.633"},{"key":"e_1_3_2_107_2","doi-asserted-by":"crossref","unstructured":"Taylor Killian George Konidaris and Finale Doshi-Velez. 2016. Transfer learning across patient variations with hidden parameter Markov decision processes. arXiv:1612.00475. Retrieved from https:\/\/arxiv.org\/abs\/1612.00475.","DOI":"10.1609\/aaai.v31i1.11065"},{"key":"e_1_3_2_108_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295373"},{"key":"e_1_3_2_109_2","doi-asserted-by":"publisher","DOI":"10.5555\/2981780.2981886"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrd1470"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0213-5"},{"key":"e_1_3_2_112_2","volume-title":"Neural Information Processing Systems Workshop on Machine Learning for Health","author":"Komorowski M.","year":"2016","unstructured":"M. Komorowski, A. Gordon, L. A. Celi, and A. Faisal. 2016. A Markov Decision Process to suggest optimal treatment of severe infections in intensive care. In Neural Information Processing Systems Workshop on Machine Learning for Health."},{"key":"e_1_3_2_113_2","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwx027"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66182-7_40"},{"key":"e_1_3_2_115_2","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/asu043"},{"key":"e_1_3_2_116_2","doi-asserted-by":"publisher","DOI":"10.1111\/biom.12132"},{"issue":"1","key":"e_1_3_2_117_2","first-page":"1225","article-title":"Dynamic treatment regimes: Technical challenges and applications","volume":"8","author":"Laber Eric B.","year":"2014","unstructured":"Eric B. Laber, Daniel J. Lizotte, Min Qian, William E. Pelham, and Susan A. Murphy. 2014. Dynamic treatment regimes: Technical challenges and applications. Electr. J. Stat. 8, 1 (2014), 1225.","journal-title":"Electr. J. Stat."},{"key":"e_1_3_2_118_2","doi-asserted-by":"publisher","DOI":"10.5555\/945365.964290"},{"key":"e_1_3_2_119_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X16001837"},{"key":"e_1_3_2_120_2","article-title":"An actor-critic contextual bandit algorithm for personalized interventions using mobile devices","volume":"27","author":"Lei Huitian","year":"2014","unstructured":"Huitian Lei, Ambuj Tewari, and Susan Murphy. 2014. An actor-critic contextual bandit algorithm for personalized interventions using mobile devices. In Advances in Neural Information Processing Systems, Vol. 27. MIT Press, 1\u20139.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_121_2","doi-asserted-by":"publisher","DOI":"10.1109\/69.868905"},{"key":"e_1_3_2_122_2","unstructured":"Kun Li and Joel W. Burdick. 2017. A function approximation method for model-based high-dimensional inverse reinforcement learning. arXiv:1708.07738. Retrieved from https:\/\/arxiv.org\/abs\/1708.07738."},{"key":"e_1_3_2_123_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460563"},{"key":"e_1_3_2_124_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_6"},{"key":"e_1_3_2_125_2","unstructured":"Luchen Li Matthieu Komorowski and Aldo A. Faisal. 2018. The actor search tree critic (ASTC) for off-policy pomdp learning in medical decision making. arXiv:1805.11548. Retrieved from https:\/\/arxiv.org\/abs\/1805.11548."},{"key":"e_1_3_2_126_2","unstructured":"Yuxi Li. 2017. Deep reinforcement learning: An overview. arXiv:1701.07274. Retrieved from https:\/\/arxiv.org\/abs\/1701.07274."},{"key":"e_1_3_2_127_2","unstructured":"Yuxi Li. 2018. Deep reinforcement learning. arXiv:1810.06339. Retrieved from https:\/\/arxiv.org\/abs\/1810.06339."},{"key":"e_1_3_2_128_2","doi-asserted-by":"publisher","DOI":"10.5555\/3298023.3298173"},{"key":"e_1_3_2_129_2","unstructured":"Timothy P. Lillicrap Jonathan J. Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv:1509.02971. Retrieved from https:\/\/arxiv.org\/abs\/1509.02971."},{"key":"e_1_3_2_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2018.8513203"},{"key":"e_1_3_2_131_2","first-page":"271","volume-title":"Proceedings of the Machine Learning for Healthcare Conference","author":"Ling Yuan","year":"2017","unstructured":"Yuan Ling, Sadid A. Hasan, Vivek Datla, Ashequl Qadir, Kathy Lee, Joey Liu, and Oladimeji Farri. 2017. Diagnostic inferencing via improving clinical concept extraction with deep reinforcement learning: A preliminary study. In Proceedings of the Machine Learning for Healthcare Conference. ML Research Press, 271\u2013285."},{"key":"e_1_3_2_132_2","first-page":"895","volume-title":"Proceedings of the 8th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","volume":"1","author":"Ling Yuan","year":"2017","unstructured":"Yuan Ling, Sadid A. Hasan, Vivek Datla, Ashequl Qadir, Kathy Lee, Joey Liu, and Oladimeji Farri. 2017. Learning to diagnose: Assimilating clinical narratives using deep reinforcement learning. In Proceedings of the 8th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Vol. 1. Asian Federation of Natural Language Processing, 895\u2013905."},{"key":"e_1_3_2_133_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2016.1155993"},{"key":"e_1_3_2_134_2","unstructured":"Zachary C. Lipton. 2017. The foctor just won\u2019t accept that!arXiv:1711.08037. Retrieved from https:\/\/arxiv.org\/abs\/1711.08037."},{"key":"e_1_3_2_135_2","doi-asserted-by":"publisher","DOI":"10.1145\/3233231"},{"key":"e_1_3_2_136_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2014.2358639"},{"key":"e_1_3_2_137_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00937-3_29"},{"key":"e_1_3_2_138_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2017.45"},{"key":"e_1_3_2_139_2","unstructured":"Ying Liu Yuanjia Wang Michael R. Kosorok Yingqi Zhao and Donglin Zeng. 2016. Robust hybrid learning for estimating personalized dynamic treatment regimens. arXiv:1611.02314. Retrieved from https:\/\/arxiv.org\/abs\/1611.02314."},{"key":"e_1_3_2_140_2","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2503346"},{"key":"e_1_3_2_141_2","doi-asserted-by":"publisher","DOI":"10.5555\/3104322.3104411"},{"key":"e_1_3_2_142_2","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.3053492"},{"key":"e_1_3_2_143_2","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2013.6696208"},{"key":"e_1_3_2_144_2","doi-asserted-by":"crossref","unstructured":"Daniel J. Luckett Eric B. Laber Anna R. Kahkoska David M. Maahs Elizabeth Mayer-Davis and Michael R. Kosorok. 2018. Estimating dynamic treatment regimes in mobile health using V-learning. Journal of the American Statistical Association 115 530 (2018) 692\u2013706.","DOI":"10.1080\/01621459.2018.1537919"},{"key":"e_1_3_2_145_2","doi-asserted-by":"publisher","DOI":"10.4137\/BII.S31559"},{"key":"e_1_3_2_146_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66182-7_28"},{"key":"e_1_3_2_147_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33492-4_6"},{"key":"e_1_3_2_148_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2790388"},{"key":"e_1_3_2_149_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66179-7_76"},{"key":"e_1_3_2_150_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2011.6033485"},{"key":"e_1_3_2_151_2","volume-title":"Proceedings of the AAAI Workshop: Modern Artificial Intelligence for Health Analytics","author":"Marivate Vukosi Ntsakisi","year":"2014","unstructured":"Vukosi Ntsakisi Marivate, Jessica Chemali, Emma Brunskill, and Michael L. Littman. 2014. Quantifying uncertainty in batch personalized sequential decision making. In Proceedings of the AAAI Workshop: Modern Artificial Intelligence for Health Analytics."},{"key":"e_1_3_2_152_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2009.02.041"},{"key":"e_1_3_2_153_2","doi-asserted-by":"publisher","DOI":"10.5555\/1781238.1781338"},{"key":"e_1_3_2_154_2","doi-asserted-by":"publisher","DOI":"10.5555\/3015812.3015966"},{"key":"e_1_3_2_155_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_156_2","doi-asserted-by":"publisher","DOI":"10.1213\/ANE.0b013e31820334a7"},{"key":"e_1_3_2_157_2","volume-title":"Proceedings of the Annual Conference on Innovative Applications of Artificial Intelligence (IAAI\u201910)","author":"Moore Brett L.","year":"2010","unstructured":"Brett L. Moore, Periklis Panousis, Vivekanand Kulkarni, Larry D. Pyeatt, and Anthony G. Doufas. 2010. Reinforcement learning for closed-loop propofol anesthesia: A human volunteer study. In Proceedings of the Annual Conference on Innovative Applications of Artificial Intelligence (IAAI\u201910). AAAI Press, 1807\u20131813."},{"key":"e_1_3_2_158_2","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2627456"},{"key":"e_1_3_2_159_2","doi-asserted-by":"publisher","DOI":"10.1213\/ANE.0b013e318202cb7c"},{"key":"e_1_3_2_160_2","first-page":"109","volume-title":"Proceedings of the Florida Artificial Intelligence Research Society Conference (FLAIRS\u201904)","author":"Moore Brett L.","year":"2004","unstructured":"Brett L. Moore, Eric D. Sinzinger, Todd M. Quasny, and Larry D. Pyeatt. 2004. Intelligent control of closed-loop sedation in simulated ICU patients. In Proceedings of the Florida Artificial Intelligence Research Society Conference (FLAIRS\u201904). AAAI Press, 109\u2013114."},{"key":"e_1_3_2_161_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00389"},{"key":"e_1_3_2_162_2","unstructured":"Susan A. Murphy Yanzhen Deng Eric B. Laber Hamid Reza Maei Richard S. Sutton and Katie Witkiewitz. 2016. A batch off-policy actor-critic algorithm for optimizing the average reward. arXiv:1607.05047. Retrieved from https:\/\/arxiv.org\/abs\/1607.05047."},{"key":"e_1_3_2_163_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065717500125"},{"key":"e_1_3_2_164_2","unstructured":"Daniel Neil Marwin Segler Laura Guasch Mohamed Ahmed Dean Plumbley Matthew Sellwood and Nathan Brown. 2018. Exploring deep recurrent models with reinforcement learning for molecule design. https:\/\/openreview.net\/forum."},{"key":"e_1_3_2_165_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2016.7591355"},{"key":"e_1_3_2_166_2","volume-title":"Reinforcement Learning","author":"Netto Stelmo Magalh\u00e3es Barros","year":"2008","unstructured":"Stelmo Magalh\u00e3es Barros Netto, Vanessa Rodrigues Coelho Leite, Arist\u00f3fanes Corr\u00eaa Silva, Anselmo Cardoso de Paiva, and Areolino de Almeida Neto. 2008. Application on reinforcement learning for diagnosis based on medical image. In Reinforcement Learning. InTech."},{"key":"e_1_3_2_167_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/4091497"},{"key":"e_1_3_2_168_2","doi-asserted-by":"publisher","DOI":"10.1109\/BHI.2018.8333436"},{"key":"e_1_3_2_169_2","doi-asserted-by":"crossref","unstructured":"Thanh Thi Nguyen Ngoc Duy Nguyen Fernando Bello and Saeid Nahavandi. 2019. A new tensioning method using deep reinforcement learning for surgical pattern cutting. In IEEE International Conference on Industrial Technology (ICIT\u201919) . IEEE 1339\u20131344.","DOI":"10.1109\/ICIT.2019.8755235"},{"key":"e_1_3_2_170_2","doi-asserted-by":"publisher","DOI":"10.1109\/IranianCEE.2017.7985166"},{"key":"e_1_3_2_171_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13321-017-0235-x"},{"key":"e_1_3_2_172_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1017928328829"},{"key":"e_1_3_2_173_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2015.05.013"},{"key":"e_1_3_2_174_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mbs.2017.08.004"},{"key":"e_1_3_2_175_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.expneurol.2013.01.002"},{"key":"e_1_3_2_176_2","volume-title":"A Reinforcement Learning Design for HIV Clinical Trials","author":"Parbhoo Sonali","year":"2014","unstructured":"Sonali Parbhoo. 2014. A Reinforcement Learning Design for HIV Clinical Trials. Ph.D. Dissertation."},{"key":"e_1_3_2_177_2","article-title":"Combining kernel and model based learning for HIV therapy selection","author":"Parbhoo Sonali","year":"2017","unstructured":"Sonali Parbhoo, Jasmina Bogojeska, Maurizio Zazzi, Volker Roth, and Finale Doshi-Velez. 2017. Combining kernel and model based learning for HIV therapy selection. AMIA Summits Transl. Sci. Proc. 2017 (2017), 239\u2013248.","journal-title":"AMIA Summits Transl. Sci. Proc."},{"key":"e_1_3_2_178_2","doi-asserted-by":"publisher","DOI":"10.5555\/2891460.2891568"},{"key":"e_1_3_2_179_2","unstructured":"Xuefeng Peng Yi Ding David Wihl Omer Gottesman Matthieu Komorowski Li-wei H. Lehman Andrew Ross Aldo Faisal and Finale Doshi-Velez. 2019. Improving sepsis treatment strategies by combining deep and kernel-based reinforcement learning. In AMIA Annual Symposium Proceedings Vol. 2018. American Medical Informatics Association 887\u2013896."},{"key":"e_1_3_2_180_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2007.11.026"},{"key":"e_1_3_2_181_2","unstructured":"Brenden K. Petersen Jiachen Yang Will S. Grathwohl Chase Cockrell Claudio Santiago Gary An and Daniel M. Faissol. 2018. Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive personalized multi-cytokine therapy for sepsis. arXiv:1802.10440. Retrieved from https:\/\/arxiv.org\/abs\/1802.10440."},{"key":"e_1_3_2_182_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2007.01.005"},{"key":"e_1_3_2_183_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065709001987"},{"key":"e_1_3_2_184_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aap7885"},{"key":"e_1_3_2_185_2","unstructured":"Niranjani Prasad Li-Fang Cheng Corey Chivers Michael Draugelis and Barbara E Engelhardt. 2017. A reinforcement learning approach to weaning of mechanical ventilation in intensive care units. arXiv:1704.06300. Retreived from https:\/\/arxiv.org\/abs\/1704.06300."},{"key":"e_1_3_2_186_2","unstructured":"Aniruddh Raghu Omer Gottesman Yao Liu Matthieu Komorowski Aldo Faisal Finale Doshi-Velez and Emma Brunskill. 2018. Behaviour policy estimation in off-policy policy evaluation: Calibration matters. arXiv:1807.01066. Retrieved from https:\/\/arxiv.org\/abs\/1807.01066."},{"key":"e_1_3_2_187_2","unstructured":"Aniruddh Raghu Matthieu Komorowski Imran Ahmed Leo Celi Peter Szolovits and Marzyeh Ghassemi. 2017. Deep Reinforcement learning for sepsis treatment. arXiv:1711.09602. Retrieved from https:\/\/arxiv.org\/abs\/1711.09602."},{"key":"e_1_3_2_188_2","first-page":"147","volume-title":"Proceedings of the Machine Learning for Healthcare Conference","author":"Raghu Aniruddh","year":"2017","unstructured":"Aniruddh Raghu, Matthieu Komorowski, Leo Anthony Celi, Peter Szolovits, and Marzyeh Ghassemi. 2017. Continuous state-space models for optimal sepsis treatment: A deep reinforcement learning approach. In Proceedings of the Machine Learning for Healthcare Conference. ML Research Press, 147\u2013163."},{"key":"e_1_3_2_189_2","unstructured":"Aniruddh Raghu Matthieu Komorowski and Sumeetpal Singh. 2018. Model-based reinforcement learning for sepsis treatment. arXiv:1811.09602. Retrieved from https:\/\/arxiv.org\/abs\/1811.09602."},{"key":"e_1_3_2_190_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2016.2636665"},{"key":"e_1_3_2_191_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-017-4683-6"},{"key":"e_1_3_2_192_2","doi-asserted-by":"publisher","DOI":"10.1007\/11564096_32"},{"key":"e_1_3_2_193_2","volume-title":"Proceedings of the Annual Text Retrieval Conference (TREC\u201916)","author":"Roberts Kirk","year":"2016","unstructured":"Kirk Roberts, Matthew S. Simpson, Ellen M. Voorhees, and William R. Hersh. 2016. Overview of the TREC 2016 clinical decision support track. In Proceedings of the Annual Text Retrieval Conference (TREC\u201916). NIST Special Publication."},{"key":"e_1_3_2_194_2","volume-title":"On-line Q-learning Using Connectionist Systems","author":"Rummery Gavin A.","year":"1994","unstructured":"Gavin A. Rummery and Mahesan Niranjan. 1994. On-line Q-learning Using Connectionist Systems. Vol. 37. University of Cambridge, Department of Engineering Cambridge, UK."},{"key":"e_1_3_2_195_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0197-2456(03)00112-0"},{"key":"e_1_3_2_196_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2006.384865"},{"key":"e_1_3_2_197_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSCI.2016.0276"},{"key":"e_1_3_2_198_2","first-page":"511","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201906)","volume":"6","author":"Sahba Farhang","year":"2006","unstructured":"Farhang Sahba, Hamid R. Tizhoosh, and Magdy M. A. Salama. 2006. A reinforcement learning framework for medical image segmentation. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201906), Vol. 6. IEEE, 511\u2013517."},{"key":"e_1_3_2_199_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIISP.2007.369176"},{"key":"e_1_3_2_200_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2342-8-8"},{"key":"e_1_3_2_201_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2017.2657381"},{"key":"e_1_3_2_202_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0253-x"},{"key":"e_1_3_2_203_2","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1007\/1-4020-8066-2_23","volume-title":"Operations Research and Health Care","author":"Schaefer Andrew J.","year":"2005","unstructured":"Andrew J. Schaefer, Matthew D. Bailey, Steven M. Shechter, and Mark S. Roberts. 2005. Modeling medical treatment using Markov decision processes. In Operations Research and Health Care. Springer, 593\u2013612."},{"key":"e_1_3_2_204_2","unstructured":"Tom Schaul John Quan Ioannis Antonoglou and David Silver. 2015. Prioritized experience replay. arXiv:1511.05952. Retrieved from https:\/\/arxiv.org\/abs\/1511.05952."},{"key":"e_1_3_2_205_2","doi-asserted-by":"publisher","DOI":"10.1002\/9783527677016"},{"key":"e_1_3_2_206_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2011.09.007"},{"key":"e_1_3_2_207_2","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv:1707.06347. Retrieved from https:\/\/arxiv.orb\/abs\/1707.06347."},{"key":"e_1_3_2_208_2","doi-asserted-by":"publisher","DOI":"10.1145\/3229710.3229731"},{"key":"e_1_3_2_209_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-010-5229-0"},{"key":"e_1_3_2_210_2","unstructured":"Jun Shu Zongben Xu and Deyu Meng. 2018. Small sample learning in big data era. arXiv:1808.04572. Retrieved from https:\/\/arxiv.org\/abs\/1808.04572."},{"key":"e_1_3_2_211_2","doi-asserted-by":"publisher","DOI":"10.1142\/S021821300500203X"},{"key":"e_1_3_2_212_2","unstructured":"Yousuf M. Soliman. 2014. Personalized medical treatments using novel reinforcement learning algorithms. arXiv:1406.3922. Retrieved from https:\/\/arxiv.org\/abs\/1406.3922."},{"issue":"3","key":"e_1_3_2_213_2","first-page":"901","article-title":"Penalized q-learning for dynamic treatment regimens","volume":"25","author":"Song Rui","year":"2015","unstructured":"Rui Song, Weiwei Wang, Donglin Zeng, and Michael R. Kosorok. 2015. Penalized q-learning for dynamic treatment regimens. Stat. Sin. 25, 3 (2015), 901.","journal-title":"Stat. Sin."},{"key":"e_1_3_2_214_2","doi-asserted-by":"publisher","DOI":"10.5555\/3312046"},{"key":"e_1_3_2_215_2","unstructured":"Fengyi Tang Kaixiang Lin Ikechukwu Uchendu Hiroko H Dodge and Jiayu Zhou. 2018. Improving mild cognitive impairment prediction via reinforcement learning and dialogue simulation. arXiv:1802.06428. Retrieved from https:\/\/arxiv.org\/abs\/1802.06428."},{"key":"e_1_3_2_216_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295035"},{"key":"e_1_3_2_217_2","volume-title":"Proceedings of the NIPS Workshop on Deep Reinforcement Learning","author":"Tang Kai-Fu","year":"2016","unstructured":"Kai-Fu Tang, Hao-Cheng Kao, Chun-Nan Chou, and Edward Y. Chang. 2016. Inquire and diagnose: Neural Symptom checking ensemble using deep reinforcement learning. In Proceedings of the NIPS Workshop on Deep Reinforcement Learning."},{"key":"e_1_3_2_218_2","doi-asserted-by":"crossref","unstructured":"Yebin Tao Lu Wang and Daniel Almirall. 2018. Tree-based reinforcement learning for estimating optimal dynamic treatment regimes. Ann. Appl. Stat. 12 3 (2018) 1914\u20131938.","DOI":"10.1214\/18-AOAS1137"},{"key":"e_1_3_2_219_2","doi-asserted-by":"publisher","DOI":"10.5555\/998671.999060"},{"key":"e_1_3_2_220_2","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1755839"},{"key":"e_1_3_2_221_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989275"},{"key":"e_1_3_2_222_2","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045616"},{"key":"e_1_3_2_223_2","volume-title":"Proceedings of the Annual Conference on Innovative Applications of Artificial Intelligence (IAAI\u201909)","author":"Thomas Philip S.","year":"2009","unstructured":"Philip S. Thomas, Antonie J. van den Bogert, Kathleen M. Jagodnik, and Michael S. Branicky. 2009. Application of the actor-critic architecture to functional electrical stimulation control of a human arm. In Proceedings of the Annual Conference on Innovative Applications of Artificial Intelligence (IAAI\u201909). AAAI Press."},{"key":"e_1_3_2_224_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0300-7"},{"key":"e_1_3_2_225_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.12625"},{"key":"e_1_3_2_226_2","unstructured":"Chandra Prasetyo Utomo Xue Li and Weitong Chen. 2018. Treatment recommendation in critical care: A scalable and interpretable approach in partially observable health states."},{"key":"e_1_3_2_227_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_7"},{"key":"e_1_3_2_228_2","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016191"},{"key":"e_1_3_2_229_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_8"},{"key":"e_1_3_2_230_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12938-018-0569-2"},{"key":"e_1_3_2_231_2","first-page":"5052","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Verma Abhinav","year":"2018","unstructured":"Abhinav Verma, Vijayaraghavan Murali, Rishabh Singh, Pushmeet Kohli, and Swarat Chaudhuri. 2018. Programmatically interpretable reinforcement learning. In Proceedings of the International Conference on Machine Learning. Omnipress, 5052\u20135061."},{"key":"e_1_3_2_232_2","doi-asserted-by":"publisher","DOI":"10.1186\/cc11500"},{"key":"e_1_3_2_233_2","volume-title":"Reinforcement Learning in Models of Adaptive Medical Treatment Strategies","author":"Vincent Robert","year":"2014","unstructured":"Robert Vincent. 2014. Reinforcement Learning in Models of Adaptive Medical Treatment Strategies. Ph.D. Dissertation. McGill University Libraries."},{"key":"e_1_3_2_234_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219961"},{"key":"e_1_3_2_235_2","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045601"},{"key":"e_1_3_2_236_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_3_2_237_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2033"},{"key":"e_1_3_2_238_2","unstructured":"Wei-Hung Weng Mingwu Gao Ze He Susu Yan and Peter Szolovits. 2017. Representation and reinforcement learning for personalized glycemic control in septic patients. arXiv:1712.00654. Retrieved from https:\/\/arxiv.org\/abs\/1712.00654."},{"key":"e_1_3_2_239_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3"},{"key":"e_1_3_2_240_2","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1120.0566"},{"key":"e_1_3_2_241_2","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3208017"},{"key":"e_1_3_2_242_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504239"},{"key":"e_1_3_2_243_2","doi-asserted-by":"publisher","DOI":"10.5555\/2997046.2997175"},{"key":"e_1_3_2_244_2","unstructured":"Jiayu Yao Taylor Killian George Konidaris and Finale Doshi-Velez. 2018. Direct policy transfer via hidden parameter markov decision processes. In LLARLA Workshop FAIM vol. 2018 ."},{"key":"e_1_3_2_245_2","first-page":"89","article-title":"Agent-based simulation for blood glucose","volume":"5","author":"Yasini Sholeh","year":"2009","unstructured":"Sholeh Yasini, Mohammad Bagher Naghibi Sistani, and Ali Karimpour. 2009. Agent-based simulation for blood glucose. Int. J. Appl. Sci. Eng. Technol. 5 (2009), 89\u201395.","journal-title":"Int. J. Appl. Sci. Eng. Technol."},{"key":"e_1_3_2_246_2","first-page":"161","volume-title":"Proceedings of the Machine Learning for Healthcare Conference","author":"Yauney Gregory","year":"2018","unstructured":"Gregory Yauney and Pratik Shah. 2018. Reinforcement learning with action-derived rewards for chemotherapy and clinical trial dosing regimen selection. In Proceedings of the Machine Learning for Healthcare Conference. ML Research Press, 161\u2013226."},{"key":"e_1_3_2_247_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7994"},{"key":"e_1_3_2_248_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0755-6"},{"key":"e_1_3_2_249_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0763-6"},{"key":"e_1_3_2_250_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-1120-5"},{"key":"e_1_3_2_251_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2019.8904645"},{"key":"e_1_3_2_252_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00937-3_86"},{"key":"e_1_3_2_253_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.3720"},{"key":"e_1_3_2_254_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1541-0420.2011.01572.x"},{"key":"e_1_3_2_255_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2014.2309951"},{"key":"e_1_3_2_256_2","doi-asserted-by":"publisher","DOI":"10.1108\/17563781211255862"},{"key":"e_1_3_2_257_2","doi-asserted-by":"publisher","DOI":"10.1145\/3233547.3233554"},{"key":"e_1_3_2_258_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00928-1_67"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477600","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477600","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T14:10:37Z","timestamp":1750169437000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477600"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,23]]},"references-count":257,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1,31]]}},"alternative-id":["10.1145\/3477600"],"URL":"https:\/\/doi.org\/10.1145\/3477600","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,23]]},"assertion":[{"value":"2020-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}