{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:24:31Z","timestamp":1785543871496,"version":"3.56.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,3,29]],"date-time":"2019-03-29T00:00:00Z","timestamp":1553817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,3,29]]},"abstract":"<jats:p>Protecting citizens' lives from emergent accidents (e.g. traffic accidents) and diseases (e.g. heart attack) is of vital importance in urban computing. Every day many people are caught in emergent accidents or diseases and thus need ambulances to transport them to hospitals. In this paper, we propose a dynamic ambulance redeployment system to reduce the time needed for ambulances to pick up patients and to increase the probability of patients being saved in time. For patients in danger, every second counts. Specifically, whenever there is an ambulance becoming available (e.g. finishing transporting a patient to a hospital), our dynamic ambulance redeployment system will redeploy it to a proper ambulance station such that it can better pick up future patients. However, the dynamic ambulance redeployment is challenging, as when we redeploy an available ambulance we need to simultaneously consider each station's multiple dynamic factors. To trade off these multiple factors using handcrafted rules are almost impossible. To deal with this issue, we propose using a deep neural network, called deep score network, to balance each station's dynamic factors into one score, leveraging the excellent representation ability of deep neural networks. And then we propose a deep reinforcement learning framework to learn the deep score network. Finally, based on the learned deep score network, we provide an effective dynamic ambulance redeployment algorithm. Experiment results using data collected in real world show clear advantages of our method over baselines, e.g. comparing with baselines, our method can save ~100 seconds (~20%) of average pickup time of patients and improve the ratio of patients being picked up within 10 minutes from 0.786 to 0.838. With our method, people in danger can be better saved.<\/jats:p>","DOI":"10.1145\/3314402","type":"journal-article","created":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T11:57:40Z","timestamp":1554206260000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["A Deep Reinforcement Learning-Enabled Dynamic Redeployment System for Mobile Ambulances"],"prefix":"10.1145","volume":"3","author":[{"given":"Shenggong","family":"Ji","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Zheng","sequence":"additional","affiliation":[{"name":"JD Urban Computing Business Unit, Beijing, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaoyuan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianrui","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Southwest Jiaotong University, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,3,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2743240"},{"key":"e_1_2_1_2_1","unstructured":"ASIRT. 2018. Road Crash Statistics. http:\/\/asirt.org\/Initiatives\/Informing-Road-Users\/Road-Safety-Facts\/Road-Crash-Statistics.  ASIRT. 2018. Road Crash Statistics. http:\/\/asirt.org\/Initiatives\/Informing-Road-Users\/Road-Safety-Facts\/Road-Crash-Statistics."},{"key":"e_1_2_1_3_1","unstructured":"Christopher M. Bishop. 2007. Pattern recognition and machine learning 5th Edition. Springer. http:\/\/www.worldcat.org\/oclc\/71008143.  Christopher M. Bishop. 2007. Pattern recognition and machine learning 5th Edition. Springer. http:\/\/www.worldcat.org\/oclc\/71008143."},{"key":"e_1_2_1_4_1","unstructured":"Tianjin EMS center. 2015. Emergency medical services center of Tianjin. http:\/\/tianjin.emss.cn\/hj.htm.  Tianjin EMS center. 2015. Emergency medical services center of Tianjin. http:\/\/tianjin.emss.cn\/hj.htm."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2015.2443799"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1435-5597.1974.tb00902.x"},{"key":"e_1_2_1_7_1","unstructured":"Cleveland Clinic. 2018. Sudden Cardiac Statistics. https:\/\/my.clevelandclinic.org\/health\/diseases\/17522-sudden-cardiac-death-sudden-cardiac-arrest.  Cleveland Clinic. 2018. Sudden Cardiac Statistics. https:\/\/my.clevelandclinic.org\/health\/diseases\/17522-sudden-cardiac-death-sudden-cardiac-arrest."},{"key":"e_1_2_1_8_1","unstructured":"Thomas H. Cormen Charles E. Leiserson Ronald L. Rivest and Clifford Stein. 2009. Introduction to Algorithms (3. ed.). MIT Press.   Thomas H. Cormen Charles E. Leiserson Ronald L. Rivest and Clifford Stein. 2009. Introduction to Algorithms (3. ed.). MIT Press."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.17.1.48"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10729-014-9271-5"},{"key":"e_1_2_1_11_1","unstructured":"Heart Foundation. 2018. Sudden Cardiac Statistics 2. https:\/\/www.heartfoundation.org.au\/your-heart\/sudden-cardiac-death.  Heart Foundation. 2018. Sudden Cardiac Statistics 2. https:\/\/www.heartfoundation.org.au\/your-heart\/sudden-cardiac-death."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(01)00103-X"},{"key":"e_1_2_1_13_1","unstructured":"Ian Goodfellow Yoshua Bengio and Aaron Courville. 2016. Deep Learning. MIT Press.   Ian Goodfellow Yoshua Bengio and Aaron Courville. 2016. Deep Learning. MIT Press."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSSC.1968.300136"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence","author":"Hessel Matteo","year":"2018"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.orhc.2015.01.001"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"C.J. Jagtenberg S. Bhulai and R. D. van der Mei. 2017. Optimal Ambulance Dispatching. Operations Research for Health Care 248 (March 2017) 269--291.  C.J. Jagtenberg S. Bhulai and R. D. van der Mei. 2017. Optimal Ambulance Dispatching. Operations Research for Health Care 248 (March 2017) 269--291.","DOI":"10.1007\/978-3-319-47766-4_9"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622748"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Yann LeCun Yoshua Bengio and Geoffrey E. Hinton. 2015. Deep learning. Nature 521 7553 (2015) 436--444.  Yann LeCun Yoshua Bengio and Geoffrey E. Hinton. 2015. Deep learning. Nature 521 7553 (2015) 436--444.","DOI":"10.1038\/nature14539"},{"key":"e_1_2_1_20_1","article-title":"End-to-End Training of Deep Visuomotor Policies","volume":"17","author":"Levine Sergey","year":"2016","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2334313"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1090.0345"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Richard McCormack and Graham Coates. 2015. A simulation model to enable the optimization of ambulance fleet allocation and base station location for increased patient survival. European Journal of Operational Research 247 (May 2015) 294--309.  Richard McCormack and Graham Coates. 2015. A simulation model to enable the optimization of ambulance fleet allocation and base station location for increased patient survival. European Journal of Operational Research 247 (May 2015) 294--309.","DOI":"10.1016\/j.ejor.2015.05.040"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623668"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence. 702--708","author":"Saisubramanian Sandhya","year":"2015"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2011.10.043"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2010.06.033"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"David Silver Aja Huang Chris J. Maddison Arthur Guez Laurent Sifre George van den Driessche Julian Schrittwieser Ioannis Antonoglou Vedavyas Panneershelvam Marc Lanctot Sander Dieleman Dominik Grewe John Nham Nal Kalchbrenner Ilya Sutskever Timothy P. Lillicrap Madeleine Leach Koray Kavukcuoglu Thore Graepel and Demis Hassabi. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529 7587 (2016) 484--489.  David Silver Aja Huang Chris J. Maddison Arthur Guez Laurent Sifre George van den Driessche Julian Schrittwieser Ioannis Antonoglou Vedavyas Panneershelvam Marc Lanctot Sander Dieleman Dominik Grewe John Nham Nal Kalchbrenner Ilya Sutskever Timothy P. Lillicrap Madeleine Leach Koray Kavukcuoglu Thore Graepel and Demis Hassabi. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529 7587 (2016) 484--489.","DOI":"10.1038\/nature16961"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 31th International Conference on Machine Learning. 387--395","author":"Silver David"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.1040.0107"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992696"},{"key":"e_1_2_1_34_1","unstructured":"Richard S. Sutton and Andrew G. Barto. 2017. Reinforcement Learning: An Introduction (Second Edition in progress). MIT Press Cambridge MA.   Richard S. Sutton and Andrew G. Barto. 2017. Reinforcement Learning: An Introduction (Second Edition in progress). MIT Press Cambridge MA."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 3rd International Conference on Logistics Operations Management. 1040--1051","author":"Pieter"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence.","author":"Wang Dong","year":"2018"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623656"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2016.01.004"},{"key":"e_1_2_1_39_1","unstructured":"Wikipedia. 2018. Half-normal distribution. https:\/\/en.wikipedia.org\/wiki\/Half-normal_distribution.  Wikipedia. 2018. Half-normal distribution. https:\/\/en.wikipedia.org\/wiki\/Half-normal_distribution."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869790.1869807"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence.","author":"Yue Yisong","year":"2012"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2604806"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Lu Zhen Kai Wang Hongtao Hu and Daofang Chang. 2014. A simulation optimization framework for ambulance deployment and relocation problems. Computers & Industrial Engineering 72 (March 2014) 12--23.  Lu Zhen Kai Wang Hongtao Hu and Daofang Chang. 2014. A simulation optimization framework for ambulance deployment and relocation problems. Computers & Industrial Engineering 72 (March 2014) 12--23.","DOI":"10.1016\/j.cie.2014.03.008"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788570"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314402","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3314402","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:30Z","timestamp":1750204410000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,29]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,29]]}},"alternative-id":["10.1145\/3314402"],"URL":"https:\/\/doi.org\/10.1145\/3314402","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,29]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}