{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:15:13Z","timestamp":1762272913460,"version":"3.41.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"The National Science Foundation","award":["CNS1640624 and IIS1814958"],"award-info":[{"award-number":["CNS1640624 and IIS1814958"]}]},{"DOI":"10.13039\/100012724","name":"Tennessee Department of Transportation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100012724","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Google through the Cloud Research Credits"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Cyber-Phys. Syst."],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>Resource allocation under uncertainty is a classic problem in city-scale cyber-physical systems. Consider emergency response, where urban planners and first responders optimize the location of ambulances to minimize expected response times to incidents such as road accidents. Typically, such problems involve sequential decision making under uncertainty and can be modeled as Markov (or semi-Markov) decision processes. The goal of the decision maker is to learn a mapping from states to actions that can maximize expected rewards. While online, offline, and decentralized approaches have been proposed to tackle such problems, scalability remains a challenge for real world use cases. We present a general approach to hierarchical planning that leverages structure in city level CPS problems for resource allocation. We use emergency response as a case study and show how a large resource allocation problem can be split into smaller problems. We then use Monte Carlo planning for solving the smaller problems and managing the interaction between them. Finally, we use data from Nashville, Tennessee, a major metropolitan area in the United States, to validate our approach. Our experiments show that the proposed approach outperforms state-of-the-art approaches used in the field of emergency response.<\/jats:p>","DOI":"10.1145\/3502869","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T12:00:09Z","timestamp":1646222409000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Hierarchical Planning for Dynamic Resource Allocation in Smart and Connected Communities"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7051-2832","authenticated-orcid":false,"given":"Geoffrey","family":"Pettet","sequence":"first","affiliation":[{"name":"Vanderbilt University, Nashville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ayan","family":"Mukhopadhyay","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mykel J.","family":"Kochenderfer","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abhishek","family":"Dubey","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,5]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"National Emergency Number Association. 2021. 911 Statistics. www.nena.org\/page\/911Statistics."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_4_2","volume-title":"When is a Hotspot a Hotspot? A Procedure for Creating Statistically Robust Hotspot Maps of Crime","author":"Chainey Spencer","year":"2002","unstructured":"Spencer Chainey, Svein Reid, and Neil Stuart. 2002. When is a Hotspot a Hotspot? A Procedure for Creating Statistically Robust Hotspot Maps of Crime. Taylor & Francis, London, England."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24369-6_26"},{"key":"e_1_3_2_6_2","first-page":"101","volume-title":"Papers of the Regional Science Association","author":"Church Richard","year":"1974","unstructured":"Richard Church and Charles ReVelle. 1974. The maximal covering location problem. In Papers of the Regional Science Association, Vol. 32. 101\u2013118."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.5555\/3091125.3091198"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781118032343"},{"key":"e_1_3_2_9_2","author":"Department Nashville Fire","year":"2018","unstructured":"Nashville Fire Department. 2018. Private Communication.","journal-title":"Private Communication"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12597-012-0098-x"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/nav.20267"},{"key":"e_1_3_2_12_2","volume-title":"Weather, Climate and Catastrophe Insight","author":"Forecasting AON Impact","year":"2018","unstructured":"AON Impact Forecasting. 2018. Weather, Climate and Catastrophe Insight. Technical Report. AON Impact Forecasting."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1978.1101707"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/978-3-540-68552-4_24","volume-title":"Workshop on Experimental and Efficient Algorithms","author":"Geisberger Robert","year":"2008","unstructured":"Robert Geisberger, Peter Sanders, Dominik Schultes, and Daniel Delling. 2008. Contraction hierarchies: Faster and simpler hierarchical routing in road networks. In Workshop on Experimental and Efficient Algorithms. 319\u2013333."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0966-8349(97)00015-6"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trd.2020.102230"},{"key":"e_1_3_2_17_2","article-title":"Hierarchical solution of Markov decision processes using macro-actions","author":"Hauskrecht Milos","year":"2013","unstructured":"Milos Hauskrecht, Nicolas Meuleau, Leslie Pack Kaelbling, Thomas L. Dean, and Craig Boutilier. 2013. Hierarchical solution of Markov decision processes using macro-actions. arXiv Preprint arXiv:1301.7381 (2013).","journal-title":"arXiv Preprint arXiv:1301.7381"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1177\/1536867X1601600209"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1137\/0137040"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177728975"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10729-014-9297-8"},{"key":"e_1_3_2_22_2","doi-asserted-by":"crossref","unstructured":"V. A. Knight P. R. Harper and L. Smith. 2012. Ambulance allocation for maximal survival with heterogeneous outcome measures. 40 6 (2012) 918\u2013926.","DOI":"10.1016\/j.omega.2012.02.003"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/2815660"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/11871842_29"},{"key":"e_1_3_2_25_2","article-title":"Eyes-closed safety kernels: Safety for autonomous systems under loss of observability","author":"Laine Forrest","year":"2020","unstructured":"Forrest Laine, Chiu-Yuan Chiu, and Claire Tomlin. 2020. Eyes-closed safety kernels: Safety for autonomous systems under loss of observability. arXiv Preprint arXiv:2005.07144 (2020).","journal-title":"arXiv Preprint arXiv:2005.07144"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_3_2_27_2","first-page":"281","volume-title":"Berkeley Symposium on Mathematical Statistics and Probability","author":"MacQueen James","year":"1967","unstructured":"James MacQueen et\u00a0al. 1967. Some methods for classification and analysis of multivariate observations. In Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1. 281\u2013297."},{"key":"e_1_3_2_28_2","first-page":"274","volume-title":"International Workshop on Algorithms and Computation","author":"Mahajan Meena","year":"2009","unstructured":"Meena Mahajan, Prajakta Nimbhorkar, and Kasturi Varadarajan. 2009. The planar k-means problem is NP-hard. In International Workshop on Algorithms and Computation. Springer, 274\u2013285."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-197908000-00004"},{"key":"e_1_3_2_30_2","unstructured":"Ayan Mukhopadhyay Geoffrey Pettet Mykel Kochenderfer and Abhishek Dubey. 2020. Designing Emergency Response Pipelines: Lessons and Challenges. AI for Social Good Workshop AAAI Fall Symposium Series (2020)."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3302509.3311055"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Ayan Mukhopadhyay Geoffrey Pettet Sayyed Mohsen Vazirizade Di Lu Alejan- dro Jaimes Said El Said Hiba Baroud Yevgeniy Vorobeychik Mykel Kochenderfer and Abhishek Dubey. 2022. A review of incident prediction resource allocation and dispatch models for emergency management. Accident Analysis & Prevention 165 (2022) 106501.","DOI":"10.1016\/j.aap.2021.106501"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/3091125.3091154"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/3237383.3237471"},{"key":"e_1_3_2_35_2","first-page":"3219","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"Park Sangdon","year":"2020","unstructured":"Sangdon Park, Osbert Bastani, James Weimer, and Insup Lee. 2020. Calibrated prediction with covariate shift via unsupervised domain adaptation. In International Conference on Artificial Intelligence and Statistics. 3219\u20133229."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_37_2","first-page":"1046","volume-title":"Conference on Autonomous Agents and Multiagent Systems","author":"Pettet Geoffrey","year":"2020","unstructured":"Geoffrey Pettet, Ayan Mukhopadhyay, Mykel Kochenderfer, Yevgeniy Vorobeychik, and Abhishek Dubey. 2020. On algorithmic decision procedures in emergency response systems in smart and connected communities. In Conference on Autonomous Agents and Multiagent Systems. 1046\u20131054."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450267.3450543"},{"key":"e_1_3_2_39_2","first-page":"1050","volume-title":"Neural Information Processing Systems","author":"Precup Doina","year":"1998","unstructured":"Doina Precup and Richard S. Sutton. 1998. Multi-time models for temporally abstract planning. In Neural Information Processing Systems. 1050\u20131056."},{"key":"e_1_3_2_40_2","article-title":"Efficient out-of-distribution detection using latent space of  \\( \\beta \\) -VAE for cyber-physical systems","author":"Ramakrishna Shreyas","year":"2021","unstructured":"Shreyas Ramakrishna, Zahra Rahiminasab, Gabor Karsai, Arvind Easwaran, and Abhishek Dubey. 2021. Efficient out-of-distribution detection using latent space of \\( \\beta \\) -VAE for cyber-physical systems. ACM Transactions on Cyber Physical Systems (2021).","journal-title":"ACM Transactions on Cyber Physical Systems"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.5555\/2968618.2968823"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119453765"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2602473"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50072-4"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.19.6.1363"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","unstructured":"Sayyed Mohsen Vazirizade Ayan Mukhopadhyay Geoffrey Pettet Said El Said Hiba Baroud and Abhishek Dubey. 2021. Learning incident prediction models over large geographical areas for emergency response systems. In IEEE Conference on Smart Computing (2021).","DOI":"10.1109\/SMARTCOMP52413.2021.00091"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/1695886"},{"key":"e_1_3_2_48_2","unstructured":"Kate Keahey et\u00a0al. 2020. Lessons learned from the chameleon testbed. In USENIX Annual Technical Conference ."}],"container-title":["ACM Transactions on Cyber-Physical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502869","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3502869","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3502869","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:34Z","timestamp":1750188634000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502869"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3502869"],"URL":"https:\/\/doi.org\/10.1145\/3502869","relation":{},"ISSN":["2378-962X","2378-9638"],"issn-type":[{"type":"print","value":"2378-962X"},{"type":"electronic","value":"2378-9638"}],"subject":[],"published":{"date-parts":[[2022,10,31]]},"assertion":[{"value":"2021-06-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}