{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T14:50:24Z","timestamp":1776351024568,"version":"3.51.2"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF \u201cDataStorm: A Data Enabled System for End-to-End Disaster Planning and Response,\u201d","award":["#1610282"],"award-info":[{"award-number":["#1610282"]}]},{"name":"NSF \u201cBIGDATA: Discovering Context-Sensitive Impact in Complex Systems,\u201d","award":["#1633381"],"award-info":[{"award-number":["#1633381"]}]},{"name":"NSF \u201cpCAR: Discovering and Leveraging Plausibly Causal (p-causal) Relationships to Understand Complex Dynamic Systems,\u201d","award":["#1909555"],"award-info":[{"award-number":["#1909555"]}]},{"name":"\u201cFourCmodeling\u201d: EUH2020 Marie Sklodowska-Curie","award":["690817"],"award-info":[{"award-number":["690817"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>\n                    Urban systems are characterized by complexity and dynamicity. Data-driven simulations represent a promising approach in understanding and predicting complex dynamic processes in the presence of shifting demands of urban systems. Yet, today\u2019s silo-based, de-coupled simulation engines fail to provide an end-to-end view of the complex urban system, preventing informed decision-making. In this article, we present\n                    <jats:monospace>DataStorm<\/jats:monospace>\n                    to support integration of existing simulation, analysis and visualization components into integrated workflows.\n                    <jats:monospace>DataStorm<\/jats:monospace>\n                    provides a flow engine,\n                    <jats:monospace>DataStorm-FE<\/jats:monospace>\n                    , for coordinating data and decision flows among multiple actors (each representing a model, analytic operation, or a decision criterion) and enables ensemble planning and optimization across cloud resources.\n                    <jats:monospace>DataStorm<\/jats:monospace>\n                    provides native support for simulation ensemble creation through parameter space sampling to decide which simulations to run, as well as distributed instantiation and parallel execution of simulation instances on cluster resources. Recognizing that simulation ensembles are inherently sparse relative to the potential parameter space, we also present a density-boosting partition-stitch sampling scheme to increase the effective density of the simulation ensemble through a sub-space partitioning scheme, complemented with an efficient stitching mechanism that leverages partial and imperfect knowledge from partial dynamical systems to effectively obtain a global view of the complex urban process being simulated.\n                  <\/jats:p>","DOI":"10.1145\/3447572","type":"journal-article","created":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T16:17:23Z","timestamp":1626884243000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["DataStorm: Coupled, Continuous Simulations for Complex Urban Environments"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6706-4197","authenticated-orcid":false,"given":"Hans Walter","family":"Behrens","sequence":"first","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4977-6646","authenticated-orcid":false,"given":"K. Sel\u00e7uk","family":"Candan","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xilun","family":"Chen","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yash","family":"Garg","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mao-Lin","family":"Li","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinsheng","family":"Li","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sicong","family":"Liu","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria Luisa","family":"Sapino","sequence":"additional","affiliation":[{"name":"University of Turin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Md","family":"Shadab","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dalton","family":"Turner","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Magesh","family":"Vijayakumaren","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, Arizona, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,21]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/998688.1007097"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2320765.2320791"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2010.07.002"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1068\/a44153","article-title":"Visually-driven urban simulation: Exploring fast and slow change in residential location","volume":"45","author":"Batty Michael","year":"2013","unstructured":"Michael Batty. 2013. Visually-driven urban simulation: Exploring fast and slow change in residential location. Environ. Plan. A: Econ. Space 45, 3 (2013), 532\u2013552.","journal-title":"Environ. Plan. A: Econ. Space"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3236221"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the Chameleon User Meeting.","author":"Behrens Hans Walter","unstructured":"Hans Walter Behrens, Mao-Lin Li, Ashish Gadkari, Yash Garg, Xilun Chen, Sicong Liu, and K. Sel\u00e7uk Candan. 2019. Load-adaptive continuous coupled-simulation ensembles with DataStorm and Chameleon. In Proceedings of the Chameleon User Meeting."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1875121"},{"key":"e_1_2_2_8_1","volume-title":"Grand challenges for disaster reduction. Executive Office of the President","author":"Committee on Environment and Natural Resources. 2008.","year":"2008","unstructured":"Committee on Environment and Natural Resources. 2008. Grand challenges for disaster reduction. Executive Office of the President (2008). https:\/\/www.sdr.gov\/docs\/SDRGrandChallengesforDisasterReduction.pdf."},{"key":"e_1_2_2_9_1","unstructured":"Greg Cope. 2017. Programming the Lorenz Attractor. Retrieved from https:\/\/www.algosome.com\/articles\/lorenz-attractor-programming-code.html"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5194\/gmd-10-1835-2017"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1175\/2007MWR2085.1"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882992.1883115"},{"key":"e_1_2_2_13_1","unstructured":"Christoph Federrath. 2017. Java Applets. Retrieved from http:\/\/www.ita.uni-heidelberg.de\/\u02dcchfeder\/applets.shtml?lang=en."},{"key":"e_1_2_2_14_1","unstructured":"Ronald Aylmer Fisher. 1935. The Design of Eexperiments. Oliver and Boyd."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.2999534"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","unstructured":"Michael Gollner Arnaud Trouve Ilkay Altintas Jessica Block Raymond de Callafon Craig Clements Anna Cortes Evan Ellicott Jean Baptiste Filippi Mark Finney Kayo Ide Mary Ann Jenkins Daniel Jimenez Christopher Lautenberger Jan Mandel Melanie Rochoux and Albert Simeoni. 2015. Towards data-driven operational wildfire spread modeling: A report of the NSF-funded WIFIRE workshop. (Jan. 2015). DOI:https:\/\/doi.org\/10.13016\/M2Z70R","DOI":"10.13016\/M2Z70R"},{"key":"e_1_2_2_17_1","volume-title":"Foundations of The PARAFAC procedure: Models and conditions for an \u2018explanatory","author":"Harshman Richard A.","unstructured":"Richard A. Harshman. 1970. Foundations of The PARAFAC procedure: Models and conditions for an \u2018explanatory\u201d multimodal factor analysis. In UCLA Working Papers in Phonetics."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkl320"},{"key":"e_1_2_2_19_1","volume-title":"Proceedings of the OCEANS 1984 Conference. 314\u2013317","author":"Jelesnianski C.","year":"1984","unstructured":"C. Jelesnianski, Jye Chen, W. Shaffer, and A. Gilad. 1984. SLOSH\u2014A hurricane storm surge forecast model. In Proceedings of the OCEANS 1984 Conference. 314\u2013317. DOI:https:\/\/doi.org\/10.1109\/OCEANS.1984.1152341"},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the IEEE 31st International Conference on Data Engineering. 1047\u20131058","author":"Jeon I.","year":"2015","unstructured":"I. Jeon, E. E. Papalexakis, U. Kang, and C. Faloutsos. 2015. HaTen2: Billion-scale tensor decompositions. In Proceedings of the IEEE 31st International Conference on Data Engineering. 1047\u20131058. DOI:https:\/\/doi.org\/10.1109\/ICDE.2015.7113355"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.2307\/2343243"},{"key":"e_1_2_2_22_1","volume-title":"Chameleon: A scalable production testbed for computer science research. In Contemporary High Performance Computing: From Petascale toward Exascale","author":"Keahey Kate","year":"2018","unstructured":"Kate Keahey, Pierre Riteau, Dan Stanzione, Tim Cockerill, Joe Mambretti, Paul Rad, and Paul Ruth. 2018. Chameleon: A scalable production testbed for computer science research. In Contemporary High Performance Computing: From Petascale toward Exascale. CRC Press."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2009.94"},{"key":"e_1_2_2_24_1","volume-title":"Proceedings of the 2nd International Conference on Simulation Tools and Techniques (SIMUTools'09)","author":"Keranen Ari","year":"2008","unstructured":"Ari Keranen. 2008. Opportunistic network environment simulator. In Proceedings of the 2nd International Conference on Simulation Tools and Techniques (SIMUTools'09). https:\/\/www.netlab.tkk.fi\/tutkimus\/dtn\/theone\/pub\/the_one.pdf."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0401-6"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6544\/aabc8f"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.89"},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the IEEE 34th International Conference on Data Engineering (ICDE\u201918)","author":"Li X.","unstructured":"X. Li, K. S. Candan, and M. L. Sapino. 2018. M2TD: Multi-task tensor decomposition for sparse ensemble simulations. In Proceedings of the IEEE 34th International Conference on Data Engineering (ICDE\u201918). 1144\u20131155."},{"key":"e_1_2_2_30_1","volume-title":"Proceedings of the IEEE 32nd International Conference on Data Engineering (ICDE\u201916)","author":"Li X.","unstructured":"X. Li, S. Huang, K. S. Candan, and M. L. Sapino. 2016. 2PCP: Two-phase CP decomposition for billion-scale dense tensors. In Proceedings of the IEEE 32nd International Conference on Data Engineering (ICDE\u201916). 835\u2013846."},{"key":"e_1_2_2_31_1","volume-title":"Proceedings of the Workshops at the 29th AAAI Conference on Artificial Intelligence.","author":"Liu Sicong","year":"2015","unstructured":"Sicong Liu, Yash Garg, K. Selcuk Candan, Maria Luisa Sapino, and Gerardo Chowell-Puente. 2015. NOTES2: Networks-of-traces for epidemic spread simulations. In Proceedings of the Workshops at the 29th AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","first-page":"S427","DOI":"10.1093\/infdis\/jiw305","article-title":"epiDMS: Data management and analytics for decision-making from epidemic spread simulation ensembles","volume":"214","author":"Liu Sicong","year":"2016","unstructured":"Sicong Liu, Silvestro Poccia, K. Sel\u00e7uk Candan, Gerardo Chowell, and Maria Luisa Sapino. 2016. epiDMS: Data management and analytics for decision-making from epidemic spread simulation ensembles. J. Infect. Dis. 214, suppl_4 (2016), S427\u2013S432.","journal-title":"J. Infect. Dis."},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1111\/cgf.13585","article-title":"Urban walkability design using virtual population simulation","volume":"38","author":"Tharindu Mathew C. D.","year":"2019","unstructured":"C. D. Tharindu Mathew, Paulo R. Knob, Soraia Raupp Musse, and Daniel G. Aliaga. 2019. Urban walkability design using virtual population simulation. Comput. Graph. Forum 38, 1 (2019), 455\u2013469.","journal-title":"Comput. Graph. Forum"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989485"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1029\/2008GL036832"},{"key":"e_1_2_2_36_1","volume-title":"Sidiropoulos","author":"Papalexakis Evangelos E.","year":"2012","unstructured":"Evangelos E. Papalexakis, Christos Faloutsos, and Nicholas D. Sidiropoulos. 2012. ParCube: Sparse parallelizable tensor decompositions. In Machine Learning and Knowledge Discovery in Databases (Lecture Notes in Computer Science), Peter A. Flach, Tijl De Bie, and Nello Cristianini (Eds.). Springer Berlin, 521\u2013536."},{"key":"e_1_2_2_37_1","unstructured":"Giulia Pedrielli Yinchao Zhu and Loo Hay Lee. 2015. Single-run simulation optimization through time dilation and optimal computing budget allocation. http:\/\/www.smmso.org\/SMMSO2015\/Downloads\/Giulia%20Pedrielli.pdf."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/3042094.3042198"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the 20th International Conference on Extending Database Technology: Advances in Database Technology (EDBT\u201917)","author":"Poccia Silvestro","year":"2017","unstructured":"Silvestro Poccia, Maria Luisa Sapino, Sicong Liu, Xilun Chen, Yash Garg, Shengyu Huang, Jung Hyun Kim, Xinsheng Li, Parth Nagarkar, and Kasim Candan. 2017. SIMDMS: Data management and analysis to support decision making through large simulation ensembles. In Proceedings of the 20th International Conference on Extending Database Technology: Advances in Database Technology (EDBT\u201917). OpenProceedings.org, 582\u2013585. DOI:https:\/\/doi.org\/10.5441\/002\/edbt.2017.75."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999792.2999906"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/268437.268471"},{"key":"e_1_2_2_42_1","unstructured":"EmitLab DataStorm Team. 2018. DataStorm demo v1. Retrieved from https:\/\/www.youtube.com\/watch?v=L74jwa78Dg4."},{"key":"e_1_2_2_43_1","unstructured":"EmitLab DataStorm Team. 2018. DataStorm release v1. Retrieved from https:\/\/github.com\/EmitLab\/DataStorm-Release."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289464"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/01944360208976274"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3054177"},{"key":"e_1_2_2_47_1","unstructured":"Ming Zhao K. Sel\u00e7uk Candan Huan Liu Hasan Davulcu and Fengbo Ren. 2016. NSF Award Search: Award#1629888 - II-NEW: GEARS - An Infrastructure for Energy-Efficient Big Data Research on Heterogeneous and Dynamic Data. Retrieved from https:\/\/nsf.gov\/awardsearch\/showAward?AWD_ID=1629888"}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447572","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447572","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:56:27Z","timestamp":1776347787000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447572"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3447572"],"URL":"https:\/\/doi.org\/10.1145\/3447572","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2021,7,21]]},"assertion":[{"value":"2019-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}