{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T22:54:18Z","timestamp":1772492058120,"version":"3.50.1"},"reference-count":84,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T00:00:00Z","timestamp":1548288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2019,1,31]]},"abstract":"<jats:p>Cellular Automata (CA) are discrete simulation models, thus producing spatio-temporal data through experiments, as well as stochastic models, thus generating multi-run data. Identifying temporal patterns, such as cycles, is important to understand the behavior of the model. Assessing variability is also essential to estimate which parameter values may require more runs and what consensus emerges across simulation runs. However, these two tasks are currently arduous as the commonly employed slider-based visualizations offer little support to identify temporal trends or excessive model variability. In this article, we addressed these two tasks by developing, implementing, and evaluating a new visual analytics environment that uses several linked visualizations. Our empirical evaluation of the proposed environment assessed (i) whether modelers could identify temporal patterns and variability, (ii) how features of simulations impacted performances, and (iii) whether modelers can use the familiar slider-based visualization together with our new environment. Results shows that participants were confident on results obtained using our new environment. They were also able to accomplish the two target tasks without taking longer than they would with current solutions. Our qualitative analysis found that some participants saw value in switching between our proposed visualization and the commonly used slider-based version. In addition, we noted that errors were affected not only by the type of visualizations but also by specific features of the simulations. Future work may combine and adapt these visualizations depending on salient simulation parameters.<\/jats:p>","DOI":"10.1145\/3265748","type":"journal-article","created":{"date-parts":[[2019,1,28]],"date-time":"2019-01-28T14:01:39Z","timestamp":1548684099000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Visual Analytics to Identify Temporal Patterns and Variability in Simulations from Cellular Automata"],"prefix":"10.1145","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6816-355X","authenticated-orcid":false,"given":"Philippe J.","family":"Giabbanelli","sequence":"first","affiliation":[{"name":"Furman University, Greenville, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Magda","family":"Baniukiewicz","sequence":"additional","affiliation":[{"name":"Northern Illinois University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,1,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2007.01.030"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amc.2008.06.046"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01664.x"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1179\/000870409X12525737905042"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 6th International Conference on Digital Society (ICDS)","author":"Stavros","year":"2012"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.59.381"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3056901.3056911"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809404"},{"key":"e_1_2_1_9_1","first-page":"21","article-title":"Applications of high performance algorithms to large scale cellular automata frameworks used in pharmaceutical modelling","volume":"11","author":"Bezbradica Marija","year":"2016","journal-title":"Journal of Cell Automata"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03116.x"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.2481\/dsj.3.153"},{"key":"e_1_2_1_12_1","volume-title":"Glyph-based visualization: Foundations, design guidelines, techniques and applications. Eurographics State of the Art Reports","author":"Borgo Rita","year":"2013"},{"key":"e_1_2_1_13_1","volume-title":"Identifying binge drinkers based on parenting dimensions and alcohol-specific parenting practices: Building classifiers on adolescent-parent paired data. BMC Public Health 15, 1 (05","author":"Crutzen Rik","year":"2015"},{"key":"e_1_2_1_14_1","volume-title":"Using classifiers to identify binge drinkers based on drinking motives. Substance Use 8 Misuse 49, 1--2","author":"Crutzen Rik","year":"2014"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2010.07.002"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.fbr.2007.02.005"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346448"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apm.2006.04.001"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598868"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466443"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2012.01.004"},{"key":"e_1_2_1_22_1","volume-title":"Guru Jagadeesh Babu, and Magda Baniukiewicz","author":"Giabbanelli Philippe J.","year":"2016"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-14-130"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.05.195"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/PDP.2017.84"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/2891307.2891313"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346371"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611430769"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981848"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/263407.263408"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the Workshop on Visualisation in Environmental Sciences (EnvirVis\u201916)","author":"Thomas"},{"key":"e_1_2_1_32_1","volume-title":"Measurement, Simulation, and Modeling","author":"Jain Raj"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70615"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3800(96)01942-4"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.110"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.841121"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.240"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 6th Joint Eurographics - IEEE TCVG Conference on Visualization (VISSYM\u201904)","author":"Kindlmann Gordon","year":"2004"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/IST.2014.6958460"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the Spring Conference on Computer Graphics (2009","author":"Konyha Z.","year":"2009"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/1473871613481692"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12653"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2468091"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 2017 Winter Simulation Conference (WSC). 1868--1879","author":"Lavin E. A."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598603"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598602"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2440233"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2007.129"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/2835425.2835429"},{"key":"e_1_2_1_50_1","first-page":"391","article-title":"Interactive visual analysis and exploration of injection systems simulations. In VIS 05","volume":"2005","author":"Matkovic K.","year":"2005","journal-title":"IEEE Visualization"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","volume-title":"Making Sense of Large Datasets in the Context of Complex Situation Understanding","author":"Mokhtari Marielle","DOI":"10.1007\/978-3-642-39420-1_27"},{"key":"e_1_2_1_52_1","volume-title":"Design and Analysis of Experiments","author":"Montgomery Douglas C.","edition":"8"},{"key":"e_1_2_1_53_1","volume-title":"2007 Winter Simulation Conference. 703--711","author":"Nocke T.","year":"1966"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.170"},{"key":"e_1_2_1_55_1","volume-title":"Ntinas and others","author":"Vasileios","year":"2016"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2015.10.005"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the Workshop on the Intersections Between Geospatial Information and Information Technology. http:\/\/www.sci.utah.edu\/&sim;kpotter\/Library\/Papers\/pang:2001:UVGD\/index.html.","author":"Pang Alex","year":"2001"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2005.1570853"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01684.x"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 2012 IEEE International Conference on Intelligence and Security Informatics. 90--95","author":"Pratt S. F."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2769458.2769477"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702406"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). IEEE Press, 1038--1042","author":"Silvio"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of Simulation and Visualization (SimVis) (2008","author":"Ropinski T.","year":"2008"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the 7th International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computing Systems (PMBS\u201916)","author":"Caitlin"},{"key":"e_1_2_1_66_1","unstructured":"Richard C. Rothermel. 1972. A mathematical model for predicting fire spread in wildland fuels. In Research Paper INT-115. U.S. Department of Agriculture Intermountain Forest and Range Experiment Station.  Richard C. Rothermel. 1972. A mathematical model for predicting fire spread in wildland fuels. In Research Paper INT-115. U.S. Department of Agriculture Intermountain Forest and Range Experiment Station."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993901.2993903"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.5555\/832277.834354"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2016.7465251"},{"key":"e_1_2_1_70_1","volume-title":"Six and Ritch Macefield","author":"Janet","year":"2016"},{"key":"e_1_2_1_71_1","volume-title":"Scaling behavior of crowd flow outside a hall. Physica A: Statistical Mechanics and its Applications 292, 1","author":"Tajima Yusuke","year":"2001"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the Symposium on Theory of Modeling 8 Simulation. Society for Computer Simulation International","author":"S. J."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the Summer Conference on Computer Simulation. Society for Computer Simulation International","author":"Tolk A.","year":"2015"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/IV.2005.3"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 6th International Conference on Cellular Automata for Research and Industry (ACRI\u201904)","author":"Trunfio Giuseppe A.","year":"2004"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.5194\/gmd-9-823-2016"},{"key":"e_1_2_1_77_1","volume-title":"Measuring the User Experience","author":"Albert William","edition":"2"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2009.4906838"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346352"},{"key":"e_1_2_1_80_1","volume-title":"Multivariate Data Glyphs: Principles and Practice","author":"Ward Matthew O."},{"key":"e_1_2_1_81_1","volume-title":"Simulation of bi-direction pedestrian movement using a cellular automata model. Physica A: Statistical Mechanics and its Applications 321, 3","author":"Weifeng Fang","year":"2003"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.537309"},{"key":"e_1_2_1_83_1","volume-title":"Theory and Applications of Cellular Automata","author":"Wolfram Stephen"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.qai.0000165907.04710.da"}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3265748","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3265748","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:49Z","timestamp":1750210789000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3265748"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,24]]},"references-count":84,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1,31]]}},"alternative-id":["10.1145\/3265748"],"URL":"https:\/\/doi.org\/10.1145\/3265748","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,24]]},"assertion":[{"value":"2017-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}