{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T18:35:10Z","timestamp":1764873310157},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1-2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:p>In many scientific domains, researchers are turning to large-scale behavioral simulations to better understand real-world phenomena. While there has been a great deal of work on simulation tools from the high-performance computing community, behavioral simulations remain challenging to program and automatically scale in parallel environments. In this paper we present BRACE (Big Red Agent-based Computation Engine), which extends the MapReduce framework to process these simulations efficiently across a cluster. We can leverage spatial locality to treat behavioral simulations as iterated spatial joins and greatly reduce the communication between nodes. In our experiments we achieve nearly linear scale-up on several realistic simulations.<\/jats:p>\n          <jats:p>Though processing behavioral simulations in parallel as iterated spatial joins can be very efficient, it can be much simpler for the domain scientists to program the behavior of a single agent. Furthermore, many simulations include a considerable amount of complex computation and message passing between agents, which makes it important to optimize the performance of a single node and the communication across nodes. To address both of these challenges, BRACE includes a high-level language called BRASIL (the Big Red Agent SImulation Language). BRASIL has object-oriented features for programming simulations, but can be compiled to a dataflow representation for automatic parallelization and optimization. We show that by using various optimization techniques, we can achieve both scalability and single-node performance similar to that of a hand-coded simulation.<\/jats:p>","DOI":"10.14778\/1920841.1920962","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"952-963","source":"Crossref","is-referenced-by-count":38,"title":["Behavioral simulations in MapReduce"],"prefix":"10.14778","volume":"3","author":[{"given":"Guozhang","family":"Wang","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcos Vaz","family":"Salles","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Sowell","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xun","family":"Wang","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tuan","family":"Cao","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alan","family":"Demers","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johannes","family":"Gehrke","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Walker","family":"White","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1755913.1755937"},{"key":"e_1_2_1_2_1","unstructured":"Amazon Elastic Compute Cloud (Amazon EC2). http:\/\/http:\/\/aws.amazon.com\/ec2\/.  Amazon Elastic Compute Cloud (Amazon EC2). http:\/\/http:\/\/aws.amazon.com\/ec2\/."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141753.1141771"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/98524.98564"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/227234.227246"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1125142"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3975(95)00024-Q"},{"key":"e_1_2_1_8_1","volume-title":"Proc. Swiss Transport Research Conference (STRC)","author":"Cetin N.","year":"2003","unstructured":"N. Cetin , A. Burri , and K. Nagel . A large-scale agent-based traffic microsimulation based on queue model . In Proc. Swiss Transport Research Conference (STRC) , 2003 . N. Cetin, A. Burri, and K. Nagel. A large-scale agent-based traffic microsimulation based on queue model. In Proc. Swiss Transport Research Conference (STRC), 2003."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1979.230182"},{"key":"e_1_2_1_10_1","first-page":"07","volume-title":"Federal Highway Administration","author":"Choudhury C.","year":"2006","unstructured":"C. Choudhury , M. Ben-Akiva , T. Toledo , A. Rao , and G. Lee . NGSIM cooperative lane changing and forced merging model. Technical report , Federal Highway Administration , 2006 . FHWA-HOP- 07 - 096 . C. Choudhury, M. Ben-Akiva, T. Toledo, A. Rao, and G. Lee. NGSIM cooperative lane changing and forced merging model. Technical report, Federal Highway Administration, 2006. FHWA-HOP-07-096."},{"key":"e_1_2_1_11_1","first-page":"06","volume-title":"Federal Highway Administration","author":"Choudhury C.","year":"2004","unstructured":"C. Choudhury , T. Toledo , and M. Ben-Akiva . NGSIM freeway lane selection model. Technical report , Federal Highway Administration , 2004 . FHWA-HOP- 06 - 103 . C. Choudhury, T. Toledo, and M. Ben-Akiva. NGSIM freeway lane selection model. Technical report, Federal Highway Administration, 2004. FHWA-HOP-06-103."},{"key":"e_1_2_1_12_1","unstructured":"Cornell Database Group. The brasil language specification. http:\/\/www.cs.cornell.edu\/bigreddata\/games\/simulations.php 2010.  Cornell Database Group. The brasil language specification. http:\/\/www.cs.cornell.edu\/bigreddata\/games\/simulations.php 2010."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature03236"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2004.11.016"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/193201.194885"},{"key":"e_1_2_1_16_1","first-page":"137","volume-title":"Proc. OSDI","author":"Dean J.","year":"2004","unstructured":"J. Dean and S. Ghemawat . Mapreduce: Simplified data processing on large clusters . In Proc. OSDI , pages 137 -- 150 , 2004 . J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proc. OSDI, pages 137--150, 2004."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.50905"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02982-0_14"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2008.59"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/568522.568525"},{"key":"e_1_2_1_21_1","volume-title":"An efficient gpu implementation for large-scale individual based simulation of collective behavior","author":"Erra U.","unstructured":"U. Erra , B. Frola , V. Scarano , and I. Couzin . An efficient gpu implementation for large-scale individual based simulation of collective behavior . In Press . U. Erra, B. Frola, V. Scarano, and I. Couzin. An efficient gpu implementation for large-scale individual based simulation of collective behavior. In Press."},{"key":"e_1_2_1_22_1","volume-title":"Proc. Int. Conf. on Advanced Robotics (ICAR)","author":"Gerkey B.","year":"2003","unstructured":"B. Gerkey , R. Vaughan , and A. Howard . The player\/stage project: Tools for multi-robot and distributed sensor systems . In Proc. Int. Conf. on Advanced Robotics (ICAR) , 2003 . B. Gerkey, R. Vaughan, and A. Howard. The player\/stage project: Tools for multi-robot and distributed sensor systems. In Proc. Int. Conf. on Advanced Robotics (ICAR), 2003."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/93597.98720"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1127548"},{"key":"e_1_2_1_25_1","unstructured":"Hadoop. http:\/\/hadoop.apache.org\/.  Hadoop. http:\/\/hadoop.apache.org\/."},{"key":"e_1_2_1_26_1","volume-title":"Dynamic load balancing in computational mechanics. Computer Methods in Applied Mechanics and Engineering, 184(2--4):485--500","author":"Hendrickson B.","year":"2000","unstructured":"B. Hendrickson and K. Devine . Dynamic load balancing in computational mechanics. Computer Methods in Applied Mechanics and Engineering, 184(2--4):485--500 , 2000 . B. Hendrickson and K. Devine. Dynamic load balancing in computational mechanics. Computer Methods in Applied Mechanics and Engineering, 184(2--4):485--500, 2000."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89674-6_25"},{"key":"e_1_2_1_28_1","first-page":"364","article-title":"Farm: A scalable environment for multi-agent development and evaluation","volume":"2940","author":"Horling B.","year":"2004","unstructured":"B. Horling , R. Mailler , and V. Lesser . Farm: A scalable environment for multi-agent development and evaluation . Software Engineering for Multi-Agent Systems II , 2940 : 364 -- 367 , 2004 . B. Horling, R. Mailler, and V. Lesser. Farm: A scalable environment for multi-agent development and evaluation. Software Engineering for Multi-Agent Systems II, 2940:364--367, 2004.","journal-title":"Software Engineering for Multi-Agent Systems II"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1218112.1218282"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3374.001.0001","volume-title":"Growing Artificial Societies: Social Science from the Bottom Up","author":"Epstein Joshua","year":"1996","unstructured":"Joshua Epstein and Robert Axtell . Growing Artificial Societies: Social Science from the Bottom Up . The MIT Press , 1996 . Joshua Epstein and Robert Axtell. Growing Artificial Societies: Social Science from the Bottom Up. The MIT Press, 1996."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1065167.1065179"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142485"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/0037549705058073"},{"key":"e_1_2_1_34_1","volume-title":"Proc. ICDE","author":"Luo G.","year":"2002","unstructured":"G. Luo , J. Naughton , and C. Ellmann . A non-blocking parallel spatial join algorithm . In Proc. ICDE , 2002 . G. Luo, J. Naughton, and C. Ellmann. A non-blocking parallel spatial join algorithm. In Proc. ICDE, 2002."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1006\/jpdc.1993.1075"},{"key":"e_1_2_1_36_1","volume-title":"The swarm simulation system: A toolkit for building multi-agent simulations. Working Papers 96-06-042","author":"Minar N.","year":"1996","unstructured":"N. Minar , R. Burkhart , C. Langton , and M. Askenazi . The swarm simulation system: A toolkit for building multi-agent simulations. Working Papers 96-06-042 , Santa Fe Institute , 1996 . N. Minar, R. Burkhart, C. Langton, and M. Askenazi. The swarm simulation system: A toolkit for building multi-agent simulations. Working Papers 96-06-042, Santa Fe Institute, 1996."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1066157.1066230"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(01)00106-5"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/151261.151266"},{"key":"e_1_2_1_40_1","volume-title":"Proc. DASFAA","author":"Ohmori T.","year":"1995","unstructured":"T. Ohmori and M. Hoshi . Gaming-simulations of multi-agent information systems using large databases: The concept and database algorithms . In Proc. DASFAA , 1995 . T. Ohmori and M. Hoshi. Gaming-simulations of multi-agent information systems using large databases: The concept and database algorithms. In Proc. DASFAA, 1995."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/308386.308402"},{"issue":"4","key":"e_1_2_1_42_1","first-page":"227","article-title":"Interpreting the data: Parallel analysis with Sawzall","volume":"13","author":"Pike R.","year":"2005","unstructured":"R. Pike , S. Doward , R. Griesemer , and S. Quinlan . Interpreting the data: Parallel analysis with Sawzall . Scientific Programming Journal , 13 ( 4 ): 227 -- 204 , 2005 . R. Pike, S. Doward, R. Griesemer, and S. Quinlan. Interpreting the data: Parallel analysis with Sawzall. Scientific Programming Journal, 13(4):227--204, 2005.","journal-title":"Scientific Programming Journal"},{"key":"e_1_2_1_43_1","volume-title":"Proc. Artificial Life X","author":"Scheutz M.","year":"2006","unstructured":"M. Scheutz , P. Schermerhorn , R. Connaughton , and A. Dingler . SWAGES--an extendable parallel grid experimentation system for large-scale agent-based alife simulations . In Proc. Artificial Life X , 2006 . M. Scheutz, P. Schermerhorn, R. Connaughton, and A. Dingler. SWAGES--an extendable parallel grid experimentation system for large-scale agent-based alife simulations. In Proc. Artificial Life X, 2006."},{"key":"e_1_2_1_44_1","volume-title":"The 2009 urban mobility report. Technical report","author":"Schrank D.","year":"2009","unstructured":"D. Schrank and T. Lomax . The 2009 urban mobility report. Technical report , Texas Transportation Institute , 2009 . D. Schrank and T. Lomax. The 2009 urban mobility report. Technical report, Texas Transportation Institute, 2009."},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4613-9575-1","volume-title":"Programming with sets","author":"Schwartz J. T.","year":"1986","unstructured":"J. T. Schwartz , R. B. Dewar , E. Schonberg , and E. Dubinsky . Programming with sets ; an introduction to SETL. Springer-Verlag New York, Inc. , New York, NY, USA , 1986 . J. T. Schwartz, R. B. Dewar, E. Schonberg, and E. Dubinsky. Programming with sets; an introduction to SETL. Springer-Verlag New York, Inc., New York, NY, USA, 1986."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0190(98)00061-1"},{"key":"e_1_2_1_47_1","volume-title":"University of Pennsylvania","author":"Suciu D.","year":"1995","unstructured":"D. Suciu . Parallel programming languages for collections. PhD thesis , University of Pennsylvania , 1995 . D. Suciu. Parallel programming languages for collections. PhD thesis, University of Pennsylvania, 1995."},{"key":"e_1_2_1_48_1","volume-title":"Proc. ICDT","author":"Tannen V.","year":"1992","unstructured":"V. Tannen , P. Buneman , and L. Wong . Naturally embedded query languages . In Proc. ICDT , 1992 . V. Tannen, P. Buneman, and L. Wong. Naturally embedded query languages. In Proc. ICDT, 1992."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247486"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401843.1401847"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247602"},{"key":"e_1_2_1_54_1","volume-title":"Annual Meeting of Transportation Research Board","author":"Yang Q.","year":"1999","unstructured":"Q. Yang , H. Koutsopoulos , and M. Ben-Akiva . A simulation laboratory for evaluating dynamic traffic management systems . In Annual Meeting of Transportation Research Board , 1999 . TRB Paper No. 00--1688. Q. Yang, H. Koutsopoulos, and M. Ben-Akiva. A simulation laboratory for evaluating dynamic traffic management systems. In Annual Meeting of Transportation Research Board, 1999. TRB Paper No. 00--1688."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2009.5306783"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTR.2009.5289178"},{"key":"e_1_2_1_57_1","volume-title":"Proc. IPDPS","author":"Zheng G.","year":"2004","unstructured":"G. Zheng , G. Kakulapati , and L. Kale . Bigsim: A parallel simulator for performance prediction of extremely large parallel machines . In Proc. IPDPS , 2004 . G. Zheng, G. Kakulapati, and L. Kale. Bigsim: A parallel simulator for performance prediction of extremely large parallel machines. In Proc. IPDPS, 2004."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/1920841.1920962","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:41:51Z","timestamp":1672227711000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/1920841.1920962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9]]},"references-count":55,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["10.14778\/1920841.1920962"],"URL":"https:\/\/doi.org\/10.14778\/1920841.1920962","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2010,9]]}}}