{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:10:08Z","timestamp":1767183008689,"version":"3.44.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2211939"],"award-info":[{"award-number":["2211939"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>Data-driven predictions are often perceived as inaccurate in hindsight due to behavioral responses. In this study, we explore the role of interface design choices in shaping individuals' decision-making processes in response to predictions presented on a shared information display in a strategic setting. We introduce a novel staged experimental design to investigate the effects of design features, such as visualizations of prediction uncertainty and error, within a repeated congestion game. In this game, participants assume the role of taxi drivers and use a shared information display to decide where to search for their next ride. Our experimental design endows agents with varying level-k depths of thinking, allowing some agents to possess greater sophistication in anticipating the decisions of others using the same information display. Through several extensive experiments, we identify trade-offs between displays that optimize individual decisions and those that best serve the collective social welfare of the system. We find that the influence of display characteristics varies based on an agent's strategic sophistication. We observe that design choices promoting individual-level decision-making can lead to suboptimal system outcomes, as manifested by a lower realization of potential social welfare. However, this decline in social welfare is offset by a reduction in the distribution shift, narrowing the gap between predicted and realized system outcomes, which potentially enhances the perceived reliability and trustworthiness of the information display post hoc. Our findings pave the way for new research questions concerning the design of effective prediction interfaces in strategic environments.<\/jats:p>","DOI":"10.1145\/3637319","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Designing Shared Information Displays for Agents of Varying Strategic Sophistication"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9825-1411","authenticated-orcid":false,"given":"Dongping","family":"Zhang","sequence":"first","affiliation":[{"name":"Technology and Social Behavior, Northwestern University, Evanston, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5505-6819","authenticated-orcid":false,"given":"Jason","family":"Hartline","sequence":"additional","affiliation":[{"name":"Computer Science, Northwestern University, Evanston, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6826-3550","authenticated-orcid":false,"given":"Jessica","family":"Hullman","sequence":"additional","affiliation":[{"name":"Computer Science, Northwestern University, Evanston, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_2_1_1","DOI":"10.3758\/s13428-020-01535-9"},{"key":"e_1_2_2_2_1","volume-title":"1988 a. Lagrange multiplier test diagnostics for spatial dependence and spatial heterogeneity. Geographical analysis","author":"Anselin Luc","year":"1988","unstructured":"Luc Anselin. 1988 a. Lagrange multiplier test diagnostics for spatial dependence and spatial heterogeneity. Geographical analysis, Vol. 20, 1 (1988), 1--17."},{"volume-title":"1988 b. Spatial econometrics: methods and models","author":"Anselin Luc","unstructured":"Luc Anselin. 1988 b. Spatial econometrics: methods and models. Vol. 4. Springer Science & Business Media.","key":"e_1_2_2_3_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_4_1","DOI":"10.1016\/j.jml.2012.11.001"},{"doi-asserted-by":"publisher","key":"e_1_2_2_5_1","DOI":"10.1257\/jel.20181489"},{"key":"e_1_2_2_6_1","volume-title":"Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature human behaviour","author":"Bryan Christopher J","year":"2021","unstructured":"Christopher J Bryan, Elizabeth Tipton, and David S Yeager. 2021. Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature human behaviour, Vol. 5, 8 (2021), 980--989."},{"doi-asserted-by":"publisher","key":"e_1_2_2_7_1","DOI":"10.1162\/0033553041502225"},{"doi-asserted-by":"publisher","key":"e_1_2_2_8_1","DOI":"10.1080\/03610928708829384"},{"doi-asserted-by":"publisher","key":"e_1_2_2_9_1","DOI":"10.1504\/IJBIDM.2010.030296"},{"doi-asserted-by":"publisher","key":"e_1_2_2_10_1","DOI":"10.1073\/pnas.0807721106"},{"doi-asserted-by":"publisher","key":"e_1_2_2_11_1","DOI":"10.2139\/ssrn.4229042"},{"key":"e_1_2_2_12_1","volume-title":"Error bars considered harmful: Exploring alternate encodings for mean and error","author":"Correll Michael","year":"2014","unstructured":"Michael Correll and Michael Gleicher. 2014. Error bars considered harmful: Exploring alternate encodings for mean and error. IEEE transactions on visualization and computer graphics, Vol. 20, 12 (2014), 2142--2151."},{"volume-title":"Reducing congestion through information design. In 2017 55th annual allerton conference on communication, control, and computing (allerton)","author":"Das Sanmay","unstructured":"Sanmay Das, Emir Kamenica, and Renee Mirka. 2017. Reducing congestion through information design. In 2017 55th annual allerton conference on communication, control, and computing (allerton). IEEE, 1279--1284.","key":"e_1_2_2_13_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_14_1","DOI":"10.1109\/ITSC.2016.7795558"},{"key":"e_1_2_2_15_1","series-title":"Journal of Physics: Conference Series","volume-title":"Non-cooperative game of multi-agent countermeasure systems based on cognitive hierarchy theory","author":"Dong Xiaonan","year":"2015","unstructured":"Xiaonan Dong, Xuehuan Li, Zongcheng Liu, and Qiuni Li. 2018. Non-cooperative game of multi-agent countermeasure systems based on cognitive hierarchy theory. In Journal of Physics: Conference Series, Vol. 1069. IOP Publishing, 012015."},{"key":"e_1_2_2_16_1","volume-title":"Congressus numerantium","volume":"42","author":"Eades Peter","year":"1984","unstructured":"Peter Eades. 1984. A heuristic for graph drawing. Congressus numerantium, Vol. 42 (1984), 149--160."},{"doi-asserted-by":"publisher","key":"e_1_2_2_17_1","DOI":"10.1145\/3173574.3173718"},{"doi-asserted-by":"publisher","key":"e_1_2_2_18_1","DOI":"10.1109\/CCTA48906.2021.9658965"},{"doi-asserted-by":"publisher","key":"e_1_2_2_19_1","DOI":"10.1371\/journal.pone.0056416"},{"doi-asserted-by":"publisher","key":"e_1_2_2_20_1","DOI":"10.1145\/108844.108856"},{"key":"e_1_2_2_21_1","volume-title":"Causal quartets: Different ways to attain the same average treatment effect. arXiv preprint arXiv:2302.12878","author":"Gelman Andrew","year":"2023","unstructured":"Andrew Gelman, Jessica Hullman, and Lauren Kennedy. 2023. Causal quartets: Different ways to attain the same average treatment effect. arXiv preprint arXiv:2302.12878 (2023)."},{"key":"e_1_2_2_22_1","volume-title":"Bayesian workflow. arXiv preprint arXiv:2011.01808","author":"Gelman Andrew","year":"2020","unstructured":"Andrew Gelman, Aki Vehtari, Daniel Simpson, Charles C Margossian, Bob Carpenter, Yuling Yao, Lauren Kennedy, Jonah Gabry, Paul-Christian B\u00fcrkner, and Martin Modr\u00e1k. 2020. Bayesian workflow. arXiv preprint arXiv:2011.01808 (2020)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_23_1","DOI":"10.1080\/02693799208901893"},{"doi-asserted-by":"publisher","key":"e_1_2_2_24_1","DOI":"10.1145\/2840728.2840730"},{"doi-asserted-by":"publisher","key":"e_1_2_2_25_1","DOI":"10.1145\/3313831.3376454"},{"unstructured":"Xiaohua Hu Ronald Shonkwiler and Marcus C Spruill. 2009. Random restarts in global optimization. (2009).","key":"e_1_2_2_26_1"},{"key":"e_1_2_2_27_1","volume-title":"Why authors don't visualize uncertainty","author":"Hullman Jessica","year":"2019","unstructured":"Jessica Hullman. 2019. Why authors don't visualize uncertainty. IEEE transactions on visualization and computer graphics, Vol. 26, 1 (2019), 130--139."},{"doi-asserted-by":"crossref","unstructured":"Jessica Hullman Xiaoli Qiao Michael Correll Alex Kale and Matthew Kay. 2018. In pursuit of error: A survey of uncertainty visualization evaluation. IEEE transactions on visualization and computer graphics Vol. 25 1 (2018) 903--913.","key":"e_1_2_2_28_1","DOI":"10.1109\/TVCG.2018.2864889"},{"doi-asserted-by":"publisher","key":"e_1_2_2_29_1","DOI":"10.1371\/journal.pone.0142444"},{"doi-asserted-by":"publisher","key":"e_1_2_2_30_1","DOI":"10.1145\/3178876.3186134"},{"key":"e_1_2_2_31_1","volume-title":"Bounded rationality. Annual review of political science","author":"Jones Bryan D","year":"1999","unstructured":"Bryan D Jones. 1999. Bounded rationality. Annual review of political science, Vol. 2, 1 (1999), 297--321."},{"doi-asserted-by":"crossref","unstructured":"Daniel Kahneman and Amos Tversky. 2013. Prospect theory: An analysis of decision under risk. In Handbook of the fundamentals of financial decision making: Part I. World Scientific 99--127.","key":"e_1_2_2_32_1","DOI":"10.1142\/9789814417358_0006"},{"key":"e_1_2_2_33_1","volume-title":"Hypothetical outcome plots help untrained observers judge trends in ambiguous data","author":"Kale Alex","year":"2018","unstructured":"Alex Kale, Francis Nguyen, Matthew Kay, and Jessica Hullman. 2018. Hypothetical outcome plots help untrained observers judge trends in ambiguous data. IEEE transactions on visualization and computer graphics, Vol. 25, 1 (2018), 892--902."},{"doi-asserted-by":"publisher","key":"e_1_2_2_34_1","DOI":"10.1145\/2858036.2858558"},{"doi-asserted-by":"publisher","key":"e_1_2_2_35_1","DOI":"10.1109\/TVCG.2021.3114842"},{"volume-title":"Numerical ecology","author":"Legendre Pierre","unstructured":"Pierre Legendre and Louis Legendre. 2012. Numerical ecology. Elsevier.","key":"e_1_2_2_36_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_37_1","DOI":"10.1111\/jcc4.12029"},{"doi-asserted-by":"publisher","key":"e_1_2_2_38_1","DOI":"10.1109\/ASPDAC.2018.8297361"},{"doi-asserted-by":"publisher","key":"e_1_2_2_39_1","DOI":"10.1145\/3411764.3445562"},{"volume-title":"Exponential random graph models for social networks: Theory, methods, and applications","author":"Lusher Dean","unstructured":"Dean Lusher, Johan Koskinen, and Garry Robins. 2013. Exponential random graph models for social networks: Theory, methods, and applications. Cambridge University Press.","key":"e_1_2_2_40_1"},{"volume-title":"Statistical rethinking: A Bayesian course with examples in R and Stan","author":"McElreath Richard","unstructured":"Richard McElreath. 2020. Statistical rethinking: A Bayesian course with examples in R and Stan. Chapman and Hall\/CRC.","key":"e_1_2_2_41_1"},{"key":"e_1_2_2_42_1","volume-title":"Quantal response equilibria for normal form games. Games and economic behavior","author":"McKelvey Richard D","year":"1995","unstructured":"Richard D McKelvey and Thomas R Palfrey. 1995. Quantal response equilibria for normal form games. Games and economic behavior, Vol. 10, 1 (1995), 6--38."},{"key":"e_1_2_2_43_1","first-page":"4929","article-title":"Stochastic optimization for performative prediction","volume":"33","author":"Mendler-D\u00fcnner Celestine","year":"2020","unstructured":"Celestine Mendler-D\u00fcnner, Juan Perdomo, Tijana Zrnic, and Moritz Hardt. 2020. Stochastic optimization for performative prediction. Advances in Neural Information Processing Systems, Vol. 33 (2020), 4929--4939.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_44_1","volume-title":"International Conference on Machine Learning. PMLR, 7710--7720","author":"Miller John P","year":"2021","unstructured":"John P Miller, Juan C Perdomo, and Tijana Zrnic. 2021. Outside the echo chamber: Optimizing the performative risk. In International Conference on Machine Learning. PMLR, 7710--7720."},{"doi-asserted-by":"publisher","key":"e_1_2_2_45_1","DOI":"10.1109\/ITSC.2012.6338680"},{"doi-asserted-by":"publisher","key":"e_1_2_2_46_1","DOI":"10.1111\/j.0906-7590.2008.05548.x"},{"doi-asserted-by":"crossref","unstructured":"Anthony O'Hagan Caitlin E Buck Alireza Daneshkhah J Richard Eiser Paul H Garthwaite David J Jenkinson Jeremy E Oakley and Tim Rakow. 2006. Uncertain judgements: eliciting experts' probabilities. (2006).","key":"e_1_2_2_47_1","DOI":"10.1002\/0470033312"},{"key":"e_1_2_2_48_1","volume-title":"International Conference on Machine Learning. PMLR, 7599--7609","author":"Perdomo Juan","year":"2020","unstructured":"Juan Perdomo, Tijana Zrnic, Celestine Mendler-D\u00fcnner, and Moritz Hardt. 2020. Performative prediction. In International Conference on Machine Learning. PMLR, 7599--7609."},{"key":"e_1_2_2_49_1","volume-title":"Bert Van Willigen, and R Maintainer","author":"Pinheiro Jos\u00e9","year":"2017","unstructured":"Jos\u00e9 Pinheiro, Douglas Bates, Saikat DebRoy, Deepayan Sarkar, Siem Heisterkamp, Bert Van Willigen, and R Maintainer. 2017. Package ?nlme'. Linear and nonlinear mixed effects models, version, Vol. 3, 1 (2017)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_50_1","DOI":"10.1016\/j.jet.2008.11.010"},{"doi-asserted-by":"publisher","key":"e_1_2_2_51_1","DOI":"10.1007\/BF01737559"},{"volume-title":"Selfish routing and the price of anarchy","author":"Roughgarden Tim","unstructured":"Tim Roughgarden. 2005. Selfish routing and the price of anarchy. MIT press.","key":"e_1_2_2_52_1"},{"key":"e_1_2_2_53_1","volume-title":"Proceedings of the ARPA image understanding workshop","volume":"661","author":"Rubner Yossi","year":"1997","unstructured":"Yossi Rubner, Leonidas J Guibas, and Carlo Tomasi. 1997. The earth mover's distance, multi-dimensional scaling, and color-based image retrieval. In Proceedings of the ARPA image understanding workshop, Vol. 661. 668."},{"doi-asserted-by":"publisher","key":"e_1_2_2_54_1","DOI":"10.1109\/ICCV.1998.710701"},{"key":"e_1_2_2_55_1","first-page":"649","article-title":"Bounded rationality","volume":"146","author":"Selten Reinhard","year":"1990","unstructured":"Reinhard Selten. 1990. Bounded rationality. Journal of Institutional and Theoretical Economics (JITE)\/Zeitschrift f\u00fcr die gesamte Staatswissenschaft, Vol. 146, 4 (1990), 649--658.","journal-title":"Journal of Institutional and Theoretical Economics (JITE)\/Zeitschrift f\u00fcr die gesamte Staatswissenschaft"},{"key":"e_1_2_2_56_1","volume-title":"Rational choice and the structure of the environment. Psychological review","author":"Simon Herbert A","year":"1956","unstructured":"Herbert A Simon. 1956. Rational choice and the structure of the environment. Psychological review, Vol. 63, 2 (1956), 129."},{"key":"e_1_2_2_57_1","volume-title":"Bounded rationality. Utility and probability","author":"Simon Herbert A","year":"1990","unstructured":"Herbert A Simon. 1990. Bounded rationality. Utility and probability (1990), 15--18."},{"key":"e_1_2_2_58_1","volume-title":"An introduction to hierarchical linear modelling. Statistics in medicine","author":"Sullivan Lisa M","year":"1999","unstructured":"Lisa M Sullivan, Kimberly A Dukes, and Elena Losina. 1999. An introduction to hierarchical linear modelling. Statistics in medicine, Vol. 18, 7 (1999), 855--888."},{"key":"e_1_2_2_59_1","volume-title":"Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning. arXiv preprint arXiv:1901.09216","author":"Wen Ying","year":"2019","unstructured":"Ying Wen, Yaodong Yang, Rui Luo, and Jun Wang. 2019. Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning. arXiv preprint arXiv:1901.09216 (2019)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_60_1","DOI":"10.5555\/3491440.3491498"},{"doi-asserted-by":"publisher","key":"e_1_2_2_61_1","DOI":"10.2307\/2346786"},{"key":"e_1_2_2_62_1","first-page":"921","article-title":"Behavioral game theoretic models: a Bayesian framework for parameter analysis","volume":"12","author":"Wright James R","year":"2012","unstructured":"James R Wright and Kevin Leyton-Brown. 2012. Behavioral game theoretic models: a Bayesian framework for parameter analysis.. In AAMAS, Vol. 12. 921--930.","journal-title":"AAMAS"},{"doi-asserted-by":"publisher","key":"e_1_2_2_63_1","DOI":"10.1016\/j.geb.2017.09.009"},{"volume-title":"Interior algorithms for linear, quadratic, and linearly constrained convex programming","author":"Yinyu Ye.","unstructured":"Yinyu Ye. 1988. Interior algorithms for linear, quadratic, and linearly constrained convex programming. Stanford University.","key":"e_1_2_2_64_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_65_1","DOI":"10.1109\/TVCG.2021.3114679"},{"doi-asserted-by":"publisher","key":"e_1_2_2_66_1","DOI":"10.1109\/SCC.2016.51"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637319","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:28:26Z","timestamp":1755883706000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":66,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3637319"],"URL":"https:\/\/doi.org\/10.1145\/3637319","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}