{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T17:25:26Z","timestamp":1767979526947,"version":"3.49.0"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T00:00:00Z","timestamp":1615766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000185","name":"DARPA","doi-asserted-by":"crossref","award":["#N66001-17-2-4030"],"award-info":[{"award-number":["#N66001-17-2-4030"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSF","award":["#1314384"],"award-info":[{"award-number":["#1314384"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2021,3,31]]},"abstract":"<jats:p>\n            Assessing and understanding intelligent agents is a difficult task for users who lack an AI background. \u201cExplainable AI\u201d (XAI) aims to address this problem, but what should be in an explanation? One route toward answering this question is to turn to theories of how humans try to obtain information they seek. Information Foraging Theory (IFT) is one such theory. In this article, we present a series of studies\n            <jats:sup>1<\/jats:sup>\n            using IFT: the first investigates how expert explainers\n            <jats:italic>supply<\/jats:italic>\n            explanations in the RTS domain, the second investigates what explanations domain experts\n            <jats:italic>demand<\/jats:italic>\n            from agents in the RTS domain, and the last focuses on how both populations try to explain a state-of-the-art AI. Our results show that RTS environments like StarCraft offer so many options that change so rapidly, foraging tends to be very costly. Ways foragers attempted to manage such costs included \u201csatisficing\u201d approaches to reduce their cognitive load, such as focusing more on What information than on Why information, strategic use of language to communicate a lot of nuanced information in a few words, and optimizing their environment when possible to make their most valuable information patches readily available. Further, when a real AI entered the picture, even very experienced domain experts had difficulty understanding and judging some of the AI\u2019s unconventional behaviors. Finally, our results reveal ways Information Foraging Theory can inform future XAI interactive explanation environments, and also how XAI can inform IFT.\n          <\/jats:p>","DOI":"10.1145\/3396047","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T12:34:07Z","timestamp":1594125247000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy Players"],"prefix":"10.1145","volume":"11","author":[{"given":"Sean","family":"Penney","sequence":"first","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Dodge","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4964-6059","authenticated-orcid":false,"given":"Andrew","family":"Anderson","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claudia","family":"Hilderbrand","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Logan","family":"Simpson","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Margaret","family":"Burnett","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,15]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018410.1018852"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/3367032.3367221"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2014.6883015"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025212"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2502081.2502098"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2365952.2365964"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1260\/2040-2295.1.2.255"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025485"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979053"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365325"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/116517.116560"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053114"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174136"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302316"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2430545.2430551"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1466607.1466608"},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the Institute of Industrial and Systems Engineers Conference (IISE\u201909)","author":"Sandra","unstructured":"Sandra K. Garrett and Barrett S. Caldwell. 2009. Human factors aspects of planning and response to pandemic events . In Proceedings of the Institute of Industrial and Systems Engineers Conference (IISE\u201909) . 705. Sandra K. Garrett and Barrett S. Caldwell. 2009. Human factors aspects of planning and response to pandemic events. In Proceedings of the Institute of Industrial and Systems Engineers Conference (IISE\u201909). 705."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753431"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2147783.2147788"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.59"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020233"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.09.008"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.158"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.54"},{"key":"e_1_2_2_26_1","first-page":"223","article-title":"Nouvelles recherches sur la distribution florale","volume":"44","author":"Jaccard Paul","year":"1908","unstructured":"Paul Jaccard . 1908 . Nouvelles recherches sur la distribution florale . Bull. Soc. Vaud. Sci. Nat. 44 (1908), 223 \u2013 270 . Paul Jaccard. 1908. Nouvelles recherches sur la distribution florale. Bull. Soc. Vaud. Sci. Nat. 44 (1908), 223\u2013270.","journal-title":"Bull. Soc. Vaud. Sci. Nat."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753529"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300795"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892305"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2800016"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858529"},{"key":"e_1_2_2_32_1","volume-title":"Can AI be taught to explain itself? New York Times. (Nov. 21","author":"Kuang Cliff","year":"2017","unstructured":"Cliff Kuang . 2017. Can AI be taught to explain itself? New York Times. (Nov. 21 2017 ). Retrieved from https:\/\/www.nytimes.com\/2017\/11\/21\/magazine\/can-ai-be-taught-to-explain-itself.html. Cliff Kuang. 2017. Can AI be taught to explain itself? New York Times. (Nov. 21 2017). Retrieved from https:\/\/www.nytimes.com\/2017\/11\/21\/magazine\/can-ai-be-taught-to-explain-itself.html."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207678"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2010.15"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030365.2030367"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cola.2019.04.003"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645244"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753332"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620576"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3635"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157748"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the IEEE Symposium on Visual Languages and Human-centric Computing (VL\/HCC\u201915)","author":"McGregor S.","year":"2015","unstructured":"S. McGregor , H. Buckingham , T. G. Dietterich , R. Houtman , C. Montgomery , and R. Metoyer . 2015. Facilitating testing and debugging of Markov decision processes with interactive visualization . In Proceedings of the IEEE Symposium on Visual Languages and Human-centric Computing (VL\/HCC\u201915) . 53\u201361. DOI:https:\/\/doi.org\/10.1109\/VLHCC. 2015 .7357198 10.1109\/VLHCC.2015.7357198 S. McGregor, H. Buckingham, T. G. Dietterich, R. Houtman, C. Montgomery, and R. Metoyer. 2015. Facilitating testing and debugging of Markov decision processes with interactive visualization. In Proceedings of the IEEE Symposium on Visual Languages and Human-centric Computing (VL\/HCC\u201915). 53\u201361. DOI:https:\/\/doi.org\/10.1109\/VLHCC.2015.7357198"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2009.11.006"},{"key":"e_1_2_2_47_1","volume-title":"Explanation in artificial intelligence: Insights from the social sciences. CoRR abs\/1706.07269","author":"Miller Tim","year":"2017","unstructured":"Tim Miller . 2017. Explanation in artificial intelligence: Insights from the social sciences. CoRR abs\/1706.07269 ( 2017 ). Tim Miller. 2017. Explanation in artificial intelligence: Insights from the social sciences. CoRR abs\/1706.07269 (2017)."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486864"},{"key":"e_1_2_2_49_1","first-page":"7","article-title":"Some observations on mental models","volume":"7","author":"Norman Donald A.","year":"1983","unstructured":"Donald A. Norman . 1983 . Some observations on mental models . Ment. Models 7 , 112 (1983), 7 \u2013 14 . Donald A. Norman. 1983. Some observations on mental models. Ment. Models 7, 112 (1983), 7\u201314.","journal-title":"Ment. Models"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2013.2286295"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172946"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597008.2597151"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208608"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2015.7332447"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950302"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2017.8103444"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1450927"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858469"},{"key":"e_1_2_2_59_1","volume-title":"Version control systems: An information foraging perspective","author":"Ragavan Sruti Srinivasa","year":"2019","unstructured":"Sruti Srinivasa Ragavan , Mihai Codoban , David Piorkowski , Danny Dig , and Burnett Margaret . 2019. Version control systems: An information foraging perspective . IEEE Trans. Softw. Eng . ( 2019 ). DOI:https:\/\/doi.org\/10.1109\/TSE.2019.2931296 10.1109\/TSE.2019.2931296 Sruti Srinivasa Ragavan, Mihai Codoban, David Piorkowski, Danny Dig, and Burnett Margaret. 2019. Version control systems: An information foraging perspective. IEEE Trans. Softw. Eng. (2019). DOI:https:\/\/doi.org\/10.1109\/TSE.2019.2931296"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.5555\/3060621.3060741"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300750"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.5555\/773294"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.5555\/1196684"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858469"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v32i2.2336"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378773.1378781"},{"key":"e_1_2_2_68_1","unstructured":"Adam Summerville Michael Cook and Ben Steenhuisen. 2016. Draft-analysis of the ancients: Predicting draft picks in DotA 2 using machine learning. Retrieved from https:\/\/aaai.org\/ocs\/index.php\/AIIDE\/AIIDE16\/paper\/view\/14075  Adam Summerville Michael Cook and Ben Steenhuisen. 2016. Draft-analysis of the ancients: Predicting draft picks in DotA 2 using machine learning. Retrieved from https:\/\/aaai.org\/ocs\/index.php\/AIIDE\/AIIDE16\/paper\/view\/14075"},{"key":"e_1_2_2_69_1","volume-title":"Proceedings of the International Conference on Cognitive Modeling.","author":"Sycara Katia","year":"2015","unstructured":"Katia Sycara , Christian Lebiere , Yulong Pei , Donald Morrison , and Michael Lewis . 2015 . Abstraction of analytical models from cognitive models of human control of robotic swarms . In Proceedings of the International Conference on Cognitive Modeling. Katia Sycara, Christian Lebiere, Yulong Pei, Donald Morrison, and Michael Lewis. 2015. Abstraction of analytical models from cognitive models of human control of robotic swarms. In Proceedings of the International Conference on Cognitive Modeling."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240630"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/IE.2010.56"},{"key":"e_1_2_2_72_1","unstructured":"Oriol Vinyals. 2017. DeepMind and Blizzard open StarCraft II as an AI research environment. Retrieved from https:\/\/deepmind.com\/blog\/deepmind-and-blizzard-open-starcraft-ii-ai-research-environment\/.  Oriol Vinyals. 2017. DeepMind and Blizzard open StarCraft II as an AI research environment. Retrieved from https:\/\/deepmind.com\/blog\/deepmind-and-blizzard-open-starcraft-ii-ai-research-environment\/."},{"key":"e_1_2_2_73_1","volume-title":"et\u00a0al","author":"Vinyals Oriol","year":"2019","unstructured":"Oriol Vinyals , David Silver , et\u00a0al . 2019 . AlphaStar: Mastering the real-time strategy game StarCraft II. Retrieved from https:\/\/deepmind.com\/blog\/article\/alphastar-mastering-real-time-strategy-game-starcraft-ii. Oriol Vinyals, David Silver, et\u00a0al. 2019. AlphaStar: Mastering the real-time strategy game StarCraft II. Retrieved from https:\/\/deepmind.com\/blog\/article\/alphastar-mastering-real-time-strategy-game-starcraft-ii."},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.5555\/330775"},{"key":"e_1_2_2_75_1","unstructured":"Kevin Wong. 2016. StarCraft 2 and the quest for the highest APM. Retrieved from https:\/\/www.engadget.com\/2014\/10\/24\/starcraft-2-and-the-quest-for-the-highest-apm\/  Kevin Wong. 2016. StarCraft 2 and the quest for the highest APM. Retrieved from https:\/\/www.engadget.com\/2014\/10\/24\/starcraft-2-and-the-quest-for-the-highest-apm\/"},{"key":"e_1_2_2_76_1","volume-title":"Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917)","author":"Wortham Robert H.","unstructured":"Robert H. Wortham , Andreas Theodorou , and Joanna J. Bryson . 2017. Improving robot transparency: Real-time visualisation of robot AI substantially improves understanding in naive observers , In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917) . Retrieved from http:\/\/opus.bath.ac.uk\/55793\/ Robert H. Wortham, Andreas Theodorou, and Joanna J. Bryson. 2017. Improving robot transparency: Real-time visualisation of robot AI substantially improves understanding in naive observers, In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917). Retrieved from http:\/\/opus.bath.ac.uk\/55793\/"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045591"},{"key":"e_1_2_2_78_1","volume-title":"Zeiler and Rob Fergus","author":"Matthew","year":"2014","unstructured":"Matthew D. Zeiler and Rob Fergus . 2014 . Visualizing and Understanding Convolutional Networks. Springer International Publishing , Cham, 818\u2013833. DOI:https:\/\/doi.org\/10.1007\/978-3-319-10590-1_53 10.1007\/978-3-319-10590-1_53 Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and Understanding Convolutional Networks. Springer International Publishing, Cham, 818\u2013833. DOI:https:\/\/doi.org\/10.1007\/978-3-319-10590-1_53"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3396047","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3396047","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3396047","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:45Z","timestamp":1750199925000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3396047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,15]]},"references-count":77,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,31]]}},"alternative-id":["10.1145\/3396047"],"URL":"https:\/\/doi.org\/10.1145\/3396047","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,15]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}