{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T11:50:44Z","timestamp":1751629844038},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:p>As more and more forms of AI become prevalent, it becomes increasingly important to understand how people develop mental models of these systems. In this work we study people's mental models of an AI agent in a cooperative word guessing game. We run a study in which people play the game with an AI agent while ``thinking out loud''; through thematic analysis we identify features of the mental models developed by participants. In a large-scale study we have participants play the game with the AI agent online and use a post-game survey to probe their mental model. We find that those who win more often have better estimates of the AI agent's abilities. We present three components---global knowledge, local knowledge, and knowledge distribution---for modeling AI systems and propose that understanding the underlying technology is insufficient for developing appropriate conceptual models---analysis of behavior is also necessary.<\/jats:p>","DOI":"10.24963\/ijcai.2021\/648","type":"proceedings-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T07:00:49Z","timestamp":1628665249000},"page":"4770-4774","source":"Crossref","is-referenced-by-count":2,"title":["Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)"],"prefix":"10.24963","author":[{"given":"Katy Ilonka","family":"Gero","sequence":"first","affiliation":[{"name":"Columbia University, New York City, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zahra","family":"Ashktorab","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Casey","family":"Dugan","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qian","family":"Pan","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Johnson","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Werner","family":"Geyer","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Ruiz","sequence":"additional","affiliation":[{"name":"IBM Watson"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Miller","sequence":"additional","affiliation":[{"name":"IBM Watson"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David R.","family":"Millen","sequence":"additional","affiliation":[{"name":"IBM Watson"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Murray","family":"Campbell","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sadhana","family":"Kumaravel","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"IBM Research AI"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"number":"30","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"acronym":"IJCAI-2021","name":"Thirtieth International Joint Conference on Artificial Intelligence {IJCAI-21}","start":{"date-parts":[[2021,8,19]]},"theme":"Artificial Intelligence","location":"Montreal, Canada","end":{"date-parts":[[2021,8,27]]}},"container-title":["Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T07:04:30Z","timestamp":1628665470000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2021\/648"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2021\/648","relation":{},"subject":[],"published":{"date-parts":[[2021,8]]}}}