{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T05:23:53Z","timestamp":1782278633105,"version":"3.54.5"},"reference-count":173,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,5,28]],"date-time":"2023-05-28T00:00:00Z","timestamp":1685232000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"H2020","doi-asserted-by":"crossref","award":["952026, CHIST-ERA-19-XAI-010-MUR-484-22"],"award-info":[{"award-number":["952026, CHIST-ERA-19-XAI-010-MUR-484-22"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]},{"name":"European Union under the Italian National Recovery and Resilience Plan (NRRP) of partnership on \u201cArtifical Intelligence: Foundational","award":["PE0000013-program \u201cFAIR\u201d"],"award-info":[{"award-number":["PE0000013-program \u201cFAIR\u201d"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>Given the popular presupposition of human reasoning as the standard for learning and decision making, there have been significant efforts and a growing trend in research to replicate these innate human abilities in artificial systems. As such, topics including Game Theory, Theory of Mind, and Machine Learning, among others, integrate concepts that are assumed components of human reasoning. These serve as techniques to replicate and understand the behaviors of humans. In addition, next-generation autonomous and adaptive systems will largely include AI agents and humans working together as teams. To make this possible, autonomous agents will require the ability to embed practical models of human behavior, allowing them not only to replicate human models as a technique to \u201clearn\u201d but also to understand the actions of users and anticipate their behavior, so as to truly operate in symbiosis with them. The main objective of this article is to provide a succinct yet systematic review of important approaches in two areas dealing with quantitative models of human behaviors. Specifically, we focus on (i) techniques that learn a model or policy of behavior through exploration and feedback, such as Reinforcement Learning, and (ii) directly model mechanisms of human reasoning, such as beliefs and bias, without necessarily learning via trial and error.<\/jats:p>","DOI":"10.1145\/3580492","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T12:02:56Z","timestamp":1674561776000},"page":"1-47","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Modeling, Replicating, and Predicting Human Behavior: A Survey"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7191-8781","authenticated-orcid":false,"given":"Andrew","family":"Fuchs","sequence":"first","affiliation":[{"name":"Universit\u00e1 di Pisa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1694-612X","authenticated-orcid":false,"given":"Andrea","family":"Passarella","sequence":"additional","affiliation":[{"name":"National Research Council (CNR)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4097-4064","authenticated-orcid":false,"given":"Marco","family":"Conti","sequence":"additional","affiliation":[{"name":"National Research Council (CNR)"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,5,28]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015430"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2017.05.004"},{"key":"e_1_3_1_4_2","unstructured":"Malik Ghallab Adele Howe Craig Knoblock Drew McDermott Ashwin Ram Manuela Veloso Daniel Weld et\u00a0al. 1998. PDDL\u2014The Planning Domain Definition Language . Technical Report CVC TR-98-003\/DCS TR-1165. Yale Center for Computational Vision and Control."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10699-018-9559-x"},{"key":"e_1_3_1_6_2","first-page":"1896","volume-title":"Proceedings of the Conference on Robot Learning","author":"Akbulut Mete","year":"2021","unstructured":"Mete Akbulut, Erhan Oztop, Muhammet Yunus Seker, X. Hh, Ahmet Tekden, and Emre Ugur. 2021. ACNMP: Skill transfer and task extrapolation through learning from demonstration and reinforcement learning via representation sharing. In Proceedings of the Conference on Robot Learning. 1896\u20131907."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1912341117"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203771730"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1996.0007"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103500"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2743240"},{"key":"e_1_3_1_12_2","doi-asserted-by":"crossref","unstructured":"Alireza Asgari and Yvan Beauregard. 2021. Brain-inspired model for decision-making in the selection of beneficial information among signals received by an unpredictable information-development environment. Preprint (2021).","DOI":"10.31224\/osf.io\/5rq6e"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1057\/s41599-019-0265-2"},{"key":"e_1_3_1_14_2","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society","volume":"33","author":"Baker Chris","year":"2011","unstructured":"Chris Baker, Rebecca Saxe, and Joshua Tenenbaum. 2011. Bayesian theory of mind: Modeling joint belief-desire attribution. In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 33."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.1994.577208"},{"key":"e_1_3_1_17_2","article-title":"Modeling human driving behavior through generative adversarial imitation learning","author":"Bhattacharyya Raunak","year":"2020","unstructured":"Raunak Bhattacharyya, Blake Wulfe, Derek Phillips, Alex Kuefler, Jeremy Morton, Ransalu Senanayake, and Mykel Kochenderfer. 2020. Modeling human driving behavior through generative adversarial imitation learning. arXiv preprint arXiv:2006.06412 (2020).","journal-title":"arXiv preprint arXiv:2006.06412"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/CEEC47804.2019.8974334"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1108\/ITSE-05-2020-0069"},{"key":"e_1_3_1_20_2","article-title":"Thinking fast and slow in AI","author":"Booch Grady","year":"2020","unstructured":"Grady Booch, Francesco Fabiano, Lior Horesh, Kiran Kate, Jon Lenchner, Nick Linck, Andrea Loreggia, et\u00a0al. 2020. Thinking fast and slow in AI. arXiv preprint arXiv:2010.06002 (2020).","journal-title":"arXiv preprint arXiv:2010.06002"},{"key":"e_1_3_1_21_2","unstructured":"Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:1606.01540 (2016)."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2006.01.003"},{"key":"e_1_3_1_23_2","article-title":"StylePredict: Machine theory of mind for human driver behavior from trajectories","author":"Chandra Rohan","year":"2020","unstructured":"Rohan Chandra, Aniket Bera, and Dinesh Manocha. 2020. StylePredict: Machine theory of mind for human driver behavior from trajectories. arXiv preprint arXiv:2011.04816 (2020).","journal-title":"arXiv preprint arXiv:2011.04816"},{"key":"e_1_3_1_24_2","article-title":"DROGON: A trajectory prediction model based on intention-conditioned behavior reasoning","author":"Choi Chiho","year":"2019","unstructured":"Chiho Choi, Srikanth Malla, Abhishek Patil, and Joon Hee Choi. 2019. DROGON: A trajectory prediction model based on intention-conditioned behavior reasoning. arXiv preprint arXiv:1908.00024 (2019).","journal-title":"arXiv preprint arXiv:1908.00024"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/8893795"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2017.07.009"},{"key":"e_1_3_1_27_2","article-title":"Attention, please! A survey of neural attention models in deep learning","author":"Correia Alana de Santana","year":"2021","unstructured":"Alana de Santana Correia and Esther Luna Colombini. 2021. Attention, please! A survey of neural attention models in deep learning. arXiv preprint arXiv:2103.16775 (2021).","journal-title":"arXiv preprint arXiv:2103.16775"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/3-540-45632-5_11","volume-title":"Computational Logic: Logic Programming and Beyond","author":"Costantini Stefania","year":"2002","unstructured":"Stefania Costantini. 2002. Meta-reasoning: A survey. In Computational Logic: Logic Programming and Beyond. Springer, 253\u2013288."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12513"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.5555\/AAI28444884"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000178"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/SBGames.2019.00030"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.3390\/e22020174"},{"key":"e_1_3_1_34_2","article-title":"The future of human-AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems","author":"Dellermann Dominik","year":"2021","unstructured":"Dominik Dellermann, Adrian Calma, Nikolaus Lipusch, Thorsten Weber, Sascha Weigel, and Philipp Ebel. 2021. The future of human-AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems. arXiv preprint arXiv:2105.03354 (2021).","journal-title":"arXiv preprint arXiv:2105.03354"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-019-01286-2"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2018.0053"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.plrev.2017.06.026"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450694"},{"key":"e_1_3_1_39_2","volume-title":"Think Critically","author":"Facione P. A.","year":"2012","unstructured":"P. A. Facione and C. A. Gittens. 2012. Think Critically. Pearson. 2011050397https:\/\/books.google.it\/books?id=YGM5ygAACAAJ."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2020.2988287"},{"key":"e_1_3_1_41_2","article-title":"Modeling theory of mind in multi-agent games using adaptive feedback control","author":"Freire Ismael T.","year":"2019","unstructured":"Ismael T. Freire, Xerxes D. Arsiwalla, Jordi-Ysard Puigb\u00f2, and Paul Verschure. 2019. Modeling theory of mind in multi-agent games using adaptive feedback control. arXiv preprint arXiv:1905.13225 (2019).","journal-title":"arXiv preprint arXiv:1905.13225"},{"key":"e_1_3_1_42_2","article-title":"Modeling human behavior part I\u2014Learning and belief approaches","author":"Fuchs Andrew","year":"2022","unstructured":"Andrew Fuchs, Andrea Passarella, and Marco Conti. 2022. Modeling human behavior part I\u2014Learning and belief approaches. arXiv preprint arXiv:2205.06485 (2022).","journal-title":"arXiv preprint arXiv:2205.06485"},{"key":"e_1_3_1_43_2","article-title":"Modeling human behavior part II\u2014Cognitive approaches and uncertainty","author":"Fuchs Andrew","year":"2022","unstructured":"Andrew Fuchs, Andrea Passarella, and Marco Conti. 2022. Modeling human behavior part II\u2014Cognitive approaches and uncertainty. arXiv preprint arXiv:2205.06483 (2022).","journal-title":"arXiv preprint arXiv:2205.06483"},{"key":"e_1_3_1_44_2","article-title":"Human-AI collaboration with bandit feedback","author":"Gao Ruijiang","year":"2021","unstructured":"Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Min Kyung Lee, and Matthew Lease. 2021. Human-AI collaboration with bandit feedback. arXiv preprint arXiv:2105.10614 (2021).","journal-title":"arXiv preprint arXiv:2105.10614"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aac6076"},{"key":"e_1_3_1_46_2","first-page":"1","volume-title":"Moral Psychology","author":"Gigerenzer Gerd","year":"2008","unstructured":"Gerd Gigerenzer. 2008. Moral intuition = fast and frugal heuristics? In Moral Psychology. MIT Press, Cambridge, MA, 1\u201326."},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2704_2"},{"key":"e_1_3_1_48_2","article-title":"Inductive biases for deep learning of higher-level cognition","author":"Goyal Anirudh","year":"2020","unstructured":"Anirudh Goyal and Yoshua Bengio. 2020. Inductive biases for deep learning of higher-level cognition. arXiv preprint arXiv:2011.15091 (2020).","journal-title":"arXiv preprint arXiv:2011.15091"},{"issue":"3","key":"e_1_3_1_49_2","first-page":"17","article-title":"Attributing awareness to others: The attention schema theory and its relationship to behavioural prediction","volume":"26","author":"Graziano Michael S. A.","year":"2019","unstructured":"Michael S. A. Graziano. 2019. Attributing awareness to others: The attention schema theory and its relationship to behavioural prediction. Journal of Consciousness Studies 26, 3-4 (2019), 17\u201337.","journal-title":"Journal of Consciousness Studies"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186138"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2019.01.005"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2005.05.004"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envsoft.2016.10.008"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1819668"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSSC.1968.300136"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2018.03.014"},{"key":"e_1_3_1_57_2","article-title":"Fairness behind a veil of ignorance: A welfare analysis for automated decision making","volume":"31","author":"Heidari Hoda","year":"2018","unstructured":"Hoda Heidari, Claudio Ferrari, Krishna Gummadi, and Andreas Krause. 2018. Fairness behind a veil of ignorance: A welfare analysis for automated decision making. Advances in Neural Information Processing Systems 31 (2018), 1\u201312.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_58_2","series-title":"Proceedings of the 36th International Conference on Machine Learning","first-page":"2692","volume":"97","author":"Heidari Hoda","year":"2019","unstructured":"Hoda Heidari, Vedant Nanda, and Krishna Gummadi. 2019. On the long-term impact of algorithmic decision policies: Effort unfairness and feature segregation through social learning. In Proceedings of the 36th International Conference on Machine Learning, Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). Proceedings of Machine Learning Research, Vol. 97. PMLR, 2692\u20132701. https:\/\/proceedings.mlr.press\/v97\/heidari19a.html."},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2021.10.007"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-018-1361-5"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-04083-2_2"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2021.3092610"},{"key":"e_1_3_1_63_2","article-title":"Meta-learning in neural networks: A survey","author":"Hospedales Timothy","year":"2020","unstructured":"Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2020. Meta-learning in neural networks: A survey. arXiv preprint arXiv:2004.05439 (2020).","journal-title":"arXiv preprint arXiv:2004.05439"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amc.2018.11.036"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-021-10004-4"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3054912"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1177\/1948550617691100"},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"C. Jones. 2020. The cerebral cortex realizes a universal probabilistic model of computation in complex Hilbert spaces. Preprint (2020).","DOI":"10.31234\/osf.io\/gbmk6"},{"key":"e_1_3_1_69_2","article-title":"Never stop learning: The effectiveness of fine-tuning in robotic reinforcement learning","author":"Julian Ryan","year":"2020","unstructured":"Ryan Julian, Benjamin Swanson, Gaurav S. Sukhatme, Sergey Levine, Chelsea Finn, and Karol Hausman. 2020. Never stop learning: The effectiveness of fine-tuning in robotic reinforcement learning. arXiv preprint arXiv:2004.10190 (2020).","journal-title":"arXiv preprint arXiv:2004.10190"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0031322"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21072514"},{"key":"e_1_3_1_72_2","article-title":"Challenges of human-aware AI systems","author":"Kambhampati Subbarao","year":"2019","unstructured":"Subbarao Kambhampati. 2019. Challenges of human-aware AI systems. arXiv preprint arXiv:1910.07089 (2019).","journal-title":"arXiv preprint arXiv:1910.07089"},{"key":"e_1_3_1_73_2","first-page":"3491","volume-title":"Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci\u201919)","author":"Kelly Matthew A.","year":"2019","unstructured":"Matthew A. Kelly, Nipun Arora, Robert L. West, and David Reitter. 2019. High-dimensional vector spaces as the architecture of cognition. In Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci\u201919). 3491."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-90-481-8927-4_9"},{"key":"e_1_3_1_75_2","doi-asserted-by":"crossref","unstructured":"Akif Quddus Khan Salman Khan and Utkurbek Safaev. 2022. Serious games and gamification: A systematic literature review. Virtual Reality & Intelligent Hardware 4 3 (2022) 189\u2013209.","DOI":"10.1016\/j.vrih.2022.02.001"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2964726"},{"key":"e_1_3_1_77_2","article-title":"Equilibrium computation of generalized Nash games: A new Lagrangian-based approach","author":"Kim Jong Gwang","year":"2021","unstructured":"Jong Gwang Kim. 2021. Equilibrium computation of generalized Nash games: A new Lagrangian-based approach. arXiv preprint arXiv:2106.00109 (2021).","journal-title":"arXiv preprint arXiv:2106.00109"},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3116303"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-018-9646-y"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v15i1.5223"},{"key":"e_1_3_1_81_2","article-title":"Learning not to learn: Nature versus nurture in silico","author":"Lange Robert Tjarko","year":"2020","unstructured":"Robert Tjarko Lange and Henning Sprekeler. 2020. Learning not to learn: Nature versus nurture in silico. arXiv preprint arXiv:2010.04466 (2020).","journal-title":"arXiv preprint arXiv:2010.04466"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF03354932"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_3_1_84_2","article-title":"Offline reinforcement learning: Tutorial, review, and perspectives on open problems","author":"Levine Sergey","year":"2020","unstructured":"Sergey Levine, Aviral Kumar, George Tucker, and Justin Fu. 2020. Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv preprint arXiv:2005.01643 (2020).","journal-title":"arXiv preprint arXiv:2005.01643"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X1900061X"},{"key":"e_1_3_1_86_2","volume-title":"Proceedings of the 39th Annual Meeting of the Cognitive Science Society (CogSci\u201917)","author":"Lieder Falk","year":"2017","unstructured":"Falk Lieder, Paul M. Krueger, and Tom Griffiths. 2017. An automatic method for discovering rational heuristics for risky choice. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society (CogSci\u201917)."},{"key":"e_1_3_1_87_2","doi-asserted-by":"crossref","unstructured":"Antonio Lieto Mehul Bhatt Alessandro Oltramari and David Vernon. 2018. The role of cognitive architectures in general artificial intelligence. Cognitive Systems Research 48 (2018) 1\u20133.","DOI":"10.1016\/j.cogsys.2017.08.003"},{"key":"e_1_3_1_88_2","doi-asserted-by":"publisher","DOI":"10.5555\/3306127.3331673"},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-020-00626-z"},{"key":"e_1_3_1_90_2","article-title":"Can resources save rationality? \u201cAnti-Bayesian\u201d updating in cognition and perception","volume":"143","author":"Mandelbaum Eric","year":"2020","unstructured":"Eric Mandelbaum, Isabel Won, Steven Gross, and Chaz Firestone. 2020. Can resources save rationality? \u201cAnti-Bayesian\u201d updating in cognition and perception. Behavioral and Brain Sciences 143 (2020), e16.","journal-title":"Behavioral and Brain Sciences"},{"key":"e_1_3_1_91_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envsoft.2018.09.016"},{"key":"e_1_3_1_92_2","article-title":"Core challenges of social robot navigation: A survey","author":"Mavrogiannis Christoforos","year":"2021","unstructured":"Christoforos Mavrogiannis, Francesca Baldini, Allan Wang, Dapeng Zhao, Pete Trautman, Aaron Steinfeld, and Jean Oh. 2021. Core challenges of social robot navigation: A survey. arXiv preprint arXiv:2103.05668 (2021).","journal-title":"arXiv preprint arXiv:2103.05668"},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2021.104881"},{"key":"e_1_3_1_94_2","article-title":"A survey on human-aware robot navigation","author":"M\u00f6ller Ronja","year":"2021","unstructured":"Ronja M\u00f6ller, Antonino Furnari, Sebastiano Battiato, Aki H\u00e4rm\u00e4, and Giovanni Maria Farinella. 2021. A survey on human-aware robot navigation. arXiv preprint arXiv:2106.11650 (2021).","journal-title":"arXiv preprint arXiv:2106.11650"},{"key":"e_1_3_1_95_2","article-title":"Towards a quantum-like cognitive architecture for decision-making","author":"Moreira Catarina","year":"2019","unstructured":"Catarina Moreira, Lauren Fell, Shahram Dehdashti, Peter Bruza, and Andreas Wichert. 2019. Towards a quantum-like cognitive architecture for decision-making. arXiv preprint arXiv:1905.05176 (2019).","journal-title":"arXiv preprint arXiv:1905.05176"},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2017.11.003"},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445290"},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.5194\/esd-8-977-2017"},{"key":"e_1_3_1_99_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2021.584075"},{"key":"e_1_3_1_100_2","article-title":"Human AI interaction loop training: New approach for interactive reinforcement learning","author":"Navidi Neda","year":"2020","unstructured":"Neda Navidi. 2020. Human AI interaction loop training: New approach for interactive reinforcement learning. arXiv preprint arXiv:2003.04203 (2020).","journal-title":"arXiv preprint arXiv:2003.04203"},{"key":"e_1_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11073068"},{"key":"e_1_3_1_102_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3074695"},{"key":"e_1_3_1_103_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.03.091"},{"key":"e_1_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0470-8"},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01699-5"},{"key":"e_1_3_1_106_2","article-title":"AttendLight: Universal attention-based reinforcement learning model for traffic signal control","author":"Oroojlooy Afshin","year":"2020","unstructured":"Afshin Oroojlooy, Mohammadreza Nazari, Davood Hajinezhad, and Jorge Silva. 2020. AttendLight: Universal attention-based reinforcement learning model for traffic signal control. arXiv preprint arXiv:2010.05772 (2020).","journal-title":"arXiv preprint arXiv:2010.05772"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1561\/2300000053"},{"key":"e_1_3_1_108_2","article-title":"Towards human-level learning of complex physical puzzles","author":"Ota Kei","year":"2020","unstructured":"Kei Ota, Devesh K. Jha, Diego Romeres, Jeroen van Baar, Kevin A. Smith, Takayuki Semitsu, Tomoaki Oiki, Alan Sullivan, Daniel Nikovski, and Joshua B. Tenenbaum. 2020. Towards human-level learning of complex physical puzzles. arXiv E-prints CoRR abs\/2011.07193 (2020).","journal-title":"arXiv E-prints CoRR abs\/2011.07193"},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3068887"},{"key":"e_1_3_1_110_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976699300016890"},{"key":"e_1_3_1_111_2","doi-asserted-by":"publisher","DOI":"10.1080\/17439884.2020.1686017"},{"key":"e_1_3_1_112_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0024722"},{"key":"e_1_3_1_113_2","article-title":"A survey on offline reinforcement learning: Taxonomy, review, and open problems","author":"Prudencio Rafael Figueiredo","year":"2022","unstructured":"Rafael Figueiredo Prudencio, Marcos R. O. A. Maximo, and Esther Luna Colombini. 2022. A survey on offline reinforcement learning: Taxonomy, review, and open problems. arXiv preprint arXiv:2203.01387 (2022).","journal-title":"arXiv preprint arXiv:2203.01387"},{"key":"e_1_3_1_114_2","article-title":"Watch-and-help: A challenge for social perception and human-AI collaboration","author":"Puig Xavier","year":"2020","unstructured":"Xavier Puig, Tianmin Shu, Shuang Li, Zilin Wang, Yuan-Hong Liao, Joshua B. Tenenbaum, Sanja Fidler, and Antonio Torralba. 2020. Watch-and-help: A challenge for social perception and human-AI collaboration. arXiv preprint arXiv:2010.09890 (2020).","journal-title":"arXiv preprint arXiv:2010.09890"},{"key":"e_1_3_1_115_2","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"Puterman Martin L.","year":"2014","unstructured":"Martin L. Puterman. 2014. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons."},{"key":"e_1_3_1_116_2","first-page":"4218","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Rabinowitz Neil","year":"2018","unstructured":"Neil Rabinowitz, Frank Perbet, Francis Song, Chiyuan Zhang, S. M. Ali Eslami, and Matthew Botvinick. 2018. Machine theory of mind. In Proceedings of the International Conference on Machine Learning. 4218\u20134227."},{"key":"e_1_3_1_117_2","article-title":"The algorithmic automation problem: Prediction, triage, and human effort","author":"Raghu Maithra","year":"2019","unstructured":"Maithra Raghu, Katy Blumer, Greg Corrado, Jon Kleinberg, Ziad Obermeyer, and Sendhil Mullainathan. 2019. The algorithmic automation problem: Prediction, triage, and human effort. arXiv preprint arXiv:1903.12220 (2019).","journal-title":"arXiv preprint arXiv:1903.12220"},{"key":"e_1_3_1_118_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1138-y"},{"key":"e_1_3_1_119_2","article-title":"Unpacking human teachers\u2019 intentions for natural interactive task learning","author":"Ramaraj Preeti","year":"2021","unstructured":"Preeti Ramaraj, Charles L. Ortiz Jr., Matthew Klenk, and Shiwali Mohan. 2021. Unpacking human teachers\u2019 intentions for natural interactive task learning. arXiv preprint arXiv:2102.06755 (2021).","journal-title":"arXiv preprint arXiv:2102.06755"},{"key":"e_1_3_1_120_2","article-title":"Deciding fast and slow: The role of cognitive biases in AI-assisted decision-making","author":"Rastogi Charvi","year":"2020","unstructured":"Charvi Rastogi, Yunfeng Zhang, Dennis Wei, Kush R. Varshney, Amit Dhurandhar, and Richard Tomsett. 2020. Deciding fast and slow: The role of cognitive biases in AI-assisted decision-making. arXiv preprint arXiv:2010.07938 (2020).","journal-title":"arXiv preprint arXiv:2010.07938"},{"key":"e_1_3_1_121_2","article-title":"Shared autonomy via deep reinforcement learning","author":"Reddy Siddharth","year":"2018","unstructured":"Siddharth Reddy, Anca D. Dragan, and Sergey Levine. 2018. Shared autonomy via deep reinforcement learning. arXiv preprint arXiv:1802.01744 (2018).","journal-title":"arXiv preprint arXiv:1802.01744"},{"key":"e_1_3_1_122_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472291"},{"key":"e_1_3_1_123_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2014.2307024"},{"key":"e_1_3_1_124_2","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.1488"},{"issue":"2","key":"e_1_3_1_125_2","first-page":"241","article-title":"Simulation models of human decision-making processes","volume":"2","author":"Rizun Nina","year":"2014","unstructured":"Nina Rizun and Yurii Taranenko. 2014. Simulation models of human decision-making processes. Management Dynamics in the Knowledge Economy 2, 2 (2014), 241\u2013264.","journal-title":"Management Dynamics in the Knowledge Economy"},{"key":"e_1_3_1_126_2","unstructured":"Stuart Russell and Peter Norvig. 2003. Artificial Intelligence: A Modern Approach (2nd ed.). Prentice Hall."},{"key":"e_1_3_1_127_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(91)90015-C"},{"key":"e_1_3_1_128_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1062-9769(96)90006-X"},{"key":"e_1_3_1_129_2","first-page":"2734","volume-title":"Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci\u201919)","author":"Scharfe Marlene","year":"2019","unstructured":"Marlene Scharfe and Nele Russwinkel. 2019. A cognitive model for understanding the takeover in highly automated driving depending on the objective complexity of non-driving related tasks and the traffic environment. In Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci\u201919). 2734\u20132740."},{"key":"e_1_3_1_130_2","volume-title":"Proceedings of the 17th International Conference on Cognitive Modelling.","author":"Scharfe Marlene","year":"2019","unstructured":"Marlene Scharfe and Nele Russwinkel. 2019. Towards a cognitive model of the takeover in highly automated driving for the improvement of human machine interaction. In Proceedings of the 17th International Conference on Cognitive Modelling."},{"key":"e_1_3_1_131_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888906000944"},{"key":"e_1_3_1_132_2","article-title":"Humans learn too: Better human-AI interaction using optimized human inputs","author":"Schneider Johannes","year":"2020","unstructured":"Johannes Schneider. 2020. Humans learn too: Better human-AI interaction using optimized human inputs. arXiv preprint arXiv:2009.09266 (2020).","journal-title":"arXiv preprint arXiv:2009.09266"},{"key":"e_1_3_1_133_2","article-title":"Human-robot collaboration and machine learning: A systematic review of recent research","author":"Semeraro Francesco","year":"2021","unstructured":"Francesco Semeraro, Alexander Griffiths, and Angelo Cangelosi. 2021. Human-robot collaboration and machine learning: A systematic review of recent research. arXiv preprint arXiv:2110.07448 (2021).","journal-title":"arXiv preprint arXiv:2110.07448"},{"key":"e_1_3_1_134_2","volume-title":"Active Learning Literature Survey","author":"Settles Burr","year":"2009","unstructured":"Burr Settles. 2009. Active Learning Literature Survey. Computer Sciences Technical Report 1648. University of Wisconsin\u2013Madison."},{"key":"e_1_3_1_135_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-012-9200-2"},{"key":"e_1_3_1_136_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-349-20568-4_5"},{"key":"e_1_3_1_137_2","doi-asserted-by":"publisher","DOI":"10.5555\/3237383.3237943"},{"key":"e_1_3_1_138_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2019.08.034"},{"key":"e_1_3_1_139_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2021.118035"},{"key":"e_1_3_1_140_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77873-6_12"},{"key":"e_1_3_1_141_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2012.6252552"},{"key":"e_1_3_1_142_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.570430"},{"key":"e_1_3_1_143_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction (2nd ed.). MIT Press, Cambridge, MA."},{"key":"e_1_3_1_144_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-26196-w"},{"key":"e_1_3_1_145_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1192788"},{"key":"e_1_3_1_146_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jarmac.2014.06.002"},{"key":"e_1_3_1_147_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6386109"},{"key":"e_1_3_1_148_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"e_1_3_1_149_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-devpsych-121318-084833"},{"key":"e_1_3_1_150_2","unstructured":"Christoph Urban and Bernd Schmidt. 2001. PECS\u2013agent-based modelling of human behaviour. In Emotional and Intelligent\u2014The Tangled Knot of Social Cognition . AAAI Fall Symposium Series. AAAI."},{"key":"e_1_3_1_151_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_2"},{"key":"e_1_3_1_152_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017), 1\u201311.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_153_2","article-title":"Understanding mental models of AI through player-AI interaction","author":"Villareale Jennifer","year":"2021","unstructured":"Jennifer Villareale and Jichen Zhu. 2021. Understanding mental models of AI through player-AI interaction. arXiv preprint arXiv:2103.16168 (2021).","journal-title":"arXiv preprint arXiv:2103.16168"},{"key":"e_1_3_1_154_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-03731-8_30"},{"key":"e_1_3_1_155_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2021.01.002"},{"key":"e_1_3_1_156_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445645"},{"key":"e_1_3_1_157_2","article-title":"Model-based reinforcement learning for decentralized multiagent rendezvous","author":"Wang Rose E.","year":"2020","unstructured":"Rose E. Wang, J. Chase Kew, Dennis Lee, Tsang-Wei Edward Lee, Tingnan Zhang, Brian Ichter, Jie Tan, and Aleksandra Faust. 2020. Model-based reinforcement learning for decentralized multiagent rendezvous. arXiv preprint arXiv:2003.06906 (2020).","journal-title":"arXiv preprint arXiv:2003.06906"},{"key":"e_1_3_1_158_2","first-page":"2032","volume-title":"Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems","author":"Wang Rose E.","year":"2020","unstructured":"Rose E. Wang, Sarah A. Wu, James A. Evans, Joshua B. Tenenbaum, David C. Parkes, and Max Kleiman-Weiner. 2020. Too many cooks: Coordinating multi-agent collaboration through inverse planning. In Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems. 2032\u20132034."},{"key":"e_1_3_1_159_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330949"},{"key":"e_1_3_1_160_2","article-title":"Understanding ACT-R\u2014An outsider\u2019s perspective","author":"Whitehill Jacob","year":"2013","unstructured":"Jacob Whitehill. 2013. Understanding ACT-R\u2014An outsider\u2019s perspective. arXiv preprint arXiv:1306.0125 (2013).","journal-title":"arXiv preprint arXiv:1306.0125"},{"key":"e_1_3_1_161_2","unstructured":"Uta Wilkens Christian Cost Reyes Tim Treude and Annette Kluge. 2021. Understandings and perspectives of human-centered AI\u2014A transdisciplinary literature review. Fr\u00fchjahrskongress der Gesellschaft f\u00fcr Arbeitswissenschaf Bochum (2021)."},{"key":"e_1_3_1_162_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412682"},{"key":"e_1_3_1_163_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWCMC48107.2020.9148327"},{"key":"e_1_3_1_164_2","article-title":"Learning latent representations to influence multi-agent interaction","author":"Xie Annie","year":"2020","unstructured":"Annie Xie, Dylan P. Losey, Ryan Tolsma, Chelsea Finn, and Dorsa Sadigh. 2020. Learning latent representations to influence multi-agent interaction. arXiv preprint arXiv:2011.06619 (2020).","journal-title":"arXiv preprint arXiv:2011.06619"},{"key":"e_1_3_1_165_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_3_1_166_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00027"},{"key":"e_1_3_1_167_2","doi-asserted-by":"publisher","DOI":"10.5555\/3275299"},{"issue":"1","key":"e_1_3_1_168_2","first-page":"1","article-title":"An architecture for integrating plan-based behavior generation with interactive game environments.","volume":"1","author":"Young R. Michael","year":"2004","unstructured":"R. Michael Young, Mark O. Riedl, Mark Branly, Arnav Jhala, R. J. Martin, and C. J. Saretto. 2004. An architecture for integrating plan-based behavior generation with interactive game environments. Journal of Game Development 1, 1 (2004), 1\u201329.","journal-title":"Journal of Game Development"},{"key":"e_1_3_1_169_2","article-title":"Human-AI symbiosis: A survey of current approaches","author":"Zahedi Zahra","year":"2021","unstructured":"Zahra Zahedi and Subbarao Kambhampati. 2021. Human-AI symbiosis: A survey of current approaches. arXiv preprint arXiv:2103.09990 (2021).","journal-title":"arXiv preprint arXiv:2103.09990"},{"key":"e_1_3_1_170_2","doi-asserted-by":"publisher","DOI":"10.1109\/TG.2020.2990865"},{"key":"e_1_3_1_171_2","article-title":"Imitation learning: Progress, taxonomies and opportunities","author":"Zheng Boyuan","year":"2021","unstructured":"Boyuan Zheng, Sunny Verma, Jianlong Zhou, Ivor Tsang, and Fang Chen. 2021. Imitation learning: Progress, taxonomies and opportunities. arXiv preprint arXiv:2106.12177 (2021).","journal-title":"arXiv preprint arXiv:2106.12177"},{"key":"e_1_3_1_172_2","first-page":"19238","article-title":"Online Bayesian goal inference for boundedly rational planning agents","volume":"33","author":"Zhi-Xuan Tan","year":"2020","unstructured":"Tan Zhi-Xuan, Jordyn Mann, Tom Silver, Josh Tenenbaum, and Vikash Mansinghka. 2020. Online Bayesian goal inference for boundedly rational planning agents. Advances in Neural Information Processing Systems 33 (2020), 19238\u201319250.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_173_2","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000190"},{"key":"e_1_3_1_174_2","doi-asserted-by":"crossref","unstructured":"Shlomo Zilberstein. 2011. Metareasoning and bounded rationality. In Metareasoning: Thinking About Thinking Michael T. Cox and Anita Raja (Eds.). MIT Press Cambridge MA 27\u201340.","DOI":"10.7551\/mitpress\/9780262014809.003.0003"}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580492","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580492","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:42Z","timestamp":1750178262000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,28]]},"references-count":173,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3580492"],"URL":"https:\/\/doi.org\/10.1145\/3580492","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"value":"1556-4665","type":"print"},{"value":"1556-4703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,28]]},"assertion":[{"value":"2022-05-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-09","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}