{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T19:32:00Z","timestamp":1790969520172,"version":"4.1.0"},"reference-count":121,"publisher":"Annual Reviews","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Annu. Rev. Control Robot. Auton. Syst."],"published-print":{"date-parts":[[2022,5,3]]},"abstract":"<jats:p> Those designing autonomous systems that interact with humans will invariably face questions about how humans think and make decisions. Fortunately, computational cognitive science offers insight into human decision-making using tools that will be familiar to those with backgrounds in optimization and control (e.g., probability theory, statistical machine learning, and reinforcement learning). Here, we review some of this work, focusing on how cognitive science can provide forward models of human decision-making and inverse models of how humans think about others\u2019 decision-making. We highlight relevant recent developments, including approaches that synthesize black box and theory-driven modeling, accounts that recast heuristics and biases as forms of bounded optimality, and models that characterize human theory of mind and communication in decision-theoretic terms. In doing so, we aim to provide readers with a glimpse of the range of frameworks, methodologies, and actionable insights that lie at the intersection of cognitive science and control research. <\/jats:p>","DOI":"10.1146\/annurev-control-042920-015547","type":"journal-article","created":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T17:45:26Z","timestamp":1637084726000},"page":"33-53","source":"Crossref","is-referenced-by-count":39,"title":["Cognitive Science as a Source of Forward and Inverse Models of Human Decisions for Robotics and Control"],"prefix":"10.1146","volume":"5","author":[{"given":"Mark K.","family":"Ho","sequence":"first","affiliation":[{"name":"Department of Computer Science, Princeton University, Princeton, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas L.","family":"Griffiths","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Princeton University, Princeton, New Jersey, USA"},{"name":"Department of Psychology, Princeton University, Princeton, New Jersey, USA;"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"22","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X00076512"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X05000129"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-373694-9.00012-X"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2009.07.005"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0092160"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.05.011"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013298507114"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(02)00373-1"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2013.6483603"},{"key":"B10","first-page":"3027","volume-title":"Advances in Neural Information Processing Systems 29","author":"Ho MK","year":"2016"},{"key":"B11","doi-asserted-by":"crossref","unstructured":"Fisac JF, Gates MA, Hamrick JB, Liu C, Hadfield-Menell D, et al. 2020. Pragmatic-pedagogic value alignment. In Robotics Research: The 18th International Symposium ISRR, ed. N Amato, G Hager, S Thomas, M Torres-Torriti, pp. 49\u201357. Cham, Switz. Springer","DOI":"10.1007\/978-3-030-28619-4_7"},{"key":"B12","volume-title":"The Cambridge Handbook of Computational Psychology","author":"Sun R","year":"2008"},{"key":"B13","first-page":"22","volume":"22","author":"Bernoulli D.","year":"1738","journal-title":"Econometrica"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1126\/science.abe2629"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1915841117"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12142"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X1900061X"},{"key":"B19","volume-title":"Theory of Games and Economic Behavior","author":"Von Neumann J","year":"1944"},{"key":"B20","volume-title":"The Foundations of Statistics","author":"Savage LJ.","year":"1972"},{"key":"B21","first-page":"1433","volume-title":"Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence","volume":"3","author":"Ziebart BD","year":"2008"},{"key":"B22","first-page":"105","volume-title":"Frontiers in Econometrics","author":"McFadden D","year":"1973"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.2307\/1914185"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1007\/BF00122574"},{"key":"B25","volume-title":"Simple Heuristics That Make Us Smart","author":"Gigerenzer G","year":"1999"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjs018"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.01.007"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00079"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1126\/science.1169405"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaa4056"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000062"},{"key":"B32","unstructured":"Noti G, Levi E, Kolumbus Y, Daniely A. 2016. Behavior-based machine-learning: a hybrid approach for predicting human decision making. arXiv:1611.10228 [cs.LG]"},{"key":"B33","first-page":"656","volume-title":"Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence","author":"Plonsky O","year":"2017"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.1.1"},{"key":"B35","unstructured":"Fudenberg D, Kleinberg J, Liang A, Mullainathan S. 2019. Measuring the completeness of theories. arXiv:1910.07022 [econ.TH]"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2016.08.017"},{"key":"B37","unstructured":"Plonsky O, Apel R, Ert E, Tennenholtz M, Bourgin D, et al. 2019. Predicting human decisions with behavioral theories and machine learning. arXiv:1904.06866 [cs.AI]"},{"key":"B38","first-page":"5133","volume-title":"Proceedings of the 36th International Conference on Machine Learning","author":"Bourgin DD","year":"2019"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-018-0637-6"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.5840\/monist197659224"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.2307\/1884852"},{"key":"B42","first-page":"429","volume-title":"Proceedings of the Third Conference on Uncertainty in Artificial Intelligence","author":"Horvitz EJ.","year":"1987"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(91)90015-C"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1126\/science.aac6076"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12086"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000074"},{"key":"B47","first-page":"346","volume-title":"Proceedings of the 28th Conference on Uncertainty in Artificial Intelligence","author":"Hay N","year":"2012"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1008863"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22887-2_28"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000123"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3932(03)00029-1"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-16852-y"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(03)00128-1"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1353\/mpq.2004.0018"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0277(95)00661-H"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015430"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2008.10.024"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103500"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2015.03.006"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1126\/science.aag2132"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2017.06.017"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0064"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2019.04.010"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0162246"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2015.06.010"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2017.04.019"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12371"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2018.03.019"},{"key":"B69","first-page":"1123","volume-title":"Proceedings of the 37th Annual Meeting of the Cognitive Science Society","author":"Kleiman-Weiner M","year":"2015"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000470"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016163"},{"key":"B72","unstructured":"Littman ML, Topcu U, Fu J, Isbell C, Wen M, MacGlashan J. 2017. Environment-independent task specifications via GLTL. arXiv:1704.04341 [cs.AI]"},{"key":"B73","first-page":"1284","volume-title":"Proceedings of the 39th Annual Meeting of the Cognitive Science Society","author":"Velez-Ginorio J","year":"2017"},{"key":"B74","first-page":"5367","volume-title":"Advances in Neural Information Processing Systems 31","author":"Vazquez-Chanlatte M","year":"2018"},{"key":"B75","first-page":"2107","volume-title":"Proceedings of the 35th International Conference on Machine Learning","author":"Icarte RT","year":"2018"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.32470\/CCN.2018.1265-0"},{"key":"B77","first-page":"4218","volume-title":"Proceedings of the 35th International Conference on Machine Learning","author":"Rabinowitz N","year":"2018"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1261"},{"key":"B79","volume-title":"Philosophical Investigations","author":"Wittgenstein L.","year":"1953"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.2307\/2182440"},{"key":"B81","volume-title":"Relevance: Communication and Cognition","author":"Sperber D","year":"1986"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511620539"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2009.01.005"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2013.12.004"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.08.005"},{"key":"B86","first-page":"1632","volume-title":"Proceedings of the 30th Annual Meeting of the Cognitive Science Society","author":"Shafto P","year":"2008"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2014.12.007"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2010.10.001"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-019-0748-6"},{"key":"B90","first-page":"17582","volume-title":"Advances in Neural Information Processing Systems 33","author":"Wang P","year":"2020"},{"key":"B91","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2021.07.012"},{"key":"B92","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1407479111"},{"key":"B93","doi-asserted-by":"publisher","DOI":"10.1162\/opmi_a_00035"},{"key":"B94","first-page":"193","volume-title":"Proceedings of ICCM 2017: 15th International Conference on Cognitive Modeling","author":"Tessler MH","year":"2017"},{"key":"B95","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000142"},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0017.2009.01384.x"},{"key":"B97","volume-title":"Speaking Our Minds: Why Human Communication Is Different, and How Language Evolved to Make It Special","author":"Scott-Phillips T.","year":"2014"},{"key":"B98","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-7687.2012.01135.x"},{"key":"B99","doi-asserted-by":"publisher","DOI":"10.1037\/xge0001035"},{"key":"B100","first-page":"3692","volume-title":"Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence","author":"MacGlashan J","year":"2015"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2017.03.006"},{"key":"B102","first-page":"920","volume-title":"Proceedings of the 37th Annual Meeting of the Cognitive Science Society","author":"Ho MK","year":"2015"},{"key":"B103","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000569"},{"key":"B104","first-page":"937","volume-title":"Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence","author":"Loftin R","year":"2014"},{"key":"B105","first-page":"6768","volume-title":"Advances in Neural Information Processing Systems 30","author":"Hadfield-Menell D","year":"2017"},{"key":"B106","first-page":"2285","volume-title":"Proceedings of the 34th International Conference on Machine Learning","author":"MacGlashan J","year":"2017"},{"key":"B107","first-page":"30","volume-title":"Machine Learning: Proceedings of the Twelfth International Conference on Machine Learning","author":"Baird L","year":"1995"},{"key":"B108","unstructured":"Arumugam D, Lee JK, Saskin S, Littman ML. 2019. Deep reinforcement learning from policy-dependent human feedback. arXiv:1902.04257 [cs.LG]"},{"key":"B109","first-page":"3916","volume-title":"Advances in Neural Information Processing Systems 29","author":"Hadfield-Menell D","year":"2016"},{"key":"B110","first-page":"4415","volume-title":"Advances in Neural Information Processing Systems 33","author":"Jeon HJ","year":"2020"},{"key":"B111","first-page":"2974","volume-title":"Proceedings of the 42nd Annual Meeting of the Cognitive Science Society","author":"Correa CG","year":"2020"},{"key":"B112","unstructured":"Ho MK, Abel D, Correa CG, Littman ML, Cohen JD, Griffiths TL. 2021. Control of mental representations in human planning. arXiv:2105.06948 [cs.AI]"},{"key":"B113","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12926"},{"key":"B114","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2021.104885"},{"key":"B115","first-page":"323","volume-title":"Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence","author":"Evans O","year":"2016"},{"key":"B116","doi-asserted-by":"crossref","unstructured":"Berke M, Jara-Ettinger J. 2021. Thinking about thinking through inverse reasoning. PsyArXiv. https:\/\/doi.org\/10.31234\/osf.io\/r25qn","DOI":"10.31234\/osf.io\/r25qn"},{"key":"B117","first-page":"1013","volume-title":"Proceedings of the 43rd Annual Meeting of the Cognitive Science Society","author":"Alanqary A","year":"2021"},{"key":"B118","first-page":"19238","volume-title":"Advances in Neural Information Processing Systems 33","author":"Zhi-Xuan T","year":"2020"},{"key":"B119","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2006.02.006"},{"key":"B120","first-page":"1679","volume-title":"Proceedings of the 38th Annual Meeting of the Cognitive Science Society","author":"Kleiman-Weiner M","year":"2016"},{"key":"B121","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2018.11.003"}],"container-title":["Annual Review of Control, Robotics, and Autonomous Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.annualreviews.org\/doi\/pdf\/10.1146\/annurev-control-042920-015547","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,3]],"date-time":"2022-05-03T16:13:39Z","timestamp":1651594419000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.annualreviews.org\/doi\/10.1146\/annurev-control-042920-015547"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,3]]},"references-count":121,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,5,3]]}},"alternative-id":["10.1146\/annurev-control-042920-015547"],"URL":"https:\/\/doi.org\/10.1146\/annurev-control-042920-015547","relation":{},"ISSN":["2573-5144","2573-5144"],"issn-type":[{"value":"2573-5144","type":"print"},{"value":"2573-5144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,3]]}}}