{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:14:49Z","timestamp":1778080489395,"version":"3.51.4"},"reference-count":133,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004189","name":"Max-Planck-Gesellschaft","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004189","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01IS18039A"],"award-info":[{"award-number":["01IS18039A"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01IS18039A"],"award-info":[{"award-number":["01IS18039A"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["EXC 2064\/1 \u2013 390727645"],"award-info":[{"award-number":["EXC 2064\/1 \u2013 390727645"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["EXC 2064\/1 \u2013 390727645"],"award-info":[{"award-number":["EXC 2064\/1 \u2013 390727645"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001663","name":"Volkswagen Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Mach Intell"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>A chief goal of artificial intelligence is to build machines that think like people. Yet it has been argued that deep neural network architectures fail to accomplish this. Researchers have asserted these models\u2019 limitations in the domains of causal reasoning, intuitive physics and intuitive psychology. Yet recent advancements, namely the rise of large language models, particularly those designed for visual processing, have rekindled interest in the potential to emulate human-like cognitive abilities. This paper evaluates the current state of vision-based large language models in the domains of intuitive physics, causal reasoning and intuitive psychology. Through a series of controlled experiments, we investigate the extent to which these modern models grasp complex physical interactions, causal relationships and intuitive understanding of others\u2019 preferences. Our findings reveal that, while some of these models demonstrate a notable proficiency in processing and interpreting visual data, they still fall short of human capabilities in these areas. Our results emphasize the need for integrating more robust mechanisms for understanding causality, physical dynamics and social cognition into modern-day, vision-based language models, and point out the importance of cognitively inspired benchmarks.<\/jats:p>","DOI":"10.1038\/s42256-024-00963-y","type":"journal-article","created":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T10:04:04Z","timestamp":1736935444000},"page":"96-106","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Visual cognition in multimodal large language models"],"prefix":"10.1038","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2964-2843","authenticated-orcid":false,"given":"Luca M.","family":"Schulze Buschoff","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2016-7671","authenticated-orcid":false,"given":"Elif","family":"Akata","sequence":"additional","affiliation":[]},{"given":"Matthias","family":"Bethge","sequence":"additional","affiliation":[]},{"given":"Eric","family":"Schulz","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,15]]},"reference":[{"key":"963_CR1","unstructured":"Mitchell, M. Artificial Intelligence: A Guide for Thinking Humans (Penguin, 2019)."},{"key":"963_CR2","unstructured":"Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (eds Burstein, J. et al.) 4171\u20134186 (Association for Computational Linguistics, 2019)."},{"key":"963_CR3","unstructured":"Vaswani, A. et al. Attention is all you need. In Proc. Advances in Neural Information Processing Systems 30 (NIPS 2017) (eds Guyon, I. et al.) 5998\u20136008 (2017)."},{"key":"963_CR4","unstructured":"Brown, T. et al. Language models are few-shot learners. In Proc. Advances in Neural Information Processing Systems 33 (NeurIPS 2020) (eds Larochelle, H. et al.) 1877\u20131901 (Curran Associates, 2020)."},{"key":"963_CR5","unstructured":"Bubeck, S. et al. Sparks of artificial general intelligence: early experiments with GPT-4. Preprint at https:\/\/arxiv.org\/abs\/2303.12712 (2023)."},{"key":"963_CR6","unstructured":"Wei, J. et al. Emergent abilities of large language models. Trans. Mach. Learn. Res. https:\/\/openreview.net\/forum?id=yzkSU5zdwD (2022)."},{"key":"963_CR7","doi-asserted-by":"publisher","first-page":"2270","DOI":"10.1098\/rsta.2023.0254","volume":"382","author":"DM Katz","year":"2024","unstructured":"Katz, D. M., Bommarito, M. J., Gao, S. & Arredondo, P. GPT-4 passes the bar exam. Phil. Trans. R. Soc. A 382, 2270 (2024).","journal-title":"Phil. Trans. R. Soc. A"},{"key":"963_CR8","unstructured":"Sawicki, P. et al. On the power of special-purpose gpt models to create and evaluate new poetry in old styles. In Proc. 14th International Conference on Computational Creativity (ICCC\u201923) (eds Pease, A. et al.) 10\u201319 (Association for Computational Creativity, 2023)."},{"key":"963_CR9","first-page":"2523","volume":"31","author":"Z Borsos","year":"2023","unstructured":"Borsos, Z. et al. Audiolm: a language modeling approach to audio generation. IEEE\/ACM Trans. Audio Speech Lang. Process 31, 2523\u20132533 (2023).","journal-title":"Audio Speech Lang. Process"},{"key":"963_CR10","unstructured":"Poldrack, R. A., Lu, T. & Begu\u0161, G. Ai-assisted coding: experiments with GPT-4. Preprint at https:\/\/arxiv.org\/abs\/2304.13187 (2023)."},{"key":"963_CR11","doi-asserted-by":"publisher","first-page":"102274","DOI":"10.1016\/j.lindif.2023.102274","volume":"103","author":"E Kasneci","year":"2023","unstructured":"Kasneci, E. et al. ChatGPT for good? On opportunities and challenges of large language models for education. Learn. Individ. Differ. 103, 102274 (2023).","journal-title":"Learn. Individ. Differ."},{"key":"963_CR12","unstructured":"Bommasani, R. et al. On the opportunities and risks of foundation models. Preprint at https:\/\/arxiv.org\/abs\/2108.07258 (2021)."},{"key":"963_CR13","first-page":"2","volume":"5","author":"K Elkins","year":"2020","unstructured":"Elkins, K. & Chun, J. Can GPT-3 pass a writer\u2019s Turing test? J. Cult. Anal. 5, 2 (2020).","journal-title":"J. Cult. Anal."},{"key":"963_CR14","doi-asserted-by":"crossref","unstructured":"Dell\u2019Acqua, F. et al. Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. Harvard Business School Technology & Operations Mgt. Unit Working Paper (Harvard Business School, 2023).","DOI":"10.2139\/ssrn.4573321"},{"key":"963_CR15","doi-asserted-by":"publisher","first-page":"750","DOI":"10.1057\/s41599-023-02269-7","volume":"10","author":"\u017d Ba\u0161i\u0107","year":"2023","unstructured":"Ba\u0161i\u0107, \u017d., Banovac, A., Kru\u017ei\u0107, I. & Jerkovi\u0107, I. Better by you, better than me? ChatGPT-3.5 as writing assistance in students\u2019 essays. Humanit. Soc. Sci. Commun. 10, 750 (2023).","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"963_CR16","unstructured":"Akata, E. et al. Playing repeated games with large language models. Preprint at https:\/\/arxiv.org\/abs\/2305.16867 (2023)."},{"key":"963_CR17","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1207\/s15516709cog0401_2","volume":"4","author":"HA Simon","year":"1980","unstructured":"Simon, H. A. Cognitive science: the newest science of the artificial. Cogn. Sci. 4, 33\u201346 (1980).","journal-title":"Cogn. Sci."},{"key":"963_CR18","doi-asserted-by":"crossref","unstructured":"Rumelhart, D. E. et al. Parallel Distributed Processing, Vol.1 (MIT Press, 1987).","DOI":"10.7551\/mitpress\/5236.001.0001"},{"key":"963_CR19","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1146\/annurev-vision-120522-031739","volume":"9","author":"FA Wichmann","year":"2023","unstructured":"Wichmann, F. A. & Geirhos, R. Are deep neural networks adequate behavioral models of human visual perception? Annu. Rev. Vis. Sci. 9, 501\u2013524 (2023).","journal-title":"Annu. Rev. Vis. Sci."},{"key":"963_CR20","doi-asserted-by":"publisher","first-page":"101158","DOI":"10.1016\/j.cogsys.2023.101158","volume":"82","author":"JS Bowers","year":"2023","unstructured":"Bowers, J. S. et al. On the importance of severely testing deep learning models of cognition. Cogn. Syst. Res. 82, 101158 (2023).","journal-title":"Cogn. Syst. Res."},{"key":"963_CR21","unstructured":"Marcus, G. Deep learning: a critical appraisal. Preprint at https:\/\/arxiv.org\/abs\/1801.00631 (2018)."},{"key":"963_CR22","doi-asserted-by":"publisher","first-page":"e253","DOI":"10.1017\/S0140525X16001837","volume":"40","author":"BM Lake","year":"2017","unstructured":"Lake, B. M., Ullman, T. D., Tenenbaum, J. B. & Gershman, S. J. Building machines that learn and think like people. Behav. Brain Sci. 40, e253 (2017).","journal-title":"Behav. Brain Sci."},{"key":"963_CR23","doi-asserted-by":"crossref","unstructured":"Sejnowski, T. J. The Deep Learning Revolution (MIT, 2018).","DOI":"10.7551\/mitpress\/11474.001.0001"},{"key":"963_CR24","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1007\/s42113-018-0007-3","volume":"1","author":"KA Smith","year":"2018","unstructured":"Smith, K. A., Battaglia, P. W. & Vul, E. Different physical intuitions exist between tasks, not domains. Comput. Brain Behav. 1, 101\u2013118 (2018).","journal-title":"Comput. Brain Behav."},{"key":"963_CR25","doi-asserted-by":"publisher","first-page":"e1007210","DOI":"10.1371\/journal.pcbi.1007210","volume":"15","author":"CJ Bates","year":"2019","unstructured":"Bates, C. J., Yildirim, I., Tenenbaum, J. B. & Battaglia, P. Modeling human intuitions about liquid flow with particle-based simulation. PLoS Comput. Biol. 15, e1007210 (2019).","journal-title":"PLoS Comput. Biol."},{"key":"963_CR26","first-page":"32","volume":"34","author":"P Battaglia","year":"2012","unstructured":"Battaglia, P. et al. Computational models of intuitive physics. Proc. Annu. Meet. Cogn. Sci. Soc. 34, 32\u201333 (2012).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR27","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.cogpsych.2018.05.001","volume":"105","author":"NR Bramley","year":"2018","unstructured":"Bramley, N. R., Gerstenberg, T., Tenenbaum, J. B. & Gureckis, T. M. Intuitive experimentation in the physical world. Cogn. Psychol. 105, 9\u201338 (2018).","journal-title":"Cogn. Psychol."},{"key":"963_CR28","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1146\/annurev-devpsych-121318-084833","volume":"2","author":"TD Ullman","year":"2020","unstructured":"Ullman, T. D. & Tenenbaum, J. B. Bayesian models of conceptual development: learning as building models of the world. Annu. Rev. Dev. Psychol. 2, 533\u2013558 (2020).","journal-title":"Annu. Rev. Dev. Psychol."},{"key":"963_CR29","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1016\/j.tics.2017.05.012","volume":"21","author":"TD Ullman","year":"2017","unstructured":"Ullman, T. D., Spelke, E., Battaglia, P. & Tenenbaum, J. B. Mind games: game engines as an architecture for intuitive physics. Trends Cogn. Sci. 21, 649\u2013665 (2017).","journal-title":"Trends Cogn. Sci."},{"key":"963_CR30","first-page":"1545","volume":"33","author":"J Hamrick","year":"2011","unstructured":"Hamrick, J., Battaglia, P. & Tenenbaum, J. B. Probabilistic internal physics models guide judgments about object dynamics. Proc. Annu. Meet. Cogn. Sci. Soc. 33, 1545\u20131550 (2011).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR31","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1080\/09500690117839","volume":"23","author":"P Mildenhall","year":"2001","unstructured":"Mildenhall, P. & Williams, J. Instability in students\u2019 use of intuitive and Newtonian models to predict motion: the critical effect of the parameters involved. Int. J. Sci. Educ. 23, 643\u2013660 (2001).","journal-title":"Int. J. Sci. Educ."},{"key":"963_CR32","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1068\/p110325","volume":"11","author":"JT Todd","year":"1982","unstructured":"Todd, J. T. & Warren, W. H. Jr Visual perception of relative mass in dynamic events. Perception 11, 325\u2013335 (1982).","journal-title":"Perception"},{"key":"963_CR33","doi-asserted-by":"publisher","first-page":"18327","DOI":"10.1073\/pnas.1306572110","volume":"110","author":"PW Battaglia","year":"2013","unstructured":"Battaglia, P. W., Hamrick, J. B. & Tenenbaum, J. B. Simulation as an engine of physical scene understanding. Proc. Natl Acad. Sci. USA 110, 18327\u201318332 (2013).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"963_CR34","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.cognition.2016.08.012","volume":"157","author":"JB Hamrick","year":"2016","unstructured":"Hamrick, J. B., Battaglia, P. W., Griffiths, T. L. & Tenenbaum, J. B. Inferring mass in complex scenes by mental simulation. Cognition 157, 61\u201376 (2016).","journal-title":"Cognition"},{"key":"963_CR35","unstructured":"Bakhtin, A., van der Maaten, L., Johnson, J., Gustafson, L. & Girshick, R. PHYRE: a new benchmark for physical reasoning. In Proc. Advances in Neural Information Processing Systems 32 (NeurIPS 2019) (eds Wallach, H. et al.) 5082\u20135093 (Curran Associates, 2019)."},{"key":"963_CR36","unstructured":"Riochet, R. et al. Intphys: a framework and benchmark for visual intuitive physics reasoning. Preprint at https:\/\/arxiv.org\/abs\/1803.07616 (2018)."},{"key":"963_CR37","unstructured":"Schulze Buschoff, L. M., Schulz, E. & Binz, M. The acquisition of physical knowledge in generative neural networks. In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) 202, 30321\u201330341 (JMLR, 2023)."},{"key":"963_CR38","doi-asserted-by":"crossref","unstructured":"Waldmann, M. The Oxford Handbook of Causal Reasoning (Oxford Univ. Press, 2017).","DOI":"10.1093\/oxfordhb\/9780199399550.001.0001"},{"key":"963_CR39","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1037\/0033-295X.104.2.367","volume":"104","author":"PW Cheng","year":"1997","unstructured":"Cheng, P. W. From covariation to causation: a causal power theory. Psychol. Rev. 104, 367 (1997).","journal-title":"Psychol. Rev."},{"key":"963_CR40","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1146\/annurev.psych.121208.131634","volume":"62","author":"KJ Holyoak","year":"2011","unstructured":"Holyoak, K. J. & Cheng, P. W. Causal learning and inference as a rational process: the new synthesis. Annu. Rev. Psychol. 62, 135\u2013163 (2011).","journal-title":"Annu. Rev. Psychol."},{"key":"963_CR41","doi-asserted-by":"crossref","unstructured":"Pearl, J. Causality (Cambridge Univ. Press, 2009).","DOI":"10.1017\/CBO9780511803161"},{"key":"963_CR42","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1037\/a0017201","volume":"116","author":"TL Griffiths","year":"2009","unstructured":"Griffiths, T. L. & Tenenbaum, J. B. Theory-based causal induction. Psychol. Rev. 116, 661 (2009).","journal-title":"Psychol. Rev."},{"key":"963_CR43","doi-asserted-by":"crossref","unstructured":"Lagnado, D. A., Waldmann, M. R., Hagmayer, Y. & Sloman, S. A. in Causal Learning: Psychology, Philosophy, and Computation (eds Gopnik, A. and Schulz, L.) 154\u2013172 (Oxford Univ. Press, 2007).","DOI":"10.1093\/acprof:oso\/9780195176803.003.0011"},{"key":"963_CR44","doi-asserted-by":"crossref","unstructured":"Carey, S. On the Origin of Causal Understanding (Clarendon Press\/Oxford Univ. Press, 1995).","DOI":"10.1093\/acprof:oso\/9780198524021.003.0010"},{"key":"963_CR45","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/0033-295X.111.1.3","volume":"111","author":"A Gopnik","year":"2004","unstructured":"Gopnik, A. et al. A theory of causal learning in children: causal maps and Bayes nets. Psychol. Rev. 111, 3 (2004).","journal-title":"Psychol. Rev."},{"key":"963_CR46","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1111\/j.1551-6709.2009.01058.x","volume":"34","author":"CG Lucas","year":"2010","unstructured":"Lucas, C. G. & Griffiths, T. L. Learning the form of causal relationships using hierarchical bayesian models. Cogn. Sci. 34, 113\u2013147 (2010).","journal-title":"Cogn. Sci."},{"key":"963_CR47","doi-asserted-by":"publisher","first-page":"1880","DOI":"10.1037\/xlm0000548","volume":"44","author":"NR Bramley","year":"2018","unstructured":"Bramley, N. R., Gerstenberg, T., Mayrhofer, R. & Lagnado, D. A. Time in causal structure learning. J. Exp. Psychol. Learn. Mem. Cogn. 44, 1880 (2018).","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"963_CR48","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.cogpsych.2005.05.004","volume":"51","author":"TL Griffiths","year":"2005","unstructured":"Griffiths, T. L. & Tenenbaum, J. B. Structure and strength in causal induction. Cogn. Psychol. 51, 334\u2013384 (2005).","journal-title":"Cogn. Psychol."},{"key":"963_CR49","doi-asserted-by":"crossref","unstructured":"Schulz, L., Kushnir, T. & Gopnik, A. in Causal Learning: Psychology, Philosophy, and Computation (eds Gopnik, A. and Schulz, L.) 67\u201385 (Oxford Univ. Press, 2007).","DOI":"10.1093\/acprof:oso\/9780195176803.003.0006"},{"key":"963_CR50","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1037\/rev0000061","volume":"124","author":"NR Bramley","year":"2017","unstructured":"Bramley, N. R., Dayan, P., Griffiths, T. L. & Lagnado, D. A. Formalizing Neurath\u2019s ship: approximate algorithms for online causal learning. Psychol. Rev. 124, 301 (2017).","journal-title":"Psychol. Rev."},{"key":"963_CR51","doi-asserted-by":"publisher","first-page":"20210339","DOI":"10.1098\/rstb.2021.0339","volume":"377","author":"T Gerstenberg","year":"2022","unstructured":"Gerstenberg, T. What would have happened? Counterfactuals, hypotheticals and causal judgements. Philos. Trans. R. Soc. B 377, 20210339 (2022).","journal-title":"Philos. Trans. R. Soc. B"},{"key":"963_CR52","doi-asserted-by":"publisher","first-page":"1731","DOI":"10.1177\/0956797617713053","volume":"28","author":"T Gerstenberg","year":"2017","unstructured":"Gerstenberg, T., Peterson, M. F., Goodman, N. D., Lagnado, D. A. & Tenenbaum, J. B. Eye-tracking causality. Psychol. Sci. 28, 1731\u20131744 (2017).","journal-title":"Psychol. Sci."},{"key":"963_CR53","doi-asserted-by":"publisher","first-page":"936","DOI":"10.1037\/rev0000281","volume":"128","author":"T Gerstenberg","year":"2021","unstructured":"Gerstenberg, T., Goodman, N. D., Lagnado, D. A. & Tenenbaum, J. B. A counterfactual simulation model of causal judgments for physical events. Psychol. Rev. 128, 936 (2021).","journal-title":"Psychol. Rev."},{"key":"963_CR54","unstructured":"Jin, Z. et al. CLadder: Assessing causal reasoning in language models. In Proc. Advances in Neural Information Processing Systems 36 (NeurIPS 2023) (eds Oh, A. et al.) 31038\u201331065 (Curran Associates, 2023)."},{"key":"963_CR55","unstructured":"Dasgupta, I. et al. Causal reasoning from meta-reinforcement learning. Preprint at https:\/\/arxiv.org\/abs\/1901.08162 (2019)."},{"key":"963_CR56","doi-asserted-by":"crossref","unstructured":"Baker, C. L. & Tenenbaum, J. B. in Plan, Activity, and Intent Recognition: Theory and Practice (eds Sukthankar, G. et al.) 177\u2013204 (Morgan Kaufmann, 2014).","DOI":"10.1016\/B978-0-12-398532-3.00007-5"},{"key":"963_CR57","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.cognition.2015.05.006","volume":"142","author":"A Jern","year":"2015","unstructured":"Jern, A. & Kemp, C. A decision network account of reasoning about other people\u2019s choices. Cognition 142, 12\u201338 (2015).","journal-title":"Cognition"},{"key":"963_CR58","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.cobeha.2021.01.006","volume":"38","author":"N V\u00e9lez","year":"2021","unstructured":"V\u00e9lez, N. & Gweon, H. Learning from other minds: an optimistic critique of reinforcement learning models of social learning. Curr. Opin. Behav. Sci. 38, 110\u2013115 (2021).","journal-title":"Curr. Opin. Behav. Sci."},{"key":"963_CR59","unstructured":"Spelke, E. S., Bernier, E. P. & Skerry, A. Core Social Cognition (Oxford Univ. Press, 2013)."},{"key":"963_CR60","first-page":"2469","volume":"33","author":"C Baker","year":"2011","unstructured":"Baker, C., Saxe, R. & Tenenbaum, J. Bayesian theory of mind: modeling joint belief-desire attribution. Proc. Annu. Meet. Cogn. Sci. Soc. 33, 2469\u20132474 (2011).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR61","doi-asserted-by":"publisher","first-page":"R644","DOI":"10.1016\/j.cub.2005.08.041","volume":"15","author":"C Frith","year":"2005","unstructured":"Frith, C. & Frith, U. Theory of mind. Curr. Biol. 15, R644\u2013R645 (2005).","journal-title":"Curr. Biol."},{"key":"963_CR62","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.copsyc.2017.04.019","volume":"17","author":"R Saxe","year":"2017","unstructured":"Saxe, R. & Houlihan, S. D. Formalizing emotion concepts within a Bayesian model of theory of mind. Curr. Opin. Psychol. 17, 15\u201321 (2017).","journal-title":"Curr. Opin. Psychol."},{"key":"963_CR63","first-page":"69k8c7v6","volume":"28","author":"CL Baker","year":"2006","unstructured":"Baker, C. L. et al. Intuitive theories of mind: a rational approach to false belief. Proc. Annu. Meet. Cogn. Sci. Soc. 28, 69k8c7v6 (2006).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR64","doi-asserted-by":"crossref","unstructured":"Shum, M., Kleiman-Weiner, M., Littman, M. L. & Tenenbaum, J. B. Theory of minds: understanding behavior in groups through inverse planning. In Proc. 33rd AAAI Conference on Artificial Intelligence 6163\u20136170 (Curran Associates, 2019).","DOI":"10.1609\/aaai.v33i01.33016163"},{"key":"963_CR65","doi-asserted-by":"publisher","first-page":"0064","DOI":"10.1038\/s41562-017-0064","volume":"1","author":"CL Baker","year":"2017","unstructured":"Baker, C. L., Jara-Ettinger, J., Saxe, R. & Tenenbaum, J. B. Rational quantitative attribution of beliefs, desires and percepts in human mentalizing. Nat. Hum. Behav. 1, 0064 (2017).","journal-title":"Nat. Hum. Behav."},{"key":"963_CR66","unstructured":"Zhi-Xuan, T. et al. Solving the baby intuitions benchmark with a hierarchically Bayesian theory of mind. Preprint at https:\/\/arxiv.org\/abs\/2208.02914 (2022)."},{"key":"963_CR67","unstructured":"Rabinowitz, N. et al. Machine theory of mind. In Proc. 35th International Conference on Machine Learning (eds Dy, J. & Krause, A.) 80, 4218\u20134227 (JMLR, 2018)."},{"key":"963_CR68","unstructured":"Kosinski, M. Theory of mind may have spontaneously emerged in large language models. Preprint at https:\/\/arxiv.org\/abs\/2302.02083 (2023)."},{"key":"963_CR69","unstructured":"Ullman, T. Large language models fail on trivial alterations to theory-of-mind tasks. Preprint at https:\/\/arxiv.org\/abs\/2302.08399 (2023)."},{"key":"963_CR70","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1016\/j.tics.2012.06.004","volume":"16","author":"L Schulz","year":"2012","unstructured":"Schulz, L. The origins of inquiry: inductive inference and exploration in early childhood. Trends Cogn. Sci. 16, 382\u2013389 (2012).","journal-title":"Trends Cogn. Sci."},{"key":"963_CR71","unstructured":"Ullman, T. D. On the Nature and Origin of Intuitive Theories: Learning, Physics and Psychology. PhD thesis, Massachusetts Institute of Technology (2015)."},{"key":"963_CR72","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1126\/science.1192788","volume":"331","author":"JB Tenenbaum","year":"2011","unstructured":"Tenenbaum, J. B., Kemp, C., Griffiths, T. L. & Goodman, N. D. How to grow a mind: statistics, structure, and abstraction. Science 331, 1279\u20131285 (2011).","journal-title":"Science"},{"key":"963_CR73","doi-asserted-by":"publisher","first-page":"e2218523120","DOI":"10.1073\/pnas.2218523120","volume":"120","author":"M Binz","year":"2023","unstructured":"Binz, M. & Schulz, E. Using cognitive psychology to understand GPT-3. Proc. Natl Acad. Sci. USA 120, e2218523120 (2023).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"963_CR74","doi-asserted-by":"crossref","unstructured":"Huang, J. & Chang, K. C.-C. Towards reasoning in large language models: a survey. In Findings of the Association for Computational Linguistics: ACL 2023 (eds Rogers, A. et al.) 1049\u20131065 (Association for Computational Linguistics, 2023).","DOI":"10.18653\/v1\/2023.findings-acl.67"},{"key":"963_CR75","unstructured":"Sawada, T. et al. ARB: Advanced reasoning benchmark for large language models. Preprint at https:\/\/arxiv.org\/abs\/2307.13692 (2023)."},{"key":"963_CR76","unstructured":"Wei, J. et al. Chain-of-thought prompting elicits reasoning in large language models. In Proc. Advances in Neural Information Processing Systems 35 (NeurIPS 2022) (eds Koyejo, S. et al.) 24824\u201324837 (Curran Associates, 2022)."},{"key":"963_CR77","doi-asserted-by":"publisher","first-page":"1526","DOI":"10.1038\/s41562-023-01659-w","volume":"7","author":"T Webb","year":"2023","unstructured":"Webb, T., Holyoak, K. J. & Lu, H. Emergent analogical reasoning in large language models. Nat. Hum. Behav. 7, 1526\u20131541 (2023).","journal-title":"Nat. Hum. Behav."},{"key":"963_CR78","unstructured":"Coda-Forno, J. et al. Inducing anxiety in large language models increases exploration and bias. Preprint at https:\/\/arxiv.org\/abs\/2304.11111 (2023)."},{"key":"963_CR79","doi-asserted-by":"crossref","unstructured":"Eisape, T. et al. A systematic comparison of syllogistic reasoning in humans and language models. In Proc. 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) (eds Duh, K. et al.) 8425\u20138444 (Association for Computational Linguistics, 2024).","DOI":"10.18653\/v1\/2024.naacl-long.466"},{"key":"963_CR80","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1038\/s43588-023-00527-x","volume":"3","author":"T Hagendorff","year":"2023","unstructured":"Hagendorff, T., Fabi, S. & Kosinski, M. Human-like intuitive behavior and reasoning biases emerged in large language models but disappeared in ChatGPT. Nat. Comput. Sci. 3, 833\u2013838 (2023).","journal-title":"Nat. Comput. Sci."},{"key":"963_CR81","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1162\/tacl_a_00298","volume":"8","author":"A Ettinger","year":"2020","unstructured":"Ettinger, A. What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models. Trans. Assoc. Comput. Linguist. 8, 34\u201348 (2020).","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"963_CR82","first-page":"482","volume":"44","author":"CR Jones","year":"2022","unstructured":"Jones, C. R. et al. Distrubutional semantics still can\u2019t account for affordances. Proc. Annu. Meet. Cogn. Sci. Soc. 44, 482\u2013489 (2022).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR83","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1038\/s41586-019-1138-y","volume":"568","author":"I Rahwan","year":"2019","unstructured":"Rahwan, I. et al. Machine behaviour. Nature 568, 477\u2013486 (2019).","journal-title":"Nature"},{"key":"963_CR84","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.isci.2020.101772","volume":"23","author":"E Schulz","year":"2020","unstructured":"Schulz, E. & Dayan, P. Computational psychiatry for computers. iScience 23, 12 (2020).","journal-title":"iScience"},{"key":"963_CR85","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1038\/s42256-019-0038-z","volume":"1","author":"AS Rich","year":"2019","unstructured":"Rich, A. S. & Gureckis, T. M. Lessons for artificial intelligence from the study of natural stupidity. Nat. Mach. Intell. 1, 174\u2013180 (2019).","journal-title":"Nat. Mach. Intell."},{"key":"963_CR86","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Pan, J., Zhou, Y., Pan, R. & Chai, J. Grounding visual illusions in language: do vision-language models perceive illusions like humans? In Proc. 2023 Conference on Empirical Methods in Natural Language (eds Bouamor, H. et al.) 5718\u20135728 (Association for Computational Linguistics, 2023).","DOI":"10.18653\/v1\/2023.emnlp-main.348"},{"key":"963_CR87","unstructured":"Mitchell, M., Palmarini, A. B. & Moskvichev, A. Comparing humans, GPT-4, and GPT-4v on abstraction and reasoning tasks. Preprint at https:\/\/arxiv.org\/abs\/2311.09247 (2023)."},{"key":"963_CR88","unstructured":"Ze\u010devi\u0107, M., Willig, M., Dhami, D. S. & Kersting, K. Causal parrots: large language models may talk causality but are not causal. Trans. Mach. Learn. Res. https:\/\/openreview.net\/pdf?id=tv46tCzs83 (2023)."},{"key":"963_CR89","first-page":"3476","volume":"45","author":"C Zhang","year":"2023","unstructured":"Zhang, C., Wong, L., Grand, G. & Tenenbaum, J. Grounded physical language understanding with probabilistic programs and simulated worlds. Proc. Annu. Meet. Cogn. Sci. Soc. 45, 3476\u20133483 (2023).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR90","doi-asserted-by":"crossref","unstructured":"Jassim, S. et al. GRASP: a novel benchmark for evaluating language grounding and situated physics understanding in multimodal language models. Preprint at https:\/\/arxiv.org\/abs\/2311.09048 (2023).","DOI":"10.24963\/ijcai.2024\/696"},{"key":"963_CR91","first-page":"363","volume":"45","author":"E Kosoy","year":"2023","unstructured":"Kosoy, E. et al. Towards understanding how machines can learn causal overhypotheses. Proc. Annu. Meet. Cogn. Sci. Soc. 45, 363\u2013374 (2023).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR92","unstructured":"Gandhi, K., Fr\u00e4nken, J.-P., Gerstenberg, T. & Goodman, N. D. Understanding social reasoning in language models with language models. In Proc. 37th International Conference on Neural Information Processing Systems (NIPS \u201923) (eds Oh, A. et al.) 13518\u201313529 (Curran Associates, 2024)."},{"key":"963_CR93","unstructured":"Srivastava, A. et al. Beyond the imitation game: quantifying and extrapolating the capabilities of language models. Preprint at https:\/\/arxiv.org\/abs\/2206.04615 (2022)."},{"key":"963_CR94","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1109\/TPAMI.2018.2798607","volume":"41","author":"T Baltru\u0161aitis","year":"2018","unstructured":"Baltru\u0161aitis, T., Ahuja, C. & Morency, L.-P. Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 41, 423\u2013443 (2018).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"963_CR95","unstructured":"Reed, S. et al. Generative adversarial text to image synthesis. In Proc. 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48, 1060\u20131069 (JMLR, 2016)."},{"key":"963_CR96","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.cviu.2017.05.001","volume":"163","author":"Q Wu","year":"2017","unstructured":"Wu, Q. et al. Visual question answering: a survey of methods and datasets. Comput. Vis. Image Underst. 163, 21\u201340 (2017).","journal-title":"Comput. Vis. Image Underst."},{"key":"963_CR97","doi-asserted-by":"publisher","first-page":"5705","DOI":"10.1007\/s10462-020-09832-7","volume":"53","author":"S Manmadhan","year":"2020","unstructured":"Manmadhan, S. & Kovoor, B. C. Visual question answering: a state-of-the-art review. Artif. Intell. Rev. 53, 5705\u20135745 (2020).","journal-title":"Artif. Intell. Rev."},{"key":"963_CR98","unstructured":"Lerer, A., Gross, S. & Fergus, R. Learning physical intuition of block towers by example. In Proc. 33rd International Conference on Machine Learning (eds Balcan, M. F. & Weinberger, K. Q.) 48, 430\u2013438 (JMLR, 2016)."},{"key":"963_CR99","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1080\/00031305.2018.1549100","volume":"73","author":"A Gelman","year":"2019","unstructured":"Gelman, A., Goodrich, B., Gabry, J. & Vehtari, A. R-squared for Bayesian regression models. Am. Stat. 73, 307\u2013309 (2019).","journal-title":"Am. Stat."},{"key":"963_CR100","doi-asserted-by":"publisher","first-page":"2237","DOI":"10.1037\/xge0001392","volume":"152","author":"L Zhou","year":"2023","unstructured":"Zhou, L., Smith, K. A., Tenenbaum, J. B. & Gerstenberg, T. Mental Jenga: a counterfactual simulation model of causal judgments about physical support. J. Exp. Psychol. Gen. 152, 2237 (2023).","journal-title":"J. Exp. Psychol. Gen."},{"key":"963_CR101","first-page":"409","volume":"39","author":"T Gerstenberg","year":"2017","unstructured":"Gerstenberg, T., Zhou, L., Smith, K. A. & Tenenbaum, J. B. Faulty towers: A hypothetical simulation model of physical support. Proc. Annu. Meet. Cogn. Sci. Soc. 39, 409\u2013414 (2017).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR102","unstructured":"Michotte, A. The Perception of Causality (Basic Books, 1963)."},{"key":"963_CR103","doi-asserted-by":"publisher","first-page":"101334","DOI":"10.1016\/j.cogpsych.2020.101334","volume":"123","author":"J Jara-Ettinger","year":"2020","unstructured":"Jara-Ettinger, J., Schulz, L. E. & Tenenbaum, J. B. The na\u00efve utility calculus as a unified, quantitative framework for action understanding. Cogn. Psychol. 123, 101334 (2020).","journal-title":"Cogn. Psychol."},{"key":"963_CR104","first-page":"3375","volume":"45","author":"SA Wu","year":"2023","unstructured":"Wu, S. A., Sridhar, S. & Gerstenberg, T. A computational model of responsibility judgments from counterfactual simulations and intention inferences. Proc. Annu. Meet. Cogn. Sci. Soc. 45, 3375\u20133382 (2023).","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"963_CR105","unstructured":"Sutton, R. The bitter lesson. Incomplete Ideas http:\/\/www.incompleteideas.net\/IncIdeas\/BitterLesson.html (2019)."},{"key":"963_CR106","unstructured":"Kaplan, J. et al. Scaling laws for neural language models. Preprint at https:\/\/arxiv.org\/abs\/2001.08361 (2020)."},{"key":"963_CR107","unstructured":"Binz, M. & Schulz, E. Turning large language models into cognitive models. In Proc. 12th International Conference on Learning Representations (ICLR) https:\/\/openreview.net\/forum?id=eiC4BKypf1 (OpenReview, 2024)."},{"key":"963_CR108","doi-asserted-by":"crossref","unstructured":"Rahmanzadehgervi, P., Bolton, L., Taesiri, M. R. & Nguyen, A. T. Vision language models are blind. In Proc. Asian Conference on Computer Vision (ACCV) 18\u201334 (Computer Vision Foundation, 2024).","DOI":"10.1007\/978-981-96-0917-8_17"},{"key":"963_CR109","doi-asserted-by":"crossref","unstructured":"Ju, C., Han, T., Zheng, K., Zhang, Y. & Xie, W. Prompting visual-language models for efficient video understanding. In Proc. Computer Vision \u2013 ECCV 2022: 17th European Conference (eds Avidan, S. et al.) 105\u2013124 (Springer, 2022).","DOI":"10.1007\/978-3-031-19833-5_7"},{"key":"963_CR110","first-page":"204166952092703","volume":"11","author":"K Meding","year":"2020","unstructured":"Meding, K., Bruijns, S. A., Sch\u00f6lkopf, B., Berens, P. & Wichmann, F. A. Phenomenal causality and sensory realism. Iperception 11, 2041669520927038 (2020).","journal-title":"Iperception"},{"key":"963_CR111","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.1038\/s41562-024-01878-9","volume":"8","author":"KR Allen","year":"2024","unstructured":"Allen, K. R. et al. Using games to understand the mind. Nat. Hum. Behav. 8, 1035\u20131043 (2024).","journal-title":"Nat. Hum. Behav."},{"key":"963_CR112","doi-asserted-by":"crossref","unstructured":"Maaz, M., Rasheed, H., Khan, S. & Khan, F. Video-ChatGPT: Towards detailed video understanding via large vision and language models. In Proc. 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (eds Ku, L.-W. et al.) 12585\u201312602 (Association for Computational Linguistics, 2024).","DOI":"10.18653\/v1\/2024.acl-long.679"},{"key":"963_CR113","doi-asserted-by":"publisher","first-page":"29330","DOI":"10.1073\/pnas.1912334117","volume":"117","author":"T Golan","year":"2020","unstructured":"Golan, T., Raju, P. C. & Kriegeskorte, N. Controversial stimuli: pitting neural networks against each other as models of human cognition. Proc. Natl Acad. Sci. USA 117, 29330\u201329337 (2020).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"963_CR114","doi-asserted-by":"publisher","first-page":"952","DOI":"10.1038\/s42256-023-00718-1","volume":"5","author":"T Golan","year":"2023","unstructured":"Golan, T., Siegelman, M., Kriegeskorte, N. & Baldassano, C. Testing the limits of natural language models for predicting human language judgements. Nat. Mach. Intell. 5, 952\u2013964 (2023).","journal-title":"Nat. Mach. Intell."},{"key":"963_CR115","doi-asserted-by":"crossref","unstructured":"Reynolds, L. & McDonell, K. Prompt programming for large language models: beyond the few-shot paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (eds Kitamura, Y. et al.) 314 (Association for Computing Machinery, 2021).","DOI":"10.1145\/3411763.3451760"},{"key":"963_CR116","first-page":"1146","volume":"29","author":"H Strobelt","year":"2022","unstructured":"Strobelt, H. et al. Interactive and visual prompt engineering for ad-hoc task adaptation with large language models. IEEE Trans. Vis. Comput. Graph. 29, 1146\u20131156 (2022).","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"963_CR117","doi-asserted-by":"crossref","unstructured":"Webson, A. & Pavlick, E. Do prompt-based models really understand the meaning of their prompts? In Proc. 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (eds Carpuat, M. et al.) 2300\u20132344 (Association for Computational Linguistics, 2022).","DOI":"10.18653\/v1\/2022.naacl-main.167"},{"key":"963_CR118","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1145\/3560815","volume":"55","author":"P Liu","year":"2023","unstructured":"Liu, P. et al. Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing. ACM Comput. Surv. 55, 195 (2023).","journal-title":"ACM Comput. Surv."},{"key":"963_CR119","unstructured":"Gu, J. et al. A systematic survey of prompt engineering on vision-language foundation models. Preprint at https:\/\/arxiv.org\/abs\/2307.12980 (2023)."},{"key":"963_CR120","unstructured":"Coda-Forno, J. et al. Meta-in-context learning in large language models. In Proc. Advances in Neural Information Processing Systems 36 (NeurIPS 2023) (eds Oh, A. et al.) 65189\u201365201 (Curran Associates, 2023)."},{"key":"963_CR121","unstructured":"Geirhos, R. et al. Partial success in closing the gap between human and machine vision. In Proc. Advances in Neural Information Processing Systems 34 (NeurIPS 2021) (eds Ranzato, M. et al.) 23885\u201323899 (Curran Associates, 2021)."},{"key":"963_CR122","unstructured":"Balestriero, R. et al. A cookbook of self-supervised learning. Preprint at https:\/\/arxiv.org\/abs\/2304.12210 (2023)."},{"key":"963_CR123","unstructured":"Wong, L. et al. From word models to world models: translating from natural language to the probabilistic language of thought. Preprint at https:\/\/arxiv.org\/abs\/2306.12672 (2023)."},{"key":"963_CR124","unstructured":"Carta, T. et al. Grounding large language models in interactive environments with online reinforcement learning. In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) 202, 3676\u20133713 (JMLR, 2023)."},{"key":"963_CR125","unstructured":"Paszke, A. et al. Pytorch: An imperative style, high-performance deep learning library. In Proc. Advances in Neural Information Processing Systems 32 (NeurIPS 2019) (eds Wallach, H. et al.) 8026\u20138037 (Curran Associates, 2019)."},{"key":"963_CR126","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","volume":"585","author":"CR Harris","year":"2020","unstructured":"Harris, C. R. et al. Array programming with NumPy. Nature 585, 357\u2013362 (2020).","journal-title":"Nature"},{"key":"963_CR127","doi-asserted-by":"publisher","unstructured":"Pandas Development Team. pandas-dev\/pandas: Pandas. Zenodo https:\/\/doi.org\/10.5281\/zenodo.3509134 (2020).","DOI":"10.5281\/zenodo.3509134"},{"key":"963_CR128","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","volume":"17","author":"P Virtanen","year":"2020","unstructured":"Virtanen, P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods 17, 261\u2013272 (2020).","journal-title":"Nat. Methods"},{"key":"963_CR129","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","volume":"9","author":"JD Hunter","year":"2007","unstructured":"Hunter, J. D. Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9, 90\u201395 (2007).","journal-title":"Comput. Sci. Eng."},{"key":"963_CR130","doi-asserted-by":"publisher","first-page":"3021","DOI":"10.21105\/joss.03021","volume":"6","author":"M Waskom","year":"2021","unstructured":"Waskom, M. L. seaborn: statistical data visualization. J. Open Source Softw 6, 3021 (2021).","journal-title":"J. Open Source Softw"},{"key":"963_CR131","doi-asserted-by":"publisher","unstructured":"B\u00fcrkner, P.-C. brms: an R package for Bayesian multilevel models using Stan. J. Stat. Softw. https:\/\/doi.org\/10.18637\/jss.v080.i01 (2017).","DOI":"10.18637\/jss.v080.i01"},{"key":"963_CR132","unstructured":"R Core Team. R: a language and environment for statistical computing (R Foundation for Statistical Computing, 2021)."},{"key":"963_CR133","doi-asserted-by":"publisher","unstructured":"Schulze Buschoff, L. M. et al. lsbuschoff\/multimodal: First release. Zenodo https:\/\/doi.org\/10.5281\/zenodo.14050104 (2024).","DOI":"10.5281\/zenodo.14050104"}],"container-title":["Nature Machine Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s42256-024-00963-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42256-024-00963-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42256-024-00963-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,26]],"date-time":"2025-01-26T23:03:46Z","timestamp":1737932626000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s42256-024-00963-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,15]]},"references-count":133,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["963"],"URL":"https:\/\/doi.org\/10.1038\/s42256-024-00963-y","relation":{},"ISSN":["2522-5839"],"issn-type":[{"value":"2522-5839","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,15]]},"assertion":[{"value":"29 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}