{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T21:12:13Z","timestamp":1781039533910,"version":"3.54.1"},"reference-count":61,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2021,4,9]],"date-time":"2021-04-09T00:00:00Z","timestamp":1617926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,4,9]],"date-time":"2021-04-09T00:00:00Z","timestamp":1617926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01IS18039B"],"award-info":[{"award-number":["01IS18039B"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Max Planck Institute for Intelligent Systems"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors, with decision aids, such as decision trees and flowcharts. Designing effective decision aids is a difficult problem. We propose that recently developed reinforcement learning methods for discovering clever heuristics for good decision-making can be partially leveraged to assist human experts in this design process. One of the biggest remaining obstacles to leveraging the aforementioned methods for improving human decision-making is that the policies they learn are opaque to people. To solve this problem, we introduce AI-Interpret: a general method for transforming idiosyncratic policies into simple and interpretable descriptions. Our algorithm combines recent advances in imitation learning and program induction with a new clustering method for identifying a large subset of demonstrations that can be accurately described by a simple, high-performing decision rule. We evaluate our new AI-Interpret algorithm and employ it to translate information-acquisition policies discovered through metalevel reinforcement learning. The results of three large behavioral experiments showed that providing the decision rules generated by AI-Interpret as flowcharts significantly improved people\u2019s planning strategies and decisions across three different classes of sequential decision problems. Moreover, our fourth experiment revealed that this approach is significantly more effective at improving human decision-making than training people by giving them performance feedback. Finally, a series of ablation studies confirmed that our AI-Interpret algorithm was critical to the discovery of interpretable decision rules and that it is ready to be applied to other reinforcement learning problems. We conclude that the methods and findings presented in this article are an important step towards leveraging automatic strategy discovery to improve human decision-making. The code for our algorithm and the experiments is available at<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/RationalityEnhancement\/InterpretableStrategyDiscovery\">https:\/\/github.com\/RationalityEnhancement\/InterpretableStrategyDiscovery<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s10994-021-05963-2","type":"journal-article","created":{"date-parts":[[2021,4,9]],"date-time":"2021-04-09T17:02:23Z","timestamp":1617987743000},"page":"2641-2683","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Automatic discovery of interpretable planning strategies"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7422-4176","authenticated-orcid":false,"given":"Julian","family":"Skirzy\u0144ski","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frederic","family":"Becker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Falk","family":"Lieder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,4,9]]},"reference":[{"key":"5963_CR1","doi-asserted-by":"crossref","unstructured":"Alur, R., Radhakrishna, A., & Udupa, A. (2017). Scaling enumerative program synthesis via divide and conquer. In International conference on tools and algorithms for the construction and analysis of systems (pp. 319\u2013336). Springer.","DOI":"10.1007\/978-3-662-54577-5_18"},{"key":"5963_CR2","doi-asserted-by":"publisher","first-page":"4561","DOI":"10.1609\/aaai.v33i01.33014561","volume":"33","author":"RM Annasamy","year":"2019","unstructured":"Annasamy, R. M., & Sycara, K. (2019). Towards better interpretability in deep q-networks. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 4561\u20134569.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"5963_CR3","doi-asserted-by":"crossref","unstructured":"Araki, B., Vodrahalli, K., Leech, T., Vasile, C. I., Donahue, M., & Rus, D. (2019). Learning to Plan with Logical Automata. In Robotics: Science and systems conference (RSS) (pp. 1\u20139). Messe Freiburg, Germany.","DOI":"10.15607\/RSS.2019.XV.064"},{"key":"5963_CR4","unstructured":"Atrey, A., Clary, K., & Jensen, D. (2019). Exploratory not explanatory: Counterfactual analysis of saliency maps for deep reinforcement learning. In International conference on learning representations."},{"key":"5963_CR5","unstructured":"Bastani, O., Pu, Y., & Solar-Lezama, A. (2018). Verifiable reinforcement learning via policy extraction. In: S.\u00a0Bengio, H.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi, R.\u00a0Garnett (eds.) Advances in Neural Information Processing Systems 31, pp. 2494\u20132504. Curran Associates, Inc. http:\/\/papers.nips.cc\/paper\/7516-verifiable-reinforcement-learning-via-policy-extraction.pdf"},{"key":"5963_CR6","unstructured":"Bhupatiraju, S., Agrawal, K. K., & Singh, R. (2018). Towards mixed optimization for reinforcement learning with program synthesis. arXiv preprint arXiv:1807.00403."},{"key":"5963_CR7","unstructured":"Binz, M., & Endres, D. (2019). Where do heuristics come from? In CogSci 2019."},{"key":"5963_CR8","first-page":"151","volume":"432","author":"L Breiman","year":"1984","unstructured":"Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees. Belmont, Ca: Wadsworth. International Group, 432, 151\u2013166.","journal-title":"International Group"},{"key":"5963_CR10","unstructured":"Callaway, F., Gul, S., Krueger, P., Griffiths, T. L., & Lieder, F. (2018a). Learning to select computations. In Uncertainty in artificial intelligence: Proceedings of the thirty-fourth conference."},{"key":"5963_CR9","unstructured":"Callaway, F., Gul, S., Krueger, P., Griffiths, T., Pachur, T., & Lieder, F. (2019). Discovering rational heuristics for risky choice. Manuscript in preparation."},{"key":"5963_CR11","unstructured":"Callaway, F., Lieder, F., Das, P., Gul, S., Krueger, P., & Griffiths, T. (2018b). A resource-rational analysis of human planning. In: C.\u00a0Kalish, M.\u00a0Rau, J.\u00a0Zhu, T.\u00a0Rogers (eds.) CogSci 2018."},{"key":"5963_CR12","doi-asserted-by":"crossref","unstructured":"Callaway, F., Lieder, F., Krueger, P. M., & Griffiths, T. L. (2017). Mouselab-MDP: A new paradigm for tracing how people plan. In The 3rd multidisciplinary conference on reinforcement learning and decision making, Ann Arbor, MI. https:\/\/osf.io\/vmkrq\/","DOI":"10.31219\/osf.io\/7wcya"},{"key":"5963_CR13","doi-asserted-by":"crossref","unstructured":"Callaway, F., van Opheusden, B., Gul, S., Das, P., Krueger, P., Lieder, F., & Griffiths, T. (2020). Human planning as optimal information seeking. Manuscript in preparation.","DOI":"10.31234\/osf.io\/byaqd"},{"key":"5963_CR14","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1609\/icaps.v29i1.3529","volume":"29","author":"A Camacho","year":"2019","unstructured":"Camacho, A., & McIlraith, S. A. (2019). Learning interpretable models expressed in linear temporal logic. Proceedings of the International Conference on Automated Planning and Scheduling, 29, 621\u2013630.","journal-title":"Proceedings of the International Conference on Automated Planning and Scheduling"},{"key":"5963_CR15","unstructured":"Che, Z., Purushotham, S., Khemani, R., & Liu, Y. (2016). Interpretable deep models for icu outcome prediction. AMIA ... Annual Symposium proceedings. AMIA Symposium 2016, 371\u2013380. https:\/\/europepmc.org\/articles\/PMC5333206"},{"key":"5963_CR16","unstructured":"Consul, S., Heindrich, L., Stojcheski, J., & Lieder, F. (2021). Improving human decision-making by discovering efficient strategies for hierarchical planning. arXiv preprint arXiv:2102.00521"},{"key":"5963_CR17","unstructured":"Coppens, Y., Efthymiadis, K., Lenaerts, T., Now\u00e9, A., Miller, T., Weber, R., & Magazzeni, D. (2019). Distilling deep reinforcement learning policies in soft decision trees. In Proceedings of the IJCAI 2019 workshop on explainable artificial intelligence (pp. 1\u20136)."},{"key":"5963_CR18","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195328981.001.0001","volume-title":"Rationality for mortals: How people cope with uncertainty","author":"G Gigerenzer","year":"2008","unstructured":"Gigerenzer, G. (2008). Rationality for mortals: How people cope with uncertainty. Oxford: Oxford University Press."},{"key":"5963_CR19","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","volume":"62","author":"G Gigerenzer","year":"2011","unstructured":"Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology, 62, 451\u2013482.","journal-title":"Annual Review of Psychology"},{"key":"5963_CR20","volume-title":"Simple heuristics that make us smart","author":"G Gigerenzer","year":"1999","unstructured":"Gigerenzer, G., & Todd, P. M. (1999). Simple heuristics that make us smart. Oxford: Oxford University Press."},{"key":"5963_CR21","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511808098","volume-title":"Heuristics and biases: The psychology of intuitive judgment","author":"T Gilovich","year":"2002","unstructured":"Gilovich, T., Griffin, D., & Kahneman, D. (2002). Heuristics and biases: The psychology of intuitive judgment. New York, NY: Cambridge University Press."},{"key":"5963_CR22","unstructured":"Greydanus, S., Koul, A., Dodge, J., & Fern, A. (2018). Visualizing and understanding atari agents. In International conference on machine learning (pp. 1792\u20131801)."},{"key":"5963_CR23","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.cobeha.2019.01.005","volume":"29","author":"TL Griffiths","year":"2019","unstructured":"Griffiths, T. L., Callaway, F., Chang, M. B., Grant, E., Krueger, P. M., & Lieder, F. (2019). Doing more with less: meta-reasoning and meta-learning in humans and machines. Current Opinion in Behavioral Sciences, 29, 24\u201330.","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"2","key":"5963_CR24","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.jarmac.2016.04.011","volume":"5","author":"S Hafenbr\u00e4dl","year":"2016","unstructured":"Hafenbr\u00e4dl, S., Waeger, D., Marewski, J. N., & Gigerenzer, G. (2016). Applied decision making with fast-and-frugal heuristics. Journal of Applied Research in Memory and Cognition, 5(2), 215\u2013231.","journal-title":"Journal of Applied Research in Memory and Cognition"},{"key":"5963_CR25","unstructured":"Hay, N., Russell, S., Tolpin, D., & Shimony, S. (2012). Selecting computations: Theory and applications. In: N.\u00a0de\u00a0Freitas, K.\u00a0Murphy (eds.) Proceedings of the 28th conference on uncertainty in artificial intelligence. AUAI Press, Corvallis, OR."},{"key":"5963_CR26","doi-asserted-by":"crossref","unstructured":"Iyer, R., Li, Y., Li, H., Lewis, M., Sundar, R., & Sycara, K. (2018). Transparency and explanation in deep reinforcement learning neural networks. In Proceedings of the 2018 AAAI\/ACM conference on ai, ethics, and society (pp. 144\u2013150).","DOI":"10.1145\/3278721.3278776"},{"key":"5963_CR27","doi-asserted-by":"crossref","unstructured":"Jhunjhunwala, A. (2019). Policy extraction via online q-value distillation. http:\/\/hdl.handle.net\/10012\/14963","DOI":"10.1109\/IJCNN48605.2020.9207648"},{"key":"5963_CR28","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477","volume-title":"Judgment under uncertainty: Heuristics and biases","author":"D Kahneman","year":"1982","unstructured":"Kahneman, D., Slovic, S. P., Slovic, P., & Tversky, A. (1982). Judgment under uncertainty: Heuristics and biases. Cambridge: Cambridge University Press."},{"key":"5963_CR29","unstructured":"Kemtur, A., Jain, Y., Mehta, A., Callaway, F., Consul, S., Stojcheski, J., & Lieder, F. (2020). Leveraging machine learning to automatically derive robust planning strategies from biased models of the environment. In CogSci 2020"},{"issue":"12","key":"5963_CR30","doi-asserted-by":"publisher","first-page":"1999","DOI":"10.1016\/S0031-3203(98)00181-2","volume":"32","author":"R Krishnan","year":"1999","unstructured":"Krishnan, R., Sivakumar, G., & Bhattacharya, P. (1999). Extracting decision trees from trained neural networks. Pattern Recognition, 32(12), 1999\u20132009. https:\/\/doi.org\/10.1016\/S0031-3203(98)00181-2.","journal-title":"Pattern Recognition"},{"key":"5963_CR31","unstructured":"Lam, K. H., Zhengxian, L., Jed, I., Dodge, J., Shureih, Z. T., Khanna, R., Kahng, M., & Fern, A. (2020). Identifying reasoning flaws in planning-based rl using tree explanations. IJCAI-PRICAI XAI workshop."},{"key":"5963_CR32","unstructured":"Laskey, K. B., & Martignon, L. (2014). Comparing fast and frugal trees and Bayesian networks for risk assessment. In K. Makar (Ed.), Sustainability in statistics education. Proceedings of the ninth international conference on teaching statistics (ICOTS9)."},{"key":"5963_CR33","unstructured":"Lieder, F., Callaway, F., Jain, Y., Krueger, P., Das, P., Gul, S., & Griffiths, T. (2019). 2019. A cognitive tutor for helping people overcome present bias. In RLDM 2019."},{"key":"5963_CR34","unstructured":"Lieder, F., Callaway, F., Jain, Y. R., Das, P., Iwama, G., Gul, S., Krueger, P., & Griffiths, T. L. (2020). Leveraging artificial intelligence to improve people\u2019s planning strategies. Manuscript in revision."},{"key":"5963_CR35","unstructured":"Lieder, F., Callaway, F., Krueger, P. M., Das, P., Griffiths, T. L., & Gul, S. (2018). Discovering and teaching optimal planning strategies. In The 14th biannual conference of the German Society for Cognitive Science, GK."},{"key":"5963_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0140525X1900061X","volume":"3","author":"F Lieder","year":"2020","unstructured":"Lieder, F., & Griffiths, T. L. (2020). Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources. Behavioral and Brain Sciences, 3, 1\u201385.","journal-title":"Behavioral and Brain Sciences"},{"key":"5963_CR37","unstructured":"Lieder, F., Krueger, P. M., Griffiths, T. (2017). An automatic method for discovering rational heuristics for risky choice. In G.\u00a0Gunzelmann, A.\u00a0Howes, T.\u00a0Tenbrink, E.\u00a0Davelaar (Eds.) CogSci 2017."},{"key":"5963_CR38","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1007\/978-3-030-10928-8_25","volume-title":"Machine learning and knowledge discovery in databases","author":"G Liu","year":"2019","unstructured":"Liu, G., Schulte, O., Zhu, W., & Li, Q. (2019). Toward interpretable deep reinforcement learning with linear model u-trees. In M. Berlingerio, F. Bonchi, T. G\u00e4rtner, N. Hurley, & G. Ifrim (Eds.), Machine learning and knowledge discovery in databases (pp. 414\u2013429). Cham: Springer."},{"key":"5963_CR39","first-page":"189","volume":"2003","author":"L Martignon","year":"2003","unstructured":"Martignon, L., Vitouch, O., Takezawa, M., & Forster, M. R. (2003). Naive and yet enlightened: From natural frequencies to fast and frugal decision trees. Thinking: Psychological Perspective on Reasoning, Judgment, and Decision Making, 2003, 189\u2013211.","journal-title":"Thinking: Psychological Perspective on Reasoning, Judgment, and Decision Making"},{"key":"5963_CR40","doi-asserted-by":"publisher","first-page":"490","DOI":"10.1111\/j.1558-5646.1957.tb02884.x","volume":"11","author":"C Michener","year":"1957","unstructured":"Michener, C., & Sokal, R. (1957). A quantitative approach to a problem of classification. Evolution, 11, 490\u2013499.","journal-title":"Evolution"},{"issue":"7540","key":"5963_CR41","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., & Petersen, S. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529\u2013533.","journal-title":"Nature"},{"key":"5963_CR42","unstructured":"Mott, A., Zoran, D., Chrzanowski, M., Wierstra, D., Rezende, & D. J. (2019). Towards interpretable reinforcement learning using attention augmented agents. In Advances in neural information processing systems (pp. 12350\u201312359)."},{"issue":"1\u20132","key":"5963_CR43","first-page":"1","volume":"7","author":"T Osa","year":"2018","unstructured":"Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018). An algorithmic perspective on imitation learning. Foundations and Trends\u00ae in Robotics, 7(1\u20132), 1\u2013179.","journal-title":"Foundations and Trends\u00ae in Robotics"},{"key":"5963_CR44","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., & Vanderplas, J. (2011). Scikit-learn: Machine learning in python. Journal of Machine Learning Research, 12, 2825\u20132830.","journal-title":"Journal of Machine Learning Research"},{"key":"5963_CR45","unstructured":"Penkov, S., & Ramamoorthy, S. (2019). Learning programmatically structured representations with perceptor gradients. arXiv preprint arXiv:1905.00956."},{"key":"5963_CR46","unstructured":"Puri, N., Verma, S., Gupta, P., Kayastha, D., Deshmukh, S., Krishnamurthy, B., & Singh, S. (2019). Explain your move: Understanding agent actions using specific and relevant feature attribution. In International conference on learning representations."},{"issue":"2","key":"5963_CR47","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1037\/0096-3445.135.2.207","volume":"135","author":"J Rieskamp","year":"2006","unstructured":"Rieskamp, J., & Otto, P. E. (2006). Ssl: A theory of how people learn to select strategies. Journal of Experimental Psychology: General, 135(2), 207.","journal-title":"Journal of Experimental Psychology: General"},{"key":"5963_CR48","unstructured":"Silva, A., Gombolay, M., Killian, T., Jimenez, I., & Son, S.H. (2020). Optimization methods for interpretable differentiable decision trees applied to reinforcement learning. In International conference on artificial intelligence and statistics (pp. 1855\u20131865)."},{"issue":"6419","key":"5963_CR49","doi-asserted-by":"publisher","first-page":"1140","DOI":"10.1126\/science.aar6404","volume":"362","author":"D Silver","year":"2018","unstructured":"Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., & Lillicrap, T. (2018). A general reinforcement learning algorithm that masters chess, shogi, and go through self-play. Science, 362(6419), 1140\u20131144. https:\/\/doi.org\/10.1126\/science.aar6404.","journal-title":"Science"},{"issue":"7676","key":"5963_CR50","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D Silver","year":"2017","unstructured":"Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., & Chen, Y. (2017). Mastering the game of go without human knowledge. Nature, 550(7676), 354\u2013359.","journal-title":"Nature"},{"key":"5963_CR51","doi-asserted-by":"crossref","unstructured":"Silver, T., Allen, K. R., Lew, A. K., Kaelbling, L. P., & Tenenbaum, J. (2019). Few-shot Bayesian imitation learning with logical program policies.","DOI":"10.1609\/aaai.v34i06.6587"},{"issue":"4157","key":"5963_CR52","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","volume":"185","author":"A Tversky","year":"1974","unstructured":"Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124\u20131131.","journal-title":"Science"},{"key":"5963_CR53","unstructured":"Valiant, L. G. (1985). Learning disjunction of conjunctions. In IJCAI (pp. 560\u2013566). Citeseer."},{"key":"5963_CR54","volume-title":"The nature of statistical learning theory","author":"V Vapnik","year":"2013","unstructured":"Vapnik, V. (2013). The nature of statistical learning theory. Berlin: Springer."},{"key":"5963_CR55","unstructured":"Vazquez-Chanlatte, M., Jha, S., Tiwari, A., Ho, M. K., & Seshia, S. (2018). Learning task specifications from demonstrations. In Advances in neural information processing systems (pp. 5367\u20135377)."},{"key":"5963_CR56","doi-asserted-by":"publisher","first-page":"9902","DOI":"10.1609\/aaai.v33i01.33019902","volume":"33","author":"A Verma","year":"2019","unstructured":"Verma, A. (2019). Verifiable and interpretable reinforcement learning through program synthesis. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 9902\u20139903.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"5963_CR57","unstructured":"Verma, A., Le, H., Yue, Y., & Chaudhuri, S. (2019). Imitation-projected programmatic reinforcement learning. In: H.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d\u00c1lch\u00e9-Buc, E.\u00a0Fox, R.\u00a0Garnett (eds.) (2019). Advances in Neural Information Processing Systems 32, pp. 15752\u201315763. Curran Associates, Inc. http:\/\/papers.nips.cc\/paper\/9705-imitation-projected-programmatic-reinforcement-learning.pdf"},{"key":"5963_CR58","unstructured":"Verma, A., Murali, V., Singh, R., Kohli, P., & Chaudhuri, S. (2018). Programmatically interpretable reinforcement learning."},{"key":"5963_CR59","doi-asserted-by":"crossref","unstructured":"Wilcox, R. (2016). Introduction to Robust Estimation and Hypothesis Testing. Statistical Modeling and Decision Science. Elsevier Science. https:\/\/books.google.de\/books?id=FELQDAAAQBAJ","DOI":"10.1016\/B978-0-12-804733-0.00010-X"},{"key":"5963_CR60","unstructured":"Wymann, B., Dimitrakakis, C., Sumner, A., Espi\u00e9, E., & Guionneau, C. (2015). Torcs: The open racing car simulator."},{"key":"5963_CR61","unstructured":"Yau, H., Russell, C., & Hadfield, S. (2020). What did you think would happen? explaining agent behaviour through intended outcomes. In: H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.F. Balcan, H.\u00a0Lin (eds.) (2020). Advances in Neural Information Processing Systems, vol.\u00a033, pp. 18375\u201318386. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/d5ab8dc7ef67ca92e41d730982c5c602-Paper.pdf"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05963-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-021-05963-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05963-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T00:28:40Z","timestamp":1724804920000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-021-05963-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,9]]},"references-count":61,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["5963"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-05963-2","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,9]]},"assertion":[{"value":"16 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 October 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 April 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}