{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T14:39:33Z","timestamp":1775745573762,"version":"3.50.1"},"reference-count":132,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T00:00:00Z","timestamp":1677628800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T00:00:00Z","timestamp":1678492800000},"content-version":"vor","delay-in-days":10,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000288","name":"Royal Society","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000288","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning (ML) techniques have become pervasive across a range of different applications, and are now widely used in areas as disparate as recidivism prediction, consumer credit-risk analysis, and insurance pricing. Likewise, in the physical world, ML models are critical components in autonomous agents such as robotic surgeons and self-driving cars. Among the many ethical dimensions that arise in the use of ML technology in such applications, analyzing morally permissible actions is both immediate and profound. For example, there is the potential for learned algorithms to become biased against certain groups. More generally, in so much that the decisions of ML models impact society, both virtually (e.g., denying a loan) and physically (e.g., driving into a pedestrian), notions of accountability, blame and responsibility need to be carefully considered. In this article, we advocate for a two-pronged approach ethical decision-making enabled using rich models of autonomous agency: on the one hand, we need to draw on philosophical notions of such as beliefs, causes, effects and intentions, and look to formalise them, as attempted by the knowledge representation community, but on the other, from a computational perspective, such theories need to also address the problems of tractable reasoning and (probabilistic) knowledge acquisition. As a concrete instance of this tradeoff, we report on a few preliminary results that apply (propositional) tractable probabilistic models to problems in fair ML and automated reasoning of moral principles. Such models are compilation targets for certain types of knowledge representation languages, and can effectively reason in service some computational tasks. They can also be learned from data. Concretely, current evidence suggests that they are attractive structures for jointly addressing three fundamental challenges: reasoning about possible worlds + tractable computation + knowledge acquisition. Thus, these seems like a good starting point for modelling reasoning robots as part of the larger ecosystem where accountability and responsibility is understood more broadly.<\/jats:p>","DOI":"10.1007\/s10676-023-09692-z","type":"journal-article","created":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T09:03:05Z","timestamp":1678525385000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Knowledge representation and acquisition for ethical AI: challenges and opportunities"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5573-8465","authenticated-orcid":false,"given":"Vaishak","family":"Belle","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,11]]},"reference":[{"key":"9692_CR1","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.artint.2018.01.002","volume":"258","author":"SV Albrecht","year":"2018","unstructured":"Albrecht, S. V., & Stone, P. (2018). Autonomous agents modelling other agents: A comprehensive survey and open problems. Artificial Intelligence, 258, 66\u201395.","journal-title":"Artificial Intelligence"},{"issue":"3","key":"9692_CR2","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/s10676-006-0004-4","volume":"7","author":"C Allen","year":"2005","unstructured":"Allen, C., Smit, I., & Wallach, W. (2005). Artificial morality: Top-down, bottom-up, and hybrid approaches. Ethics and Information Technology, 7(3), 149\u2013155.","journal-title":"Ethics and Information Technology"},{"key":"9692_CR3","volume-title":"Machine bias: There\u2019s software used across the country to predict future criminals. And it\u2019s biased against blacks","author":"J Angwin","year":"2016","unstructured":"Angwin, J., Larson, J., Mattu, S., & Kirchner, L. (2016). Machine bias: There\u2019s software used across the country to predict future criminals. And it\u2019s biased against blacks. Benton Institute."},{"key":"9692_CR4","unstructured":"Aplin, T., Schafer, B., & Li, P. (2022). Trustworthy autonomous systems hub and TAS node on regulation and governance (2021) artificial intelligence and IP: Copyright and patents: A call for evidence from Intellectual Property Office."},{"key":"9692_CR5","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"AB Arrieta","year":"2020","unstructured":"Arrieta, A. B., D\u00edaz-Rodr\u00edguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garc\u00eda, S., Gil-L\u00f3pez, S., Molina, D., Benjamins, R., et al. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82\u2013115.","journal-title":"Information Fusion"},{"key":"9692_CR6","first-page":"1","volume":"18","author":"SH Bach","year":"2017","unstructured":"Bach, S. H., Broecheler, M., Huang, B., & Getoor, L. (2017). Hinge-loss Markov random fields and probabilistic soft logic. Journal of Machine Learning Research, 18, 1\u201367.","journal-title":"Journal of Machine Learning Research"},{"key":"9692_CR7","unstructured":"Barrett, C., Sebastiani, R., Seshia, S. A., & Tinelli, C. (2009). Chapter 26: Satisfiability modulo theories. In Handbook of satisfiability (pp. 825\u2013885). IOS Press."},{"key":"9692_CR8","doi-asserted-by":"crossref","unstructured":"Batusov, V., & Soutchanski, M. (2018). Situation calculus semantics for actual causality. In Proceedings of the AAAI conference on artificial intelligence, 2018 (Vol. 32).","DOI":"10.1609\/aaai.v32i1.11561"},{"key":"9692_CR9","doi-asserted-by":"crossref","unstructured":"Beckers, S., & Halpern, J. Y. (2019). Abstracting causal models. In Proceedings of the AAAI conference on artificial intelligence, 2019 (Vol. 33, pp. 2678\u20132685).","DOI":"10.1609\/aaai.v33i01.33012678"},{"key":"9692_CR10","doi-asserted-by":"crossref","unstructured":"Belle, V. (2017). Logic meets probability: Towards explainable AI systems for uncertain worlds. In IJCAI, 2017 (pp. 5116\u20135120).","DOI":"10.24963\/ijcai.2017\/733"},{"key":"9692_CR11","doi-asserted-by":"publisher","first-page":"105976","DOI":"10.1016\/j.knosys.2020.105976","volume":"199","author":"V Belle","year":"2020","unstructured":"Belle, V. (2020a). Abstracting probabilistic models: Relations, constraints and beyond. Knowledge-Based Systems, 199, 105976.","journal-title":"Knowledge-Based Systems"},{"key":"9692_CR12","doi-asserted-by":"crossref","unstructured":"Belle, V. (2020b). Symbolic logic meets machine learning: A brief survey in infinite domains. In International conference on scalable uncertainty management, 2020 (pp. 3\u201316). Springer.","DOI":"10.1007\/978-3-030-58449-8_1"},{"key":"9692_CR13","doi-asserted-by":"crossref","unstructured":"Belle, V. (2021). Logic meets learning: From Aristotle to neural networks. In Neuro-symbolic artificial intelligence: The state of the art (pp. 78\u2013102). IOS Press.","DOI":"10.3233\/FAIA210350"},{"key":"9692_CR14","unstructured":"Belle, V., & Juba, B. (2019). Implicitly learning to reason in first-order logic. Advances in neural information processing systems, 2019 (Vol. 32)."},{"key":"9692_CR15","doi-asserted-by":"crossref","unstructured":"Belle, V., & Lakemeyer, G. (2017). Reasoning about probabilities in unbounded first-order dynamical domains. In IJCAI, 2017.","DOI":"10.24963\/ijcai.2017\/115"},{"key":"9692_CR16","unstructured":"Belle, V., & Levesque, H. J. (2015). ALLEGRO: Belief-based programming in stochastic dynamical domains. In IJCAI, 2015."},{"key":"9692_CR17","doi-asserted-by":"crossref","unstructured":"Belle, V., & Papantonis, I. (2020). Principles and practice of explainable machine learning. arXiv preprint. arXiv:2009.11698","DOI":"10.3389\/fdata.2021.688969"},{"key":"9692_CR18","unstructured":"Bhattacharjya, D., & Shachter, R. D. (2012). Evaluating influence diagrams with decision circuits. arXiv preprint. arXiv:1206.5257"},{"key":"9692_CR19","doi-asserted-by":"crossref","unstructured":"Bienvenu, M., Fargier, H., & Marquis, P. (2010). Knowledge compilation in the modal logic S5. In Twenty-fourth AAAI conference on artificial intelligence, 2010.","DOI":"10.1609\/aaai.v24i1.7587"},{"issue":"6293","key":"9692_CR20","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1126\/science.aaf2654","volume":"352","author":"J-F Bonnefon","year":"2016","unstructured":"Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016). The social dilemma of autonomous vehicles. Science, 352(6293), 1573\u20131576.","journal-title":"Science"},{"key":"9692_CR21","volume-title":"Knowledge representation","author":"RJ Brachman","year":"1992","unstructured":"Brachman, R. J., Levesque, H. J., & Reiter, R. (1992). Knowledge representation. MIT Press."},{"key":"9692_CR22","doi-asserted-by":"crossref","unstructured":"Broersen, J., Dastani, M., Hulstijn, J., Huang, Z., & van der Torre, L. (2001). The BOID architecture: Conflicts between beliefs, obligations, intentions and desires. In Proceedings of the fifth international conference on Autonomous agents, 2001 (pp. 9\u201316).","DOI":"10.1145\/375735.375766"},{"issue":"6","key":"9692_CR23","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1017\/S1471068420000228","volume":"20","author":"P Cabalar","year":"2020","unstructured":"Cabalar, P., Fandinno, J., Garea, J., Romero, J., & Schaub, T. (2020). eclingo: A solver for epistemic logic programs. Theory and Practice of Logic Programming, 20(6), 834\u2013847.","journal-title":"Theory and Practice of Logic Programming"},{"key":"9692_CR24","unstructured":"Charisi, V., Dennis, L., Fisher, M., Lieck, R., Matthias, A., Slavkovik, M., Sombetzki, J., Winfield, A. F., & Yampolskiy, R. (2017). Towards moral autonomous systems. arXiv preprint. arXiv:1703.04741"},{"key":"9692_CR25","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1613\/jair.1391","volume":"22","author":"H Chockler","year":"2004","unstructured":"Chockler, H., & Halpern, J. Y. (2004). Responsibility and blame: A structural-model approach. Journal of Artificial Intelligence Research, 22, 93\u2013115.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9692_CR26","doi-asserted-by":"crossref","unstructured":"Choi, Y., Dang, M., & Van den Broeck, G. (2020). Group fairness by probabilistic modeling with latent fair decisions. arXiv preprint. arXiv:2009.09031","DOI":"10.1609\/aaai.v35i13.17431"},{"issue":"2","key":"9692_CR27","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1089\/big.2016.0047","volume":"5","author":"A Chouldechova","year":"2017","unstructured":"Chouldechova, A. (2017). Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big Data, 5(2), 153\u2013163.","journal-title":"Big Data"},{"key":"9692_CR28","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1016\/j.ijar.2021.06.003","volume":"136","author":"FG Cozman","year":"2021","unstructured":"Cozman, F. G., & Munhoz, H. N. (2021). Some thoughts on knowledge-enhanced machine learning. International Journal of Approximate Reasoning, 136, 308\u2013324.","journal-title":"International Journal of Approximate Reasoning"},{"key":"9692_CR29","doi-asserted-by":"publisher","DOI":"10.12987\/9780300252392","volume-title":"The atlas of AI","author":"K Crawford","year":"2021","unstructured":"Crawford, K. (2021a). The atlas of AI. Yale University Press."},{"issue":"3327","key":"9692_CR30","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/S0262-4079(21)00524-8","volume":"249","author":"K Crawford","year":"2021","unstructured":"Crawford, K. (2021b). The hidden costs of AI. New Scientist, 249(3327), 46\u201349.","journal-title":"New Scientist"},{"key":"9692_CR31","unstructured":"Creager, E., Madras, D., Pitassi, T., & Zemel, R. (2020). Causal modeling for fairness in dynamical systems. In International conference on machine learning, 2020 (pp. 2185\u20132195). PMLR."},{"key":"9692_CR32","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4066781","author":"R Crootof","year":"2022","unstructured":"Crootof, R., Kaminski, M. E., & Price, W. N., II. (2022). Humans in the loop. Vanderbilt Law Review. https:\/\/doi.org\/10.2139\/ssrn.4066781.","journal-title":"Vanderbilt Law Review"},{"key":"9692_CR33","unstructured":"Darwiche, A. (2002a). A logical approach to factoring belief networks. In Proceedings of the 8th international conference on principles of knowledge representation and reasoning, 2002 (pp. 409\u2013420)."},{"key":"9692_CR34","unstructured":"Darwiche, A. (2022b). Causal inference using tractable circuits. arXiv preprint. arXiv:2202.02891"},{"key":"9692_CR35","unstructured":"Darwiche, A., Marques-Silva, J., & Marquis, P. (2016). Preface: The beyond NP workshop. In Beyond NP, papers from the 2016 AAAI workshop, Phoenix, Arizona, USA, February 12, 2016."},{"key":"9692_CR36","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1613\/jair.1.12756","volume":"72","author":"A Darwiche","year":"2021","unstructured":"Darwiche, A., & Marquis, P. (2021). On quantifying literals in Boolean logic and its applications to explainable AI. Journal of Artificial Intelligence Research, 72, 285\u2013328.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9692_CR37","unstructured":"Darwiche, A., Marquis, P., Suciu, D., & Szeider, S. (2018). Recent trends in knowledge compilation (Dagstuhl seminar 17381). In Dagstuhl reports (Vol. 7). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik"},{"key":"9692_CR38","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0211-3","volume-title":"Neural-symbolic learning systems: Foundations and applications","author":"AS d\u2019Avila Garcez","year":"2002","unstructured":"d\u2019Avila Garcez, A. S., Broda, K., Gabbay, D. M., et al. (2002). Neural-symbolic learning systems: Foundations and applications. Springer."},{"key":"9692_CR39","doi-asserted-by":"crossref","unstructured":"De Raedt, L., & Kersting, K. (2011). Statistical relational learning. In Encyclopedia of machine learning (pp. 916\u2013924). Springer.","DOI":"10.1007\/978-0-387-30164-8_786"},{"issue":"2","key":"9692_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-031-01574-8","volume":"10","author":"L De Raedt","year":"2016","unstructured":"De Raedt, L., Kersting, K., Natarajan, S., & Poole, D. (2016). Statistical relational artificial intelligence: Logic, probability, and computation. Synthesis Lectures on Artificial Intelligence and Machine Learning, 10(2), 1\u2013189.","journal-title":"Synthesis Lectures on Artificial Intelligence and Machine Learning"},{"key":"9692_CR41","unstructured":"De Raedt, L., Kimmig, A., & Toivonen, H. (2007). ProbLog: A probabilistic prolog and its application in link discovery. In Proceedings of IJCAI, 2007 (pp. 2462\u20132467)."},{"key":"9692_CR42","unstructured":"Dieterich, W., Mendoza, C., & Brennan, T. (2016). COMPAS risk scales: Demonstrating accuracy equity and predictive parity. Technical Report. Northpointe."},{"key":"9692_CR43","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30371-6","volume-title":"Responsible artificial intelligence: How to develop and use AI in a responsible way","author":"V Dignum","year":"2019","unstructured":"Dignum, V. (2019). Responsible artificial intelligence: How to develop and use AI in a responsible way. Springer."},{"key":"9692_CR44","doi-asserted-by":"crossref","unstructured":"Doshi-Velez, F., Kortz, M., Budish, R., Bavitz, C., Gershman, S., O\u2019Brien, D., Scott, K., Schieber, S., Waldo, J., Weinberger, D., et al. (2017). Accountability of AI under the law: The role of explanation. arXiv preprint. arXiv:1711.01134","DOI":"10.2139\/ssrn.3064761"},{"key":"9692_CR45","unstructured":"Du, X., Legastelois, B., Ganesh, B., Rajan, A., Chockler, H., Belle, V. Anderson, S., & Ramamoorthy, S. (2022). Vision checklist: Towards testable error analysis of image models to help system designers interrogate model capabilities. arXiv preprint. arXiv:2201.11674"},{"key":"9692_CR46","doi-asserted-by":"crossref","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2011). Fairness through awareness. In Innovations in theoretical computer science conference, 2011.","DOI":"10.1145\/2090236.2090255"},{"key":"9692_CR47","unstructured":"Ermon, S., Gomes, C. P., Sabharwal, A., & Selman, B. (2013). Embed and project: Discrete sampling with universal hashing. In NIPS, 2013 (pp. 2085\u20132093)."},{"issue":"4","key":"9692_CR48","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1007\/s10892-017-9252-2","volume":"21","author":"A Etzioni","year":"2017","unstructured":"Etzioni, A., & Etzioni, O. (2017). Incorporating ethics into artificial intelligence. The Journal of Ethics, 21(4), 403\u2013418.","journal-title":"The Journal of Ethics"},{"key":"9692_CR49","volume-title":"Reasoning about knowledge","author":"R Fagin","year":"2003","unstructured":"Fagin, R., Moses, Y., Halpern, J. Y., & Vardi, M. Y. (2003). Reasoning about knowledge. MIT Press."},{"key":"9692_CR50","doi-asserted-by":"crossref","unstructured":"Farnadi, G., Babaki, B., & Getoor, L. (2018). Fairness in relational domains. In Proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society, 2018 (pp. 108\u2013114).","DOI":"10.1145\/3278721.3278733"},{"key":"9692_CR51","unstructured":"Fierens, D., Van den Broeck, G., Thon, I., Gutmann, B., & De Raedt, L. (2011a). Inference in probabilistic logic programs using weighted CNF\u2019s. In UAI, 2011 (pp. 211\u2013220)."},{"key":"9692_CR52","unstructured":"Fierens, D., Van den Broeck, G., Thon, I., Gutmann, B., & De Raedt, L. (2011b). Inference in probabilistic logic programs using weighted CNF\u2019s. In Proceedings of UAI, 2011 (pp. 211\u2013220)."},{"key":"9692_CR53","unstructured":"Flores, A. W., Lowenkamp, C., & Bechtel, K. (2016). False positives, false negatives, and false analyses: A rejoinder to \u201cmachine bias: There\u2019s software used across the country to predict future criminals. And it\u2019s biased against blacks\u201d. Federal Probation, 80(2)."},{"key":"9692_CR54","unstructured":"Friedler, S. A., Scheidegger, C., & Venkatasubramanian, S. (2016). On the (IM) possibility of fairness. arXiv preprint. arXiv:1609.07236."},{"issue":"3","key":"9692_CR55","doi-asserted-by":"publisher","first-page":"334","DOI":"10.3390\/e22030334","volume":"22","author":"K Gajowniczek","year":"2020","unstructured":"Gajowniczek, K., Liang, Y., Friedman, T., Zabkowski, T., & Van den Broeck, G. (2020). Semantic and generalized entropy loss functions for semi-supervised deep learning. Entropy, 22(3), 334.","journal-title":"Entropy"},{"key":"9692_CR56","doi-asserted-by":"crossref","unstructured":"Galindez Olascoaga, L. I., Meert, W., & Verhelst, M. (2021). Hardware-aware probabilistic circuits. In Hardware-aware probabilistic machine learning models (pp. 81\u2013110). Springer.","DOI":"10.1007\/978-3-030-74042-9_5"},{"key":"9692_CR57","unstructured":"Gens, R., & Domingos, P. (2013). Learning the structure of sum\u2013product networks. In International conference on machine learning, 2013."},{"key":"9692_CR58","doi-asserted-by":"crossref","unstructured":"Georgeff, M., Pell, B., Pollack, M., Tambe, M., & Wooldridge, M. (1998). The belief\u2013desire\u2013intention model of agency. In International workshop on agent theories, architectures, and languages, 1998 (pp. 1\u201310). Springer.","DOI":"10.1007\/3-540-49057-4_1"},{"key":"9692_CR59","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7432.001.0001","volume-title":"Introduction to statistical relational learning (adaptive computation and machine learning)","author":"L Getoor","year":"2007","unstructured":"Getoor, L., & Taskar, B. (2007). Introduction to statistical relational learning (adaptive computation and machine learning). MIT Press."},{"key":"9692_CR60","doi-asserted-by":"crossref","unstructured":"Ghaderi, H., Levesque, H., & Lesp\u00e9rance, Y. (2007). Towards a logical theory of coordination and joint ability. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, 2007 (pp. 1\u20133).","DOI":"10.1145\/1329125.1329223"},{"key":"9692_CR61","unstructured":"Gomes, C. P., Sabharwal, A., & Selman, B. (2009). Model counting. In Handbook of satisfiability. IOS Press."},{"key":"9692_CR62","unstructured":"Gunning, D. (2016a). Explainable artificial intelligence (XAI). Technical Report, DARPA\/I20."},{"key":"9692_CR63","unstructured":"Gunning, D. (2016b). Explainable artificial intelligence (XAI)\u2014DARPA-BAA-16-53. Defense Advanced Research Projects Agency."},{"key":"9692_CR64","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10809.001.0001","volume-title":"Actual causality","author":"JY Halpern","year":"2016","unstructured":"Halpern, J. Y. (2016). Actual causality. MIT Press."},{"key":"9692_CR65","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10951.001.0001","volume-title":"Reasoning about uncertainty","author":"JY Halpern","year":"2017","unstructured":"Halpern, J. Y. (2017). Reasoning about uncertainty. MIT Press."},{"key":"9692_CR66","doi-asserted-by":"crossref","unstructured":"Halpern, J. Y., & Kleiman-Weiner, M. (2018). Towards formal definitions of blameworthiness, intention, and moral responsibility. In Proceedings of the 32nd AAAI conference on artificial intelligence, 2018 (pp. 1853\u20131860).","DOI":"10.1609\/aaai.v32i1.11557"},{"issue":"4","key":"9692_CR67","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1093\/bjps\/axi147","volume":"56","author":"JY Halpern","year":"2005","unstructured":"Halpern, J. Y., & Pearl, J. (2005). Causes and explanations: A structural-model approach. Part I: Causes. The British Journal for the Philosophy of Science, 56(4), 843\u2013887.","journal-title":"The British Journal for the Philosophy of Science"},{"issue":"2","key":"9692_CR68","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1007\/s10618-020-00726-4","volume":"35","author":"L Hammond","year":"2021","unstructured":"Hammond, L., & Belle, V. (2021). Learning tractable probabilistic models for moral responsibility and blame. Data Mining and Knowledge Discovery, 35(2), 621\u2013659.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"9692_CR69","unstructured":"Hardt, M., Price, E., & Srebro, N. (2016). Equality of opportunity in supervised learning. In International conference on neural information processing systems, 2016."},{"key":"9692_CR70","doi-asserted-by":"crossref","unstructured":"Hitzler, P. (2022). Neuro-symbolic artificial intelligence: The state of the art. IOS Press.","DOI":"10.3233\/FAIA342"},{"key":"9692_CR71","doi-asserted-by":"crossref","unstructured":"Hoernle, N., Karampatsis, R. M., Belle, V., & Gal, K. (2022). MultiplexNet: Towards fully satisfied logical constraints in neural networks. In Proceedings of the AAAI conference on artificial intelligence, 2022 (Vol. 36, pp. 5700\u20135709).","DOI":"10.1609\/aaai.v36i5.20512"},{"key":"9692_CR72","doi-asserted-by":"crossref","unstructured":"Huang, Y., Holtzen, S., Millstein, T., Van den Broeck, G., & Martonosi, M. (2021). Logical abstractions for noisy variational quantum algorithm simulation. In Proceedings of the 26th ACM international conference on architectural support for programming languages and operating systems, 2021 (pp. 456\u2013472).","DOI":"10.1145\/3445814.3446750"},{"key":"9692_CR73","doi-asserted-by":"crossref","unstructured":"Hurtado, J. V., Londo\u00f1o, L., & Valada, A. (2021). From learning to relearning: A framework for diminishing bias in social robot navigation. arXiv preprint. arXiv:2101.02647","DOI":"10.3389\/frobt.2021.650325"},{"issue":"3","key":"9692_CR74","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2307\/3033790","volume":"46","author":"G Jasso","year":"1983","unstructured":"Jasso, G. (1983). Fairness of individual rewards and fairness of the reward distribution: Specifying the inconsistency between the micro and macro principles of justice. Social Psychology Quarterly, 46(3), 185\u2013199.","journal-title":"Social Psychology Quarterly"},{"issue":"03","key":"9692_CR75","first-page":"289","volume":"2","author":"NR Jennings","year":"1993","unstructured":"Jennings, N. R. (1993). Specification and implementation of a belief\u2013desire\u2013joint\u2013intention architecture for collaborative problem solving. International Journal of Intelligent and Cooperative Information Systems, 2(03), 289\u2013318.","journal-title":"International Journal of Intelligent and Cooperative Information Systems"},{"key":"9692_CR76","unstructured":"Juba, B. (2013). Implicit learning of common sense for reasoning. In Twenty-third international joint conference on artificial intelligence, 2013."},{"issue":"1\u20132","key":"9692_CR77","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/S0004-3702(98)00023-X","volume":"101","author":"LP Kaelbling","year":"1998","unstructured":"Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1\u20132), 99\u2013134.","journal-title":"Artificial Intelligence"},{"issue":"9\u201310","key":"9692_CR78","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1177\/0278364913484072","volume":"32","author":"LP Kaelbling","year":"2013","unstructured":"Kaelbling, L. P., & Lozano-P\u00e9rez, T. (2013). Integrated task and motion planning in belief space. I. Journal of Robotic Research, 32(9\u201310), 1194\u20131227.","journal-title":"Journal of Robotic Research"},{"issue":"3","key":"9692_CR79","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1609\/aimag.v41i3.5257","volume":"41","author":"S Kambhampati","year":"2020","unstructured":"Kambhampati, S. (2020). Challenges of human-aware AI systems. AI Magazine, 41(3), 3\u201317.","journal-title":"AI Magazine"},{"key":"9692_CR80","doi-asserted-by":"crossref","unstructured":"Kamishima, T., Akaho, S., & Sakuma, J. (2011). Fairness-aware learning through regularization approach. In Conference on data mining, 2011.","DOI":"10.1109\/ICDMW.2011.83"},{"key":"9692_CR81","unstructured":"Kautz, H., & Selman, B. (1992). Planning as satisfiability. In ECAI \u201992: Proceedings of the 10th European conference on Artificial intelligence, 1992 (pp. 359\u2013363). Wiley."},{"issue":"11","key":"9692_CR82","doi-asserted-by":"publisher","first-page":"2767","DOI":"10.1016\/j.jbankfin.2010.06.001","volume":"34","author":"A Khandani","year":"2010","unstructured":"Khandani, A., Kim, J., & Lo, A. (2010). Consumer credit-risk models via machine-learning algorithms. Journal of Banking and Finance, 34(11), 2767\u20132787.","journal-title":"Journal of Banking and Finance"},{"key":"9692_CR83","doi-asserted-by":"crossref","unstructured":"Kim, R., Kleiman-Weiner, M., Abeliuk, A., Awad, E., Dsouza, S., Tenenbaum, J. B., & Rahwan, I. (2018). A computational model of commonsense moral decision making. In Proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society, 2018 (pp. 197\u2013203).","DOI":"10.1145\/3278721.3278770"},{"key":"9692_CR84","unstructured":"Kisa, D., Van den Broeck, G., Choi, A., & Darwiche, A. (2014). Probabilistic sentential decision diagrams. In Proceedings of the 14th international conference on principles of knowledge representation and reasoning, 2014 (pp. 558\u2013567)."},{"key":"9692_CR85","unstructured":"Kuppler, M., Kern, C., Bach, R. L., & Kreuter, F. (2021). Distributive justice and fairness metrics in automated decision-making: How much overlap is there? arXiv preprint. arXiv:2105.01441"},{"key":"9692_CR86","unstructured":"Kusner, M., Loftus, J., Russel, C., & Silva, R. (2017). Counterfactual fairness. In Neural information processing systems, 2017."},{"key":"9692_CR87","doi-asserted-by":"crossref","unstructured":"Lakemeyer, G., & Levesque, H. J. (2007). Cognitive robotics. In Handbook of knowledge representation (pp. 869\u2013886). Elsevier.","DOI":"10.1016\/S1574-6526(07)03023-4"},{"key":"9692_CR88","doi-asserted-by":"publisher","first-page":"106520","DOI":"10.1016\/j.chb.2020.106520","volume":"113","author":"X Leo","year":"2020","unstructured":"Leo, X., & Huh, Y. E. (2020). Who gets the blame for service failures? Attribution of responsibility toward robot versus human service providers and service firms. Computers in Human Behavior, 113, 106520.","journal-title":"Computers in Human Behavior"},{"issue":"2","key":"9692_CR89","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1080\/1047840X.2014.877340","volume":"25","author":"BF Malle","year":"2014","unstructured":"Malle, B. F., Guglielmo, S., & Monroe, A. E. (2014). A theory of blame. Psychological Inquiry, 25(2), 147\u2013186.","journal-title":"Psychological Inquiry"},{"key":"9692_CR90","doi-asserted-by":"crossref","unstructured":"Malle, B. F., & Scheutz, M. (2018). Learning how to behave: Moral competence for social robots. In: Handbuch Maschinenethik (pp. 1\u201324).","DOI":"10.1007\/978-3-658-17484-2_17-1"},{"key":"9692_CR91","unstructured":"Manhaeve, R., Dumancic, S., Kimmig, A., Demeester, T., & De Raedt, L. (2018). DeepProbLog: Neural probabilistic logic programming. Advances in neural information processing systems, 2018 (Vol. 31)."},{"key":"9692_CR92","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1613\/jair.3526","volume":"44","author":"W Mao","year":"2012","unstructured":"Mao, W., & Gratch, J. (2012). Modeling social causality and responsibility judgement in multi-agent interactions. Journal of Artificial Intelligence Research, 44, 223\u2013273.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9692_CR93","doi-asserted-by":"crossref","unstructured":"Melibari, M., Poupart, P., & Doshi, P. (2016). Sum\u2013product-max networks for tractable decision making. In IJCAI, 2016.","DOI":"10.1609\/aaai.v30i1.9957"},{"key":"9692_CR94","unstructured":"Mitchell, D. G., Selman, B., & Levesque, H. J. (1992). Hard and easy distributions of SAT problems. In Proceedings of AAAI, 1992 (pp. 459\u2013465)."},{"key":"9692_CR95","unstructured":"Mocanu, I. G., Belle, V., & Juba, B. (2020). Polynomial-time implicit learnability in SMT. In ECAI 2020, 2020 (pp. 1152\u20131158). IOS Press."},{"key":"9692_CR96","doi-asserted-by":"crossref","unstructured":"Mothilal, R. K., Sharma, A., & Tan, C. (2020). Explaining machine learning classifiers through diverse counterfactual explanations. In Proceedings of the 2020 conference on fairness, accountability, and transparency, 2020 (pp. 607\u2013617).","DOI":"10.1145\/3351095.3372850"},{"issue":"1","key":"9692_CR97","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s10994-011-5259-2","volume":"86","author":"S Muggleton","year":"2012","unstructured":"Muggleton, S., De Raedt, L., Poole, D., Bratko, I., Flach, P., Inoue, K., & Srinivasan, A. (2012). ILP turns 20. Machine Learning, 86(1), 3\u201323.","journal-title":"Machine Learning"},{"key":"9692_CR98","volume-title":"Machine learning: A probabilistic perspective","author":"K Murphy","year":"2012","unstructured":"Murphy, K. (2012). Machine learning: A probabilistic perspective. The MIT Press."},{"key":"9692_CR99","doi-asserted-by":"crossref","unstructured":"Naiseh, M., Bentley, C., & Ramchurn, S. (2022). Trustworthy autonomous systems (TAS): Engaging TAS experts in curriculum design. In 2022 IEEE global engineering education conference (EDUCON), 2022 (pp. 901\u2013905). IEEE.","DOI":"10.1109\/EDUCON52537.2022.9766663"},{"key":"9692_CR100","doi-asserted-by":"crossref","unstructured":"Naiseh, M., Bentley, C., Ramchurn, S., Williams, E., Awad, E., & Alix, C. (2022). Methods, tools and techniques for trustworthy autonomous systems (TAS) design and development. In Companion of the 2022 ACM SIGCHI symposium on engineering interactive computing systems, 2022 (pp. 66\u201369).","DOI":"10.1145\/3531706.3536459"},{"key":"9692_CR101","unstructured":"Nitti, D. (2016). Hybrid probabilistic logic programming. PhD Thesis, KU Leuven."},{"key":"9692_CR102","doi-asserted-by":"crossref","unstructured":"Pagnucco, M., Rajaratnam, D., Limarga, R., Nayak, A., & Song, Y. (2021). Epistemic reasoning for machine ethics with situation calculus. In Proceedings of the 2021 AAAI\/ACM conference on AI, ethics, and society, 2021 (pp. 814\u2013821).","DOI":"10.1145\/3461702.3462586"},{"key":"9692_CR103","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2021.644062","author":"I Papantonis","year":"2021","unstructured":"Papantonis, I., & Belle, V. (2021). Closed-form results for prior constraints in sum\u2013product networks. Frontiers in Artificial Intelligence. https:\/\/doi.org\/10.3389\/frai.2021.644062.","journal-title":"Frontiers in Artificial Intelligence"},{"key":"9692_CR104","unstructured":"Papantonis, I., & Belle, V. (2022). Principled diverse counterfactuals in multilinear models. arXiv preprint. arXiv:2201.06467"},{"key":"9692_CR105","doi-asserted-by":"crossref","unstructured":"Petrick, R. P. A., & Foster, M. (2013). Planning for social interaction in a robot bartender domain. In Proceedings of ICAPS, 2013, Rome, Italy (pp. 389\u2013397).","DOI":"10.1609\/icaps.v23i1.13589"},{"key":"9692_CR106","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4074.001.0001","volume-title":"Knowledge in action: Logical foundations for specifying and implementing dynamical systems","author":"R Reiter","year":"2001","unstructured":"Reiter, R. (2001). Knowledge in action: Logical foundations for specifying and implementing dynamical systems. MIT Press."},{"issue":"5","key":"9692_CR107","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206\u2013215.","journal-title":"Nature Machine Intelligence"},{"key":"9692_CR108","doi-asserted-by":"crossref","unstructured":"Salimi, B., Parikh, H., Kayali, M., Getoor, L., Roy, S.. & Suciu, D. (2020). Causal relational learning. In Proceedings of the 2020 ACM SIGMOD international conference on management of data, 2020 (pp. 241\u2013256).","DOI":"10.1145\/3318464.3389759"},{"key":"9692_CR109","unstructured":"Sanner, S. (2011). Relational dynamic influence diagram language (RDDL): Language description. Technical Report. Australian National University."},{"key":"9692_CR110","doi-asserted-by":"crossref","unstructured":"Sanner, S., & Kersting, K. (2010). Symbolic dynamic programming for first-order POMDPs. In Proceedings of AAAI, 2010 (pp. 1140\u20131146).","DOI":"10.1609\/aaai.v24i1.7747"},{"key":"9692_CR111","unstructured":"Sardina, S., De Giacomo, G., Lesp\u00e9rance, Y., & Levesque, H. J. (2006). On the limits of planning over belief states under strict uncertainty. In KR, 2006 (Vol. 6, pp. 463\u2013471)."},{"key":"9692_CR112","doi-asserted-by":"crossref","unstructured":"Saxena, N. A., Huang, K., DeFilippis, E., Radanovic, G., Parkes, D. C., & Liu, Y. (2019). How do fairness definitions fare? Examining public attitudes towards algorithmic definitions of fairness. In Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society, 2019 (pp. 99\u2013106).","DOI":"10.1145\/3306618.3314248"},{"key":"9692_CR113","doi-asserted-by":"crossref","unstructured":"Smart, A., James, L., Hutchinson, B., Wu, S., & Vallor, S. (2020). Why reliabilism is not enough. In Proceedings of the AAAI\/ACM conference on AI, ethics, and society, 2020.","DOI":"10.1145\/3375627.3375866"},{"key":"9692_CR114","doi-asserted-by":"publisher","first-page":"75","DOI":"10.3389\/frai.2022.806262","volume":"5","author":"GB Smith","year":"2022","unstructured":"Smith, G. B., Belle, V., & Petrick, R. (2022). Intention recognition with ProbLog. Frontiers in Artificial Intelligence, 5, 75.","journal-title":"Frontiers in Artificial Intelligence"},{"issue":"1","key":"9692_CR115","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1177\/0306312717741687","volume":"48","author":"J Stilgoe","year":"2018","unstructured":"Stilgoe, J. (2018). Machine learning, social learning and the governance of self-driving cars. Social Studies of Science, 48(1), 25\u201356.","journal-title":"Social Studies of Science"},{"issue":"6","key":"9692_CR116","doi-asserted-by":"publisher","first-page":"1395","DOI":"10.2307\/796133","volume":"94","author":"JJ Thomson","year":"1985","unstructured":"Thomson, J. J. (1985). The trolley problem. The Yale Law Journal, 94(6), 1395\u20131415.","journal-title":"The Yale Law Journal"},{"issue":"6","key":"9692_CR117","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3419633","volume":"53","author":"S Tolmeijer","year":"2020","unstructured":"Tolmeijer, S., Kneer, M., Sarasua, C., Christen, M., & Bernstein, A. (2020). Implementations in machine ethics: A survey. ACM Computing Surveys, 53(6), 1\u201338.","journal-title":"ACM Computing Surveys"},{"key":"9692_CR118","doi-asserted-by":"crossref","unstructured":"Tran, S. D., & Davis, L. S. (2008). Event modeling and recognition using Markov logic networks. In Proceedings of ECCV, 2008 (pp. 610\u2013623).","DOI":"10.1007\/978-3-540-88688-4_45"},{"key":"9692_CR119","doi-asserted-by":"crossref","unstructured":"Treiber, A., Molina, A., Weinert, C., Schneider, T., & Kersting, K. (2020). CryptoSPN: Privacy-preserving sum\u2013product network inference. arXiv preprint. arXiv:2002.00801","DOI":"10.1145\/3411501.3419417"},{"key":"9692_CR120","unstructured":"Van den Broeck, G. (2011). On the completeness of first-order knowledge compilation for lifted probabilistic inference. In NIPS, 2011 (pp. 1386\u20131394)."},{"key":"9692_CR121","doi-asserted-by":"crossref","unstructured":"Van den Broeck, G., Thon, I., van Otterlo, M., & De Raedt, L (2010). DTProbLog: A decision-theoretic probabilistic prolog. In Proceedings of the twenty-fourth AAAI conference on artificial intelligence, AAAI\u201910, 2010 (pp. 1217\u20131222). AAAI Press.","DOI":"10.1609\/aaai.v24i1.7755"},{"key":"9692_CR122","doi-asserted-by":"publisher","first-page":"106715","DOI":"10.1016\/j.knosys.2020.106715","volume":"215","author":"M Varley","year":"2021","unstructured":"Varley, M., & Belle, V. (2021). Fairness in machine learning with tractable models. Knowledge-Based Systems, 215, 106715.","journal-title":"Knowledge-Based Systems"},{"key":"9692_CR123","doi-asserted-by":"crossref","unstructured":"Vennekens, J., Bruynooghe, M., & Denecker, M. (2010). Embracing events in causal modelling: Interventions and counterfactuals in CP-logic. In European workshop on logics in artificial intelligence, 2010 (pp. 313\u2013325). Springer.","DOI":"10.1007\/978-3-642-15675-5_27"},{"key":"9692_CR124","doi-asserted-by":"crossref","unstructured":"Verma, S., & Rubin, J. (2018). Fairness definitions explained. In 2018 IEEE\/ACM international workshop on software fairness (FairWare), 2018 (pp. 1\u20137). IEEE.","DOI":"10.1145\/3194770.3194776"},{"key":"9692_CR125","first-page":"841","volume":"31","author":"S Wachter","year":"2017","unstructured":"Wachter, S., Mittelstadt, B., & Russell, C. (2017). Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard Journal of Law and Technology, 31, 841.","journal-title":"Harvard Journal of Law and Technology"},{"key":"9692_CR126","doi-asserted-by":"crossref","unstructured":"Wang, K., & Zhang, Y. (2005). Nested epistemic logic programs. In International conference on logic programming and nonmonotonic reasoning, 2005 (pp. 279\u2013290). Springer.","DOI":"10.1007\/11546207_22"},{"key":"9692_CR127","doi-asserted-by":"crossref","unstructured":"Weller, A. (2019). Transparency: motivations and challenges. In Explainable AI: Interpreting, explaining and visualizing deep learning (pp. 23\u201340). Springer.","DOI":"10.1007\/978-3-030-28954-6_2"},{"key":"9692_CR128","doi-asserted-by":"crossref","unstructured":"Williams, M.-A. (2012). Robot social intelligence. In ICSR, 2012 (pp. 45\u201355).","DOI":"10.1007\/978-3-642-34103-8_5"},{"key":"9692_CR129","unstructured":"Xiang, A., & Raji, I. D. (2019). On the legal compatibility of fairness definitions. arXiv preprint. arXiv:1912.00761"},{"key":"9692_CR130","doi-asserted-by":"crossref","unstructured":"Zafar, M. B., Valera, I., Rodriguez, M. G., & Gummadi, K. P. (2017). Fairness beyond disparate treatment and disparate impact: Learning classification without disparate mistreatment. In International conference on World Wide Web, 2017.","DOI":"10.1145\/3038912.3052660"},{"key":"9692_CR131","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1613\/jair.1.11345","volume":"64","author":"FM Zanzotto","year":"2019","unstructured":"Zanzotto, F. M. (2019). Human-in-the-loop artificial intelligence. Journal of Artificial Intelligence Research, 64, 243\u2013252.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9692_CR132","unstructured":"Ze\u010devi\u0107, M., Dhami, D., Karanam, A., Natarajan, S., & Kersting, K. (2021). Interventional sum\u2013product networks: Causal inference with tractable probabilistic models. Advances in neural information processing systems, 2021 (Vol. 34)."}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09692-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-023-09692-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09692-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T07:23:38Z","timestamp":1679988218000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-023-09692-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3]]},"references-count":132,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["9692"],"URL":"https:\/\/doi.org\/10.1007\/s10676-023-09692-z","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3]]},"assertion":[{"value":"11 March 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"22"}}