{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:23:12Z","timestamp":1776082992518,"version":"3.50.1"},"reference-count":141,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Interreg North Sea","award":["STORM_SAFE"],"award-info":[{"award-number":["STORM_SAFE"]}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["389792660"],"award-info":[{"award-number":["389792660"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001663","name":"Volkswagen Foundation","doi-asserted-by":"publisher","award":["AZ 98514"],"award-info":[{"award-number":["AZ 98514"]}],"id":[{"id":"10.13039\/501100001663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001663","name":"Volkswagen Foundation","doi-asserted-by":"publisher","award":["AZ 98513"],"award-info":[{"award-number":["AZ 98513"]}],"id":[{"id":"10.13039\/501100001663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001663","name":"Volkswagen Foundation","doi-asserted-by":"publisher","award":["Volkswagen Foundation"],"award-info":[{"award-number":["Volkswagen Foundation"]}],"id":[{"id":"10.13039\/501100001663","id-type":"DOI","asserted-by":"publisher"}]},{"name":"European Regional Development Fund (ERDF) and the Saarland","award":["CERTAIN"],"award-info":[{"award-number":["CERTAIN"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Form Methods Syst Des"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This article introduces a framework that is meant to assist in mitigating societal risks that software can pose. Concretely, this encompasses facets of software doping as well as unfairness and discrimination in high-risk decision-making systems. The term <jats:italic>software doping<\/jats:italic> refers to software that contains surreptitiously added functionality that is against the interest of the user. A prominent example of software doping are the tampered emission cleaning systems that were found in millions of cars around the world when the diesel emissions scandal surfaced. The first part of this article combines the formal foundations of software doping analysis with established probabilistic falsification techniques to arrive at a black-box analysis technique for identifying undesired effects of software. We apply this technique to emission cleaning systems in diesel cars but also to high-risk systems that evaluate humans in a possibly unfair or discriminating way. We demonstrate how our approach can assist humans-in-the-loop to make better informed and more responsible decisions. This is to promote effective human oversight, which will be a central requirement enforced by the European Union\u2019s upcoming AI Act. We complement our technical contribution with a juridically, philosophically, and psychologically informed perspective on the potential problems caused by such systems.<\/jats:p>","DOI":"10.1007\/s10703-024-00445-2","type":"journal-article","created":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T16:01:59Z","timestamp":1712246519000},"page":"49-98","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Software doping analysis for human oversight"],"prefix":"10.1007","volume":"66","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6897-2506","authenticated-orcid":false,"given":"Sebastian","family":"Biewer","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6893-573X","authenticated-orcid":false,"given":"Kevin","family":"Baum","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Sterz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Holger","family":"Hermanns","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sven","family":"Hetmank","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"Langer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anne","family":"Lauber-R\u00f6nsberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Franz","family":"Lehr","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,4]]},"reference":[{"issue":"2","key":"445_CR1","doi-asserted-by":"publisher","first-page":"95:1","DOI":"10.1145\/2465787.2465797","volume":"12","author":"H Abbas","year":"2013","unstructured":"Abbas H, Fainekos GE, Sankaranarayanan S et al (2013) Probabilistic temporal logic falsification of cyber-physical systems. ACM Trans Embed Comput Syst 12(2):95:1-95:30. https:\/\/doi.org\/10.1145\/2465787.2465797","journal-title":"ACM Trans Embed Comput Syst"},{"issue":"3","key":"445_CR2","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1086\/226826","volume":"84","author":"WM Alves","year":"1978","unstructured":"Alves WM, Rossi PH (1978) Who should get what? fairness judgments of the distribution of earnings. Am J Sociol 84(3):541\u2013564","journal-title":"Am J Sociol"},{"key":"445_CR3","unstructured":"Angwin J, Larson J, Mattu S, et\u00a0al (2016) Machine bias. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing"},{"key":"445_CR4","doi-asserted-by":"publisher","unstructured":"Annapureddy YSR, Fainekos GE (2010) Ant colonies for temporal logic falsification of hybrid systems. In: IECON 2010\u201436th annual conference on IEEE industrial electronics society, pp 91\u201396, https:\/\/doi.org\/10.1109\/IECON.2010.5675195","DOI":"10.1109\/IECON.2010.5675195"},{"key":"445_CR5","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"AB Arrieta","year":"2020","unstructured":"Arrieta AB, D\u00edaz-Rodr\u00edguez N, Del Ser J et al (2020) Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fusion 58:82\u2013115","journal-title":"Inf Fusion"},{"key":"445_CR6","unstructured":"Artistotle (1998a) The nicomachean ethics. Oxford worlds classics, Oxford University Press, Oxford, translation by W.D. Ross. Edition by John L. Ackrill, and James O. Urmson"},{"key":"445_CR7","unstructured":"Artistotle (1998b) Politics. Oxford worlds classics, Oxford University Press, Oxford, translation by Ernest Barker. Edition by R. F. Stalley"},{"key":"445_CR8","first-page":"671","volume":"104","author":"S Barocas","year":"2016","unstructured":"Barocas S, Selbst AD (2016) Big data\u2019s disparate impact. Calif L Rev 104:671","journal-title":"Calif L Rev"},{"issue":"6","key":"445_CR9","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1017\/S0960129511000193","volume":"21","author":"G Barthe","year":"2011","unstructured":"Barthe G, D\u2019Argenio PR, Rezk T (2011) Secure information flow by self-composition. Math Struct Comput Sci 21(6):1207\u20131252. https:\/\/doi.org\/10.1017\/S0960129511000193","journal-title":"Math Struct Comput Sci"},{"key":"445_CR10","doi-asserted-by":"publisher","unstructured":"Barthe G, D\u2019Argenio PR, Finkbeiner B, et\u00a0al (2016) Facets of software doping. In: Margaria T, Steffen B (eds) Leveraging applications of formal methods, verification and validation: discussion, dissemination, applications\u20147th international symposium, ISoLA 2016, Imperial, Corfu, Greece, October 10-14, 2016, Proceedings, Part II, pp 601\u2013608, https:\/\/doi.org\/10.1007\/978-3-319-47169-3_46","DOI":"10.1007\/978-3-319-47169-3_46"},{"key":"445_CR11","first-page":"889","volume":"31","author":"Y Bathaee","year":"2017","unstructured":"Bathaee Y (2017) The artificial intelligence black box and the failure of intent and causation. Harvard J Law Tech 31:889","journal-title":"Harvard J Law Tech"},{"key":"445_CR12","doi-asserted-by":"crossref","unstructured":"Baum D, Baum K, Gros TP, et\u00a0al (2023) XAI requirements in smart production processes: a case study. In: World conference on explainable artificial intelligence. Springer, pp 3\u201324","DOI":"10.1007\/978-3-031-44064-9_1"},{"key":"445_CR13","doi-asserted-by":"publisher","unstructured":"Baum K (2016) What the hack is wrong with software doping? In: Margaria T, Steffen B (eds) Leveraging applications of formal methods, verification and validation: discussion, dissemination, applications\u20137th international symposium, ISoLA 2016, Imperial, Corfu, Greece, October 10-14, 2016, Proceedings, Part II, pp 633\u2013647, https:\/\/doi.org\/10.1007\/978-3-319-47169-3_49,","DOI":"10.1007\/978-3-319-47169-3_49"},{"issue":"1","key":"445_CR14","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1007\/s13347-022-00510-w","volume":"35","author":"K Baum","year":"2022","unstructured":"Baum K, Mantel S, Schmidt E et al (2022) From responsibility to reason-giving explainable artificial intelligence. Philos Tech 35(1):12. https:\/\/doi.org\/10.1007\/s13347-022-00510-w","journal-title":"Philos Tech"},{"key":"445_CR15","doi-asserted-by":"publisher","unstructured":"Biewer S (2023). Real driving emissions tests records. https:\/\/doi.org\/10.5281\/zenodo.8058770","DOI":"10.5281\/zenodo.8058770"},{"key":"445_CR16","doi-asserted-by":"publisher","unstructured":"Biewer S (2023b) Software doping\u2014theory and detection. Dissertation. https:\/\/doi.org\/10.22028\/D291-40364","DOI":"10.22028\/D291-40364"},{"key":"445_CR17","doi-asserted-by":"publisher","unstructured":"Biewer S, Hermanns H (2022) On the detection of doped software by falsification. In: Johnsen EB, Wimmer M (eds) Fundamental approaches to software engineering\u201425th international conference, FASE 2022, Held as Part of the European joint conferences on theory and practice of software, ETAPS 2022, Munich, Germany, April 2-7, 2022, Proceedings, Lecture Notes in Computer Science, vol 13241. Springer, pp 71\u201391, https:\/\/doi.org\/10.1007\/978-3-030-99429-7_4,","DOI":"10.1007\/978-3-030-99429-7_4"},{"key":"445_CR18","doi-asserted-by":"publisher","unstructured":"Biewer S, D\u2019Argenio PR, Hermanns H (2019) Doping tests for cyber-physical systems. In: Parker D, Wolf V (eds) Quantitative evaluation of systems, 16th international conference, QEST 2019, Glasgow, UK, September 10-12, 2019, proceedings, lecture notes in computer science, vol 11785. Springer, pp 313\u2013331, https:\/\/doi.org\/10.1007\/978-3-030-30281-8_18,","DOI":"10.1007\/978-3-030-30281-8_18"},{"issue":"3","key":"445_CR19","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1145\/3449354","volume":"31","author":"S Biewer","year":"2021","unstructured":"Biewer S, D\u2019Argenio PR, Hermanns H (2021) Doping tests for cyber-physical systems. ACM Trans Model Comput Simul 31(3):161\u20131627. https:\/\/doi.org\/10.1145\/3449354","journal-title":"ACM Trans Model Comput Simul"},{"key":"445_CR20","doi-asserted-by":"publisher","unstructured":"Biewer S, Finkbeiner B, Hermanns H, et\u00a0al (2021b) rtlola on board: testing real driving emissions on your phone. In: Groote JF, Larsen KG (eds) Tools and algorithms for the construction and analysis of systems\u201427th international conference, TACAS 2021, Held as Part of the European joint conferences on theory and practice of software, ETAPS 2021, Luxembourg City, Luxembourg, March 27 - April 1, 2021, Proceedings, Part II, Lecture Notes in Computer Science, vol 12652. Springer, pp 365\u2013372, https:\/\/doi.org\/10.1007\/978-3-030-72013-1_20","DOI":"10.1007\/978-3-030-72013-1_20"},{"key":"445_CR21","doi-asserted-by":"publisher","unstructured":"Biewer S, Dimitrova R, Fries M, et\u00a0al (2022) Conformance relations and hyperproperties for doping detection in time and space. Log Methods Comput Sci. https:\/\/doi.org\/10.46298\/lmcs-18(1:14)2022,","DOI":"10.46298\/lmcs-18(1:14)2022"},{"issue":"2","key":"445_CR22","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s10009-022-00689-5","volume":"25","author":"S Biewer","year":"2023","unstructured":"Biewer S, Finkbeiner B, Hermanns H et al (2023) On the road with rtlola. Int J Softw Tools Technol Transf 25(2):205\u2013218. https:\/\/doi.org\/10.1007\/s10009-022-00689-5","journal-title":"Int J Softw Tools Technol Transf"},{"key":"445_CR23","doi-asserted-by":"publisher","unstructured":"Binns R (2020) On the apparent conflict between individual and group fairness. In: Proceedings of the 2020 conference on fairness, accountability, and transparency. Association for computing machinery, New York, FAT* \u201920, pp 514\u2013524, https:\/\/doi.org\/10.1145\/3351095.3372864,","DOI":"10.1145\/3351095.3372864"},{"issue":"3\u20134","key":"445_CR24","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s00236-013-0191-5","volume":"51","author":"R Bloem","year":"2014","unstructured":"Bloem R, Chatterjee K, Greimel K et al (2014) Synthesizing robust systems. Acta Inf 51(3\u20134):193\u2013220. https:\/\/doi.org\/10.1007\/s00236-013-0191-5","journal-title":"Acta Inf"},{"issue":"10","key":"445_CR25","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.1080\/13642987.2020.1743976","volume":"24","author":"FJZ Borgesius","year":"2020","unstructured":"Borgesius FJZ (2020) Strengthening legal protection against discrimination by algorithms and artificial intelligence. Int J Human Rights 24(10):1572\u20131593. https:\/\/doi.org\/10.1080\/13642987.2020.1743976","journal-title":"Int J Human Rights"},{"key":"445_CR26","unstructured":"Buchner B (2020) DS-GVO Art. 1 Gegenstand und Ziele Rn. 14. In: Buchner JK (ed) Datenschutz-Grundverordnung, Bundesdatenschutzgesetz. C.H. Beck, Munich"},{"key":"445_CR27","unstructured":"Burke L (2020) The death and life of an admissions algorithm. https:\/\/www.insidehighered.com\/admissions\/article\/2020\/12\/14\/u-texas-will-stop-using-controversial-algorithm-evaluate-phd"},{"key":"445_CR28","doi-asserted-by":"publisher","unstructured":"Chazette L, Brunotte W, Speith T (2021) Exploring explainability: a definition, a model, and a knowledge catalogue. In: 2021 IEEE 29th international requirements engineering conference (RE), pp 197\u2013208, https:\/\/doi.org\/10.1109\/RE51729.2021.00025","DOI":"10.1109\/RE51729.2021.00025"},{"issue":"4","key":"445_CR29","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1080\/00031305.1995.10476177","volume":"49","author":"S Chib","year":"1995","unstructured":"Chib S, Greenberg E (1995) Understanding the metropolis-hastings algorithm. Am Stat 49(4):327\u2013335. https:\/\/doi.org\/10.1080\/00031305.1995.10476177","journal-title":"Am Stat"},{"issue":"2","key":"445_CR30","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1089\/big.2016.0047","volume":"5","author":"A Chouldechova","year":"2017","unstructured":"Chouldechova A (2017) Fair prediction with disparate impact: a study of bias in recidivism prediction instruments. Big Data 5(2):153\u2013163. https:\/\/doi.org\/10.1089\/big.2016.0047","journal-title":"Big Data"},{"key":"445_CR31","doi-asserted-by":"publisher","unstructured":"Clarkson MR, Finkbeiner B, Koleini M, et\u00a0al (2014) Temporal logics for hyperproperties. In: Principles of security and trust\u2014third international conference, POST 2014, Held as Part of the European joint conferences on theory and practice of software, ETAPS 2014, Grenoble, France, April 5-13, 2014, Proceedings, LNCS, vol 8414. Springer, pp 265\u2013284, https:\/\/doi.org\/10.1007\/978-3-642-54792-8_15","DOI":"10.1007\/978-3-642-54792-8_15"},{"key":"445_CR32","doi-asserted-by":"publisher","unstructured":"D\u2019Argenio PR, Barthe G, Biewer S, et\u00a0al (2017) Is your software on dope? - formal analysis of surreptitiously \u201cenhanced\u201d programs. In: Yang H (ed) Programming Languages and Systems - 26th European Symposium on Programming, ESOP 2017, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2017, Uppsala, Sweden, April 22-29, 2017, Proceedings, Lecture Notes in Computer Science, vol 10201. Springer, pp 83\u2013110, https:\/\/doi.org\/10.1007\/978-3-662-54434-1_4,","DOI":"10.1007\/978-3-662-54434-1_4"},{"key":"445_CR33","doi-asserted-by":"publisher","unstructured":"Donz\u00e9 A, Ferr\u00e8re T, Maler O (2013) Efficient robust monitoring for STL. In: Sharygina N, Veith H (eds) Computer aided verification\u2014proceedings of 25th international conference, CAV 2013, Saint Petersburg, Russia, July 13-19, 2013. Lecture Notes in Computer Science, vol 8044. Springer, pp 264\u2013279, https:\/\/doi.org\/10.1007\/978-3-642-39799-8_19","DOI":"10.1007\/978-3-642-39799-8_19"},{"key":"445_CR34","doi-asserted-by":"crossref","unstructured":"Dressel J, Farid H (2018) The accuracy, fairness, and limits of predicting recidivism. Sci Adv 4(1):eaao5580","DOI":"10.1126\/sciadv.aao5580"},{"key":"445_CR35","doi-asserted-by":"crossref","unstructured":"Dwork C, Hardt M, Pitassi T, et\u00a0al (2012) Fairness through awareness. In: Proceedings of the 3rd innovations in theoretical computer science conference, pp 214\u2013226","DOI":"10.1145\/2090236.2090255"},{"issue":"4","key":"445_CR36","first-page":"283","volume":"10","author":"R Dworkin","year":"1981","unstructured":"Dworkin R (1981) What is equality? Part 2: equality of resources. Philos Public Aff 10(4):283\u2013345","journal-title":"Philos Public Aff"},{"issue":"1","key":"445_CR37","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1518\/001872095779049543","volume":"37","author":"MR Endsley","year":"1995","unstructured":"Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Hum Factors 37(1):32\u201364. https:\/\/doi.org\/10.1518\/001872095779049543","journal-title":"Hum Factors"},{"issue":"1","key":"445_CR38","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1177\/0018720816681350","volume":"59","author":"MR Endsley","year":"2017","unstructured":"Endsley MR (2017) From here to autonomy: lessons learned from human-automation research. Hum Factors 59(1):5\u201327. https:\/\/doi.org\/10.1177\/0018720816681350","journal-title":"Hum Factors"},{"key":"445_CR39","unstructured":"European Commission (2011) Proposal for a regulation of the European parliament and of the council on the protection of individuals with regard to the processing of personal data and on the free movement of such data (general data protection regulation) \/* com\/2012\/011 final. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=celex%3A52012PC0011"},{"key":"445_CR40","unstructured":"European Commission (2021) Laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts (proposal for a regulation) no 0106\/2021. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206"},{"key":"445_CR41","unstructured":"European Commission (2023) Amendments adopted by the european parliament on 14 june 2023 on the proposal for a regulation of the european parliament and of the council on laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts. https:\/\/www.europarl.europa.eu\/doceo\/document\/TA-9-2023-0236_EN.html"},{"key":"445_CR42","unstructured":"European Court of Justice (1993) C-127\/92 - enderby ecli:eu:c:1993:859. https:\/\/curia.europa.eu\/juris\/liste.jsf?language=en &num=C-127\/92"},{"key":"445_CR43","unstructured":"European Court of Justice (1995) C-400\/93 - royal copenhagen ecli:eu:c:195:155. https:\/\/curia.europa.eu\/juris\/liste.jsf?language=en &num=C-400\/93"},{"key":"445_CR44","unstructured":"European Court of Justice (2014) C-356\/12 - glatzel ecli:eu:c:2014:350. https:\/\/curia.europa.eu\/juris\/liste.jsf?language=en &num=C-356\/12"},{"key":"445_CR45","unstructured":"European Court of Justice (2018) C-414\/16 - egenberger ecli:eu:c:2018:257. https:\/\/curia.europa.eu\/juris\/liste.jsf?language=en &num=C-414\/16"},{"key":"445_CR46","unstructured":"European Parliament (2020) European parliament resolution of 20 october 2020 with recommendations to the commission on a framework of ethical aspects of artificial intelligence, robotics and related technologies. https:\/\/www.europarl.europa.eu\/doceo\/document\/TA-9-2020-0275_EN.html"},{"key":"445_CR47","unstructured":"European Union (2016a) Charter of fundamental rights of the european union. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A12012P%2FTXT"},{"key":"445_CR48","unstructured":"European Union (2016b) Consolidated version of the treaty on the functioning of the european union. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A12016ME%2FTXT"},{"issue":"42","key":"445_CR49","doi-asserted-by":"publisher","first-page":"4262","DOI":"10.1016\/j.tcs.2009.06.021","volume":"410","author":"GE Fainekos","year":"2009","unstructured":"Fainekos GE, Pappas GJ (2009) Robustness of temporal logic specifications for continuous-time signals. Theor Comput Sci 410(42):4262\u20134291. https:\/\/doi.org\/10.1016\/j.tcs.2009.06.021","journal-title":"Theor Comput Sci"},{"issue":"2","key":"445_CR50","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/MTS.2021.3056293","volume":"40","author":"X Ferrer","year":"2021","unstructured":"Ferrer X, Tv N, Such JM et al (2021) Bias and discrimination in AI: a cross-disciplinary perspective. IEEE Technol Soc Mag 40(2):72\u201380. https:\/\/doi.org\/10.1109\/MTS.2021.3056293","journal-title":"IEEE Technol Soc Mag"},{"key":"445_CR51","doi-asserted-by":"publisher","unstructured":"Finkbeiner B, Rabe MN, S\u00e1nchez C (2015) Algorithms for model checking HyperLTL and HyperCTL$$^*$$. In: CAV 2015, LNCS, vol 9206. Springer, pp 30\u201348, https:\/\/doi.org\/10.1007\/978-3-319-21690-4_3","DOI":"10.1007\/978-3-319-21690-4_3"},{"issue":"4","key":"445_CR52","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1145\/3433949","volume":"64","author":"SA Friedler","year":"2021","unstructured":"Friedler SA, Scheidegger C, Venkatasubramanian S (2021) The (im)possibility of fairness: different value systems require different mechanisms for fair decision making. Commun ACM 64(4):136\u2013143. https:\/\/doi.org\/10.1145\/3433949","journal-title":"Commun ACM"},{"key":"445_CR53","doi-asserted-by":"publisher","unstructured":"Gazda M, Mousavi MR (2020) Logical characterisation of hybrid conformance. In: Czumaj A, Dawar A, Merelli E (eds) 47th international colloquium on automata, languages, and programming, ICALP 2020, July 8-11, 2020, Saarbr\u00fccken, Germany (Virtual Conference), LIPIcs, vol 168. Schloss Dagstuhl\u2014Leibniz-Zentrum f\u00fcr Informatik, pp 130:1\u2013130:18, https:\/\/doi.org\/10.4230\/LIPIcs.ICALP.2020.130,","DOI":"10.4230\/LIPIcs.ICALP.2020.130"},{"key":"445_CR54","unstructured":"Gunning D (2016) Explainable artificial intelligence (XAI) (darpa-baa-16-53). Tech. rep, Arlington, VA, USA"},{"key":"445_CR55","doi-asserted-by":"crossref","unstructured":"Guryan J, Charles KK (2013) taste-based or statistical discrimination: the economics of discrimination returns to its roots. Econ J 123(572):F417\u2013F432. http:\/\/www.jstor.org\/stable\/42919257","DOI":"10.1111\/ecoj.12080"},{"key":"445_CR56","doi-asserted-by":"crossref","unstructured":"Hacker P (2018) Teaching fairness to artificial intelligence: existing and novel strategies against algorithmic discrimination under EU law. Common Market Law Rev (55):1143\u20131186. https:\/\/ssrn.com\/abstract=3164973","DOI":"10.54648\/COLA2018095"},{"key":"445_CR57","unstructured":"Hartmann F (2006) Diskriminierung durch Antidiskriminierungsrecht? M\u00f6glichkeiten und Grenzen eines postkategorialen Diskriminierungsschutzes in der Europ\u00e4ischen Union. EuZA - Europ\u00e4ische Zeitschrift f\u00fcr Arbeitsrecht p\u00a024"},{"key":"445_CR58","unstructured":"Heaven WD (2020) Predictive policing algorithms are racist. They need to be dismantled. https:\/\/www.technologyreview.com\/2020\/07\/17\/1005396\/predictive-policing-algorithms-racist-dismantled-machine-learning-bias-criminal-justice\/"},{"key":"445_CR59","unstructured":"High-Level Expert Group on Artificial Intelligence (2019) Ethics Guidelines for Trustworthy AI. https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai"},{"issue":"1\u20132","key":"445_CR60","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1111\/1468-2389.00171","volume":"9","author":"LM Hough","year":"2001","unstructured":"Hough LM, Oswald FL, Ployhart RE (2001) Determinants, detection and amelioration of adverse impact in personnel selection procedures: issues, evidence and lessons learned. Int J Sel Assess 9(1\u20132):152\u2013194","journal-title":"Int J Sel Assess"},{"key":"445_CR61","unstructured":"Ilvento C (2019) Metric learning for individual fairness. arXiv:1906.00250"},{"key":"445_CR62","doi-asserted-by":"crossref","unstructured":"Jacovi A, Marasovi\u0107 A, Miller T, et\u00a0al (2021) Formalizing trust in artificial intelligence: prerequisites, causes and goals of human trust in AI. In: Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pp 624\u2013635","DOI":"10.1145\/3442188.3445923"},{"issue":"1","key":"445_CR63","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1177\/0038038586020001005","volume":"20","author":"N Jewson","year":"1986","unstructured":"Jewson N, Mason D (1986) Modes of discrimination in the recruitment process: formalisation, fairness and efficiency. Sociology 20(1):43\u201363","journal-title":"Sociology"},{"key":"445_CR64","unstructured":"John PG, Vijaykeerthy D, Saha D (2020) Verifying individual fairness in machine learning models. In: Adams RP, Gogate V (eds) Proceedings of the thirty-sixth conference on uncertainty in artificial intelligence, UAI 2020, virtual online, August 3-6, 2020, Proceedings of machine learning research, vol 124. AUAI Press, pp 749\u2013758, http:\/\/proceedings.mlr.press\/v124\/george-john20a.html"},{"key":"445_CR65","doi-asserted-by":"publisher","unstructured":"K\u00e4stner L, Langer M, Lazar V, et\u00a0al (2021) On the relation of trust and explainability: Why to engineer for trustworthiness. In: Yue T, Mirakhorli M (eds) 29th IEEE international requirements engineering conference workshops, RE 2021 workshops, Notre Dame, IN, USA, September 20-24, 2021. IEEE, pp 169\u2013175, https:\/\/doi.org\/10.1109\/REW53955.2021.00031,","DOI":"10.1109\/REW53955.2021.00031"},{"key":"445_CR66","unstructured":"Kim B, Khanna R, Koyejo O (2016) Examples are not enough, learn to criticize! criticism for interpretability. In: Proceedings of the 30th international conference on neural information processing systems. Curran Associates Inc., Red Hook, NIPS\u201916, pp 2288\u20132296"},{"key":"445_CR67","doi-asserted-by":"publisher","unstructured":"K\u00f6hl MA, Hermanns H, Biewer S (2018) Efficient monitoring of real driving emissions. In: Colombo C, Leucker M (eds) Runtime Verification\u2014Proceedings of 18th international conference, RV 2018, Limassol, Cyprus, November 10-13, 2018, Lecture Notes in Computer Science, vol 11237. Springer, pp 299\u2013315, https:\/\/doi.org\/10.1007\/978-3-030-03769-7_17","DOI":"10.1007\/978-3-030-03769-7_17"},{"key":"445_CR68","doi-asserted-by":"crossref","unstructured":"Lai V, Tan C (2019) On human predictions with explanations and predictions of machine learning models: a case study on deception detection. In: Proceedings of the conference on fairness, accountability, and transparency, pp 29\u201338","DOI":"10.1145\/3287560.3287590"},{"key":"445_CR69","doi-asserted-by":"publisher","unstructured":"Langer M, Baum K, Hartmann K, et\u00a0al (2021a) Explainability auditing for intelligent systems: a rationale for multi-disciplinary perspectives. In: Yue T, Mirakhorli M (eds) 29th IEEE international requirements engineering conference workshops, RE 2021 workshops, Notre Dame, IN, USA, September 20-24, 2021. IEEE, pp 164\u2013168, https:\/\/doi.org\/10.1109\/REW53955.2021.00030,","DOI":"10.1109\/REW53955.2021.00030"},{"issue":"103","key":"445_CR70","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1016\/j.artint.2021.103473","volume":"296","author":"M Langer","year":"2021","unstructured":"Langer M, Oster D, Speith T et al (2021) What do we want from explainable artificial intelligence (XAI)? A stakeholder perspective on XAI and a conceptual model guiding interdisciplinary XAI research. Artif Intell 296(103):473. https:\/\/doi.org\/10.1016\/j.artint.2021.103473","journal-title":"Artif Intell"},{"key":"445_CR71","doi-asserted-by":"publisher","unstructured":"Langer M, Baum K, Schlicker N (2023) A signal detection perspective on error and unfairness detection as a critical aspect of human oversight of ai-based systems https:\/\/doi.org\/10.31234\/osf.io\/ke256","DOI":"10.31234\/osf.io\/ke256"},{"key":"445_CR72","unstructured":"Larson J, Mattu S, Kirchner L, et\u00a0al (2016) How we analyzed the COMPAS recidivism algorithm. https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm"},{"issue":"1","key":"445_CR73","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","volume":"46","author":"JD Lee","year":"2004","unstructured":"Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46(1):50\u201380","journal-title":"Hum Factors"},{"key":"445_CR74","doi-asserted-by":"publisher","DOI":"10.3390\/e23010018","author":"P Linardatos","year":"2021","unstructured":"Linardatos P, Papastefanopoulos V, Kotsiantis S (2021) Explainable AI: a review of machine learning interpretability methods. Entropy. https:\/\/doi.org\/10.3390\/e23010018","journal-title":"Entropy"},{"key":"445_CR75","doi-asserted-by":"crossref","unstructured":"Looschelders D (2012) Diskriminierung und Schutz vor Diskriminierung im Privatrecht. JZ - JuristenZeitung p 105","DOI":"10.1628\/002268812799249173"},{"key":"445_CR76","doi-asserted-by":"publisher","unstructured":"Maler O, Nickovic D (2004) Monitoring temporal properties of continuous signals. In: Lakhnech Y, Yovine S (eds) Formal techniques, modelling and analysis of timed and fault-tolerant systems, joint international conferences on formal modelling and analysis of timed systems, FORMATS 2004 and Formal Techniques in Real-Time and Fault-Tolerant Systems, FTRTFT 2004, Grenoble, France, September 22-24, 2004, Proceedings, Lecture Notes in Computer Science, vol 3253. Springer, pp 152\u2013166, https:\/\/doi.org\/10.1007\/978-3-540-30206-3_12","DOI":"10.1007\/978-3-540-30206-3_12"},{"key":"445_CR77","doi-asserted-by":"publisher","unstructured":"Malgieri G (2020) What \u201cfairness\u201d means? A linguistic and contextual interpretation from the GDPR. In: FAT* \u201920: conference on fairness, accountability, and transparency, Barcelona, Spain, January 27-30, 2020. ACM, pp 154\u2013166, https:\/\/doi.org\/10.1145\/3351095.3372868,","DOI":"10.1145\/3351095.3372868"},{"key":"445_CR78","unstructured":"Mathews M (2023) Are you ready for software-defined everything? Wired, https:\/\/www.wired.com\/insights\/2013\/05\/are-you-ready-for-software-defined-everything\/, Accessed 23 June 2023"},{"issue":"3","key":"445_CR79","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1007\/s10676-004-3422-1","volume":"6","author":"A Matthias","year":"2004","unstructured":"Matthias A (2004) The responsibility gap: ascribing responsibility for the actions of learning automata. Ethics Inf Technol 6(3):175\u2013183. https:\/\/doi.org\/10.1007\/s10676-004-3422-1","journal-title":"Ethics Inf Technol"},{"issue":"2","key":"445_CR80","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s10676-019-09519-w","volume":"22","author":"G Mecacci","year":"2020","unstructured":"Mecacci G, de Sio FS (2020) Meaningful human control as reason-responsiveness: the case of dual-mode vehicles. Ethics Inf Technol 22(2):103\u2013115. https:\/\/doi.org\/10.1007\/s10676-019-09519-w","journal-title":"Ethics Inf Technol"},{"issue":"6","key":"445_CR81","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","volume":"54","author":"N Mehrabi","year":"2021","unstructured":"Mehrabi N, Morstatter F, Saxena N et al (2021) A survey on bias and fairness in machine learning. ACM Comput Surv 54(6):1\u201335","journal-title":"ACM Comput Surv"},{"key":"445_CR82","doi-asserted-by":"publisher","unstructured":"Meinke K, Sindhu MA (2011) Incremental learning-based testing for reactive systems. In: Gogolla M, Wolff B (eds) Tests and proofs\u2014proceedings of 5th international conference, TAP@TOOLS 2011, Zurich, Switzerland, June 30\u2013July 1, 2011. Lecture Notes in Computer Science, vol 6706. Springer, pp 134\u2013151, https:\/\/doi.org\/10.1007\/978-3-642-21768-5_11","DOI":"10.1007\/978-3-642-21768-5_11"},{"key":"445_CR83","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2021.737072","author":"L Methnani","year":"2021","unstructured":"Methnani L, Aler Tubella A, Dignum V et al (2021) Let me take over: variable autonomy for meaningful human control. Front Artific Intell. https:\/\/doi.org\/10.3389\/frai.2021.737072","journal-title":"Front Artific Intell"},{"key":"445_CR84","unstructured":"Meurrens S (2021) The increasing role of AI in visa processing. https:\/\/canadianimmigrant.ca\/immigrate\/immigration-law\/the-increasing-role-of-ai-in-visa-processing"},{"issue":"2","key":"445_CR85","doi-asserted-by":"publisher","first-page":"205395171667967","DOI":"10.1177\/2053951716679679","volume":"3","author":"BD Mittelstadt","year":"2016","unstructured":"Mittelstadt BD, Allo P, Taddeo M et al (2016) The ethics of algorithms: mapping the debate. Big Data Soc 3(2):2053951716679679. https:\/\/doi.org\/10.1177\/2053951716679679","journal-title":"Big Data Soc"},{"key":"445_CR86","doi-asserted-by":"publisher","unstructured":"Molnar C, Casalicchio G, Bischl B (2020) Interpretable machine learning\u2014a brief history, state-of-the-art and challenges. In: Koprinska I, Kamp M, Appice A, et\u00a0al (eds) ECML PKDD 2020 workshops\u2014workshops of the European conference on machine learning and knowledge discovery in databases (ECML PKDD 2020): SoGood 2020, PDFL 2020, MLCS 2020, NFMCP 2020, DINA 2020, EDML 2020, XKDD 2020 and INRA 2020, Ghent, Belgium, September 14-18, 2020, Proceedings, Communications in Computer and Information Science, vol 1323. Springer, pp 417\u2013431, https:\/\/doi.org\/10.1007\/978-3-030-65965-3_28,","DOI":"10.1007\/978-3-030-65965-3_28"},{"key":"445_CR87","unstructured":"Mukherjee D, Yurochkin M, Banerjee M, et\u00a0al (2020) Two simple ways to learn individual fairness metrics from data. In: III HD, Singh A (eds) Proceedings of the 37th international conference on machine learning, proceedings of machine learning research, vol 119. PMLR, pp 7097\u20137107, https:\/\/proceedings.mlr.press\/v119\/mukherjee20a.html"},{"key":"445_CR88","doi-asserted-by":"publisher","unstructured":"Nghiem T, Sankaranarayanan S, Fainekos GE, et\u00a0al (2010) Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems. In: Johansson KH, Yi W (eds) Proceedings of the 13th ACM international conference on hybrid systems: computation and control, HSCC 2010, Stockholm, Sweden, April 12-15, 2010. ACM, pp 211\u2013220, https:\/\/doi.org\/10.1145\/1755952.1755983","DOI":"10.1145\/1755952.1755983"},{"key":"445_CR89","doi-asserted-by":"publisher","unstructured":"Nguyen LV, Kapinski J, Jin X, et\u00a0al (2017) Hyperproperties of real-valued signals. In: Talpin J, Derler P, Schneider K (eds) Proceedings of the 15th ACM-IEEE international conference on formal methods and models for system design, MEMOCODE 2017, Vienna, Austria, September 29 - October 02, 2017. ACM, pp 104\u2013113, https:\/\/doi.org\/10.1145\/3127041.3127058","DOI":"10.1145\/3127041.3127058"},{"key":"445_CR90","unstructured":"Noorman M (2020) Computing and Moral Responsibility. In: Zalta EN (ed) The stanford encyclopedia of philosophy, Spring, 2020th edn. Stanford University, Metaphysics Research Lab"},{"issue":"3","key":"445_CR91","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1007\/s11257-017-9195-0","volume":"27","author":"I Nunes","year":"2017","unstructured":"Nunes I, Jannach D (2017) A systematic review and taxonomy of explanations in decision support and recommender systems. User Model User-Adap Inter 27(3):393\u2013444","journal-title":"User Model User-Adap Inter"},{"key":"445_CR92","unstructured":"O\u2019Neil C (2016a) How algorithms rule our working lives. https:\/\/www.theguardian.com\/science\/2016\/sep\/01\/how-algorithms-rule-our-working-lives, Accessed 23 June 2023"},{"key":"445_CR93","unstructured":"O\u2019Neil C (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. Crown Publishing Group, USA"},{"key":"445_CR94","unstructured":"Orcale (2019) AI in human resources: The time is now. https:\/\/www.oracle.com\/a\/ocom\/docs\/applications\/hcm\/oracle-ai-in-hr-wp.pdf"},{"key":"445_CR95","unstructured":"Organisation for Economic Co-operation and Development (OECD) (2021) Artificial intelligence, machine learning and big data in finance: opportunities, challenges and implications for policy makers. https:\/\/www.oecd.org\/finance\/financial-markets\/Artificial-intelligence-machine-learning-big-data-in-finance.pdf"},{"key":"445_CR96","doi-asserted-by":"publisher","DOI":"10.1145\/3494672","author":"D Pessach","year":"2022","unstructured":"Pessach D, Shmueli E (2022) A review on fairness in machine learning. ACM Comput Surv. https:\/\/doi.org\/10.1145\/3494672","journal-title":"ACM Comput Surv"},{"key":"445_CR97","doi-asserted-by":"publisher","unstructured":"Pnueli A (1977) The temporal logic of programs. In: 18th annual symposium on foundations of computer science, Providence, Rhode Island, USA, 31 October\u20131 November 1977. IEEE Computer Society, pp 46\u201357, https:\/\/doi.org\/10.1109\/SFCS.1977.32","DOI":"10.1109\/SFCS.1977.32"},{"key":"445_CR98","unstructured":"Rawls J (1985) Justice as fairness: Political not metaphysical. Philos Public Affairs 14(3):223\u2013251. http:\/\/www.jstor.org\/stable\/2265349"},{"key":"445_CR99","doi-asserted-by":"crossref","unstructured":"Rawls J (1999) A theory of justice: Revised edition. Harvard university press","DOI":"10.4159\/9780674042582"},{"key":"445_CR100","doi-asserted-by":"crossref","unstructured":"Rawls J (2001) Justice as fairness: a restatement. Harvard University Press","DOI":"10.2307\/j.ctv31xf5v0"},{"key":"445_CR101","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016a) Model-agnostic interpretability of machine learning. abs\/1606.05386. arxiv:1606.05386"},{"key":"445_CR102","doi-asserted-by":"publisher","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016b) \u201cWhy should I trust you?\u201d: Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. Association for computing machinery, New York, KDD \u201916, pp 1135\u20131144, https:\/\/doi.org\/10.1145\/2939672.2939778,","DOI":"10.1145\/2939672.2939778"},{"key":"445_CR103","unstructured":"Riesenhuber K (2021) BDSG \u00a726 Datenverarbeitung f\u00fcr Zwecke des Besch\u00e4ftigungsverh\u00e4ltnisses Rn. 79f. In: Wolff SBA (ed) BeckOK Datenschutzrecht. C.H. Beck, Munich"},{"key":"445_CR104","unstructured":"Rockafellar RT, Wets RJB (2009) Variational analysis, vol 317. Springer Science & Business Media"},{"key":"445_CR105","unstructured":"Rosen KH, Krithivasan K (2012) Discrete mathematics and its applications: with combinatorics and graph theory. Tata McGraw-Hill Education"},{"issue":"4","key":"445_CR106","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1093\/analys\/anab033","volume":"81","author":"T Rowe","year":"2022","unstructured":"Rowe T (2022) Can a risk of harm itself be a harm? Analysis 81(4):694\u2013701. https:\/\/doi.org\/10.1093\/analys\/anab033","journal-title":"Analysis"},{"key":"445_CR107","doi-asserted-by":"crossref","unstructured":"Rubinstein RY (1981) Simulation and the Monte Carlo method. Wiley series in probability and mathematical statistics, Wiley https:\/\/www.worldcat.org\/oclc\/07275104","DOI":"10.1002\/9780470316511"},{"key":"445_CR108","doi-asserted-by":"publisher","unstructured":"Sankaranarayanan S, Fainekos G (2012) Falsification of temporal properties of hybrid systems using the cross-entropy method. In: Dang T, Mitchell IM (eds) Hybrid systems: computation and control (part of CPS Week 2012), HSCC\u201912, Beijing, China, April 17-19, 2012. ACM, pp 125\u2013134, https:\/\/doi.org\/10.1145\/2185632.2185653,","DOI":"10.1145\/2185632.2185653"},{"key":"445_CR109","doi-asserted-by":"crossref","unstructured":"Sanneman L, Shah JA (2020) A situation awareness-based framework for design and evaluation of explainable AI. International workshop on explainable. Springer, Transparent Autonomous Agents and Multi-Agent Systems, pp 94\u2013110","DOI":"10.1007\/978-3-030-51924-7_6"},{"key":"445_CR110","first-page":"325","volume":"2021","author":"N Schlicker","year":"2021","unstructured":"Schlicker N, Langer M (2021) Towards warranted trust: a model on the relation between actual and perceived system trustworthiness. Mensch Comput 2021:325\u2013329","journal-title":"Mensch Comput"},{"issue":"106","key":"445_CR111","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1016\/j.chb.2021.106837","volume":"122","author":"N Schlicker","year":"2021","unstructured":"Schlicker N, Langer M, \u00d6tting SK et al (2021) What to expect from opening up black boxes? comparing perceptions of justice between human and automated agents. Comput Hum Behav 122(106):837. https:\/\/doi.org\/10.1016\/j.chb.2021.106837","journal-title":"Comput Hum Behav"},{"key":"445_CR112","doi-asserted-by":"publisher","unstructured":"Schlicker N, Uhde A, Baum K, et\u00a0al (2022) Calibrated trust as a result of accurate trustworthiness assessment\u2014introducing the trustworthiness assessment model. https:\/\/doi.org\/10.31234\/osf.io\/qhwvx","DOI":"10.31234\/osf.io\/qhwvx"},{"key":"445_CR113","doi-asserted-by":"crossref","unstructured":"Schwab D (2006) Schranken der Vertragsfreiheit durch die Antidiskriminierungsrichtlinien und ihre Umsetzung in Deutschland. DNotZ\u2014Deutsche Notar-Zeitschrift","DOI":"10.5771\/9783845201726-33"},{"key":"445_CR114","doi-asserted-by":"publisher","unstructured":"Santoni de Sio F, van den Hoven J (2018) Meaningful human control over autonomous systems: a philosophical account. Frontiers in Robotics and AI 5. https:\/\/doi.org\/10.3389\/frobt.2018.00015https:\/\/www.frontiersin.org\/article\/10.3389\/frobt.2018.00015","DOI":"10.3389\/frobt.2018.00015"},{"key":"445_CR115","unstructured":"Smith E, Vogell H (2021) How your shadow credit score could decide whether you get an apartment. https:\/\/www.propublica.org\/article\/how-your-shadow-credit-score-could-decide-whether-you-get-an-apartment, Accessed 23 June 2023"},{"key":"445_CR116","doi-asserted-by":"publisher","unstructured":"Speith T (2022) A review of taxonomies of explainable artificial intelligence (XAI) methods. In: 2022 ACM conference on fairness, accountability, and transparency. Association for computing machinery, New York, FAccT \u201922, pp 2239\u20132250, https:\/\/doi.org\/10.1145\/3531146.3534639,","DOI":"10.1145\/3531146.3534639"},{"key":"445_CR117","doi-asserted-by":"publisher","unstructured":"Sterz S, Baum K, Lauber-R\u00f6nsberg A, et\u00a0al (2021) Towards perspicuity requirements. In: Yue T, Mirakhorli M (eds) 29th IEEE international requirements engineering conference workshops, RE 2021 Workshops, Notre Dame, IN, USA, September 20-24, 2021. IEEE, pp 159\u2013163, https:\/\/doi.org\/10.1109\/REW53955.2021.00029,","DOI":"10.1109\/REW53955.2021.00029"},{"key":"445_CR118","doi-asserted-by":"publisher","unstructured":"Tabuada P, Balkan A, Caliskan SY, et\u00a0al (2012) Input-output robustness for discrete systems. In: Proceedings of the 12th International Conference on Embedded Software, EMSOFT 2012, part of the eighth embedded systems week, ESWeek 2012, Tampere, Finland, October 7-12, 2012. ACM, pp 217\u2013226, https:\/\/doi.org\/10.1145\/2380356.2380396","DOI":"10.1145\/2380356.2380396"},{"key":"445_CR119","unstructured":"Talbert M (2019) Moral responsibility. In: Zalta EN (ed) The stanford encyclopedia of philosophy, Winter, 2019th edn. Stanford University, Metaphysics Research Lab"},{"key":"445_CR120","doi-asserted-by":"publisher","DOI":"10.1177\/25152459211061337","author":"L Tay","year":"2022","unstructured":"Tay L, Woo SE, Hickman L et al (2022) A conceptual framework for investigating and mitigating machine-learning measurement bias (mlmb) in psychological assessment. Adv Methods Pract Psychol Sci. https:\/\/doi.org\/10.1177\/25152459211061337","journal-title":"Adv Methods Pract Psychol Sci"},{"key":"445_CR121","unstructured":"Technavio (2022) Software defined everything (SDE) market by end-user and geography\u2014forecast and analysis 2022-2026. https:\/\/www.technavio.com\/report\/software-defined-everything-sde-market-industry-analysis, Accessed 23 June 2023"},{"key":"445_CR122","unstructured":"The Council of the European Union (2000) Council directive 2000\/78\/EC of 27 november 2000 establishing a general framework for equal treatment in employment and occupation. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX:32000L0078"},{"key":"445_CR123","unstructured":"The Council of the European Union (2004) Council directive 2004\/113\/EC of 13 december 2004 implementing the principle of equal treatment between men and women in the access to and supply of goods and services. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=celex%3A32004L0113"},{"key":"#cr-split#-445_CR124.1","unstructured":"The European Parliament and the Council of the European Union (2017) Commission Regulation"},{"key":"#cr-split#-445_CR124.2","unstructured":"(EU) 2017\/1151. http:\/\/data.europa.eu\/eli\/reg\/2017\/1151\/oj"},{"key":"445_CR125","doi-asserted-by":"crossref","unstructured":"Th\u00fcsing G (2013) European Labour Law, \u00a73 Protection against discrimination. C.H, Beck","DOI":"10.5771\/9783845259086-60"},{"key":"445_CR126","unstructured":"Th\u00fcsing G (2019) Das k\u00fcnftige Anti-Diskriminierungsrecht als Herausforderung f\u00fcr Wissenschaft und Praxis. ZfA - Zeitschrift f\u00fcr Arbeitsrecht p 241"},{"issue":"Suppl C","key":"445_CR127","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.trd.2015.07.011","volume":"40","author":"M Tutuianu","year":"2015","unstructured":"Tutuianu M, Bonnel P, Ciuffo B et al (2015) Development of the world-wide harmonized light duty test cycle (WLTC) and a possible pathway for its introduction in the european legislation. Trans Res Part D Trans Environ 40(Suppl C):61\u201375. https:\/\/doi.org\/10.1016\/j.trd.2015.07.011","journal-title":"Trans Res Part D Trans Environ"},{"key":"445_CR128","unstructured":"United Nations (2013) UN Vehicle Regulations\u20141958 Agreement, Revision 2, Addendum 100, Regulation No. 101, Revision 3\u2014E\/ECE\/324\/Rev.2\/Add.100\/Rev.3. http:\/\/www.unece.org\/trans\/main\/wp29\/wp29regs101-120.html"},{"key":"445_CR129","unstructured":"United Nations Educational, Scientific and Cultural Organization (UNESCO) (2021) Recommendation on the ethics of artificial intelligence. https:\/\/unesdoc.unesco.org\/ark:\/48223\/pf0000380455"},{"key":"445_CR130","doi-asserted-by":"publisher","unstructured":"Volpato M, Tretmans J (2015) Approximate active learning of nondeterministic input output transition systems. Electron Commun Eur Assoc Softw Sci Technol 72. https:\/\/doi.org\/10.14279\/tuj.eceasst.72.1008","DOI":"10.14279\/tuj.eceasst.72.1008"},{"key":"445_CR131","doi-asserted-by":"publisher","first-page":"735","DOI":"10.2139\/ssrn.3792772","volume":"123","author":"S Wachter","year":"2020","unstructured":"Wachter S, Mittelstadt B, Russell C (2020) Bias preservation in machine learning: the legality of fairness metrics under eu non-discrimination law. W Va L Rev 123:735. https:\/\/doi.org\/10.2139\/ssrn.3792772","journal-title":"W Va L Rev"},{"key":"445_CR132","unstructured":"Washington State (2020) Certification of enrollment: engrossed substitute senate bill 6280 (\u2019Washington State Facial Recognition Law\u2019). https:\/\/lawfilesext.leg.wa.gov\/biennium\/2019-20\/Pdf\/Bills\/Senate%20Passed%20Legislature\/6280-S.PL.pdf?q=20210513071229"},{"issue":"1","key":"445_CR133","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1609\/aimag.v35i1.2504","volume":"35","author":"A Waters","year":"2014","unstructured":"Waters A, Miikkulainen R (2014) Grade: machine learning support for graduate admissions. AI Mag 35(1):64. https:\/\/doi.org\/10.1609\/aimag.v35i1.2504","journal-title":"AI Mag"},{"key":"445_CR134","unstructured":"Zehlike M, Yang K, Stoyanovich J (2021) Fairness in ranking: a survey. CoRR abs\/2103.14000. arxiv:2103.14000,"},{"key":"445_CR135","unstructured":"Zemel R, Wu Y, Swersky K, et\u00a0al (2013) Learning fair representations. In: International conference on machine learning, PMLR, pp 325\u2013333"},{"issue":"3","key":"445_CR136","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1037\/0021-9010.90.3.553","volume":"90","author":"JC Ziegert","year":"2005","unstructured":"Ziegert JC, Hanges PJ (2005) Employment discrimination: the role of implicit attitudes, motivation, and a climate for racial bias. J Appl Psychol 90(3):553","journal-title":"J Appl Psychol"},{"issue":"4","key":"445_CR137","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1257\/0002828042002561","volume":"94","author":"M Bertrand","year":"2004","unstructured":"Bertrand M, Mullainathan S (2004) Are emily and greg more employable than lakisha and jamal? a field experiment on labor market discrimination. Am Econ Rev 94(4):991\u20131013","journal-title":"Am Econ Rev"},{"issue":"3","key":"445_CR138","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1177\/0018720814547570","volume":"57","author":"KA Hoff","year":"2015","unstructured":"Hoff KA, Bashir M (2015) Trust in automation: Integrating empirical evidence on factors that influence trust. Hum Factors 57(3):407\u2013434","journal-title":"Hum Factors"},{"key":"445_CR139","doi-asserted-by":"crossref","unstructured":"Lahoti P, Gummadi KP, Weikum G (2019) ifair: Learning individually fair data representations for algorithmic decision making. In: 2019 IEEE 35th international conference on data engineering (icde), IEEE, pp 1334\u20131345","DOI":"10.1109\/ICDE.2019.00121"},{"key":"445_CR140","doi-asserted-by":"crossref","unstructured":"Langer M, K\u00f6nig CJ, Back C, et\u00a0al (2022) Trust in artificial intelligence: comparing trust processes between human and automated trustees in light of unfair bias. J Bus Psychol","DOI":"10.31234\/osf.io\/r9y3t"}],"container-title":["Formal Methods in System Design"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10703-024-00445-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10703-024-00445-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10703-024-00445-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,30]],"date-time":"2025-05-30T10:01:35Z","timestamp":1748599295000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10703-024-00445-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,4]]},"references-count":141,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["445"],"URL":"https:\/\/doi.org\/10.1007\/s10703-024-00445-2","relation":{},"ISSN":["0925-9856","1572-8102"],"issn-type":[{"value":"0925-9856","type":"print"},{"value":"1572-8102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,4]]},"assertion":[{"value":"22 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Not applicable","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}