{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:27:32Z","timestamp":1782282452182,"version":"3.54.5"},"reference-count":86,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T00:00:00Z","timestamp":1660348800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T00:00:00Z","timestamp":1660348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["CISC.CC.018"],"award-info":[{"award-number":["CISC.CC.018"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Minds &amp; Machines"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>As the use of AI systems continues to increase, so do concerns over their lack of fairness, legitimacy and accountability. Such harmful automated decision-making can be guarded against by ensuring AI systems are contestable by design: responsive to human intervention throughout the system lifecycle. Contestable AI by design is a small but growing field of research. However, most available knowledge requires a significant amount of translation to be applicable in practice. A proven way of conveying intermediate-level, generative design knowledge is in the form of frameworks. In this article we use qualitative-interpretative methods and visual mapping techniques to extract from the literature sociotechnical features and practices that contribute to contestable AI, and synthesize these into a design framework.<\/jats:p>","DOI":"10.1007\/s11023-022-09611-z","type":"journal-article","created":{"date-parts":[[2022,8,13]],"date-time":"2022-08-13T11:02:42Z","timestamp":1660388562000},"page":"613-639","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["Contestable AI by Design: Towards a Framework"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7562-019X","authenticated-orcid":false,"given":"Kars","family":"Alfrink","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ianus","family":"Keller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerd","family":"Kortuem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neelke","family":"Doorn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,13]]},"reference":[{"key":"9611_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-57977-7_12","volume-title":"Rules and reasoning","author":"A Aler Tubella","year":"2020","unstructured":"Aler Tubella, A., Theodorou, A., Dignum, V., et al. (2020). Contestable black boxes. In V. Guti\u00e9rrez-Basulto, T. Kliegr, A. Soylu, et al. (Eds.), Rules and reasoning (Vol. 12173). Springer."},{"key":"9611_CR2","doi-asserted-by":"crossref","unstructured":"Almada, M. (2019). Human intervention in automated decision-making: Toward the construction of contestable systems. In Proceedings of the 17th International Conference on Artificial Intelligence and Law, ICAIL 2019, pp 2\u201311","DOI":"10.1145\/3322640.3326699"},{"issue":"3","key":"9611_CR3","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1177\/1461444816676645","volume":"20","author":"M Ananny","year":"2018","unstructured":"Ananny, M., & Crawford, K. (2018). Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. New Media and Society, 20(3), 973\u2013989.","journal-title":"New Media and Society"},{"issue":"2","key":"9611_CR4","doi-asserted-by":"crossref","first-page":"168","DOI":"10.58680\/la198326236","volume":"60","author":"AN Applebee","year":"1983","unstructured":"Applebee, A. N., & Langer, J. A. (1983). Instructional scaffolding: Reading and writing as natural language activities. Language Arts, 60(2), 168\u2013175 http:\/\/www.jstor.org\/stable\/41961447.","journal-title":"Language Arts"},{"key":"9611_CR5","doi-asserted-by":"crossref","unstructured":"Bayaml\u0131o\u011flu, E. (2021). The right to contest automated decisions under the General Data Protection Regulation: Beyond the so-called \u201cright to explanation\u201d. Regulation and Governance.","DOI":"10.1111\/rego.12391"},{"key":"9611_CR6","unstructured":"Binns, R., & Gallo, V. (2019). An overview of the Auditing Framework for Artificial Intelligence and its core components. https:\/\/ico.org.uk\/about-the-ico\/news-and-events\/ai-blog-an-overview-of-the-auditing-framework-for-artificial-intelligence-and-its-core-components\/"},{"issue":"3","key":"9611_CR7","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1002\/hast.1207","volume":"51","author":"M Braun","year":"2021","unstructured":"Braun, M., Bleher, H., & Hummel, P. (2021). A leap of faith: Is there a formula for \u201ctrustworthy\u2019\u2019 AI? Hastings Center Report, 51(3), 17\u201322. https:\/\/doi.org\/10.1002\/hast.1207.","journal-title":"Hastings Center Report"},{"issue":"2","key":"9611_CR8","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","volume":"3","author":"V Braun","year":"2006","unstructured":"Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77\u2013101.","journal-title":"Qualitative Research in Psychology"},{"issue":"2","key":"9611_CR9","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1093\/ijlit\/eay017","volume":"27","author":"M Brkan","year":"2019","unstructured":"Brkan, M. (2019). Do algorithms rule the world? Algorithmic decision-making and data protection in the framework of the GDPR and beyond. International Journal of Law and Information Technology, 27(2), 91\u2013121.","journal-title":"International Journal of Law and Information Technology"},{"key":"9611_CR10","doi-asserted-by":"crossref","unstructured":"Cavalcante\u00a0Siebert, L., Lupetti, M. L., & Aizenberg, E., et\u00a0al. (2022). Meaningful human control: Actionable properties for AI system development. AI and Ethics.","DOI":"10.1007\/s43681-022-00167-3"},{"key":"9611_CR11","unstructured":"Chiusi, F., Fischer, S., & Kayser-Bril, N., et\u00a0al. (2020). Automating Society Report 2020. Tech. rep., Algorithm Watch, https:\/\/automatingsociety.algorithmwatch.org"},{"key":"9611_CR12","doi-asserted-by":"publisher","unstructured":"Cobbe, J., Lee, M. S. A., & Singh, J. (2021). Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, Virtual Event, pp 598\u2013609, https:\/\/doi.org\/10.1145\/3442188.3445921","DOI":"10.1145\/3442188.3445921"},{"key":"9611_CR13","unstructured":"Cowgill, B., & Tucker, C. (2017). Algorithmic bias: A counterfactual perspective. Working Paper: NSFTrustworthy Algorithms p\u00a03. http:\/\/trustworthy-algorithms.org\/whitepapers\/Bo Cowgill.pdf"},{"issue":"1","key":"9611_CR14","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1177\/0162243915589635","volume":"41","author":"K Crawford","year":"2016","unstructured":"Crawford, K. (2016). Can an algorithm be agonistic? Ten scenes from life in calculated publics. Science, Technology, & Human Values, 41(1), 77\u201392","journal-title":"Science, Technology, & Human Values"},{"key":"9611_CR15","unstructured":"Crawford, K., Dobbe, R., & Dryer, T., et\u00a0al. (2019). AI now 2019 report. Technical report, AI Now Institute. https:\/\/ainowinstitute.org\/AI_Now_2019_Report.html"},{"key":"9611_CR16","doi-asserted-by":"crossref","unstructured":"Davis, J. (2009). Design methods for ethical persuasive computing. In Proceedings of the 4th international conference on persuasive technology. Association for Computing Machinery, Persuasive \u201909.","DOI":"10.1145\/1541948.1541957"},{"key":"9611_CR71","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/frobt.2018.00001","volume":"5","author":"FS de Sio","year":"2018","unstructured":"de Sio, F. S., & van den Hoven, J. (2018). Meaningful human control over autonomous systems: A philosophical account. Frontiers Robotics AI, 5, 1\u201314.","journal-title":"Frontiers Robotics AI"},{"issue":"5","key":"9611_CR17","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1016\/S0142-694X(01)00009-6","volume":"22","author":"K Dorst","year":"2001","unstructured":"Dorst, K., & Cross, N. (2001). Creativity in the design process: Co-evolution of problem-solution. Design Studies, 22(5), 425\u2013437.","journal-title":"Design Studies"},{"issue":"1","key":"9611_CR18","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s00779-003-0253-8","volume":"8","author":"P Dourish","year":"2004","unstructured":"Dourish, P. (2004). What we talk about when we talk about context. Personal and Ubiquitous Computing, 8(1), 19\u201330.","journal-title":"Personal and Ubiquitous Computing"},{"issue":"3","key":"9611_CR19","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/MSP.2018.2701152","volume":"16","author":"L Edwards","year":"2018","unstructured":"Edwards, L., & Veale, M. (2018). Enslaving the algorithm: From a \u201cright to an explanation\u2019\u2019 to a \u201cright to better decisions\u2019\u2019? IEEE Security & Privacy, 16(3), 46\u201354.","journal-title":"IEEE Security & Privacy"},{"issue":"2","key":"9611_CR20","doi-asserted-by":"publisher","first-page":"205395172093,22","DOI":"10.1177\/2053951720932296","volume":"7","author":"N Elkin-Koren","year":"2020","unstructured":"Elkin-Koren, N. (2020). Contesting algorithms: Restoring the public interest in content filtering by artificial intelligence. Big Data & Society, 7(2), 205395172093,229.","journal-title":"Big Data & Society"},{"key":"9611_CR21","doi-asserted-by":"publisher","unstructured":"Franssen, M. (2015). Design for values and operator roles in sociotechnical systemsociotechnical systems. In: van den Hoven J, Vermaas PE, van de Poel I (Eds.) Handbook of Ethics, Values, and Technological Design. Springer, pp 117\u2013149, https:\/\/doi.org\/10.1007\/978-94-007-6970-0_8","DOI":"10.1007\/978-94-007-6970-0_8"},{"key":"9611_CR22","unstructured":"Gebru, T., Morgenstern, J., & Vecchione, B., et\u00a0al. (2020). Datasheets for datasets. arXiv:1803.09010 [cs]"},{"key":"9611_CR23","doi-asserted-by":"crossref","unstructured":"Geuens, J., Geurts, L., Swinnen, T. W., et\u00a0al. (2018). Turning tables: A structured focus group method to remediate unequal power during participatory design in health care. In Proceedings of the 15th participatory design conference: Short papers, situated actions, workshops and tutorial - Volume 2. ACM, Hasselt and Genk, pp 1\u20135.","DOI":"10.1145\/3210604.3210649"},{"key":"9611_CR24","unstructured":"Goodman, B. (2016). Economic models of (algorithmic) discrimination. In 29th conference on neural information processing systems"},{"key":"9611_CR25","doi-asserted-by":"crossref","unstructured":"Henin, C., & Le\u00a0M\u00e9tayer, D. (2021). Beyond explainability: Justifiability and contestability of algorithmic decision systems. AI & Society","DOI":"10.1007\/s00146-021-01251-8"},{"key":"9611_CR26","doi-asserted-by":"crossref","unstructured":"Hildebrandt, M. (2017). Privacy as protection of the incomputable self: Agonistic machine learning. SSRN Electronic Journal 1\u201333.","DOI":"10.2139\/ssrn.3081776"},{"key":"9611_CR27","doi-asserted-by":"crossref","unstructured":"Hirsch, T., Merced, K., Narayanan, S., et\u00a0al. (2017). Designing contestability: Interaction design, machine learning, and mental health. In DIS 2017 - Proceedings of the 2017 ACM conference on designing interactive systems. ACM Press, pp 95\u201399.","DOI":"10.1145\/3064663.3064703"},{"key":"9611_CR29","doi-asserted-by":"publisher","unstructured":"H\u00f6\u00f6k, K., Karlgren, J., & W\u00e6rn, A., et\u00a0al. (1998). A glass box approach to adaptive hypermedia. In: Brusilovsky P, Kobsa A, Vassileva J (Eds.) Adaptive hypertext and hypermedia. Springer, pp 143\u2013170, https:\/\/doi.org\/10.1007\/978-94-017-0617-9_6","DOI":"10.1007\/978-94-017-0617-9_6"},{"issue":"3","key":"9611_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2362364.2362371","volume":"19","author":"K H\u00f6\u00f6k","year":"2012","unstructured":"H\u00f6\u00f6k, K., & L\u00f6wgren, J. (2012). Strong concepts: Intermediate-level knowledge in interaction design research. ACM Transactions on Computer-Human Interaction, 19(3), 1\u201318.","journal-title":"ACM Transactions on Computer-Human Interaction"},{"key":"9611_CR30","doi-asserted-by":"crossref","unstructured":"Hutchinson, B., Smart, A., & Hanna, A., et\u00a0al. (2021). Towards accountability for machine learning datasets: Practices from software engineering and infrastructure. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. ACM, Virtual Event Canada, pp 560\u2013575.","DOI":"10.1145\/3442188.3445918"},{"key":"9611_CR31","doi-asserted-by":"crossref","unstructured":"Jewell, M. (2018). Contesting the decision: Living in (and living with) the smart city. International Review of Law, Computers and Technology.","DOI":"10.1080\/13600869.2018.1457000"},{"issue":"9","key":"9611_CR32","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389\u2013399.","journal-title":"Nature Machine Intelligence"},{"issue":"11","key":"9611_CR33","doi-asserted-by":"publisher","first-page":"934","DOI":"10.1037\/0003-066X.58.11.934","volume":"58","author":"DW Johnson","year":"2003","unstructured":"Johnson, D. W. (2003). Social interdependence: Interrelationships among theory, research, and practice. American Psychologist, 58(11), 934\u2013945.","journal-title":"American Psychologist"},{"issue":"247","key":"9611_CR34","first-page":"23","volume":"1","author":"D Kamarinou","year":"2016","unstructured":"Kamarinou, D., Millard, C., & Singh, J. (2016). Machine learning with personal data. Queen Mary School of Law Legal Studies Research Paper, 1(247), 23.","journal-title":"Queen Mary School of Law Legal Studies Research Paper"},{"key":"9611_CR35","doi-asserted-by":"crossref","unstructured":"Kariotis, T., & Mir, D. J. (2020). Fighting back algocracy: The need for new participatory approaches to technology assessment. In Proceedings of the 16th Participatory Design Conference 2020 - Participation(s) Otherwise - Volume 2. ACM, Manizales Colombia, pp 148\u2013153.","DOI":"10.1145\/3384772.3385151"},{"key":"9611_CR36","doi-asserted-by":"publisher","unstructured":"Katell, M., Young, M., & Dailey, D., et\u00a0al. (2020). Toward situated interventions for algorithmic equity: Lessons from the field. In Proceedings of the 2020 conference on fairness, accountability, and transparency. Association for Computing Machinery, pp 45\u201355, https:\/\/doi.org\/10.1145\/3351095.3372874","DOI":"10.1145\/3351095.3372874"},{"key":"9611_CR37","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3311894","author":"D Kluttz","year":"2018","unstructured":"Kluttz, D., Kohli, N., & Mulligan, D. K. (2018). Contestability and professionals: From explanations to engagement with algorithmic systems. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.3311894.","journal-title":"SSRN Electronic Journal"},{"issue":"3","key":"9611_CR38","doi-asserted-by":"publisher","first-page":"853","DOI":"10.15779\/Z38154DP7K","volume":"34","author":"DN Kluttz","year":"2019","unstructured":"Kluttz, D. N., & Mulligan, D. K. (2019). Automated decision support technologies and the legal profession. Berkeley Technology Law Journal, 34(3), 853. https:\/\/doi.org\/10.15779\/Z38154DP7K.","journal-title":"Berkeley Technology Law Journal"},{"key":"9611_CR54","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3311894","author":"DN Kluttz","year":"2019","unstructured":"Kluttz, D. N., Mulligan, D. K., Mulligan, D. K., et al. (2019). Shaping our tools: Contestability as a means to promote responsible algorithmic decision making in the professions. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.3311894.","journal-title":"SSRN Electronic Journal"},{"issue":"101","key":"9611_CR39","first-page":"688","volume":"67","author":"PD K\u00f6nig","year":"2021","unstructured":"K\u00f6nig, P. D., & Wenzelburger, G. (2021). The legitimacy gap of algorithmic decision-making in the public sector: Why it arises and how to address it. Technology in Society, 67(101), 688.","journal-title":"Technology in Society"},{"issue":"6","key":"9611_CR40","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1002\/sres.703","volume":"23","author":"P Kroes","year":"2006","unstructured":"Kroes, P., Franssen, M., van de Poel, I., et al. (2006). Treating socio-technical systems as engineering systems: Some conceptual problems. Systems Research and Behavioral Science, 23(6), 803\u2013814.","journal-title":"Systems Research and Behavioral Science"},{"key":"9611_CR41","first-page":"633","volume":"165","author":"JA Kroll","year":"2016","unstructured":"Kroll, J. A., Barocas, S., Felten, E. W., et al. (2016). Accountable algorithms. U Pa L Rev, 165, 633.","journal-title":"Accountable algorithms. U Pa L Rev"},{"key":"9611_CR42","doi-asserted-by":"crossref","unstructured":"Leahu, L. (2016). Ontological surprises: A relational perspective on machine learning. In Proceedings of the 2016 ACM conference on designing interactive systems. ACM, pp 182\u2013186","DOI":"10.1145\/2901790.2901840"},{"key":"9611_CR43","doi-asserted-by":"crossref","unstructured":"Leydens, J. A., & Lucena, J. C. (2018). Engineering justice: Transforming engineering education and practice. IEEE PCS Professional Engineering Communication Series. Wiley.","DOI":"10.1002\/9781118757369"},{"key":"9611_CR44","doi-asserted-by":"crossref","unstructured":"L\u00f6wgren, J., Gaver, B., & Bowers, J. (2013). Annotated Portfolios and other forms of intermediate- level knowledge. Interactions pp 30\u201334.","DOI":"10.1145\/2405716.2405725"},{"issue":"CSCW1","key":"9611_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3449180","volume":"5","author":"H Lyons","year":"2021","unstructured":"Lyons, H., Velloso, E., & Miller, T. (2021). Conceptualising contestability: Perspectives on contesting algorithmic decisions. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW1), 1\u201325.","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"9611_CR46","doi-asserted-by":"crossref","unstructured":"Mahendran, A., & Vedaldi, A. (2015). Understanding deep image representations by inverting them. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2015.7299155"},{"key":"9611_CR47","doi-asserted-by":"publisher","unstructured":"Matias, J. N., Johnson, A., Boesel, W. E., et\u00a0al. (2015). Reporting, reviewing, and responding to harassment on twitter. https:\/\/doi.org\/10.48550\/ARXIV.1505.03359","DOI":"10.48550\/ARXIV.1505.03359"},{"key":"9611_CR48","doi-asserted-by":"crossref","unstructured":"Mendoza, I., & Bygrave, L. A. (2017). The right not to be subject to automated decisions based on profiling. In EU Internet Law. Springer, pp 77\u201398","DOI":"10.1007\/978-3-319-64955-9_4"},{"key":"9611_CR49","doi-asserted-by":"crossref","unstructured":"Methnani, L., Aler\u00a0Tubella, A., & Dignum, V., et\u00a0al. (2021). Let me take over: Variable autonomy for meaningful human control. Frontiers in Artificial Intelligence 4.","DOI":"10.3389\/frai.2021.737072"},{"key":"9611_CR50","doi-asserted-by":"crossref","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., et\u00a0al. (2019). Model cards for model reporting. In Proceedings of the conference on fairness, accountability, and transparency. ACM, pp 220\u2013229","DOI":"10.1145\/3287560.3287596"},{"issue":"7","key":"9611_CR51","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000097","volume":"6","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J., et al. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000,097.","journal-title":"PLoS Medicine"},{"key":"9611_CR52","doi-asserted-by":"crossref","unstructured":"Mohseni, S. (2019). Toward design and evaluation framework for interpretable machine learning systems. In Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society. ACM, pp. 553\u2013554.","DOI":"10.1145\/3306618.3314322"},{"key":"9611_CR53","doi-asserted-by":"publisher","first-page":"2141","DOI":"10.1007\/s11948-019-00165-5","volume":"26","author":"J Morley","year":"2019","unstructured":"Morley, J., Floridi, L., Kinsey, L., et al. (2019). From what to how. An overview of AI ethics tools, methods and research to translate principles into practices. Science and Engineering Ethics, 26, 2141\u20132168.","journal-title":"Science and Engineering Ethics"},{"issue":"11","key":"9611_CR55","doi-asserted-by":"publisher","first-page":"4366","DOI":"10.1177\/1461444818773059","volume":"20","author":"S Myers West","year":"2018","unstructured":"Myers West, S. (2018). Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, 20(11), 4366\u20134383.","journal-title":"New Media & Society"},{"issue":"4","key":"9611_CR56","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1162\/DAED_a_00113","volume":"140","author":"H Nissenbaum","year":"2011","unstructured":"Nissenbaum, H. (2011). A contextual approach to privacy online. Daedalus, 140(4), 32\u201348.","journal-title":"Daedalus"},{"issue":"2","key":"9611_CR57","first-page":"83","volume":"1","author":"DA Norman","year":"2015","unstructured":"Norman, D. A., & Stappers, P. J. (2015). DesignX: Complex sociotechnical systems. She Ji: The Journal of Design, Economics, and Innovation, 1(2), 83\u2013106.","journal-title":"She Ji: The Journal of Design, Economics, and Innovation"},{"key":"9611_CR58","unstructured":"Novick, D. G., & Sutton, S. (1997). What is mixed-initiative interaction. In Proceedings of the AAAI spring symposium on computational models for mixed initiative interaction, p\u00a012."},{"issue":"5","key":"9611_CR59","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1145\/2008176.2008189","volume":"18","author":"\u017d Obrenovi\u0107","year":"2011","unstructured":"Obrenovi\u0107, \u017d. (2011). Design-based research: What we learn when we engage in design of interactive systems. Interactions, 18(5), 56\u201359.","journal-title":"Interactions"},{"issue":"1","key":"9611_CR60","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1186\/s13643-016-0384-4","volume":"5","author":"M Ouzzani","year":"2016","unstructured":"Ouzzani, M., Hammady, H., Fedorowicz, Z., et al. (2016). Rayyan: A web and mobile app for systematic reviews. Systematic Reviews, 5(1), 210.","journal-title":"Systematic Reviews"},{"issue":"101","key":"9611_CR61","first-page":"901","volume":"107","author":"T Ploug","year":"2020","unstructured":"Ploug, T., & Holm, S. (2020). The four dimensions of contestable AI diagnostics: A patient-centric approach to explainable AI. Artificial Intelligence in Medicine, 107(101), 901.","journal-title":"Artificial Intelligence in Medicine"},{"key":"9611_CR62","doi-asserted-by":"crossref","unstructured":"Raji, I. D., Smart, A., White, R. N., et\u00a0al. (2020). Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing. FAT* 2020\u2014Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency pp 33\u201344","DOI":"10.1145\/3351095.3372873"},{"key":"9611_CR63","doi-asserted-by":"crossref","unstructured":"Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). \"Why should i trust you?\": Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135\u20131144.","DOI":"10.1145\/2939672.2939778"},{"key":"9611_CR64","unstructured":"Rouvroy, A. (2012). The end(s) of critique: Data-behaviourism vs. due-process. In: Hildebrandt M, De\u00a0Vries E (Eds.) Privacy, due process and the computational turn. Philosophers of Law Meet Philosophers of Technology."},{"key":"9611_CR65","doi-asserted-by":"crossref","unstructured":"Salehi, N., Teevan, J., Iqbal, S., et\u00a0al. (2017). Communicating context to the crowd for complex writing tasks. In: Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. ACM, Portland, pp 1890\u20131901.","DOI":"10.1145\/2998181.2998332"},{"key":"9611_CR66","unstructured":"Sandvig, C., Hamilton, K., Karahalios, K., et\u00a0al. (2014). Auditing algorithms: Research methods for detecting discrimination on internet platforms. In: Data and discrimination: Converting critical concerns into productive inquiry."},{"issue":"3","key":"9611_CR67","doi-asserted-by":"publisher","first-page":"20200,003","DOI":"10.1515\/gj-2020-0003","volume":"20","author":"C Sarra","year":"2020","unstructured":"Sarra, C. (2020). Put dialectics into the machine: Protection against automatic-decision-making through a deeper understanding of contestability by design. Global Jurist, 20(3), 20200,003.","journal-title":"Global Jurist"},{"issue":"2\u20133","key":"9611_CR68","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/S0040-1625(96)00180-1","volume":"54","author":"J Schot","year":"1997","unstructured":"Schot, J., & Rip, A. (1997). The past and future of constructive technology assessment. Technological Forecasting and Social Change, 54(2\u20133), 251\u2013268.","journal-title":"Technological Forecasting and Social Change"},{"key":"9611_CR69","doi-asserted-by":"crossref","unstructured":"Selbst, A. D., & Barocas, S. (2018). The intuitive appeal of explainable machines. SSRN Electronic Journal.","DOI":"10.2139\/ssrn.3126971"},{"issue":"4","key":"9611_CR70","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3419764","volume":"10","author":"B Shneiderman","year":"2020","unstructured":"Shneiderman, B. (2020). Bridging the gap between ethics and practice: Guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Transactions on Interactive Intelligent Systems, 10(4), 1\u201331.","journal-title":"ACM Transactions on Interactive Intelligent Systems"},{"key":"9611_CR72","unstructured":"Sloane, M., Moss, E., Awomolo, O., et\u00a0al. (2020). Participation is not a design fix for machine learning. arXiv:2007.02423 [cs]"},{"issue":"2","key":"9611_CR73","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1080\/07370020903586696","volume":"25","author":"E Stolterman","year":"2010","unstructured":"Stolterman, E., & Wiberg, M. (2010). Concept-driven interaction design research. Human-Computer Interaction, 25(2), 95\u2013118.","journal-title":"Human-Computer Interaction"},{"key":"9611_CR74","unstructured":"Suchman, L. (2018). Corporate accountability. https:\/\/robotfutures.wordpress.com\/2018\/06\/10\/corporate-accountability\/"},{"issue":"6","key":"9611_CR75","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1109\/72.728352","volume":"9","author":"A Tickle","year":"1998","unstructured":"Tickle, A., Andrews, R., Golea, M., et al. (1998). The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks. IEEE Transactions on Neural Networks, 9(6), 1057\u20131068.","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"3","key":"9611_CR76","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1145\/2907987","volume":"23","author":"C Tonkinwise","year":"2016","unstructured":"Tonkinwise, C. (2016). The interaction design public intellectual. Interactions, 23(3), 24\u201325).","journal-title":"Interactions"},{"issue":"3","key":"9611_CR77","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s10676-021-09588-w","volume":"23","author":"S Umbrello","year":"2021","unstructured":"Umbrello, S. (2021). Coupling levels of abstraction in understanding meaningful human control of autonomous weapons: A two-tiered approach. Ethics and Information Technology, 23(3), 455\u2013464.","journal-title":"Ethics and Information Technology"},{"key":"9611_CR78","doi-asserted-by":"crossref","unstructured":"Vaccaro, K., Karahalios, K., Mulligan, D. K., et\u00a0al. (2019). Contestability in algorithmic systems. In Conference companion publication of the 2019 on computer supported cooperative work and social computing. ACM, pp 523\u2013527","DOI":"10.1145\/3311957.3359435"},{"key":"9611_CR79","doi-asserted-by":"crossref","unstructured":"Vaccaro, K., Sandvig, C., & Karahalios, K. (2020). At the end of the day Facebook does what it wants: How users experience contesting algorithmic content moderation. In Proceedings of the ACM on human-computer interaction 4.","DOI":"10.1145\/3415238"},{"key":"9611_CR80","doi-asserted-by":"crossref","unstructured":"Vaccaro, K., Xiao, Z., Hamilton, K., et\u00a0al. (2021). Contestability for content moderation. In: Proceedings of the ACM on human-computer interaction, pp 1\u201328.","DOI":"10.1145\/3476059"},{"key":"9611_CR81","doi-asserted-by":"crossref","unstructured":"van de Poel, I. (2020). Embedding values in artificial intelligence (AI) systems. Minds and machines","DOI":"10.1007\/s11023-020-09537-4"},{"issue":"3","key":"9611_CR82","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1145\/2751314","volume":"22","author":"PP Verbeek","year":"2015","unstructured":"Verbeek, P. P. (2015). Beyond interaction: A short introduction to mediation theory. Interactions, 22(3), 26\u201331.","journal-title":"Interactions"},{"issue":"1","key":"9611_CR83","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s11023-020-09532-9","volume":"31","author":"I Verdiesen","year":"2021","unstructured":"Verdiesen, I., Santoni de Sio, F., & Dignum, V. (2021). Accountability and control over autonomous weapon systems: A framework for comprehensive human oversight. Minds and Machines, 31(1), 137\u2013163.","journal-title":"Minds and Machines"},{"issue":"2","key":"9611_CR84","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/s00146-020-01066-z","volume":"36","author":"J Walmsley","year":"2021","unstructured":"Walmsley, J. (2021). Artificial intelligence and the value of transparency. AI & SOCIETY, 36(2), 585\u2013595.","journal-title":"AI & SOCIETY"},{"issue":"1","key":"9611_CR85","first-page":"121","volume":"109","author":"L Winner","year":"1980","unstructured":"Winner, L. (1980). Do artifacts have politics? Daedalus, 109(1), 121\u2013136.","journal-title":"Daedalus"},{"issue":"12","key":"9611_CR86","doi-asserted-by":"publisher","first-page":"527","DOI":"10.3390\/info12120527","volume":"12","author":"A Wyatt","year":"2021","unstructured":"Wyatt, A., & Galliott, J. (2021). An empirical examination of the impact of cross-cultural perspectives on value sensitive design for autonomous systems. Information, 12(12), 527.","journal-title":"Information"}],"container-title":["Minds and Machines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-022-09611-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11023-022-09611-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-022-09611-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T17:26:36Z","timestamp":1727803596000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11023-022-09611-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,13]]},"references-count":86,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["9611"],"URL":"https:\/\/doi.org\/10.1007\/s11023-022-09611-z","relation":{},"ISSN":["1572-8641"],"issn-type":[{"value":"1572-8641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,13]]},"assertion":[{"value":"21 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}]}}