{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T08:03:01Z","timestamp":1764403381021,"version":"3.40.5"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T00:00:00Z","timestamp":1721865600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T00:00:00Z","timestamp":1721865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Dieter Schwarz Foundation"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This paper discusses an algorithmic tool introduced in the Basque Country (Spain) to assess the risk of intimate partner violence. The algorithm was introduced to address the lack of human experts by automatically\u00a0calculating the level of violence based on psychometric features such as controlling or violent behaviour. Given that\u00a0critical literature on risk assessment tools for domestic violence mainly focuses on English-speaking countries, this paper offers an algorithmic accountability analysis\u00a0in a non-English speaking region. It investigates\u00a0the algorithmic risks, harms, and limitations\u00a0associated with the Basque tool. We propose a transdisciplinary approach from a critical\u00a0statistical and legal perspective. This approach unveils issues and limitations that could lead to unexpected consequences for individuals suffering from partner violence. Moreover, our analysis suggests that\u00a0the algorithmic\u00a0tool has a high error rate on severe cases, i.e.,\u00a0cases where the aggressor could murder his partner\u20145 out of 10 high-risk cases are misclassified as low risk\u2014and that\u00a0there is a lack of appropriate legal guidelines for judges, the end users of this tool. The paper concludes that this risk assessment tool needs to be urgently evaluated by independent and transdisciplinary experts to better mitigate algorithmic harms\u00a0in the context of intimate partner violence.<\/jats:p>","DOI":"10.1007\/s00146-024-02016-9","type":"journal-article","created":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T14:29:43Z","timestamp":1721917783000},"page":"2633-2650","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Judging the algorithm"],"prefix":"10.1007","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8214-8380","authenticated-orcid":false,"given":"Ana","family":"Valdivia","sequence":"first","affiliation":[]},{"given":"Cari","family":"Hyde-Vaamonde","sequence":"additional","affiliation":[]},{"given":"Juli\u00e1n","family":"Garc\u00eda Marcos","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,7,25]]},"reference":[{"key":"2016_CR1","unstructured":"Albright A (2019) If you give a judge a risk score: evidence from Kentucky bail decisions. Law, Economics, and Business Fellows\u2019 Discussion Paper Series 85"},{"key":"2016_CR2","doi-asserted-by":"crossref","unstructured":"Amusa LB, Bengesai AV, Khan HT (2020) Predicting the vulnerability of women to intimate partner violence in south Africa: evidence from tree-based machine learning techniques. J Interpers Violence p 0886260520960110","DOI":"10.1177\/0886260520960110"},{"key":"2016_CR3","unstructured":"Angwin J, Larson J, Mattu S, Kirchner L (2016) Machine bias. Propublica, may 23, 2016"},{"key":"2016_CR4","doi-asserted-by":"crossref","unstructured":"Berber A, Sre\u0107kovi\u0107 S (2023) When something goes wrong: who is responsible for errors in ml decision-making? AI Soc:1\u201313","DOI":"10.1007\/s00146-023-01640-1"},{"issue":"1","key":"2016_CR5","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1111\/rego.12358","volume":"16","author":"R Binns","year":"2022","unstructured":"Binns R (2022) Human judgment in algorithmic loops: individual justice and automated decision-making. Regul Govern 16(1):197\u2013211","journal-title":"Regul Govern"},{"key":"2016_CR6","doi-asserted-by":"crossref","unstructured":"Birhane A, Kalluri P, Card D, Agnew W, Dotan R, Bao M (2021) The values encoded in machine learning research. arXiv preprint arXiv:2106.15590","DOI":"10.1145\/3531146.3533083"},{"key":"2016_CR7","volume-title":"Assessing dangerousness: violence by sexual offenders, batterers, and child abusers","author":"JC Campbell","year":"1995","unstructured":"Campbell JC (1995) Assessing dangerousness: violence by sexual offenders, batterers, and child abusers. Sage Publications Inc, Thousand Oaks"},{"key":"2016_CR8","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1089\/big.2016.0047","volume":"5","author":"A Chouldechova","year":"2017","unstructured":"Chouldechova A (2017) Fair prediction with disparate impact: a study of bias in recidivism prediction instruments. Big Data 5:153\u2013163. https:\/\/doi.org\/10.1089\/big.2016.0047","journal-title":"Big Data"},{"key":"2016_CR9","volume-title":"The alignment problem: how can machines learn human values?","author":"B Christian","year":"2021","unstructured":"Christian B (2021) The alignment problem: how can machines learn human values? Atlantic Books, London"},{"key":"2016_CR10","doi-asserted-by":"crossref","unstructured":"Cobbe J, Lee MSA, Singh J (2021) Reviewable automated decision-making: A framework for accountable algorithmic systems. In: Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pp 598\u2013609","DOI":"10.1145\/3442188.3445921"},{"key":"2016_CR11","doi-asserted-by":"crossref","unstructured":"Cumbicus-Pineda OM, Abad-Eras TE, Neyra-Romero LA (2021) Data mining to determine the causes of gender-based violence against women in ecuador. In: 2021 IEEE Fifth ecuador technical chapters meeting (ETCM), IEEE, pp 1\u20136","DOI":"10.1109\/ETCM53643.2021.9590664"},{"key":"2016_CR12","doi-asserted-by":"crossref","unstructured":"De-Arteaga M, Fogliato R, Chouldechova A (2020) A case for humans-in-the-loop: decisions in the presence of erroneous algorithmic scores. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1\u201312","DOI":"10.1145\/3313831.3376638"},{"issue":"2","key":"2016_CR13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0262538","volume":"17","author":"N Dehingia","year":"2022","unstructured":"Dehingia N, Dey AK, McDougal L, McAuley J, Singh A, Raj A (2022) Help seeking behavior by women experiencing intimate partner violence in India: a machine learning approach to identifying risk factors. PLoS One 17(2):e0262538","journal-title":"PLoS One"},{"issue":"1","key":"2016_CR14","doi-asserted-by":"publisher","first-page":"eaao5580","DOI":"10.1126\/sciadv.aao5580","volume":"4","author":"J Dressel","year":"2018","unstructured":"Dressel J, Farid H (2018) The accuracy, fairness, and limits of predicting recidivism. Sci Adv 4(1):eaao5580","journal-title":"Sci Adv"},{"key":"2016_CR15","unstructured":"Dreyfus HL, Dreyfus SE (1989) Why computers may never think like people. In: Computers in the human context: information technology, productivity, and people, pp 125\u2013143"},{"issue":"2","key":"2016_CR16","first-page":"355","volume":"8","author":"E Echebur\u00faa","year":"2008","unstructured":"Echebur\u00faa E, Fern\u00e1ndez-Montalvo J, de Corral P (2008) \u00bf hay diferencias entre la violencia grave y la violencia menos grave contra la pareja?: un an\u00e1lisis comparativo. Int J Clin Health Psychol 8(2):355\u2013382","journal-title":"Int J Clin Health Psychol"},{"issue":"6","key":"2016_CR17","doi-asserted-by":"publisher","first-page":"925","DOI":"10.1177\/0886260508319370","volume":"24","author":"E Echebur\u00faa","year":"2009","unstructured":"Echebur\u00faa E, Fern\u00e1ndez-Montalvo J, de Corral P, L\u00f3pez-Go\u00f1i JJ (2009) Assessing risk markers in intimate partner femicide and severe violence: a new assessment instrument. J Interpers Violence 24(6):925\u2013939","journal-title":"J Interpers Violence"},{"issue":"4","key":"2016_CR18","first-page":"1054","volume":"22","author":"E Echebur\u00faa","year":"2010","unstructured":"Echebur\u00faa E, Amor PJ, Loinaz I, De Corral P (2010) Escala de predicci\u00f3n del riesgo de violencia grave contra la pareja-revisada-(epv-r). Psicothema 22(4):1054\u20131060","journal-title":"Psicothema"},{"issue":"2","key":"2016_CR19","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1177\/0093854818811379","volume":"46","author":"L Eckhouse","year":"2019","unstructured":"Eckhouse L, Lum K, Conti-Cook C, Ciccolini J (2019) Layers of bias: a unified approach for understanding problems with risk assessment. Crim Justice Behav 46(2):185\u2013209","journal-title":"Crim Justice Behav"},{"issue":"1","key":"2016_CR20","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1080\/13600834.2021.1958860","volume":"31","author":"T Enarsson","year":"2022","unstructured":"Enarsson T, Enqvist L, Naarttij\u00e4rvi M (2022) Approaching the human in the loop-legal perspectives on hybrid human\/algorithmic decision-making in three contexts. Inf Commun Technol Law 31(1):123\u2013153. https:\/\/doi.org\/10.1080\/13600834.2021.1958860. (publisher: Routledge)","journal-title":"Inf Commun Technol Law"},{"key":"2016_CR21","volume-title":"Automating inequality: how high-tech tools profile, police, and punish the poor","author":"V Eubanks","year":"2018","unstructured":"Eubanks V (2018) Automating inequality: how high-tech tools profile, police, and punish the poor. St. Martin\u2019s Press, Springfield"},{"key":"2016_CR22","unstructured":"European Institute for Gender Equality (2019) Risk assessment and management of intimate partner violence in the eu"},{"key":"2016_CR23","first-page":"18","volume":"2","author":"LM Garay","year":"2018","unstructured":"Garay LM, Suay FM (2018) El uso de valoraciones del riesgo de violencia en derecho penal: algunas cautelas necesarias. InDret 2:18\u201368","journal-title":"InDret"},{"issue":"4","key":"2016_CR24","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1891\/0886-6708.3.4.303","volume":"3","author":"SD Gottfredson","year":"1988","unstructured":"Gottfredson SD, Gottfredson DM (1988) Violence prediction methods: Statistical and clinical strategies. Violence Vict 3(4):303\u2013324","journal-title":"Violence Vict"},{"key":"2016_CR25","doi-asserted-by":"crossref","unstructured":"Green B, Chen Y (2019) Disparate interactions: an algorithm-in-the-loop analysis of fairness in risk assessments. In: Proceedings of the conference on fairness, accountability, and transparency, pp 90\u201399","DOI":"10.1145\/3287560.3287563"},{"issue":"CSCW2","key":"2016_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3479562","volume":"5","author":"B Green","year":"2021","unstructured":"Green B, Chen Y (2021) Algorithmic risk assessments can alter human decision-making processes in high-stakes government contexts. Proc ACM Hum Comput Interact 5(CSCW2):1\u201333","journal-title":"Proc ACM Hum Comput Interact"},{"key":"2016_CR27","unstructured":"Hacking I (2007) Making up people, pp 285\u2013318"},{"key":"2016_CR28","unstructured":"INTERPOL, UNICRI (2020) Towards responsible AI innovation: report on artificial intelligence for law enforcement. INTERPOL-UNICRI. Report The Hague, the Netherlands. http:\/\/www.unicri.it\/towards-responsible-artificial-intelligence-innovation. Accessed 31 Jan 2022"},{"key":"2016_CR29","unstructured":"Kahneman D (2011) Thinking fast and slow"},{"key":"2016_CR30","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1093\/jla\/laz001","volume":"10","author":"J Kleinberg","year":"2018","unstructured":"Kleinberg J, Ludwig J, Mullainathan S, Sunstein CR (2018) Discrimination in the age of algorithms. J Legal Anal 10:113\u2013174","journal-title":"J Legal Anal"},{"key":"2016_CR31","unstructured":"Kropp P, Hart S, Webster C, Eaves D (2005) Spouse abuse risk assessment. SFU Vancouver"},{"issue":"1","key":"2016_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.psi.2015.10.002","volume":"25","author":"JJ L\u00f3pez-Ossorio","year":"2016","unstructured":"L\u00f3pez-Ossorio JJ, Gonz\u00e1lez-\u00c1lvarez JL, Andr\u00e9s-Pueyo A (2016) Eficacia predictiva de la valoraci\u00f3n policial del riesgo de la violencia de g\u00e9nero. Psychosoc Interv 25(1):1\u20137","journal-title":"Psychosoc Interv"},{"issue":"4","key":"2016_CR33","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1257\/jep.35.4.71","volume":"35","author":"J Ludwig","year":"2021","unstructured":"Ludwig J, Mullainathan S (2021) Fragile algorithms and fallible decision-makers: lessons from the justice system. J Econ Perspect 35(4):71\u201396","journal-title":"J Econ Perspect"},{"key":"2016_CR34","unstructured":"Mart\u00ednez R (2019) Valoraci\u00f3n del riesgo de violencia de g\u00e9nero: Escala de predicc\u00f3n del riesgo de violencia grave contra la pareja-revisada (epv-r). Bolet\u00edn Galego Med Legal Forense 2019(25)"},{"issue":"4","key":"2016_CR35","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1891\/0886-6708.3.4.263","volume":"3","author":"M Miller","year":"1988","unstructured":"Miller M, Morris N (1988) Predictions of dangerousness: an argument for limited use. Violence Vict 3(4):263\u2013283","journal-title":"Violence Vict"},{"key":"2016_CR36","doi-asserted-by":"crossref","unstructured":"Morin-Martel A (2023) Machine learning in bail decisions and judges\u2019 trustworthiness. AI Soc:1\u201312","DOI":"10.1007\/s00146-023-01673-6"},{"key":"2016_CR37","volume-title":"To save everything, click here: the folly of technological solutionism","author":"E Morozov","year":"2013","unstructured":"Morozov E (2013) To save everything, click here: the folly of technological solutionism. Public Affairs, New York"},{"key":"2016_CR38","unstructured":"Narayanan A (2019) How to recognize ai snake oil. Arthur Miller Lecture on Science and Ethics"},{"issue":"1","key":"2016_CR39","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1891\/1946-6560.4.1.76","volume":"4","author":"TL Nicholls","year":"2013","unstructured":"Nicholls TL, Pritchard MM, Reeves KA, Hilterman E (2013) Risk assessment in intimate partner violence: a systematic review of contemporary approaches. Partn Abus 4(1):76\u2013168","journal-title":"Partn Abus"},{"key":"2016_CR40","unstructured":"O\u2019Neil C (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. Crown, google-Books-ID: NgEwCwAAQBAJ"},{"issue":"2","key":"2016_CR41","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1080\/13600869.2020.1733758","volume":"34","author":"M Oswald","year":"2020","unstructured":"Oswald M (2020) Technologies in the twilight zone: early lie detectors, machine learning and reformist legal realism. Int Rev Law Comput Technol 34(2):214\u2013231. https:\/\/doi.org\/10.1080\/13600869.2020.1733758. (publisher: Routledge)","journal-title":"Int Rev Law Comput Technol"},{"issue":"3","key":"2016_CR42","doi-asserted-by":"publisher","first-page":"384","DOI":"10.7334\/psicothema2016.75","volume":"29","author":"D Paniagua","year":"2017","unstructured":"Paniagua D, Amor P, Echebur\u00faa E, Abad F (2017) Comparison of methods for dealing with missing values in the epvr. Psicotherma 29(3):384\u2013389. https:\/\/doi.org\/10.7334\/psicothema2016.75","journal-title":"Psicotherma"},{"issue":"1","key":"2016_CR43","first-page":"107","volume":"29","author":"AA Pueyo","year":"2008","unstructured":"Pueyo AA, L\u00f3pez S, \u00c1lvarez E (2008) Valoraci\u00f3n del riesgo de violencia contra la pareja por medio de la sara. Papel Psic\u00f3l 29(1):107\u2013122","journal-title":"Papel Psic\u00f3l"},{"issue":"2","key":"2016_CR44","doi-asserted-by":"publisher","first-page":"205395172312115","DOI":"10.1177\/20539517231211553","volume":"10","author":"B Rakova","year":"2023","unstructured":"Rakova B, Shelby R, Ma M (2023) Terms-we-serve-with: five dimensions for anticipating and repairing algorithmic harm. Big Data Soc 10(2):20539517231211550","journal-title":"Big Data Soc"},{"issue":"22","key":"2016_CR45","doi-asserted-by":"publisher","first-page":"8244","DOI":"10.3390\/app10228244","volume":"10","author":"I Rodr\u00edguez-Rodr\u00edguez","year":"2020","unstructured":"Rodr\u00edguez-Rodr\u00edguez I, Rodr\u00edguez JV, Pardo-Quiles DJ, Heras-Gonz\u00e1lez P, Chatzigiannakis I (2020) Modeling and forecasting gender-based violence through machine learning techniques. Appl Sci 10(22):8244","journal-title":"Appl Sci"},{"issue":"9","key":"2016_CR46","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0072484","volume":"8","author":"JP Singh","year":"2013","unstructured":"Singh JP, Grann M, Fazel S (2013) Authorship bias in violence risk assessment? A systematic review and meta-analysis. PLoS One 8(9):e72484","journal-title":"PLoS One"},{"key":"2016_CR47","doi-asserted-by":"publisher","DOI":"10.1002\/9781119184256","volume-title":"Handbook of recidivism risk\/needs assessment tools","author":"JP Singh","year":"2018","unstructured":"Singh JP, Kroner DG, Wormith JS, Desmarais SL, Hamilton Z (2018) Handbook of recidivism risk\/needs assessment tools. Wiley, New York"},{"key":"2016_CR48","unstructured":"State v Loomis (2016) Harvard Law Rev 130:1530"},{"issue":"Supplement 1","key":"2016_CR49","doi-asserted-by":"publisher","first-page":"59","DOI":"10.3138\/utlj-2023-0014","volume":"73","author":"MT Stevenson","year":"2023","unstructured":"Stevenson MT, Doleac JL (2023) The counterintuitive consequences of sex offender risk assessments at sentencing. Univ Toronto Law J 73(Supplement 1):59\u201372","journal-title":"Univ Toronto Law J"},{"issue":"5","key":"2016_CR50","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1002\/bsl.2384","volume":"36","author":"MT Stevenson","year":"2018","unstructured":"Stevenson MT, Slobogin C (2018) Algorithmic risk assessments and the double-edged sword of youth. Behav Sci Law 36(5):638\u2013656","journal-title":"Behav Sci Law"},{"key":"2016_CR51","volume-title":"Policy paradox: the art of political decision making","author":"DA Stone","year":"1997","unstructured":"Stone DA (1997) Policy paradox: the art of political decision making, vol 13. Norton, New York"},{"key":"2016_CR52","unstructured":"Takeuchi J, Solomon F, Menninger WW (1981) Behavioral science and the Secret Service: Toward the prevention of assassination. 81, National Academy Press"},{"key":"2016_CR53","first-page":"371","volume":"40","author":"C Thomas","year":"2022","unstructured":"Thomas C, Pont\u00f3n-N\u00fa\u00f1z A (2022) Automating judicial discretion: how algorithmic risk assessments in pretrial adjudications violate equal protection rights on the basis of race. Law Inequal 40:371","journal-title":"Law Inequal"},{"key":"2016_CR54","doi-asserted-by":"crossref","unstructured":"Tyler TR (2003) Procedural justice, legitimacy, and the effective rule of law. Crime Just 30:283\u2013357. https:\/\/www.jstor.org\/stable\/1147701. University of Chicago Press, University of Chicago","DOI":"10.1086\/652233"},{"key":"2016_CR55","volume-title":"The paradox of efficiency: frictions between law and algorithms","author":"A Valdivia","year":"2022","unstructured":"Valdivia A, de la Cueva J (2022) The paradox of efficiency: frictions between law and algorithms. On Matters Constitutional, Verfassungsblog"},{"key":"2016_CR56","doi-asserted-by":"publisher","unstructured":"Vanderstichele G (2019) The normative value of legal analytics. Is there a case for statistical precedent? SSRN Electron J. https:\/\/doi.org\/10.2139\/ssrn.3474878, https:\/\/www.ssrn.com\/abstract=3474878","DOI":"10.2139\/ssrn.3474878"},{"key":"2016_CR57","volume-title":"AI for everyone?","author":"P Verdegem","year":"2021","unstructured":"Verdegem P (2021) AI for everyone? University of Westminster Press, London"},{"issue":"3","key":"2016_CR58","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1177\/1524838020985565","volume":"23","author":"L Zark","year":"2022","unstructured":"Zark L, Satyen L (2022) Cross-cultural differences in student attitudes toward intimate partner violence: a systematic review. Trauma Violence Abuse 23(3):1007\u20131022","journal-title":"Trauma Violence Abuse"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-024-02016-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-024-02016-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-024-02016-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,15]],"date-time":"2025-05-15T02:38:48Z","timestamp":1747276728000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-024-02016-9"}},"subtitle":["Algorithmic accountability on the risk assessment tool for intimate partner violence in the Basque Country"],"short-title":[],"issued":{"date-parts":[[2024,7,25]]},"references-count":58,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["2016"],"URL":"https:\/\/doi.org\/10.1007\/s00146-024-02016-9","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"type":"print","value":"0951-5666"},{"type":"electronic","value":"1435-5655"}],"subject":[],"published":{"date-parts":[[2024,7,25]]},"assertion":[{"value":"17 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}