{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T15:54:46Z","timestamp":1783612486457,"version":"3.55.0"},"reference-count":48,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2019,7,1]],"date-time":"2019-07-01T00:00:00Z","timestamp":1561939200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001793","name":"Queensland University of Technology","doi-asserted-by":"publisher","award":["Vice-Chancellor's Research Fellowship (awarded to"],"award-info":[{"award-number":["Vice-Chancellor's Research Fellowship (awarded to"]}],"id":[{"id":"10.13039\/501100001793","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Big Data &amp; Society"],"published-print":{"date-parts":[[2019,7]]},"abstract":"<jats:p>The potential for biases being built into algorithms has been known for some time (e.g., Friedman and Nissenbaum, 1996), yet literature has only recently demonstrated the ways algorithmic profiling can result in social sorting and harm marginalised groups (e.g., Browne, 2015; Eubanks, 2018; Noble, 2018). We contend that with increased algorithmic complexity, biases will become more sophisticated and difficult to identify, control for, or contest. Our argument has four steps: first, we show how harnessing algorithms means that data gathered at a particular place and time relating to specific persons, can be used to build group models applied in different contexts to different persons. Thus, privacy and data protection rights, with their focus on individuals (Coll, 2014; Parsons, 2015), do not protect from the discriminatory potential of algorithmic profiling. Second, we explore the idea that anti-discrimination regulation may be more promising, but acknowledge limitations. Third, we argue that in order to harness anti-discrimination regulation, it needs to confront emergent forms of discrimination or risk creating new invisibilities, including invisibility from existing safeguards. Finally, we outline suggestions to address emergent forms of discrimination and exclusionary invisibilities via intersectional and post-colonial analysis.<\/jats:p>","DOI":"10.1177\/2053951719895805","type":"journal-article","created":{"date-parts":[[2019,12,16]],"date-time":"2019-12-16T07:18:49Z","timestamp":1576480729000},"page":"205395171989580","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":78,"title":["Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination"],"prefix":"10.1177","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8372-3797","authenticated-orcid":false,"given":"Monique","family":"Mann","sequence":"first","affiliation":[{"name":"School of Humanities and Social Sciences, Deakin University, Geelong, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Matzner","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Medienwissenschaften, Universit\u00e4t Paderborn, Paderborn, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2019,12,16]]},"reference":[{"key":"bibr1-2053951719895805","doi-asserted-by":"publisher","DOI":"10.4324\/9780203814949.ch3_1_a"},{"key":"bibr2-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/0263276411417430"},{"key":"bibr7-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1215\/9780822375302"},{"key":"bibr8-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1093\/idpl\/ipw006"},{"key":"bibr9-2053951719895805","volume-title":"AI now 2017 report. Technical Report","author":"Campolo A","year":"2017"},{"key":"bibr10-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2014.918636"},{"issue":"8","key":"bibr11-2053951719895805","first-page":"139","volume":"1","author":"Crenshaw K","year":"1989","journal-title":"The University of Chicago Legal Forum"},{"key":"bibr12-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020845814009"},{"key":"bibr13-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716679678"},{"issue":"1","key":"bibr14-2053951719895805","first-page":"18","volume":"16","author":"Edwards L","year":"2017","journal-title":"Duke Law and Technology Review"},{"key":"bibr15-2053951719895805","volume-title":"Automating Inequality: How High-Tech Tools Profile, Police and Punish the Poor","author":"Eubanks V","year":"2018"},{"key":"bibr16-2053951719895805","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctt1pwtb27"},{"key":"bibr17-2053951719895805","volume-title":"Society Must Be Defended: Lectures at the Coll\u00e8ge de France, 1975\u201376","author":"Foucault M","year":"2003"},{"key":"bibr19-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1145\/230538.230561"},{"key":"bibr20-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-009-9198-6"},{"key":"bibr21-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30487-3_4"},{"key":"bibr23-2053951719895805","volume-title":"Overseers of the Poor: Surveillance, Resistance and the Limits of Privacy","author":"Gilliom J","year":"2001"},{"key":"bibr25-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-6914-7_2"},{"key":"bibr26-2053951719895805","doi-asserted-by":"publisher","DOI":"10.4135\/9781473909472"},{"key":"bibr28-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1093\/idpl\/ipu023"},{"key":"bibr29-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/0967010614544204"},{"key":"bibr30-2053951719895805","first-page":"265","volume-title":"Space, Knowledge and Power: Foucault and Geography","author":"Legg S","year":"2007"},{"key":"bibr31-2053951719895805","volume-title":"Surveillance Society: Monitoring Everyday Life","author":"Lyon D","year":"2001"},{"key":"bibr33-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/2053951714541861"},{"key":"bibr34-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/1527476418806091"},{"key":"bibr35-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1111\/issj.12154"},{"key":"bibr36-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1108\/JICES-08-2013-0030"},{"key":"bibr37-2053951719895805","doi-asserted-by":"publisher","DOI":"10.24908\/ss.v14i2.5831"},{"key":"bibr38-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1080\/17530350.2016.1273843"},{"key":"bibr39-2053951719895805","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctt1pwt9w5"},{"key":"bibr40-2053951719895805","volume-title":"Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy","author":"O\u2019Neil C","year":"2016"},{"key":"bibr41-2053951719895805","doi-asserted-by":"publisher","DOI":"10.17645\/mac.v3i3.263"},{"key":"bibr42-2053951719895805","doi-asserted-by":"publisher","DOI":"10.4159\/harvard.9780674736061"},{"issue":"5","key":"bibr43-2053951719895805","volume":"17","author":"Pe\u00f1a Gangadharan S","year":"2012","journal-title":"First Monday"},{"key":"bibr44-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1080\/17579961.2018.1452176"},{"key":"bibr45-2053951719895805","first-page":"809","volume":"47","author":"Safari B","year":"2017","journal-title":"Seton Hall Law Review"},{"key":"bibr46-2053951719895805","first-page":"4972","volume":"10","author":"Sandvig C","year":"2016","journal-title":"International Journal of Communication"},{"key":"bibr47-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30487-3_7"},{"key":"bibr48-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-6914-7_13"},{"key":"bibr49-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1093\/idpl\/ipx022"},{"key":"bibr50-2053951719895805","doi-asserted-by":"publisher","DOI":"10.24908\/ss.v1i1.3397"},{"key":"bibr51-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/0263775816633195"},{"key":"bibr52-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1080\/13600869.2017.1298547"},{"key":"bibr53-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1177\/1350506806065753"},{"key":"bibr54-2053951719895805","first-page":"1","volume":"2","author":"Wachter S","year":"2019","journal-title":"Columbia Business Law Review"},{"key":"bibr55-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1093\/idpl\/ipx005"},{"key":"bibr56-2053951719895805","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvhrd092.18"},{"key":"bibr57-2053951719895805","doi-asserted-by":"publisher","DOI":"10.1057\/jit.2015.5"}],"container-title":["Big Data &amp; Society"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/2053951719895805","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/2053951719895805","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/2053951719895805","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T12:57:52Z","timestamp":1777381072000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1177\/2053951719895805"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,7]]}},"alternative-id":["10.1177\/2053951719895805"],"URL":"https:\/\/doi.org\/10.1177\/2053951719895805","relation":{},"ISSN":["2053-9517","2053-9517"],"issn-type":[{"value":"2053-9517","type":"print"},{"value":"2053-9517","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7]]}}}