{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T16:59:06Z","timestamp":1777741146177,"version":"3.51.4"},"reference-count":40,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IP"],"published-print":{"date-parts":[[2021,2,22]]},"abstract":"<jats:p>There is a widespread belief that machine learning tools can be used to improve decision-making in health and social care. At the same time, there are concerns that they pose threats to privacy and confidentiality. Policy makers therefore need to develop governance arrangements that balance benefits and risks associated with the new tools. This article traces the history of developments of information infrastructures for secondary uses of personal datasets, including routine reporting of activity and service planning, in health and social care. The developments provide broad context for a study of the governance implications of new tools for the analysis of health and social care datasets. We find that machine learning tools can increase the capacity to make inferences about the people represented in datasets, although the potential is limited by the poor quality of routine data, and the methods and results are difficult to explain to other stakeholders. We argue that current local governance arrangements are piecemeal, but at the same time reinforce centralisation of the capacity to make inferences about individuals and populations. They do not provide adequate oversight, or accountability to the patients and clients represented in datasets.<\/jats:p>","DOI":"10.3233\/ip-200264","type":"journal-article","created":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T10:20:49Z","timestamp":1605262849000},"page":"57-69","source":"Crossref","is-referenced-by-count":3,"title":["Machine learning, materiality and governance: A health and social care case study"],"prefix":"10.1177","volume":"26","author":[{"given":"Justin","family":"Keen","sequence":"first","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, England"}]},{"given":"Roy","family":"Ruddle","sequence":"additional","affiliation":[{"name":"School of Computing, University of Leeds, Leeds, England"}]},{"given":"Jan","family":"Palczewski","sequence":"additional","affiliation":[{"name":"School of Mathematics, University of Leeds, Leeds, England"}]},{"given":"Georgios","family":"Aivaliotis","sequence":"additional","affiliation":[{"name":"School of Mathematics, University of Leeds, Leeds, England"}]},{"given":"Anna","family":"Palczewska","sequence":"additional","affiliation":[{"name":"School of Built Environment, Engineering and Computing, Leeds Beckett University, Leeds, England"}]},{"given":"Christopher","family":"Megone","sequence":"additional","affiliation":[{"name":"School of Philosophy, University of Leeds, Leeds, England"}]},{"given":"Kevin","family":"Macnish","sequence":"additional","affiliation":[{"name":"Centre for Ethics and Technology, University of Twente, Enschede, Netherlands"}]}],"member":"179","reference":[{"key":"10.3233\/IP-200264_ref1","unstructured":"Adnan, M., Nguyen, P., Ruddle, R. & Turkay, C. (2019) Visual analytics of event data using multiple mining methods. Proceedings of the EuroVis Workshop on Visual Analytics (EuroVA), 2019."},{"key":"10.3233\/IP-200264_ref2","unstructured":"Adnan, M. & Ruddle, R. (2018) A set-based visual analytics approach to analyze retail data. Proceedings of the EuroVis Workshop on Visual Analytics (EuroVA), 2018."},{"key":"10.3233\/IP-200264_ref3","unstructured":"AHSN Network (2020)Accelerating artificial intelligence in health and care: results from a state of the nation survey, https:\/\/bit.ly\/30K8AHM\u00a0\u2013 accessed 9th October 2020"},{"key":"10.3233\/IP-200264_ref4","doi-asserted-by":"crossref","first-page":"100203","DOI":"10.1016\/j.cosrev.2019.100203","article-title":"Application of deep learning for retinal analysis: a review","volume":"35","author":"Badar","year":"2020","journal-title":"Computer Science Review"},{"issue":"2","key":"10.3233\/IP-200264_ref5","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1093\/ageing\/afq181","article-title":"Predicting who will use intensive social care: case finding tools based on linked health and social care data","volume":"40","author":"Bardsley","year":"2011","journal-title":"Age and Ageing"},{"issue":"1","key":"10.3233\/IP-200264_ref6","doi-asserted-by":"crossref","first-page":"11","DOI":"10.15265\/IY-2015-020","article-title":"Health information technology and care coordination: the next big opportunity for informatics","volume":"10","author":"Bates","year":"2015","journal-title":"Yearb Med Inform"},{"key":"10.3233\/IP-200264_ref7","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1186\/1472-6963-14-370","article-title":"Implementing electronic health records in hospitals: a systematic literature review","volume":"14","author":"Boonstra","year":"2014","journal-title":"BMC Health Serv Res"},{"key":"10.3233\/IP-200264_ref9","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1038\/s41586-018-0579-z","article-title":"The UK Biobank resource with deep phenotyping and genomic data","volume":"562","author":"Bycroft","year":"2018","journal-title":"Nature"},{"issue":"8","key":"10.3233\/IP-200264_ref10","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1080\/13642987.2017.1348707","article-title":"The uncounted: politics of data and visibility in global health","volume":"21","author":"Davis","year":"2017","journal-title":"The International Journal of Human Rights"},{"key":"10.3233\/IP-200264_ref11","doi-asserted-by":"crossref","unstructured":"Dourish, P. & Cruz, E. (2018) Datafication and data fiction: narrating data and narrating with data. Big Data and Society, July-December 1-10.","DOI":"10.1177\/2053951718784083"},{"key":"10.3233\/IP-200264_ref12","doi-asserted-by":"crossref","unstructured":"Dourish, P. (2016) Algorithms and their others: algorithmic culture in context. Big Data and Society, July-December 1-11.","DOI":"10.1177\/2053951716665128"},{"key":"10.3233\/IP-200264_ref14","doi-asserted-by":"crossref","unstructured":"Ezrachi, A., & Stucke, M. (2016) Virtual competition: the promise and perils of the algorithm-driven economy. Cambridge MA: Harvard University Press.","DOI":"10.4159\/9780674973336"},{"issue":"2","key":"10.3233\/IP-200264_ref15","first-page":"271","article-title":"Beyond the \u201cNature\u201d of Data: Obstacles to Protecting Sensitive Information in the European Union and the United States","volume":"46","author":"Fazlioglu","year":"2019","journal-title":"Fordham Urban Law Journal"},{"key":"10.3233\/IP-200264_ref16","doi-asserted-by":"crossref","unstructured":"Fernow, J., de Miguel Beriain, I., Brey, P., & Stahl, B. (2019). Setting future ethical standards for ICT, Big Data, AI and robotics. ORBIT Journal, 2019(1).","DOI":"10.29297\/orbit.v2019i1.115"},{"key":"10.3233\/IP-200264_ref17","unstructured":"Future Advocacy (2018) Ethical, social and political challenges of artificial intelligence in health. London: Wellcome Trust."},{"key":"10.3233\/IP-200264_ref19","doi-asserted-by":"crossref","unstructured":"Hanseth, O., & Ciborra, C. (Editors) (2007) Risk, complexity and ICT. Cheltenham: Edward Elgar.","DOI":"10.4337\/9781847207005"},{"issue":"2","key":"10.3233\/IP-200264_ref21","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1017\/S0963180115000614","article-title":"How Should Health Data Be Used","volume":"25","author":"Kaplan","year":"2016","journal-title":"Camb Q Healthc Ethics"},{"key":"10.3233\/IP-200264_ref22","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1186\/s13643-019-1223-1","article-title":"Networked information technologies and patient safety: a protocol for a realist synthesis","volume":"8","author":"Keen","year":"2019","journal-title":"Syst Rev"},{"key":"10.3233\/IP-200264_ref23","doi-asserted-by":"crossref","first-page":"e022921","DOI":"10.1136\/bmjopen-2018-022921","article-title":"From embracing to managing risks","volume":"8","author":"Keen","year":"2018","journal-title":"BMJ Open"},{"key":"10.3233\/IP-200264_ref24","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1136\/jme.20.2.69","article-title":"Between ourselves","volume":"20","author":"Kennedy","year":"1994","journal-title":"Br J Med Ethics"},{"key":"10.3233\/IP-200264_ref25","unstructured":"Laurie, G., Stevens, L., Jones, K., & Dobbs, C. (2015) A Review of Evidence Relating to Harm Resulting from Uses of Health and Biomedical Data. London: Nuffield Council on Bioethics."},{"key":"10.3233\/IP-200264_ref26","unstructured":"Malik, M. (2020) A Hierarchy of Limitations in Machine Learning. arXiv:2002.05193."},{"key":"10.3233\/IP-200264_ref28","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11948-015-9652-2","article-title":"The ethics of big data: current and foreseeable issues in biomedical contexts","volume":"22","author":"Mittelstadt","year":"2016","journal-title":"Sci Eng Ethics"},{"issue":"1","key":"10.3233\/IP-200264_ref29","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1136\/bmjqs-2018-008216","article-title":"Scaffolding our systems? Patients and families \u2018reaching in\u2019 as a source of healthcare resilience","volume":"28","author":"O\u2019Hara","year":"2019","journal-title":"BMJ Qual Saf"},{"key":"10.3233\/IP-200264_ref30","unstructured":"O\u2019Neil, C. (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. London: Penguin."},{"key":"10.3233\/IP-200264_ref31","doi-asserted-by":"crossref","unstructured":"O\u2019Neill, O. (2002) Autonomy and trust in bioethics. Cambridge: Cambridge University Press.","DOI":"10.1017\/CBO9780511606250"},{"key":"10.3233\/IP-200264_ref32","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1186\/s13643-019-0971-2","article-title":"Evaluation of interventions to improve electronic health record documentation within the inpatient setting: a protocol for a systematic review","volume":"8","author":"Otero Varela","year":"2019","journal-title":"Syst Rev"},{"key":"10.3233\/IP-200264_ref33","doi-asserted-by":"crossref","unstructured":"Palczewska, A. & Palczewski, J. (2019) Risk stratification for ASC services. Leeds: Leeds City Council.","DOI":"10.12968\/cypn.2019.3.54"},{"key":"10.3233\/IP-200264_ref34","doi-asserted-by":"crossref","unstructured":"Palczewska, A., Palczewski, J., Aivaliotis, G., & Kowalik, L. (2017) RobustSPAM for inference from noisy longitudinal data and preservation of privacy. Proceedings of 6th IEEE International Conference on Machine Learning and Applications (ICMLA), 2017.","DOI":"10.1109\/ICMLA.2017.0-137"},{"key":"10.3233\/IP-200264_ref35","first-page":"217","article-title":"The comparative value of 3 electronic sources of medication data","volume":"6","author":"Pfoh","year":"2014","journal-title":"American Journal of Pharmacy Benefits"},{"key":"10.3233\/IP-200264_ref36","doi-asserted-by":"crossref","unstructured":"Pollock, N., & Williams, R. (2009) Software and organisations. London: Routledge.","DOI":"10.4324\/9780203891940"},{"key":"10.3233\/IP-200264_ref37","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s12553-017-0179-1","article-title":"Google DeepMind and healthcare in an age of algorthms","volume":"7","author":"Powles","year":"2017","journal-title":"Health and Technology"},{"key":"10.3233\/IP-200264_ref38","unstructured":"Richardson, G. (1991) Feedback thought in social science and systems theory. Philadelphia, University of Pennsylvania Press."},{"key":"10.3233\/IP-200264_ref39","doi-asserted-by":"crossref","first-page":"230","DOI":"10.5220\/0007354802300238","article-title":"Using Miniature Visualizations of Descriptive Statistics to Investigate the Quality of Electronic Health Records","author":"Ruddle","year":"2019","journal-title":"Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies\u00a0\u2013 Volume 5: HEALTHINF"},{"key":"10.3233\/IP-200264_ref40","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.neucom.2017.01.105","article-title":"What you see is what you can change: Human-centered machine learning by interactive visualization","volume":"268","author":"Sacha","year":"2019","journal-title":"Neurocomputing"},{"key":"10.3233\/IP-200264_ref41","first-page":"59","article-title":"Fairness and Abstraction in Sociotechnical Systems. In: Proceedings of the Conference on Fairness, Accountability, and Transparency","author":"Selbst","year":"2019","journal-title":"Atlanta: Association for Computing Machinery"},{"issue":"14","key":"10.3233\/IP-200264_ref42","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1001\/jama.2019.10306","article-title":"Making Machine Learning Models Clinically Useful","volume":"322","author":"Shah","year":"2019","journal-title":"JAMA"},{"key":"10.3233\/IP-200264_ref43","unstructured":"Tanner, A. (2017) Strengthening Protection of Patient Medical Data. New York: The Century Foundation."},{"key":"10.3233\/IP-200264_ref44","first-page":"1","article-title":"The value of health care information exchange and interoperability","volume":"19","author":"Walker","year":"2005","journal-title":"Health Affairs"},{"key":"10.3233\/IP-200264_ref45","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1038\/s41591-019-0548-6","article-title":"Do no harm: a roadmap for responsible machine learning for health care","volume":"25","author":"Wiens","year":"2019","journal-title":"Nat Med"}],"container-title":["Information Polity"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IP-200264","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T11:28:26Z","timestamp":1777462106000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IP-200264"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,22]]},"references-count":40,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/ip-200264","relation":{},"ISSN":["1570-1255","1875-8754"],"issn-type":[{"value":"1570-1255","type":"print"},{"value":"1875-8754","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,22]]}}}