{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T05:45:12Z","timestamp":1775367912388,"version":"3.50.1"},"reference-count":102,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T00:00:00Z","timestamp":1695340800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T00:00:00Z","timestamp":1695340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Alma Mater Studiorum - Universit\u00e0 di Bologna"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Minds &amp; Machines"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Online controlled experiments, also known as A\/B tests, have become ubiquitous. While many practical challenges in running experiments at scale have been thoroughly discussed, the ethical dimension of A\/B testing has been neglected. This article fills this gap in the literature by introducing a new, soft ethics and governance framework that explicitly recognizes how the rise of an experimentation culture in industry settings brings not only unprecedented opportunities to businesses but also significant responsibilities. More precisely, the article (a) introduces a set of principles to encourage ethical and responsible experimentation to protect users, customers, and society; (b) argues that ensuring compliance with the proposed principles is a complex challenge unlikely to be addressed by resorting to a one-solution response; (c) discusses the relevance and effectiveness of several mechanisms and policies in educating, governing, and incentivizing companies conducting online controlled experiments; and (d) offers a list of prompting questions specifically designed to help and empower practitioners by stimulating specific ethical deliberations and facilitating coordination among different groups of stakeholders.<\/jats:p>","DOI":"10.1007\/s11023-023-09644-y","type":"journal-article","created":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T13:01:55Z","timestamp":1695387715000},"page":"667-693","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["The Ethics of Online Controlled Experiments (A\/B Testing)"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7275-5902","authenticated-orcid":false,"given":"Andrea","family":"Polonioli","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8645-7401","authenticated-orcid":false,"given":"Riccardo","family":"Ghioni","sequence":"additional","affiliation":[]},{"given":"Ciro","family":"Greco","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9676-8916","authenticated-orcid":false,"given":"Prathm","family":"Juneja","sequence":"additional","affiliation":[]},{"given":"Jacopo","family":"Tagliabue","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9632-2159","authenticated-orcid":false,"given":"David","family":"Watson","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5444-2280","authenticated-orcid":false,"given":"Luciano","family":"Floridi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,22]]},"reference":[{"key":"9644_CR1","unstructured":"Akhtar, A. (2021). California is banning companies from using \u2019dark patterns,\u2019 a sneaky website design that makes things like canceling a subscription frustratingly difficult. Retrieved January 2, 2021 from https:\/\/www.businessinsider.com\/what-are-dark-patterns-2021-3?r=US&IR=T"},{"issue":"1","key":"9644_CR3","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1093\/qje\/qjx029","volume":"133","author":"M Alsan","year":"2018","unstructured":"Alsan, M., & Wanamaker, M. (2018). Tuskegee and the health of black men. The Quarterly Journal of Economics, 133(1), 407\u2013455. https:\/\/doi.org\/10.1093\/qje\/qjx029","journal-title":"The Quarterly Journal of Economics"},{"key":"9644_CR4","volume-title":"Mastering \u2019metrics: The path from cause to effect","author":"J Angrist","year":"2015","unstructured":"Angrist, J., & Pischke, J. (2015). Mastering \u2019metrics: The path from cause to effect. Princeton University Press."},{"key":"9644_CR5","doi-asserted-by":"publisher","DOI":"10.2307\/25148715","author":"NF Awad","year":"2006","unstructured":"Awad, N. F., & Krishnan, M. S. (2006). The personalization privacy paradox: An empirical evaluation of information transparency and the willingness to be profiled online for personalization. MIS Quarterly. https:\/\/doi.org\/10.2307\/25148715","journal-title":"MIS Quarterly"},{"issue":"3","key":"9644_CR6","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1017\/S0963180101003048","volume":"10","author":"R Baker","year":"2001","unstructured":"Baker, R. (2001). Bioethics and human rights: A historical perspective. Cambridge Quarterly of Healthcare Ethics, 10(3), 241\u2013252.","journal-title":"Cambridge Quarterly of Healthcare Ethics"},{"key":"9644_CR8","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1353\/ken.2003.0019","volume":"13","author":"T Beauchamp","year":"2003","unstructured":"Beauchamp, T. (2003). A defense of the common morality. Kennedy Institute of Ethics Journal, 13, 259\u2013274. https:\/\/doi.org\/10.1353\/ken.2003.0019","journal-title":"Kennedy Institute of Ethics Journal"},{"key":"9644_CR9","volume-title":"Principles of biomedical ethics","author":"T Beauchamp","year":"2001","unstructured":"Beauchamp, T., & Childress, J. (2001). Principles of biomedical ethics. Oxford University Press."},{"key":"9644_CR10","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.01943","author":"R Bellamy","year":"2018","unstructured":"Bellamy, R., Kuntal, D., Hind, M., Hoffman, S., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., & Mojsilovic, A. (2018). AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias. Artificial Intelligence. https:\/\/doi.org\/10.48550\/arXiv.1810.01943","journal-title":"Artificial Intelligence"},{"issue":"3\u20134","key":"9644_CR11","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1177\/1747016116680664","volume":"13","author":"R Benbunan-Fich","year":"2017","unstructured":"Benbunan-Fich, R. (2017). The ethics of online research with unsuspecting users: From A\/B testing to C\/D experimentation. Research Ethics, 13(3\u20134), 200\u2013218.","journal-title":"Research Ethics"},{"key":"9644_CR12","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1257\/aer.20130848","volume":"105","author":"D Bergemann","year":"1996","unstructured":"Bergemann, D., Brooks, B., & Morris, S. (1996). The limits of price discrimination. American Economic Review, 105, 921\u2013957.","journal-title":"American Economic Review"},{"key":"9644_CR13","doi-asserted-by":"crossref","unstructured":"Binns, R., (2020). On the apparent conflict between individual and group fairness. In Proceedings of the 2020 conference on fairness, accountability, and transparency (pp. 514\u2013524).","DOI":"10.1145\/3351095.3372864"},{"key":"9644_CR1003","unstructured":"Boesel, W. E. (2014). Facebook\u2019s Controversial Experiment: Big Tech Is the New Big Pharma. Retrieved January 2, 2021 from https:\/\/time.com\/2951726\/facebook-emotion-contagion-experiment\/."},{"key":"9644_CR14","doi-asserted-by":"crossref","unstructured":"Bondi, E., Xu, L., Acosta-Navas, D. and Killian, J.A., (2021). Envisioning communities: a participatory approach towards AI for social good. In Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society (pp. 425\u2013436).","DOI":"10.1145\/3461702.3462612"},{"issue":"3","key":"9644_CR15","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1080\/08989620600848561","volume":"13","author":"L Bortolotti","year":"2006","unstructured":"Bortolotti, L., & Mameli, M. (2006). Deception in psychology: Moral costs and benefits of unsought self-knowledge. Accountability in Research, 13(3), 259\u2013275.","journal-title":"Accountability in Research"},{"issue":"2","key":"9644_CR17","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1525\/jer.2006.1.2.39","volume":"1","author":"S Burris","year":"2006","unstructured":"Burris, S., & Moss, K. (2006). US health researchers review their ethics review boards: A qualitative study. Journal of Empirical Research on Human Research Ethics, 1(2), 39\u201358.","journal-title":"Journal of Empirical Research on Human Research Ethics"},{"key":"9644_CR18","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/978-3-030-50585-1_2","volume-title":"Ethics of digital well-being: A multidisciplinary approach","author":"R Calvo","year":"2020","unstructured":"Calvo, R., Dorian, P., Vold, K., & Ryan, R. (2020). Supporting human autonomy in AI systems: A framework for ethical enquiry. Ethics of digital well-being: A multidisciplinary approach (pp. 31\u201354). Springer."},{"issue":"1","key":"9644_CR19","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1017\/S0266267114000042","volume":"30","author":"R Claassen","year":"2014","unstructured":"Claassen, R. (2014). Capability paternalism. Economics & Philosophy, 30(1), 57\u201373.","journal-title":"Economics & Philosophy"},{"issue":"2","key":"9644_CR20","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1093\/jmp\/15.2.219","volume":"15","author":"KD Clouser","year":"1990","unstructured":"Clouser, K. D., & Gert, B. (1990). A critique of principlism. The Journal of Medicine and Philosophy, 15(2), 219\u2013236.","journal-title":"The Journal of Medicine and Philosophy"},{"key":"9644_CR21","unstructured":"Costa, E., & Halpern, D. (2019). The behavioural science of online harm and manipulation, and what to do about it (pp. 1\u201382) [Technical Report]. https:\/\/www.cxmlab.com\/wp-content\/uploads\/2019\/07\/BIT_The-behavioural-science-of-online-harm-and-manipulation-and-what-to-do-about-it_Single-2.pdf"},{"key":"9644_CR22","volume-title":"The intentional stance","author":"D Dennett","year":"1987","unstructured":"Dennett, D. (1987). The intentional stance. MIT Press."},{"key":"9644_CR23","doi-asserted-by":"publisher","DOI":"10.1515\/9781400834655","author":"N Dow Sch\u00fcll","year":"2012","unstructured":"Dow Sch\u00fcll, N. (2012). Addiction by design. Princeton University Press. https:\/\/doi.org\/10.1515\/9781400834655","journal-title":"Princeton University Press"},{"key":"9644_CR24","unstructured":"Drayna, G, Chen, CJ & Schulte, M. (2021). A\/B tests for Lyft Hardware. Lyft (March 2021). Retrieved January 2, 2021 from https:\/\/eng.lyft.com\/a-b-tests-for-lyft-hardware-570330b488d4"},{"key":"9644_CR25","doi-asserted-by":"publisher","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012). Fairness through awareness. Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, pp. 214--226. https:\/\/doi.org\/10.1145\/2090236.2090255","DOI":"10.1145\/2090236.2090255"},{"key":"9644_CR26","volume-title":"Cannibals with forks. The triple bottom line of 21st century","author":"J Elkington","year":"1997","unstructured":"Elkington, J. (1997). Cannibals with forks. The triple bottom line of 21st century. New Society Publishers."},{"key":"9644_CR27","unstructured":"European Union. (2012). Charter of Fundamental Rights of the European Union. https:\/\/www.refworld.org\/docid\/3ae6b3b70.html"},{"issue":"4","key":"9644_CR32","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s13347-017-0291-1","volume":"30","author":"L Floridi","year":"2017","unstructured":"Floridi, L. (2017). Infraethics\u2013on the Conditions of Possibility of Morality. Philosophy & Technology, 30(4), 391\u2013394.","journal-title":"Philosophy & Technology"},{"issue":"2133","key":"9644_CR33","doi-asserted-by":"publisher","first-page":"20180081","DOI":"10.1098\/rsta.2018.0081","volume":"376","author":"L Floridi","year":"2018","unstructured":"Floridi, L. (2018). Soft ethics, the governance of the digital and the general data protection regulation. Philosophical Transactions of the Royal Society a: Mathematical, Physical and Engineering Sciences, 376(2133), 20180081.","journal-title":"Philosophical Transactions of the Royal Society a: Mathematical, Physical and Engineering Sciences"},{"key":"9644_CR34","doi-asserted-by":"publisher","DOI":"10.1162\/99608f92.8cd550d1","author":"L Floridi","year":"2019","unstructured":"Floridi, L., & Cowls, J. A. (2019). Unified framework of five principles for AI in society. Harvard Data Science Review. https:\/\/doi.org\/10.1162\/99608f92.8cd550d1","journal-title":"Harvard Data Science Review"},{"key":"9644_CR35","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/978-94-007-7844-3_4","volume-title":"Early engagement and new technologies: Opening up the laboratory philosophy of engineering and technology","author":"B Friedman","year":"2013","unstructured":"Friedman, B., Kahn, P. H., Borning, A., & Huldtgren, A. (2013). Value sensitive design and information systems. In N. Doorn, D. Schuurbiers, I. van de Poel, & M. Gorman (Eds.), Early engagement and new technologies: Opening up the laboratory philosophy of engineering and technology (Vol. 16, pp. 55\u201395). Springer. https:\/\/doi.org\/10.1007\/978-94-007-7844-3_4"},{"key":"9644_CR36","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1145\/230538.230561","volume":"14","author":"B Friedman","year":"1996","unstructured":"Friedman, B., & Nissenbaum, H. (1996). Bias in computer systems. ACM Transactions on Information Systems (TOIS), 14, 330\u2013347. https:\/\/doi.org\/10.1145\/230538.230561","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"key":"9644_CR37","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1111\/1758-5899.12965","volume":"12","author":"S Fukuda-Parr","year":"2021","unstructured":"Fukuda-Parr, S., & Gibbons, E. (2021). emerging consensus on \u2018Ethical AI\u2019: Human rights critique of stakeholder guidelines. Global Policy, 12, 32\u201344.","journal-title":"Global Policy"},{"issue":"2","key":"9644_CR38","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1002\/hast.548","volume":"46","author":"L Gelinas","year":"2016","unstructured":"Gelinas, L., Wertheimer, A., & Miller, F. G. (2016). When and why is research without consent permissible? Hastings Center Report, 46(2), 35\u201343.","journal-title":"Hastings Center Report"},{"key":"9644_CR39","doi-asserted-by":"publisher","unstructured":"Geyik, S., Ambler, S., & Kenthapadi, K. (2019). Fairness-aware ranking in search\\& recommendation systems with application to linkedin talent search. Proceedings of the 25th Acm Sigkdd International Conference on Knowledge Discovery & Data Mining, pp. 2221\u20132231. https:\/\/doi.org\/10.1145\/3292500.3330691","DOI":"10.1145\/3292500.3330691"},{"key":"9644_CR40","doi-asserted-by":"crossref","unstructured":"Gilotte, A., Calauz\u00e8nes, C., Nedelec, T., Abraham, A. & Doll\u00e9, S. (2018). Offline a\/b testing for recommender systems. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining (pp. 198\u2013206).","DOI":"10.1145\/3159652.3159687"},{"issue":"1998","key":"9644_CR41","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1023\/A:1008234330618","volume":"8","author":"C Glymour","year":"1998","unstructured":"Glymour, C. (1998). Learning causes: Psychological explanations of causal explanation. Minds & Machines, 8(1998), 39\u201360.","journal-title":"Minds & Machines"},{"key":"9644_CR42","first-page":"219","volume":"13","author":"J Grimmelmann","year":"2015","unstructured":"Grimmelmann, J. (2015). The law and ethics of experiments on social media users. Colo. Tech. LJ, 13, 219.","journal-title":"Colo. Tech. LJ"},{"issue":"3","key":"9644_CR1000","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1017\/S0140525X01004149","volume":"24","author":"R Hertwig","year":"2001","unstructured":"Hertwig, R., & Ortmann, A. (2001). Experimental practices in economics: A methodological challenge for psychologists? Behavioral and Brain Sciences, 24(3), 383\u2013403.","journal-title":"Behavioral and Brain Sciences"},{"key":"9644_CR43","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.1007\/s11948-015-9689-2","volume":"22","author":"M Horvat","year":"2015","unstructured":"Horvat, M., Mlinaric, A., Omazic, J., & Supak-Smolcic, V. (2015). An analysis of medical laboratory technology journals\u2019 instructions for authors. Science and Engineering Ethics, 22, 1095\u20131106.","journal-title":"Science and Engineering Ethics"},{"key":"9644_CR44","volume-title":"Why organizations should care about responsible AI & digital ethics","author":"IDC","year":"2021","unstructured":"IDC. (2021). Why organizations should care about responsible AI & digital ethics. IDC."},{"key":"9644_CR45","doi-asserted-by":"publisher","first-page":"3767","DOI":"10.1145\/3442381.3450077","volume":"2021","author":"B Imana","year":"2021","unstructured":"Imana, B., Korolova, A., & Heidemann, J. (2021). Auditing for discrimination in algorithms delivering job ads. Proceedings of the Web Conference, 2021, 3767\u20133778. https:\/\/doi.org\/10.1145\/3442381.3450077","journal-title":"Proceedings of the Web Conference"},{"key":"9644_CR46","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"GW Imbens","year":"2015","unstructured":"Imbens, G. W., & Rubin, D. B. (2015). Causal inference in statistics, social, and biomedical sciences. Cambridge University Press."},{"issue":"2009","key":"9644_CR47","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1111\/j.1756-2171.2009.00083.x","volume":"4","author":"R Inderst","year":"2009","unstructured":"Inderst, R., & Shaffer, G. (2009). Market power, price discrimination, and allocative efficiency in intermediate-goods markets. The RAND Journal of Economics, 4(2009), 658\u2013672.","journal-title":"The RAND Journal of Economics"},{"key":"9644_CR48","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9760.2006.00253.x","volume":"14","author":"A Jaggar","year":"2006","unstructured":"Jaggar, A. (2006). Reasoning about well-being: Nussbaum\u2019s methods of justifying the capabilities. Journal of Political Philosophy, 14, 301\u2013322.","journal-title":"Journal of Political Philosophy"},{"key":"9644_CR49","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1145\/3287560.3287565","volume":"2019","author":"S Jiang","year":"2019","unstructured":"Jiang, S., Martin, J., & Wilson, C. (2019). Who\u2019s the Guinea Pig? Investigating online A\/B\/n tests in-the-wild. Proceedings of the Conference on Fairness, Accountability, and Transparency, 2019, 201\u2013210. https:\/\/doi.org\/10.1145\/3287560.3287565","journal-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency"},{"issue":"9","key":"9644_CR50","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389\u2013399.","journal-title":"Nature Machine Intelligence"},{"key":"9644_CR51","first-page":"728","volume":"76","author":"D Kahneman","year":"1986","unstructured":"Kahneman, D., Knetsch, J., & Thaler, R. (1986). Fairness as a constraint on profit seeking: Entitlements in the market. The American Economic Review, 76, 728\u2013741.","journal-title":"The American Economic Review"},{"key":"9644_CR52","unstructured":"Katsimerou, C. (2020). There's more to experimentation than A\/B. Booking. https:\/\/booking.ai\/theres-more-to-experimentation-than-a-b-223fba846876."},{"key":"9644_CR53","first-page":"401","volume-title":"APA handbook of ethics in psychology","author":"AJ Kimmel","year":"2012","unstructured":"Kimmel, A. J. (2012). Deception in research. In S. J. Knapp (Ed.), APA handbook of ethics in psychology (pp. 401\u2013421). American Psychological Association."},{"key":"9644_CR54","doi-asserted-by":"crossref","unstructured":"Kohavi, R., Deng, A., Frasca, B., Walker, T., Xu, Y. and Pohlmann, N., (2013), August. Online controlled experiments at large scale. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1168\u20131176).","DOI":"10.1145\/2487575.2488217"},{"key":"9644_CR55","doi-asserted-by":"publisher","DOI":"10.1017\/9781108653985","volume-title":"Trustworthy online controlled experiments: A practical guide to a\/b testing","author":"R Kohavi","year":"2020","unstructured":"Kohavi, R., Tang, D., & Xu, Y. (2020). Trustworthy online controlled experiments: A practical guide to a\/b testing. Cambridge University Press."},{"issue":"24","key":"9644_CR56","doi-asserted-by":"publisher","first-page":"8788","DOI":"10.1073\/pnas.1320040111","volume":"111","author":"A Kramer","year":"2014","unstructured":"Kramer, A., Guillory, J., & Hancock, J. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24), 8788\u20138790. https:\/\/doi.org\/10.1073\/pnas.1320040111","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"9644_CR57","unstructured":"Larson J, Angwin J and Valentino-DeVreis J (2017) How We are Monitoring Political Ads on Facebook. ProPublica, 5 December. Available at: www.propublica.org\/article\/howwe-are-monitoring-political-ads-on-facebook (Accessed 5 May 2021)."},{"issue":"2","key":"9644_CR58","first-page":"37","volume":"48","author":"AP Liberale","year":"2017","unstructured":"Liberale, A. P., & Kovach, J. V. (2017). Reducing the time for IRB reviews: A case study. Journal of Research Administration, 48(2), 37\u201350.","journal-title":"Journal of Research Administration"},{"key":"9644_CR59","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2111.10198","author":"CH Liu","year":"2021","unstructured":"Liu, C. H., Cardoso, \u00c2., Couturier, P., & McCoy, E. J. (2021). Datasets for online controlled experiments. Databases. https:\/\/doi.org\/10.48550\/arXiv.2111.10198","journal-title":"Databases"},{"issue":"12_Part_1","key":"9644_CR60","first-page":"5940","volume":"44","author":"LA Loeb","year":"1984","unstructured":"Loeb, L. A., Emster, V. L., Warner, K. E., Abbotts, J., & Laszlo, J. (1984). Smoking and lung cancer: An overview. Cancer Research, 44(12_Part_1), 5940\u20135958.","journal-title":"Cancer Research"},{"key":"9644_CR61","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481371","author":"E Luger","year":"2013","unstructured":"Luger, E., Moran, S., & Rodden, T. (2013). Consent for all: Revealing the hidden complexity of terms and conditions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/2470654.2481371","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"issue":"11","key":"9644_CR62","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1111\/bioe.12403","volume":"32","author":"D MacKay","year":"2018","unstructured":"MacKay, D. (2018). The ethics of public policy RCTs: The principle of policy equipoise. Bioethics, 32(11), 59\u201367. https:\/\/doi.org\/10.1111\/bioe.12403","journal-title":"Bioethics"},{"key":"9644_CR63","volume-title":"The cement of the universe: A study of causation","author":"J Mackie","year":"1974","unstructured":"Mackie, J. (1974). The cement of the universe: A study of causation. Clarendon Press."},{"key":"9644_CR64","doi-asserted-by":"crossref","unstructured":"Mathur, A., Kshirsagar, M., & Mayer, J. (2021). What makes a dark pattern... Dark? Design attributes, normative considerations, and measurement methods. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1\u201318)","DOI":"10.1145\/3411764.3445610"},{"issue":"1","key":"9644_CR65","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-021-00934-7","volume":"8","author":"JN Matias","year":"2021","unstructured":"Matias, J. N., Munger, K., Le Quere, M. A., & Ebersole, C. (2021). The upworthy research archive, a time series of 32,487 experiments in US media. Scientific Data, 8(1), 1\u20136.","journal-title":"Scientific Data"},{"key":"9644_CR66","doi-asserted-by":"crossref","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D. & Gebru, T., (2019). Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 220\u2013229).","DOI":"10.1145\/3287560.3287596"},{"issue":"1","key":"9644_CR67","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.im.2017.05.001","volume":"55","author":"M Moqbel","year":"2018","unstructured":"Moqbel, M., & Kock, N. (2018). Unveiling the dark side of social networking sites: Personal and work-related consequences of social networking site addiction. Information & Management, 55(1), 109\u2013119. https:\/\/doi.org\/10.1016\/j.im.2017.05.001","journal-title":"Information & Management"},{"key":"9644_CR68","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.cs\/0610105","author":"A Narayanan","year":"2006","unstructured":"Narayanan, A., & Shmatikov, V. (2006). How to break anonymity of the Netflix prize dataset. Cryptography and Security. https:\/\/doi.org\/10.48550\/arXiv.cs\/0610105","journal-title":"Cryptography and Security"},{"key":"9644_CR69","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1177\/0090591707310088","volume":"36","author":"E Nelson","year":"2008","unstructured":"Nelson, E. (2008). From primary goods to capabilities: Distributive justice and the problem of neutrality. Political Theory, 36, 93\u2013122.","journal-title":"Political Theory"},{"key":"9644_CR70","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479833641.001.0001","volume-title":"Algorithms of oppression","author":"SA Noble","year":"2018","unstructured":"Noble, S. A. (2018). Algorithms of oppression. New York University Press."},{"key":"9644_CR71","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511841286","volume-title":"Women and human development: The capabilities approach","author":"MD Nussbaum","year":"2000","unstructured":"Nussbaum, M. D. (2000). Women and human development: The capabilities approach. Harvard University Press."},{"key":"9644_CR73","doi-asserted-by":"publisher","first-page":"5","DOI":"10.53841\/bpsrep.2021.inf180","volume-title":"Code of human research ethics","author":"J Oates","year":"2021","unstructured":"Oates, J., Kwiatkowski, R., & Coulthard, L. M. (2021). Code of human research ethics (pp. 5\u201330). UK British Psychological Society Psychol Soc."},{"issue":"1","key":"9644_CR74","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1080\/1369118X.2018.1486870","volume":"23","author":"JA Obar","year":"2020","unstructured":"Obar, J. A., & Oeldorf-Hirsch, A. (2020). The biggest lie on the internet: Ignoring the privacy policies and terms of service policies of social networking services. Information, Communication & Society, 23(1), 128\u2013147.","journal-title":"Information, Communication & Society"},{"issue":"15","key":"9644_CR75","doi-asserted-by":"crossref","first-page":"8503","DOI":"10.3390\/su13158503","volume":"13","author":"A Owe","year":"2021","unstructured":"Owe, A., & Baum, S. (2021). The ethics of sustainability for artificial intelligence. Sustainability, 13(15), 8503.","journal-title":"Sustainability"},{"issue":"1","key":"9644_CR76","doi-asserted-by":"publisher","first-page":"70","DOI":"10.4103\/2229-3485.106394","volume":"4","author":"M Pandya","year":"2013","unstructured":"Pandya, M., & Desai, C. (2013). Compensation in clinical research: The debate continues. Perspectives in Clinical Research, 4(1), 70.","journal-title":"Perspectives in Clinical Research"},{"key":"9644_CR77","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality","author":"J Pearl","year":"2009","unstructured":"Pearl, J. (2009). Causality. Cambridge University Press."},{"key":"9644_CR78","doi-asserted-by":"crossref","unstructured":"Pedreschi, D., Ruggieri, S., & Turini, F. (2008). Discrimination-aware data mining. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 560--568)","DOI":"10.1145\/1401890.1401959"},{"key":"9644_CR79","first-page":"288","volume-title":"Elements of causal inference: Foundations and learning algorithms","author":"J Peters","year":"2017","unstructured":"Peters, J., Janzing, D., & Sch\u00f6lkopf, B. (2017). Elements of causal inference: Foundations and learning algorithms (p. 288). MIT Press."},{"issue":"4","key":"9644_CR80","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1007\/s11948-016-9838-2","volume":"23","author":"A Polonioli","year":"2017","unstructured":"Polonioli, A. (2017). New issues for new methods: Ethical and editorial challenges for an experimental philosophy. Science and Engineering Ethics, 23(4), 1009\u20131034.","journal-title":"Science and Engineering Ethics"},{"key":"9644_CR81","doi-asserted-by":"publisher","first-page":"106294","DOI":"10.1016\/j.chb.2020.106294","volume":"107","author":"S Ponnusamy","year":"2020","unstructured":"Ponnusamy, S., Iranmanesh, M., Foroughi, B., & Hyun, S. S. (2020). Drivers and outcomes of Instagram addiction: Psychological well-being as moderator. Computers in Human Behavior, 107, 106294. https:\/\/doi.org\/10.1016\/j.chb.2020.106294","journal-title":"Computers in Human Behavior"},{"issue":"6612","key":"9644_CR82","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1126\/science.abl4476","volume":"377","author":"K Rajkumar","year":"2022","unstructured":"Rajkumar, K., Saint-Jacques, G., Bojinov, I., Brynjolfsson, E., & Aral, S. (2022). A causal test of the strength of weak ties. Science, 377(6612), 1304\u20131310.","journal-title":"Science"},{"key":"9644_CR83","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s11017-008-9061-5","volume":"29","author":"O Rauprich","year":"2008","unstructured":"Rauprich, O. (2008). Common morality: Comment on Beauchamp and Childress. Theoretical Medicine and Bioethics, 29, 43\u201371.","journal-title":"Theoretical Medicine and Bioethics"},{"key":"9644_CR84","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvjf9z6v","author":"J Rawls","year":"1971","unstructured":"Rawls, J. (1971). A theory of justice. Harvard University Press, Belknap Press. https:\/\/doi.org\/10.2307\/j.ctvjf9z6v","journal-title":"Harvard University Press, Belknap Press."},{"key":"9644_CR85","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68756-8","volume-title":"The ethics of research with human subjects Protecting people, advancing science, promoting trust","author":"D Resnik","year":"2018","unstructured":"Resnik, D. (2018). The ethics of research with human subjects Protecting people, advancing science, promoting trust. Springer."},{"key":"9644_CR87","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2002.05819","author":"G Saint-Jacques","year":"2020","unstructured":"Saint-Jacques, G., Sepehri, A., Li, N., & Perisic, I. (2020). Fairness through experimentation: Inequality in A\/B testing as an approach to responsible design. Social and Information Networks. https:\/\/doi.org\/10.48550\/arXiv.2002.05819","journal-title":"Social and Information Networks"},{"key":"9644_CR88","doi-asserted-by":"crossref","unstructured":"Saxena, N. A., Huang, K., DeFilippis, E., Radanovic, G., Parkes, D., & Liu, Y. (2019). How do fairness definitions fare? Examining public attitudes towards algorithmic definitions of fairness.In Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society, 99\u2013106. Conference on AI, Ethics, and Society","DOI":"10.1145\/3306618.3314248"},{"key":"9644_CR1001","volume-title":"Commodities and Capabilities","author":"AK Sen","year":"1985","unstructured":"Sen, A. K. (1985). Commodities and Capabilities. Oxford: Elsevier Science Publishers."},{"key":"9644_CR89","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195368246.001.0001","volume-title":"Responsible conduct of research","author":"AE Shamoo","year":"2009","unstructured":"Shamoo, A. E., & Resnik, D. B. (2009). Responsible conduct of research. Oxford University Press."},{"key":"9644_CR90","unstructured":"Shaw, S. (2019). Consumers Are Becoming Wise to Your Nudge. Retrieved January 2, 2021 from https:\/\/behavioralscientist.org\/consumers-are-becoming-wise-to-your-nudge\/"},{"key":"9644_CR91","volume-title":"A\/B testing: The most powerful way to turn clicks into customers","author":"D Siroker","year":"2013","unstructured":"Siroker, D., & Koomen, P. (2013). A\/B testing: The most powerful way to turn clicks into customers. John Wiley."},{"issue":"4","key":"9644_CR92","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1177\/1556264618780803","volume":"13","author":"R Spellecy","year":"2018","unstructured":"Spellecy, R., Eve, A., Connors, E., Shaker, R., & Clark, D. (2018). The real-time IRB: A collaborative innovation to decrease IRB review time. Journal of Empirical Research on Human Research Ethics, 13(4), 432\u2013437.","journal-title":"Journal of Empirical Research on Human Research Ethics"},{"key":"9644_CR93","unstructured":"Spotify, (2022). Allow Pro Users to Opt-Out of A\/B Testing. https:\/\/community.spotify.com\/t5\/Closed-Ideas\/All-Platforms-Allow-Pro-Users-to-Opt-Out-of-A-B-Testing\/idi-p\/5092429."},{"key":"9644_CR94","unstructured":"Tagliabue, J., Tuulos, V., Greco, C. & Valay D. (2021). DAG Card is the new Model Card. 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Sydney. https:\/\/datacentricai.org\/neurips21\/papers\/43_CameraReady_neurips_data_centric_2021_DAG_CARDS_camera_ready.pdf"},{"issue":"1","key":"9644_CR95","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-021-00981-0","volume":"8","author":"L Tedersoo","year":"2021","unstructured":"Tedersoo, L., K\u00fcngas, R., Oras, E., K\u00f6ster, K., Eenmaa, H., Leijen, \u00c4., Pedaste, M., Raju, M., Astapova, A., Lukner, H., & Kogermann, K. (2021). Data sharing practices and data availability upon request differ across scientific disciplines. Scientific Data, 8(1), 1\u201311.","journal-title":"Scientific Data"},{"key":"9644_CR97","volume-title":"Experimentation works: The surprising power of business experiments","author":"S Thomke","year":"2020","unstructured":"Thomke, S. (2020). Experimentation works: The surprising power of business experiments. Harvard Business Press."},{"issue":"2","key":"9644_CR98","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1007\/s10676-009-9187-9","volume":"11","author":"M Turilli","year":"2009","unstructured":"Turilli, M., & Floridi, L. (2009). The ethics of information transparency. Ethics and Information Technology, 11(2), 105\u2013112.","journal-title":"Ethics and Information Technology"},{"key":"9644_CR100","doi-asserted-by":"publisher","unstructured":"Verma, S., & Rubin, J. (2018). Fairness definitions explained. Ieee\/ACM International Workshop on Software Fairness (Fairware). Workshop on software fairness (fairware). Doi https:\/\/doi.org\/10.23919\/FAIRWARE.2018.8452913","DOI":"10.23919\/FAIRWARE.2018.8452913"},{"key":"9644_CR101","unstructured":"Veytsman, B. (2020). Computational Causal Inference. https:\/\/arxiv.org\/pdf\/2007.10979.pdf"},{"key":"9644_CR102","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.copsyc.2019.08.025","volume":"31","author":"AE Waldman","year":"2020","unstructured":"Waldman, A. E. (2020). Cognitive biases, dark patterns, and the \u2018privacy paradox.\u2019 Current Opinion in Psychology, 31, 105\u2013109.","journal-title":"Current Opinion in Psychology"},{"key":"9644_CR103","unstructured":"Wells, G., Horwitz, J., & Seetharaman, D. (2021). Facebook Knows Instagram Is Toxic for Teen Girls, Company Documents Show. Wall Street Journal. Wall Street Journal. Retrieved 2 February 2022, from https:\/\/www.wsj.com\/articles\/facebook-knows-instagram-is-toxic-for-teen-girls-company-documentsshow-11631620739"},{"key":"9644_CR104","volume-title":"Designing for behavior change: Applying psychology and behavioral economics","author":"S Wendel","year":"2020","unstructured":"Wendel, S. (2020). Designing for behavior change: Applying psychology and behavioral economics. O\u2019Reilly Media."},{"key":"9644_CR1002","doi-asserted-by":"crossref","unstructured":"Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019). The role and limits of principles in AI ethics: Towards a focus on tensions. In Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society (pp. 195\u2013200).","DOI":"10.1145\/3306618.3314289"},{"key":"9644_CR105","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s11023-022-09613-x","volume":"33","author":"D Wong","year":"2023","unstructured":"Wong, D., & Floridi, L. (2023) Meta\u2019s oversight board: A review and critical assessment. Minds & Machines, 33, 261\u2013284. https:\/\/doi.org\/10.1007\/s11023-022-09613-x.","journal-title":"Minds & Machines"},{"key":"9644_CR106","volume-title":"Making things happen: A theory of causal explanation","author":"J Woodward","year":"2005","unstructured":"Woodward, J. (2005). Making things happen: A theory of causal explanation. Oxford University Press."},{"issue":"5","key":"9644_CR107","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3444944","volume":"15","author":"L Yao","year":"2021","unstructured":"Yao, L., Chu, Z., Li, S., Li, Y., Gao, J., & Zhang, A. (2021). A survey on causal inference. ACM Transactions on Knowledge Discovery from Data (TKDD), 15(5), 1\u201346.","journal-title":"ACM Transactions on Knowledge Discovery from Data (TKDD)"},{"key":"9644_CR108","unstructured":"Yu, B & Tagliabue, J. (2020). Blending search and discovery: Tag-based query refinement with contextual reinforcement learning. In Workshop on Natural Language Processing in E-Commerce (EcomNLP). https:\/\/arxiv.org\/abs\/2010.09495"},{"key":"9644_CR109","doi-asserted-by":"crossref","unstructured":"Zimmer, M. & Chapman, E. (2020). Ethical Review Boards and Pervasive Data Research: Gaps and Opportunities. In AoIR Selected Papers of Internet Research.","DOI":"10.5210\/spir.v2020i0.11369"}],"container-title":["Minds and Machines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-023-09644-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11023-023-09644-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-023-09644-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T16:28:35Z","timestamp":1710779315000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11023-023-09644-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,22]]},"references-count":102,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["9644"],"URL":"https:\/\/doi.org\/10.1007\/s11023-023-09644-y","relation":{},"ISSN":["1572-8641"],"issn-type":[{"value":"1572-8641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,22]]},"assertion":[{"value":"12 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}