{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T22:04:35Z","timestamp":1780351475861,"version":"3.54.1"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T00:00:00Z","timestamp":1593561600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T00:00:00Z","timestamp":1593561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["SES-1449351"],"award-info":[{"award-number":["SES-1449351"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Eng Ethics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>There is growing consensus that teaching computer ethics is important, but there is little consensus on how to do so. One unmet challenge is increasing the capacity of computing students to make decisions about the ethical challenges embedded in their technical work. This paper reports on the design, testing, and evaluation of an educational simulation to meet this challenge. The privacy by design simulation enables more relevant and effective computer ethics education by letting students experience and make decisions about common ethical challenges encountered in real-world work environments. This paper describes the process of incorporating empirical observations of ethical questions in computing into an online simulation and an in-person board game. We employed the <jats:italic>Values at Play<\/jats:italic> framework to transform empirical observations of design into a playable educational experience. First, we conducted qualitative research to discover when and how values levers\u2014practices that encourage values discussions during technology development\u2014occur during the design of new mobile applications. We then translated these findings into gameplay elements, including the goals, roles, and elements of surprise incorporated into a simulation. We ran the online simulation in five undergraduate computer and information science classes. Based on this experience, we created a more accessible board game, which we tested in two undergraduate classes and two professional workshops. We evaluated the effectiveness of both the online simulation and the board game using two methods: a pre\/post-test of moral sensitivity based on the Defining Issues Test, and a questionnaire evaluating student experience. We found that converting real-world ethical challenges into a playable simulation increased student\u2019s reported interest in ethical issues in technology, and that students identified the role-playing activity as relevant to their technical coursework. This demonstrates that roleplaying can emphasize ethical decision-making as a relevant component of technical work.<\/jats:p>","DOI":"10.1007\/s11948-020-00250-0","type":"journal-article","created":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T11:45:41Z","timestamp":1593603941000},"page":"2911-2926","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Role-Playing Computer Ethics: Designing and Evaluating the Privacy by Design (PbD) Simulation"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1816-6140","authenticated-orcid":false,"given":"Katie","family":"Shilton","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donal","family":"Heidenblad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Porter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Winter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary","family":"Kendig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,7,1]]},"reference":[{"key":"250_CR1","unstructured":"ABET Computing Accreditation Commission. (2017). Criteria for accrediting computing programs. ABET. Retrieved April 4, 2018, from http:\/\/www.abet.org\/accreditation\/accreditation-criteria\/criteria-for-accrediting-computing-programs-2018-2019\/."},{"key":"250_CR2","unstructured":"ACM Committee on Professional Ethics. (2018). ACM code of ethics and professional conduct. Retrieved August 16, 2018, from https:\/\/www.acm.org\/code-of-ethics."},{"key":"250_CR47","doi-asserted-by":"crossref","unstructured":"Aiken, R. M. (1983). Reflections on teaching computer ethics. ACM SIGCSE Bulletin, 8\u201312.","DOI":"10.1145\/382188.382563"},{"key":"250_CR3","unstructured":"Bell, K. (2019). The funeral to end all funerals (No. 47). In The good place. NBC."},{"key":"250_CR45","doi-asserted-by":"crossref","unstructured":"Borenstein, J., Drake, M. J., Kirkman, R., & Swann, J. L. (2008). The test of ethical sensitivity in science and engineering (TESSE): A discipline-specific assessment tool for awareness of ethical issues. In Annual ASEE conference, American Society for Engineering Education, Pittsburgh, PA.","DOI":"10.18260\/1-2--3253"},{"issue":"2","key":"250_CR46","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s11948-009-9148-z","volume":"16","author":"J Borenstein","year":"2010","unstructured":"Borenstein, J., Drake, M. J., Kirkman, R., & Swann, J. L. (2010). The engineering and science issues test (ESIT): A discipline-specific approach to assessing moral judgment. Science and Engineering Ethics, 16(2), 387\u2013407. https:\/\/doi.org\/10.1007\/s11948-009-9148-z.","journal-title":"Science and Engineering Ethics"},{"issue":"1","key":"250_CR4","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1177\/1046878106286187","volume":"37","author":"ND Bos","year":"2006","unstructured":"Bos, N. D., Shami, N. S., & Naab, S. (2006). A globalization simulation to teach corporate social responsibility: Design features and analysis of student reasoning. Simulation and Gaming, 37(1), 56\u201372. https:\/\/doi.org\/10.1177\/1046878106286187.","journal-title":"Simulation and Gaming"},{"issue":"1","key":"250_CR5","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1177\/0162243913504305","volume":"39","author":"EA Cech","year":"2014","unstructured":"Cech, E. A. (2014). Culture of disengagement in engineering education? Science, Technology and Human Values, 39(1), 42\u201372. https:\/\/doi.org\/10.1177\/0162243913504305.","journal-title":"Science, Technology and Human Values"},{"issue":"4","key":"250_CR48","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1080\/0305724022000029662","volume":"31","author":"H Clarkeburn","year":"2002","unstructured":"Clarkeburn, H. (2002). A Test for Ethical Sensitivity in Science. Journal of Moral Education, 31(4), 439\u2013453. https:\/\/doi.org\/10.1080\/0305724022000029662.","journal-title":"Journal of Moral Education"},{"issue":"3","key":"250_CR6","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1007\/BF02583922","volume":"2","author":"D Elliott","year":"1996","unstructured":"Elliott, D., & Stern, J. E. (1996). Evaluating teaching and students\u2019 learning of academic research ethics. Science and Engineering Ethics, 2(3), 345\u2013366. https:\/\/doi.org\/10.1007\/BF02583922.","journal-title":"Science and Engineering Ethics"},{"key":"250_CR7","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9016.001.0001","volume-title":"Values at play in digital games","author":"M Flanagan","year":"2014","unstructured":"Flanagan, M., & Nissenbaum, H. (2014). Values at play in digital games. Cambridge: The MIT Press."},{"key":"250_CR8","doi-asserted-by":"crossref","unstructured":"Fleischmann, K. R., Robbins, R. W., & Wallace, W. A. (2011). Collaborative learning of ethical decision-making via simulated cases. In Proceedings of the 6th annual iconference.","DOI":"10.1145\/1940761.1940805"},{"key":"250_CR9","doi-asserted-by":"publisher","DOI":"10.1177\/1046878118789976","author":"S Galgouranas","year":"2018","unstructured":"Galgouranas, S., & Xinogalos, S. (2018). jAVANT-GARDE: A cross-platform serious game for an introduction to programming with Java. Simulation and Gaming. https:\/\/doi.org\/10.1177\/1046878118789976.","journal-title":"Simulation and Gaming"},{"key":"250_CR10","doi-asserted-by":"publisher","DOI":"10.1177\/1461444817702397","author":"D Greene","year":"2018","unstructured":"Greene, D., & Shilton, K. (2018). Platform privacies: Governance, collaboration, and the different meanings of \u201cprivacy\u201d in iOS and Android development. New Media and Society. https:\/\/doi.org\/10.1177\/1461444817702397.","journal-title":"New Media and Society"},{"issue":"8","key":"250_CR11","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1145\/3330794","volume":"62","author":"BJ Grosz","year":"2019","unstructured":"Grosz, B. J., Grant, D. G., Vredenburgh, K., Behrends, J., Hu, L., Simmons, A., et al. (2019). Embedded EthiCS: Integrating ethics across CS education. Communications of the ACM, 62(8), 54\u201361.","journal-title":"Communications of the ACM"},{"key":"250_CR50","doi-asserted-by":"crossref","unstructured":"Harmon, C., & Huff, C. (2000). Teaching computer ethics wtih detailed historical cases: A web site with cases and instructional support. Computers and Society, 24\u201325.","DOI":"10.1145\/572241.572251"},{"key":"250_CR12","doi-asserted-by":"publisher","unstructured":"Hof, S., Kropp, M., & Landolt, M. (2017). Use of gamification to teach agile values and collaboration: A multi-week scrum simulation project in an undergraduate software engineering course. In Proceedings of the 2017 ACM conference on innovation and technology in computer science education (pp. 323\u2013328). https:\/\/doi.org\/10.1145\/3059009.3059043.","DOI":"10.1145\/3059009.3059043"},{"issue":"7","key":"250_CR13","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1145\/2618103","volume":"57","author":"C Huff","year":"2014","unstructured":"Huff, C., & Furchert, A. (2014). Toward a pedagogy of ethical practice. Communications of the ACM, 57(7), 25\u201327. https:\/\/doi.org\/10.1145\/2618103.","journal-title":"Communications of the ACM"},{"key":"250_CR14","unstructured":"Lewis, P. (2017). \u201cOur minds can be hijacked\u201d: The tech insiders who fear a smartphone dystopia. The guardian. Retrieved October 23, 2017, from http:\/\/www.theguardian.com\/technology\/2017\/oct\/05\/smartphone-addiction-silicon-valley-dystopia."},{"key":"250_CR15","volume-title":"The Social Shaping of Technology","year":"1999","unstructured":"MacKenzie, D., & Wajcman, J. (Eds.). (1999). The Social Shaping of Technology (2nd ed.). New York: McGraw Hill Education.","edition":"2"},{"key":"250_CR16","unstructured":"Nanjiani, K. (2017). Thread: I know there\u2019s a lot of scary stuff in the world rn. [Tweet]. https:\/\/twitter.com\/kumailn\/status\/925828976882282496."},{"key":"250_CR17","doi-asserted-by":"publisher","unstructured":"Navarro, E. O., & van der Hoek, A. (2004). SimSE: An educational simulation game for teaching the software engineering process. In Proceedings of the 9th annual SIGCSE conference on innovation and technology in computer science education (pp. 233\u2013233). https:\/\/doi.org\/10.1145\/1007996.1008062.","DOI":"10.1145\/1007996.1008062"},{"key":"250_CR18","doi-asserted-by":"publisher","unstructured":"Navarro, E., & van der Hoek, A. (2009). Multi-site evaluation of SimSE. In Proceedings of the 40th ACM technical symposium on computer science education (pp. 326\u2013330). https:\/\/doi.org\/10.1145\/1508865.1508981.","DOI":"10.1145\/1508865.1508981"},{"key":"250_CR19","volume-title":"Weapons of math destruction: How big data increases inequality and threatens democracy","author":"C O\u2019Neil","year":"2017","unstructured":"O\u2019Neil, C. (2017). Weapons of math destruction: How big data increases inequality and threatens democracy (Reprint ed.). New York: Broadway Books.","edition":"Reprint"},{"key":"250_CR49","volume-title":"Ethical conflicts in computer science and technology","author":"DB Parker","year":"1979","unstructured":"Parker, D. B. (1979). Ethical conflicts in computer science and technology. Arlington, Va: AFIPS Press."},{"issue":"4","key":"250_CR51","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1037\/0022-0663.91.4.644","volume":"91","author":"JR Rest","year":"1999","unstructured":"Rest, J. R., Narvaez, D., Thoma, S. J., & Bebeau, M. J. (1999). DIT2: Devising and testing a revised instrument of moral judgment. Journal of Educational Psychology, 91(4), 644\u2013659.","journal-title":"Journal of Educational Psychology"},{"key":"250_CR20","unstructured":"Rosenberg, M., Confessore, N., & Cadwalladr, C. (2018). How trump consultants exploited the Facebook data of millions. In The New York times. https:\/\/www.nytimes.com\/2018\/03\/17\/us\/politics\/cambridge-analytica-trump-campaign.html."},{"issue":"4","key":"250_CR21","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1080\/03057240.2015.1095168","volume":"44","author":"K Schrier","year":"2015","unstructured":"Schrier, K. (2015). EPIC: A framework for using video games in ethics education. Journal of Moral Education, 44(4), 393\u2013424. https:\/\/doi.org\/10.1080\/03057240.2015.1095168.","journal-title":"Journal of Moral Education"},{"issue":"3","key":"250_CR22","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1177\/0162243912436985","volume":"38","author":"K Shilton","year":"2013","unstructured":"Shilton, K. (2013). Values levers: Building ethics into design. Science, Technology and Human Values, 38(3), 374\u2013397. https:\/\/doi.org\/10.1177\/0162243912436985.","journal-title":"Science, Technology and Human Values"},{"issue":"1","key":"250_CR23","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10551-017-3504-8","volume":"155","author":"K Shilton","year":"2019","unstructured":"Shilton, K., & Greene, D. (2019). Linking platforms, practices, and developer ethics: Levers for privacy discourse in mobile application development. Journal of Business Ethics, 155(1), 131\u2013146. https:\/\/doi.org\/10.1007\/s10551-017-3504-8.","journal-title":"Journal of Business Ethics"},{"key":"250_CR24","unstructured":"Singer, N. (2018). Tech\u2019s ethical \u2018Dark Side\u2019: Harvard, Stanford and others want to address it. In The New York times. https:\/\/www.nytimes.com\/2018\/02\/12\/business\/computer-science-ethics-courses.html."},{"issue":"3","key":"250_CR25","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.1145\/2460276.2460278","volume":"11","author":"L Sweeney","year":"2013","unstructured":"Sweeney, L. (2013). Discrimination in online Ad delivery. Queue, 11(3), 1010\u20131029. https:\/\/doi.org\/10.1145\/2460276.2460278.","journal-title":"Queue"},{"key":"250_CR26","doi-asserted-by":"publisher","unstructured":"The Joint Task Force on Computing Curricula, C. (Ed.). (2001). Computing curricula 2001. Journal on Educational Resources in Computing, 1(3es). https:\/\/doi.org\/10.1145\/384274.384275","DOI":"10.1145\/384274.384275"},{"key":"250_CR27","doi-asserted-by":"publisher","unstructured":"Tucker, A. B. (Ed.) (1991). Computing curricula 1991. Communication ACM, 34(6), 68\u201384. https:\/\/doi.org\/10.1145\/103701.103710.","DOI":"10.1145\/103701.103710"},{"key":"250_CR28","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780190498511.001.0001","volume-title":"Technology and the virtues: A philosophical guide to a future worth wanting","author":"S Vallor","year":"2016","unstructured":"Vallor, S. (2016). Technology and the virtues: A philosophical guide to a future worth wanting (1st ed.). Oxford: Oxford University Press.","edition":"1"},{"key":"250_CR29","unstructured":"Values at Play. (2008). VAP FAQ & quick reference. Values at Play. http:\/\/valuesatplay.org\/curriculum."},{"key":"250_CR30","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195323306.001.0001","volume-title":"Discourse and practice: New tools for critical discourse analysis","author":"T van Leeuwen","year":"2008","unstructured":"van Leeuwen, T. (2008). Discourse and practice: New tools for critical discourse analysis (1st ed.). Oxford: Oxford University Press.","edition":"1"},{"key":"250_CR31","volume-title":"Technically wrong: sexist apps, biased algorithms, and other threats of toxic tech","author":"S Wachter-Boettcher","year":"2017","unstructured":"Wachter-Boettcher, S. (2017). Technically wrong: sexist apps, biased algorithms, and other threats of toxic tech (1st ed.). New York: W. W. Norton & Company.","edition":"1"},{"key":"250_CR32","unstructured":"Wong, R. Y., Mulligan, D. K., Van Wyk, E., Pierce, J., & Chuang, J. (2018). Eliciting values reflections by engaging privacy futures using design workbooks. In Proceedings of the 2018 ACM conference on computer supported cooperative work and social computing. 2018 ACM conference on computer supported cooperative work and social computing, Jersey City, NJ. https:\/\/escholarship.org\/uc\/item\/78c2802k."}],"container-title":["Science and Engineering Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11948-020-00250-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11948-020-00250-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11948-020-00250-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:21:40Z","timestamp":1625098900000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11948-020-00250-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,1]]},"references-count":39,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["250"],"URL":"https:\/\/doi.org\/10.1007\/s11948-020-00250-0","relation":{},"ISSN":["1353-3452","1471-5546"],"issn-type":[{"value":"1353-3452","type":"print"},{"value":"1471-5546","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,1]]},"assertion":[{"value":"27 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}