{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T12:59:46Z","timestamp":1783429186725,"version":"3.54.6"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T00:00:00Z","timestamp":1512518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE 1106400"],"award-info":[{"award-number":["DGE 1106400"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2017,12,6]]},"abstract":"<jats:p>Although \"privacy by design\" (PBD)?embedding privacy protections into products during design, rather than retroactively?uses the term \"design\" to recognize how technical design choices implement and settle policy, design approaches and methodologies are largely absent from PBD conversations. Critical, speculative, and value-centered design approaches can be used to elicit reflections on relevant social values early in product development, and are a natural fit for PBD and necessary to achieve PBD's goal. Bringing these together, we present a case study using a design workbook of speculative design fictions as a values elicitation tool. Originally used as a reflective tool among a research group, we transformed the workbook into artifacts to share as values elicitation tools in interviews with graduate students training as future technology professionals. We discuss how these design artifacts surface contextual, socially-oriented understandings of privacy, and their potential utility in relationship to other values levers.<\/jats:p>","DOI":"10.1145\/3134746","type":"journal-article","created":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T21:23:15Z","timestamp":1512595395000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":103,"title":["Eliciting Values Reflections by Engaging Privacy Futures Using Design Workbooks"],"prefix":"10.1145","volume":"1","author":[{"given":"Richmond Y.","family":"Wong","sequence":"first","affiliation":[{"name":"University of California Berkeley, Berkeley, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deirdre K.","family":"Mulligan","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, Berkeley, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ellen","family":"Van Wyk","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, Berkeley, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Pierce","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, Berkeley, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Chuang","sequence":"additional","affiliation":[{"name":"UC Berkeley, Berkeley, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,12,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702200"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.7146\/aahcc.v1i1.21199"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3022198.3026326"},{"key":"e_1_2_1_4_1","volume-title":"Mulligan","author":"Bamberger Kenneth A.","year":"2011","unstructured":"Kenneth A. Bamberger and Deidre K . Mulligan . 2011 . Privacy on the Books and on the Ground. Stanford Law Review 63 (Jan. 2011), 247--316. Kenneth A. Bamberger and Deidre K. Mulligan. 2011. Privacy on the Books and on the Ground. Stanford Law Review 63 (Jan. 2011), 247--316."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025740"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1215\/9780822391623"},{"key":"e_1_2_1_7_1","volume-title":"Design Fiction: A Short Essay on Design, Science, Fact and Fiction.","author":"Bleecker Julian","year":"2009","unstructured":"Julian Bleecker . 2009 . Design Fiction: A Short Essay on Design, Science, Fact and Fiction. Retrieved from http:\/\/www.nearfuturelaboratory.com\/2009\/03\/17\/design-fiction-a-short-essay-on-design-science-fact-and-fiction\/ Julian Bleecker. 2009. Design Fiction: A Short Essay on Design, Science, Fact and Fiction. Retrieved from http:\/\/www.nearfuturelaboratory.com\/2009\/03\/17\/design-fiction-a-short-essay-on-design-science-fact-and-fiction\/"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026023"},{"key":"e_1_2_1_9_1","volume-title":"CHI'05 Workshop.","author":"Boehner Kirsten","year":"2005","unstructured":"Kirsten Boehner , Shay David , Joseph \"Jofish\" Kaye , and Phoebe Sengers . 2005 . Critical technical practice as a methodology for values in design . CHI'05 Workshop. Kirsten Boehner, Shay David, Joseph \"Jofish\" Kaye, and Phoebe Sengers. 2005. Critical technical practice as a methodology for values in design. CHI'05 Workshop."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2778972"},{"key":"e_1_2_1_11_1","volume-title":"An introduction to privacy engineering and risk management in federal systems","author":"Brooks Sean","unstructured":"Sean Brooks , Michael Garcia , Naomi Lefkovitz , Suzanne Lightman , and Ellen Nadeau . 2017. An introduction to privacy engineering and risk management in federal systems . National Institute of Standards and Technology , Gaithersburg, MD . Sean Brooks, Michael Garcia, Naomi Lefkovitz, Suzanne Lightman, and Ellen Nadeau. 2017. An introduction to privacy engineering and risk management in federal systems. National Institute of Standards and Technology, Gaithersburg, MD."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Ann Cavoukian. 2012. Privacy by Design -- The 7 Foundational Principles. Information and Privacy Commissioner of Ontario.  Ann Cavoukian. 2012. Privacy by Design -- The 7 Foundational Principles. Information and Privacy Commissioner of Ontario.","DOI":"10.4018\/978-1-61350-501-4.ch007"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998329"},{"key":"e_1_2_1_14_1","volume-title":"Privacy by Design - State of Research and Practice. Retrieved","author":"Computing Community Consortium (CCC). 2015.","year":"2017","unstructured":"Computing Community Consortium (CCC). 2015. Privacy by Design - State of Research and Practice. Retrieved May 7, 2017 from http:\/\/cra.org\/ccc\/events\/pbd-state-of-research-and-practice\/ Computing Community Consortium (CCC). 2015. Privacy by Design - State of Research and Practice. Retrieved May 7, 2017 from http:\/\/cra.org\/ccc\/events\/pbd-state-of-research-and-practice\/"},{"key":"e_1_2_1_15_1","volume-title":"Rapidly Exploring Application Design Through Speed Dating. In International Conference on Ubiquitous Computing (UbiComp","author":"Davidoff Scott","year":"2007","unstructured":"Scott Davidoff , Min Kyung Lee , Anind K Dey , and John Zimmerman . 2007 . Rapidly Exploring Application Design Through Speed Dating. In International Conference on Ubiquitous Computing (UbiComp 2007). Springer-Verlag, Berlin, 429--446. Scott Davidoff, Min Kyung Lee, Anind K Dey, and John Zimmerman. 2007. Rapidly Exploring Application Design Through Speed Dating. In International Conference on Ubiquitous Computing (UbiComp 2007). Springer-Verlag, Berlin, 429--446."},{"key":"e_1_2_1_16_1","volume-title":"Retrieved","year":"2014","unstructured":"DistriNet. 2014 . LINDDUN Privacy Threat Modeling . Retrieved April 27, 2017 from https:\/\/distrinet.cs.kuleuven.be\/software\/linddun\/index.php DistriNet. 2014. LINDDUN Privacy Threat Modeling. Retrieved April 27, 2017 from https:\/\/distrinet.cs.kuleuven.be\/software\/linddun\/index.php"},{"key":"e_1_2_1_17_1","volume-title":"The MIT Press","author":"Dunne Anthony","unstructured":"Anthony Dunne and Fiona Raby . 2013. Speculative Everything . The MIT Press , Cambridge, Massachusetts . Anthony Dunne and Fiona Raby. 2013. Speculative Everything. The MIT Press, Cambridge, Massachusetts."},{"key":"e_1_2_1_18_1","volume-title":"The Circle","author":"Eggers Dave","unstructured":"Dave Eggers . 2013. The Circle . McSweeny's Books , San Francisco . Dave Eggers. 2013. The Circle. McSweeny's Books, San Francisco."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025503"},{"key":"e_1_2_1_20_1","volume-title":"Retrieved","author":"Federal Trade","year":"2012","unstructured":"Federal Trade Commision (FTC). 2012 . Protecting Consumer in an Era of Rapid Change: Recommendations for businesses and policymakers. 1--112 . Retrieved September 20, 2016 from https:\/\/www.ftc.gov\/sites\/default\/files\/documents\/reports\/federal-trade-commission-report-protecting-consumer-privacy-era-rapid-change-recommendations\/120326privacyreport.pdf Federal Trade Commision (FTC). 2012. Protecting Consumer in an Era of Rapid Change: Recommendations for businesses and policymakers. 1--112. Retrieved September 20, 2016 from https:\/\/www.ftc.gov\/sites\/default\/files\/documents\/reports\/federal-trade-commission-report-protecting-consumer-privacy-era-rapid-change-recommendations\/120326privacyreport.pdf"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208562"},{"key":"e_1_2_1_22_1","volume-title":"The Handbook of Information and Computer Ethics, Kenneth Einar Himma and Herman T","author":"Friedman Batya","unstructured":"Batya Friedman , Peter H. Kahn , and Alan Borning . 2008. Value Sensitive Design and Information Systems . In The Handbook of Information and Computer Ethics, Kenneth Einar Himma and Herman T . Tavani (eds.). John Wiley & Sons, Inc. , 69--101. Batya Friedman, Peter H. Kahn, and Alan Borning. 2008. Value Sensitive Design and Information Systems. In The Handbook of Information and Computer Ethics, Kenneth Einar Himma and Herman T. Tavani (eds.). John Wiley & Sons, Inc., 69--101."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/291224.291235"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/332040.332433"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979169"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642653"},{"key":"e_1_2_1_27_1","volume-title":"Article 25: Data protection by design and by default. Retrieved","author":"Protection General Data","year":"2017","unstructured":"General Data Protection Regulation (GDPR). 2016. Article 25: Data protection by design and by default. Retrieved May 7, 2017 from https:\/\/gdpr-info.eu\/art-25-gdpr\/ General Data Protection Regulation (GDPR). 2016. Article 25: Data protection by design and by default. Retrieved May 7, 2017 from https:\/\/gdpr-info.eu\/art-25-gdpr\/"},{"key":"e_1_2_1_28_1","volume-title":"Toward an Anthropological Theory of Value: The False Coin of Our Own Dreams","author":"Graeber David","unstructured":"David Graeber . 2001. Three Ways of Talking about Value . In Toward an Anthropological Theory of Value: The False Coin of Our Own Dreams . Palgrave Macmillan , New York . David Graeber. 2001. Three Ways of Talking about Value. In Toward an Anthropological Theory of Value: The False Coin of Our Own Dreams. Palgrave Macmillan, New York."},{"key":"e_1_2_1_29_1","volume-title":"International Conference on Privacy and Data Protection.","author":"G\u00fcrses Seda","year":"2011","unstructured":"Seda G\u00fcrses , Carmela Troncoso , and Claudia Diaz . 2011 . Engineering Privacy by Design . In International Conference on Privacy and Data Protection. Seda G\u00fcrses, Carmela Troncoso, and Claudia Diaz. 2011. Engineering Privacy by Design. In International Conference on Privacy and Data Protection."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1415472.1415481"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2006.72"},{"key":"e_1_2_1_32_1","volume-title":"Workshop 2 Report. Retrieved","author":"Hemmings Justin","year":"2015","unstructured":"Justin Hemmings , Marie Le Pichon , and Peter Swire . 2015 . Privacy by Design - Privacy Enabling Design , Workshop 2 Report. Retrieved September 20, 2016 from http:\/\/cra.org\/ccc\/wp-content\/uploads\/sites\/2\/2015\/05\/PbD2-Report-v5.pdf Justin Hemmings, Marie Le Pichon, and Peter Swire. 2015. Privacy by Design - Privacy Enabling Design, Workshop 2 Report. Retrieved September 20, 2016 from http:\/\/cra.org\/ccc\/wp-content\/uploads\/sites\/2\/2015\/05\/PbD2-Report-v5.pdf"},{"key":"e_1_2_1_33_1","volume-title":"Federal Trade Commission Privacy Law and Policy","author":"Hoofnagle Chris Jay","unstructured":"Chris Jay Hoofnagle . Online privacy . In Federal Trade Commission Privacy Law and Policy . Cambridge University Press , Cambridge , 145--192. Chris Jay Hoofnagle. Online privacy. In Federal Trade Commission Privacy Law and Policy. Cambridge University Press, Cambridge, 145--192."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642616"},{"key":"e_1_2_1_35_1","volume-title":"IDEO. Human Centered Design Toolkit.","year":"2017","unstructured":"IDEO. Human Centered Design Toolkit. 2 nd Edition. Retrieved May 7, 2017 from https:\/\/climateandhealthresearch.files.wordpress.com\/2015\/04\/ideo-org_hcd_toolkit.pdf IDEO. Human Centered Design Toolkit. 2nd Edition. Retrieved May 7, 2017 from https:\/\/climateandhealthresearch.files.wordpress.com\/2015\/04\/ideo-org_hcd_toolkit.pdf","edition":"2"},{"key":"e_1_2_1_36_1","volume-title":"Retrieved","author":"IDEO.","year":"2003","unstructured":"IDEO. 2003 . Method Cards . Retrieved January 15, 2017 from https:\/\/www.ideo.com\/us\/post\/method-cards IDEO. 2003. Method Cards. Retrieved January 15, 2017 from https:\/\/www.ideo.com\/us\/post\/method-cards"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/DESI_a_00354"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.7146\/aahcc.v1i1.21266"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1965724.1965735"},{"key":"e_1_2_1_40_1","volume-title":"Shaping Technology\/Building Society: Studies in Sociotechnical Change","author":"Latour Bruno","unstructured":"Bruno Latour . 1992. Where are the missing masses? The sociology of a few mundane artifacts . In Shaping Technology\/Building Society: Studies in Sociotechnical Change , Wiebe Bijker and John Law (eds.). MIT Press , 225--258. Bruno Latour. 1992. Where are the missing masses? The sociology of a few mundane artifacts. In Shaping Technology\/Building Society: Studies in Sociotechnical Change, Wiebe Bijker and John Law (eds.). MIT Press, 225--258."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783446.2783592"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998286"},{"key":"e_1_2_1_43_1","first-page":"989","article-title":"Bridging the gap between privacy and design","volume":"14","author":"Mulligan Deirdre K.","year":"2011","unstructured":"Deirdre K. Mulligan and Jennifer King . 2011 . Bridging the gap between privacy and design . University of Pennsylvania Journal of Constitutional Law 14 (2011), 989 -- 1034 . Deirdre K. Mulligan and Jennifer King. 2011. Bridging the gap between privacy and design. University of Pennsylvania Journal of Constitutional Law 14 (2011), 989--1034.","journal-title":"University of Pennsylvania Journal of Constitutional Law"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2016.0118"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394445.1394446"},{"key":"e_1_2_1_46_1","volume-title":"Privacy in Context: Technology, Policy, and the Integrity of Social Life","author":"Nissenbaum Helen","unstructured":"Helen Nissenbaum . 2009. Privacy in Context: Technology, Policy, and the Integrity of Social Life . Stanford University Press , Stanford, California . Helen Nissenbaum. 2009. Privacy in Context: Technology, Policy, and the Integrity of Social Life. Stanford University Press, Stanford, California."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064768"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858447"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318008"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598525"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702438"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1415472.1415486"},{"key":"e_1_2_1_53_1","article-title":"Privacy by Design: A Counterfactual Analysis of Google and Facebook Privacy Incidents","volume":"28","author":"Rubinstein Ira S.","year":"2013","unstructured":"Ira S. Rubinstein and Nathaniel Good . 2013 . Privacy by Design: A Counterfactual Analysis of Google and Facebook Privacy Incidents . Berkeley Technology Law Journal , 28 , 2 (2013). Ira S. Rubinstein and Nathaniel Good. 2013. Privacy by Design: A Counterfactual Analysis of Google and Facebook Privacy Incidents. Berkeley Technology Law Journal, 28, 2 (2013).","journal-title":"Berkeley Technology Law Journal"},{"key":"e_1_2_1_54_1","volume-title":"The Coding Manual for Qualitative Researchers","author":"Salda\u00f1a Johnny","unstructured":"Johnny Salda\u00f1a . 2013. The Coding Manual for Qualitative Researchers . Sage , Los Angeles . Johnny Salda\u00f1a. 2013. The Coding Manual for Qualitative Researchers. Sage, Los Angeles."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1094562.1094569"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/0162243912436985"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531625"},{"key":"e_1_2_1_58_1","unstructured":"Adam Shostack. 2014. Elevation of Privilege: Drawing Developers into Threat Modeling. In USENIX Summit on Gaming Games and Gamification in Security Education 1--15.  Adam Shostack. 2014. Elevation of Privilege: Drawing Developers into Threat Modeling. In USENIX Summit on Gaming Games and Gamification in Security Education 1--15."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/030631289019003001"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2856503"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819992"},{"key":"e_1_2_1_62_1","volume-title":"Privacy Impact Assessments: The Privacy Office Official Guidance (June","author":"U.S. Department of Homeland Security. 2010.","year":"2010","unstructured":"U.S. Department of Homeland Security. 2010. Privacy Impact Assessments: The Privacy Office Official Guidance (June 2010 ). Retrieved January 1, 2017 from https:\/\/www.dhs.gov\/sites\/default\/files\/publications\/privacy_pia_guidance_june2010_0.pdf U.S. Department of Homeland Security. 2010. Privacy Impact Assessments: The Privacy Office Official Guidance (June 2010). Retrieved January 1, 2017 from https:\/\/www.dhs.gov\/sites\/default\/files\/publications\/privacy_pia_guidance_june2010_0.pdf"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2685553.2685554"},{"key":"e_1_2_1_64_1","first-page":"121","article-title":"Do Artifacts Have Politics","volume":"109","author":"Winner Langdon","year":"1980","unstructured":"Langdon Winner . 1980 . Do Artifacts Have Politics ? Daedalus 109 , 1: 121 -- 136 . Langdon Winner. 1980. Do Artifacts Have Politics? Daedalus 109, 1: 121--136.","journal-title":"Daedalus"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3022198.3022660"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064682"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240704"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134746","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3134746","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3134746","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:24Z","timestamp":1750212684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134746"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,6]]},"references-count":67,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2017,12,6]]}},"alternative-id":["10.1145\/3134746"],"URL":"https:\/\/doi.org\/10.1145\/3134746","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,6]]},"assertion":[{"value":"2017-12-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}