{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:11:31Z","timestamp":1776107491858,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":74,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,5,2]],"date-time":"2017-05-02T00:00:00Z","timestamp":1493683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["637991"],"award-info":[{"award-number":["637991"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002341","name":"Suomen Akatemia","doi-asserted-by":"publisher","award":["259281,298879"],"award-info":[{"award-number":["259281,298879"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,5,2]]},"DOI":"10.1145\/3025453.3025658","type":"proceedings-article","created":{"date-parts":[[2017,5,2]],"date-time":"2017-05-02T18:37:22Z","timestamp":1493750242000},"page":"2064-2077","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["Evaluation of Prototypes and the Problem of Possible Futures"],"prefix":"10.1145","author":[{"given":"Antti","family":"Salovaara","sequence":"first","affiliation":[{"name":"University of Helsinki & Aalto University, Helsinki, Finland"}]},{"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}]},{"given":"Giulio","family":"Jacucci","sequence":"additional","affiliation":[{"name":"University of Helsinki, Helsinki, Finland"}]}],"member":"320","published-online":{"date-parts":[[2017,5,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.384.0508"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.229"},{"key":"e_1_3_2_1_3_1","volume-title":"Design at Work: Cooperative Design of Computer Systems, Joan M","author":"Bannon Liam","unstructured":"Liam Bannon . 1991. From Human Factors to Human Actors: The Role of Psychology and Human-Computer Interaction Studies in System Design . In Design at Work: Cooperative Design of Computer Systems, Joan M . Greenbaum and Morten Kyng (Eds.). Lawrence Erlbaum , Hillsdale, NJ , Chapter 2, 25--44. Liam Bannon. 1991. From Human Factors to Human Actors: The Role of Psychology and Human-Computer Interaction Studies in System Design. In Design at Work: Cooperative Design of Computer Systems, Joan M. Greenbaum and Morten Kyng (Eds.). Lawrence Erlbaum, Hillsdale, NJ, Chapter 2, 25--44."},{"key":"e_1_3_2_1_4_1","first-page":"9","article-title":"Ethnography: Relating the Part to the Whole. In Qualitative Research: Theory, Methods and Practice (2 ed.), David Silverman (Ed.). Sage Publications, London, UK","volume":"2","author":"Baszanger Isabelle","year":"2004","unstructured":"Isabelle Baszanger and Nicolas Dodier . 2004 . Ethnography: Relating the Part to the Whole. In Qualitative Research: Theory, Methods and Practice (2 ed.), David Silverman (Ed.). Sage Publications, London, UK , Chapter 2 , 9 -- 34 . Isabelle Baszanger and Nicolas Dodier. 2004. Ethnography: Relating the Part to the Whole. In Qualitative Research: Theory, Methods and Practice (2 ed.), David Silverman (Ed.). Sage Publications, London, UK, Chapter 2, 9--34.","journal-title":"Chapter"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208347"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037373.2037396"},{"key":"e_1_3_2_1_7_1","unstructured":"Wiebe E. Bijker Thomas P. Hughes and Trevor J. Pinch (Eds.). 1987. The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology. The MIT Press Cambridge MA.  Wiebe E. Bijker Thomas P. Hughes and Trevor J. Pinch (Eds.). 1987. The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology. The MIT Press Cambridge MA."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240789"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318014"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/1289765.1289768"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0665-4_1"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979185"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858498"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/347642.347652"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/67449.67452"},{"key":"e_1_3_2_1_16_1","volume-title":"Cook and Donald Thomas Campbell","author":"Thomas","year":"1979","unstructured":"Thomas D. Cook and Donald Thomas Campbell . 1979 . Quasi-Experimentation: Design and Analysis Issues for Field Settings. Houghton Mifflin, New York, NY. Thomas D. Cook and Donald Thomas Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Houghton Mifflin, New York, NY."},{"key":"e_1_3_2_1_17_1","volume-title":"Giovanna Di Chiro, and Rayvon Fouch\u00e9 (Eds.)","author":"Eglash Ron","year":"2004","unstructured":"Ron Eglash , Jennifer L. Croissant , Giovanna Di Chiro, and Rayvon Fouch\u00e9 (Eds.) . 2004 . Appropriating Technology : Vernacular Science and Social Power. University of Minnesota Press , Minneapolis, MN. Ron Eglash, Jennifer L. Croissant, Giovanna Di Chiro, and Rayvon Fouch\u00e9 (Eds.). 2004. Appropriating Technology: Vernacular Science and Social Power. University of Minnesota Press, Minneapolis, MN."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/291224.291235"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208538"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2011.03.005"},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of alt.chi","author":"Harrison Steve","year":"2007","unstructured":"Steve Harrison , Deborah Tatar , and Phoebe Sengers . 2007 . The Three Paradigms of HCI . In Proceedings of alt.chi 2007. Steve Harrison, Deborah Tatar, and Phoebe Sengers. 2007. The Three Paradigms of HCI. In Proceedings of alt.chi 2007."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000043"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481312"},{"key":"e_1_3_2_1_25_1","volume-title":"Cognition in the Wild","author":"Hutchins Edwin","unstructured":"Edwin Hutchins . 1995. Cognition in the Wild . The MIT Press , Cambridge, MA . Edwin Hutchins. 1995. Cognition in the Wild. The MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642616"},{"key":"e_1_3_2_1_27_1","volume-title":"Forecasting: Principles and Practice. OTexts","author":"Hyndman J.","year":"2013","unstructured":"J. Hyndman and George Athanasopoulos . 2013 . Forecasting: Principles and Practice. OTexts , Melbourne, Australia . J. Hyndman and George Athanasopoulos. 2013. Forecasting: Principles and Practice. OTexts, Melbourne, Australia."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007790200031"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/347642.347715"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258715"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240817"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2371574.2371586"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2628398"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-28637-0_6"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028014.1028060"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557111"},{"key":"e_1_3_2_1_37_1","volume-title":"Work: Cooperative Design of Computer Systems","author":"Kyng Morten","year":"1991","unstructured":"Morten Kyng and Joan Greenbaum (Eds.). 1991 . Design at Work: Cooperative Design of Computer Systems . Lawrence Erlbaum , Hillsdale, NJ . Morten Kyng and Joan Greenbaum (Eds.). 1991. Design at Work: Cooperative Design of Computer Systems. Lawrence Erlbaum, Hillsdale, NJ."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858446"},{"key":"e_1_3_2_1_40_1","unstructured":"Daniel MacKenzie and Judy Wajcman (Eds.). 1998. The Social Shaping of Technology (2 ed.). Open University Press Buckingham UK.  Daniel MacKenzie and Judy Wajcman (Eds.). 1998. The Social Shaping of Technology (2 ed.). Open University Press Buckingham UK."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2006.05.006"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/347642.347763"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518991"},{"key":"e_1_3_2_1_44_1","volume-title":"A Small Matter of Programming: Perspectives on End User Computing","author":"Nardi Bonnie A.","unstructured":"Bonnie A. Nardi . 1993. A Small Matter of Programming: Perspectives on End User Computing . The MIT Press , Cambridge, MA . Bonnie A. Nardi. 1993. A Small Matter of Programming: Perspectives on End User Computing. The MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781452229560.n11"},{"key":"e_1_3_2_1_46_1","volume-title":"Cognition and Reality: Principles and Implications of Cognitive Psychology","author":"Neisser Ulric","unstructured":"Ulric Neisser . 1976. Cognition and Reality: Principles and Implications of Cognitive Psychology . W. H. Freeman and Company , San Francisco, CA . Ulric Neisser. 1976. Cognition and Reality: Principles and Implications of Cognitive Psychology. W. H. Freeman and Company, San Francisco, CA."},{"key":"e_1_3_2_1_47_1","volume-title":"Usability Engineering","author":"Nielsen Jakob","unstructured":"Jakob Nielsen . 1993. Usability Engineering . Academic Press , Boston, MA . Jakob Nielsen. 1993. Usability Engineering. Academic Press, Boston, MA."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1996.11518138"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2008.75"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318008"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Nelly Oudshoorn and Trevor Pinch (Eds.). 2003. How Users Matter: The Co-Construction of Users and Technology. The MIT Press Cambridge MA.  Nelly Oudshoorn and Trevor Pinch (Eds.). 2003. How Users Matter: The Co-Construction of Users and Technology. The MIT Press Cambridge MA.","DOI":"10.7551\/mitpress\/3592.001.0001"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-008-0209-0"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858283"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-003-0238-7"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208278"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1162\/DESI_a_00395"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74853-3_20"},{"key":"e_1_3_2_1_58_1","volume-title":"Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests (2 ed.)","author":"Rubin Jeffrey","unstructured":"Jeffrey Rubin and Dana Chisnell . 2008. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests (2 ed.) . Wiley Publishing, Indianapolis , IN. Jeffrey Rubin and Dana Chisnell. 2008. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests (2 ed.). Wiley Publishing, Indianapolis, IN."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/11555261_58"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1002\/for.3980100602"},{"key":"e_1_3_2_1_61_1","volume-title":"The Reflective Practitioner: How Professionals Think in Action","author":"Sch\u00f6n Donald A.","unstructured":"Donald A. Sch\u00f6n . 1983. The Reflective Practitioner: How Professionals Think in Action . Basic Books , New York, NY . Donald A. Sch\u00f6n. 1983. The Reflective Practitioner: How Professionals Think in Action. Basic Books, New York, NY."},{"key":"e_1_3_2_1_62_1","volume-title":"Participatory Design: Principles and Practices","author":"Schuler Douglas","year":"1993","unstructured":"Douglas Schuler and Aki Namioka (Eds.). 1993 . Participatory Design: Principles and Practices . Lawrence Erlbaum, Hillsdale , NJ. Douglas Schuler and Aki Namioka (Eds.). 1993. Participatory Design: Principles and Practices. Lawrence Erlbaum, Hillsdale, NJ."},{"key":"e_1_3_2_1_63_1","unstructured":"W. Shadish T. Cook and D. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Boston MA.  W. Shadish T. Cook and D. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Boston MA."},{"key":"e_1_3_2_1_64_1","volume-title":"The Sciences of the Artificial","author":"Simon Herbert A.","unstructured":"Herbert A. Simon . 1969. The Sciences of the Artificial . The MIT Press , Cambridge, MA . Herbert A. Simon. 1969. The Sciences of the Artificial. The MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370020903586696"},{"key":"e_1_3_2_1_66_1","volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","author":"Suchman Lucy A.","unstructured":"Lucy A. Suchman . 1987. Plans and Situated Actions: The Problem of Human-Machine Communication . Cambridge University Press, Cambridge , UK. Lucy A. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, Cambridge, UK."},{"key":"e_1_3_2_1_67_1","volume-title":"The Sources of Innovation","author":"von Hippel Eric","unstructured":"Eric von Hippel . 1988. The Sources of Innovation . Oxford University Press, New York , NY. Eric von Hippel. 1988. The Sources of Innovation. Oxford University Press, New York, NY."},{"key":"e_1_3_2_1_68_1","volume-title":"The MIT Press","author":"von Hippel Eric","unstructured":"Eric von Hippel . 2005. Democratizing Innovation . The MIT Press , Cambridge, MA . Eric von Hippel. 2005. Democratizing Innovation. The MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-1153-7_1140"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0991-94"},{"key":"e_1_3_2_1_71_1","unstructured":"William Foote Whyte (Ed.). 1990. Participatory Action Research. Sage Publications Thousand Oaks CA.  William Foote Whyte (Ed.). 1990. Participatory Action Research. Sage Publications Thousand Oaks CA."},{"key":"e_1_3_2_1_72_1","volume-title":"Laura De Young","author":"Winograd Terry","year":"1996","unstructured":"Terry Winograd , John Bennett , Laura De Young , and Bradley Hartfield (Eds.). 1996 . Bringing Design to Software. ACM Press , New York, NY. Terry Winograd, John Bennett, Laura De Young, and Bradley Hartfield (Eds.). 1996. Bringing Design to Software. ACM Press, New York, NY."},{"key":"e_1_3_2_1_73_1","volume-title":"Understanding Computers and Cognition: A New Foundation for Design","author":"Winograd Terry","unstructured":"Terry Winograd and Fernando Flores . 1986. Understanding Computers and Cognition: A New Foundation for Design . Addison-Wesley, Reading , MA. Terry Winograd and Fernando Flores. 1986. Understanding Computers and Cognition: A New Foundation for Design. Addison-Wesley, Reading, MA."},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518874"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240704"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1858171.1858228"}],"event":{"name":"CHI '17: CHI Conference on Human Factors in Computing Systems","location":"Denver Colorado USA","acronym":"CHI '17","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025658","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3025453.3025658","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:34Z","timestamp":1750215814000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,2]]},"references-count":74,"alternative-id":["10.1145\/3025453.3025658","10.1145\/3025453"],"URL":"https:\/\/doi.org\/10.1145\/3025453.3025658","relation":{},"subject":[],"published":{"date-parts":[[2017,5,2]]},"assertion":[{"value":"2017-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}