{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:14:48Z","timestamp":1776111288276,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T00:00:00Z","timestamp":1660867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"The Austrian Research Promotion Agency (FFG)","award":["879324"],"award-info":[{"award-number":["879324"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,19]]},"DOI":"10.1145\/3537797.3537828","type":"proceedings-article","created":{"date-parts":[[2022,8,15]],"date-time":"2022-08-15T18:22:38Z","timestamp":1660587758000},"page":"161-166","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Evaluation in Participatory Design \u2013 The Whys and the Nots"],"prefix":"10.1145","author":[{"given":"Quynh","family":"Nguyen","sequence":"first","affiliation":[{"name":"Center for Technology Experience, AIT Austrian Institute of Technology GmbH, Austria"}]}],"member":"320","published-online":{"date-parts":[[2022,8,19]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940317"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385010.3385016"},{"key":"e_1_3_2_1_3_1","unstructured":"Valerie Anderson. 2017. Criteria for evaluating qualitative research. Human Resource Development Quarterly(2017) 1\u20139. https:\/\/pure.port.ac.uk\/ws\/files\/6930813\/ANDERSONv_2017_cright_HRDQ_Criteria_for_Evaluating_Qualitative_Research.pdf  Valerie Anderson. 2017. Criteria for evaluating qualitative research. Human Resource Development Quarterly(2017) 1\u20139. https:\/\/pure.port.ac.uk\/ws\/files\/6930813\/ANDERSONv_2017_cright_HRDQ_Criteria_for_Evaluating_Qualitative_Research.pdf"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3177794"},{"key":"e_1_3_2_1_5_1","volume-title":"A UTOPIAN experience: On design of powerful computer-based tools for skilled graphic workers","author":"Bodker Sussanne","year":"1987","unstructured":"Sussanne Bodker , Pelle Ehn , John Kammersgaard , Morten Kyng , and Yngve Sundblad . 1987. A UTOPIAN experience: On design of powerful computer-based tools for skilled graphic workers . Computers and Democracy G. Bjerknes, P. Ehn, and M. Knyg (Eds.). Avebury Pub. England ( 1987 ), 25. Sussanne Bodker, Pelle Ehn, John Kammersgaard, Morten Kyng, and Yngve Sundblad. 1987. A UTOPIAN experience: On design of powerful computer-based tools for skilled graphic workers. Computers and Democracy G. Bjerknes, P. Ehn, and M. Knyg (Eds.). Avebury Pub. England (1987), 25."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/572020.572023"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940303"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210604.3210638"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940316"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385010.3385027"},{"key":"e_1_3_2_1_11_1","volume-title":"Evaluation Society: Stanford University Press.","author":"Dahler-Larsen P","year":"2011","unstructured":"P Dahler-Larsen . 2011 . Evaluation Society: Stanford University Press. (2011). P Dahler-Larsen. 2011. Evaluation Society: Stanford University Press. (2011)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/1077800416681864"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2018.1540641"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/14487136.2015.1085690"},{"key":"e_1_3_2_1_15_1","volume-title":"Designs for the Pluriverse: Radical Interdependence, Autonomy, and the Making of Worlds","author":"Escobar Arturo","year":"1816","unstructured":"Arturo Escobar . 2018. Designs for the Pluriverse: Radical Interdependence, Autonomy, and the Making of Worlds . Duke University Press . https:\/\/doi.org\/10.1515\/978082237 1816 Arturo Escobar. 2018. Designs for the Pluriverse: Radical Interdependence, Autonomy, and the Making of Worlds. Duke University Press. https:\/\/doi.org\/10.1515\/9780822371816"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Christopher Frauenberger Judith Good Geraldine Fitzpatrick and Ole\u00a0Sejer Iversen. 2015. In Pursuit of Rigour and Accountability in Participatory Design. International journal of human-computer studies 74 (2015) 93\u2013106. https:\/\/doi.org\/10.1016\/j.ijhcs.2014.09.004  Christopher Frauenberger Judith Good Geraldine Fitzpatrick and Ole\u00a0Sejer Iversen. 2015. In Pursuit of Rigour and Accountability in Participatory Design. International journal of human-computer studies 74 (2015) 93\u2013106. https:\/\/doi.org\/10.1016\/j.ijhcs.2014.09.004","DOI":"10.1016\/j.ijhcs.2014.09.004"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3166.3170"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1900441.1900451"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384772.3385145"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2018.1424204"},{"key":"e_1_3_2_1_22_1","first-page":"15","article-title":"Design choices framework for co-creation projects","volume":"12","author":"Lee Jung\u00a0Joo","year":"2018","unstructured":"Jung\u00a0Joo Lee , Miia Jaatinen , Anna Salmi , Tuuli Mattelm\u00e4ki , Riitta Smeds , and Mari Holopainen . 2018 . Design choices framework for co-creation projects . International Journal of Design 12 , 2 (2018), 15 \u2013 31 . http:\/\/www.ijdesign.org\/index.php\/IJDesign\/article\/view\/2782 Jung\u00a0Joo Lee, Miia Jaatinen, Anna Salmi, Tuuli Mattelm\u00e4ki, Riitta Smeds, and Mari Holopainen. 2018. Design choices framework for co-creation projects. International Journal of Design 12, 2 (2018), 15\u201331. http:\/\/www.ijdesign.org\/index.php\/IJDesign\/article\/view\/2782","journal-title":"International Journal of Design"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210604.3210615"},{"key":"e_1_3_2_1_24_1","first-page":"61","article-title":"The human touch: Participatory practice and the role of facilitation in designing with communities","volume":"1","author":"Light Ann","year":"2012","unstructured":"Ann Light and Yoko Akama . 2012 . The human touch: Participatory practice and the role of facilitation in designing with communities . ACM International Conference Proceeding Series 1 (2012), 61 \u2013 70 . https:\/\/doi.org\/10.1145\/2347635.2347645 Ann Light and Yoko Akama. 2012. The human touch: Participatory practice and the role of facilitation in designing with communities. ACM International Conference Proceeding Series 1 (2012), 61\u201370. https:\/\/doi.org\/10.1145\/2347635.2347645","journal-title":"ACM International Conference Proceeding Series"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Rachael Luck. 2018. What is it that makes participation in design participatory design?Design Studies 59(2018) 1\u20138. https:\/\/doi.org\/10.1016\/j.destud.2018.10.002 Participatory Design.  Rachael Luck. 2018. What is it that makes participation in design participatory design?Design Studies 59(2018) 1\u20138. https:\/\/doi.org\/10.1016\/j.destud.2018.10.002 Participatory Design.","DOI":"10.1016\/j.destud.2018.10.002"},{"key":"e_1_3_2_1_26_1","volume-title":"The evaluation of policies, programs, and practices. Handbook of evaluation: Policies, programs and practices","author":"Mark M","year":"2006","unstructured":"Melvin\u00a0 M Mark , Jennifer\u00a0 C Greene , and Ian Shaw . 2006. The evaluation of policies, programs, and practices. Handbook of evaluation: Policies, programs and practices ( 2006 ), 1\u201330. Melvin\u00a0M Mark, Jennifer\u00a0C Greene, and Ian Shaw. 2006. The evaluation of policies, programs, and practices. Handbook of evaluation: Policies, programs and practices (2006), 1\u201330."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1011870.1011872"},{"key":"e_1_3_2_1_28_1","volume-title":"The Human\u2013Computer Interaction Handbook","author":"Muller J","unstructured":"Michael\u00a0 J Muller and Allison Druin . 2012. Participatory design: the third space in human\u2013computer interaction . In The Human\u2013Computer Interaction Handbook . CRC Press , 1125\u20131153. Michael\u00a0J Muller and Allison Druin. 2012. Participatory design: the third space in human\u2013computer interaction. In The Human\u2013Computer Interaction Handbook. CRC Press, 1125\u20131153."},{"key":"e_1_3_2_1_29_1","unstructured":"Helga Nowotny Peter Scott Michael Gibbons 2001. Re-thinking science: Knowledge and the public in an age of uncertainty. SciELO Argentina.  Helga Nowotny Peter Scott Michael Gibbons 2001. Re-thinking science: Knowledge and the public in an age of uncertainty. SciELO Argentina."},{"key":"e_1_3_2_1_30_1","volume-title":"Social Research: Qualitative and Quantitative Methods Can Really Be Mixed","author":"Olsen W K.","year":"2004","unstructured":"W K. Olsen , Michael Haralambos , and M. Holborn . 2004 . Triangulation in Social Research: Qualitative and Quantitative Methods Can Really Be Mixed . Causeway Press Ltd , United Kingdom . W K. Olsen, Michael Haralambos, and M. Holborn. 2004. Triangulation in Social Research: Qualitative and Quantitative Methods Can Really Be Mixed. Causeway Press Ltd, United Kingdom."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384772.3385141"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940302"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijproman.2006.08.002"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1900441.1900476"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2014.888183"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348144.2348166"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/DESI_a_00158"},{"key":"e_1_3_2_1_38_1","unstructured":"Jesper Simonsen and Morten Hertzum. 2022. Effects-Driven IT Improvement: Pursuing Local Post-Implementation Opportunities. Scandinavian Journal of Information Systems(2022).  Jesper Simonsen and Morten Hertzum. 2022. Effects-Driven IT Improvement: Pursuing Local Post-Implementation Opportunities. Scandinavian Journal of Information Systems(2022)."},{"key":"e_1_3_2_1_39_1","volume-title":"Routledge international handbook of participatory design. Vol.\u00a0711","author":"Simonsen Jesper","unstructured":"Jesper Simonsen and Toni Robertson . 2013. Routledge international handbook of participatory design. Vol.\u00a0711 . Routledge New York . Jesper Simonsen and Toni Robertson. 2013. Routledge international handbook of participatory design. Vol.\u00a0711. Routledge New York."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2018.05.005"}],"event":{"name":"PDC 2022: Participatory Design Conference 2022","location":"Newcastle upon Tyne United Kingdom","acronym":"PDC 2022"},"container-title":["Proceedings of the Participatory Design Conference 2022 - Volume 2"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3537797.3537828","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3537797.3537828","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:51Z","timestamp":1750186971000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3537797.3537828"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,19]]},"references-count":39,"alternative-id":["10.1145\/3537797.3537828","10.1145\/3537797"],"URL":"https:\/\/doi.org\/10.1145\/3537797.3537828","relation":{},"subject":[],"published":{"date-parts":[[2022,8,19]]},"assertion":[{"value":"2022-08-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}