{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:58:26Z","timestamp":1776113906035,"version":"3.50.1"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"CHI PLAY","license":[{"start":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T00:00:00Z","timestamp":1728864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,10,14]]},"abstract":"<jats:p>\n            Repeated measurements of player experience are crucial in games user research, assessing how different designs evolve over time. However, this necessitates lightweight measurement instruments that are fit for the purpose. In this study, we conduct an examination of the test-retest reliability of the\n            <jats:italic toggle=\"yes\">miniPXI<\/jats:italic>\n            -a short variant of the\n            <jats:italic toggle=\"yes\">Player Experience Inventory (PXI)<\/jats:italic>\n            , an established measure for measuring player experience. We analyzed test-retest reliability by leveraging four games involving 100 participants, comparing it with four established multi-item measures and single-item indicators such as the Net Promoter Score (\n            <jats:italic toggle=\"yes\">NPS<\/jats:italic>\n            ) and overall enjoyment. The findings show mixed outcomes; the\n            <jats:italic toggle=\"yes\">miniPXI<\/jats:italic>\n            demonstrated varying levels of test-retest reliability. Some constructs showed good to moderate reliability, while others were less consistent. On the other hand, multi-item measures exhibited moderate to good test-retest reliability, demonstrating their effectiveness in measuring player experiences over time. Additionally, the employed single-item indicators (\n            <jats:italic toggle=\"yes\">NPS<\/jats:italic>\n            and overall enjoyment) demonstrated good reliability. The results of our study highlight the complexity of player experience evaluations over time, utilizing single and multiple items per construct measures. We conclude that single-item measures may not be appropriate for long-term investigations of more complex PX dimensions and provide practical considerations for the applicability of such measures in repeated measurements.\n          <\/jats:p>","DOI":"10.1145\/3677058","type":"journal-article","created":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T12:14:13Z","timestamp":1728994453000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["An Investigation of the Test-Retest Reliability of the miniPXI"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2246-3666","authenticated-orcid":false,"given":"Aqeel","family":"Haider","sequence":"first","affiliation":[{"name":"KU Leuven, Leuven, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0815-5985","authenticated-orcid":false,"given":"G\u00fcnter","family":"Wallner","sequence":"additional","affiliation":[{"name":"Johannes Kepler University Linz, Linz, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8449-6124","authenticated-orcid":false,"given":"Kathrin","family":"Gerling","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology, Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3031-9579","authenticated-orcid":false,"given":"Vero","family":"Vanden Abeele","sequence":"additional","affiliation":[{"name":"KU Leuven, Leuven, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,10,15]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.102370"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3235765.3235780"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0022--3999(02)00330--6"},{"key":"e_1_2_2_4_1","volume-title":"Game User Experience Evaluation","author":"Bernhaupt Regina","unstructured":"Regina Bernhaupt. 2015. Game User Experience Evaluation. Springer, Cham, Switzerland."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2018.00149"},{"key":"e_1_2_2_6_1","volume-title":"Sort the Court! ttps:\/\/graebor.itch.io\/sort-the-court Accessed","author":"Borland Graeme","year":"2024","unstructured":"Graeme Borland. 2016. Sort the Court! ttps:\/\/graebor.itch.io\/sort-the-court Accessed: February, 2024."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2009.02.016"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986048"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986048"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118796443.ch12"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868914.1868929"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--1--4615--1185--4_10"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12066"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cedpsych.2014.06.004"},{"key":"e_1_2_2_15_1","volume-title":"https:\/\/booleet.itch.io\/station-saturn Accessed","author":"Chmutov Maksim","year":"2024","unstructured":"Maksim Chmutov. 2023. Station Saturn. https:\/\/booleet.itch.io\/station-saturn Accessed: February, 2024."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02310555"},{"key":"e_1_2_2_17_1","volume-title":"Flow: The Psychology of Optimal Experience","author":"Csikszentmihalyi Mihaly","year":"1990","unstructured":"Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience. Harper and Row, New York, NY, USA."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2967934.2968095"},{"key":"e_1_2_2_19_1","volume-title":"Game Usability Heuristics (PLAY) for Evaluating and Designing Better Games: The Next Iteration","author":"Desurvire Heather","unstructured":"Heather Desurvire and Charlotte Wiberg. 2009. Game Usability Heuristics (PLAY) for Evaluating and Designing Better Games: The Next Iteration. In Online Communities and Social Computing, A. Ant Ozok and Panayiotis Zaphiris (Eds.). Springer, Berlin, Heidelberg, 557--566."},{"key":"e_1_2_2_20_1","volume-title":"Scale development : theory and applications","author":"DeVellis Robert F.","unstructured":"Robert F. DeVellis. 2017. Scale development : theory and applications fourth edition ed.). SAGE, Los Angeles, CA, USA."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.4278\/0890--1171--19.3.194"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0279720"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198794844.003.0001"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/109467050133001"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjop.12046"},{"key":"e_1_2_2_26_1","volume-title":"https:\/\/dustyroom.itch.io\/empty Accessed","year":"2024","unstructured":"Dustyroom. 2020. Empty. https:\/\/dustyroom.itch.io\/empty Accessed: February, 2024."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.26503\/dl.v2005i1.119"},{"key":"e_1_2_2_28_1","volume-title":"Discovering statistics using IBM SPSS statistics","author":"Field Andy","unstructured":"Andy Field. 2013. Discovering statistics using IBM SPSS statistics. Sage, London, UK."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0039139"},{"key":"e_1_2_2_30_1","unstructured":"James Gaskin. 2012. Data screening. http:\/\/statwiki.gaskination.com\/index.php\/Data_Prep Accessed: February 2024."},{"key":"e_1_2_2_31_1","volume-title":"Little Runmo -- YouTube. https:\/\/www.youtube.com\/watch?v=ErQHVUQ6QCk Accessed","year":"2024","unstructured":"Gooseworx. 2019. Little Runmo -- YouTube. https:\/\/www.youtube.com\/watch?v=ErQHVUQ6QCk Accessed: February, 2024."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288892"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3549507"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3573382.3616076"},{"key":"e_1_2_2_35_1","volume-title":"Aesthetics in interactive products: correlates and consequences of beauty","author":"Hassenzahl Marc","unstructured":"Marc Hassenzahl. 2008. Aesthetics in interactive products: correlates and consequences of beauty. In Product Experience, H Schifferstein and P Hekkert (Eds.). Elsevier, New York NY, 287--302."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--322--80058--9_19"},{"key":"e_1_2_2_37_1","volume-title":"Conference on Learning Theory. MLResearchPress, 2388--2422","author":"Hsieh Yu-Guan","year":"2021","unstructured":"Yu-Guan Hsieh, Kimon Antonakopoulos, and Panayotis Mertikopoulos. 2021. Adaptive learning in continuous games: Optimal regret bounds and convergence to Nash equilibrium. In Conference on Learning Theory. MLResearchPress, 2388--2422."},{"key":"e_1_2_2_38_1","volume-title":"itch.io. https:\/\/itch.io\/ Accessed","year":"2024","unstructured":"itch corp. 2024. itch.io. https:\/\/itch.io\/ Accessed: February, 2024."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1123\/jsep.18.1.17"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.04.004"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.05.003"},{"key":"e_1_2_2_42_1","unstructured":"JuhoSprite. 2023. Little Runmo."},{"key":"e_1_2_2_43_1","first-page":"1","article-title":"Validation of the GUESS-18: A Short Version of the Game User Experience Satisfaction Scale (GUESS)","volume":"16","author":"Keebler Joseph R.","year":"2020","unstructured":"Joseph R. Keebler, William J. Shelstad, Dustin C. Smith, Barbara S. Chaparro, and Mikki H. Phan. 2020. Validation of the GUESS-18: A Short Version of the Game User Experience Satisfaction Scale (GUESS). J. Usability Studies, Vol. 16, 1 (nov 2020), 49--62.","journal-title":"J. Usability Studies"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","unstructured":"Emily Kothe and Mathew Ling. 2019. Retention of participants recruited to a multi-year longitudinal study via Prolific. (2019). https:\/\/doi.org\/10.31234\/osf.io\/5yv2u","DOI":"10.31234\/osf.io\/5yv2u"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580968"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518813"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1108\/02683940210415933"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2019.8925493"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(03)00084-2"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/1088868310366253"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082--989x.1.1.30"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0028085"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557078"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2223795"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1348\/096317902167658"},{"key":"e_1_2_2_57_1","volume-title":"Psychometric Theory","author":"Nunnally Jum C.","unstructured":"Jum C. Nunnally. 1978. Psychometric Theory. McGraw-Hill, New York, NY, USA."},{"key":"e_1_2_2_58_1","volume-title":"The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Andrew Sears and Julie A","author":"Pagulayan Randy J.","unstructured":"Randy J. Pagulayan, Kevin Keeker, Dennis Wixon, Ramon L. Romero, and Thomas Fuller. 2003. User-centered design in games. In The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Andrew Sears and Julie A. Jacko (Eds.). CRC Press, Baco Raton, FL, USA, 883--906."},{"key":"e_1_2_2_59_1","volume-title":"https:\/\/www.prolific.com Accessed","year":"2024","unstructured":"Prolific. 2024. Prolific. https:\/\/www.prolific.com Accessed: February 2024."},{"key":"e_1_2_2_60_1","volume-title":"https:\/\/www.qualtrics.com\/uk Accessed","author":"Qualtrics","year":"2024","unstructured":"Qualtrics. 2024. Qualtrics XM. https:\/\/www.qualtrics.com\/uk Accessed: February 2024."},{"key":"e_1_2_2_61_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2023","unstructured":"R Core Team. 2023. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/"},{"key":"e_1_2_2_62_1","volume-title":"The one number you need to grow. Harvard business review","author":"Reichheld Frederick F","year":"2003","unstructured":"Frederick F Reichheld. 2003. The one number you need to grow. Harvard business review, Vol. 81, 12 (2003), 46--55."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11031-006--9051--8"},{"key":"e_1_2_2_64_1","volume-title":"Smith","author":"Stanton Jeffrey M.","year":"2002","unstructured":"Jeffrey M. Stanton, Evan F. Sinar, William K. Balzer, Amanda L. Julian, Paul Thoresen, Shahnaz Aziz, Gwenith G. Fisher, and Patricia C. Smith. 2002. Development of a compact measure of job satisfaction: The abridged Job Descriptive Index. Educational and psychological measurement, Vol. 62, 1 (2002), 173--191."},{"key":"e_1_2_2_65_1","volume-title":"Jamovi -- Ppen statistical software for the desktop and cloud. https:\/\/www.jamovi.org\/ Accessed","author":"The","year":"2024","unstructured":"The jamovi project. 2023. Jamovi -- Ppen statistical software for the desktop and cloud. https:\/\/www.jamovi.org\/ Accessed: February, 2024."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173760"},{"key":"e_1_2_2_67_1","volume-title":"Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement. 19--22","author":"V\u00e4\u00e4n\u00e4nen-Vainio-Mattila Kaisa","year":"2008","unstructured":"Kaisa V\u00e4\u00e4n\u00e4nen-Vainio-Mattila, Virpi Roto, and Marc Hassenzahl. 2008. Towards Practical User Experience Evaluation Methods. In Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement. 19--22."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecns.2021.11.002"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1002\/per.2083"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300593"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021--9010.82.2.247"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2004.03.001"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--40612--1_9"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445299"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1002\/nur.4770160610"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677058","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3677058","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T11:36:12Z","timestamp":1755776172000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677058"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,14]]},"references-count":75,"journal-issue":{"issue":"CHI PLAY","published-print":{"date-parts":[[2024,10,14]]}},"alternative-id":["10.1145\/3677058"],"URL":"https:\/\/doi.org\/10.1145\/3677058","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,14]]},"assertion":[{"value":"2024-10-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}