{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:20:32Z","timestamp":1762273232426,"version":"3.37.3"},"reference-count":61,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"Fonds National de la Recherche","award":["PRIDE15\/10621687"],"award-info":[{"award-number":["PRIDE15\/10621687"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The aim of this study is to investigate the use of the sentence completion technique (SCT) as a user experience (UX) research method. We conducted an online experiment (N\u00a0=\u00a0400) to test the effect of sentence stem variations on sentence completion outcomes. Using a between-subjects design, half of the participants were exposed to impersonal sentence stems that did not include pronouns while the other half were exposed to stems formulated using first-person pronouns (PR). Additional hypotheses around stem formats (use of redundant stems, imaginative stems, two blanks stems, generic stems, stems prompting others\u2019 perception) were tested using a within-subject design. The results do not support hypothesized differences between the pronoun and no pronoun condition. Findings however show that varying the format of the stem influences response behavior, as measured by variety, quantity and novelty of ideas, as well as the length of response. This study contributes to consolidating the use of SCT as a user research method and proposes actionable recommendations on how to create optimal sentence completion surveys in Human-Computer Interaction (HCI).<\/jats:p>","DOI":"10.1093\/iwc\/iwae002","type":"journal-article","created":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T19:54:40Z","timestamp":1709841280000},"page":"48-61","source":"Crossref","is-referenced-by-count":3,"title":["Sentence Completion as a User Experience Research Method: Recommendations From an Experimental Study"],"prefix":"10.1093","volume":"36","author":[{"given":"Denise","family":"Schmidt","sequence":"first","affiliation":[{"name":"Rhine-Waal University , Faculty of Communication and Environment, Friedrich-Heinrich-Allee 25, 47475 Kamp-Lintfort, Germany"}]},{"given":"Karsten","family":"Nebe","sequence":"additional","affiliation":[{"name":"Rhine-Waal University , Faculty of Communication and Environment, Friedrich-Heinrich-Allee 25, 47475 Kamp-Lintfort, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2048-7947","authenticated-orcid":false,"given":"Carine","family":"Lallemand","sequence":"additional","affiliation":[{"name":"University of Luxembourg , HCI research group, Maison des Sciences Humaines, 11 Porte des Sciences, L-4366 Esch-sur-Alzette, Luxembourg"}]}],"member":"286","published-online":{"date-parts":[[2024,3,6]]},"reference":[{"key":"2024062610560689500_ref1","doi-asserted-by":"crossref","first-page":"2689","DOI":"10.1145\/1978942.1979336","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11)","author":"Bargas-Avila","year":"2011"},{"key":"2024062610560689500_ref2","doi-asserted-by":"crossref","first-page":"800","DOI":"10.3758\/s13428-011-0081-0","article-title":"The viability of crowdsourcing for survey research","volume":"43","author":"Behrend","year":"2011","journal-title":"Behav. Res. Methods"},{"key":"2024062610560689500_ref3","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1093\/pan\/mpr057","article-title":"Evaluating online labor markets for experimental research: Amazon.com\u2019s Mechanical Turk","volume":"20","author":"Berinsky","year":"2012","journal-title":"Polit. Anal."},{"volume-title":"Human-Computer Interaction \u2013 INTERACT 2009. INTERACT 2009","year":"2009","author":"Cockton","key":"2024062610560689500_ref4"},{"key":"2024062610560689500_ref5","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1037\/h0059972","article-title":"Productivity of clinical hypotheses on a sentence completion test","volume":"18","author":"Cromwell","year":"1954","journal-title":"J. Consult. Psychol."},{"key":"2024062610560689500_ref6","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1145\/3469845","article-title":"A systematic literature review of empirical methods and risk representation in usable privacy and security research","volume":"28","author":"Distler","year":"2021","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"2024062610560689500_ref7","first-page":"47","article-title":"Projective techniques in consumer research","volume":"28","author":"Donoghue","year":"2010","journal-title":"J. Fam. Ecol. Consum. Sci."},{"key":"2024062610560689500_ref8","first-page":"401","article-title":"Uber eine neue methode zur pr\u00fcfung geistiger f\u00e4higkeiten and ihre anwendung bei schulkindern [About a new method for testing intellectual abilities]","volume":"13","author":"Ebbinghaus","year":"1897","journal-title":"Psychologie Und Physiologie Der Sinnesorgane"},{"key":"2024062610560689500_ref9","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1177\/1468794117743462","article-title":"Researching mobile practices: participant reflection and audio-recording in repeat question diaries","volume":"18","author":"Fitt","year":"2018","journal-title":"Qual. Res."},{"key":"2024062610560689500_ref10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13104-018-3584-2","article-title":"Conceptions of sleep experience: a layman perspective","volume":"11","author":"Goelema","year":"2018","journal-title":"BMC Res. Notes"},{"key":"2024062610560689500_ref11","first-page":"12","article-title":"A review of sentence completion methods in personality assessment","volume":"29","author":"Goldberg","year":"1965","journal-title":"J. Proj. Tech. Pers. Assess."},{"key":"2024062610560689500_ref12","first-page":"11","volume-title":"Proceedings of the Ninth International Workshop on Internationalisation of Products and Systems IWIPS 2010, 7\u201310 July 2010","author":"Helki\u00f6","year":"2010"},{"key":"2024062610560689500_ref13","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1207\/S15327752JPA7403_3","article-title":"Sentence completion tests: a review of the literature and results of a survey of members of the Society for Personality Assessment","volume":"74","author":"Holaday","year":"2000","journal-title":"J. Pers. Assess."},{"key":"2024062610560689500_ref15","volume-title":"Consumer behavior","author":"Hoyer","year":"2006","edition":"4th"},{"key":"2024062610560689500_ref16","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"Hsieh","year":"2005","journal-title":"Qual. Health Res."},{"key":"2024062610560689500_ref17","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.lindif.2016.07.015","article-title":"The effects of stimulus words\u2019 positions and properties on response words and creativity performance in the tasks of analogical sentence completion","volume":"50","author":"Kao","year":"2016","journal-title":"Learn. Individ. Differ."},{"key":"2024062610560689500_ref18","doi-asserted-by":"crossref","first-page":"231","DOI":"10.4103\/ipj.ipj_63_18","article-title":"The utility of modified version of sentence completion test for children and adolescents","volume":"27","author":"Kohli","year":"2018","journal-title":"Ind. Psychiatry J."},{"key":"2024062610560689500_ref19","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1145\/1621841.1621860","volume-title":"Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era (MindTrek '09)","author":"Kujala","year":"2009"},{"key":"2024062610560689500_ref20","first-page":"15","article-title":"Sentence completion for evaluating symbolic meaning","volume":"6","author":"Kujala","year":"2012","journal-title":"Int. J. Des."},{"key":"2024062610560689500_ref21","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1093\/iwc\/iwt036","article-title":"Sentence completion for understanding users and evaluating user experience","volume":"26","author":"Kujala","year":"2014","journal-title":"Interact. Comput."},{"volume-title":"Towards Consolidated Methods for the Design and Evaluation of User Experience","year":"2015","author":"Lallemand","key":"2024062610560689500_ref22"},{"volume-title":"M\u00e9thodes de design UX: 30 m\u00e9thodes fondamentales pour concevoir des exp\u00e9riences optimales","year":"2018","author":"Lallemand","key":"2024062610560689500_ref23"},{"key":"2024062610560689500_ref24","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/3121283.3121288","volume-title":"Proceedings of the European Conference on Cognitive Ergonomics (ECCE '17)","author":"Lallemand","year":"2017"},{"key":"2024062610560689500_ref25","first-page":"1","volume-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)","author":"Lallemand","year":"2022"},{"key":"2024062610560689500_ref26","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1037\/h0058624","article-title":"The effect of mental set and item structure upon response to a projective test","volume":"46","author":"Meltzoff","year":"1951","journal-title":"J. Abnorm. Soc. Psychol."},{"volume-title":"Synergy - DRS International Conference 2020, 11-14 August","year":"2020","author":"Menheere","key":"2024062610560689500_ref27"},{"key":"2024062610560689500_ref28","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1080\/00223891.1972.10119751","article-title":"Influence of stimulus properties of the sentence-completion-method on projection and adjustment","volume":"36","author":"Murstein","year":"1972","journal-title":"J. Pers. Assess."},{"key":"2024062610560689500_ref29","doi-asserted-by":"crossref","first-page":"3480","DOI":"10.3390\/s21103480","article-title":"Are UX evaluation methods providing the same big picture?","volume":"21","author":"Nakamura","year":"2021","journal-title":"Sensors"},{"key":"2024062610560689500_ref30","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1007\/s12187-020-09776-y","article-title":"A cross-cultural study of happiness in Japanese, Finnish, and Mongolian children: analysis of the sentence completion test","volume":"14","author":"Ninomiya","year":"2021","journal-title":"Child Indic. Res."},{"key":"2024062610560689500_ref31","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1080\/09544820903158835","article-title":"Capturing users\u2019 perceptions of valuable experience and meaning","volume":"20","author":"Nurkka","year":"2009","journal-title":"J. Eng. Des."},{"key":"2024062610560689500_ref32","doi-asserted-by":"crossref","first-page":"151","DOI":"10.2466\/pr0.1959.5.g.151","article-title":"Measuring changes in mental health with the sentence completion technique","volume":"5","author":"Peck","year":"1959","journal-title":"Psychol. Rep."},{"key":"2024062610560689500_ref33","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.3758\/s13428-021-01694-3","article-title":"Data quality of platforms and panels for online behavioral research","volume":"54","author":"Peer","year":"2022","journal-title":"Behav. Res. Methods"},{"key":"2024062610560689500_ref34","first-page":"515","article-title":"Cross-cultural issues in working with users in the design of interactive systems","volume":"34","author":"Petrie","year":"2015","journal-title":"ICoRD\u201915 Smart Innov. Syst. Technol."},{"key":"2024062610560689500_ref35","first-page":"60","article-title":"Sentence Completion Methods: A Summary Review of 70 Survey-based Studies of Training and Professional Settings","volume":"25","author":"Piotrowski","year":"2018","journal-title":"ISIS J. Proj. Psy. & Ment."},{"key":"2024062610560689500_ref36","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1177\/0907568201008003006","article-title":"How do Brazilian Streeth youth experience the street? Analysis of a sentence completion task","volume":"8","author":"Raffaelli","year":"2001","journal-title":"Childhood"},{"key":"2024062610560689500_ref37","doi-asserted-by":"crossref","first-page":"86","DOI":"10.4135\/9781446280119.n8","volume-title":"Essential Guide to Qualitative Methods in Organizational Research","author":"Rees","year":"2004"},{"volume-title":"Psychometric Testing: Critical Perspectives","year":"2017","author":"Ridgeway","key":"2024062610560689500_ref38"},{"key":"2024062610560689500_ref39","first-page":"10","article-title":"The past, present, and future of UX empirical research","volume":"5","author":"Robinson","year":"2018","journal-title":"Communic. Des. Quart."},{"key":"2024062610560689500_ref40","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1023\/A:1023977704349","article-title":"Considerations for the use of sentence completion tests","volume":"33","author":"Rogers","year":"2003","journal-title":"J. Contemp. Psychother."},{"key":"2024062610560689500_ref41","doi-asserted-by":"crossref","first-page":"11","DOI":"10.55612\/s-5002-042-001","article-title":"Experience matters: bridging the gap between experience- and functionality-driven design in technology-enhanced learning","volume":"42","author":"Rohles","year":"2019","journal-title":"Interact. Des. Architect."},{"volume-title":"Outcome of Dagstuhl Seminar 10373 on Demarcating User Experience","year":"2011","author":"Roto","key":"2024062610560689500_ref42"},{"key":"2024062610560689500_ref43","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1037\/h0059479","article-title":"The incomplete sentences test as a method of studying personality","volume":"11","author":"Rotter","year":"1947","journal-title":"J. Consult. Psychol."},{"key":"2024062610560689500_ref44","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1037\/h0055829","article-title":"The relative effect upon projective responses of stimuli referring to the subject and of stimuli referring to other persons","volume":"13","author":"Sacks","year":"1949","journal-title":"J. Consult. Psychol."},{"key":"2024062610560689500_ref45","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/S0142-694X(02)00034-0","article-title":"Metrics for measuring ideation effectiveness","volume":"24","author":"Shah","year":"2003","journal-title":"Des. Stud."},{"key":"2024062610560689500_ref46","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1037\/1931-3896.2.2.68","article-title":"Assessing creativity with divergent thinking tasks: exploring the reliability and validity of new subjective scoring methods","volume":"2","author":"Silvia","year":"2008","journal-title":"Psychol. Aesthet. Creat. Arts"},{"key":"2024062610560689500_ref47","first-page":"459","article-title":"Does a persona improve creativity?","volume":"20","author":"So","year":"2017","journal-title":"Des. J."},{"volume-title":"Projective techniques for social science and business research","year":"2008","author":"Soley","key":"2024062610560689500_ref48"},{"key":"2024062610560689500_ref49","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1002\/1097-4679(194701)3:1<47::AID-JCLP2270030111>3.0.CO;2-Q","article-title":"The use of a sentence completion test for the diagnosis of personality","volume":"3","author":"Stein","year":"1947","journal-title":"J. Clin. Psychol."},{"key":"2024062610560689500_ref50","first-page":"332","article-title":"Stimulus pull as a determinant of individual differences in sentence completion responses","volume":"34","author":"Stephens","year":"1970","journal-title":"J. Proj Tech. Pers. Assess."},{"key":"2024062610560689500_ref51","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1037\/h0044329","article-title":"Evaluation of assumptions underlying interpretation of sentence completion tests","volume":"20","author":"Trites","year":"1956","journal-title":"J. Consult. Psychol."},{"key":"2024062610560689500_ref52","first-page":"57","article-title":"Memory probes: exploring retrospective user experience through traces of use on cherished objects","volume":"12","author":"Tsai","year":"2018","journal-title":"Int. J. Des."},{"key":"2024062610560689500_ref53","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1207\/s15327752jpa4501_7","article-title":"The effects of stem length and directions on sentence completion test responses","volume":"45","author":"Turnbow","year":"1981","journal-title":"J. Pers. Assess."},{"key":"2024062610560689500_ref54","first-page":"521","volume-title":"INTERACT 2015 Adjunct Proceedings: 15th IFIP TC.13 International Conference on Human-Computer Interaction","author":"V\u00e4\u00e4t\u00e4j\u00e4","year":"2015"},{"volume-title":"Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work","year":"(2023)","author":"Van Den Heuvel","key":"2024062610560689500_ref62"},{"key":"2024062610560689500_ref55","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.destud.2012.08.003","article-title":"Refinements to the variety metric for idea evaluation","volume":"34","author":"Verhaegen","year":"2013","journal-title":"Des. Stud."},{"key":"2024062610560689500_ref56","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1145\/1868914.1868973","volume-title":"Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10)","author":"Vermeeren","year":"2010"},{"volume-title":"Online surveys in collecting cross-cultural qualitative user experience feedback","year":"2016","author":"Walsh","key":"2024062610560689500_ref57"},{"key":"2024062610560689500_ref58","first-page":"11","volume-title":"Proceedings of the Ninth International Workshop on Internationalisation of Products and Systems IWIPS 2010, 7-10 July 2010","author":"Walsh","year":"2010"},{"key":"2024062610560689500_ref59","first-page":"1","volume-title":"Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia (MUM '10)","author":"Walsh","year":"2010"},{"key":"2024062610560689500_ref60","first-page":"73","volume-title":"Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13)","author":"Walsh","year":"2013"},{"volume-title":"Psychological Assessment of Candidates for a Religious Order","year":"1969","author":"Weisgerber","key":"2024062610560689500_ref61"}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/36\/1\/48\/58330817\/iwae002.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/36\/1\/48\/58330817\/iwae002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T11:22:42Z","timestamp":1719400962000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/36\/1\/48\/7617597"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,1]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3,6]]},"published-print":{"date-parts":[[2024,1,1]]}},"URL":"https:\/\/doi.org\/10.1093\/iwc\/iwae002","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"type":"print","value":"0953-5438"},{"type":"electronic","value":"1873-7951"}],"subject":[],"published-other":{"date-parts":[[2024,1]]},"published":{"date-parts":[[2024,1,1]]}}}