{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T21:38:05Z","timestamp":1772660285477,"version":"3.50.1"},"reference-count":72,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>This paper reviews types and uses of card sorting and how a relatively unpopularized variation of card sorting\u2014\u2018repeated single-criterion sorting\u2019\u2014can be applied to the information architecture design of digital music services. A total of 52 respondents were asked to sort, using their own choice of criteria, 12 popular songs using an online card sorting tool. Once respondents had chosen a construct for a particular sort e.g. \u2018Genre\u2019, they placed each card into a named category, e.g. \u2018Rock\u2019, \u2018Pop\u2019, and were encouraged to repeat this process until they could think of no more constructs. High levels of agreement were found for a small number of constructs such as \u2018genre\u2019, \u2018gender\u2019 and \u2018speed of song\u2019, but the remaining constructs were individual to each respondent e.g. \u2018songs that make me cry\u2019. The results highlighted differences with current approaches to music categorization, as well as the potential for repeated single-criterion sorting to be used to design faceted navigation structures and form part of the user-centred design process.<\/jats:p>","DOI":"10.1093\/iwc\/iwac002","type":"journal-article","created":{"date-parts":[[2022,3,9]],"date-time":"2022-03-09T20:11:53Z","timestamp":1646856713000},"page":"442-457","source":"Crossref","is-referenced-by-count":7,"title":["Card Sorting for User Experience Design"],"prefix":"10.1093","volume":"33","author":[{"given":"Ed","family":"de Quincey","sequence":"first","affiliation":[{"name":"School of Computing and Mathematics , Keele University, Keele, Stoke-on-Trent, Staffordshire, ST5 5BG"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Mitchell","sequence":"additional","affiliation":[{"name":"School of Computing and Mathematics , Keele University, Keele, Stoke-on-Trent, Staffordshire, ST5 5BG"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,6,30]]},"reference":[{"key":"2022092214273687100_ref1","first-page":"192","volume-title":"Proceedings of the 2005 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries","author":"Alexander","year":"2005"},{"key":"2022092214273687100_ref2","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1076\/jnmr.32.1.83.16801","article-title":"Representing musical genre: a state of the art","volume":"32","author":"Aucouturier","year":"2003","journal-title":"J. New Music Res."},{"key":"2022092214273687100_ref3","volume-title":"Card Sorting Best Practices for UX","author":"Babich","year":"2019"},{"key":"2022092214273687100_ref4","volume-title":"Inquiring Man: The Psychology of Personal Constructs","author":"Bannister","year":"1986"},{"key":"2022092214273687100_ref5","first-page":"273","article-title":"A note on the correlation of elements in repertory grids: how to, and why","volume":"19","author":"Bell","year":"2006","journal-title":"J. Constr. Psychol."},{"key":"2022092214273687100_ref6","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/1341531.1341539","article-title":"Beyond basic faceted search","author":"Ben-Yitzhak","year":"2008","journal-title":"Proceedings of the international conference on Web search and web data mining"},{"key":"2022092214273687100_ref7","first-page":"769","volume-title":"Data Management and Analysis Methods. Handbook of Qualitative Research","author":"Bernard","year":"2000","edition":"2nd"},{"key":"2022092214273687100_ref8","volume-title":"Usability Net Methods for User-Centred Design. Human\u2013Computer Interaction: Theory and Practice 1","author":"Bevan","year":"2003"},{"key":"2022092214273687100_ref9","doi-asserted-by":"crossref","DOI":"10.1037\/13141-000","volume-title":"The Q-Sort Method in Personality Assessment and Psychiatric Research","author":"Block","year":"1961"},{"key":"2022092214273687100_ref10","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/S1042-8143(89)80019-6","article-title":"Recent progress in AQUINAS: a knowledge acquisition workbench","volume":"1","author":"Boose","year":"1989","journal-title":"Knowl. Acquis."},{"key":"2022092214273687100_ref11","first-page":"35","article-title":"Q is accounting for tastes","volume":"39","author":"Brouwer","year":"1999","journal-title":"J. Advert. Res."},{"key":"2022092214273687100_ref12","first-page":"91","article-title":"A primer on Q methodology","volume":"16","author":"Brown","year":"1993","journal-title":"Oper. Subject."},{"key":"2022092214273687100_ref13","doi-asserted-by":"crossref","first-page":"2287","DOI":"10.1145\/2470654.2481315","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI '13)","author":"Cassidy","year":"2013"},{"key":"2022092214273687100_ref14","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1111\/1468-0394.00106","article-title":"A knowledge sorting process for a product design expert system","volume":"16","author":"Chen","year":"1999","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref15","volume-title":"Understanding Your Users","author":"Courage","year":"2005"},{"key":"2022092214273687100_ref16","article-title":"Sorting techniques for user-centered information design","author":"Deaton","year":"2004"},{"key":"2022092214273687100_ref17","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1111\/j.1468-0394.2005.00304.x","article-title":"Using edit distance to analyze card sorts","volume":"22","author":"Deibel","year":"2005","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref18","volume-title":"Music in Everyday Life","author":"DeNora","year":"2009"},{"key":"2022092214273687100_ref19","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1145\/634067.634085","article-title":"A user input and analysis tool for information architecture","author":"Dong","year":"2001","journal-title":"CHI'01 Extended Abstracts on Human Factors in Computing Systems"},{"key":"2022092214273687100_ref20","article-title":"Understanding personal construct theory and George Kelly","author":"Enquire Within","year":"2010"},{"key":"2022092214273687100_ref21","article-title":"Q-methodology\u2014a sneak preview","author":"Exel","year":"2005"},{"key":"2022092214273687100_ref22","doi-asserted-by":"crossref","first-page":"349","DOI":"10.5860\/crl.61.4.349","article-title":"Gaining user insight: a case study illustrating the card sort technique","volume":"61","author":"Faiks","year":"2000","journal-title":"C&RL"},{"key":"2022092214273687100_ref23","volume-title":"Proceedings of SIGCHI 1997","author":"Frederickson-Mele","year":"1997"},{"key":"2022092214273687100_ref24","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/978-1-4613-1823-1_7","volume-title":"Knowledge Acquisition for Expert Systems","author":"Gammack","year":"1987"},{"key":"2022092214273687100_ref25","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1111\/j.1468-0394.2005.00301.x","article-title":"Women's working wardrobes: a study using card sorts","volume":"22","author":"Gerrard","year":"2005","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref26","article-title":"The structure of collaborative tagging systems","author":"Golder","year":"2005","journal-title":"HP Labs Tech.nical Report"},{"key":"2022092214273687100_ref27","volume-title":"Proceedings of the 9th international conference on music perception and cognition","author":"Greasley","year":"2006"},{"key":"2022092214273687100_ref28","first-page":"27","article-title":"Content analysis of the personal constructs of female sexual abuse survivors elicited through repertory grid technique","volume":"17","author":"Harter","year":"2004","journal-title":"J. Constr. Psychol."},{"key":"2022092214273687100_ref29","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1108\/eb003742","article-title":"The repertory grid in action","volume":"11","author":"Honey","year":"1979","journal-title":"Ind. Commer. Train."},{"key":"2022092214273687100_ref31","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1046\/j.1365-2575.1997.00005.x","article-title":"The use of rep grids to gather interview data about information systems analysts","volume":"7","author":"Hunter","year":"1997","journal-title":"Inf. Syst. J."},{"key":"2022092214273687100_ref32","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1287\/isre.11.1.93.11786","article-title":"Using repertory grids to conduct cross-cultural information systems research","volume":"11","author":"Hunter","year":"2000","journal-title":"Inf. Syst. Res."},{"key":"2022092214273687100_ref33","first-page":"40","article-title":"Pandora and the music genome project","volume":"23","author":"Joyce","year":"2006","journal-title":"Sci. Comput."},{"key":"2022092214273687100_ref34","volume-title":"The Psychology of Personal Constructs","author":"Kelly","year":"1955"},{"key":"2022092214273687100_ref35","volume-title":"Proceedings Information Architecture Summit 2007","author":"Kipp","year":"2007"},{"key":"2022092214273687100_ref36","first-page":"1","article-title":"Patterns and inconsistencies in collaborative tagging systems: an examination of tagging practices","volume":"43","author":"Kipp","year":"2006","journal-title":"American Society for Information Science and Technology Meeting Proceedings of the ASIST Annual Meeting"},{"key":"2022092214273687100_ref37","article-title":"Analyzing card sort results with a spreadsheet template","author":"Lamantia","year":"2003"},{"key":"2022092214273687100_ref38","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1046\/j.1365-2575.2000.00086.x","article-title":"Exploring the impact of formal training in ISD methods on the cognitive structure of novice information systems developers","volume":"10","author":"Lee","year":"2000","journal-title":"Inf. Syst. J."},{"key":"2022092214273687100_ref39","first-page":"4","volume-title":"Proceedings of IEEE international conference on acoustics, speech, and signal processing, 2004 (ICASSP'04)","author":"Lippens","year":"2004"},{"key":"2022092214273687100_ref40","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/MS.2009.59","article-title":"Card sorts to acquire requirements","volume":"26","author":"Maiden","year":"2009","journal-title":"IEEE Softw."},{"key":"2022092214273687100_ref41","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1111\/j.1468-0394.2005.00302.x","article-title":"That site looks 88.46% familiar: quantifying similarity of web page design","volume":"22","author":"Martine","year":"2005","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref42","volume-title":"Automatic music classification with jMIR","author":"McKay","year":"2010"},{"key":"2022092214273687100_ref44","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/2.121503","article-title":"The usability engineering life cycle","volume":"25","author":"Nielsen","year":"1992","journal-title":"Computer"},{"key":"2022092214273687100_ref45","first-page":"249","volume-title":"Heuristic evaluation of user interfaces","author":"Nielsen","year":"1990"},{"key":"2022092214273687100_ref46","article-title":"Design of SunWeb\u2014sun microsystems intranet","author":"Nielsen","year":"1994"},{"key":"2022092214273687100_ref47","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1348\/000709900158083","article-title":"The importance of music to adolescents","volume":"70","author":"North","year":"2000","journal-title":"Brit. J. Educ. Psychol."},{"key":"2022092214273687100_ref48","author":"O\u2019Neill","year":"2013"},{"key":"2022092214273687100_ref49","first-page":"1238","volume-title":"Proceedings of content-based multimedia information access (RIAO)","author":"Pachet","year":"2000"},{"key":"2022092214273687100_ref50a","volume-title":"Software support for comparison of media across domains","author":"de Quincey","year":"2010"},{"key":"2022092214273687100_ref50","volume-title":"Elements of Library Classification","author":"Ranganathan","year":"1962"},{"key":"2022092214273687100_ref51","volume-title":"Information Design Using Card Sorting","author":"Robertson","year":"2001"},{"key":"2022092214273687100_ref52","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1111\/1468-0394.00045","article-title":"The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts","volume":"14","author":"Rugg","year":"1997","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref53","first-page":"81","article-title":"Eliciting hierarchical knowledge structures: laddering","volume":"71","author":"Rugg","year":"2002","journal-title":"Encyc. Lib. Inf. Sci."},{"key":"2022092214273687100_ref54","volume-title":"Proceedings of 6th Banff knowledge acquisition for knowledge-based systems workshop","author":"Rugg","year":"1991"},{"key":"2022092214273687100_ref55","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/1042-8143(92)90019-W","article-title":"A comparison of sorting techniques in knowledge acquisition","volume":"4","author":"Rugg","year":"1992","journal-title":"Knowl. Acquis."},{"key":"2022092214273687100_ref56","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1111\/j.1468-0394.2005.00303.x","article-title":"A multi-institutional, multinational study of programming concepts using card sort data","volume":"22","author":"Sanders","year":"2005","journal-title":"Exp. Syst."},{"key":"2022092214273687100_ref57","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1121\/1.421129","article-title":"Tempo and beat analysis of acoustic musical signals","volume":"103","author":"Scheirer","year":"1998","journal-title":"J. Acoust. Soc. Am."},{"key":"2022092214273687100_ref58","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1049\/sej.1996.0022","article-title":"Requirements acquisition","volume":"11","author":"Shaw","year":"1996","journal-title":"Softw. Eng. J."},{"key":"2022092214273687100_ref59","volume-title":"Card Sorting: Uncover Users' Mental Models for Better Information Architecture","author":"Sherwin","year":"2018"},{"key":"2022092214273687100_ref60","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1177\/102986490100500102","article-title":"Functions of music in everyday life: an exploratory using the experience sampling method","volume":"5","author":"Sloboda","year":"2001","journal-title":"Music. Sci."},{"key":"2022092214273687100_ref61","volume-title":"Card Sorting: A Definitive Guide","author":"Spencer","year":"2004"},{"key":"2022092214273687100_ref62","volume-title":"The Study of Behavior: Q-Technique and Its Methodology","author":"Stephenson","year":"1953"},{"key":"2022092214273687100_ref63","doi-asserted-by":"crossref","first-page":"39","DOI":"10.2307\/4132340","article-title":"The repertory grid technique: a method for the study of cognition in information systems","volume":"26","author":"Tan","year":"2002","journal-title":"MIS Q."},{"key":"2022092214273687100_ref64","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/1165385.317471","article-title":"Designing a menu-based interface to an operating system","volume":"16","author":"Tullis","year":"1985","journal-title":"ACM SIGCHI Bull."},{"key":"2022092214273687100_ref65","first-page":"1","article-title":"Using card-sorting techniques to organize your intranet","volume":"1","author":"Tullis","year":"2003","journal-title":"Intra. J. Strat. Manag"},{"key":"2022092214273687100_ref66","volume-title":"Proceedings of the UPA 2004 conference","author":"Tullis","year":"2004"},{"key":"2022092214273687100_ref67","author":"Upchurch","year":"1999"},{"key":"2022092214273687100_ref68","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MS.2001.936222","article-title":"Using card sorts to elicit web page quality attributes","volume":"18","author":"Upchurch","year":"2001","journal-title":"IEEE Softw."},{"key":"2022092214273687100_ref69","volume-title":"Card Sorting","author":"Usability.gov","year":"..-"},{"key":"2022092214273687100_ref70","volume-title":"User-Centered Design Process Map","author":"Usability.gov","year":"..-"},{"key":"2022092214273687100_ref71","first-page":"105","volume-title":"Usability Inspection Methods","author":"Wharton","year":"1994"},{"key":"2022092214273687100_ref72","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1108\/09564239610109429","article-title":"Factors affecting information systems' success","volume":"7","author":"Whyte","year":"1996","journal-title":"Int. J. Service Indust. Manag."},{"key":"2022092214273687100_ref73","volume-title":"The repertory grid: a critical appraisal","author":"Yorke","year":"1983"}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/33\/4\/442\/45967670\/iwac002.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/33\/4\/442\/45967670\/iwac002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T16:09:08Z","timestamp":1663862948000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/33\/4\/442\/6623885"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7]]},"references-count":72,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,6,30]]},"published-print":{"date-parts":[[2021,7,11]]}},"URL":"https:\/\/doi.org\/10.1093\/iwc\/iwac002","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,7]]},"published":{"date-parts":[[2021,7]]}}}