{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T22:13:24Z","timestamp":1785795204380,"version":"3.56.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T00:00:00Z","timestamp":1594598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,7,14]]},"DOI":"10.1145\/3386392.3399297","type":"proceedings-article","created":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T21:57:23Z","timestamp":1594677443000},"page":"206-212","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Persona Prototypes for Improving the Qualitative Evaluation of Recommendation Systems"],"prefix":"10.1145","author":[{"given":"Joanna","family":"Misztal-Radecka","sequence":"first","affiliation":[{"name":"AGH University of Science and Technology & Ringier Axel Springer Polska, Cracow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bipin","family":"Indurkhya","sequence":"additional","affiliation":[{"name":"Jagiellonian University, Cracow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,7,13]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Bias on the web. Commun. ACM 61 (05","author":"Baeza-Yates Ricardo","year":"2018","unstructured":"Ricardo Baeza-Yates . 2018. Bias on the web. Commun. ACM 61 (05 2018 ), 54--61. https:\/\/doi.org\/10.1145\/3209581 10.1145\/3209581 Ricardo Baeza-Yates. 2018. Bias on the web. Commun. ACM 61 (05 2018), 54--61. https:\/\/doi.org\/10.1145\/3209581"},{"key":"e_1_3_2_2_2_1","unstructured":"Yoshua Bengio. 2019. From System 1 Deep Learning to System 2 Deep Learning. https:\/\/nips.cc\/Conferences\/2019\/ScheduleMultitrack?event=15488.  Yoshua Bengio. 2019. From System 1 Deep Learning to System 2 Deep Learning. https:\/\/nips.cc\/Conferences\/2019\/ScheduleMultitrack?event=15488."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1214\/11-AOAS495"},{"key":"e_1_3_2_2_4_1","volume-title":"Jordan","author":"Blei David M.","year":"2003","unstructured":"David M. Blei , Andrew Y. Ng , and Michael I . Jordan . 2003 . Latent Dirichlet Allocation. J. Mach. Learn. Res .3 (March 2003), 993--1022. http:\/\/dl.acm.org\/citation.cfm?id=944919.944937 David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. J. Mach. Learn. Res.3 (March 2003), 993--1022. http:\/\/dl.acm.org\/citation.cfm?id=944919.944937"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157584"},{"key":"e_1_3_2_2_6_1","volume-title":"Proceedings of the 12th National Conference in Artificial Intelligence and Cognitive Science, Diarmuid O'Donoghue (Ed.)","author":"Bradley K.","unstructured":"K. Bradley and B. Smyth . 2001. Improving Recommendation Diversity . In Proceedings of the 12th National Conference in Artificial Intelligence and Cognitive Science, Diarmuid O'Donoghue (Ed.) . Maynooth, Ireland, 75--84. K. Bradley and B. Smyth. 2001. Improving Recommendation Diversity. In Proceedings of the 12th National Conference in Artificial Intelligence and Cognitive Science, Diarmuid O'Donoghue (Ed.). Maynooth, Ireland, 75--84."},{"key":"#cr-split#-e_1_3_2_2_7_1.1","doi-asserted-by":"crossref","unstructured":"Tadeusz Cali'ski and Harabasz JA. 1974. A Dendrite Method for Cluster Analysis. Communications in Statistics - Theory and Methods 3 (01 1974) 1--27. https:\/\/doi.org\/10.1080\/03610927408827101 10.1080\/03610927408827101","DOI":"10.1080\/03610927408827101"},{"key":"#cr-split#-e_1_3_2_2_7_1.2","doi-asserted-by":"crossref","unstructured":"Tadeusz Cali'ski and Harabasz JA. 1974. A Dendrite Method for Cluster Analysis. Communications in Statistics - Theory and Methods 3 (01 1974) 1--27. https:\/\/doi.org\/10.1080\/03610927408827101","DOI":"10.1080\/03610927408827101"},{"key":"e_1_3_2_2_8_1","volume-title":"Advances in Knowledge Discovery and Data Mining","author":"Campello Ricardo J. G. B.","unstructured":"Ricardo J. G. B. Campello , Davoud Moulavi , and Joerg Sander . 2013. Density-Based Clustering Based on Hierarchical Density Estimates . In Advances in Knowledge Discovery and Data Mining , Jian Pei, Vincent S. Tseng, Longbing Cao, Hiroshi Motoda, and Guandong Xu (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg , 160--172. Ricardo J. G. B. Campello, Davoud Moulavi, and Joerg Sander. 2013. Density-Based Clustering Based on Hierarchical Density Estimates. In Advances in Knowledge Discovery and Data Mining, Jian Pei, Vincent S. Tseng, Longbing Cao, Hiroshi Motoda, and Guandong Xu (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 160--172."},{"key":"e_1_3_2_2_9_1","volume-title":"Event-Driven Narratives. From simple descriptions to real stories. Journalism Practice(05","author":"Caswell David","year":"2017","unstructured":"David Caswell and Konstantin Dorr . 2017. Automated Journalism 2.0 : Event-Driven Narratives. From simple descriptions to real stories. Journalism Practice(05 2017 ). David Caswell and Konstantin Dorr. 2017. Automated Journalism 2.0: Event-Driven Narratives. From simple descriptions to real stories. Journalism Practice(05 2017)."},{"key":"e_1_3_2_2_10_1","volume-title":"About Face: The Essentials of Interaction Design","author":"Cooper Alan","year":"2014","unstructured":"Alan Cooper , Robert Reimann , and Dave Cronin . 2014 . About Face: The Essentials of Interaction Design . John Wiley & Sons, Inc. , New York, NY, USA . Alan Cooper, Robert Reimann, and Dave Cronin. 2014. About Face: The Essentials of Interaction Design. John Wiley & Sons, Inc., New York, NY, USA."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242610"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1979.4766909"},{"key":"e_1_3_2_2_13_1","volume-title":"A density-based algorithm for discovering clusters in large spatial databases with noise","author":"Ester Martin","unstructured":"Martin Ester , Hans-Peter Kriegel , J\u00f6rg Sander , and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise . AAAI Press , 226--231. Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. AAAI Press, 226--231."},{"key":"e_1_3_2_2_14_1","volume-title":"User Clustering in On-line Advertising via Topic Models. CoRRabs\/1501.06595","author":"Geyik Sahin Cem","year":"2015","unstructured":"Sahin Cem Geyik , Ali Dasdan , and Kuang-Chih Lee . 2015. User Clustering in On-line Advertising via Topic Models. CoRRabs\/1501.06595 ( 2015 ). arXiv:1501.06595 http:\/\/arxiv.org\/abs\/1501.06595 Sahin Cem Geyik, Ali Dasdan, and Kuang-Chih Lee. 2015. User Clustering in On-line Advertising via Topic Models. CoRRabs\/1501.06595 (2015). arXiv:1501.06595 http:\/\/arxiv.org\/abs\/1501.06595"},{"key":"e_1_3_2_2_15_1","volume-title":"First Women","author":"Graells-Garrido Eduardo","year":"2015","unstructured":"Eduardo Graells-Garrido , Mounia Lalmas , and Filippo Menczer . 2015. First Women , Second Sex : Gender Bias in Wikipedia. CoRRabs\/ 1502.02341 ( 2015 ). arXiv:1502.02341 http:\/\/arxiv.org\/abs\/1502.02341 Eduardo Graells-Garrido, Mounia Lalmas, and Filippo Menczer. 2015. First Women, Second Sex: Gender Bias in Wikipedia. CoRRabs\/1502.02341 (2015). arXiv:1502.02341 http:\/\/arxiv.org\/abs\/1502.02341"},{"key":"e_1_3_2_2_16_1","volume-title":"A Survey Of Methods For Explaining Black Box Models. CoRRabs\/1802.01933","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti , Anna Monreale , Franco Turini , Dino Pedreschi , and Fosca Giannotti . 2018. A Survey Of Methods For Explaining Black Box Models. CoRRabs\/1802.01933 ( 2018 ). arXiv:1802.01933 http:\/\/arxiv.org\/abs\/1802.01933 Riccardo Guidotti, Anna Monreale, Franco Turini, Dino Pedreschi, and Fosca Giannotti. 2018. A Survey Of Methods For Explaining Black Box Models. CoRRabs\/1802.01933 (2018). arXiv:1802.01933 http:\/\/arxiv.org\/abs\/1802.01933"},{"key":"e_1_3_2_2_17_1","article-title":"The Movie Lens Datasets","volume":"5","author":"Maxwell Harper F.","year":"2015","unstructured":"F. Maxwell Harper and Joseph A. Konstan . 2015 . The Movie Lens Datasets : History and Context. ACM Trans. Interact. Intell. Syst. 5 , 4, Article 19 (Dec. 2015), 19 pages.https:\/\/doi.org\/10.1145\/2827872 10.1145\/2827872 F. Maxwell Harper and Joseph A. Konstan. 2015. The Movie Lens Datasets: History and Context. ACM Trans. Interact. Intell. Syst.5, 4, Article 19 (Dec. 2015), 19 pages.https:\/\/doi.org\/10.1145\/2827872","journal-title":"History and Context. ACM Trans. Interact. Intell. Syst."},{"key":"e_1_3_2_2_18_1","unstructured":"Christian Hennig. 2017. Cluster validation by measurement of clustering characteristics relevant to the user. arXiv:stat.ME\/1703.09282  Christian Hennig. 2017. Cluster validation by measurement of clustering characteristics relevant to the user. arXiv:stat.ME\/1703.09282"},{"key":"e_1_3_2_2_19_1","volume-title":"Semantics derived automatically from language corpora necessarily contain human biases. CoRRabs\/1608.07187","author":"Islam Aylin Caliskan","year":"2016","unstructured":"Aylin Caliskan Islam , Joanna J. Bryson , and Arvind Narayanan . 2016. Semantics derived automatically from language corpora necessarily contain human biases. CoRRabs\/1608.07187 ( 2016 ). arXiv:1608.07187 http:\/\/arxiv.org\/abs\/1608.07187 Aylin Caliskan Islam, Joanna J. Bryson, and Arvind Narayanan. 2016. Semantics derived automatically from language corpora necessarily contain human biases. CoRRabs\/1608.07187 (2016). arXiv:1608.07187 http:\/\/arxiv.org\/abs\/1608.07187"},{"key":"e_1_3_2_2_20_1","volume-title":"Dubes","author":"Jain Anil K.","year":"1988","unstructured":"Anil K. Jain and Richard C . Dubes . 1988 . Algorithms for Clustering Data. Prentice-Hall , Inc., Upper Saddle River, NJ, USA. Anil K. Jain and Richard C. Dubes. 1988. Algorithms for Clustering Data. Prentice-Hall, Inc., Upper Saddle River, NJ, USA."},{"key":"e_1_3_2_2_21_1","volume-title":"fast and slow. Farrar, Straus and Giroux","author":"Kahneman Daniel","unstructured":"Daniel Kahneman . 2011.Thinking , fast and slow. Farrar, Straus and Giroux , New York . https:\/\/www.amazon.de\/Thinking-Fast-Slow-Daniel-Kahneman\/dp\/0374275637\/ref=wl_it_dp_o_pdT1_nS_nC?ie=UTF8&colid=151193SNGKJT9&coliid=I3OCESLZCVDFL7 Daniel Kahneman. 2011.Thinking, fast and slow. Farrar, Straus and Giroux, New York. https:\/\/www.amazon.de\/Thinking-Fast-Slow-Daniel-Kahneman\/dp\/0374275637\/ref=wl_it_dp_o_pdT1_nS_nC?ie=UTF8&colid=151193SNGKJT9&coliid=I3OCESLZCVDFL7"},{"key":"e_1_3_2_2_22_1","volume-title":"Advances in Neural Information Processing Systems 29","author":"Kim Been","unstructured":"Been Kim , Rajiv Khanna , and Oluwasanmi O Koyejo . 2016. Examples are not enough, learn to criticize! Criticism for Interpretability . In Advances in Neural Information Processing Systems 29 , D. D.Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett (Eds.). Curran Associates, Inc. , 2280--2288.http:\/\/papers.nips.cc\/paper\/6300-examples-are-not-enough-learn-to-criticize-criticism-for-interpretability.pdf Been Kim, Rajiv Khanna, and Oluwasanmi O Koyejo. 2016. Examples are not enough, learn to criticize! Criticism for Interpretability. In Advances in Neural Information Processing Systems 29, D. D.Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett (Eds.). Curran Associates, Inc., 2280--2288.http:\/\/papers.nips.cc\/paper\/6300-examples-are-not-enough-learn-to-criticize-criticism-for-interpretability.pdf"},{"key":"e_1_3_2_2_23_1","unstructured":"Been Kim Cynthia Rudin and Julie Shah. 2015. The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification. arXiv:stat.ML\/1503.01161  Been Kim Cynthia Rudin and Julie Shah. 2015. The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification. arXiv:stat.ML\/1503.01161"},{"key":"e_1_3_2_2_24_1","volume-title":"UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv:stat.ML\/1802.03426","author":"McInnes Leland","year":"2018","unstructured":"Leland McInnes , John Healy , and James Melville . 2018 . UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv:stat.ML\/1802.03426 Leland McInnes, John Healy, and James Melville. 2018. UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv:stat.ML\/1802.03426"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Christoph Molnar. 2019. Interpretable Machine Learning. https:\/\/christophm.github.io\/interpretable-ml-book\/.  Christoph Molnar. 2019. Interpretable Machine Learning. https:\/\/christophm.github.io\/interpretable-ml-book\/.","DOI":"10.21105\/joss.00786"},{"key":"e_1_3_2_2_26_1","volume-title":"The Design of Everyday Things","author":"Norman Donald A.","unstructured":"Donald A. Norman . 2002. The Design of Everyday Things . Basic Books, Inc. , New York, NY, USA . Donald A. Norman. 2002. The Design of Everyday Things. Basic Books, Inc., NewYork, NY, USA."},{"key":"e_1_3_2_2_27_1","volume-title":"Reviewon Customer Segmentation Technique on E-commerce. Advanced Science Letters 22 (10","author":"Sari Juni Nurma","year":"2016","unstructured":"Juni Nurma Sari , Lukito Nugroho , Ridi Ferdiana , and Paulus Santosa . 2016. Reviewon Customer Segmentation Technique on E-commerce. Advanced Science Letters 22 (10 2016 ), 3018--3022. https:\/\/doi.org\/10.1166\/asl.2016.7985 10.1166\/asl.2016.7985 Juni Nurma Sari, Lukito Nugroho, Ridi Ferdiana, and Paulus Santosa. 2016. Reviewon Customer Segmentation Technique on E-commerce. Advanced Science Letters 22 (10 2016), 3018--3022. https:\/\/doi.org\/10.1166\/asl.2016.7985"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0377-0427(87)90125-7"},{"key":"e_1_3_2_2_30_1","volume-title":"Proceedings of the 5th International Conference on Computer and Information Technology (ICCIT).","author":"Sarwar Badrul M.","year":"2002","unstructured":"Badrul M. Sarwar , George Karypis , Joseph Konstan , and John Reidl . 2002 . Recommender Systems for Large-Scale E-Commerce: Scalable Neighborhood Formation Using Clustering . In Proceedings of the 5th International Conference on Computer and Information Technology (ICCIT). Badrul M. Sarwar, George Karypis, Joseph Konstan, and John Reidl. 2002. Recommender Systems for Large-Scale E-Commerce: Scalable Neighborhood Formation Using Clustering. In Proceedings of the 5th International Conference on Computer and Information Technology (ICCIT)."},{"key":"#cr-split#-e_1_3_2_2_31_1.1","doi-asserted-by":"crossref","unstructured":"Nava Tintarev and Judith Masthoff. 2011. Designing and Evaluating Explanations for Recommender Systems. In Recommender Systems Handbook Francesco Ricci Lior Rokach Bracha Shapira and Paul B. Kantor (Eds.). Springer US 479--510. https:\/\/doi.org\/10.1007\/978-0--387--85820--3_15 10.1007\/978-0--387--85820--3_15","DOI":"10.1007\/978-0-387-85820-3_15"},{"key":"#cr-split#-e_1_3_2_2_31_1.2","doi-asserted-by":"crossref","unstructured":"Nava Tintarev and Judith Masthoff. 2011. Designing and Evaluating Explanations for Recommender Systems. In Recommender Systems Handbook Francesco Ricci Lior Rokach Bracha Shapira and Paul B. Kantor (Eds.). Springer US 479--510. https:\/\/doi.org\/10.1007\/978-0--387--85820--3_15","DOI":"10.1007\/978-0-387-85820-3_15"},{"key":"e_1_3_2_2_32_1","volume-title":"Bias Disparity in Recommendation Systems. CoRRabs\/1811.01461","author":"Tsintzou Virginia","year":"2018","unstructured":"Virginia Tsintzou , Evaggelia Pitoura , and Panayiotis Tsaparas . 2018. Bias Disparity in Recommendation Systems. CoRRabs\/1811.01461 ( 2018 ). arXiv:1811.01461http:\/\/arxiv.org\/abs\/1811.01461 Virginia Tsintzou, Evaggelia Pitoura, and Panayiotis Tsaparas. 2018. Bias Disparity in Recommendation Systems. CoRRabs\/1811.01461 (2018). arXiv:1811.01461http:\/\/arxiv.org\/abs\/1811.01461"},{"key":"e_1_3_2_2_33_1","first-page":"1124","article-title":"Judgment under Uncertainty","volume":"185","author":"Tversky Amos","year":"1974","unstructured":"Amos Tversky and Daniel Kahneman . 1974 . Judgment under Uncertainty : Heuristics and Biases. Science 185 ,4157(1974), 1124 -- 1131 .https:\/\/doi.org\/10.1126\/science.185.4157.1124arXiv:https:\/\/science.sciencemag.org\/content\/185\/4157\/1124.full.pdf 10.1126\/science.185.4157.1124arXiv:https: Amos Tversky and Daniel Kahneman.1974. Judgment under Uncertainty: Heuristics and Biases. Science 185,4157(1974),1124--1131.https:\/\/doi.org\/10.1126\/science.185.4157.1124arXiv:https:\/\/science.sciencemag.org\/content\/185\/4157\/1124.full.pdf","journal-title":"Heuristics and Biases. Science"},{"key":"e_1_3_2_2_34_1","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton . 2008 . Visualizing Data using t-SNE . Journal of Machine Learning Research 9 (2008), 2579 -- 2605 . http:\/\/www.jmlr.org\/papers\/v9\/vandermaaten08a.html Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9 (2008), 2579--2605. http:\/\/www.jmlr.org\/papers\/v9\/vandermaaten08a.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2684822.2685291"},{"key":"e_1_3_2_2_36_1","volume-title":"Explainable Recommendation: A Survey and New Perspectives. CoRRabs\/1804.11192","author":"Zhang Yongfeng","year":"2018","unstructured":"Yongfeng Zhang and Xu Chen . 2018 . Explainable Recommendation: A Survey and New Perspectives. CoRRabs\/1804.11192 (2018). arXiv:1804.11192 http:\/\/arxiv.org\/abs\/1804.11192 Yongfeng Zhang and Xu Chen. 2018. Explainable Recommendation: A Survey and New Perspectives. CoRRabs\/1804.11192 (2018). arXiv:1804.11192 http:\/\/arxiv.org\/abs\/1804.11192"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1002\/nem.1900"}],"event":{"name":"UMAP '20: 28th ACM Conference on User Modeling, Adaptation and Personalization","location":"Genoa Italy","acronym":"UMAP '20","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386392.3399297","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386392.3399297","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:44Z","timestamp":1750200104000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386392.3399297"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,13]]},"references-count":39,"alternative-id":["10.1145\/3386392.3399297","10.1145\/3386392"],"URL":"https:\/\/doi.org\/10.1145\/3386392.3399297","relation":{},"subject":[],"published":{"date-parts":[[2020,7,13]]},"assertion":[{"value":"2020-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}