{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T23:27:52Z","timestamp":1793921272600,"version":"4.8.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T00:00:00Z","timestamp":1454284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,4]]},"abstract":"<jats:p>The primary goal of a recommender system is to generate high quality user-centred recommendations. However, the traditional evaluation methods and metrics were developed before researchers understood all the factors that increase user satisfaction. This study is an introduction to a novel user and item classification framework. It is proposed that this framework should be used during user-centred evaluation of recommender systems and the need for this framework is justified through experiments. User profiles are constructed and matched against other users\u2019 profiles to formulate neighbourhoods and generate top-N recommendations. The recommendations are evaluated to measure the success of the process. In conjunction with the framework, a new diversity metric is presented and explained. The accuracy, coverage, and diversity of top-N recommendations is illustrated and discussed for groups of users. It is found that in contradiction to common assumptions, not all users suffer as expected from the data sparsity problem. In fact, the group of users that receive the most accurate recommendations do not belong to the least sparse area of the dataset.<\/jats:p>","DOI":"10.1145\/2700491","type":"journal-article","created":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T20:37:54Z","timestamp":1454359074000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["A Novel Classification Framework for Evaluating Individual and Aggregate Diversity in Top-N Recommendations"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6171-9129","authenticated-orcid":false,"given":"Jennifer","family":"Moody","sequence":"first","affiliation":[{"name":"University of Ulster, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David H.","family":"Glass","sequence":"additional","affiliation":[{"name":"University of Ulster, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.15"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2005.99"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/312129.312230"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/11577935_1"},{"key":"e_1_2_1_5_1","volume-title":"The Longer Long Tail: How Endless Choice is Creating Unlimited Demand","author":"Anderson Chris"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869446.1869447"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043996"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence (UAI\u201998)","author":"Breese John S.","year":"1998"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021240730564"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/AXMEDIS.2008.13"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2007.07.047"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/91474.91486"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.11.010"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/138859.138867"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011419012209"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358995"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2007.80"},{"key":"e_1_2_1_20_1","volume-title":"Recommender Systems: An Introduction (1st. ed.)","author":"Jannach Dietmar","year":"2011"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/502585.502627"},{"key":"e_1_2_1_22_1","volume-title":"Konstan and John Riedl","author":"Joseph","year":"1999"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2003.1167344"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277751"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639714.1639717"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/1760422.1760447"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009050"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125659"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/646180.682439"},{"key":"e_1_2_1_31_1","volume-title":"18th National Conference on Artificial Intelligence, Rina Dechter, Michael Kearns, and Rich Sutton (Eds.). American Association for Artificial Intelligence","author":"Melville Prem","year":"2002"},{"key":"e_1_2_1_32_1","volume-title":"Retrieved","author":"Dataset MovieLens","year":"2006"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043962"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/502716.502737"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12275-0_35"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 2010 Conference on STAIRS 2010: Proceedings of the 5th Starting AI Researchers\u2019 Symposium, Thomas \u00c5gotnes (Ed.). IOS Press","author":"Redpath Jennifer","year":"2010"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 19th Irish Conference on Artificial Intelligence and Cognitive Science (AICS).","author":"Redpath Jennifer","year":"2008"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.192905"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/245108.245121"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/352871.352887"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA439541"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Guy Shani and Asela Gunawardana. 2010. Evaluating recommendation systems. In Recommender Systems Handbook 257--297 doi:10.1007\/978-0-387-85820-3_8  Guy Shani and Asela Gunawardana. 2010. Evaluating recommendation systems. In Recommender Systems Handbook 257--297 doi:10.1007\/978-0-387-85820-3_8","DOI":"10.1007\/978-0-387-85820-3_8"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/223904.223931"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/646268.758890"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/421425"},{"key":"e_1_2_1_48_1","volume-title":"Designing Interactive Systems 2002 (DIS\u201902)","author":"Swearingen Kirsten"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/IDEAS.2006.55"},{"key":"e_1_2_1_50_1","volume-title":"AAAI Workshop on Recommendation Systems. AAAI.","author":"Ungar Lyle","year":"1998"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043955"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2645710.2645744"},{"key":"e_1_2_1_53_1","volume-title":"Witten and Eibe Frank","author":"Ian","year":"2005"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1454008.1454031"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNSC.2010.5461512"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1060745.1060754"},{"key":"e_1_2_1_57_1","first-page":"23","article-title":"Making product recommendations more diverse","volume":"32","author":"Ziegler Cai-Nicolas","year":"2009","journal-title":"IEEE Data Eng. Bull."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700491","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2700491","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:13:34Z","timestamp":1750227214000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2]]},"references-count":55,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,4]]}},"alternative-id":["10.1145\/2700491"],"URL":"https:\/\/doi.org\/10.1145\/2700491","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,2]]},"assertion":[{"value":"2014-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-02-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}