{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T13:49:58Z","timestamp":1760708998468,"version":"3.41.0"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T00:00:00Z","timestamp":1454284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Brazilian National Institute of Science and Technology for Web Research","award":["MCT\/CNPq\/INCT Web grant 573871\/2008-6"],"award-info":[{"award-number":["MCT\/CNPq\/INCT Web grant 573871\/2008-6"]}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004901","name":"FAPEMIG","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004901","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002322","name":"CAPES","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,4]]},"abstract":"<jats:p>\n            The design and evaluation of tag recommendation methods has historically focused on maximizing the relevance of the suggested tags for a given object, such as a movie or a song. However, relevance by itself may not be enough to guarantee recommendation usefulness. Promoting novelty and diversity in tag recommendation not only increases the chances that the user will select \u201csome\u201d of the recommended tags but also promotes complementary information (i.e., tags), which helps to cover multiple aspects or topics related to the target object. Previous work has addressed the tag recommendation problem by exploiting at most two of the following aspects: (1) relevance, (2) explicit topic diversity, and (3) novelty. In contrast, here we tackle these three aspects conjointly, by introducing two new tag recommendation methods that cover all three aspects of the problem at different levels. Our first method, called\n            <jats:italic>Random Forest with topic-related attributes<\/jats:italic>\n            , or\n            <jats:italic>\n              RF\n              <jats:sub>t<\/jats:sub>\n            <\/jats:italic>\n            , extends a relevance-driven tag recommender based on the Random Forest (\n            <jats:italic>RF<\/jats:italic>\n            ) learning-to-rank method by including new tag attributes to capture the extent to which a candidate tag is related to the topics of the target object. This solution captures topic diversity as well as novelty at the attribute level while aiming at maximizing relevance in its objective function. Our second method, called\n            <jats:italic>Explicit Tag Recommendation Diversifier with Novelty Promotion<\/jats:italic>\n            , or\n            <jats:italic>xTReND<\/jats:italic>\n            , reranks the recommendations provided by any tag recommender to jointly promote relevance, novelty, and topic diversity. We use\n            <jats:italic>\n              RF\n              <jats:sub>t<\/jats:sub>\n            <\/jats:italic>\n            as a basic recommender applied before the reranking, thus building a solution that addresses the problem at both attribute and objective levels. Furthermore, to enable the use of our solutions on applications in which category information is unavailable, we investigate the suitability of using latent Dirichlet allocation (LDA) to automatically generate topics for objects. We evaluate all tag recommendation approaches using real data from five popular Web 2.0 applications. Our results show that\n            <jats:italic>\n              RF\n              <jats:sub>t<\/jats:sub>\n            <\/jats:italic>\n            greatly outperforms the relevance-driven\n            <jats:italic>RF<\/jats:italic>\n            baseline in diversity while producing gains in relevance as well. We also find that our new\n            <jats:italic>xTReND<\/jats:italic>\n            reranker obtains considerable gains in both novelty and relevance when compared to that same baseline while keeping the same relevance levels. Furthermore, compared to our previous reranker method,\n            <jats:italic>xTReD<\/jats:italic>\n            , which does not consider novelty,\n            <jats:italic>xTReND<\/jats:italic>\n            is also quite effective, improving the novelty of the recommended tags while keeping similar relevance and diversity levels in most datasets and scenarios. Comparing our two new proposals, we find that\n            <jats:italic>xTReND<\/jats:italic>\n            considerably outperforms\n            <jats:italic>\n              RF\n              <jats:sub>t<\/jats:sub>\n            <\/jats:italic>\n            in terms of novelty and diversity with only small losses (under 4%) in relevance. Overall, considering the trade-off among relevance, novelty, and diversity, our results demonstrate the superiority of\n            <jats:italic>xTReND<\/jats:italic>\n            over the baselines and the proposed alternative,\n            <jats:italic>\n              RF\n              <jats:sub>t<\/jats:sub>\n            <\/jats:italic>\n            . Finally, the use of automatically generated latent topics as an alternative to manually labeled categories also provides significant improvements, which greatly enhances the applicability of our solutions to applications where the latter is not available.\n          <\/jats:p>","DOI":"10.1145\/2801130","type":"journal-article","created":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T20:37:54Z","timestamp":1454359074000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Beyond Relevance"],"prefix":"10.1145","volume":"7","author":[{"given":"Fabiano M.","family":"Bel\u00e9m","sequence":"first","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carolina S.","family":"Batista","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rodrygo L. T.","family":"Santos","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jussara M.","family":"Almeida","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcos A.","family":"Gon\u00e7alves","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498766"},{"volume-title":"Proceedings of the 20th International Conference on Very Large Data Bases (VLDB\u201994)","author":"Agrawal R.","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","unstructured":"R. Baeza-Yates and B. Ribeiro-Neto. 1999. Modern Information Retrieval. Addison-Wesley.   R. Baeza-Yates and B. Ribeiro-Neto. 1999. Modern Information Retrieval. Addison-Wesley."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36973-5_32"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.03.002"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2507157.2507184"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133806.2133826"},{"key":"e_1_2_1_8_1","first-page":"453","article-title":"A comparative study of learning-to-rank techniques for tag recommendation","volume":"4","author":"Canuto S.","year":"2013","journal-title":"Journal of Information and Data Management"},{"volume-title":"Proceedings of the ECML\/PKDD Discovery Challenge Workshop. 35--48","author":"Cao H.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291025"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1454008.1454038"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-012-0200-0"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935847"},{"volume-title":"Overview of the TREC 2012 Web track. In Proceedings of the 21st Text Retrieval Conference (TREC\u201912)","author":"Clarke C.","key":"e_1_2_1_14_1"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390446"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348296"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/285055.285059"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339729"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2012.03.003"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1454008.1454020"},{"volume-title":"The Structure of Collaborative Tagging Systems. Retrieved","year":"2016","author":"Golder S.","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572034"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390425"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"D. Hochbaum (Ed.). 1997. Approximation Algorithms for NP-Hard Problems. PWS Publishing Co.   D. Hochbaum (Ed.). 1997. Approximation Algorithms for NP-Hard Problems. PWS Publishing Co.","DOI":"10.1145\/261342.571216"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944339.1944341"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/3120747.3120802"},{"volume-title":"Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases.","author":"Katakis I.","key":"e_1_2_1_27_1"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0190(99)00031-9"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639714.1639726"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488451"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835486"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367589"},{"volume-title":"Proceedings of the ECML\/PKDD Discovery Challenge Workshop.","author":"Lipczak M.","key":"e_1_2_1_33_1"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2036264.2036266"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961198"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-012-0215-6"},{"volume-title":"Proceedings of the 21st International Conference on Artificial Intelligence. 2064--2069","author":"Lu Y.","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526796"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2526188.2526189"},{"volume-title":"Proceedings of the ECML\/PKDD Discovery Challenge Workshop.","author":"Menezes G.","key":"e_1_2_1_40_1"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0262.00321"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718498"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2365952.2365962"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772780"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-011-9180-x"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000040"},{"volume-title":"Proceedings of the 1st International Workshop on Diversity in Document Retrieval. 37--41","author":"Santos R.","key":"e_1_2_1_47_1"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2507157.2507165"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367542"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1921591.1921595"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488497"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043955"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348297"},{"volume-title":"Proceedings of the ECML\/PKDD Discovery Challenge Workshop. http:\/\/sunsite.informatik.rwth-aachen.de\/Publications\/CEUR-WS\/Vol-497\/.","author":"Wang J.","key":"e_1_2_1_54_1"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526758"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433466"},{"volume-title":"Proceedings of the 25th AAAI Conference on Artificial Intelligence. 1279--1285","author":"Yin D.","key":"e_1_2_1_57_1"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556195.2556215"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860440"},{"volume-title":"Proceedings of the ECML\/PKDD Discovery Challenge Workshop.","author":"Zhang N.","key":"e_1_2_1_60_1"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124300"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2801130","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2801130","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:07:13Z","timestamp":1750223233000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2801130"}},"subtitle":["Explicitly Promoting Novelty and Diversity in Tag Recommendation"],"short-title":[],"issued":{"date-parts":[[2016,2]]},"references-count":61,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,4]]}},"alternative-id":["10.1145\/2801130"],"URL":"https:\/\/doi.org\/10.1145\/2801130","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2016,2]]},"assertion":[{"value":"2014-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-02-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}