{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:59:03Z","timestamp":1771700343021,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2009,9,1]],"date-time":"2009-09-01T00:00:00Z","timestamp":1251763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2009,9]]},"abstract":"<jats:p>This article uses data from the social bookmarking site del.icio.us to empirically examine the dynamics of collaborative tagging systems and to study how coherent categorization schemes emerge from unsupervised tagging by individual users.<\/jats:p>\n          <jats:p>First, we study the formation of stable distributions in tagging systems, seen as an implicit form of \u201cconsensus\u201d reached by the users of the system around the tags that best describe a resource. We show that final tag frequencies for most resources converge to power law distributions and we propose an empirical method to examine the dynamics of the convergence process, based on the Kullback-Leibler divergence measure. The convergence analysis is performed for both the most utilized tags at the top of tag distributions and the so-called long tail.<\/jats:p>\n          <jats:p>Second, we study the information structures that emerge from collaborative tagging, namely tag correlation (or folksonomy) graphs. We show how community-based network techniques can be used to extract simple tag vocabularies from the tag correlation graphs by partitioning them into subsets of related tags. Furthermore, we also show, for a specialized domain, that shared vocabularies produced by collaborative tagging are richer than the vocabularies which can be extracted from large-scale query logs provided by a major search engine.<\/jats:p>\n          <jats:p>Although the empirical analysis presented in this article is based on a set of tagging data obtained from del.icio.us, the methods developed are general, and the conclusions should be applicable across other websites that employ tagging.<\/jats:p>","DOI":"10.1145\/1594173.1594176","type":"journal-article","created":{"date-parts":[[2009,9,22]],"date-time":"2009-09-22T14:09:47Z","timestamp":1253628587000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":94,"title":["Emergence of consensus and shared vocabularies in collaborative tagging systems"],"prefix":"10.1145","volume":"3","author":[{"given":"Valentin","family":"Robu","sequence":"first","affiliation":[{"name":"University of Southampton, Southampton, UK"}]},{"given":"Harry","family":"Halpin","sequence":"additional","affiliation":[{"name":"University of Edinburgh and World Wide Web Consortium (W3C), Edinburgh, Scotland"}]},{"given":"Hana","family":"Shepherd","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, NJ"}]}],"member":"320","published-online":{"date-parts":[[2009,9,24]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The Long Tail","author":"Anderson C.","unstructured":"Anderson , C. 2006. The Long Tail . Random House Business Books . Anderson, C. 2006. The Long Tail. Random House Business Books."},{"key":"e_1_2_1_2_1","volume-title":"Dynamics of Complex Systems (Studies in Nonlinearity)","author":"Bar-Yam Y.","unstructured":"Bar-Yam , Y. 2003. Dynamics of Complex Systems (Studies in Nonlinearity) . Westview Press . Bar-Yam, Y. 2003. Dynamics of Complex Systems (Studies in Nonlinearity). Westview Press."},{"key":"e_1_2_1_3_1","first-page":"47","article-title":"Pajek\u2014A program for large network analysis","volume":"21","author":"Batagelj V.","year":"1998","unstructured":"Batagelj , V. and Mrvar , A. 1998 . Pajek\u2014A program for large network analysis . Connections 21 , 47 -- 57 . Batagelj, V. and Mrvar, A. 1998. Pajek\u2014A program for large network analysis. Connections 21, 47--57.","journal-title":"Connections"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07)","author":"Bateman S.","unstructured":"Bateman , S. , Brooks , C. , McCalla , G. , and Brusilovsky , P . 2007. Applying collaborative tagging to e-learning . In Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07) . Bateman, S., Brooks, C., McCalla, G., and Brusilovsky, P. 2007. Applying collaborative tagging to e-learning. In Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183614.1183657"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216311"},{"key":"e_1_2_1_7_1","unstructured":"Brandes U. Delling D. Gaertler M. Goerke R. Hoefer M. Nikoloski Z. and Wagner D. 2006. Maximizing modularity is hard. http:\/\/arxiv.org\/abs\/physics\/0608255.  Brandes U. Delling D. Gaertler M. Goerke R. Hoefer M. Nikoloski Z. and Wagner D. 2006. Maximizing modularity is hard. http:\/\/arxiv.org\/abs\/physics\/0608255."},{"key":"e_1_2_1_8_1","unstructured":"Butterfield S. 2004. Folksonomy. http:\/\/www.sylloge.com\/personal\/2004\/08\/folksonomy-social-classification-great.html.  Butterfield S. 2004. Folksonomy. http:\/\/www.sylloge.com\/personal\/2004\/08\/folksonomy-social-classification-great.html."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0610487104"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242686"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2007.48"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1379092.1379109"},{"key":"e_1_2_1_13_1","volume-title":"Proceeding of the 15th International World Wide Web Conference (WWW'06)","author":"Dubinko M.","unstructured":"Dubinko , M. , Kumar , R. , Magnani , J. , Novak , J. , Raghvan , P. , and Tomkins , A . 2006. P-tag: Large scale automated generation of personalised annotation tags for the Web . In Proceeding of the 15th International World Wide Web Conference (WWW'06) . ACM Press, 193--202. Dubinko, M., Kumar, R., Magnani, J., Novak, J., Raghvan, P., and Tomkins, A. 2006. P-tag: Large scale automated generation of personalised annotation tags for the Web. In Proceeding of the 15th International World Wide Web Conference (WWW'06). ACM Press, 193--202."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242676"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/0165551506062337"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242602"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242826"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 1st International Conference on Weblogs and Social Media, N. Nicolov, N. Glance, E. Adar, M. Hurst, M. Liberman, J. H. Martin, and F. Salvetti, Eds. http:\/\/www.icwsm.org.","author":"Hayes C.","unstructured":"Hayes , C. and Avesani , P . 2007. Using tags and clustering to identify topic-relevant blogs . In Proceedings of the 1st International Conference on Weblogs and Social Media, N. Nicolov, N. Glance, E. Adar, M. Hurst, M. Liberman, J. H. Martin, and F. Salvetti, Eds. http:\/\/www.icwsm.org. Hayes, C. and Avesani, P. 2007. Using tags and clustering to identify topic-relevant blogs. In Proceedings of the 1st International Conference on Weblogs and Social Media, N. Nicolov, N. Glance, E. Adar, M. Hurst, M. Liberman, J. H. Martin, and F. Salvetti, Eds. http:\/\/www.icwsm.org."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2008.422"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341558"},{"key":"e_1_2_1_21_1","volume-title":"Google sets. (Accessed","year":"2009","unstructured":"http:\/\/labs.google.com\/sets. 2008. Google sets. (Accessed September 2009 ). http:\/\/labs.google.com\/sets. 2008. Google sets. (Accessed September 2009)."},{"key":"e_1_2_1_22_1","first-page":"515","article-title":"Classification and categorization: A difference that makes a difference","volume":"52","author":"Jacob E.","year":"2004","unstructured":"Jacob , E. 2004 . Classification and categorization: A difference that makes a difference . Library Trends 52 , 3, 515 -- 540 . Jacob, E. 2004. Classification and categorization: A difference that makes a difference. Library Trends 52, 3, 515--540.","journal-title":"Library Trends"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the AAAI Workshop on Plan, Activity and Intent Recognition (PAIR).","author":"Jin R. K.-X.","unstructured":"Jin , R. K.-X. , Parkes , D. C. , and Wolfe , P. J . 2007. Analysis of bidding networks in eBay: Aggregate preference identification through community detection . In Proceedings of the AAAI Workshop on Plan, Activity and Intent Recognition (PAIR). Jin, R. K.-X., Parkes, D. C., and Wolfe, P. J. 2007. Analysis of bidding networks in eBay: Aggregate preference identification through community detection. In Proceedings of the AAAI Workshop on Plan, Activity and Intent Recognition (PAIR)."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07)","author":"Kaser O.","unstructured":"Kaser , O. and Lemire , D . 2007. Tag-cloud drawing: Algorithms for cloud visualization . In Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07) . Kaser, O. and Lemire, D. 2007. Tag-cloud drawing: Algorithms for cloud visualization. In Proceedings of the Workshop on Tagging and Metadata for Social Information Organization (WWW'07)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242766"},{"key":"e_1_2_1_26_1","unstructured":"Manning C. and Schutze H. 2002. Foundations of Statistical Natural Language Processing. MIT Press London.   Manning C. and Schutze H. 2002. Foundations of Statistical Natural Language Processing. MIT Press London."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the Collaborative Web Tagging Workshop at WWW'06","author":"Marlow C.","unstructured":"Marlow , C. , Naaman , M. , Boyd , D. , and Davis , M . 2006. Position paper, tagging, taxonomy, flickr, article, toread . In Proceedings of the Collaborative Web Tagging Workshop at WWW'06 . Marlow, C., Naaman, M., Boyd, D., and Davis, M. 2006. Position paper, tagging, taxonomy, flickr, article, toread. In Proceedings of the Collaborative Web Tagging Workshop at WWW'06."},{"key":"e_1_2_1_28_1","volume-title":"Folksonomies: Cooperative classification and communication through shared metadata","author":"Mathes A.","year":"2004","unstructured":"Mathes , A. 2004 . Folksonomies: Cooperative classification and communication through shared metadata . http:\/\/www.adammathes.com\/academic\/computer-mediated-communication\/folksonomies.html. Mathes, A. 2004. Folksonomies: Cooperative classification and communication through shared metadata. http:\/\/www.adammathes.com\/academic\/computer-mediated-communication\/folksonomies.html."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/11574620_38"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2007.405"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/00107510500052444"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.066133"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277762"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03603-3_14"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of RRS'06","author":"Robu V.","unstructured":"Robu , V. and Poutr\u00e9 , J. A. L. 2006. Retrieving utility graphs used in multi-item negotiation through collaborative filtering . In Proceedings of RRS'06 . Robu, V. and Poutr\u00e9, J. A. L. 2006. Retrieving utility graphs used in multi-item negotiation through collaborative filtering. In Proceedings of RRS'06."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180904"},{"key":"e_1_2_1_39_1","unstructured":"Shen K. and Wu L. 2005. Folksonomy as a complex network. http:\/\/arxiv.org\/abs\/cs.IR\/0509072.  Shen K. and Wu L. 2005. Folksonomy as a complex network. http:\/\/arxiv.org\/abs\/cs.IR\/0509072."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Watts D. and Strogatz S. 1998. Collective dynamics of 'small-world' networks. Nature 393 6684 440--442.  Watts D. and Strogatz S. 1998. Collective dynamics of 'small-world' networks. Nature 393 6684 440--442.","DOI":"10.1038\/30918"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1594173.1594176","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1594173.1594176","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:56:27Z","timestamp":1750254987000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1594173.1594176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,9]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2009,9]]}},"alternative-id":["10.1145\/1594173.1594176"],"URL":"https:\/\/doi.org\/10.1145\/1594173.1594176","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"value":"1559-1131","type":"print"},{"value":"1559-114X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,9]]},"assertion":[{"value":"2007-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-09-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}