{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T20:03:36Z","timestamp":1776283416904,"version":"3.50.1"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>Wikidata is a collaborative knowledge graph which is central to many academic and industry IT projects. Its users are responsible for maintaining the schema that organises this knowledge into classes, properties, and attributes, which together form the Wikidata 'ontology'. In this paper, we study the relationship between different Wikidata user roles and the quality of the Wikidata ontology. To do so we first propose a framework to evaluate the ontology as it evolves. We then cluster editing activities to identify user roles in monthly time frames. Finally, we explore how each role impacts the ontology. Our analysis shows that the Wikidata ontology has uneven breadth and depth. We identified two user roles: contributors and leaders. The second category is positively associated to ontology depth, with no significant effect on other features. Further work should investigate other dimensions to define user profiles and their influence on the knowledge graph.<\/jats:p>","DOI":"10.1145\/3274410","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T21:21:27Z","timestamp":1541107287000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["Who Models the World?"],"prefix":"10.1145","volume":"2","author":[{"given":"Alessandro","family":"Piscopo","sequence":"first","affiliation":[{"name":"University of Southampton, Southampton, United Kingdom"}]},{"given":"Elena","family":"Simperl","sequence":"additional","affiliation":[{"name":"University of Southampton, Southampton, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","unstructured":"B. Thomas Adler and Luca de Alfaro. 2007. A content-driven reputation system for the Wikipedia. In WWW. ACM 261--270. 10.1145\/1242572.1242608","DOI":"10.1145\/1242572.1242608"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","unstructured":"Ofer Arazy Felipe Ortega Oded Nov M. Lisa Yeo and Adam Balila. 2015. Functional Roles and Career Paths in Wikipedia. In CSCW. ACM 1092--1105. 10.1145\/2675133.2675257","DOI":"10.1145\/2675133.2675257"},{"key":"e_1_2_1_3_1","volume-title":"et almbox","author":"Ashburner Michael","year":"2000","unstructured":"Michael Ashburner, Catherine A Ball, Judith A Blake, David Botstein, Heather Butler, J Michael Cherry, Allan P Davis, Kara Dolinski, Selina S Dwight, Janan T Eppig, et almbox. 2000. Gene Ontology: tool for the unification of biology. Nature genetics , Vol. 25, 1 (2000), 25."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883083"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrg1295"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the Conference on Data Mining and Data Warehouses (SiKDD) .","author":"Brank Janez","year":"2005","unstructured":"Janez Brank, Marko Grobelnik, and Dunja Mladeni\u0107. 2005. A survey of ontology evaluation techniques. In Proceedings of the Conference on Data Mining and Data Warehouses (SiKDD) ."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2891117"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1100.0571"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/958671.958678"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11964-9_4"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","unstructured":"Sean M. Falconer Tania Tudorache and Natalya Fridman Noy. 2011. An analysis of collaborative patterns in large-scale ontology development projects. In K-CAP. ACM 25--32. 10.1145\/1999676.1999682","DOI":"10.1145\/1999676.1999682"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-10871-6_5"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/11762256_13"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","unstructured":"Andrew Hall Sarah McRoberts Jacob Thebault-Spieker Yilun Lin Shilad Sen Brent Hecht and Loren Terveen. 2017. Freedom vs Standardization: Structured Data Generation in a Peer Production Community. In CHI. ACM 6352--6362. 10.1145\/3025453.3025940","DOI":"10.1145\/3025453.3025940"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753370"},{"key":"e_1_2_1_17_1","first-page":"1","article-title":"Approaches, methods, metrics, measures, and subjectivity in ontology evaluation: A survey","volume":"1","author":"Hlomani Hlomani","year":"2014","unstructured":"Hlomani Hlomani and Deborah Stacey. 2014. Approaches, methods, metrics, measures, and subjectivity in ontology evaluation: A survey. Semantic Web Journal , Vol. 1, 5 (2014), 1--11.","journal-title":"Semantic Web Journal"},{"key":"e_1_2_1_18_1","first-page":"19","article-title":"Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie","volume":"1","author":"Kittur Aniket","year":"2007","unstructured":"Aniket Kittur, Ed Chi, Bryan A Pendleton, Bongwon Suh, and Todd Mytkowicz. 2007. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. World Wide Web , Vol. 1, 2 (2007), 19.","journal-title":"World Wide Web"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460572"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2207798"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/223826.223828"},{"key":"e_1_2_1_22_1","volume-title":"OntoMetrics: Application of On-line Ontology Metric Calculation. In BIR Workshops (CEUR Workshop Proceedings)","volume":"1684","author":"Lantow Birger","year":"2016","unstructured":"Birger Lantow. 2016. OntoMetrics: Application of On-line Ontology Metric Calculation. In BIR Workshops (CEUR Workshop Proceedings), Vol. 1684. CEUR-WS.org."},{"key":"e_1_2_1_23_1","volume-title":"Situated learning: Legitimate peripheral participation","author":"Lave Jean","unstructured":"Jean Lave and Etienne Wenger. 1991. Situated learning: Legitimate peripheral participation .Cambridge University Press."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-140134"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985347.1985352"},{"key":"e_1_2_1_26_1","volume-title":"Suchanek","author":"Mahdisoltani Farzaneh","year":"2015","unstructured":"Farzaneh Mahdisoltani, Joanna Biega, and Fabian M. Suchanek. 2015. YAGO3: A Knowledge Base from Multilingual Wikipedias. In CIDR. www.cidrdb.org."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2788993.2789836"},{"key":"e_1_2_1_28_1","volume-title":"Francisco Jos\u00e9 Garc'i a-Pe n alvo, and Roberto Ther\u00f3 n","author":"Navarro Juan Francisco","year":"2010","unstructured":"Juan Francisco Garc'i a Navarro, Francisco Jos\u00e9 Garc'i a-Pe n alvo, and Roberto Ther\u00f3 n. 2010. A Survey on Ontology Metrics. In WSKS (1) (Communications in Computer and Information Science), Vol. 111. Springer, 22--27."},{"key":"e_1_2_1_29_1","volume-title":"et almbox","author":"Noy Natalya F","year":"2001","unstructured":"Natalya F Noy, Deborah L McGuinness, et almbox. 2001. Ontology development 101: A guide to creating your first ontology. (2001)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5465\/amj.2007.27169153"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2006.46"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-160218"},{"key":"e_1_2_1_33_1","volume-title":"SocInfo (1) (Lecture Notes in Computer Science)","author":"Piscopo Alessandro","unstructured":"Alessandro Piscopo, Christopher Phethean, and Elena Simperl. 2017a. What Makes a Good Collaborative Knowledge Graph: Group Composition and Quality in Wikidata. In SocInfo (1) (Lecture Notes in Computer Science), Vol. 10539. Springer, 305--322."},{"key":"e_1_2_1_34_1","volume-title":"Wikidatians are Born: Paths to Full Participation in a Collaborative Structured Knowledge Base","author":"Piscopo Alessandro","unstructured":"Alessandro Piscopo, Christopher Phethean, and Elena Simperl. 2017b. Wikidatians are Born: Paths to Full Participation in a Collaborative Structured Knowledge Base. In HICSS. AIS Electronic Library (AISeL)."},{"key":"e_1_2_1_35_1","volume-title":"The Reader-to-Leader framework: Motivating technology-mediated social participation. AIS transactions on human-computer interaction","author":"Preece Jennifer","year":"2009","unstructured":"Jennifer Preece and Ben Shneiderman. 2009. The Reader-to-Leader framework: Motivating technology-mediated social participation. AIS transactions on human-computer interaction , Vol. 1, 1 (2009), 5."},{"key":"e_1_2_1_36_1","volume-title":"The Evolution of Power and Standard Wikidata Editors","author":"Sarasua Cristina","year":"2018","unstructured":"Cristina Sarasua, Alessandro Checco, Gianluca Demartini, Djellel Difallah, Michael Feldman, and Lydia Pintscher. 2018. The Evolution of Power and Standard Wikidata Editors: Comparing Editing Behavior over Time to Predict Lifespan and Volume of Edits . Journal of Computer Supported Cooperative Work (2018)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2011.11.094"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641580.2641613"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2007.65"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.4018\/jdm.2004040101"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00293"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","unstructured":"Markel Vigo Caroline Jay and Robert Stevens. 2015. Constructing Conceptual Knowledge Artefacts: Activity Patterns in the Ontology Authoring Process. In CHI. ACM 3385--3394. 10.1145\/2702123.2702495","DOI":"10.1145\/2702123.2702495"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/11574620_51"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629489"},{"key":"e_1_2_1_46_1","volume-title":"OWL 2 Web Ontology Language Document Overview","author":"W3C OWL Working Group","year":"2012","unstructured":"W3C OWL Working Group. 2012. OWL 2 Web Ontology Language Document Overview (Second Edition) - W3C Recommendation 11 December 2012 . (Dec. 2012). http:\/\/www.w3.org\/TR\/owl2-overview\/"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2014.06.004"},{"key":"e_1_2_1_48_1","article-title":"Visualizing the Signatures of Social Roles in Online Discussion Groups","volume":"8","author":"Welser Howard T.","year":"2007","unstructured":"Howard T. Welser, Eric Gleave, Danyel Fisher, and Marc A. Smith. 2007. Visualizing the Signatures of Social Roles in Online Discussion Groups. Journal of Social Structure , Vol. 8 (2007).","journal-title":"Journal of Social Structure"},{"key":"e_1_2_1_49_1","volume-title":"https:\/\/www.wikidata.org\/wiki\/Wikidata:Bots . (2018). {Online","author":"Bots","year":"2018","unstructured":"Wikidata. 2018a. Wikidata:Bots . https:\/\/www.wikidata.org\/wiki\/Wikidata:Bots . (2018). {Online; accessed 08-April-2018}."},{"key":"e_1_2_1_50_1","volume-title":"https:\/\/www.wikidata.org\/wiki\/Wikidata:User_access_levels . (2018). {Online","author":"User","year":"2018","unstructured":"Wikidata. 2018b. Wikidata:User access levels . https:\/\/www.wikidata.org\/wiki\/Wikidata:User_access_levels . (2018). {Online; accessed 08-April-2018}."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.3844\/jcssp.2005.107.113"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321474"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICEBE.2006.48"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274410","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274410","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:35Z","timestamp":1750207475000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274410"}},"subtitle":["Collaborative Ontology Creation and User Roles in Wikidata"],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":52,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274410"],"URL":"https:\/\/doi.org\/10.1145\/3274410","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}