{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T00:39:23Z","timestamp":1784594363481,"version":"3.55.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1442840"],"award-info":[{"award-number":["1442840"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1717473"],"award-info":[{"award-number":["1717473"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1909803"],"award-info":[{"award-number":["1909803"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1422066"],"award-info":[{"award-number":["1422066"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>Bots are playing an increasingly important role in the creation of knowledge in Wikipedia. In many cases, editors and bots form tightly knit teams. Humans develop bots, argue for their approval, and maintain them, performing tasks such as monitoring activity, merging similar bots, splitting complex bots, and turning off malfunctioning bots. Yet this is not the entire picture. Bots are designed to perform certain functions and can acquire new functionality over time. They play particular roles in the editing process. Understanding these roles is an important step towards understanding the ecosystem, and designing better bots and interfaces between bots and humans. This is important for understanding Wikipedia along with other kinds of work in which autonomous machines affect tasks performed by humans. In this study, we use unsupervised learning to build a nine category taxonomy of bots based on their functions in English Wikipedia. We then build a multi-class classifier to classify 1,601 bots based on labeled data. We discuss different bot activities, including their edit frequency, their working spaces, and their software evolution. We use a model to investigate how bots playing certain roles will have differential effects on human editors. In particular, we build on previous research on newcomers by studying the relationship between the roles bots play, the interactions they have with newcomers, and the ensuing survival rate of the newcomers.<\/jats:p>","DOI":"10.1145\/3359317","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["The Roles Bots Play in Wikipedia"],"prefix":"10.1145","volume":"3","author":[{"given":"Lei (Nico)","family":"Zheng","sequence":"first","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher M.","family":"Albano","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neev M.","family":"Vora","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feng","family":"Mai","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey V.","family":"Nickerson","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348413"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675257"},{"key":"e_1_2_1_3_1","volume-title":"Case Method: function and process modelling","author":"Barker Richard","unstructured":"Richard Barker and Cliff Longman . 1990. Case Method: function and process modelling . Addison-Wesley . Richard Barker and Cliff Longman. 1990. Case Method: function and process modelling. Addison-Wesley."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1050.0149"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2015.14"},{"key":"e_1_2_1_6_1","volume-title":"McDonald","author":"Beschastnikh Ivan","year":"2008","unstructured":"Ivan Beschastnikh , Travis Kriplean , and David W . McDonald . 2008 . Wikipedian Self-Governance in Action : Motivating the Policy Lens. ICWSM ( 2008). Ivan Beschastnikh, Travis Kriplean, and David W. McDonald. 2008. Wikipedian Self-Governance in Action: Motivating the Policy Lens. ICWSM (2008)."},{"key":"e_1_2_1_7_1","volume-title":"Recent Developments in Role Theory. Annual review of sociology 12, 1 (Aug","author":"Biddle Bruce J.","year":"1986","unstructured":"Bruce J. Biddle . 1986. Recent Developments in Role Theory. Annual review of sociology 12, 1 (Aug . 1986 ), 67--92. Bruce J. Biddle. 1986. Recent Developments in Role Theory. Annual review of sociology 12, 1 (Aug. 1986), 67--92."},{"key":"e_1_2_1_8_1","volume-title":"Role Theory: Expectations, Identities, and Behaviors","author":"Biddle Bruce J","year":"2013","unstructured":"Bruce J Biddle . 2013 . Role Theory: Expectations, Identities, and Behaviors . Academic Press . Bruce J Biddle. 2013. Role Theory: Expectations, Identities, and Behaviors. Academic Press."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518847"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216309"},{"key":"e_1_2_1_12_1","volume-title":"Proc. 5th Hellenic Conference on Artificial Intelligence (SETN","author":"Eleftherios Spyromitros Ioannis Vlahavas","year":"2008","unstructured":"Ioannis Vlahavas Eleftherios Spyromitros , Grigorios Tsoumakas . 2008 . An Empirical Study of Lazy Multilabel Classification Algorithms . In Proc. 5th Hellenic Conference on Artificial Intelligence (SETN 2008). Syros, Greece. Ioannis Vlahavas Eleftherios Spyromitros, Grigorios Tsoumakas. 2008. An Empirical Study of Lazy Multilabel Classification Algorithms. In Proc. 5th Hellenic Conference on Artificial Intelligence (SETN 2008). Syros, Greece."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641351"},{"key":"e_1_2_1_14_1","volume-title":"The Lives of Bots. (Oct","author":"Geiger R Stuart","year":"2018","unstructured":"R Stuart Geiger . 2018. The Lives of Bots. (Oct . 2018 ). arXiv:cs.CY\/1810.09590 R Stuart Geiger. 2018. The Lives of Bots. (Oct. 2018). arXiv:cs.CY\/1810.09590"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491055.2491061"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the ACM on HumanComputer 1, CSCW","author":"Stuart Geiger R","year":"2017","unstructured":"R Stuart Geiger and Aaron Halfaker . 2017 . Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of'Even Good Bots Fight '. Proceedings of the ACM on HumanComputer 1, CSCW (2017), 49. R Stuart Geiger and Aaron Halfaker. 2017. Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of'Even Good Bots Fight'. Proceedings of the ACM on HumanComputer 1, CSCW (2017), 49."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718941"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764212469365"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557313"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038585"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2012.82"},{"key":"e_1_2_1_22_1","volume-title":"Community detection in large-scale networks: a survey and empirical evaluation","author":"Harenberg Steve","year":"2014","unstructured":"Steve Harenberg , Gonzalo Bello , L Gjeltema , Stephen Ranshous , Jitendra Harlalka , Ramona Seay , Kanchana Padmanabhan , and Nagiza Samatova . 2014. Community detection in large-scale networks: a survey and empirical evaluation . Wiley interdisciplinary reviews. Computational statistics 6, 6 ( 2014 ), 426--439. Steve Harenberg, Gonzalo Bello, L Gjeltema, Stephen Ranshous, Jitendra Harlalka, Ramona Seay, Kanchana Padmanabhan, and Nagiza Samatova. 2014. Community detection in large-scale networks: a survey and empirical evaluation. Wiley interdisciplinary reviews. Computational statistics 6, 6 (2014), 426--439."},{"key":"e_1_2_1_23_1","volume-title":"Real conversations with artificial intelligence: A comparison between human--human online conversations and human--chatbot conversations. Computers in human behavior 49","author":"Hill Jennifer","year":"2015","unstructured":"Jennifer Hill , W Randolph Ford , and Ingrid G Farreras . 2015. Real conversations with artificial intelligence: A comparison between human--human online conversations and human--chatbot conversations. Computers in human behavior 49 ( 2015 ), 245--250. Jennifer Hill, W Randolph Ford, and Ingrid G Farreras. 2015. Real conversations with artificial intelligence: A comparison between human--human online conversations and human--chatbot conversations. Computers in human behavior 49 (2015), 245--250."},{"key":"e_1_2_1_24_1","volume-title":"spaCy 2: Natural Language Understanding with Bloom Embeddings. Convolutional Neural Networks and Incremental Parsing","author":"Honnibal Matthew","year":"2017","unstructured":"Matthew Honnibal and Ines Montani . 2017. spaCy 2: Natural Language Understanding with Bloom Embeddings. Convolutional Neural Networks and Incremental Parsing ( 2017 ). Matthew Honnibal and Ines Montani. 2017. spaCy 2: Natural Language Understanding with Bloom Embeddings. Convolutional Neural Networks and Incremental Parsing (2017)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025830"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718959"},{"key":"e_1_2_1_27_1","volume-title":"Matthew Wiener, and Others","author":"Liaw Andy","year":"2002","unstructured":"Andy Liaw , Matthew Wiener, and Others . 2002 . Classification and regression by randomForest. R news 2, 3 (2002), 18--22. Andy Liaw, Matthew Wiener, and Others. 2002. Classification and regression by randomForest. R news 2, 3 (2002), 18--22."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v21i1.6027"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2015.1081822"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.5.1.86"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441871"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3233391.3233544"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1880071.1880098"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2482991.2482999"},{"key":"e_1_2_1_35_1","volume-title":"modules and large-scale structure in networks. Nature physics 8 (Dec","author":"Newman Mark EJ","year":"2011","unstructured":"Mark EJ Newman . 2011. Communities , modules and large-scale structure in networks. Nature physics 8 (Dec . 2011 ), 25. Mark EJ Newman. 2011. Communities, modules and large-scale structure in networks. Nature physics 8 (Dec. 2011), 25."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444810365297"},{"key":"e_1_2_1_37_1","volume-title":"Regulation of harvester ant foraging as a closed-loop excitable system. PLoS computational biology 14, 12 (Dec","author":"Pagliara Renato","year":"2018","unstructured":"Renato Pagliara , Deborah M Gordon , and Naomi Ehrich Leonard . 2018. Regulation of harvester ant foraging as a closed-loop excitable system. PLoS computational biology 14, 12 (Dec . 2018 ), e1006200. Renato Pagliara, Deborah M Gordon, and Naomi Ehrich Leonard. 2018. Regulation of harvester ant foraging as a closed-loop excitable system. PLoS computational biology 14, 12 (Dec. 2018), e1006200."},{"key":"e_1_2_1_38_1","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Ga\u00ebl Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , Ron Weiss , Vincent Dubourg , Jake Vanderplas , Alexandre Passos , David Cournapeau , Matthieu Brucher , Matthieu Perrot , and \u00c9douard Duchesnay . 2011 . Scikit-learn: Machine Learning in Python . Journal of machine learning research: JMLR 12 , Oct (2011), 2825 -- 2830 . Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and \u00c9douard Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of machine learning research: JMLR 12, Oct (2011), 2825--2830.","journal-title":"Journal of machine learning research: JMLR 12"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1348\/014466601164704"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274410"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274426"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210753"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641580.2641613"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2983989"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641322"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998345"},{"key":"e_1_2_1_47_1","volume-title":"A scikit-based Python environment for performing multi-label classification. arXiv preprint arXiv:1702. 01460","author":"Szyma'ski Piotr","year":"2017","unstructured":"Piotr Szyma'ski and Tomasz Kajdanowicz . 2017. A scikit-based Python environment for performing multi-label classification. arXiv preprint arXiv:1702. 01460 ( 2017 ). Piotr Szyma'ski and Tomasz Kajdanowicz. 2017. A scikit-based Python environment for performing multi-label classification. arXiv preprint arXiv:1702. 01460 (2017)."},{"key":"e_1_2_1_48_1","volume-title":"Making sense of Cronbach's alpha. The journal of the International Association of Medical Science Educators: JIAMSE 2 (June","author":"Tavakol Mohsen","year":"2011","unstructured":"Mohsen Tavakol and Reg Dennick . 2011. Making sense of Cronbach's alpha. The journal of the International Association of Medical Science Educators: JIAMSE 2 (June 2011 ), 53--55. Mohsen Tavakol and Reg Dennick. 2011. Making sense of Cronbach's alpha. The journal of the International Association of Medical Science Educators: JIAMSE 2 (June 2011), 53--55."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0171774"},{"key":"e_1_2_1_50_1","first-page":"1","article-title":"The Role of Intentions in Work Motivation: Implications for Goal-setting Theory And Research","volume":"16","author":"Tubbs Mark E","year":"1991","unstructured":"Mark E Tubbs and Steven E Ekeberg . 1991 . The Role of Intentions in Work Motivation: Implications for Goal-setting Theory And Research . AMRO 16 , 1 (Jan. 1991), 180--199. Mark E Tubbs and Steven E Ekeberg. 1991. The Role of Intentions in Work Motivation: Implications for Goal-setting Theory And Research. AMRO 16, 1 (Jan. 1991), 180--199.","journal-title":"AMRO"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188242"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1940761.1940778"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274451"},{"key":"e_1_2_1_54_1","volume-title":"Tenth International AAAI Conference on Web and Social Media.","author":"Yang Diyi","year":"2016","unstructured":"Diyi Yang , Aaron Halfaker , Robert Kraut , and Eduard Hovy . 2016 . Who did what: Editor role identification in Wikipedia . In Tenth International AAAI Conference on Web and Social Media. Diyi Yang, Aaron Halfaker, Robert Kraut, and Eduard Hovy. 2016. Who did what: Editor role identification in Wikipedia. In Tenth International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1213"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Diyi Yang Robert Kraut Tenbroeck Smith Elijah Mayfield and Dan Jurafsky. 2019. Seekers Providers Welcomers and Storytellers: Modeling Social Roles in Online Health Communities. (2019).  Diyi Yang Robert Kraut Tenbroeck Smith Elijah Mayfield and Dan Jurafsky. 2019. Seekers Providers Welcomers and Storytellers: Modeling Social Roles in Online Health Communities. (2019).","DOI":"10.1145\/3290605.3300574"},{"key":"e_1_2_1_57_1","volume-title":"ML-KNN: A lazy learning approach to multi-label learning. Pattern recognition 40, 7","author":"Zhang Min-Ling","year":"2007","unstructured":"Min-Ling Zhang and Zhi-Hua Zhou . 2007. ML-KNN: A lazy learning approach to multi-label learning. Pattern recognition 40, 7 ( 2007 ), 2038--2048. Min-Ling Zhang and Zhi-Hua Zhou. 2007. ML-KNN: A lazy learning approach to multi-label learning. Pattern recognition 40, 7 (2007), 2038--2048."},{"key":"e_1_2_1_58_1","unstructured":"Xiang Zhang Junbo Zhao and Yann LeCun. 2015. Character-level convolutional networks for text classification. In Advances in neural information processing systems. 649--657.  Xiang Zhang Junbo Zhao and Yann LeCun. 2015. Character-level convolutional networks for text classification. In Advances in neural information processing systems. 649--657."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481311"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359317","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359317","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359317","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:54Z","timestamp":1750202634000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359317"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":59,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359317"],"URL":"https:\/\/doi.org\/10.1145\/3359317","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}