{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T22:04:44Z","timestamp":1771020284827,"version":"3.50.1"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["101021377"],"award-info":[{"award-number":["101021377"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["9550-20-1-0346"],"award-info":[{"award-number":["9550-20-1-0346"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1814955, 1845576"],"award-info":[{"award-number":["1814955, 1845576"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,11,7]]},"abstract":"<jats:p>YouTube has long been a top-choice destination for independent video content creators to share their work. A large part of YouTube's appeal is owed to its practice of sharing advertising revenue with qualifying content creators through the YouTube Partner Program (YPP). In recent years, changes to the monetization policies and the introduction of algorithmic systems for making monetization decisions have been a source of controversy and tension between content creators and the platform. There have been numerous accusations suggesting that the underlying monetization algorithms engage in preferential treatment of larger channels and effectively censor minority voices by demonetizing their content.<\/jats:p>\n          <jats:p>In this paper, we conduct a measurement of the YouTube monetization algorithms. We begin by measuring the incidence rates of different monetization decisions and the time taken to reach them. Next, we analyze the relationships between video content, channel popularity and these decisions. Finally, we explore the relationship between demonetization and a channel's view growth rate. Taken all together, our work suggests that demonetization after a video is publicly listed is not a common occurrence, the characteristics of the process are associated with channel size and (in unexplainable ways) video topic, and demonetization appears to have a harsh influence on the growth rate of smaller channels. We also highlight the challenges associated with conducting large-scale algorithm audits such as ours and make an argument for more transparency in algorithmic decision-making.<\/jats:p>","DOI":"10.1145\/3555209","type":"journal-article","created":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T22:58:54Z","timestamp":1668207534000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Paying Attention to the Algorithm Behind the Curtain: Bringing Transparency to YouTube's Demonetization Algorithms"],"prefix":"10.1145","volume":"6","author":[{"given":"Arun","family":"Dunna","sequence":"first","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}]},{"given":"Katherine A.","family":"Keith","sequence":"additional","affiliation":[{"name":"Williams College, Williamstown, MA, USA"}]},{"given":"Ethan","family":"Zuckerman","sequence":"additional","affiliation":[{"name":"University of Massachusetts at Amherst, Amherst, MA, USA"}]},{"given":"Narseo","family":"Vallina-Rodriguez","sequence":"additional","affiliation":[{"name":"IMDEA Networks Institute, Leganes, Spain"}]},{"given":"Brendan","family":"O'Connor","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}]},{"given":"Rishab","family":"Nithyanand","sequence":"additional","affiliation":[{"name":"University of Iowa, Iowa City, IA, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,11,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2018. The forever war of PewDiePie YouTube's biggest creator. https:\/\/www.washingtonpost.com\/technology\/2018\/12\/20\/forever-war-pewdiepie-youtubes-biggest-creator\/  2018. The forever war of PewDiePie YouTube's biggest creator. https:\/\/www.washingtonpost.com\/technology\/2018\/12\/20\/forever-war-pewdiepie-youtubes-biggest-creator\/"},{"key":"e_1_2_1_2_1","unstructured":"2018. Top YouTube content categories by share of uploads 2018: Statista. https:\/\/www.statista.com\/statistics\/1026914\/global-distribution-youtube-video-content-by-category\/  2018. Top YouTube content categories by share of uploads 2018: Statista. https:\/\/www.statista.com\/statistics\/1026914\/global-distribution-youtube-video-content-by-category\/"},{"key":"e_1_2_1_3_1","unstructured":"2019. Divino Group LLC v. Google LLC. https:\/\/www.classaction.org\/media\/divino-group-et-al-v-google-llc-et-al.pdf  2019. Divino Group LLC v. Google LLC. https:\/\/www.classaction.org\/media\/divino-group-et-al-v-google-llc-et-al.pdf"},{"key":"e_1_2_1_4_1","unstructured":"2020. 47 U.S. Code \u00a7230 - Protection for private blocking and screening of offensive material | U.S. Code | US Law | LII \/ Legal Information Institute. https:\/\/www.law.cornell.edu\/uscode\/text\/47\/230  2020. 47 U.S. Code \u00a7230 - Protection for private blocking and screening of offensive material | U.S. Code | US Law | LII \/ Legal Information Institute. https:\/\/www.law.cornell.edu\/uscode\/text\/47\/230"},{"key":"e_1_2_1_5_1","unstructured":"2020. The Code of conduct on countering illegal hate speech online. https:\/\/ec.europa.eu\/commission\/presscorner\/detail\/en\/qanda_20_1135  2020. The Code of conduct on countering illegal hate speech online. https:\/\/ec.europa.eu\/commission\/presscorner\/detail\/en\/qanda_20_1135"},{"key":"e_1_2_1_6_1","unstructured":"2020. Wayback Machine: Advertiser-friendly content guidelines. https:\/\/web.archive.org\/web\/20200811083202\/https:\/\/support.google.com\/youtube\/answer\/6162278?hl=en&ref_topic=9153642  2020. Wayback Machine: Advertiser-friendly content guidelines. https:\/\/web.archive.org\/web\/20200811083202\/https:\/\/support.google.com\/youtube\/answer\/6162278?hl=en&ref_topic=9153642"},{"key":"e_1_2_1_7_1","unstructured":"2020. WayBack Machine: Request human review of videos marked \"Not suitable for most advertisers\" - YouTube Help. https:\/\/web.archive.org\/web\/20201020204246\/https:\/\/support.google.com\/youtube\/answer\/7083671?hl=en&ref_topic=1115890  2020. WayBack Machine: Request human review of videos marked \"Not suitable for most advertisers\" - YouTube Help. https:\/\/web.archive.org\/web\/20201020204246\/https:\/\/support.google.com\/youtube\/answer\/7083671?hl=en&ref_topic=1115890"},{"key":"e_1_2_1_8_1","unstructured":"2020. Wayback Machine: Uploading videos to monetize with ads. https:\/\/web.archive.org\/web\/20200828082433\/https:\/\/support.google.com\/youtube\/answer\/75619389153642  2020. Wayback Machine: Uploading videos to monetize with ads. https:\/\/web.archive.org\/web\/20200828082433\/https:\/\/support.google.com\/youtube\/answer\/75619389153642"},{"key":"e_1_2_1_9_1","unstructured":"2020. Wayback Machine: YouTube channel monetization policies - YouTube Help. https:\/\/web.archive.org\/web\/20200724232124\/ https:\/\/support.google.com\/youtube\/answer\/1311392  2020. Wayback Machine: YouTube channel monetization policies - YouTube Help. https:\/\/web.archive.org\/web\/20200724232124\/ https:\/\/support.google.com\/youtube\/answer\/1311392"},{"key":"e_1_2_1_10_1","unstructured":"2020. WayBack Machine: YouTube Community Guidelines & Policies - How YouTube Works. https:\/\/web.archive.org\/web\/20200811044808\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/community-guidelines\/#enforcing-policies  2020. WayBack Machine: YouTube Community Guidelines & Policies - How YouTube Works. https:\/\/web.archive.org\/web\/20200811044808\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/community-guidelines\/#enforcing-policies"},{"key":"e_1_2_1_11_1","unstructured":"2020. Wayback Machine: YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/web.archive.org\/web\/20200725004834\/https:\/\/support.google.com\/youtube\/answer\/72851?hl=en  2020. Wayback Machine: YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/web.archive.org\/web\/20200725004834\/https:\/\/support.google.com\/youtube\/answer\/72851?hl=en"},{"key":"e_1_2_1_12_1","unstructured":"2020. Wayback Machine: YouTube Rules and Policies: Community Guidelines. https:\/\/web.archive.org\/web\/20200725011550\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/community-guidelines\/  2020. Wayback Machine: YouTube Rules and Policies: Community Guidelines. https:\/\/web.archive.org\/web\/20200725011550\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/community-guidelines\/"},{"key":"e_1_2_1_13_1","unstructured":"2020. Wayback Machine: YouTube Rules and Policies: Monetization Policies. https:\/\/web.archive.org\/web\/20200722015509\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/monetization-policies\/  2020. Wayback Machine: YouTube Rules and Policies: Monetization Policies. https:\/\/web.archive.org\/web\/20200722015509\/https:\/\/www.youtube.com\/howyoutubeworks\/policies\/monetization-policies\/"},{"key":"e_1_2_1_14_1","unstructured":"2021. BRIEF OF AMICI CURIAE KYRATSO KARAHALIOS ALAN MISLOVE CHRISTIAN W. SANDVIG CHRISTOPHER WILSON FIRST LOOK MEDIA WORKS THE AMERICAN CIVIL LIBERTIES UNION THE AMERICAN CIVIL LIBERTIES UNION OF THE DISTRICT OF COLUMBIA UPTURN AND THE KNIGHT FIRST AMENDMENT INSTITUTE IN SUPPORT OF PETITIONER. https:\/\/cbw.sh\/static\/pdf\/amicus_aclu.pdf  2021. BRIEF OF AMICI CURIAE KYRATSO KARAHALIOS ALAN MISLOVE CHRISTIAN W. SANDVIG CHRISTOPHER WILSON FIRST LOOK MEDIA WORKS THE AMERICAN CIVIL LIBERTIES UNION THE AMERICAN CIVIL LIBERTIES UNION OF THE DISTRICT OF COLUMBIA UPTURN AND THE KNIGHT FIRST AMENDMENT INSTITUTE IN SUPPORT OF PETITIONER. https:\/\/cbw.sh\/static\/pdf\/amicus_aclu.pdf"},{"key":"e_1_2_1_15_1","unstructured":"2021. Upcoming and recent ad guideline updates - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/9725604?hl=en&ref_topic=9153642  2021. Upcoming and recent ad guideline updates - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/9725604?hl=en&ref_topic=9153642"},{"key":"e_1_2_1_16_1","unstructured":"2021. Van Buren is a Victory Against Overbroad Interpretations of the CFAA and Protects Security Researchers. https:\/\/www.eff.org\/deeplinks\/2021\/06\/van-buren-victory-against-overbroad-interpretations-cfaa-protects-security  2021. Van Buren is a Victory Against Overbroad Interpretations of the CFAA and Protects Security Researchers. https:\/\/www.eff.org\/deeplinks\/2021\/06\/van-buren-victory-against-overbroad-interpretations-cfaa-protects-security"},{"key":"e_1_2_1_17_1","unstructured":"2021. Van Buren vs. United States. https:\/\/www.supremecourt.gov\/opinions\/20pdf\/19--783_k53l.pdf  2021. Van Buren vs. United States. https:\/\/www.supremecourt.gov\/opinions\/20pdf\/19--783_k53l.pdf"},{"key":"e_1_2_1_18_1","unstructured":"2021. YouTube channel monetization policies: How we enforce YouTube monetization policies - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/1311392?visit_id=637535273191990793--852634117&rd=1#zippy=%2Cfollow-the-youtube-community-guidelines%2Cturn-off-ads-from-your-content%2Csuspend-your-participation-in-the-youtube-partner-program%2Csuspend-or-even-terminate-your-youtube-channel%2Chow-well-inform-you-of-actions-that-affect-your-monetization  2021. YouTube channel monetization policies: How we enforce YouTube monetization policies - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/1311392?visit_id=637535273191990793--852634117&rd=1#zippy=%2Cfollow-the-youtube-community-guidelines%2Cturn-off-ads-from-your-content%2Csuspend-your-participation-in-the-youtube-partner-program%2Csuspend-or-even-terminate-your-youtube-channel%2Chow-well-inform-you-of-actions-that-affect-your-monetization"},{"key":"e_1_2_1_19_1","unstructured":"2021. YouTube Data API: Google Developers. https:\/\/developers.google.com\/youtube\/v3  2021. YouTube Data API: Google Developers. https:\/\/developers.google.com\/youtube\/v3"},{"key":"e_1_2_1_20_1","unstructured":"2021. YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/72851?hl=en#zippy=%2Cim-no-longer-in-ypp-or-i-was-never-in-the-program-and-im-seeing-ads-on-my-videos-am-i-earning-revenue-from-those-ads%2Cwhat-if-i-dont-meet-the-program-threshold  2021. YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/72851?hl=en#zippy=%2Cim-no-longer-in-ypp-or-i-was-never-in-the-program-and-im-seeing-ads-on-my-videos-am-i-earning-revenue-from-those-ads%2Cwhat-if-i-dont-meet-the-program-threshold"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/0034-6527.00321"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445740"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300760"},{"key":"e_1_2_1_24_1","volume-title":"Networked press freedom: Creating infrastructures for a public right to hear","author":"Ananny Mike","unstructured":"Mike Ananny . 2018. Networked press freedom: Creating infrastructures for a public right to hear . MIT Press . Mike Ananny. 2018. Networked press freedom: Creating infrastructures for a public right to hear. MIT Press."},{"key":"e_1_2_1_25_1","first-page":"36","article-title":"Exploiting YouTube: Contradictions of user-generated labor","volume":"413","author":"Andrejevic Mark","year":"2009","unstructured":"Mark Andrejevic . 2009 . Exploiting YouTube: Contradictions of user-generated labor . The YouTube Reader 413 (2009), 36 . Mark Andrejevic. 2009. Exploiting YouTube: Contradictions of user-generated labor. The YouTube Reader 413 (2009), 36.","journal-title":"The YouTube Reader"},{"key":"e_1_2_1_26_1","volume-title":"Mostly harmless econometrics: An empiricist's companion","author":"Angrist Joshua D","unstructured":"Joshua D Angrist and J\u00f6rn-Steffen Pischke . 2008. Mostly harmless econometrics: An empiricist's companion . Princeton university press . Joshua D Angrist and J\u00f6rn-Steffen Pischke. 2008. Mostly harmless econometrics: An empiricist's companion. Princeton university press."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings, Part I (Lecture Notes in Computer Science","volume":"359","author":"Ara\u00fajo Camila Souza","year":"2017","unstructured":"Camila Souza Ara\u00fajo , Gabriel Magno , Wagner Meira Jr ., Virg\u00edlio A. F. Almeida , Pedro Hartung , and Danilo Doneda . 2017 . Characterizing Videos, Audience and Advertising in Youtube Channels for Kids. In Social Informatics - 9th International Conference, SocInfo 2017, Oxford, UK, September 13--15, 2017 , Proceedings, Part I (Lecture Notes in Computer Science , Vol. 10539), Giovanni Luca Ciampaglia, Afra J. Mashhadi, and Taha Yasseri (Eds.). Springer, 341-- 359 . https:\/\/doi.org\/10.1007\/978--3--319--67217--5_21 10.1007\/978--3--319--67217--5_21 Camila Souza Ara\u00fajo, Gabriel Magno, Wagner Meira Jr., Virg\u00edlio A. F. Almeida, Pedro Hartung, and Danilo Doneda. 2017. Characterizing Videos, Audience and Advertising in Youtube Channels for Kids. In Social Informatics - 9th International Conference, SocInfo 2017, Oxford, UK, September 13--15, 2017, Proceedings, Part I (Lecture Notes in Computer Science, Vol. 10539), Giovanni Luca Ciampaglia, Afra J. Mashhadi, and Taha Yasseri (Eds.). Springer, 341--359. https:\/\/doi.org\/10.1007\/978--3--319--67217--5_21"},{"key":"e_1_2_1_28_1","volume-title":"Smith","author":"Bamman David","year":"2012","unstructured":"David Bamman , Brendan O'Connor , and Noah A . Smith . 2012 . Censorship and Deletion Practices in Chinese Social Media. First Monday 17, 3 (2012). David Bamman, Brendan O'Connor, and Noah A. Smith. 2012. Censorship and Deletion Practices in Chinese Social Media. First Monday 17, 3 (2012)."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7347"},{"key":"e_1_2_1_30_1","volume-title":"Latent dirichlet allocation. the Journal of machine Learning research 3","author":"Blei David M","year":"2003","unstructured":"David M Blei , Andrew Y Ng , and Michael I Jordan . 2003. Latent dirichlet allocation. the Journal of machine Learning research 3 ( 2003 ), 993--1022. David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. the Journal of machine Learning research 3 (2003), 993--1022."},{"key":"e_1_2_1_31_1","unstructured":"Abram Brown. 2020. What Is Section 230-And Why Does Trump Want To Change It? https:\/\/www.forbes.com\/sites\/abrambrown\/2020\/05\/28\/what-is-section-230-and-why-does-trump-want-to-change-it\/'sh=552684b2389d  Abram Brown. 2020. What Is Section 230-And Why Does Trump Want To Change It? https:\/\/www.forbes.com\/sites\/abrambrown\/2020\/05\/28\/what-is-section-230-and-why-does-trump-want-to-change-it\/'sh=552684b2389d"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305120936636"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815675.2815681"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883089"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998213"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Thomas J DiCiccio Bradley Efron etal 1996. Bootstrap confidence intervals. Statistical science 11 3 (1996) 189--228.  Thomas J DiCiccio Bradley Efron et al. 1996. Bootstrap confidence intervals. Statistical science 11 3 (1996) 189--228.","DOI":"10.1214\/ss\/1032280214"},{"key":"e_1_2_1_38_1","unstructured":"Lindsay Dodgson. 2019. YouTubers have identified a long list of words that immediately get videos demonetized and they include 'gay' and 'lesbian' but not 'straight' or 'heterosexual'. https:\/\/www.insider.com\/youtubers-identify-title-words-that-get-videos-demonetized-experiment-2019--10  Lindsay Dodgson. 2019. YouTubers have identified a long list of words that immediately get videos demonetized and they include 'gay' and 'lesbian' but not 'straight' or 'heterosexual'. https:\/\/www.insider.com\/youtubers-identify-title-words-that-get-videos-demonetized-experiment-2019--10"},{"key":"e_1_2_1_39_1","volume-title":"YouTube's arbitrary standards: Stars keep making money even after breaking the rules. The Washington Post","author":"Dwoskin Elizabeth","year":"2019","unstructured":"Elizabeth Dwoskin . 2019. YouTube's arbitrary standards: Stars keep making money even after breaking the rules. The Washington Post ( 2019 ). Elizabeth Dwoskin. 2019. YouTube's arbitrary standards: Stars keep making money even after breaking the rules. The Washington Post (2019)."},{"key":"e_1_2_1_40_1","unstructured":"Yelena Dzhanova. 2019. Forget law school these kids want to be a YouTube star. https:\/\/www.cnbc.com\/2019\/08\/02\/forget-law-school-these-kids-want-to-be-a-youtube-star.html  Yelena Dzhanova. 2019. Forget law school these kids want to be a YouTube star. https:\/\/www.cnbc.com\/2019\/08\/02\/forget-law-school-these-kids-want-to-be-a-youtube-star.html"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1987.10478410"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 2013 conference of the North American Chapter of the association for computational linguistics: Human language technologies. 359--369","author":"Eisenstein Jacob","year":"2013","unstructured":"Jacob Eisenstein . 2013 . What to do about bad language on the internet . In Proceedings of the 2013 conference of the North American Chapter of the association for computational linguistics: Human language technologies. 359--369 . Jacob Eisenstein. 2013. What to do about bad language on the internet. In Proceedings of the 2013 conference of the North American Chapter of the association for computational linguistics: Human language technologies. 359--369."},{"key":"e_1_2_1_43_1","volume-title":"Introduction to Natural Language Processing","author":"Eisenstein Jacob","unstructured":"Jacob Eisenstein . 2019. Introduction to Natural Language Processing . MIT Press . Jacob Eisenstein. 2019. Introduction to Natural Language Processing. MIT Press."},{"key":"e_1_2_1_44_1","unstructured":"Megan Graham. 2020. YouTube will put ads on non-partner videos but won't pay the creators. https:\/\/www.cnbc.com\/2020\/11\/19\/youtube-will-put-ads-on-non-partner-videos-but-wont-pay-the-creators.html  Megan Graham. 2020. YouTube will put ads on non-partner videos but won't pay the creators. https:\/\/www.cnbc.com\/2020\/11\/19\/youtube-will-put-ads-on-non-partner-videos-but-wont-pay-the-creators.html"},{"key":"e_1_2_1_45_1","volume-title":"Ghost work: How to stop Silicon Valley from building a new global underclass","author":"Gray Mary L","unstructured":"Mary L Gray and Siddharth Suri . 2019. Ghost work: How to stop Silicon Valley from building a new global underclass . Eamon Dolan Books . Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0307752101"},{"key":"e_1_2_1_47_1","volume-title":"Text as data: The promise and pitfalls of automatic content analysis methods for political texts. Political analysis 21, 3","author":"Grimmer Justin","year":"2013","unstructured":"Justin Grimmer and Brandon M Stewart . 2013. Text as data: The promise and pitfalls of automatic content analysis methods for political texts. Political analysis 21, 3 ( 2013 ), 267--297. Justin Grimmer and Brandon M Stewart. 2013. Text as data: The promise and pitfalls of automatic content analysis methods for political texts. Political analysis 21, 3 (2013), 267--297."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488435"},{"key":"e_1_2_1_49_1","volume-title":"Causal Inference: What If. Boca Raton: Chapman & Hall\/CRC.","author":"Hern\u00e1n Miguel A","year":"2020","unstructured":"Miguel A Hern\u00e1n and James M Robins . 2020 . Causal Inference: What If. Boca Raton: Chapman & Hall\/CRC. Miguel A Hern\u00e1n and James M Robins. 2020. Causal Inference: What If. Boca Raton: Chapman & Hall\/CRC."},{"key":"e_1_2_1_50_1","article-title":"How YouTube developed into a successful platform for user-generated content","volume":"7","author":"Holland Margaret","year":"2016","unstructured":"Margaret Holland . 2016 . How YouTube developed into a successful platform for user-generated content . Elon Journal of Undergraduate Research in Communications 7 , 1 (2016). Margaret Holland. 2016. How YouTube developed into a successful platform for user-generated content. Elon Journal of Undergraduate Research in Communications 7, 1 (2016).","journal-title":"Elon Journal of Undergraduate Research in Communications"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392854"},{"key":"e_1_2_1_52_1","unstructured":"Knight Institute. 2021. Researchers NYU Knight Institute Condemn Facebook's Effort to Squelch Independent Research about Misinformation. https:\/\/knightcolumbia.org\/content\/researchers-nyu-knight-institute-condemn-facebooks-effort-to-squelch-independent-research-about-misinformation  Knight Institute. 2021. Researchers NYU Knight Institute Condemn Facebook's Effort to Squelch Independent Research about Misinformation. https:\/\/knightcolumbia.org\/content\/researchers-nyu-knight-institute-condemn-facebooks-effort-to-squelch-independent-research-about-misinformation"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3229"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i09.7117"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274351"},{"key":"e_1_2_1_56_1","volume-title":"Martin","author":"Jurafsky Daniel","year":"2009","unstructured":"Daniel Jurafsky and James H . Martin . 2009 . Speech and Language Processing (2nd Edition). Prentice-Hall , Inc. Daniel Jurafsky and James H. Martin. 2009. Speech and Language Processing (2nd Edition). Prentice-Hall, Inc."},{"key":"e_1_2_1_57_1","unstructured":"Jacob Kastrenakes. 2020. YouTube will rely more on AI moderation while human reviewers can't come to the office. https:\/\/www.theverge.com\/2020\/3\/16\/21182011\/youtube-ai-moderation-coronavirus-video-removal-increase-warning  Jacob Kastrenakes. 2020. YouTube will rely more on AI moderation while human reviewers can't come to the office. https:\/\/www.theverge.com\/2020\/3\/16\/21182011\/youtube-ai-moderation-coronavirus-video-removal-increase-warning"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.474"},{"key":"e_1_2_1_59_1","volume-title":"The Rise of the Platform Economy. Issues in science and technology 32 (03","author":"Kenney Martin","year":"2016","unstructured":"Martin Kenney and John Zysman . 2016. The Rise of the Platform Economy. Issues in science and technology 32 (03 2016 ), 61--69. Martin Kenney and John Zysman. 2016. The Rise of the Platform Economy. Issues in science and technology 32 (03 2016), 61--69."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v12i1.15012"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.14763\/2019.2.1417"},{"key":"e_1_2_1_62_1","first-page":"370","article-title":"How to achieve 15 minutes (or more) of fame through youtube","volume":"7","author":"Lavaveshkul Liz","year":"2012","unstructured":"Liz Lavaveshkul . 2012 . How to achieve 15 minutes (or more) of fame through youtube . J. Int'l Com. L. & Tech. 7 (2012), 370 . Liz Lavaveshkul. 2012. How to achieve 15 minutes (or more) of fame through youtube. J. Int'l Com. L. & Tech. 7 (2012), 370.","journal-title":"J. Int'l Com. L. & Tech."},{"key":"e_1_2_1_63_1","unstructured":"Paige Leskin. 2019. American Kids Want to Be YouTube Stars: Survey. https:\/\/www.businessinsider.com\/american-kids-youtube-star-astronauts-survey-2019--7  Paige Leskin. 2019. American Kids Want to Be YouTube Stars: Survey. https:\/\/www.businessinsider.com\/american-kids-youtube-star-astronauts-survey-2019--7"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.3115\/1118108.1118117"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v14i2.2378"},{"key":"e_1_2_1_66_1","volume-title":"MALLET: A Machine Learning for Language Toolkit.","author":"McCallum Andrew Kachites","year":"2002","unstructured":"Andrew Kachites McCallum . 2002 . MALLET: A Machine Learning for Language Toolkit. (2002). http:\/\/mallet.cs.umass.edu. Andrew Kachites McCallum. 2002. MALLET: A Machine Learning for Language Toolkit. (2002). http:\/\/mallet.cs.umass.edu."},{"key":"e_1_2_1_67_1","unstructured":"McKeown. 2020. Prager University v. Google LLC: Opinion from Judge McKeown. https:\/\/cdn.ca9.uscourts.gov\/datastore\/opinions\/2020\/02\/26\/18--15712.pdf  McKeown. 2020. Prager University v. Google LLC: Opinion from Judge McKeown. https:\/\/cdn.ca9.uscourts.gov\/datastore\/opinions\/2020\/02\/26\/18--15712.pdf"},{"key":"e_1_2_1_68_1","unstructured":"Toby Miller. 2009. Cybertarians of the world unite: You have nothing to lose but your tubes! National Library of Sweden.  Toby Miller. 2009. Cybertarians of the world unite: You have nothing to lose but your tubes! National Library of Sweden."},{"key":"e_1_2_1_69_1","volume-title":"Counterfactuals and causal inference","author":"Morgan Stephen L","unstructured":"Stephen L Morgan and Christopher Winship . 2015. Counterfactuals and causal inference . Cambridge University Press . Stephen L Morgan and Christopher Winship. 2015. Counterfactuals and causal inference. Cambridge University Press."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2020.00062"},{"key":"e_1_2_1_71_1","volume-title":"The platformization of cultural production: Theorizing the contingent cultural commodity. New media & society 20, 11","author":"Nieborg David B","year":"2018","unstructured":"David B Nieborg and Thomas Poell . 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. New media & society 20, 11 ( 2018 ), 4275--4292. David B Nieborg and Thomas Poell. 2018. The platformization of cultural production: Theorizing the contingent cultural commodity. New media & society 20, 11 (2018), 4275--4292."},{"key":"e_1_2_1_72_1","volume-title":"Second workshop on comptuational social science and the wisdom of crowds (NIPS","author":"O'Connor Brendan","year":"2011","unstructured":"Brendan O'Connor , David Bamman , and Noah A Smith . 2011 . Computational text analysis for social science: Model assumptions and complexity . In Second workshop on comptuational social science and the wisdom of crowds (NIPS 2011). Citeseer. Brendan O'Connor, David Bamman, and Noah A Smith. 2011. Computational text analysis for social science: Model assumptions and complexity. In Second workshop on comptuational social science and the wisdom of crowds (NIPS 2011). Citeseer."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7320"},{"key":"e_1_2_1_74_1","volume-title":"Gianluca Stringhini, and Michael Sirivianos.","author":"Papadamou Kostantinos","year":"2021","unstructured":"Kostantinos Papadamou , Savvas Zannettou , Jeremy Blackburn , Emiliano De Cristofaro , Gianluca Stringhini, and Michael Sirivianos. 2021 . Understanding the Incel Community on YouTube . arXiv:2001.08293 [cs.CY] Kostantinos Papadamou, Savvas Zannettou, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Michael Sirivianos. 2021. Understanding the Incel Community on YouTube. arXiv:2001.08293 [cs.CY]"},{"key":"e_1_2_1_75_1","unstructured":"Judea Pearl. 2009. Causality. Cambridge university press.  Judea Pearl. 2009. Causality. Cambridge university press."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50","author":"Rehurek Radim","year":"2010","unstructured":"Radim Rehurek and Petr Sojka . 2010 . Software Framework for Topic Modelling with Large Corpora . In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50 . Radim Rehurek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372879"},{"key":"e_1_2_1_79_1","volume-title":"Ethical research standards in a world of big data. F1000Research 3","author":"Rivers Caitlin M","year":"2014","unstructured":"Caitlin M Rivers and Bryan L Lewis . 2014. Ethical research standards in a world of big data. F1000Research 3 ( 2014 ). Caitlin M Rivers and Bryan L Lewis. 2014. Ethical research standards in a world of big data. F1000Research 3 (2014)."},{"key":"e_1_2_1_80_1","volume-title":"Censored: Distraction and Diversion Inside China's Great Firewall.","author":"Roberts Margaret E","year":"2018","unstructured":"Margaret E Roberts . 2018 . Censored: Distraction and Diversion Inside China's Great Firewall. (2018). Margaret E Roberts. 2018. Censored: Distraction and Diversion Inside China's Great Firewall. (2018)."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12526"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12103"},{"key":"e_1_2_1_83_1","volume-title":"Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig , Kevin Hamilton , Karrie Karahalios , and Cedric Langbort . 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry ( 2014 ). Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry (2014)."},{"key":"e_1_2_1_84_1","unstructured":"Laura Sehl and Philippe Ross. 2020. Demonetization on YouTube and the Visibility of News Produced by Non-Mainstream News Commentators.  Laura Sehl and Philippe Ross. 2020. Demonetization on YouTube and the Visibility of News Produced by Non-Mainstream News Commentators."},{"key":"e_1_2_1_85_1","unstructured":"Erin Shaak. 2020. Racism for Profit: Black Content Creators Sue YouTube Over Discriminatory Access Restrictions. https:\/\/www.classaction.org\/blog\/racism-for-profit-black-content-creators-sue-youtube-over-discriminatory-access-restrictions  Erin Shaak. 2020. Racism for Profit: Black Content Creators Sue YouTube Over Discriminatory Access Restrictions. https:\/\/www.classaction.org\/blog\/racism-for-profit-black-content-creators-sue-youtube-over-discriminatory-access-restrictions"},{"key":"e_1_2_1_86_1","unstructured":"SocialBlade. 2021. SocialBlade: Analytics Made Easy. https:\/\/socialblade.com  SocialBlade. 2021. SocialBlade: Analytics Made Easy. https:\/\/socialblade.com"},{"key":"e_1_2_1_87_1","unstructured":"Stephen Stanford. 2018. YouTube and the Adpocalypse: How Have The New YouTube Advertising Friendly Guidelines Shaped Creator Participation and Audience Engagement?  Stephen Stanford. 2018. YouTube and the Adpocalypse: How Have The New YouTube Advertising Friendly Guidelines Shaped Creator Participation and Audience Engagement?"},{"key":"e_1_2_1_88_1","volume-title":"The spread of true and false news online. Science 359, 6380","author":"Vosoughi Soroush","year":"2018","unstructured":"Soroush Vosoughi , Deb Roy , and Sinan Aral . 2018. The spread of true and false news online. Science 359, 6380 ( 2018 ), 1146--1151. Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science 359, 6380 (2018), 1146--1151."},{"key":"e_1_2_1_89_1","unstructured":"Geoff Weiss. 2017. Creators Cry Foul After YouTube Demonetizes Casey Neistat's LoveArmyLasVegas Video - Tubefilter. https:\/\/www.tubefilter.com\/2017\/10\/06\/youtube-demonetization-casey-neistats-love-army-las-vegas\/  Geoff Weiss. 2017. Creators Cry Foul After YouTube Demonetizes Casey Neistat's LoveArmyLasVegas Video - Tubefilter. https:\/\/www.tubefilter.com\/2017\/10\/06\/youtube-demonetization-casey-neistats-love-army-las-vegas\/"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1037\/ppm0000228"},{"key":"e_1_2_1_91_1","unstructured":"Rolf Winkler Jack Nicas and Ben Fritz. 2016. PewDiePie Says WSJ Took Anti-Semitic Content Out of Context. https:\/\/www.wsj.com\/articles\/pewdiepie-says-wsj-took-anti-semitic-content-out-of-context-1487278375  Rolf Winkler Jack Nicas and Ben Fritz. 2016. PewDiePie Says WSJ Took Anti-Semitic Content Out of Context. https:\/\/www.wsj.com\/articles\/pewdiepie-says-wsj-took-anti-semitic-content-out-of-context-1487278375"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359321"},{"key":"e_1_2_1_93_1","unstructured":"Leon Yin and Aaron Sankin. 2021. Google Has a Secret Blocklist that Hides YouTube Hate Videos from Advertisers-But It's Full of Holes -- The Markup. https:\/\/themarkup.org\/google-the-giant\/2021\/04\/08\/google-youtube-hate-videos-ad-keywords-blocklist-failures  Leon Yin and Aaron Sankin. 2021. Google Has a Secret Blocklist that Hides YouTube Hate Videos from Advertisers-But It's Full of Holes -- The Markup. https:\/\/themarkup.org\/google-the-giant\/2021\/04\/08\/google-youtube-hate-videos-ad-keywords-blocklist-failures"},{"key":"e_1_2_1_94_1","unstructured":"YouTube. 2020. Protecting our extended workforce and the community. https:\/\/blog.youtube\/news-and-events\/protecting-our-extended-workforce-and\/  YouTube. 2020. Protecting our extended workforce and the community. https:\/\/blog.youtube\/news-and-events\/protecting-our-extended-workforce-and\/"},{"key":"e_1_2_1_95_1","unstructured":"YouTube. 2021. Trending on YouTube. https:\/\/support.google.com\/youtube\/answer\/7239739?hl=en  YouTube. 2021. Trending on YouTube. https:\/\/support.google.com\/youtube\/answer\/7239739?hl=en"},{"key":"e_1_2_1_96_1","unstructured":"YouTube. 2021. YouTube for Press: YouTube in numbers. https:\/\/www.youtube.com\/intl\/en-GB\/about\/press\/  YouTube. 2021. YouTube for Press: YouTube in numbers. https:\/\/www.youtube.com\/intl\/en-GB\/about\/press\/"},{"key":"e_1_2_1_97_1","unstructured":"YouTube. 2021. YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/72851?hl=en  YouTube. 2021. YouTube Partner Program overview & eligibility - YouTube Help. https:\/\/support.google.com\/youtube\/answer\/72851?hl=en"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1109\/SPW.2018.00018"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555209","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555209","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555209","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:14Z","timestamp":1750182554000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555209"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":98,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2022,11,7]]}},"alternative-id":["10.1145\/3555209"],"URL":"https:\/\/doi.org\/10.1145\/3555209","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}