{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T23:17:01Z","timestamp":1784675821762,"version":"3.55.0"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Trans. Soc. Comput."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>News commenting is a prevalent form of online interaction, but it is fraught with issues, such as a low quality of discussion that often takes place. While various moderation methods can be used to maintain online discussion quality, one moderation strategy that is underexplored is for professional moderators to mark high-quality posts that are further highlighted in the interface. In this work, we look at the impact of<jats:italic>New York Times<\/jats:italic>(NYT) Picks. We present an analysis of more than 13 million NYT comments, examining the quality and frequency of commenting on the site in response to NYT Picks. The findings offer evidence that NYT Picks are associated with an increase in the quality of first-time receivers\u2019 next approved comment, as well as the commenting frequency during commenters\u2019 early tenure on the site. The quality boost associated with receiving a Pick attenuates after subsequent picks and diminishes over time as the user continues commenting but is still higher than commenters who do not receive Picks. Visible comment quality has a relatively small but significant positive correlation with the quality of the next comment, and exposure to Pick badges is also positively correlated with subsequent higher-quality approved comments, albeit to a lesser extent. Our results underscore the potential for news organizations to adopt the moderation strategy of highlighting professionally selected high-quality comments to improve overall community quality. We discuss the implications of our findings and offer design opportunities for comment sections that could further enhance quality in online discourse.<\/jats:p>","DOI":"10.1145\/3484245","type":"journal-article","created":{"date-parts":[[2022,1,29]],"date-time":"2022-01-29T10:14:10Z","timestamp":1643451250000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Highlighting High-quality Content as a Moderation Strategy: The Role of<i>New York Times<\/i>Picks in Comment Quality and Engagement"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2898-9661","authenticated-orcid":false,"given":"Yixue","family":"Wang","sequence":"first","affiliation":[{"name":"School of Communication, Northwestern University, Evanston, Illinois, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Diakopoulos","sequence":"additional","affiliation":[{"name":"School of Communication, Northwestern University, Evanston, Illinois, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,1,29]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488398"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-034-R2"},{"key":"e_1_3_2_4_2","volume-title":"Social Learning Theory","author":"Bandura Albert","year":"1977","unstructured":"Albert Bandura and Richard H. Walters. 1977. Social Learning Theory. Vol. 1. Prentice Hall, Englewood Cliffs, NJ."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0003055416000058"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518847"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026018"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998213"},{"key":"e_1_3_2_11_2","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","author":"Cheng Justin","year":"2014","unstructured":"Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2014. How community feedback shapes user behavior. In Proceedings of the International AAAI Conference on Web and Social Media."},{"key":"e_1_3_2_12_2","volume-title":"Proceedings of the 9th International AAAI Conference on Web and Social Media","author":"Cheng Justin","year":"2015","unstructured":"Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. Antisocial behavior in online discussion communities. In Proceedings of the 9th International AAAI Conference on Web and Social Media."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1177\/019027250707000109"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcom.12104"},{"issue":"7","key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1080\/1461670X.2016.1175963","article-title":"Valuable journalism: Measuring news quality from a user\u2019s perspective","volume":"17","author":"Meijer Irene Costera","year":"2016","unstructured":"Irene Costera Meijer and Hildebrand P. Bijleveld. 2016. Valuable journalism: Measuring news quality from a user\u2019s perspective. Journal. Stud. 17, 7 (2016), 827\u2013839.","journal-title":"Journal. Stud."},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","author":"Davidson Thomas","year":"2017","unstructured":"Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. Automated hate speech detection and the problem of offensive language. In Proceedings of the International AAAI Conference on Web and Social Media."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958844"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675160"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2792989.2792998"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12110-002-1012-7"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1037\/10627-000"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2786451.2786459"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.95"},{"key":"e_1_3_2_24_2","volume-title":"Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media","author":"Gillespie Tarleton","year":"2018","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media. Yale University Press, New Haven, CT."},{"key":"e_1_3_2_25_2","first-page":"42","article-title":"The virtues of moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann. 2015. The virtues of moderation. Yale JL & Tech. 17 (2015), 42.","journal-title":"Yale JL & Tech."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1080\/08824096.2014.989971"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"D. Ho K. Imai G. King and E. Stuart. 2006. MatchIt: Nonparametric Preprocessing for Parametric Casual Inference . R package version 2\u20132.","DOI":"10.32614\/CRAN.package.MatchIt"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1177\/0163443712472089"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675207"},{"issue":"1","key":"e_1_3_2_31_2","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1609\/icwsm.v8i1.14550","article-title":"VADER: A parsimonious rule-based model for sentiment analysis of social media text","volume":"8","author":"Hutto C.","year":"2014","unstructured":"C. Hutto and Eric Gilbert. 2014. VADER: A parsimonious rule-based model for sentiment analysis of social media text. Proc. Int. AAAI Conf. Web Soc. Media 8, 1 (May 2014), 216\u2013225.","journal-title":"Proc. Int. AAAI Conf. Web Soc. Media"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.ap.5500115"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_3_2_34_2","volume-title":"Proceedings of the Computation+ Journalism Symposium","author":"Jiang Ling","year":"2019","unstructured":"Ling Jiang and Eui-Hong Han. 2019. ModBot: Automatic comments moderation. In Proceedings of the Computation+ Journalism Symposium."},{"key":"e_1_3_2_35_2","first-page":"61","article-title":"Lexical diversity and lexical density in speech and writing: A developmental perspective","volume":"53","author":"Johansson Victoria","year":"2009","unstructured":"Victoria Johansson. 2009. Lexical diversity and lexical density in speech and writing: A developmental perspective. Lund Work. Pap. Ling. 53 (2009), 61\u201379.","journal-title":"Lund Work. Pap. Ling."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2006.00033.x"},{"key":"e_1_3_2_37_2","first-page":"125","article-title":"Regulating behavior in online communities","author":"Kiesler Sara","year":"2012","unstructured":"Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2012. Regulating behavior in online communities. In Building Successful Online Communities: Evidence-based Social Design, 125\u2013178.","journal-title":"Building Successful Online Communities: Evidence-based Social Design"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099206"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"issue":"2","key":"e_1_3_2_41_2","article-title":"The civic labor of volunteer moderators online","volume":"5","author":"Matias J. Nathan","year":"2019","unstructured":"J. Nathan Matias. 2019. The civic labor of volunteer moderators online. Social Media+ Society 5, 2 (2019), https:\/\/doi.org\/10.1177\/2056305119836778","journal-title":"Social Media+ Society"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1813486116"},{"issue":"8","key":"e_1_3_2_43_2","first-page":"639","article-title":"SMOG grading-a new readability formula","volume":"12","author":"Laughlin G. Harry Mc","year":"1969","unstructured":"G. Harry Mc Laughlin. 1969. SMOG grading-a new readability formula. J. Read. 12, 8 (1969), 639\u2013646.","journal-title":"J. Read."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/mpn018"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1080.0208"},{"key":"e_1_3_2_46_2","volume-title":"10 Things We Learned by Analyzing 9 Million Comments from The New York Times","author":"Muddiman Ashley","year":"2016","unstructured":"Ashley Muddiman and Natalie Jomini Stroud. 2016. 10 Things We Learned by Analyzing 9 Million Comments from The New York Times. Center for Media Engagement, The University of Texas at Austin."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-016-9373-5"},{"key":"e_1_3_2_48_2","article-title":"Reuters Institute Digital News Report","author":"Newman Nic","year":"2019","unstructured":"Nic Newman, Richard Fletcher, Antonis Kalogeropoulos, and Rasmus Kleis Nielsen. 2019. Reuters Institute Digital News Report. Reuters Institute for the Study of Journalism (2019).","journal-title":"Reuters Institute for the Study of Journalism"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883062"},{"key":"e_1_3_2_50_2","first-page":"294","article-title":"Why lurkers lurk","author":"Nonnecke Blair","year":"2001","unstructured":"Blair Nonnecke and Jenny Preece. 2001. Why lurkers lurk. AMCIS 2001 Proc. (2001), 294.","journal-title":"AMCIS 2001 Proc."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444804041444"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858389"},{"key":"e_1_3_2_53_2","volume-title":"Proceedings of the 10th International AAAI Conference on Web and Social Media","author":"Sachar Simranjit Singh","year":"2016","unstructured":"Simranjit Singh Sachar and Nicholas Diakopoulos. 2016. Changing names in online news comments at the new york times. In Proceedings of the 10th International AAAI Conference on Web and Social Media."},{"issue":"1","key":"e_1_3_2_54_2","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1080\/17512786.2013.813194","article-title":"Virtuous or vitriolic: The effect of anonymity on civility in online newspaper reader comment boards","volume":"8","author":"Santana Arthur D.","year":"2014","unstructured":"Arthur D. Santana. 2014. Virtuous or vitriolic: The effect of anonymity on civility in online newspaper reader comment boards. Journal. Pract. 8, 1 (2014), 18\u201333.","journal-title":"Journal. Pract."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/1982185.1982358"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300836"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998277"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2014.997268"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12104"},{"key":"e_1_3_2_61_2","volume-title":"Journalist Involvement in Comment Sections","author":"Stroud Natalie Jomini","year":"2014","unstructured":"Natalie Jomini Stroud, Emily Van Duyn, Alexis Alizor, Alishan Alibhai, and Cameron Lang. 2014. Journalist Involvement in Comment Sections. Center for Media Engagement, The University of Texas at Austin."},{"key":"e_1_3_2_62_2","volume-title":"Comment Section Survey Across 20 News Sites","author":"Stroud Natalie Jomini","year":"2017","unstructured":"Natalie Jomini Stroud, Emily Van Duyn, Alexis Alizor, Alishan Alibhai, and Cameron Lang. 2017. Comment Section Survey Across 20 News Sites. Center for Media Engagement, The University of Texas at Austin."},{"key":"e_1_3_2_63_2","volume-title":"Survey of Commenters and Comment Readers","author":"Stroud Natalie Jomini","year":"2016","unstructured":"Natalie Jomini Stroud, Emily Van Duyn, and Cynthia Peacock. 2016. Survey of Commenters and Comment Readers. Center for Media Engagement, The University of Texas at Austin."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979450"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12275-0_19"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1002\/job.4030150109"},{"key":"e_1_3_2_67_2","volume-title":"The New York Times, with a Little Help from Automation, Is Aiming to Open up Most Articles to Comments","author":"Wang Shan","year":"2017","unstructured":"Shan Wang. 2017. The New York Times, with a Little Help from Automation, Is Aiming to Open up Most Articles to Comments. Nieman Journalism Lab."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445266"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444819828328"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444813495165"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2006.00313.x"},{"key":"e_1_3_2_72_2","article-title":"The effects of feedback and habit on content posting in an online community","author":"Wohn Donghee Yvette","year":"2015","unstructured":"Donghee Yvette Wohn. 2015. The effects of feedback and habit on content posting in an online community. In Proceedings of the iConference.","journal-title":"Proceedings of the iConference"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052591"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cct.2015.12.012"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481311"}],"container-title":["ACM Transactions on Social Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484245","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484245","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:13Z","timestamp":1750191433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484245"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":74,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3484245"],"URL":"https:\/\/doi.org\/10.1145\/3484245","relation":{},"ISSN":["2469-7818","2469-7826"],"issn-type":[{"value":"2469-7818","type":"print"},{"value":"2469-7826","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,31]]},"assertion":[{"value":"2021-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}