{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T10:29:01Z","timestamp":1790245741367,"version":"4.1.0"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>Online sources such as social media have become increasingly important for the proliferation of science news, and past research has shown that reading user-generated comments after an article (i.e. in typical online news and blog formats) can impact the way people perceive the article. However, recent studies have shown that people are likely to read the comments before the article itself, due to the affordances of platforms like Reddit which display them up-front. This leads to questions about how comments can affect people's expectations about an article, and how those expectations impact their interest in reading it at all. This paper presents two experimental studies to better understand how the presentation of comments on Reddit affects people's engagement with science news, testing potential mediators such as the expected difficulty and quality of the article. Study 1 provides experimental evidence that difficult comments can reduce people's interest in reading an associated article. Study 2 is a pre-registered follow-up that uncovers a similarity heuristic; the various qualities of a comment (difficulty, information quality, entertainment value) signal that the article will be of similar quality, ultimately affecting participants' interest in reading it. We conclude by discussing design implications for online science news communities.<\/jats:p>","DOI":"10.1145\/3449106","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:49:24Z","timestamp":1619113764000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["The Effects of User Comments on Science News Engagement"],"prefix":"10.1145","volume":"5","author":[{"given":"Spencer","family":"Williams","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gary","family":"Hsieh","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12009"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/17524032.2018.1527378"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/1077699015573194"},{"key":"e_1_2_2_4_1","volume-title":"Multiple comparisons using R","author":"Bretz Frank","year":"2001","unstructured":"Frank Bretz, Torsten Hothorn, and Peter Westfall. 2016. Multiple comparisons using R. CRC Press. https:\/\/doi.org\/10. 1201\/9781420010909"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1212744110"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.06.022"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173715"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/c2013-0-10517-x"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159661"},{"key":"e_1_2_2_10_1","volume-title":"Competing Frames in a Political Campaign. Winning with words: The origins and impact of political framing","author":"Druckman James N","year":"2010","unstructured":"James N Druckman. 2010. Competing Frames in a Political Campaign. Winning with words: The origins and impact of political framing (2010), 101--120."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203483794"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0036240"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/19345747"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v22i10.8065"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818784472"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326985ep4102_4"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/08900523.2011.525190"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/1468--5973.12215"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/1931243111407618"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.24839\/2164--8204.jn21.3.138"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/1077699016685558"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300383"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274353"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858465"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2010.01108.x"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/15213269.2015.1090907"},{"key":"e_1_2_2_27_1","volume-title":"JAGS, and Stan","author":"Kruschke John","unstructured":"John Kruschke. 2014. Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan. Academic Press."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093650210376189"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/03637751.2016.1231334"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/hcre.12123"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.2007.00099.x"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/1464884916663597"},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Martin Modr\u00e0k. 2018. Taming Divergences in Stan Models. https:\/\/www.martinmodrak.cz\/2018\/02\/19\/tamingdivergences-in-stan-models\/","DOI":"10.59350\/zfhr1-0sr89"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-2466.1974.tb00367.x"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.31219\/osf.io"},{"key":"e_1_2_2_37_1","volume-title":"What Motivates the Online News Browser? News Item Selection in a Social Information Seeking Scenario. Information Research 19","author":"O'Brien Heather","year":"2013","unstructured":"Heather O'Brien, Luanne Freund, and Stina Westman. 2013. What Motivates the Online News Browser? News Item Selection in a Social Information Seeking Scenario. Information Research 19 (2013)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468--2958.2009"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/01639269.2015.996491"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721414531598"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1089\/cpb.2009.0003"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.106.4.643"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/1075547006293918"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1080\/1461670x.2016.1161497"},{"key":"e_1_2_2_45_1","unstructured":"Reddit. 2019. r\/science. https:\/\/www.reddit.com\/r\/science\/"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0069861"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i02"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordhb"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2011.11.004"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963662516680311"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963662512469916"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927x20902177"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1075\/itl.165.2.06sid"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1037\/e519702015-014"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/10862960009548063"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/1041794x.2016.1265578"},{"key":"e_1_2_2_57_1","volume-title":"Emily Van Duyn, and Cynthia Peacock","author":"Stroud Natalie Jomini","year":"2016","unstructured":"Natalie Jomini Stroud, Emily Van Duyn, and Cynthia Peacock. 2016. Survey of Commenters and Comment Readers. Report, The University of Texas at Austin, US 14 (2016)."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/1077699015586415"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314183.3323456"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1162\/dmal.9780262562324.073"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0036659"},{"key":"e_1_2_2_62_1","unstructured":"Stan Development Team. 2019. Stan User's Guide. https:\/\/mc-stan.org\/docs\/2_18\/stan-users-guide\/"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1615\/jwomenminorscieneng.v11.i1.10"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v059.i05"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963662515613702"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2018.1490656"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2958.2010.01384.x"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/hicss.2011.207"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1089\/cyber.2015.0005"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","unstructured":"Stephan Winter and Nicole C Kr\u00e4mer. 2016. Who's Right: The Author or the Audience? Effects of User Comments and Ratings on the Perception of Online Science Articles. https:\/\/doi.org\/10.1515\/commun-2016-0008","DOI":"10.1515\/commun-2016-0008"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.5771\/2192-4007-2017-3-240"},{"key":"e_1_2_2_72_1","volume-title":"Retrieved","author":"Woolf Max","year":"2014","unstructured":"Max Woolf. 2014. A Statistical Analysis of 142 Million Reddit Submissions. Retrieved May 21, 2020 from https:\/\/minimaxir.com\/2014\/12\/reddit-statistics\/"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","unstructured":"Yimei Zhu and Kingsley Purdam. 2017. Social Media Science Communication and the Academic Super User in the United Kingdom. (2017). https:\/\/doi.org\/10.5210\/fm.v22i11.7866","DOI":"10.5210\/fm.v22i11.7866"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1080\/08838151.2018.1532430"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449106","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449106","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:46Z","timestamp":1750191466000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":74,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449106"],"URL":"https:\/\/doi.org\/10.1145\/3449106","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}