{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T16:35:11Z","timestamp":1775147711428,"version":"3.50.1"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>\n            Social media personalization algorithms increasingly influence the flow of civic information through society, resulting in concerns about \"filter bubbles'', \"echo chambers'', and other ways they might exacerbate ideological segregation and fan the spread of polarizing content. To address these concerns, we designed and conducted a sociotechnical audit (STA) to investigate how Twitter\/X's timeline algorithm affects news curation while also tracking how user perceptions change in response. We deployed a custom-built system that, over the course of three weeks, passively tracked all tweets loaded in users' browsers in the first week, then in the second week enacted an intervention to users' Twitter\/X homepage to restrict their view to only the algorithmic or chronological timeline (randomized). We flipped this condition for each user in the third week. We ran our audit in late 2023, collecting user-centered metrics (self-reported survey measures) and platform-centered metrics (views, clicks, likes) for 243 users, along with over 800,000 tweets. Using the STA framework, our results are two-fold: (1) Our\n            <jats:italic toggle=\"yes\">algorithm audit<\/jats:italic>\n            finds that Twitter\/X's algorithmic timeline resulted in a lower quantity but higher quality of news --- less ideologically congruent, less extreme, and slightly more reliable --- compared to the chronological timeline. (2) Our\n            <jats:italic toggle=\"yes\">user audit<\/jats:italic>\n            suggests that although our timeline intervention had significant effects on users' behaviors, it had little impact on their overall perceptions of the platform. Our paper discusses these findings and their broader implications in the context of algorithmic news curation, user-centric audits, and avenues for independent social science research.\n          <\/jats:p>","DOI":"10.1145\/3687046","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Lower Quantity, Higher Quality: Auditing News Content and User Perceptions on Twitter\/X Algorithmic versus Chronological Timelines"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3437-2227","authenticated-orcid":false,"given":"Stephanie","family":"Wang","sequence":"first","affiliation":[{"name":"University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6581-3625","authenticated-orcid":false,"given":"Shengchun","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5410-9712","authenticated-orcid":false,"given":"Alvin","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, Minnesota, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9359-6090","authenticated-orcid":false,"given":"Dana\u00eb","family":"Metaxa","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Ad Fontes Media. 2023. Methodology. https:\/\/adfontesmedia.com\/how-ad-fontes-ranks-news-sources\/"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaa1160"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449148"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211041648"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449152"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447535"},{"key":"e_1_2_1_7_1","unstructured":"Axel Bruns. 2019. Are filter bubbles real John Wiley & Sons."},{"key":"e_1_2_1_8_1","volume-title":"Delli Carpini and Scott Keeter","author":"Michael","year":"1996","unstructured":"Michael X. Delli Carpini and Scott Keeter. 1996. What Americans Know about Politics and why it Matters. Yale University Press. Google-Books-ID: b2ZUquOLrzoC."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2023301118"},{"key":"e_1_2_1_10_1","volume-title":"Platform-controlled social media APIs threaten Open Science. Nature Human Behaviour","author":"Davidson Brittany I","year":"2023","unstructured":"Brittany I Davidson, Darja Wischerath, Daniel Racek, Douglas A Parry, Emily Godwin, Joanne Hinds, Dirk van der Linden, Jonathan F Roscoe, Laura Ayravainen, and Alicia G Cork. 2023. Platform-controlled social media APIs threaten Open Science. Nature Human Behaviour (2023), 1--4."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025659"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702556"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","unstructured":"Miriam Fern\u00e1ndez Alejandro Bellog\u00edn and Iv\u00e1n Cantador. 2021. Analysing the Effect of Recommendation Algorithms on the Amplification of Misinformation. https:\/\/doi.org\/10.48550\/arXiv.2103.14748 arXiv:2103.14748 [cs].","DOI":"10.48550\/arXiv.2103.14748"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.ps.44.020193.001103"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfw006"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2018.1477506"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjr044"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.ade7138"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/sipr.12091"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12589"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.abp9364"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555636"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392854"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2025334119"},{"key":"e_1_2_1_27_1","unstructured":"Alex Kirshner. 2023. Twitter's Was forNews. https:\/\/slate.com\/technology\/2023\/10\/elon-musk-x-twitter-news-linksheadlines-why.html"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610209"},{"key":"e_1_2_1_29_1","volume-title":"Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management science 65, 7","author":"Lambrecht Anja","year":"2019","unstructured":"Anja Lambrecht and Catherine Tucker. 2019. Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management science 65, 7 (2019), 2966--2981."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aao2998"},{"key":"e_1_2_1_31_1","volume-title":"Algorithmic extremism: Examining YouTube's rabbit hole of radicalization. arXiv preprint arXiv:1912.11211","author":"Ledwich Mark","year":"2019","unstructured":"Mark Ledwich and Anna Zaitsev. 2019. Algorithmic extremism: Examining YouTube's rabbit hole of radicalization. arXiv preprint arXiv:1912.11211 (2019)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1093\/pnasnexus\/pgad286"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","unstructured":"Leib Litman Aaron Moss Cheskie Rosenzweig and Jonathan Robinson. 2021. Reply to MTurk Prolific or panels? Choosing the right audience for online research. https:\/\/doi.org\/10.2139\/ssrn.3775075","DOI":"10.2139\/ssrn.3775075"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719976"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093650212466406"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359231"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000083"},{"key":"e_1_2_1_39_1","unstructured":"Smitha Milli Micah Carroll Sashrika Pandey Yike Wang and Anca Dragan. [n. d.]. Twitter's Algorithm: Amplifying Anger Animosity and Affective Polarization. ([n. d.])."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/1940161220964767"},{"key":"e_1_2_1_41_1","volume-title":"News Report","author":"Newman Nic","year":"2023","unstructured":"Nic Newman, Richard Fletcher, Kirsten Eddy, Craig T. Robertson, and Rasmus Kleis Nielsen. 2023. Reuters Institute Digital News Report 2023. https:\/\/reutersinstitute.politics.ox.ac.uk\/sites\/default\/files\/2023-06\/Digital_News_Report_2023.pdf"},{"key":"e_1_2_1_42_1","unstructured":"Twitter News. 2022. How many people come to Twitter for news? As it turns out a LOT. https:\/\/blog.twitter.com\/en_us\/topics\/insights\/2022\/how-many-people-come-twitter-for-news"},{"key":"e_1_2_1_43_1","volume-title":"The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think","author":"Pariser Eli","unstructured":"Eli Pariser. 2011. The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think. Penguin. Google-Books-ID: wcalrOI1YbQC."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3616088"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1017\/psrm.2019.55"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","unstructured":"Juergen Pfeffer Daniel Matter Kokil Jaidka Onur Varol Afra Mashhadi Jana Lasser Dennis Assenmacher Siqi Wu Diyi Yang Cornelia Brantner Daniel M. Romero Jahna Otterbacher Carsten Schwemmer Kenneth Joseph David Garcia and Fred Morstatter. 2023. Just Another Day on Twitter: A Complete 24 Hours of Twitter Data. https:\/\/doi.org\/10.48550\/arXiv.2301.11429 arXiv:2301.11429 [cs].","DOI":"10.48550\/arXiv.2301.11429"},{"key":"e_1_2_1_47_1","unstructured":"Rashawn Ray and Joy Anyanwu. 2022. Why is Elon Musk's Twitter takeover increasing hate speech? https:\/\/www.brookings.edu\/articles\/why-is-elon-musks-twitter-takeover-increasing-hate-speech\/"},{"key":"e_1_2_1_48_1","volume-title":"Auditing Radicalization Pathways on YouTube. arXiv:1908.08313 [cs] (Oct","author":"Ribeiro Manoel Horta","year":"2021","unstructured":"Manoel Horta Ribeiro, Raphael Ottoni, Robert West, Virg\u00edlio A. F. Almeida, and Wagner Meira. 2021. Auditing Radicalization Pathways on YouTube. arXiv:1908.08313 [cs] (Oct. 2021). http:\/\/arxiv.org\/abs\/1908.08313 arXiv: 1908.08313."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/1354856517736982"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-023-06078--5"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274417"},{"key":"e_1_2_1_52_1","unstructured":"Kevin Roose. [n. d.]. The Making of A YouTube Radical. https:\/\/www.nytimes.com\/interactive\/2019\/06\/08\/technology\/youtube-radical.html"},{"key":"e_1_2_1_53_1","volume-title":"Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22, 2014 (2014), 4349--4357."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568392"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1111\/comt.12087"},{"key":"e_1_2_1_56_1","unstructured":"Twitter. 2023. Twitter's Recommendation Algorithm. https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/open-source\/2023\/twitter-recommendation-algorithm"},{"key":"e_1_2_1_57_1","unstructured":"Twitter. 2023. Twitter's Recommendation Algorithm: OutOfNetworkCompetitorURLFilter. https:\/\/github.com\/twitter\/thealgorithm\/ blob\/72eda9a24f815f6d566818cbf8518138e29d83e9\/home-mixer\/server\/src\/main\/scala\/com\/twitter\/home_mixer\/product\/scored_tweets\/filter\/OutOfNetworkCompetitorURLFilter.scala#L15"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1080\/14616696.2016.1268705"},{"key":"e_1_2_1_59_1","volume-title":"Independence by permission. Science 381, 6656","author":"Wagner Michael W.","year":"2023","unstructured":"Michael W. Wagner. 2023. Independence by permission. Science 381, 6656 (2023), 388--391. https:\/\/doi.org\/10.1126\/ science.adi2430 arXiv:https:\/\/www.science.org\/doi\/pdf\/10.1126\/science.adi2430"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2006089117"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2021.101607"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448231196863"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687046","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687046","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T00:54:30Z","timestamp":1755737670000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687046"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":62,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3687046"],"URL":"https:\/\/doi.org\/10.1145\/3687046","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}