{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T16:15:01Z","timestamp":1770221701505,"version":"3.49.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T00:00:00Z","timestamp":1530057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"crossref","award":["N00014-16-1-2257"],"award-info":[{"award-number":["N00014-16-1-2257"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Trans. Soc. Comput."],"published-print":{"date-parts":[[2018,6,30]]},"abstract":"<jats:p>It has been observed that different media outlets exert bias in the way they report the news, which seamlessly influences the way that readers\u2019 knowledge is built through filtering what we read. Therefore, understanding bias in news media is fundamental for obtaining a holistic view of a news story. Traditional work has focused on biases in terms of \u201cagenda setting,\u201d where more attention is allocated to stories that fit their biased narrative. The corresponding method is straightforward, since the bias can be detected through counting the occurrences of different stories\/themes within the documents. However, these methods are not applicable to biases which are implicit in wording, namely, \u201cframing\u201d bias. According to framing theory, biased communicators will select and emphasize certain facts and interpretations over others when telling their story. By focusing on facts and interpretations that conform to their bias, they can tell the story in a way that suits their narrative. Automatic detection of framing bias is challenging since nuances in the wording can change the interpretation of the story. In this work, we aim to investigate how the subtle pattern hidden in language use of a news agency can be discovered and further leveraged to detect frames. In particular, we aim to identify the type and polarity of frame in a sentence. Extensive experiments are conducted on real-world data from different countries. A case study is further provided to reveal possible applications of the proposed method.<\/jats:p>","DOI":"10.1145\/3204948","type":"journal-article","created":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T12:14:36Z","timestamp":1530101676000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Identifying Framing Bias in Online News"],"prefix":"10.1145","volume":"1","author":[{"given":"Fred","family":"Morstatter","sequence":"first","affiliation":[{"name":"USC Information Sciences Institute, CA, USA"}]},{"given":"Liang","family":"Wu","sequence":"additional","affiliation":[{"name":"Arizona State University, AZ, USA"}]},{"given":"Uraz","family":"Yavanoglu","sequence":"additional","affiliation":[{"name":"Gazi University, Turkey"}]},{"given":"Stephen R.","family":"Corman","sequence":"additional","affiliation":[{"name":"Arizona State University, AZ, USA"}]},{"given":"Huan","family":"Liu","sequence":"additional","affiliation":[{"name":"Arizona State University, AZ, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of SocialCom.","author":"Alashri Saud","year":"2015","unstructured":"Saud Alashri , Sultan Alzahrani , Lenka Bustikova , David Siroky , and Hasan Davulcu . 2015 . What animates political debates? Analyzing ideological perspectives in online debates between opposing parties . In Proceedings of SocialCom. Saud Alashri, Sultan Alzahrani, Lenka Bustikova, David Siroky, and Hasan Davulcu. 2015. What animates political debates? Analyzing ideological perspectives in online debates between opposing parties. In Proceedings of SocialCom."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 5th International AAAI Conference on Weblogs and Social Media.","author":"An Jisun","year":"2011","unstructured":"Jisun An , Meeyoung Cha , Krishna Gummadi , and Jon Crowcroft . 2011 . Media landscape in Twitter: A world of new conventions and political diversity . In Proceedings of the 5th International AAAI Conference on Weblogs and Social Media. Jisun An, Meeyoung Cha, Krishna Gummadi, and Jon Crowcroft. 2011. Media landscape in Twitter: A world of new conventions and political diversity. In Proceedings of the 5th International AAAI Conference on Weblogs and Social Media."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 6th International AAAI Conference on Weblogs and Social Media.","author":"An Jisun","year":"2012","unstructured":"Jisun An , Meeyoung Cha , Krishna P. Gummadi , Jon Crowcroft , and Daniele Quercia . 2012 . Visualizing media bias through twitter . In Proceedings of the 6th International AAAI Conference on Weblogs and Social Media. Jisun An, Meeyoung Cha, Krishna P. Gummadi, Jon Crowcroft, and Daniele Quercia. 2012. Visualizing media bias through twitter. In Proceedings of the 6th International AAAI Conference on Weblogs and Social Media."},{"key":"e_1_2_1_4_1","volume-title":"Adamic","author":"Bakshy Eytan","year":"2015","unstructured":"Eytan Bakshy , Solomon Messing , and Lada A . Adamic . 2015 . Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132. Eytan Bakshy, Solomon Messing, and Lada A. Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132."},{"key":"e_1_2_1_5_1","unstructured":"Ethan M. Balk Mei Chung Nira Hadar Kamal Patel W. Yu Winifred Thomas A. Trikalinos and Lina Kong Win Chang. 2012. Accuracy of data extraction of non-English language trials with Google Translate.  Ethan M. Balk Mei Chung Nira Hadar Kamal Patel W. Yu Winifred Thomas A. Trikalinos and Lina Kong Win Chang. 2012. Accuracy of data extraction of non-English language trials with Google Translate."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpubeco.2004.10.006"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1171"},{"key":"e_1_2_1_8_1","volume-title":"Natural Language Processing with Python. O\u2019Reilly Media","author":"Bird Steven","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural Language Processing with Python. O\u2019Reilly Media , Inc . Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python. O\u2019Reilly Media, Inc."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_2_1_10_1","volume-title":"Smith","author":"Boydstun Amber E.","year":"2014","unstructured":"Amber E. Boydstun , Dallas Card , Justin Gross , Paul Resnick , and Noah A . Smith . 2014 . Tracking the development of media frames within and across policy issues. Amber E. Boydstun, Dallas Card, Justin Gross, Paul Resnick, and Noah A. Smith. 2014. Tracking the development of media frames within and across policy issues."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of New Directions in Analyzing Text as Data Workshop.","author":"Boydstun Amber E.","unstructured":"Amber E. Boydstun , Justin H. Gross , Philip Resnik , and Noah A. Smith . 2013. Identifying media frames and frame dynamics within and across policy issues . In Proceedings of New Directions in Analyzing Text as Data Workshop. Amber E. Boydstun, Justin H. Gross, Philip Resnik, and Noah A. Smith. 2013. Identifying media frames and frame dynamics within and across policy issues. In Proceedings of New Directions in Analyzing Text as Data Workshop."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020438"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.30"},{"key":"e_1_2_1_15_1","volume-title":"Smith","author":"Card Dallas","year":"2015","unstructured":"Dallas Card , Amber E. Boydstun , Justin H. Gross , Philip Resnik , and Noah A . Smith . 2015 . The media frames corpus: Annotations of frames across issues. In Proceedings of ACL ( 2). 438--444. Dallas Card, Amber E. Boydstun, Justin H. Gross, Philip Resnik, and Noah A. Smith. 2015. The media frames corpus: Annotations of frames across issues. In Proceedings of ACL (2). 438--444."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242610"},{"key":"e_1_2_1_17_1","volume-title":"Dearing and Everett Rogers","author":"James","year":"1996","unstructured":"James W. Dearing and Everett Rogers . 1996 . Agenda-Setting. Vol. 6 . Sage Publications . James W. Dearing and Everett Rogers. 1996. Agenda-Setting. Vol. 6. Sage Publications."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of ICWSM.","author":"Diakopoulos Nicholas","year":"2014","unstructured":"Nicholas Diakopoulos , Amy X. Zhang , Dag Elgesem , and Andrew Salway . 2014 . Identifying and analyzing moral evaluation frames in climate change blog discourse . In Proceedings of ICWSM. Nicholas Diakopoulos, Amy X. Zhang, Dag Elgesem, and Andrew Salway. 2014. Identifying and analyzing moral evaluation frames in climate change blog discourse. In Proceedings of ICWSM."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2508.2005.00349.x"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1111\/j.1460-2466.2006.00332.x","article-title":"Wanted, dead or alive: Media frames, frame adoption, and support for the war in Afghanistan","volume":"57","author":"Edy Jill A.","year":"2007","unstructured":"Jill A. Edy and Patrick C. Meirick . 2007 . Wanted, dead or alive: Media frames, frame adoption, and support for the war in Afghanistan . Journal of Communication 57 , 1 (2007), 119 -- 141 . Jill A. Edy and Patrick C. Meirick. 2007. Wanted, dead or alive: Media frames, frame adoption, and support for the war in Afghanistan. Journal of Communication 57, 1 (2007), 119--141.","journal-title":"Journal of Communication"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-2466.1993.tb01304.x"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1390681.1442794"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764289033002006"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441895"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjr044"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1620754.1620827"},{"key":"e_1_2_1_29_1","volume-title":"A measure of media bias. The Quarterly Journal of Economics","author":"Groseclose Tim","year":"2005","unstructured":"Tim Groseclose and Jeffrey Milyo . 2005. A measure of media bias. The Quarterly Journal of Economics ( 2005 ), 1191--1237. Tim Groseclose and Jeffrey Milyo. 2005. A measure of media bias. The Quarterly Journal of Economics (2005), 1191--1237."},{"key":"e_1_2_1_30_1","volume-title":"An Introduction to Functional Grammar","author":"Halliday Michael","unstructured":"Michael Halliday , Christian M. I. M. Matthiessen , and Christian Matthiessen . 2014. An Introduction to Functional Grammar . Routledge . Michael Halliday, Christian M. I. M. Matthiessen, and Christian Matthiessen. 2014. An Introduction to Functional Grammar. Routledge."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_32_1","volume-title":"Applied Logistic Regression","author":"Hosmer David W.","unstructured":"David W. Hosmer Jr . and Stanley Lemeshow . 2004. Applied Logistic Regression . John Wiley 8 Sons. David W. Hosmer Jr. and Stanley Lemeshow. 2004. Applied Logistic Regression. John Wiley 8 Sons."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/009365093020003002"},{"key":"e_1_2_1_34_1","volume-title":"Martin","author":"Jurafsky Dan","year":"2014","unstructured":"Dan Jurafsky and James H . Martin . 2014 . Speech and Language Processing. Pearson . Dan Jurafsky and James H. Martin. 2014. Speech and Language Processing. Pearson."},{"key":"e_1_2_1_35_1","first-page":"1137","article-title":"A study of cross-validation and bootstrap for accuracy estimation and model selection","volume":"14","author":"Kohavi Ron","year":"1995","unstructured":"Ron Kohavi and others. 1995 . A study of cross-validation and bootstrap for accuracy estimation and model selection . In Proceedings of IJCAI , Vol. 14. 1137 -- 1145 . Ron Kohavi and others. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of IJCAI, Vol. 14. 1137--1145.","journal-title":"Proceedings of IJCAI"},{"key":"e_1_2_1_36_1","volume-title":"Content Analysis: An Introduction to its Methodology","author":"Krippendorff Klaus","year":"2004","unstructured":"Klaus Krippendorff . 2004 . Content Analysis: An Introduction to its Methodology . Sage . Klaus Krippendorff. 2004. Content Analysis: An Introduction to its Methodology. Sage."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 9th International AAAI Conference on Web and Social Media.","author":"Kulshrestha Juhi","year":"2015","unstructured":"Juhi Kulshrestha , Muhammad Bilal Zafar , Lisette Espin Noboa , Krishna P. Gummadi , and Saptarshi Ghosh . 2015 . Characterizing information diets of social media users . In Proceedings of the 9th International AAAI Conference on Web and Social Media. Juhi Kulshrestha, Muhammad Bilal Zafar, Lisette Espin Noboa, Krishna P. Gummadi, and Saptarshi Ghosh. 2015. Characterizing information diets of social media users. In Proceedings of the 9th International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_38_1","volume-title":"Introduction to Information Retrieval","author":"Manning Christopher D.","unstructured":"Christopher D. Manning , Prabhakar Raghavan , Hinrich Sch\u00fctze , and others. 2008. Introduction to Information Retrieval . Vol. 1 . Cambridge University Press . Christopher D. Manning, Prabhakar Raghavan, Hinrich Sch\u00fctze, and others. 2008. Introduction to Information Retrieval. Vol. 1. Cambridge University Press."},{"key":"e_1_2_1_39_1","volume-title":"Shaw","author":"McCombs Maxwell E.","year":"1972","unstructured":"Maxwell E. McCombs and Donald L . Shaw . 1972 . The agenda-setting function of mass media. Public Opinion Quarterly ( 1972), 176--187. Maxwell E. McCombs and Donald L. Shaw. 1972. The agenda-setting function of mass media. Public Opinion Quarterly (1972), 176--187."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis. Association for Computational Linguistics, 3--10","author":"Montejo-Raez Arturo","year":"2012","unstructured":"Arturo Montejo-Raez , Eugenio Mart\u00ednez-C\u00e1mara , M. Teresa Martin-Valdivia , and L. Alfonso Urena-Lopez . 2012 . Random walk weighting over sentiwordnet for sentiment polarity detection on Twitter . In Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis. Association for Computational Linguistics, 3--10 . Arturo Montejo-Raez, Eugenio Mart\u00ednez-C\u00e1mara, M. Teresa Martin-Valdivia, and L. Alfonso Urena-Lopez. 2012. Random walk weighting over sentiwordnet for sentiment polarity detection on Twitter. In Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis. Association for Computational Linguistics, 3--10."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753543"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741688"},{"key":"e_1_2_1_43_1","volume-title":"The Filter Bubble: What the Internet is Hiding from You","author":"Pariser Eli","unstructured":"Eli Pariser . 2011. The Filter Bubble: What the Internet is Hiding from You . Penguin UK. Eli Pariser. 2011. The Filter Bubble: What the Internet is Hiding from You. Penguin UK."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518772"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958842"},{"key":"e_1_2_1_46_1","unstructured":"J. Ross Quinlan. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann.   J. Ross Quinlan. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1609067.1609142"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of ACL (1). 1650--1659","author":"Recasens Marta","year":"2013","unstructured":"Marta Recasens , Cristian Danescu-Niculescu-Mizil , and Dan Jurafsky . 2013 . Linguistic models for analyzing and detecting biased language . In Proceedings of ACL (1). 1650--1659 . Marta Recasens, Cristian Danescu-Niculescu-Mizil, and Dan Jurafsky. 2013. Linguistic models for analyzing and detecting biased language. In Proceedings of ACL (1). 1650--1659."},{"key":"e_1_2_1_49_1","volume-title":"Retrieved","author":"Borders Reporters Without","year":"2015","unstructured":"Reporters Without Borders . 2015 . 2015 World Press Freedom Index: How We Compiled the Index . Retrieved February 20, 2017 from http:\/\/fr.rsf.org\/IMG\/pdf\/methodology-en.pdf. Reporters Without Borders. 2015. 2015 World Press Freedom Index: How We Compiled the Index. Retrieved February 20, 2017 from http:\/\/fr.rsf.org\/IMG\/pdf\/methodology-en.pdf."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505623"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1111\/j.0021-9916.2007.00326.x","article-title":"Framing, agenda setting, and priming: The evolution of three media effects models","volume":"57","author":"Scheufele Dietram A.","year":"2007","unstructured":"Dietram A. Scheufele and David Tewksbury . 2007 . Framing, agenda setting, and priming: The evolution of three media effects models . Journal of Communication 57 , 1 (2007), 9 -- 20 . Dietram A. Scheufele and David Tewksbury. 2007. Framing, agenda setting, and priming: The evolution of three media effects models. Journal of Communication 57, 1 (2007), 9--20.","journal-title":"Journal of Communication"},{"key":"e_1_2_1_52_1","volume-title":"Smith","author":"Sim Yanchuan","year":"2013","unstructured":"Yanchuan Sim , Brice D. L. Acree , Justin H. Gross , and Noah A . Smith . 2013 . Measuring ideological proportions in political speeches. In Proceedings of EMNLP. Yanchuan Sim, Brice D. L. Acree, Justin H. Gross, and Noah A. Smith. 2013. Measuring ideological proportions in political speeches. In Proceedings of EMNLP."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v36i4.2528"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1157"},{"key":"e_1_2_1_55_1","volume-title":"The framing of decisions and the psychology of choice. Science 211, 4481","author":"Tversky Amos","year":"1981","unstructured":"Amos Tversky and Daniel Kahneman . 1981. The framing of decisions and the psychology of choice. Science 211, 4481 ( 1981 ), 453--458. Amos Tversky and Daniel Kahneman. 1981. The framing of decisions and the psychology of choice. Science 211, 4481 (1981), 453--458."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963504"}],"container-title":["ACM Transactions on Social Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3204948","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3204948","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3204948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:32Z","timestamp":1750208912000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3204948"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,6,30]]}},"alternative-id":["10.1145\/3204948"],"URL":"https:\/\/doi.org\/10.1145\/3204948","relation":{},"ISSN":["2469-7818","2469-7826"],"issn-type":[{"value":"2469-7818","type":"print"},{"value":"2469-7826","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,27]]},"assertion":[{"value":"2016-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}