{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:30:58Z","timestamp":1750221058034,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>Subjective reporting polarizes competing viewpoints. However, helping readers to recognize subjective content leads to more impartial discussions. Towards this end, we develop machine learning models that classify sentence objectivity. We contribute a set of linguistic rules for determining sentence objectivity collated from previous work. We also develop a labeled dataset with over 5000 sentences retrieved from various news sources. Further, we evaluate traditional machine learning classification models and artificial neural networks on our dataset. The best performing model, a convolutional neural network, achieved an accuracy of 85% and an AUC of 0.933. Using our subjective-objective sentence classification model, we implement Fact-or-Fiction, an end-to-end web system that highlights objective sentences in user text. Fact-or-Fiction provides additional information, such as links to related web pages and related previous submissions.<\/jats:p>","DOI":"10.1145\/3274380","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T21:21:27Z","timestamp":1541107287000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Fact or Fiction"],"prefix":"10.1145","volume":"2","author":[{"given":"Charles","family":"Lovering","sequence":"first","affiliation":[{"name":"Worcester Polytechnic Institute, Worcester, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anqi","family":"Lu","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute, Worcester, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cuong","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute, Worcester, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huyen","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute, Worcester, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Hurley","sequence":"additional","affiliation":[{"name":"Microsoft, Boston, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emmanuel","family":"Agu","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute, Worcester, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"{1} {n. d.}. Natural Language Toolkit. https:\/\/www.nltk.org\/."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.2307\/2647642"},{"volume-title":"Mining text data","author":"ChengXiang Zhai Aggarwal","key":"e_1_2_1_3_1","unstructured":"Cha2ru Aggarwal and ChengXiang Zhai. 2012. A survey of text classification algorithms. In Mining text data . Springer, 163--222."},{"key":"e_1_2_1_4_1","unstructured":"Amazon. {n. d.}. Amazon Mechanical Turk . https:\/\/www.mturk.com\/mturk\/welcome."},{"key":"e_1_2_1_5_1","first-page":"2200","article-title":"Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining","volume":"10","author":"Baccianella Stefano","year":"2010","unstructured":"Stefano Baccianella, Andrea Esuli, and Fabrizio Sebastiani. 2010. Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining.. In LREC , Vol. 10. 2200--2204.","journal-title":"LREC"},{"key":"e_1_2_1_6_1","volume-title":"Partisanship and voting behavior","author":"Bartels Larry","year":"1952","unstructured":"Larry Bartels. 2000. Partisanship and voting behavior, 1952--1996. American Journal of Political Science (2000), 35--50."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/15205436.2014.891136"},{"key":"e_1_2_1_8_1","unstructured":"BuzzFeed {n. d.}. BuzzFeedNews Github. BuzzFeed"},{"key":"e_1_2_1_9_1","volume-title":"Reference and definite descriptions. The philosophical review","author":"Donnellan Keith","year":"1966","unstructured":"Keith Donnellan. 1966. Reference and definite descriptions. The philosophical review (1966), 281--304."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-010-9139-4"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/129687"},{"key":"e_1_2_1_12_1","unstructured":"Google. 2013. word2vec . https:\/\/code.google.com\/archive\/p\/word2vec\/."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143892"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3115\/990820.990864"},{"volume-title":"Why Washington won't work: Polarization, political trust, and the governing crisis","author":"Hetherington Marc","key":"e_1_2_1_15_1","unstructured":"Marc Hetherington and Thomas Rudolph. 2015. Why Washington won't work: Polarization, political trust, and the governing crisis . University of Chicago Press."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_17_1","volume-title":"Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882","author":"Kim Yoon","year":"2014","unstructured":"Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.","DOI":"10.5555\/2999134.2999257"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfw005"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1218990"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000011"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661993"},{"key":"e_1_2_1_23_1","unstructured":"Randolph Quirk. 1985. A comprehensive grammar of the English language. (1985)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-016-9472-z"},{"key":"e_1_2_1_25_1","volume-title":"Wikicorpus: A word-sense disambiguated multilingual wikipedia corpus.","author":"Reese Samuel","year":"2010","unstructured":"Samuel Reese, Gemma Boleda, Montse Cuadros, and German Rigau. 2010. Wikicorpus: A word-sense disambiguated multilingual wikipedia corpus. (2010)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277919"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3115\/1034678.1034721"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3115\/1225733.1225751"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the Fourth SIGdial Workshop of Discourse and Dialogue .","author":"Wilson Theresa","year":"2003","unstructured":"Theresa Wilson and Janyce Wiebe. 2003. Annotating opinions in the world press. In Proceedings of the Fourth SIGdial Workshop of Discourse and Dialogue ."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119355.1119372"},{"key":"e_1_2_1_31_1","volume-title":"ADADELTA: an adaptive learning rate method. arXiv preprint arXiv:1212.5701","author":"Zeiler Matthew","year":"2012","unstructured":"Matthew Zeiler. 2012. ADADELTA: an adaptive learning rate method. arXiv preprint arXiv:1212.5701 (2012)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274380","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274380","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:35Z","timestamp":1750207475000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":31,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274380"],"URL":"https:\/\/doi.org\/10.1145\/3274380","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}