{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T06:44:14Z","timestamp":1778827454134,"version":"3.51.4"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>\n            User comments have become an essential part of online journalism. However, newsrooms are often overwhelmed by the vast number of diverse comments, for which a manual analysis is barely feasible. Identifying meta-comments that address or mention newsrooms, individual journalists, or moderators and that may call for reactions is particularly critical. In this paper, we present an automated approach to identify and classify meta-comments. We compare comment classification based on manually extracted features with an end-to-end learning approach. We develop, optimize, and evaluate multiple classifiers on a comment dataset of the large German online newsroom SPIEGEL Online and the \"One Million Posts\" corpus of DER STANDARD, an Austrian newspaper. Both optimized classification approaches achieved encouraging\n            <jats:italic>F<\/jats:italic>\n            <jats:sub>0.5<\/jats:sub>\n            values between 76% and 91%. We report on the most significant classification features with the results of a qualitative analysis and discuss how our work contributes to making participation in online journalism more constructive.\n          <\/jats:p>","DOI":"10.1145\/3274336","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T21:21:27Z","timestamp":1541107287000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Who is Addressed in this Comment?"],"prefix":"10.1145","volume":"2","author":[{"given":"Marlo","family":"H\u00e4ring","sequence":"first","affiliation":[{"name":"University of Hamburg, Hamburg, Germany"}]},{"given":"Wiebke","family":"Loosen","sequence":"additional","affiliation":[{"name":"Hans-Bredow-Institut, Hamburg, Germany"}]},{"given":"Walid","family":"Maalej","sequence":"additional","affiliation":[{"name":"University of Hamburg, Hamburg, Germany"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"13","volume":"0","year":"2017","unstructured":"2017. TextBlob: Simplified Text Processing - TextBlob 0.13.0 documentation. Website. (2017). https:\/\/textblob. readthedocs.io\/en\/dev\/","journal-title":"TextBlob: Simplified Text Processing - TextBlob"},{"key":"e_1_2_1_2_1","unstructured":"2017. Top Sites in Germany - Alexa. Website. (2017). https:\/\/www.alexa.com\/topsites\/countries\/DE"},{"key":"e_1_2_1_3_1","volume-title":"perspectiveapi: Perspective is an API that uses machine learning models to score the perceived impact a comment might have on a conversation. (July","year":"2018","unstructured":"2018. perspectiveapi: Perspective is an API that uses machine learning models to score the perceived impact a comment might have on a conversation. (July 2018). https:\/\/github.com\/conversationai\/perspectiveapi original-date:2017-02-23T10:55:14Z."},{"key":"e_1_2_1_4_1","volume-title":"ONLINE 2018. 2018","author":"SPIEGEL","year":"2018","unstructured":"SPIEGEL ONLINE 2018. 2018.: Besondere Nutzungsbedingungen f\u00fcr Ihre Beitr\u00e4ge. Spiegel Online (May 2018). http:\/\/www.spiegel.de\/extra\/besondere-nutzungsbedingungen-fuer-ihre-beitraege-a-1207779.html"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1748048516642732"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1796408"},{"key":"e_1_2_1_7_1","volume-title":"A user's guide to support vector machines. Data mining techniques for the life sciences","author":"Ben-Hur Asa","year":"2010","unstructured":"Asa Ben-Hur and Jason Weston. 2010. A user's guide to support vector machines. Data mining techniques for the life sciences (2010), 223--239."},{"key":"e_1_2_1_8_1","volume-title":"Online-Feedback als Teil redaktioneller Qualit\u00e4tsprozesse von Tageszeitungen--eine Inhaltsanalyse von Leserkommentaren. OnlineDiskurse. Theorien und Methoden transmedialer OnlineDiskursforschung","author":"Bergt Swenja","year":"2013","unstructured":"Swenja Bergt and Martin Welker. 2013. Online-Feedback als Teil redaktioneller Qualit\u00e4tsprozesse von Tageszeitungen--eine Inhaltsanalyse von Leserkommentaren. OnlineDiskurse. Theorien und Methoden transmedialer OnlineDiskursforschung (2013), 346--363."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","unstructured":"Christopher M Bishop. 2006. Pattern recognition and machine learning.springer.","DOI":"10.5555\/1162264"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/17512786.2011.557560"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002736.2002847"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3203489"},{"key":"e_1_2_1_14_1","volume-title":"mbox","author":"Franccois Chollet","year":"2015","unstructured":"Franccois Chollet et almbox. 2015. Keras. https:\/\/keras.io. (2015)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/17524032.2014.981560"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078186"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/1464884915579332"},{"key":"e_1_2_1_18_1","first-page":"1","article-title":"k-Nearest neighbour classifiers","volume":"34","author":"Cunningham Padraig","year":"2007","unstructured":"Padraig Cunningham and Sarah Jane Delany. 2007. k-Nearest neighbour classifiers. Multiple Classifier Systems, Vol. 34 (2007), 1--17.","journal-title":"Multiple Classifier Systems"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675160"},{"key":"e_1_2_1_20_1","volume-title":"Picking the NYT picks: Editor","author":"Diakopoulos Nicholas","year":"2015","unstructured":"Nicholas Diakopoulos. 2015b. Picking the NYT picks: Editorial criteria and automation in the curation of online news comments. Editors` Note (2015), 147."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188267"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742760"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858535"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/646943.712093"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/19331681.2014.997416"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/3086952"},{"key":"e_1_2_1_27_1","unstructured":"Nele Heise Julius Reimer Wiebke Loosen Jan-Hinrik Schmidt Christina Heller and Anne Quader. 2014. Publikumsinklusion bei der S\u00fcddeutschen Zeitung. (2014)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675207"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/14616700120107347"},{"key":"e_1_2_1_30_1","volume-title":"Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882","author":"Kim Yoon","year":"2014","unstructured":"Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2017.86"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/3044805.3045025"},{"key":"e_1_2_1_33_1","volume-title":"Deep learning. nature","author":"LeCun Yann","year":"2015","unstructured":"Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. nature, Vol. 521, 7553 (2015), 436."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Wiebke Loosen Marlo H\u0120ring Zijad Kurtanovic Lisa Merten Julius Reimer Lies van Roessel and Walid Maalej. 2017. Making sense of user comments: Identifying journalists' requirements for a comment analysis framework. In Studies in Communication and Media. 333--364.","DOI":"10.5771\/2192-4007-2017-4-333"},{"key":"e_1_2_1_35_1","volume-title":"Publikumsinklusion bei der Tagesschau. Fallstudienbericht aus dem DFG-Projekt \"Die (Wieder-) Entdeckung des Publikums\" (Arbeitspapiere des Hans-Bredow-Instituts Nr. 26)","author":"Loosen Wiebke","year":"2013","unstructured":"Wiebke Loosen, Jan-Hinrik Schmidt, Nele Heise, Julius Reimer, and Mareike Scheler. 2013. Publikumsinklusion bei der Tagesschau. Fallstudienbericht aus dem DFG-Projekt \"Die (Wieder-) Entdeckung des Publikums\" (Arbeitspapiere des Hans-Bredow-Instituts Nr. 26), Hamburg. www. hans-bredow-institut. de\/webfm_send\/709 {19.04. 2013} (2013)."},{"key":"e_1_2_1_36_1","first-page":"489","article-title":"WHEN THE MEDIUM IS ON THE MESSAGE: EXPLORING HATE IN MEDIA-READER INTERACTIONS IN SPANISH ONLINE SPORTS JOURNALISM","volume":"24","author":"Lopez-Gonzalez Hibai","year":"2014","unstructured":"Hibai Lopez-Gonzalez and Frederic Guerrero-Sole. 2014. WHEN THE MEDIUM IS ON THE MESSAGE: EXPLORING HATE IN MEDIA-READER INTERACTIONS IN SPANISH ONLINE SPORTS JOURNALISM. ANNALES-ANALI ZA ISTRSKE IN MEDITERANSKE STUDIJE-SERIES HISTORIA ET SOCIOLOGIA, Vol. 24, 3 (2014), 489--500.","journal-title":"ANNALES-ANALI ZA ISTRSKE IN MEDITERANSKE STUDIJE-SERIES HISTORIA ET SOCIOLOGIA"},{"key":"e_1_2_1_37_1","volume-title":"Bug report, feature request, or simply praise? on automatically classifying app reviews. In 2015 IEEE 23rd international requirements engineering conference (RE)","author":"Maalej Walid","unstructured":"Walid Maalej and Hadeer Nabil. 2015. Bug report, feature request, or simply praise? on automatically classifying app reviews. In 2015 IEEE 23rd international requirements engineering conference (RE). IEEE, 116--125."},{"key":"e_1_2_1_38_1","volume-title":"Styles of Communication","volume":"5","author":"Macovei Elena-Irina","year":"2013","unstructured":"Elena-Irina Macovei. 2013. Neo-Nazis Sympathizers on the Forums of the Romanian Online Publications. Styles of Communication, Vol. 5, 1 (2013)."},{"key":"e_1_2_1_39_1","first-page":"1","article-title":"Reader comments to online opinion journalism: A space of public deliberation","volume":"10","author":"Manosevitch Edith","year":"2009","unstructured":"Edith Manosevitch and Dana Walker. 2009. Reader comments to online opinion journalism: A space of public deliberation. In International Symposium on Online Journalism, Vol. 10. 1--30.","journal-title":"International Symposium on Online Journalism"},{"key":"e_1_2_1_40_1","unstructured":"STANDARD Verlagsgesellschaft m.b.H. {n. d.}. Die Community-Moderatoren. ({n. d.}). https:\/\/derstandard.at\/1385171179346\/Die-Community-Moderatoren"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/17512786.2013.774117"},{"key":"e_1_2_1_42_1","volume-title":"Machine Learning","author":"Michalski Ryszard S","unstructured":"Ryszard S Michalski. 1983. A theory and methodology of inductive learning. In Machine Learning, Volume I. Elsevier, 83--134."},{"key":"e_1_2_1_43_1","volume-title":"Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)."},{"key":"e_1_2_1_44_1","volume-title":"Analyse von Wort-Vektoren deutscher Textkorpora. (7","author":"M\u00fcller Andreas","year":"2015","unstructured":"Andreas M\u00fcller. 2015. Analyse von Wort-Vektoren deutscher Textkorpora. (7 2015). http:\/\/devmount.github.io\/GermanWordEmbeddings\/"},{"key":"e_1_2_1_45_1","volume-title":"Christian Nuernbergk","author":"Neuberger Christoph","year":"2009","unstructured":"Christoph Neuberger. 2009. Internet, Journalismus und \u00d6ffentlichkeit. Analyse des Medienumbruchs. S. 19--105. Christoph Neuberger, Christian Nuernbergk (2009), 79."},{"key":"e_1_2_1_46_1","volume-title":"The content analysis guidebook","author":"Neuendorf Kimberly A","unstructured":"Kimberly A Neuendorf. 2016. The content analysis guidebook. Sage."},{"key":"e_1_2_1_47_1","volume-title":"ConceptVector: text visual analytics via interactive lexicon building using word embedding","author":"Park Deokgun","year":"2018","unstructured":"Deokgun Park, Seungyeon Kim, Jurim Lee, Jaegul Choo, Nicholas Diakopoulos, and Niklas Elmqvist. 2018. ConceptVector: text visual analytics via interactive lexicon building using word embedding. IEEE transactions on visualization and computer graphics, Vol. 24, 1 (2018), 361--370."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858389"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_50_1","first-page":"1532","article-title":"Glove: Global vectors for word representation","volume":"14","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation.. In EMNLP, Vol. 14. 1532--1543.","journal-title":"EMNLP"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/08838150701626529"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50","author":"Radim","unstructured":"Radim v Rehr uv rek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50. http:\/\/is.muni.cz\/publication\/884893\/en."},{"key":"e_1_2_1_53_1","volume-title":"Publikumsinklusion beim \"Freitag\". Fallstudienbericht aus dem DFG-Projekt \"Die (Wieder-) Entdeckung des Publikums","author":"Reimer Julius","year":"2015","unstructured":"Julius Reimer, Nele Heise, Wiebke Loosen, Jan-Hinrik Schmidt, Jonas Klein, Ariane Attrodt, and Anne Quader. 2015. Publikumsinklusion beim \"Freitag\". Fallstudienbericht aus dem DFG-Projekt \"Die (Wieder-) Entdeckung des Publikums\". Hamburg: Hans-Bredow-Institut (2015)."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/08838151.2015.1093482"},{"key":"e_1_2_1_55_1","volume-title":"et almbox","author":"Rumelhart David E","year":"1988","unstructured":"David E Rumelhart, Geoffrey E Hinton, Ronald J Williams, et almbox. 1988. Learning representations by back-propagating errors. Cognitive modeling, Vol. 5, 3 (1988), 1."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080711"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21690"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/3103555"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274336","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274336","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:07Z","timestamp":1750207447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274336"}},"subtitle":["Automatically Classifying Meta-Comments in News Comments"],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":58,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274336"],"URL":"https:\/\/doi.org\/10.1145\/3274336","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}