{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:19:36Z","timestamp":1771467576166,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T00:00:00Z","timestamp":1722297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["CUC230B008"],"award-info":[{"award-number":["CUC230B008"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["CUC24SG018"],"award-info":[{"award-number":["CUC24SG018"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["23JCB002"],"award-info":[{"award-number":["23JCB002"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing Social Science Foundation of China","award":["CUC230B008"],"award-info":[{"award-number":["CUC230B008"]}]},{"name":"Beijing Social Science Foundation of China","award":["CUC24SG018"],"award-info":[{"award-number":["CUC24SG018"]}]},{"name":"Beijing Social Science Foundation of China","award":["23JCB002"],"award-info":[{"award-number":["23JCB002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Online news platforms have become users\u2019 primary information sources. However, they focus on attracting users to click on the news and ignore whether the news triggers a sense of engagement, which could potentially reduce users\u2019 participation in public events. Therefore, this study constructs four indicators by assessing user engagement to build an intelligent system to help platforms optimize their publishing strategies. First, this study defines user engagement evaluation as a classification task that divides user engagement into four indicators and proposes an extended LDA model based on user click\u2013comment behavior (UCCB), using which the attractiveness of words in news headlines and content can be effectively represented. Second, this study proposes a deep user engagement evaluation (DUEE) model that integrates news attractiveness and multiple features in an attention-based deep neural network for user engagement evaluation. The DUEE model considers various elements that collectively determine the ability of the news to attract clicks and engagement. Third, the proposed model is compared with the baseline and state-of-the-art techniques, showing that it outperforms all existing methods. This study provides new research contributions and ideas for improving user engagement in online news evaluation.<\/jats:p>","DOI":"10.3390\/systems12080274","type":"journal-article","created":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T15:25:23Z","timestamp":1722353123000},"page":"274","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Evaluating User Engagement in Online News: A Deep Learning Approach Based on Attractiveness and Multiple Features"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0599-3916","authenticated-orcid":false,"given":"Guohui","family":"Song","sequence":"first","affiliation":[{"name":"School of Computer and Cyber Sciences, Communication University of China, Beijing 100024, China"},{"name":"State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1370-8150","authenticated-orcid":false,"given":"Yongbin","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China"}]},{"given":"Xiaosen","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer and Cyber Sciences, Communication University of China, Beijing 100024, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8255-4805","authenticated-orcid":false,"given":"Hongbin","family":"Hu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China"}]},{"given":"Fan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Journalism, Communication University of China, Beijing 100024, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/0960085X.2022.2103046","article-title":"Digital platforms in the news industry: How social media platforms impact traditional media news viewership","volume":"33","author":"Ren","year":"2024","journal-title":"Eur. J. Inform. Syst."},{"key":"ref_2","unstructured":"(2024, July 10). Pewreaearch. Available online: https:\/\/www.pewresearch.org\/journalism\/fact-sheet\/news-platform-fact-sheet\/."},{"key":"ref_3","unstructured":"(2024, July 10). Statista. Available online: https:\/\/www.statista.com\/statistics\/910787\/china-monthly-active-users-on-leading-news-apps\/."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2450","DOI":"10.1177\/1461444817724170","article-title":"Are people incidentally exposed to news on social media? A comparative analysis","volume":"20","author":"Fletcher","year":"2018","journal-title":"New Media Soc."},{"key":"ref_5","first-page":"1682","article-title":"Google News and machine gatekeepers: Algorithmic personalization and news diversity in online news search","volume":"11","author":"Evans","year":"2023","journal-title":"Digit. J."},{"key":"ref_6","first-page":"1521","article-title":"From wild east to forbidden city: Mapping algorithmic news distribution in China through a case study of Jinri Toutiao","volume":"11","author":"Kuai","year":"2023","journal-title":"Digit. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3511708","article-title":"Graph neural news recommendation with user existing and potential interest modeling","volume":"16","author":"Qiu","year":"2022","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Voronov, A., Shen, Y., and Mondal, P.K. (2019, January 13\u201318). Forecasting popularity of news article by title analyzing with BN-LSTM network. Proceedings of the 2019 International Conference on Data Mining and Machine Learning, New York, NY, USA.","DOI":"10.1145\/3335656.3335679"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"203","DOI":"10.17645\/mac.v11i2.6390","article-title":"TikTok and political communication: The latest frontier of politainment? A case study","volume":"11","author":"Cervi","year":"2023","journal-title":"Media Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106430","DOI":"10.1016\/j.knosys.2020.106430","article-title":"A named entity topic model for news popularity prediction","volume":"208","author":"Yang","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103428","DOI":"10.1016\/j.im.2021.103428","article-title":"DNCP: An attention-based deep learning approach enhanced with attractiveness and timeliness of news for online news click prediction","volume":"58","author":"Xiong","year":"2021","journal-title":"Inform. Manag.-Amster."},{"key":"ref_12","unstructured":"Liao, D., Xu, J., Li, G., Huang, W., Liu, W., and Li, J. (February, January 27). Popularity prediction on online articles with deep fusion of temporal process and content features. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e13336","DOI":"10.1111\/exsy.13336","article-title":"A novel multimodal online news popularity prediction model based on ensemble learning","volume":"40","author":"Arora","year":"2023","journal-title":"Expert. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Omidvar, A., Pourmodheji, H., An, A., and Edall, G. (2020, January 22\u201324). A novel approach to determining the quality of news headlines. Proceedings of the NLPinAI 2020, Valletta, Malta.","DOI":"10.5220\/0009367504010409"},{"key":"ref_15","unstructured":"Yang, Y., Cao, J., Lu, M., Li, J., and Lin, C. (2019). How to Write High-quality News on Social Network? Predicting News Quality by Mining Writing Style. arXiv."},{"key":"ref_16","first-page":"243","article-title":"CA-CD: Context-aware clickbait detection using new Chinese clickbait dataset with transfer learning method","volume":"58","author":"Wang","year":"2023","journal-title":"Data. Technol. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"108605","DOI":"10.1016\/j.knosys.2022.108605","article-title":"Clickbait detection on WeChat: A deep model integrating semantic and syntactic information","volume":"245","author":"Liu","year":"2022","journal-title":"Knowl-Based. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1177\/0165551519871822","article-title":"Clickbait detection using multiple categorization techniques","volume":"47","author":"Pujahari","year":"2021","journal-title":"J. Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1109\/TTS.2021.3073464","article-title":"Clickbait\u2014Trust and credibility of digital news","volume":"2","author":"Kaushal","year":"2021","journal-title":"IEEE Trans. Technol. Soc."},{"key":"ref_20","first-page":"429","article-title":"Aggregation, clickbait and their effect on perceptions of journalistic credibility and quality","volume":"14","author":"Molyneux","year":"2020","journal-title":"J. Pract."},{"key":"ref_21","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, Z.C., Yang, D.Y., Dyer, C., He, X.D., Smola, A., and Hovy, E. (2016, January 12\u201317). Hierarchical attention networks for document classification. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1174"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102739","DOI":"10.1016\/j.ipm.2021.102739","article-title":"Users\u2019 ability to perceive misinformation: An information quality assessment approach","volume":"59","author":"Zrnec","year":"2022","journal-title":"Inform. Process. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"pgad286","DOI":"10.1093\/pnasnexus\/pgad286","article-title":"High level of correspondence across different news domain quality rating sets","volume":"2","author":"Lin","year":"2023","journal-title":"PNAS Nexus"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mosallanezhad, A., Karami, M., Shu, K., Mancenido, M.V., and Liu, H. (2022, January 25\u201329). Domain Adaptive Fake News Detection via Reinforcement Learning. Proceedings of the ACM Web Conference 2022, Lyon, France.","DOI":"10.1145\/3485447.3512258"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"275","DOI":"10.32604\/iasc.2023.041873","article-title":"Deep learning model for news quality evaluation based on explicit and implicit information","volume":"38","author":"Song","year":"2023","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Alam, S.M., Asevska, E., Roche, M., and Teisseire, M. (2021, January 1\u20133). A Data-Driven Score Model to Assess Online News Articles in Event-Based Surveillance System. Proceedings of the Annual International Conference on Information Management and Big Data, Virtual Event.","DOI":"10.1007\/978-3-031-04447-2_18"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, Q.Y., Li, L., Zhou, H., Zeng, Y., and Yu, Z. (2020, January 7\u201312). Importance-aware learning for neural headline editing. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6467"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2969","DOI":"10.14778\/3415478.3415521","article-title":"Scilens news platform: A system for real-time evaluation of news articles","volume":"13","author":"Romanou","year":"2020","journal-title":"Proc. Vldb. Endow."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Mantrach, A., Jaimes, A., and Oh, A. (2016, January 13\u201317). How to compete online for news audience: Modeling words that attract clicks. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939873"},{"key":"ref_31","first-page":"12","article-title":"The principles of readability","volume":"1","author":"DuBay","year":"2004","journal-title":"Online Inf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"eadn2555","DOI":"10.1126\/sciadv.adn2555","article-title":"Reading dies in complexity: Online news consumers prefer simple writing","volume":"10","author":"Shulman","year":"2024","journal-title":"Sci. Adv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5228","DOI":"10.1073\/pnas.0307752101","article-title":"Finding scientific topics","volume":"101","author":"Griffiths","year":"2004","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Li, S., Zhao, Z., Hu, R.F., Li, W.S., Liu, T., and Du, X.Y. (2018, January 15\u201320). Analogical Reasoning on Chinese Morphological and Semantic Relations. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(Volume 2: Short Papers), Melbourne, Australia.","DOI":"10.18653\/v1\/P18-2023"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.pragma.2013.07.012","article-title":"Credibility and trust of information in online environments: The use of cognitive heuristics","volume":"59","author":"Metzger","year":"2005","journal-title":"J. PRAGMATICS"},{"key":"ref_36","first-page":"261","article-title":"What is news? Galtung and Ruge revisited","volume":"2","author":"Harcup","year":"2001","journal-title":"J. Stud."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cui, Y., Jia, M.L., Lin, T.Y., Song, Y., and Belongie, S. (2019, January 15\u201320). Class-Balanced Loss Based on Effective Number of Samples. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00949"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014, January 25\u201329). Convolutional Neural Networks for Sentence Classification. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lai, S., Xu, L.H., Liu, K., and Zhao, J. (2015, January 25\u201329). Recurrent convolutional neural networks for text classification. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9513"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/8\/274\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:26:31Z","timestamp":1760109991000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/8\/274"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,30]]},"references-count":39,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["systems12080274"],"URL":"https:\/\/doi.org\/10.3390\/systems12080274","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,30]]}}}