{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T10:28:48Z","timestamp":1787740128753,"version":"build-2784847793"},"reference-count":69,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:00:00Z","timestamp":1645574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["21-18-00454"],"award-info":[{"award-number":["21-18-00454"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Abstractive summarization is a technique that allows for extracting condensed meanings from long texts, with a variety of potential practical applications. Nonetheless, today\u2019s abstractive summarization research is limited to testing the models on various types of data, which brings only marginal improvements and does not lead to massive practical employment of the method. In particular, abstractive summarization is not used for social media research, where it would be very useful for opinion and topic mining due to the complications that social media data create for other methods of textual analysis. Of all social media, Reddit is most frequently used for testing new neural models of text summarization on large-scale datasets in English, without further testing on real-world smaller-size data in various languages or from various other platforms. Moreover, for social media, summarizing pools of texts (one-author posts, comment threads, discussion cascades, etc.) may bring crucial results relevant for social studies, which have not yet been tested. However, the existing methods of abstractive summarization are not fine-tuned for social media data and have next-to-never been applied to data from platforms beyond Reddit, nor for comments or non-English user texts. We address these research gaps by fine-tuning the newest Transformer-based neural network models LongFormer and T5 and testing them against BART, and on real-world data from Reddit, with improvements of up to 2%. Then, we apply the best model (fine-tuned T5) to pools of comments from Reddit and assess the similarity of post and comment summarizations. Further, to overcome the 500-token limitation of T5 for analyzing social media pools that are usually bigger, we apply LongFormer Large and T5 Large to pools of tweets from a large-scale discussion on the Charlie Hebdo massacre in three languages and prove that pool summarizations may be used for detecting micro-shifts in agendas of networked discussions. Our results show, however, that additional learning is definitely needed for German and French, as the results for these languages are non-satisfactory, and more fine-tuning is needed even in English for Twitter data. Thus, we show that a \u2018one-for-all\u2019 neural-network summarization model is still impossible to reach, while fine-tuning for platform affordances works well. We also show that fine-tuned T5 works best for small-scale social media data, but LongFormer is helpful for larger-scale pool summarizations.<\/jats:p>","DOI":"10.3390\/fi14030069","type":"journal-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T09:34:38Z","timestamp":1645608878000},"page":"69","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Transformer-Based Abstractive Summarization for Reddit and Twitter: Single Posts vs. Comment Pools in Three Languages"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7305-1429","authenticated-orcid":false,"given":"Ivan S.","family":"Blekanov","sequence":"first","affiliation":[{"name":"School of Mathematics and Computer Science, Yan\u2019an University, Yan\u2019an 716000, China"},{"name":"Faculty of Applied Mathematics and Control Processes, St. Petersburg State University, 199034 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9473-6179","authenticated-orcid":false,"given":"Nikita","family":"Tarasov","sequence":"additional","affiliation":[{"name":"Faculty of Applied Mathematics and Control Processes, St. Petersburg State University, 199034 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0740-561X","authenticated-orcid":false,"given":"Svetlana S.","family":"Bodrunova","sequence":"additional","affiliation":[{"name":"School of Journalism and Mass Communications, St. Petersburg State University, 199034 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,23]]},"reference":[{"key":"ref_1","unstructured":"Kherwa, P., and Bansal, P. (2020). Topic modeling: A comprehensive review. EAI Endorsed Trans. Scalable Inf. Syst., 7, Available online: https:\/\/eprints.eudl.eu\/id\/eprint\/682\/1\/eai.13-7-2018.159623.pdf."},{"key":"ref_2","first-page":"784","article-title":"Robust PLSA performs better than LDA","volume":"Volume 7814","author":"Potapenko","year":"2013","journal-title":"Proceedings of the 35th European Conference on Information Retrieval"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bodrunova, S.S. (2021). Topic Modeling in Russia: Current Approaches and Issues in Methodology. The Palgrave Handbook of Digital Russia Studies, Palgrave Macmillan.","DOI":"10.1007\/978-3-030-42855-6_23"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"76","DOI":"10.5614\/itbj.ict.res.appl.2016.10.1.6","article-title":"Topic Modeling in Sentiment Analysis: A Systematic Review","volume":"10","author":"Rana","year":"2016","journal-title":"J. ICT Res. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Blekanov, I., Tarasov, N., and Maksimov, A. (2018, January 1\u20133). Topic modeling of conflict ad hoc discussions in social networks. Proceedings of the 3rd International Conference on Applications in Information Technology, Aizu-Wakamatsu, Japan.","DOI":"10.1145\/3274856.3274881"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Koltcov, S., Koltsova, O., and Nikolenko, S. (2014, January 23\u201326). Latent dirichlet allocation: Stability and applications to studies of user-generated content. Proceedings of the 2014 ACM Conference on Web Science (WebSci), Bloomington, IN, USA.","DOI":"10.1145\/2615569.2615680"},{"key":"ref_7","first-page":"265","article-title":"Interval semi-supervised LDA: Classifying needles in a haystack","volume":"Volume 8265","author":"Bodrunova","year":"2013","journal-title":"Proceedings of the 12th Mexican International Conference on Artificial Intelligence (MICAI\u20192013)"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bodrunova, S.S., Blekanov, I.S., and Kukarkin, M. (2019, January 22\u201325). Topics in the Russian Twitter and relations between their interpretability and sentiment. Proceedings of the 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS\u20192019), Granada, Spain.","DOI":"10.1109\/SNAMS.2019.8931725"},{"key":"ref_9","unstructured":"Boyd-Graber, J., Mimno, D., and Newman, D. (2014). Care and feeding of topic models: Problems, diagnostics, and improvements. Handbook of Mixed Membership Models and Their Applications, Taylor Francis Group."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/TKDE.2020.2992485","article-title":"Short text topic modeling techniques, applications, and performance: A survey","volume":"34","author":"Qiang","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_11","first-page":"61","article-title":"Detecting pivotal points in social conflicts via topic modeling of Twitter content","volume":"Volume 11193","author":"Smoliarova","year":"2018","journal-title":"Proceedings of the 5th International Conference on Internet Science (INSCI\u20192018)"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1162\/qss_a_00066","article-title":"COVID-19 publications: Database coverage, citations, readers, tweets, news, Facebook walls, Reddit posts","volume":"1","author":"Kousha","year":"2020","journal-title":"Quant. Sci. Stud."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"124414","DOI":"10.1109\/ACCESS.2020.3005935","article-title":"Community detection based on individual topics and network topology in social networks","volume":"8","author":"Jiang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1177\/0009445520916874","article-title":"Love, Hate Thy Neighbour? Or Just Don\u2019t Care Much about Them: A Sentiment Analysis of China-Related Posts and Comments on Reddit","volume":"56","author":"He","year":"2020","journal-title":"Com. China Rep."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sotudeh, S., Deilamsalehy, H., Dernoncourt, F., and Goharian, N. (2021). TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts. arXiv.","DOI":"10.18653\/v1\/2021.newsum-1.15"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, Y., Jia, Q., and Zhu, K. (2021, January 19\u201323). Keyword-aware Abstractive Summarization by Extracting Set-level Intermediate Summaries. Proceedings of the Web Conference (WWW\u20192021), Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3449906"},{"key":"ref_17","unstructured":"Zhang, J., Zhao, Y., Saleh, M., and Liu, P. (2020, January 13\u201318). Pegasus: Pre-training with extracted gap-sentences for abstractive summarization. Proceedings of the 37th International Conference on Machine Learning (PMLR), Virtual."},{"key":"ref_18","unstructured":"Maybury, M. (1999). Advances in Automatic Text Summarization, MIT Press. Available online: https:\/\/dl.acm.org\/doi\/book\/10.5555\/554275."},{"key":"ref_19","unstructured":"Jing, K., and Xu, J. (2019). A Survey on Neural Network Language Models. arXiv, Available online: https:\/\/arxiv.org\/pdf\/1906.03591.pdf."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Nallapati, R., Zhai, F., and Zhou, B. (2017, January 4\u20139). Summarunner: A recurrent neural network-based sequence model for extractive summarization of documents. Proceedings of the AAAI Conference on Artificial Intelligence, San Farncisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10958"},{"key":"ref_21","unstructured":"Liu, Y. (2019). Fine-tune BERT for Extractive Summarization. arXiv, Available online: https:\/\/arxiv.org\/pdf\/1903.10318.pdf."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, Y., and Lapata, M. (2019, January 3\u20137). Text Summarization with Pretrained Encoders. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1387"},{"key":"ref_23","unstructured":"Zhang, X., Wei, F., and Zhou, M. (August, January 28). HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_24","unstructured":"See, A., Liu, P.J., and Manning, C.D. (August, January 28). Get to the Point: Summarization with Pointer-Generator Networks. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Florence, Italy."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Narayan, S., Cohen, S.B., and Lapata, M. (2018, January 31). Don\u2019t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1206"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Cheng, J., Dong, L., and Lapata, M. (2016, January 1\u20135). Long short-term memory-networks for machine reading. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1053"},{"key":"ref_27","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 2017 Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A comprehensive survey on transfer learning","volume":"109","author":"Zhuang","year":"2020","journal-title":"Proc. IEEE"},{"key":"ref_29","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Universal Language Model. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., and Zettlemoyer, L. (2020, January 5\u201310). BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Virtual.","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"ref_31","first-page":"1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","unstructured":"Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer Normalization. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_35","unstructured":"Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., and Bowman, S.R. (2019, January 6\u201312). Super GLUE: A stickier benchmark for general-purpose language understanding systems. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_36","unstructured":"Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The Long-Document Transformer. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Torres-Moreno, J.M. (2014). Automatic Text Summarization: Some Important Concepts. Automatic Text Summarization, Wiley & Sons.","DOI":"10.1002\/9781119004752"},{"key":"ref_38","unstructured":"Mani, I., and Maybury, M. (1997). A Proposal for Task-based Evaluation of Text Summarization Systems. Intelligent Scalable Text Summarization: Proceedings of a Workshop Sponsored by the Association for Computational Linguistics, ACL."},{"key":"ref_39","unstructured":"Syed, S., V\u00f6lske, M., Lipka, N., Stein, B., Sch\u00fctze, H., and Potthast, M. (November, January 29). Towards summarization for social media-results of the tl;dr challenge. Proceedings of the 12th International Conference on Natural Language Generation, Tokyo, Japan."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"V\u00f6lske, M., Potthast, M., Syed, S., and Stein, B. (2017, January 7). Tl;dr: Mining reddit to learn automatic summarization. Proceedings of the Workshop on New Frontiers in Summarization, Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4508"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Syed, S., Yousef, T., Al-Khatib, K., J\u00e4nicke, S., and Potthast, M. (2021). Summary Explorer: Visualizing the State of the Art in Text Summarization. arXiv.","DOI":"10.18653\/v1\/2021.emnlp-demo.22"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bommasani, R., and Cardie, C. (2020, January 16\u201320). Intrinsic evaluation of summarization datasets. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), virtual.","DOI":"10.18653\/v1\/2020.emnlp-main.649"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kim, B., Kim, H., and Kim, G. (2018). Abstractive summarization of Reddit posts with multi-level memory networks. arXiv.","DOI":"10.18653\/v1\/N19-1260"},{"key":"ref_44","unstructured":"Gehrmann, S., Ziegler, Z., and Rush, A.M. (November, January 29). Generating abstractive summaries with finetuned language models. Proceedings of the 12th International Conference on Natural Language Generation, Tokyo, Japan."},{"key":"ref_45","unstructured":"Choi, H., Ravuru, L., Dryja\u00b4nski, T., Rye, S., Lee, D., Lee, H., and Hwang, I. (November, January 29). VAE-PGN based Abstractive Model in Multi-stage Architecture for Text Summarization. Proceedings of the 12th International Conference on Natural Language Generation, Tokyo, Japan."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Chen, Y., Liu, P., Zhong, M., Dou, Z.Y., Wang, D., Qiu, X., and Huang, X. (2020). CDEvalSumm: An empirical study of cross-dataset evaluation for neural summarization systems. arXiv.","DOI":"10.18653\/v1\/2020.findings-emnlp.329"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chen, Y.S., and Shuai, H.H. (2021). Meta-Transfer Learning for Low-Resource Abstractive Summarization. arXiv.","DOI":"10.1609\/aaai.v35i14.17503"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"101276","DOI":"10.1016\/j.csl.2021.101276","article-title":"Deep Reinforcement and Transfer Learning for Abstractive Text Summarization: A Review","volume":"71","author":"Alomari","year":"2022","journal-title":"Comput. Speech Lang."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3419106","article-title":"Neural abstractive text summarization with sequence-to-sequence models","volume":"2","author":"Shi","year":"2021","journal-title":"ACM Trans. Data Sci."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ertam, F., and Aydin, G. (2021). Abstractive text summarization using deep learning with a new Turkish summarization benchmark dataset. Concurr. Comput. Pract. Exp., e6482.","DOI":"10.1002\/cpe.6482"},{"key":"ref_51","first-page":"187","article-title":"Exploring correlation between ROUGE and human evaluation on meeting summaries","volume":"18","author":"Liu","year":"2009","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kryscinski, W., Keskar, N.S., McCann, B., Xiong, C., and Socher, R. (2019). Neural text summarization: A critical evaluation. arXiv.","DOI":"10.18653\/v1\/D19-1051"},{"key":"ref_53","unstructured":"Lin, C.Y. (2004, January 24\u201325). Rouge: A package for automatic evaluation of summaries. Proceedings of the Text Summarization Branches Out: Proceedings of the ACL-04 Workshop, Barcelona, Spain."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 7\u201312). Bleu: A method for automatic evaluation of machine translation. Proceedings of the 40th annual meeting of the Association for Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073135"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Bodrunova, S.S., Orekhov, A.V., Blekanov, I.S., Lyudkevich, N.S., and Tarasov, N.A. (2020). Topic detection based on sentence embeddings and agglomerative clustering with Markov moment. Future Internet, 12.","DOI":"10.3390\/fi12090144"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Burgess, J., Marwick, A., and Poell, T. (2018). The Affordances of Social Media Platforms. The SAGE Handbook of Social Media, Sage Publications.","DOI":"10.4135\/9781473984066"},{"key":"ref_57","first-page":"19","article-title":"The ideal topic: Interdependence of topic interpretability and other quality features in topic modelling for short texts","volume":"Volume 12194","author":"Blekanov","year":"2020","journal-title":"Proceedings of the International Conference on Human-Computer Interaction (HCI International 2020)"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Li, Q., and Zhang, Q. (2020, January 20\u201324). Abstractive event summarization on twitter. Proceedings of the Companion Proceedings of the Web Conference, Taipei, Taiwan.","DOI":"10.1145\/3366424.3382678"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.osnem.2018.11.001","article-title":"Where should one get news updates: Twitter or Reddit","volume":"9","author":"Priya","year":"2019","journal-title":"Online Soc. Netw. Media"},{"key":"ref_60","first-page":"267","article-title":"A global public sphere of compassion? #JeSuisCharlie and #JeNeSuisPasCharlie on Twitter and their language boundaries","volume":"1","author":"Bodrunova","year":"2018","journal-title":"Monit. Obs. Mneniya Ekon. i Sotsial\u2019nye Peremeny"},{"key":"ref_61","first-page":"20563051211063470","article-title":"Social Media and Political Dissent in Russia and Belarus: An Introduction to the Special Issue","volume":"7","author":"Bodrunova","year":"2021","journal-title":"Soc. Media Soc."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Hong, L., Ahmed, A., Gurumurthy, S., Smola, A.J., and Tsioutsiouliklis, K. (2012, January 16\u201320). Discovering geographical topics in the twitter stream. Proceedings of the 21st International Conference on World Wide Web, Lyon, France.","DOI":"10.1145\/2187836.2187940"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T. (2016). Bag of tricks for efficient text classification. arXiv.","DOI":"10.18653\/v1\/E17-2068"},{"key":"ref_64","first-page":"221","article-title":"Global Agendas: Detection of Agenda Shifts in Cross-National Discussions Using Neural-Network Text Summarization for Twitter","volume":"Volume 12774","author":"Bodrunova","year":"2021","journal-title":"Proceedings of the International Conference on Human-Computer Interaction (HCI International 2021)"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1162\/coli_a_00417","article-title":"Abstractive Text Summarization: Enhancing Sequence-to-Sequence Models Using Word Sense Disambiguation and Semantic Content Generalization","volume":"47","author":"Kouris","year":"2021","journal-title":"Comput. Linguist."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Nguyen, T., Luu, A.T., Lu, T., and Quan, T. (2021). Enriching and controlling global semantics for text summarization. arXiv.","DOI":"10.18653\/v1\/2021.emnlp-main.744"},{"key":"ref_67","unstructured":"Zheng, C., Zhang, K., Wang, H.J., and Fan, L. (2020). Topic-Aware Abstractive Text Summarization. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Wang, Z., Duan, Z., Zhang, H., Wang, C., Tian, L., Chen, B., and Zhou, M. (2020, January 16\u201320). Friendly topic assistant for transformer based abstractive summarization. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtual.","DOI":"10.18653\/v1\/2020.emnlp-main.35"},{"key":"ref_69","unstructured":"Ailem, M., Zhang, B., and Sha, F. (2020). Topic augmented generator for abstractive summarization. arXiv."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/3\/69\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:26:06Z","timestamp":1760135166000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/3\/69"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,23]]},"references-count":69,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["fi14030069"],"URL":"https:\/\/doi.org\/10.3390\/fi14030069","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,23]]}}}