{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T06:32:12Z","timestamp":1764311532397,"version":"3.46.0"},"reference-count":50,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T00:00:00Z","timestamp":1764288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Summarization of texts have been considered as essential practice nowadays with the careful presentation of the main ideas of a text. The current study aims to provide a methodology of summarizing complex texts such as argumentative discourse. Extractive and abstractive summarization techniques have recently gained significant attention. Each has its own limitations that reduce efficiency in the coverage of the main points of the summary, but by combining them, we can use the positive points of each to improve both summarization performance and summary generation quality. This paper presents a novel extractive-abstractive text summarization method that ensures coverage of the main points of the entire text. It is based on combining Bidirectional Encoder Representations from Transformers (BERT) and transfer learning. Using a dataset comprising two UK parliamentary debates, the study shows that the proposed method effectively summarizes the main points. Comparing extractive and abstractive summarization, the experiment used Recall-Oriented Understudy for Gisting Evaluation (ROUGE) sets of metrics and achieved scores of 30.1, 9.60, and 27.9 for the first debate, and 36.2, 11.80, and 31.5 for the second, using ROUGE-1, ROUGE-2, and ROUGE-L metrics, respectively.<\/jats:p>","DOI":"10.3389\/frai.2025.1654496","type":"journal-article","created":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T06:27:53Z","timestamp":1764311273000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Text summarization method of argumentative discourse by combining the BERT-transformer model"],"prefix":"10.3389","volume":"8","author":[{"given":"Yaser","family":"Altameemi","sequence":"first","affiliation":[]},{"given":"Mohammed","family":"Altamimi","sequence":"additional","affiliation":[]},{"given":"Adel","family":"Alkhalil","sequence":"additional","affiliation":[]},{"given":"Diaa","family":"Uliyan","sequence":"additional","affiliation":[]},{"given":"Romany F.","family":"Mansour","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,11,28]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-030-34614-0_1","article-title":"Text summarization: a brief review","volume-title":"Recent advances in NLP: The case of Arabic language","author":"Abualigah","year":"2020"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.procs.2017.10.088","article-title":"Automatic Arabic summarization: a survey of methodologies and systems","volume":"117","author":"Al Qassem","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.argmining-1.19","article-title":"Key point analysis via contrastive learning and extractive argument summarization","author":"Alshomary","year":"2021","journal-title":"ArXiv"},{"key":"ref4","volume-title":"Defining \u201cIntervention\u201d: A comparative study of UK parliamentary responses to the Syrian crisis -ORCA","author":"Altameemi","year":"2020"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"26","DOI":"10.5815\/ijisa.2017.11.04","article-title":"Document summarization using TextRank and semantic network","volume":"1","author":"Ashari","year":"2017","journal-title":"Int. J. Intell. Syst. Appl."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"903","DOI":"10.1016\/j.ipm.2018.06.002","article-title":"An abstractive Arabic text summarizer with user controlled granularity","volume":"54","author":"Azmi","year":"2018","journal-title":"Inf. Process. Manag."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1177\/0957926508088962","article-title":"A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press","volume":"19","author":"Baker","year":"2008","journal-title":"Discourse Soc."},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2004.05150","article-title":"Longformer: the long-document transformer","author":"Beltagy","year":"2020","journal-title":"ArXiv"},{"key":"ref9","doi-asserted-by":"crossref","DOI":"10.1109\/IAEAC50856.2021.9390683","article-title":"News text summarization method based on bart-textrank model","author":"Chen","year":"2021"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.109","article-title":"Structure-aware abstractive conversation summarization via discourse and action graphs","author":"Chen","year":"2021","journal-title":"ArXiv"},{"key":"ref11","doi-asserted-by":"crossref","DOI":"10.4324\/9780203561218","volume-title":"Analysing political discourse: Theory and practice","author":"Chilton","year":"2004"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.procs.2017.10.003","article-title":"Automatic debate text summarization in online debate forum","volume":"116","author":"Chowanda","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref13","doi-asserted-by":"crossref","DOI":"10.1109\/ICMI60790.2024.10585622","article-title":"Advanced generative AI methods for academic text summarization","author":"Dar","year":"2024"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1007\/978-3-031-76710-4_16","article-title":"Text summarization: an application of generative AI","volume-title":"Generative artificial intelligence (AI) approaches for industrial applications","author":"Das","year":"2025"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.04805","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018","journal-title":"ArXiv"},{"key":"ref16","first-page":"1361","article-title":"Legal summarization for multi-role debate dialogue via controversy focus mining and multi-task learning","author":"Duan","year":"2019"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"113679","DOI":"10.1016\/J.ESWA.2020.113679","article-title":"Automatic text summarization: a comprehensive survey","volume":"165","author":"El-Kassas","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1613\/jair.1523","article-title":"Lexrank: graph-based lexical centrality as salience in text summarization","volume":"22","author":"Erkan","year":"2004","journal-title":"J. Artif. Intell. Res."},{"key":"ref19","volume-title":"Political discourse analysis: A method for advanced students","author":"Fairclough","year":"2012"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1007\/s10489-013-0490-0","article-title":"A hybrid machine learning model for multi-document summarization","volume":"40","author":"Fattah","year":"2014","journal-title":"Appl. Intell."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"5755","DOI":"10.1016\/j.eswa.2013.04.023","article-title":"Assessing sentence scoring techniques for extractive text summarization","volume":"40","author":"Ferreira","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1075\/jlp.11.1.02for","article-title":"Critique and argumentation: on the relation between the discourse-historical approach and pragma-dialectics","volume":"11","author":"Forchtner","year":"2012","journal-title":"J. Lang. Polit."},{"key":"ref23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-016-9475-9","article-title":"Recent automatic text summarization techniques: a survey","volume":"47","author":"Gambhir","year":"2017","journal-title":"Artif. Intell. Rev."},{"key":"ref24","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.18653\/v1\/2022.emnlp-main.73","article-title":"Zero-shot text classification with self-training","volume-title":"Proceedings of the 2022 conference on empirical methods in natural language processing, (Abu Dhabi: EMNLP)","author":"Gera","year":"2022"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-5409","article-title":"SAMSum corpus: a human-annotated dialogue dataset for abstractive summarization","author":"Gliwa","year":"2019","journal-title":"ArXiv"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"258","DOI":"10.4304\/jetwi.2.3.258-268","article-title":"A survey of text summarization extractive techniques","volume":"2","author":"Gupta","year":"2010","journal-title":"J. Emerg. Technol. Web Intell."},{"key":"ref27","first-page":"31","article-title":"Random forest classifier based multi-document summarization system","volume-title":"2013 IEEE recent advances in intelligent computational systems (Trivandrum: RAICS)","author":"John","year":"2013"},{"key":"ref28","volume-title":"Abstractive","author":"Kouris","year":"2022"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1177\/1750481309337208","article-title":"Organizational decision-making, discourse, and power: integrating across contexts and scales","volume":"3","author":"Kwon","year":"2009","journal-title":"Discourse Commun."},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1910.13461","article-title":"BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension","author":"Lewis","year":"2019","journal-title":"ArXiv"},{"key":"ref31","volume-title":"Looking for a few good metrics: Automatic summarization evaluation-how many samples are enough?","author":"Lin","year":""},{"key":"ref32","first-page":"74","volume-title":"Rouge: A package for automatic evaluation of summaries","author":"Lin","year":""},{"key":"ref33","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1016\/J.ESWA.2019.05.011","article-title":"Extractive summarization using supervised and unsupervised learning","volume":"133","author":"Mao","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref34","first-page":"404","article-title":"TextRank: bringing order into text","author":"Mihalcea","year":"2004"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1906.04165","article-title":"Leveraging BERT for extractive text summarization on lectures","author":"Miller","year":"2019","journal-title":"ArXiv"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1602.06023","article-title":"Abstractive text summarization using sequence-to-sequence RNNs and beyond","author":"Nallapati","year":"","journal-title":"ArXiv"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1611.04244","article-title":"Neural architectures for extractive document summarization","author":"Nallapati","year":"","journal-title":"ArXiv"},{"key":"ref38","first-page":"1949","article-title":"Topical coherence for graph-based extractive summarization","author":"Parveen","year":"2015"},{"key":"ref39","first-page":"9308","article-title":"On extractive and abstractive neural document summarization with transformer language models","author":"Pilault","year":"2020"},{"key":"ref40","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI Blog"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2011.07251","article-title":"DebateSum: a large-scale argument mining and summarization dataset","author":"Roush","year":"2020","journal-title":"ArXiv"},{"key":"ref42","first-page":"200","article-title":"Using domain knowledge for text summarization in medical domain","volume":"1","author":"Sarkar","year":"2009","journal-title":"Int. J. Recent Trends Eng."},{"key":"ref43","doi-asserted-by":"publisher","first-page":"128255","DOI":"10.1016\/J.NEUCOM.2024.128255","article-title":"Abstractive text summarization: state of the art, challenges, and improvements","volume":"603","author":"Shakil","year":"2024","journal-title":"Neurocomputing"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1177\/0957926517734425","article-title":"Understanding political discourses about Europe: a multilevel contextual approach to discourse","volume":"29","author":"Trimithiotis","year":"2018","journal-title":"Discourse Soc."},{"key":"ref45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/1566890","article-title":"Abstractive Arabic text summarization based on deep learning","volume":"2022","author":"Wazery","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"ref46","doi-asserted-by":"publisher","first-page":"1029","DOI":"10.1016\/J.JKSUCI.2020.05.006","article-title":"Review of automatic text summarization techniques & methods","volume":"34","author":"Widyassari","year":"2022","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref47","volume-title":"The discourse of politics in action: Politics as usual","author":"Wodak","year":"2009"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"133981","DOI":"10.1109\/ACCESS.2022.3231016","article-title":"Feature based automatic text summarization methods: a comprehensive state-of-the-art survey","volume":"10","author":"Yadav","year":"2022","journal-title":"IEEE Access"},{"key":"ref49","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.eswa.2016.10.017","article-title":"Text summarization using unsupervised deep learning","volume":"68","author":"Yousefi-Azar","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref50","doi-asserted-by":"crossref","first-page":"3270","DOI":"10.18653\/v1\/2023.findings-emnlp.214","article-title":"Extractive summarization via ChatGPT for faithful summary generation","volume-title":"Findings of the association for computational linguistics: EMNLP","author":"Zhang","year":"2023"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1654496\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T06:27:57Z","timestamp":1764311277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1654496\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,28]]},"references-count":50,"alternative-id":["10.3389\/frai.2025.1654496"],"URL":"https:\/\/doi.org\/10.3389\/frai.2025.1654496","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,28]]},"article-number":"1654496"}}