{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T16:44:06Z","timestamp":1789145046849,"version":"build-2803163510"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,6,29]],"date-time":"2024-06-29T00:00:00Z","timestamp":1719619200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,29]],"date-time":"2024-06-29T00:00:00Z","timestamp":1719619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Effective summarization of long documents is a challenging task. When addressing this challenge, Graph and Cluster-Based methods stand out as effective unsupervised solutions. Graph-Based Unsupervised methods are widely employed for summarization due to their success in identifying relationships within documents. Cluster-Based methods excel in minimizing redundancy by grouping similar content together before generating a concise summary. Therefore, this paper merges Cluster-Based and Graph-Based methods by applying language models for Unsupervised Extractive Summarization of long documents. The approach simultaneously extracts key information while minimizing redundancy. First, we use BERT-based sentence embeddings to create sentence clusters using <jats:italic>k<\/jats:italic>-means clustering and select the optimum number of clusters using the elbow method to ensure that sentences are categorized based on their semantic similarities. Then, the TextRank algorithm is employed within each cluster to rank sentences based on their importance and representativeness. Finally, the total similarity score of the graph is used to rank the clusters and eliminate less important sentence groups. Our method achieves comparable or better summary quality and reduced redundancy compared to both individual Cluster-Based and Graph-Based methods, as well as other supervised and Unsupervised baseline models across diverse datasets.<\/jats:p>","DOI":"10.1007\/s10462-024-10828-w","type":"journal-article","created":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T19:02:15Z","timestamp":1719860535000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Graphs in clusters: a hybrid approach to unsupervised extractive long document summarization using language models"],"prefix":"10.1007","volume":"57","author":[{"given":"Tuba","family":"Gokhan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Malcolm James","family":"Price","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,29]]},"reference":[{"key":"10828_CR9","unstructured":"Agarwal N, Gvr K, Reddy RS, Ros\u00e9 CP (2011) Scisumm: A multi-document summarization system for scientific articles. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Systems Demonstrations. HLT \u201911, pp. 115\u2013120. Association for Computational Linguistics, USA"},{"key":"10828_CR12","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.12340","author":"R Alguliyev","year":"2019","unstructured":"Alguliyev R, Aliguliyev R, Isazade N, Abdi A, Idris N (2019) Cosum: text summarization based on clustering and optimization. Exp Syst. https:\/\/doi.org\/10.1111\/exsy.12340","journal-title":"Exp Syst"},{"key":"10828_CR30","doi-asserted-by":"publisher","unstructured":"Bommasani R, Cardie C (2020) Intrinsic evaluation of summarization datasets. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 8075\u20138096. Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.649 . https:\/\/aclanthology.org\/2020.emnlp-main.649","DOI":"10.18653\/v1\/2020.emnlp-main.649"},{"key":"10828_CR35","unstructured":"Chen C-Y, Ye F (2012) Particle swarm optimization algorithm and its application to clustering analysis. In: 2012 Proceedings of 17th Conference on Electrical Power Distribution, pp. 789\u2013794"},{"key":"10828_CR10","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.future.2013.07.018","volume":"32","author":"J Chen","year":"2014","unstructured":"Chen J, Zhuge H (2014) Summarization of scientific documents by detecting common facts in citations. Future Gener Comput Syst 32:246\u2013252. https:\/\/doi.org\/10.1016\/j.future.2013.07.018","journal-title":"Future Gener Comput Syst"},{"key":"10828_CR25","doi-asserted-by":"publisher","unstructured":"Cohan A, Dernoncourt F, Kim DS, Bui T, Kim S, Chang W, Goharian N (2018) A discourse-aware attention model for abstractive summarization of long documents. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 615\u2013621. Association for Computational Linguistics, New Orleans, Louisiana. https:\/\/doi.org\/10.18653\/v1\/N18-2097 . https:\/\/aclanthology.org\/N18-2097","DOI":"10.18653\/v1\/N18-2097"},{"key":"10828_CR15","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171\u20134186. Association for Computational Linguistics, Minneapolis, Minnesota. https:\/\/doi.org\/10.18653\/v1\/N19-1423 . https:\/\/www.aclweb.org\/anthology\/N19-1423","DOI":"10.18653\/v1\/N19-1423"},{"key":"10828_CR18","doi-asserted-by":"publisher","unstructured":"Dong Y, Mircea A, Cheung JCK (2021) Discourse-Aware Unsupervised Summarization for Long Scientific Documents. In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pp. 1089\u20131102. Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2021.eacl-main.93 . https:\/\/aclanthology.org\/2021.eacl-main.93","DOI":"10.18653\/v1\/2021.eacl-main.93"},{"key":"10828_CR5","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1613\/jair.1523","volume":"22","author":"G Erkan","year":"2004","unstructured":"Erkan G, Radev DR (2004) Lexrank: graph-based lexical centrality as salience in text summarization. J Artif Intell Res 22:457\u2013479","journal-title":"J Artif Intell Res"},{"key":"10828_CR20","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/978-3-031-35320-8_21","volume-title":"Natural language processing and information systems","author":"T Gokhan","year":"2023","unstructured":"Gokhan T, Smith P, Lee M (2023) Node-weighted centrality ranking for unsupervised long document summarization. In: M\u00e9tais E, Meziane F, Sugumaran V, Manning W, Reiff-Marganiec S (eds) Natural language processing and information systems. Springer, Cham, pp 299\u2013312. https:\/\/doi.org\/10.1007\/978-3-031-35320-8_21"},{"key":"10828_CR19","unstructured":"Gokhan T, Smith P, Lee M (2022) GUSUM: Graph-based unsupervised summarization using sentence features scoring and sentence-BERT. In: Proceedings of TextGraphs-16: Graph-based Methods for Natural Language Processing, pp. 44\u201353. Association for Computational Linguistics, Gyeongju, Republic of Korea. https:\/\/aclanthology.org\/2022.textgraphs-1.5"},{"issue":"1","key":"10828_CR22","first-page":"100","volume":"28","author":"JA Hartigan","year":"1979","unstructured":"Hartigan JA, Wong MA (1979) Algorithm as 136: A k-means clustering algorithm. J Royal Stat Soc 28(1):100\u2013108","journal-title":"J Royal Stat Soc"},{"key":"10828_CR24","doi-asserted-by":"publisher","DOI":"10.1145\/3545176","author":"HY Koh","year":"2022","unstructured":"Koh HY, Ju J, Liu M, Pan S (2022) An empirical survey on long document summarization: Datasets, models, and metrics. ACM Comput Surv. https:\/\/doi.org\/10.1145\/3545176","journal-title":"ACM Comput Surv"},{"key":"10828_CR17","doi-asserted-by":"publisher","unstructured":"Liang X, Wu S, Li M, Li Z (2021) Improving unsupervised extractive summarization with facet-aware modeling. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 1685\u20131697. Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2021.findings-acl.147 . https:\/\/aclanthology.org\/2021.findings-acl.147","DOI":"10.18653\/v1\/2021.findings-acl.147"},{"key":"10828_CR26","doi-asserted-by":"crossref","unstructured":"Lin C-Y, Hovy E (2003) Automatic evaluation of summaries using n-gram co-occurrence statistics. In: Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pp. 150\u2013157. https:\/\/aclanthology.org\/N03-1020","DOI":"10.3115\/1073445.1073465"},{"key":"10828_CR6","doi-asserted-by":"publisher","unstructured":"Liu J, Hughes DJD, Yang Y (2021) Unsupervised Extractive Text Summarization with Distance-Augmented Sentence Graphs, pp. 2313\u20132317. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3404835.3463111","DOI":"10.1145\/3404835.3463111"},{"key":"10828_CR14","unstructured":"Mihalcea R, Tarau P (2004) TextRank: Bringing order into text. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pp. 404\u2013411. Association for Computational Linguistics, Barcelona, Spain. https:\/\/aclanthology.org\/W04-3252"},{"key":"10828_CR13","unstructured":"Miller D (2019) Leveraging BERT for extractive text summarization on lectures"},{"issue":"8","key":"10828_CR33","doi-asserted-by":"publisher","first-page":"825","DOI":"10.1016\/0167-8655(96)00043-8","volume":"17","author":"CA Murthy","year":"1996","unstructured":"Murthy CA, Chowdhury N (1996) In search of optimal clusters using genetic algorithms. Pattern Recognit Lett 17(8):825\u2013832. https:\/\/doi.org\/10.1016\/0167-8655(96)00043-8","journal-title":"Pattern Recognit Lett"},{"issue":"1","key":"10828_CR23","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1361\/1\/012015","volume":"1361","author":"R Nainggolan","year":"2019","unstructured":"Nainggolan R, Perangin-angin R, Simarmata E, Tarigan AF (2019) Improved the performance of the k-means cluster using the sum of squared error (sse) optimized by using the elbow method. J Phys 1361(1):012015. https:\/\/doi.org\/10.1088\/1742-6596\/1361\/1\/012015","journal-title":"J Phys"},{"key":"10828_CR27","doi-asserted-by":"publisher","unstructured":"Nallapati R, Zhai F, Zhou B (2017) Summarunner: A recurrent neural network based sequence model for extractive summarization of documents. Proceedings of the AAAI Conference on Artificial Intelligence 31(1) https:\/\/doi.org\/10.1609\/aaai.v31i1.10958","DOI":"10.1609\/aaai.v31i1.10958"},{"key":"10828_CR3","doi-asserted-by":"publisher","unstructured":"Nallapati R, Zhou B, Santos C, Gul\u00e7ehre \u00c7, Xiang B (2016) Abstractive text summarization using sequence-to-sequence RNNs and beyond. In: Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pp. 280\u2013290. Association for Computational Linguistics, Berlin, Germany. https:\/\/doi.org\/10.18653\/v1\/K16-1028 . https:\/\/aclanthology.org\/K16-1028","DOI":"10.18653\/v1\/K16-1028"},{"key":"10828_CR8","doi-asserted-by":"publisher","unstructured":"Pawar S, Manjula Gururaj H, Chiplunar NN (2022) Text summarization using document and sentence clustering. Procedia Computer Science 215, 361\u2013369 . 4th International Conference on Innovative Data Communication Technology and Application https:\/\/doi.org\/10.1016\/j.procs.2022.12.038","DOI":"10.1016\/j.procs.2022.12.038"},{"key":"10828_CR31","doi-asserted-by":"publisher","unstructured":"Peyrard M, Botschen T, Gurevych I (2017) Learning to score system summaries for better content selection evaluation. In: Proceedings of the Workshop on New Frontiers in Summarization, pp. 74\u201384. Association for Computational Linguistics, Copenhagen, Denmark. https:\/\/doi.org\/10.18653\/v1\/W17-4510 . https:\/\/aclanthology.org\/W17-4510","DOI":"10.18653\/v1\/W17-4510"},{"key":"10828_CR29","doi-asserted-by":"publisher","unstructured":"Pilault J, Li R, Subramanian S, Pal C (2020) On extractive and abstractive neural document summarization with transformer language models. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 9308\u20139319. Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.748 . https:\/\/aclanthology.org\/2020.emnlp-main.748","DOI":"10.18653\/v1\/2020.emnlp-main.748"},{"key":"10828_CR7","doi-asserted-by":"crossref","unstructured":"Qazvinian V, Radev DR (2008) Scientific paper summarization using citation summary networks. In: Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pp. 689\u2013696. Coling 2008 Organizing Committee, Manchester, UK . https:\/\/aclanthology.org\/C08-1087","DOI":"10.3115\/1599081.1599168"},{"issue":"4","key":"10828_CR1","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1162\/089120102762671927","volume":"28","author":"DR Radev","year":"2002","unstructured":"Radev DR, Hovy E, McKeown K (2002) Introduction to the special issue on summarization. Comput Linguist 28(4):399\u2013408. https:\/\/doi.org\/10.1162\/089120102762671927","journal-title":"Comput Linguist"},{"key":"10828_CR21","doi-asserted-by":"publisher","unstructured":"Reimers N, Gurevych I (2019) Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3982\u20133992. Association for Computational Linguistics, Hong Kong, Chinahttps:\/\/doi.org\/10.18653\/v1\/D19-1410 . https:\/\/aclanthology.org\/D19-1410","DOI":"10.18653\/v1\/D19-1410"},{"issue":"2","key":"10828_CR34","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.aca.2003.12.032","volume":"509","author":"PS Shelokar","year":"2004","unstructured":"Shelokar PS, Jayaraman VK, Kulkarni BD (2004) An ant colony approach for clustering. Anal Chimica Acta 509(2):187\u2013195. https:\/\/doi.org\/10.1016\/j.aca.2003.12.032","journal-title":"Anal Chimica Acta"},{"key":"10828_CR2","doi-asserted-by":"crossref","unstructured":"Vilca GCV, Cabezudo MAS (2017) A study of abstractive summarization using semantic representations and discourse level information. In: International Conference on Text, Speech, and Dialogue. Springer, pp. 482\u2013490","DOI":"10.1007\/978-3-319-64206-2_54"},{"key":"10828_CR11","doi-asserted-by":"publisher","unstructured":"Wang Z, Ma L, Zhang Y (2016) A novel method for document summarization using word2vec. In: 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC), pp. 523\u2013529 . https:\/\/doi.org\/10.1109\/ICCI-CC.2016.7862087","DOI":"10.1109\/ICCI-CC.2016.7862087"},{"key":"10828_CR28","doi-asserted-by":"publisher","unstructured":"Xiao W, Carenini G (2019) Extractive summarization of long documents by combining global and local context. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3011\u20133021. Association for Computational Linguistics, Hong Kong, China. https:\/\/doi.org\/10.18653\/v1\/D19-1298 . https:\/\/aclanthology.org\/D19-1298","DOI":"10.18653\/v1\/D19-1298"},{"key":"10828_CR32","unstructured":"Xiao W, Carenini G (2020) Systematically exploring redundancy reduction in summarizing long documents. In: Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pp. 516\u2013528. Association for Computational Linguistics, Suzhou, China. https:\/\/aclanthology.org\/2020.aacl-main.51"},{"key":"10828_CR16","doi-asserted-by":"publisher","unstructured":"Xu S, Zhang X, Wu Y, Wei F, Zhou M (2020) Unsupervised extractive summarization by pre-training hierarchical transformers. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 1784\u20131795. Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2020.findings-emnlp.161 . https:\/\/aclanthology.org\/2020.findings-emnlp.161","DOI":"10.18653\/v1\/2020.findings-emnlp.161"},{"key":"10828_CR4","doi-asserted-by":"publisher","unstructured":"Zheng H, Lapata M (2019) Sentence Centrality Revisited for Unsupervised Summarization. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 6236\u20136247. Association for Computational Linguistics, Stroudsburg, PA, USA. https:\/\/doi.org\/10.18653\/v1\/P19-1628","DOI":"10.18653\/v1\/P19-1628"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10828-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10828-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10828-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T10:33:27Z","timestamp":1721039607000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10828-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,29]]},"references-count":35,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["10828"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10828-w","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,29]]},"assertion":[{"value":"6 June 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"189"}}