{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:32:46Z","timestamp":1777703566899,"version":"3.51.4"},"reference-count":26,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2018,5,18]],"date-time":"2018-05-18T00:00:00Z","timestamp":1526601600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2018,5,24]]},"abstract":"<jats:p>In this paper we study how the presence or absence of redundancy on multiple related texts can be used to compute sentence relevance for extractive multi-document summarization. Two types of redundancy can be found: intra-document and inter-document. By experimenting with them, different ideas can be extracted, for example: statements redundant between documents\u2014which can be important by their popularity; statements that are not redundant\u2014which can be important by their novelty; or statements redundant within each document\u2014which can be important by being constantly addressed by a single author. We propose an unsupervised graph-based method that allows to generate summaries based on different strategies of redundancy. We present experiments on two DUC corpora of nine different strategies to extract information depending of how redundancy within a document and in different documents is managed. According to DUC gold standards, we found that a multi-document generic summary should contain the most redundant (popular) information between different sources while avoiding local intra-document redundancy. We implemented a mechanism to enrich sentence rankings with redundancy, improving the evaluation of summaries.<\/jats:p>","DOI":"10.3233\/jifs-169507","type":"journal-article","created":{"date-parts":[[2018,5,22]],"date-time":"2018-05-22T10:54:34Z","timestamp":1526986474000},"page":"3245-3255","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["On redundancy in multi-document summarization"],"prefix":"10.1177","volume":"34","author":[{"given":"Hiram","family":"Calvo","sequence":"first","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n, Instituto Polit\u00e9cnico Nacional, Mexico City, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pabel","family":"Carrillo-Mendoza","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n, Instituto Polit\u00e9cnico Nacional, Mexico City, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Gelbukh","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n, Instituto Polit\u00e9cnico Nacional, Mexico City, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2018,5,18]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"112","article-title":"Removal of redundancy in documents retrieved from dierent resources","author":"Bourbakis N.","year":"1998","unstructured":"BourbakisN., MengW., WuZ., SalernoJ. and BorekS., Removal of redundancy in documents retrieved from dierent resources, Proceedings of IC-TAI 1998, 10th IEEE International Conference on Tools with Articial Intelligence (1998), 112\u2013119.","journal-title":"Proceedings of IC-TAI 1998, 10th IEEE International Conference on Tools with Articial Intelligence"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(95)00052-I"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24033-6_29"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0689-8"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2015.11.004"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291025"},{"key":"e_1_3_2_9_2","first-page":"815","article-title":"A hybrid hierarchical model for multi-document summarization","author":"Celikyilmaz A.","year":"2010","unstructured":"CelikyilmazA. and Hakkani-TurD., A hybrid hierarchical model for multi-document summarization, Proceedings of ACL 2010, 48th Annual Meeting of the Association for Computational Linguistics (2010), 815\u2013824.","journal-title":"Proceedings of ACL 2010, 48th Annual Meeting of the Association for Computational Linguistics"},{"key":"e_1_3_2_10_2","first-page":"911","volume-title":"Proceedings of COLING 2012, 24th International Conference on Computational Linguistics","author":"Galanis D.","year":"2012","unstructured":"GalanisD., LampourasG. and AndroutsopoulosI., Extractive multi-document summarization with integer linear programming and support vector regression, in pp, Proceedings of COLING 2012, 24th International Conference on Computational Linguistics (2012), 911\u2013926."},{"key":"e_1_3_2_11_2","first-page":"144","volume-title":"Proceedings of RANLP 2009, 7th conference on Recent Advances in Natural Language Processing","author":"Hennig L.","year":"2009","unstructured":"HennigL., Topic-based multi-document summarization with probabilistic latent semantic analysis, Proceedings of RANLP 2009, 7th conference on Recent Advances in Natural Language Processing (2009), 144\u2013149."},{"key":"e_1_3_2_12_2","first-page":"1188","volume-title":"Proceedings of ICML 2014, 31st International Conference on Machine Learning","author":"Le Q.","year":"2014","unstructured":"LeQ. and MikolovT., Distributed representations of sentences and documents, Proceedings of ICML 2014, 31st International Conference on Machine Learning (2014), 1188\u20131196."},{"key":"e_1_3_2_13_2","first-page":"1197","volume-title":"Proceedings of COLING 2014, 25th International Conference on Computational Linguistics","author":"Li Y.","year":"2014","unstructured":"LiY. and LiS., Query-focused multi-document summarization: Combining a topic model with graph-based semi-supervised learning, Proceedings of COLING 2014, 25th International Conference on Computational Linguistics (2014), 1197\u20131207."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00123"},{"key":"e_1_3_2_15_2","first-page":"404","volume-title":"Proceedings of EMNLP 2004, 9th conference on Empirical Methods in Natural Language Processing","volume":"4","author":"Mihalcea R.","year":"2004","unstructured":"MihalceaR. and TarauP., TextRank: Bringing order into texts, Proceedings of EMNLP 2004, 9th conference on Empirical Methods in Natural Language Processing4(4) (2004), 404\u2013411."},{"key":"e_1_3_2_16_2","first-page":"19","volume-title":"Proceedings of IJCNLP 2005, 2nd International Join Conference on Natural Language Processing","author":"Mihalcea R.","year":"2005","unstructured":"MihalceaR. and TarauP., A language independent algorithm for single and multiple document summarization, Proceedings of IJCNLP 2005, 2nd International Join Conference on Natural Language Processing (2005), 19\u201324."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2010.03.005"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3703"},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of DUC 2007, 7th Document Understanding Conference","author":"Pingali P.","year":"2007","unstructured":"PingaliP., KR. and VarmaV., IIIT hyderabad at DUC in 2007, Proceedings of DUC 2007, 7th Document Understanding Conference (2007)."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.01.030"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2003.10.006"},{"key":"e_1_3_2_22_2","unstructured":"SaggionH. Torres-MorenoJ.-M. CunhaI.D. and SanJuanE. Multilingual summarization evaluation without human models in; Posters Proceedings of the 23rd International Conference on Computational Linguistics (2010) 1059\u20131067."},{"key":"e_1_3_2_23_2","first-page":"984","volume-title":"Proceedings of COL-ING 2010, 23rd International Conference on Computational Linguistics 2","author":"Shen C.","year":"2010","unstructured":"ShenC. and LiT., Multi-document summarization via the minimum dominating set, Proceedings of COL-ING 2010, 23rd International Conference on Computational Linguistics 2 (2010), 984\u2013992."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1998.0699"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.17562\/PB-42-2"},{"key":"e_1_3_2_26_2","unstructured":"ToutanovaK. BrockettC. GamonM. Jagarla-mudiJ. SuzukiH. and VanderwendeL. The PYTHY summarization system: Microsoft research at DUC Proceedings of DUC 2007 7th Document Understanding Conference (2007)."},{"key":"e_1_3_2_27_2","first-page":"2977","volume-title":"Proceedings of COLING 2012, 24th","author":"Yin W.","year":"2012","unstructured":"YinW., PeiY., ZhangF. and HuangL., SentTopic-MultiRank: A novel ranking model for multi-document summarization, in}} International Conference on Computational Linguistics, Proceedings of COLING 2012, 24th (2012), 2977\u20132992."}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169507","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-169507","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:39:00Z","timestamp":1777455540000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-169507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,18]]},"references-count":26,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2018,5,24]]}},"alternative-id":["10.3233\/JIFS-169507"],"URL":"https:\/\/doi.org\/10.3233\/jifs-169507","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,18]]}}}