{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:35:49Z","timestamp":1777703749208,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2018,7,4]],"date-time":"2018-07-04T00:00:00Z","timestamp":1530662400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2018,7,27]]},"abstract":"<jats:p>In the last 16 years with the existence of Document Understanding Conference (DUC), several methods have been developed in Automatic Extractive Text Summarization (AETS) that have allowed the continuous improvement of this task. However, no significant analysis has been performed to determine the significance of the AETS methods. In this paper, we present a new method based on a Genetic Algorithm to determine the best sentence combination of DUC01 and DUC02 datasets to rank the newest methods of AETS. Using three heuristics presented in the state-of-the-art, we rank the most recent AETS methods, obtaining upper bounds and recovering lower bounds of the state-of-the-art.<\/jats:p>","DOI":"10.3233\/jifs-169588","type":"journal-article","created":{"date-parts":[[2018,7,6]],"date-time":"2018-07-06T11:58:54Z","timestamp":1530878334000},"page":"293-304","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":13,"title":["Calculating the significance of automatic extractive text summarization using a genetic algorithm"],"prefix":"10.1177","volume":"35","author":[{"given":"Jonathan Rojas","family":"Sim\u00f3n","sequence":"first","affiliation":[{"name":"Universidad Aut\u00f3noma del Estado de M\u00e9xico, Unidad Acad\u00e9mica Profesional Tianguistenco, Instituto Literario, CP, Toluca, Edo. Mex, M\u00e9xico"}]},{"given":"Yulia","family":"Ledeneva","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma del Estado de M\u00e9xico, Unidad Acad\u00e9mica Profesional Tianguistenco, Instituto Literario, CP, Toluca, Edo. Mex, M\u00e9xico"}]},{"given":"Ren\u00e9 Arnulfo","family":"Garc\u00eda-Hern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma del Estado de M\u00e9xico, Unidad Acad\u00e9mica Profesional Tianguistenco, Instituto Literario, CP, Toluca, Edo. Mex, M\u00e9xico"}]}],"member":"179","published-online":{"date-parts":[[2018,7,4]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44874-8"},{"key":"e_1_3_1_3_2","unstructured":"LouisA. JoshiA. and NenkovaA. Discourse indicators for content selection in summarization 11th Annu Meet Spec Interes Gr Discourse Dialogue (2010) pp. 147\u2013156."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.3115\/980845.980856"},{"key":"e_1_3_1_5_2","unstructured":"DarwinC. The origin of species 1859."},{"key":"e_1_3_1_6_2","unstructured":"LinC.Y. Rouge: A package for automatic evaluation of summaries Proc Work text Summ Branches out (WAS 2004)no. 1 (2004) pp 25\u201326."},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","unstructured":"LinC.Y. and HovyE. Automatic evaluation of summaries using N-gram co-occurrence statistics Proc 2003 Conf North Am Chapter Assoc Comput Linguist Hum Lang Technol - NAACL \u201903 vol. 2003 2003 pp. 71\u201378.","DOI":"10.3115\/1073445.1073465"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.3115\/1119467.1119477"},{"key":"e_1_3_1_9_2","unstructured":"MarcuD. Improving summarization through rhetorical parsing tuning Proc 6th Work Very Large Corpora (1998) pp. 206\u2013215."},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.01.003"},{"key":"e_1_3_1_11_2","unstructured":"ShenD. SunJ. LiH. YangQ. and ChenZ. Document Summarization using Conditional Random Fields (2004) pp. 2862\u20132867."},{"key":"e_1_3_1_12_2","unstructured":"DUC Document Undertanding Conferences 2002."},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"VazquezE. LedenevaY. and Garc\u00eda-Hern\u00e1ndezR.A. Sentence Features Relevance for Extractive Text Summarization using Genetic Algorithms. JIFS. (to be published April 2018).","DOI":"10.3233\/JIFS-169594"},{"key":"e_1_3_1_14_2","first-page":"87","article-title":"Multi-Document summarization based on locally relevant sentences","author":"Villatoro-Tello E.","year":"2009","unstructured":"Villatoro-TelloE., Villase\u00f1or-PinedaL., Montes-y-G\u00f3mezM. and Pinto-Avenda\u00f1oD., Multi-Document summarization based on locally relevant sentences, 8th Mex Int Conf Artif Intell - Proc Spec Sess MICAI 20092009, pp 87\u201391.","journal-title":"8th Mex Int Conf Artif Intell - Proc Spec Sess MICAI 2009"},{"key":"e_1_3_1_15_2","volume-title":"Non-linear construction of n-grams in computational linguistics","author":"Sidorov G.","year":"2013","unstructured":"SidorovG.Non-linear construction of n-grams in computational linguistics, 1st ed. M\u00e9xico: Sociedad Mexicana de Inteligencia Artificial, 2013.","edition":"1"},{"key":"e_1_3_1_16_2","first-page":"903","article-title":"Quantifying the limits and success of extractive summarization systems across domains","author":"Ceylan H.","year":"2010","unstructured":"CeylanH., MihalceaR., \u00d6yertemU., LloretE. and PalomarM., Quantifying the limits and success of extractive summarization systems across domains, Hum Lang Technol (2010), 903\u2013911.","journal-title":"Hum Lang Technol"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/321510.321519"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1147\/rd.22.0159"},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","unstructured":"ConroyJ. and O\u2019LearyD.P. Text summarization via hidden markov models Proc 24th Annu Int ACM SIGIR Conf Res Dev Inf Retrieval (2001) pp. 406\u2013407.","DOI":"10.1145\/383952.384042"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2008.06.002"},{"key":"e_1_3_1_21_2","unstructured":"SteinbergerJ. JezekK.Using latent antic analysis in text summarization and summary evaluation 7th Int Conf ISIM (2004) pp. 93\u2013100sem."},{"key":"e_1_3_1_22_2","first-page":"141","article-title":"Sentence compression for the LSA-based summarizer","volume":"180","author":"Steinberger J.","year":"2006","unstructured":"SteinbergerJ. and JezekK., Sentence compression for the LSA-based summarizer, CEUR Workshop Proc180 (2006), 141\u2013148.","journal-title":"CEUR Workshop Proc"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.04.003"},{"key":"e_1_3_1_24_2","first-page":"448","article-title":"Enhancing single-document summarization by combining rank Net andthird-party sources","author":"Svore K.M.","year":"2007","unstructured":"SvoreK.M., VanderwendeL. and BurgesC.J.C., Enhancing single-document summarization by combining rank Net andthird-party sources, Comput Linguist (2007) pp. 448\u2013457.","journal-title":"Comput Linguist"},{"key":"e_1_3_1_25_2","unstructured":"AraujoL. Cervig\u00f3nC.Algoritmos Evolutivos: Un Enfoque Pr\u00e1ctico 2nd ed. RA-MA 2009."},{"issue":"1","key":"e_1_3_1_26_2","first-page":"22","article-title":"Binwahlan, Genetic algorithm based sentence extraction for text summarization","volume":"1","author":"Suanmali L.","year":"2011","unstructured":"SuanmaliL., SalimN. and S.M., Binwahlan, Genetic algorithm based sentence extraction for text summarization, Int J Innov Comput1(1) (2011), 22.","journal-title":"Int J Innov Comput"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.12.042"},{"key":"e_1_3_1_28_2","first-page":"30","article-title":"Introduction to DUC01: An Intrinsic Evaluation of Generic News Text Summarization Systems, in p","author":"Over P.","year":"2004","unstructured":"OverP. and YenJ., Introduction to DUC01: An Intrinsic Evaluation of Generic News Text Summarization Systems, in p, Proceedings of DUC04 Document Understanding Workshop (2004), 30.","journal-title":"Proceedings of DUC04 Document Understanding Workshop"},{"key":"e_1_3_1_29_2","first-page":"48","article-title":"Introduction to DUC02: An Intrinsic Evaluation of Generic News Text Summarization Systems Document Understanding Conferences (DUC), in p","author":"Over P.","year":"2004","unstructured":"OverP. and LiggetW., Introduction to DUC02: An Intrinsic Evaluation of Generic News Text Summarization Systems Document Understanding Conferences (DUC), in p, Proceedings of DUC04 Document Understanding Workshop (2004), 48","journal-title":"Proceedings of DUC04 Document Understanding Workshop"},{"key":"e_1_3_1_30_2","unstructured":"PonceP. Inteligencia artificial con aplicaciones a la ingenier\u00eda 1st ed. M\u00e9xico2010."},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Hern\u00e1ndezR.A. and LedenevaY. Single Extractive Text Summarization Based on a Genetic Algorithm (2013) pp. 374\u2013383.","DOI":"10.1007\/978-3-642-38989-4_38"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Hern\u00e1ndezR.A. Comparing commercial tools and state-of-the-art methods for generating text summaries 8th Mex Int Conf Artif Intell - Proc Spec Sess MICAI 2009 (2009) pp. 92\u201396.","DOI":"10.1109\/MICAI.2009.24"},{"issue":"1","key":"e_1_3_1_33_2","first-page":"5","article-title":"Automatic text summarization","volume":"161","author":"Chettri R.","year":"2017","unstructured":"ChettriR. and ChakrabortyU.K., Automatic text summarization, Int J Comput Appl161(1) (2017), 5\u20137.","journal-title":"Int J Comput Appl"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.04.067"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.11.022"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"VermaR. and LeeD. Extractive Summarization: Limits Compression Generalized Model and Heuristics (2017)p. 19.","DOI":"10.13053\/cys-21-4-2855"},{"key":"e_1_3_1_37_2","first-page":"404","article-title":"TextRank: Bringing order into texts","volume":"85","author":"Mihalcea R.","year":"2004","unstructured":"MihalceaR. and TarauP., TextRank: Bringing order into texts, Proc EMNLP, vol. 85, (2004) pp. 404\u2013411.","journal-title":"Proc EMNLP"},{"key":"e_1_3_1_38_2","first-page":"19","article-title":"A language independent algorithm for single and multiple document summarization","volume":"5","author":"Mihalcea R.","year":"2005","unstructured":"MihalceaR. and TarauP., A language independent algorithm for single and multiple document summarization, Dep Comput Sci Eng5 (2005), 19\u201324.","journal-title":"Dep Comput Sci Eng"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/11671299_27"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.3115\/1219044.1219064"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2012.10.007"},{"key":"e_1_3_1_42_2","unstructured":"SivanandamS.N. DeepaS.N.Introduction to Genetic Algorithms 2008."},{"key":"e_1_3_1_43_2","unstructured":"RussellS. NorvigP.Inteligencia artificial 2009."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.08.040"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.12.102"},{"key":"e_1_3_1_46_2","unstructured":"WanX. Towards a Unified Approach to Simultaneous Single-Document Proceeding 23rd Int Conf Comput Linguist (Coling 2010)2010 pp. 1137\u20131145."},{"key":"e_1_3_1_47_2","unstructured":"WanX. YangJ. and XiaoJ. Manifold-ranking based topic-focused multi-document summarization IJCAI Int Jt Conf Artif Intell (2007) pp. 2903\u20132908."},{"key":"e_1_3_1_48_2","first-page":"593","article-title":"Terms derived from frequent sequences for extractive text summarization","volume":"4919","author":"Ledeneva Y.","year":"2008","unstructured":"LedenevaY., GelbukhA. and Garc\u00eda-Hern\u00e1ndezR.A., Terms derived from frequent sequences for extractive text summarization, Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics), vol. 4919LNCS, (2008) pp. 593\u2013604.","journal-title":"Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics)"},{"key":"e_1_3_1_49_2","doi-asserted-by":"crossref","unstructured":"LedenevaY. Garc\u00eda-Hern\u00e1ndezR.A. and GelbukhA. Graph Ranking on Maximal Frequent Sequences for Single Extractive Text Summarization Int Conf Intell Text Process Comput Linguist vol. 8404 (2014) pp. 466\u2013480.","DOI":"10.1007\/978-3-642-54903-8_39"},{"key":"e_1_3_1_50_2","volume-title":"Challenges, Proposals and Experiments","author":"Ledeneva Y.","year":"2017","unstructured":"LedenevaY. and Garc\u00eda-Hern\u00e1ndezR.A., Generaci\u00f3n autom\u00e1tica de res\u00famenes. Retos, propuestasy experimentos. Automatic Generation of Text Summaries. Challenges, Proposals and Experiments, UniversidadAut\u00f3noma del Estado de M\u00e9xico, Toluca, 2017."},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.04.177"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169588","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-169588","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:39:29Z","timestamp":1777455569000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-169588"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,4]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,7,27]]}},"alternative-id":["10.3233\/JIFS-169588"],"URL":"https:\/\/doi.org\/10.3233\/jifs-169588","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,4]]}}}