{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T06:09:39Z","timestamp":1792130979264,"version":"4.4.0"},"reference-count":85,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,1,31]],"date-time":"2020-01-31T00:00:00Z","timestamp":1580428800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61572211, 61173114, and 61202300"],"award-info":[{"award-number":["61572211, 61173114, and 61202300"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Text summarization is a process of producing a concise version of text (summary) from one or more information sources. If the generated summary preserves meaning of the original text, it will help the users to make fast and effective decision. However, how much meaning of the source text can be preserved is becoming harder to evaluate. The most commonly used automatic evaluation metrics like Recall-Oriented Understudy for Gisting Evaluation (ROUGE) strictly rely on the overlapping n-gram units between reference and candidate summaries, which are not suitable to measure the quality of abstractive summaries. Another major challenge to evaluate text summarization systems is lack of consistent ideal reference summaries. Studies show that human summarizers can produce variable reference summaries of the same source that can significantly affect automatic evaluation metrics scores of summarization systems. Humans are biased to certain situation while producing summary, even the same person perhaps produces substantially different summaries of the same source at different time. This paper proposes a word embedding based automatic text summarization and evaluation framework, which can successfully determine salient top-n sentences of a source text as a reference summary, and evaluate the quality of systems summaries against it. Extensive experimental results demonstrate that the proposed framework is effective and able to outperform several baseline methods with regard to both text summarization systems and automatic evaluation metrics when tested on a publicly available dataset.<\/jats:p>","DOI":"10.3390\/info11020078","type":"journal-article","created":{"date-parts":[[2020,1,31]],"date-time":"2020-01-31T11:55:56Z","timestamp":1580471756000},"page":"78","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["A Framework for Word Embedding Based Automatic Text Summarization and Evaluation"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0224-0932","authenticated-orcid":false,"given":"Tulu Tilahun","family":"Hailu","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junqing","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China"},{"name":"Center of Network and Computation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tessfu Geteye","family":"Fantaye","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rush, A.M., Chopra, S., and Weston, J. (2015). A Neural Attention Model for Abstractive Sentence Summarization. arXiv.","DOI":"10.18653\/v1\/D15-1044"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Torres-Moreno, J.-M. (2014). Automatic Text Summarization, ISTE Ltd. and John Wiley & Sons.","DOI":"10.1002\/9781119004752"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Saggion, H., and Poibeau, T. (2013). Automatic text summarization: Past, present and future. Multi-Source, Multilingual Information Extraction and Summarization, Springer.","DOI":"10.1007\/978-3-642-28569-1_1"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"178","DOI":"10.3844\/jcssp.2016.178.190","article-title":"A review on automatic text summarization approaches","volume":"12","author":"Kumar","year":"2016","journal-title":"J. Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"See, A., Liu, P.J., and Manning, C.D. (2017). Get To The Point: Summarization with Pointer-Generator Networks. arXiv.","DOI":"10.18653\/v1\/P17-1099"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1147\/rd.22.0159","article-title":"The Automatic Creation of Literature Abstracts *","volume":"2","author":"Luhn","year":"1958","journal-title":"IBM J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1145\/321510.321519","article-title":"New Methods in Automatic Extracting","volume":"16","author":"Edmundson","year":"1969","journal-title":"J. ACM."},{"key":"ref_8","unstructured":"Barrios, F., Federico, L., Argerich, L., and Wachenchauzer, R. (2016). Variations of the Similarity Function of TextRank for Automated Summarization. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rossiello, G., Basile, P., and Semeraro, G. (2017, January 3). Centroid-based Text Summarization through Compositionality of Word Embeddings. Proceedings of the MultiLing 2017 Workshop on Summarization and Summary Evaluation Across Source Types and Genres, Valencia, Spain.","DOI":"10.18653\/v1\/W17-1003"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wu, Y., and Hu, B. (2018, January 2\u20137). Learning to Extract Coherent Summary via Deep Reinforcement Learning. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11987"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jadhav, A., and Rajan, V. (2018, January 15\u201320). Extractive Summarization with SWAP-NET: Sentences and Words from Alternating Pointer Networks. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1014"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nallapati, R., Zhai, F., and Zhou, B. (2017, January 4\u20139). SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10958"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Bansal, M. (2018). Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting. arXiv.","DOI":"10.18653\/v1\/P18-1063"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, D., Wang, Y., and Fang, Y. (2019). Abstract Text Summarization with a Convolutional Seq2seq Model. Appl. Sci., 9.","DOI":"10.3390\/app9081665"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bae, S., Kim, T., Kim, J., and Lee, S. (2019). Summary Level Training of Sentence Rewriting for Abstractive Summarization. arXiv.","DOI":"10.18653\/v1\/D19-5402"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, C., Xu, W., Li, S., and Gao, S. (2018, January 1\u20136). Guiding Generation for Abstractive Text Summarization based on Key Information Guide Network. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-2009"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hsu, W., Lin, C., Lee, M., Min, K., Tang, J., and Sun, M. (2018). A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss. arXiv.","DOI":"10.18653\/v1\/P18-1013"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1613\/jair.1523","article-title":"LexRank: Graph-based Lexical Centrality as Salience in Text Summarization","volume":"22","author":"Erkan","year":"2004","journal-title":"J. Artif. Intell. Res."},{"key":"ref_19","first-page":"1001","article-title":"Evaluation Measures for Text Summarization","volume":"28","author":"Steinberger","year":"2009","journal-title":"Comput. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1002\/asi.5090120210","article-title":"The Formation of Abstracts By the Selection of Sentences. Part 1. Sentence Selection By Men and Machines","volume":"12","author":"Rath","year":"1961","journal-title":"Am. Doc."},{"key":"ref_21","unstructured":"Berg-Kirkpatrick, T., Gillick, D., and Klein, D. (, January 19\u201324June). Jointly Learning to Extract and Compress. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA."},{"key":"ref_22","first-page":"703","article-title":"Statistics-Based Summarization\u2014Step One: Sentence Compression","volume":"2000","author":"Knight","year":"2000","journal-title":"AAAI\/IAAI"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Grusky, M., Naaman, M., and Artz, Y. (2018). Newsroom: A dataset of 1.3 million summaries with diverse extractive strategies. arXiv.","DOI":"10.18653\/v1\/N18-1065"},{"key":"ref_24","unstructured":"Radev, D.R., Blair-Goldensohn, S., and Zhang, Z. (2001, January 13\u201314). Experiments in Single and Multi-Document Summarization Using MEAD. Proceedings of the First Document Understanding Conference, New Orleans, LA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1147\/rd.14.0309","article-title":"A Statistical Approach to Mechanized Encoding and Searching of Literary Information","volume":"1","author":"Luhn","year":"1957","journal-title":"IBM J. Res. Dev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1108\/eb026526","article-title":"A statistical interpretation of term specificity and its application in retrieval","volume":"28","author":"Jones","year":"1972","journal-title":"J. Doc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/0306-4573(88)90021-0","article-title":"Term-weighting approaches in automatic text retrieval","volume":"24","author":"Salton","year":"1988","journal-title":"Inf. Process. Manag."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kyoomarsi, F., Khosravi, H., Eslami, E., Dehkordy, P.K., and Tajoddin, A. (2008). Optimizing Text Summarization Based on Fuzzy Logic. Seventh IEEE\/ACIS International Conference on Computer and Information Science (Icis 2008), IEEE.","DOI":"10.1109\/ICIS.2008.46"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Villatoro-Tello, E., Villase\u00f1or-Pineda, L., and Montes-y-G\u00f3mez, M. (2006, January 11\u201315). Using Word Sequences for Text Summarization. Proceedings of the International Conference on Text, Speech and Dialogue, Brno, Czech Republic.","DOI":"10.1007\/11846406_37"},{"key":"ref_30","unstructured":"Ren\u00e9 Arnulfo, G., Montiel, R., Ledeneva, Y., Rend\u00f3n, E., Gelbukh, A., and Cruz, R. (2008, January 27\u201331). Text Summarization by Sentence Extraction Using Unsupervised Learning *. Proceedings of the Mexican International Conference on Artificial Intelligence, Atizap\u00e1n de Zaragoza, Mexico."},{"key":"ref_31","first-page":"90","article-title":"Automatic Text Summarization","volume":"2","author":"Fattah","year":"2008","journal-title":"Int. J. Comput. Inf. Eng."},{"key":"ref_32","first-page":"1","article-title":"Ultra-Summarization: A Statistical Approach to Generating Highly Condensed Non-Extractive Summaries","volume":"9","author":"Witbrock","year":"1999","journal-title":"In SIGIR"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1016\/j.ipm.2007.01.016","article-title":"Multi-candidate reduction: Sentence compression as a tool for document summarization tasks","volume":"43","author":"Zajic","year":"2007","journal-title":"Inf. Process. Manag."},{"key":"ref_34","unstructured":"Jing, H., and McKeow, K.R. (May, January 29). Cut and Paste Based Text Summarization. Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, Seattle, WA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"112958","DOI":"10.1016\/j.eswa.2019.112958","article-title":"Text document summarization using word embedding","volume":"143","author":"Mohd","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Al-Sabahi, K., Zuping, Z., and Kang, Y. (2018). Latent Semantic Analysis Approach for Document Summarization Based on Word Embeddings. arXiv.","DOI":"10.1007\/s13369-018-3286-z"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nema, P., Khapra, M., Laha, A., and Ravindran, B. (2018). Diversity driven Attention Model for Query-based Abstractive Summarization. arXiv.","DOI":"10.18653\/v1\/P17-1098"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nallapati, R., Zhou, B., Gulcehre, C., and Xiang, B. (2016). Abstractive text summarization using sequence-to-sequence rnns and beyond. arXiv.","DOI":"10.18653\/v1\/K16-1028"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Xiang, X., Xu, G., Fu, X., Wei, Y., Jin, L., and Wang, L. (2018). Skeleton to Abstraction: An Attentive Information Extraction Schema for Enhancing the Saliency of Text Summarization. Inf., 9.","DOI":"10.3390\/info9090217"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Rush, A.M., Chopra, S., and Weston, J. (2015, January 17\u201321). A Neural Attention Model for Abstractive Sentence Summarization. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1044"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"24205","DOI":"10.1109\/ACCESS.2018.2829199","article-title":"A Hierarchical Structured Self-Attentive Model for Extractive Document Summarization (HSSAS)","volume":"6","author":"Zuping","year":"2018","journal-title":"IEEE Access"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yang, K., Al-Sabahi, K., Xiang, Y., and Zhang, Z. (2018). An Integrated Graph Model for Document Summarization. Information, 9.","DOI":"10.3390\/info9090232"},{"key":"ref_43","unstructured":"Ganesan, K., Zhai, C., and Han, J. (2010, January 23\u201327). Opinosis: A graph based approach to abstractive summarization of highly redundant opinions. Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), Beijing, China."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Jing, H., and Mckeown, K.R. (1999, January 15\u201319). The Decomposition of Human-Written Summary Sentences. Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, USA.","DOI":"10.1145\/312624.312666"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Saggion, H. (2009, January 6). A classification algorithm for predicting the structure of summaries. Proceedings of the 2009 Workshop on Language Generation and Summarisation, Suntec, Singapore.","DOI":"10.3115\/1708155.1708162"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Saggion, H. (2011). Learning Predicate Insertion Rules for Document Abstracting. International Conference on Intelligent Text Processing and Computational Linguistics, Springer.","DOI":"10.1007\/978-3-642-19437-5_25"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"64","DOI":"10.3390\/info8020064","article-title":"Identifying High Quality Document\u2013Summary Pairs through Text Matching","volume":"8","author":"Hou","year":"2017","journal-title":"Information"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Hu, B., Chen, Q., and Zhu, F. (2015). LCSTS: A Large Scale Chinese Short Text Summarization Dataset. arXiv.","DOI":"10.18653\/v1\/D15-1229"},{"key":"ref_49","unstructured":"Hermann, K.M., Ko, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., and Blunsom, P. (2015, January 11\u201315). Teaching Machines to Read and Comprehend. Proceedings of the Advances in Neural Information Processing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1016\/j.ipm.2007.01.019","article-title":"DUC in Context","volume":"43","author":"Over","year":"2007","journal-title":"Inf. Process. Manag."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Chopra, S., Auli, M., and Rush, A.M. (2016, January 12\u201317). Abstractive Sentence Summarization with Attentive Recurrent Neural Networks. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1012"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"V\u00f6lske, M., Potthast, M., Syed, S., and Stein, B. (2017, January 7). TL; DR: Mining Reddit to Learn Automatic Summarization. Proceedings of the Workshop on New Frontiers in Summarization, Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4508"},{"key":"ref_53","unstructured":"Filippova, K., and Altun, Y. (2013, January 18\u201321). Overcoming the Lack of Parallel Data in Sentence Compression. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"138603","DOI":"10.1109\/ACCESS.2019.2941964","article-title":"MS-Pointer Network: Abstractive Text Summary Based on Multi-Head Self-Attention","volume":"7","author":"Guo","year":"2019","journal-title":"IEEE Access."},{"key":"ref_55","first-page":"336","article-title":"Evaluating Natural Language Processing Systems: An Analysis and Review","volume":"24","author":"Jones","year":"1996","journal-title":"Comput. Linguist."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/0306-4573(90)90014-S","article-title":"Constructing literature abstracts by computer: techniques and prospects","volume":"26","author":"Paice","year":"1990","journal-title":"Inf. Process. Manag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1016\/j.ipm.2003.10.006","article-title":"Centroid-based summarization of multiple documents","volume":"40","author":"Radev","year":"2004","journal-title":"Inf. Proc. Manag."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Mani, I., House, D., Klein, G., Hirschman, L., Firmin, T., and Sundheim, B.M. (1999, January 8\u201312). The TIPSTER SUMMAC text summarization evaluation. Proceedings of the Ninth Conference of the European Chapter of the Association for Computational Linguistics, Bergen, Norway.","DOI":"10.3115\/977035.977047"},{"key":"ref_59","unstructured":"Hynek, J., and Jezek, K. (2003, January 25\u201328). Practical Approach to Automatic Text Summarization. Proceedings of the 7th ICCC\/IFIP International Conference on Electronic Publishing, Minho, Portugal."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"R.Radev, D., Teufel, S., Saggion, H., and Lam, W. (2003, January 7\u201312). Evaluation challenges in large-scale document summarization. Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, Sapporo, Japan.","DOI":"10.3115\/1075096.1075144"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1287\/isre.3.1.17","article-title":"The Effects and Limitations of Automated Text Condensing on Reading Comprehension Performance","volume":"3","author":"Morris","year":"1992","journal-title":"Inf. Syst. Res."},{"key":"ref_62","unstructured":"Lin, C. (2004, January 25\u201326). ROUGE: A Package for Automatic Evaluation of Summaries. Proceedings of the Text Summarization Branches Out, Barcelona, Spain."},{"key":"ref_63","unstructured":"Lin, C.Y. (2004, January 2\u20134). Looking for a few good metrics: ROUGE and its evaluation. Proceedings of the NTCIR Workshop, Tokyo, Japan."},{"key":"ref_64","unstructured":"Minel, J.-L., Nugler, S., and Plat, G. (1997, January 11). How to appreciate the quality of automatic text summarization? Examples of FAN and MLUCE protocols and their results on SERAPHIN. Proceedings of the Intelligent Scalable Text Summarization, Madrid, Spain."},{"key":"ref_65","unstructured":"Nenkova, A., and Passonneau, R. (2004, January 2\u20137). Evaluating Content Selection in Summarization: The Pyramid Method. Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Boston, MA, USA."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1017\/S1351324901002741","article-title":"SUMMAC: A text summarization evaluation","volume":"8","author":"Mani","year":"2002","journal-title":"Nat. Lang. Eng."},{"key":"ref_67","unstructured":"Jing, H., Barzilay, R., McKeow, K., and Elhadad, M. (1998, January 26\u201330). Summarization Evaluation Methods: Experiments and Analysis. Proceedings of the AAAI Symposium on Intelligent Summarization, Madison, WI, USA."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/978-3-642-15760-8_14","article-title":"Evaluation of a Sentence Ranker for Text Summarization Based on Roget\u2019s Thesaurus","volume":"6231","author":"Kennedy","year":"2010","journal-title":"Int. Conf. Text, Speech Dialogue."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/S0306-4573(97)00009-5","article-title":"Thesaurus construction: problems and their roots","volume":"33","author":"MILLER","year":"1997","journal-title":"Inf. Process. Manag"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Ng, J., and Abrech, V. (2015, January 17\u201321). Better Summarization Evaluation with Word Embeddings for ROUGE. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1222"},{"key":"ref_71","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv."},{"key":"ref_72","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013, January 5\u201310). Distributed Representations of Words and Phrases and their Compositionality. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_73","unstructured":"Mikolov, T., Yih, W., and Zweig, G. (2013, January 9\u201314). Linguistic Regularities in Continuous Space Word Representations. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Atlanta, GA, USA."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Bojanowski, P., Grave, E., Joulin, A., and Mikolov, T. (2017). Enriching Word Vectors with Subword Information. arXiv.","DOI":"10.1162\/tacl_a_00051"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., and Manning, C.D.. (2014, January 25\u201329). GloVe: Global Vectors for Word Representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1162"},{"key":"ref_76","first-page":"147","article-title":"The Rhetorical Organisation of English Argumentative Essays by Malay ESL Students: The Placement of Thesis Statement","volume":"9","author":"Husin","year":"2012","journal-title":"J. Asia TEFL."},{"key":"ref_77","unstructured":"Vinyals, O., Fortunato, M., and Jaitly, N. (2015, January 7\u201312). Pointer Networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Tu, Z., Lu, Z., Liu, Y., and Liu, X. (2016). Modeling Coverage for Neural Machine Translation. arXiv.","DOI":"10.18653\/v1\/P16-1008"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002, January 7\u201312). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073135"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Graham, Y. (2015, January 17\u201321). Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1013"},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Popovi\u0107, M. (2015, January 17\u201318). CHRF: character n-gram F-score for automatic MT evaluation. Proceedings of the Tenth Workshop on Statistical Machine Translation, Lisbon, Portugal.","DOI":"10.18653\/v1\/W15-3049"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Bojar, O., Graham, Y., Kamran, A., and Stanojevi\u0107, M. (2016, January 11\u201312). Results of the WMT16 Metrics Shared Task. Proceedings of the First Conference on Machine Translation, Berlin, Germany.","DOI":"10.18653\/v1\/W16-2302"},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Bojar, O., Graham, Y., and Kamran, A. (2017, January 7\u201311). Results of the WMT17 Metrics Shared Task. Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4755"},{"key":"ref_84","unstructured":"Pearson, K. (1895, January 31). Note on regression and inheritance in the case of two parents. Proceedings of the Royal Society of London, London, UK."},{"key":"ref_85","unstructured":"Villanueva, V. (2003). Cross-Talk in Comp Theory: A Reader, ERIC. [2nd ed.]. Revised and Updated."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/2\/78\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:53:30Z","timestamp":1760172810000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/2\/78"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,31]]},"references-count":85,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["info11020078"],"URL":"https:\/\/doi.org\/10.3390\/info11020078","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,31]]}}}