{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T04:37:57Z","timestamp":1762058277524,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Politeknik Negeri Ketapang","award":["224\/PL39\/KP\/BP\/2022","3550\/UN1.P.III\/Dit-Lit\/PT.01.05\/2022"],"award-info":[{"award-number":["224\/PL39\/KP\/BP\/2022","3550\/UN1.P.III\/Dit-Lit\/PT.01.05\/2022"]}]},{"name":"the thesis recognition program (RTA) from Universitas Gadjah Mada","award":["224\/PL39\/KP\/BP\/2022","3550\/UN1.P.III\/Dit-Lit\/PT.01.05\/2022"],"award-info":[{"award-number":["224\/PL39\/KP\/BP\/2022","3550\/UN1.P.III\/Dit-Lit\/PT.01.05\/2022"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Automatic short answer scoring methods have been developed with various algorithms over the decades. In the Indonesian language, the string-based similarity is more commonly used. This method is difficult to accurately measure the similarity of two sentences with significantly different word lengths. This problem has been handled by the Geometric Average Normalized-Longest Common Subsequence (GAN-LCS) method by eliminating non-contributive words utilizing the Longest Common Subsequence method. However, students\u2019 answers may vary not only in character length but also in the words they choose. For instance, some students tend only to write the abbreviations or acronyms of the phrase instead of writing meaningful words. As a result, it will reduce the intersection character between the reference answer and the student answer. Moreover, it can change the sentence structure even though it has the same meaning by definition. Therefore, this study aims to improve GAN-LCS method performance by incorporating the abbreviation checker to handle the abbreviations or acronyms found in the reference answer or student answer. The dataset used in this study consisted of 10 questions with 1 reference answer for each question and 585 student answers. The experimental results show an improvement in GAN-LCS performance that could run 34.43% faster. Meanwhile, the Root Mean Square Error (RSME) value became lower by 7.65% and the correlation value was increased by 8%. Looking forward, future studies may continue to investigate a method for automatically generate the abbreviations dictionary.<\/jats:p>","DOI":"10.3390\/computers11070108","type":"journal-article","created":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T11:12:35Z","timestamp":1656760355000},"page":"108","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Enhancing GAN-LCS Performance Using an Abbreviations Checker in Automatic Short Answer Scoring"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8616-4318","authenticated-orcid":false,"given":"Ar-Razy","family":"Muhammad","sequence":"first","affiliation":[{"name":"Department of Informatics Engineering, Politeknik Negeri Ketapang, Ketapang 78851, Indonesia"},{"name":"Department of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta 55281, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adhistya Erna","family":"Permanasari","sequence":"additional","affiliation":[{"name":"Department of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta 55281, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4044-4987","authenticated-orcid":false,"given":"Indriana","family":"Hidayah","sequence":"additional","affiliation":[{"name":"Department of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta 55281, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"267","DOI":"10.46328\/ijtes.v4i4.113","article-title":"Investigation of Views of Students and Teachers on Distance Education Practices during the Coronavirus (COVID-19) Pandemic","volume":"4","author":"Hebebci","year":"2020","journal-title":"Int. J. Technol. Educ. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pregowska, A., Masztalerz, K., Garli\u0144ska, M., and Osial, M. (2021). A Worldwide Journey through Distance Education\u2014From the Post Office to Virtual, Augmented and Mixed Realities, and Education during the COVID-19 Pandemic. Educ. Sci., 11.","DOI":"10.3390\/educsci11030118"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1016\/j.pcl.2021.05.009","article-title":"The Effect of COVID-19 on Education","volume":"68","author":"Hoofman","year":"2021","journal-title":"Pediatr. Clin. N. Am."},{"key":"ref_4","first-page":"100177","article-title":"MOOCS and 100 Days of COVID: Enrollment surges in massive open online astronomy classes during the coronavirus pandemic","volume":"4","author":"Impey","year":"2021","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s40593-014-0026-8","article-title":"The Eras and Trends of Automatic Short Answer Grading","volume":"25","author":"Burrows","year":"2015","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_6","unstructured":"Perez, D., and Alfonseca, E. (2005, January 11\u201313). Application of the Bleu algorithm for recognising textual entailments. Proceedings of the First Challenge Workshop, Southampton, UK."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xi, Y., and Liang, W. (2011, January 17\u201318). Automated Computer-Based CET4 Essay Scoring System. Proceedings of the 2011 Third Pacific-Asia Con-ference on Circuits, Communications and System (PACCS), Wuhan, China.","DOI":"10.1109\/PACCS.2011.5990116"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1109\/TLT.2010.4","article-title":"Improving Teaching and Learning through Automated Short-Answer Marking","volume":"3","author":"Siddiqi","year":"2010","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lahitani, A.R., Permanasari, A.E., and Setiawan, N.A. (2016, January 26\u201327). Cosine similarity to determine similarity measure: Study case in online essay assessment. Proceedings of the 2016 4th International Conference on Cyber and IT Service Management, Bandung, Indonesia.","DOI":"10.1109\/CITSM.2016.7577578"},{"key":"ref_10","first-page":"54","article-title":"Aplikasi penilaian ujian essay otomatis menggunakan metode cosine similarity","volume":"7","author":"Fitri","year":"2015","journal-title":"J. Poros Tek."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fauzi, M.A., Utomo, D.C., Setiawan, B.D., and Pramukantoro, E.S. (2017, January 25\u201327). Automatic Essay Scoring System Using N-Gram and Cosine Similarity for Gamification Based E-Learning. Proceedings of the International Conference on Advances in Image Processing, Bangkok, Thailand.","DOI":"10.1145\/3133264.3133303"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"763","DOI":"10.12928\/telkomnika.v17i2.11785","article-title":"A scoring rubric for automatic short answer grading system","volume":"17","author":"Hasanah","year":"2019","journal-title":"TELKOMNIKA"},{"key":"ref_13","unstructured":"Aji, R.B., Baizar, A., and Firdaus, Y. (2011, January 17\u201318). Automatic essay grading system menggunakan metode latent semantic analysis. Proceedings of the Seminar Nasional Aplikasi Teknologi Informasi (SNATI), Yogyakarta, Indonesia."},{"key":"ref_14","unstructured":"Yustiana, D. (2015, January 19). Penilaian otomatis terhadap jawaban esai pada soal berbahasa indonesia menggunakan latent semantic analysis. Proceedings of the Seminar Nasional Inovasi dalam Desain dan Teknologi, Surabaya, Indonesia."},{"key":"ref_15","first-page":"5","article-title":"SIMPLE: Sistim penilai esei otomatis untuk menilai ujian dalam bahasa Indonesia","volume":"11","author":"Ratna","year":"2010","journal-title":"Makara J. Technol."},{"key":"ref_16","unstructured":"Citawan, R.S., Mawardi, V.C., and Mulyawan, B. (2017, January 26\u201329). Automatic Essay Scoring in E-learning System Using LSA Method with N-Gram Feature for Bahasa Indonesia. Proceedings of the 3rd International Conference on Electrical Systems, Technology and Information (ICESTI 2017), Bali, Indonesia."},{"key":"ref_17","unstructured":"Amalia, A., Gunawan, D., Fithri, Y., and Aulia, I. (2019, January 18\u201319). Automated Bahasa Indonesia essay evaluation with latent semantic analysis. Proceedings of the 3rd International Conference on Computing and Applied Informatics 2018, Medan, Indonesia."},{"key":"ref_18","first-page":"47","article-title":"Sistem penilaian esai otomatis pada e-learning dengan algoritma winnowing","volume":"12","author":"Astutik","year":"2014","journal-title":"J. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hasanah, U., and Hartato, B.P. (2020, January 6\u20138). Assessing Short Answers in Indonesian Using Semantic Text Similarity Method and Dynamic Corpus. Proceedings of the 2020 12th International Conference on Information Technology and Electrical Engineering (ICITEE), Yogyakarta, Indonesia.","DOI":"10.1109\/ICITEE49829.2020.9271696"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2855","DOI":"10.1007\/s10639-018-9745-z","article-title":"Short answer scoring system using automatic reference answer generation and geometric average normalized-longest common subsequence (GAN-LCS)","volume":"23","author":"Pribadi","year":"2018","journal-title":"Educ. Inf. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Raghavan, P., and Schuetze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_22","unstructured":"Tala, F.Z. (2003). A Study of Stemming Effects on Information Retrieval in Bahasa Indonesia. [Master\u2019s Thesis, Universiteit van Amsterdam]."},{"key":"ref_23","unstructured":"(2022, June 30). Stopwords Indonesian (ID). Available online: https:\/\/github.com\/stopwords-iso\/stopwords-id."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Carvalho, G., de Matos, D.M., and Rocio, V. (2007, January 9). Document Retrieval for Question Answering: A Quantitative Evaluation of Text Preprocessing. Proceedings of the First Ph.D. Workshop in CIKM, PIKM 2007, Sixteenth ACM Conference on Information and Knowledge Management, Lisbon, Portugal.","DOI":"10.1145\/1316874.1316894"},{"key":"ref_25","unstructured":"(2022, June 30). Sastrawi. Available online: https:\/\/github.com\/sastrawi\/sastrawi."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1316457.1316459","article-title":"Stemming Indonesian: A confix-stripping approach","volume":"6","author":"Adriani","year":"2007","journal-title":"ACM Trans. Asian Lang. Inf. Process."},{"key":"ref_27","unstructured":"Asian, J. (2007). Effective Techniques for Indonesian Text Retrieval. [Ph.D. Thesis, RMIT University]."},{"key":"ref_28","unstructured":"Arifin, A.Z. (2009, January 4). Enhanced confix stripping stemmer and ants algorithm for classifying news document in indonesian language. Proceedings of the 5th International Conference on Information & Communication Technology and Systems (ICTS), Surabaya, Indonesia."},{"key":"ref_29","unstructured":"Tahitoe, A.D., and Purwitasari, D. (2010). Implementasi Modifikasi Enhanced Confix Stripping Stemmer untuk Bahasa Indonesia dengan Metode Corpus Based Stemming. [Bachelor\u2019s Thesis, Institut Teknologi Sepuluh Nopember]."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1698","DOI":"10.1016\/j.ipm.2019.05.009","article-title":"Query expansion techniques for information retrieval: A survey","volume":"56","author":"Azad","year":"2019","journal-title":"Inf. Process. Manag."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.compedu.2010.07.013","article-title":"The automatic assessment of free text answers using a modified BLEU algorithm","volume":"56","author":"Noorbehbahani","year":"2011","journal-title":"Comput. Educ."},{"key":"ref_32","unstructured":"Rodrigues, F., and Ara\u00fajo, L. (2012, January 16\u201318). Automatic assessment of short free text answers. Proceedings of the 4th International Conference on Computer Supported Education, Porto, Portugal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1025779619903","article-title":"C-rater: Automated Scoring of Short-Answer Questions","volume":"37","author":"Leacock","year":"2003","journal-title":"Comput. Humanit."},{"key":"ref_34","unstructured":"Mohler, M., and Mihalcea, R. (April, January 30). Text-to-text semantic similarity for automatic short answer grading. Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics on\u2014EACL-09, Athens, Greece."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Carbonell, J., and Goldstein, J. (1998, January 24\u201328). The use of MMR, diversity-based reranking for reordering documents and producing summaries. Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval\u2014SIGIR-98, Melbourne, Australia.","DOI":"10.1145\/290941.291025"},{"key":"ref_36","unstructured":"Thakkar, M. (2021). Finetuning Transformer Models to Build ASAG System, University of Limerick."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ko, Y., and Han, S. (2017). A Duration Prediction Using a Material-Based Progress Management Methodology for Construction Operation Plans. Sustainability, 9.","DOI":"10.3390\/su9040635"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/7\/108\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:41:44Z","timestamp":1760139704000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/7\/108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,1]]},"references-count":37,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["computers11070108"],"URL":"https:\/\/doi.org\/10.3390\/computers11070108","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2022,7,1]]}}}