{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:41:15Z","timestamp":1777696875416,"version":"3.51.4"},"reference-count":69,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T00:00:00Z","timestamp":1733961600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Intelligent Decision Technologies"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:p>Understanding the satisfaction of students\u2019 academic experience is essential for enhancing the educational process and lowering attrition rates. In this context, universities conduct surveys via questionnaires, including both closed-ended and open-ended questions, to track and assess students\u2019 feedback. While closed-ended questions seem useful for rapid quantitative analysis, open-ended ones usually obtain deeper insights and capture a wide spectrum of student experiences. This paper proposes an automated hybrid text summarization approach to handle the problem of assessing vast amounts of qualitative data from responses to open-ended questions. Data preparation, anonymization, normalization, sentence ranking, sentence clustering, extractive, and abstractive summarization, are the main tasks of the proposed approach, which is based on a Microservice-Oriented Architecture. Such an architecture ensures flexibility and scalability, enabling the easy integration of new components that may enhance the approach's overall functionality. Moreover, the applicability of the proposed approach is demonstrated through a dataset containing written responses in the modern Greek language from an online questionnaire completed by about 20.000 students attending study programs at the Hellenic Open University (HOU). The results show that automated text summarization proved to be efficient regarding the time required to produce reports, while also maintaining satisfactory quality.<\/jats:p>","DOI":"10.1177\/18724981241303216","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T09:51:32Z","timestamp":1747734692000},"page":"781-803","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Summarizing responses to open-ended questions in educational surveys: A\u00a0microservice-oriented approach"],"prefix":"10.1177","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2530-4820","authenticated-orcid":false,"given":"Nikos","family":"Karousos","sequence":"first","affiliation":[{"name":"School of Science &amp; Technology, Hellenic Open University, 26335 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9472-6774","authenticated-orcid":false,"given":"George","family":"Vorvilas","sequence":"additional","affiliation":[{"name":"School of Science &amp; Technology, Hellenic Open University, 26335 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Despoina","family":"Pantazi","sequence":"additional","affiliation":[{"name":"School of Science &amp; Technology, Hellenic Open University, 26335 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manolis","family":"Tzagarakis","sequence":"additional","affiliation":[{"name":"Dept. of Economics, University of Patras, 26504 Rio Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikos","family":"Karacapilidis","sequence":"additional","affiliation":[{"name":"IMIS Lab, University of Patras, 26504 Rio Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vassilios S.","family":"Verykios","sequence":"additional","affiliation":[{"name":"School of Science &amp; Technology, Hellenic Open University, 26335 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,12,12]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1080\/1360080022000013518"},{"key":"e_1_3_3_3_2","first-page":"26","article-title":"The art of asking WHY in marketing research: three principles underlying the formulation of questionnaires","volume":"1","author":"Lazarsfeld PF","year":"1935","unstructured":"Lazarsfeld PF. The art of asking WHY in marketing research: three principles underlying the formulation of questionnaires. National Marketing Review 1935; 1: 26\u201338.","journal-title":"National Marketing Review"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.2307\/2090907"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12103"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2022.880554"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1002\/bs.3830070412"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2309.17447"},{"key":"e_1_3_3_9_2","volume-title":"Mastering Text Mining with R: Extract and recognize your text data","author":"Kumar A","year":"2016","unstructured":"Kumar A, Paul A. Mastering Text Mining with R: Extract and recognize your text data. Birmingham, Mumbai: Packt Publishing, 2016."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","unstructured":"Blei DM Lafferty JD. A correlated topic model of Science. 2007. 10.48550\/arXiv.0708.3601.","DOI":"10.48550\/arXiv.0708.3601"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.560"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.13707"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","unstructured":"Gu Y Tinn R Cheng H et al. Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing 2021. 10.48550\/arXiv.2007.15779.","DOI":"10.48550\/arXiv.2007.15779"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00458"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67425-4_12"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","unstructured":"De Lauretis L. From Monolithic Architecture to Microservices Architecture. 2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) 2019 p. 93\u20136. 10.1109\/ISSREW.2019.00050.","DOI":"10.1109\/ISSREW.2019.00050"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2017.4250931"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1080\/02602930500099193"},{"key":"e_1_3_3_19_2","volume-title":"The Coding Manual for Qualitative Researchers","author":"Saldana J","year":"2021","unstructured":"Saldana J. The Coding Manual for Qualitative Researchers. USA: Sage, Arizona State University, 2021."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781071802878"},{"key":"e_1_3_3_21_2","first-page":"433","article-title":"Embarking on large-scale qualitative research: reaping the benefits of mixed methods in studying youth, clubs and drugs","volume":"28","author":"Hunt G","year":"2011","unstructured":"Hunt G, Moloney M, Fazio A. Embarking on large-scale qualitative research: reaping the benefits of mixed methods in studying youth, clubs and drugs. Nordisk Alkohol- & Narkotikatidskrift: NAT 2011; 28: 433\u2013452.","journal-title":"Nordisk Alkohol- & Narkotikatidskrift: NAT"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.119265"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/0759106315597389"},{"key":"e_1_3_3_24_2","volume-title":"Text Data Management and Analysis: A Practical Introduction to Information Retrieval and Text Mining","author":"Zhai C","year":"2016","unstructured":"Zhai C, Massung S. Text Data Management and Analysis: A Practical Introduction to Information Retrieval and Text Mining. Morgan & Claypool, 2016."},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","unstructured":"Allahyari M Pouriyeh S Assefi M et al. A Brief Survey of Text Mining: Classification Clustering and Extraction Techniques. 2017. 10.48550\/arXiv.1707.02919","DOI":"10.48550\/arXiv.1707.02919"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-5400-1_16"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39937-9_24"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.3390\/app13137620"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-73618-1_28"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigDataCongress.2017.46"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-5934-7_31"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2024.128280"},{"key":"e_1_3_3_33_2","unstructured":"Vaswani A Shazeer N Parmar N et al. Attention is All you need\u2019 2017."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","unstructured":"Alhojely S Kalita J. Recent progress on text summarization. 2020 International Conference on Computational Science and Computational Intelligence (CSCI) 2020 pp.1503\u20131509. 10.1109\/CSCI51800.2020.00278.","DOI":"10.1109\/CSCI51800.2020.00278"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-63215-0_5"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3635059.3635062"},{"key":"e_1_3_3_37_2","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin J","year":"2018","unstructured":"Devlin J. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv Preprint arXiv:181004805 2018.","journal-title":"arXiv Preprint arXiv:181004805"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.3390\/info15090521"},{"key":"e_1_3_3_39_2","volume-title":"Distance Education: A Systems View of Online Learning","author":"Moore MG","year":"2011","unstructured":"Moore MG, Kearsley G. Distance Education: A Systems View of Online Learning. 3rd edition. Belmont, CA: Cengage Learning, 2011.","edition":"3"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.17718\/tojde.971889"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/IISA59645.2023.10345883"},{"key":"e_1_3_3_42_2","unstructured":"Vorvilas G Liapis A Korovesis A et al. Evaluating the quality of master\u2019s thesis supervision in academic distance education: Hellenic Open University students\u2019 perceptions. Digital Reset: European Universities Transforming for a Changing World: Overview of papers as presented during the Innovating Higher Education Conference 2022: 19-21 October 2022 in Athens 2022 ISBN 9789079730452 p\u00e1gs. 472-485 Zenodo; 2022 p. 472\u201385."},{"key":"e_1_3_3_43_2","volume-title":"Content Analysis: An Introduction to Its Methodology","author":"Krippendorff K","year":"2004","unstructured":"Krippendorff K. Content Analysis: An Introduction to Its Methodology. Sage, 2004."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","unstructured":"Nadeau D Sekine S. A survey of named entity recognition and classification. 2007; 30: 3\u201326. 10.1075\/li.30.1.03nad","DOI":"10.1075\/li.30.1.03nad"},{"key":"e_1_3_3_45_2","volume-title":"Practical Text Analytics: Maximizing the Value of Text Data","author":"Anandarajan M","year":"2018","unstructured":"Anandarajan M, Hill C, Nolan T. Practical Text Analytics: Maximizing the Value of Text Data. Springer, 2018."},{"key":"e_1_3_3_46_2","volume-title":"Text Mining: Concepts, Implementation, and Big Data Challenge","author":"Jo T","year":"2018","unstructured":"Jo T. Text Mining: Concepts, Implementation, and Big Data Challenge. 1st ed. 2019 edition. New York, NY: Springer, 2018.","edition":"1"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.122653799"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.76.036106"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.7155\/jgaa.00124"},{"key":"e_1_3_3_51_2","first-page":"849","volume-title":"Proceedings of the 14th international conference on neural information processing systems: natural and synthetic","author":"Ng AY","year":"2001","unstructured":"Ng AY, Jordan MI, Weiss Y. On spectral clustering: analysis and an algorithm. In: Proceedings of the 14th international conference on neural information processing systems: natural and synthetic. Cambridge, MA, USA: MIT Press, 2001, pp.849\u2013856."},{"key":"e_1_3_3_52_2","unstructured":"Welcome to Flask \u2014 Flask Documentation (3.0.x) n.d. https:\/\/flask.palletsprojects.com\/en\/stable\/ (accessed November 8 2024)."},{"key":"e_1_3_3_53_2","unstructured":"Django documentation | Django documentation. Django Project n.d. https:\/\/docs.djangoproject.com\/en\/5.1\/ (accessed November 8 2024)."},{"key":"e_1_3_3_54_2","first-page":"404","volume-title":"Proceedings of the 2004 conference on empirical methods in natural language processing","author":"Mihalcea R","year":"2004","unstructured":"Mihalcea R, Tarau P. Textrank: bringing order into text. In: Lin D, Wu D (eds) Proceedings of the 2004 conference on empirical methods in natural language processing. Barcelona, Spain: Association for Computational Linguistics, 2004, pp.404\u2013411."},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.1"},{"key":"e_1_3_3_56_2","unstructured":"Page L Brin S Motwani R et al. The PageRank Citation Ranking: Bringing Order to the Web 1999."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113"},{"key":"e_1_3_3_58_2","unstructured":"langdetect-py \u00b7 PyPI n.d. https:\/\/pypi.org\/project\/langdetect-py\/ (accessed November 8 2024)."},{"key":"e_1_3_3_59_2","unstructured":"EntityRecognizer \u00b7 spaCy API Documentation. EntityRecognizer n.d. https:\/\/spacy.io\/api\/entityrecognizer\/ (accessed November 8 2024)."},{"key":"e_1_3_3_60_2","unstructured":"spacy-udpipe \u00b7 spaCy Universe. Spacy-Udpipe n.d. https:\/\/spacy.io\/universe\/project\/spacy-udpipe\/ (accessed November 8 2024)."},{"key":"e_1_3_3_61_2","unstructured":"scikit-learn: machine learning in Python \u2014 scikit-learn 1.5.1 documentation n.d. https:\/\/scikit-learn.org\/stable\/ (accessed July 22 2024)."},{"key":"e_1_3_3_62_2","unstructured":"python-igraph stable \u2014 igraph stable documentation n.d. https:\/\/python.igraph.org\/en\/stable\/ (accessed July 22 2024)."},{"key":"e_1_3_3_63_2","unstructured":"GPT-4o mini: advancing cost-efficient intelligence n.d. https:\/\/openai.com\/index\/gpt-4o-mini-advancing-cost-efficient-intelligence\/ (accessed July 22 2024)."},{"key":"e_1_3_3_64_2","unstructured":"Introduction | DeepEval - The Open-Source LLM Evaluation Framework 2024. https:\/\/docs.confident-ai.com\/docs\/evaluation-introduction (accessed November 8 2024)."},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.153"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11912"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.450"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1561\/0400000042"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.11591\/ijece.v13i5.pp5472-5482"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/EDPEE61724.2024.00121."}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18724981241303216","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/18724981241303216","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18724981241303216","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:21:12Z","timestamp":1777454472000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/18724981241303216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,12]]},"references-count":69,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1177\/18724981241303216"],"URL":"https:\/\/doi.org\/10.1177\/18724981241303216","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,12]]}}}