{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T16:59:54Z","timestamp":1791910794300,"version":"4.3.4"},"reference-count":73,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T00:00:00Z","timestamp":1786579200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DUE-1504618"],"award-info":[{"award-number":["DUE-1504618"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>\n                    This study seeks best practices for when and how to apply short text topic modelling (STTM) techniques using natural language processing to semi-structured data collected as part of education research in order to provide accurate guidance for interventions and avoid misguided improvements in education practice. Student feedback was collected using short answer questions that resulted in 1,667, 1,592, and 1,376 expectations for faculty support, teaching assistant (TA) support, and peer support respectively as part of a larger survey conducted via convenience sampling in over 40 engineering courses offered at a single large university between 2016 and 2023. After cleaning and preprocessing the data, short text responses were analyzed using five unsupervised topic models implemented in Python: traditional models Latent Dirichlet Allocation (LDA), Latent Semantic Analysis (LSA), Non-Negative Matrix Factorization (NMF), and\n                    <jats:italic>k<\/jats:italic>\n                    -means and one deep learning model (BERTopic). Model performance was evaluated using topic coherence and exse than that expected by chance (internal performance metrics. Addressing a methodological gap in prior comparative studies that rely predominantly on machine-led evaluation, two approaches to establishing ground truth were evaluated: (a) keywords from each topic model guided manual (human) coding of the data (a machine-led approach); and (b) themes in the data were extracted and coded independently by a domain expert (a human-led approach). NMF achieved the highest average performance in two of the three datasets, reaching 75.6% accuracy, 75.7% F1-Score, and 0.63 interrater reliability for the peer support dataset and 72.6% accuracy, 72.0% F1-Score, and 0.57 interrater reliability for the TA support dataset. The human-led approach yielded higher accuracy and F1-scores for faculty and peer support but failed for TA support when the topics extracted by topic models did not align with themes identified by a domain expert. These findings highlight the need for humans to be involved in the analysis of short text data in contexts like education research where high performance is necessary to achieve appropriate rigor. Domain expert intervention also enables strategic use of topic models to optimize their use in qualitative data analysis.\n                  <\/jats:p>","DOI":"10.1371\/journal.pone.0328697","type":"journal-article","created":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T17:37:41Z","timestamp":1786642661000},"page":"e0328697","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["A comparative analysis of topic modelling techniques for the thematic analysis of student feedback"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-8767-8552","authenticated-orcid":true,"given":"Neha","family":"Kardam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denise","family":"Wilson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,8,13]]},"reference":[{"key":"pone.0328697.ref001","doi-asserted-by":"crossref","unstructured":"Soledad M, Grohs J, Bhaduri S, Doggett J, Williams J, Culver S. Leveraging institutional data to understand student perceptions of teaching in large engineering classes. In: 2017 IEEE Frontiers in Education Conference (FIE), 2017. 1\u20138. https:\/\/doi.org\/10.1109\/fie.2017.8190608","DOI":"10.1109\/FIE.2017.8190608"},{"issue":"2","key":"pone.0328697.ref002","doi-asserted-by":"crossref","first-page":"101094","DOI":"10.1016\/j.lisr.2021.101094","article-title":"Is research with qualitative data more prevalent and impactful now? Interviews, case studies, focus groups and ethnographies","volume":"43","author":"M Thelwall","year":"2021","journal-title":"Libr Inf Sci Res"},{"key":"pone.0328697.ref003","first-page":"57","article-title":"Thematic analysis","author":"V Braun","year":"2012","journal-title":"APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. American Psychological Association"},{"issue":"2","key":"pone.0328697.ref004","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"V Braun","year":"2006","journal-title":"Qual Res Psychol"},{"issue":"3","key":"pone.0328697.ref005","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1007\/s11135-021-01182-y","article-title":"A worked example of Braun and Clarke\u2019s approach to reflexive thematic analysis","volume":"56","author":"DA Byrne","year":"2022","journal-title":"Qual Quant"},{"issue":"7","key":"pone.0328697.ref006","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1177\/0735633120927486","article-title":"Computer science meets education: Natural language processing for automatic grading of open-ended questions in eBooks","volume":"58","author":"GG Smith","year":"2020","journal-title":"J Educ Comput Res"},{"key":"pone.0328697.ref007","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/3-540-28349-8_2","article-title":"A Survey of Clustering Data Mining Techniques","author":"P Berkhin","year":"2006","journal-title":"Grouping Multidimensional Data. Springer-Verlag"},{"issue":"2","key":"pone.0328697.ref008","doi-asserted-by":"crossref","first-page":"102034","DOI":"10.1016\/j.ipm.2019.04.002","article-title":"An evaluation of document clustering and topic modelling in two online social networks: Twitter and Reddit","volume":"57","author":"SA Curiskis","year":"2020","journal-title":"Inf Process Manag"},{"key":"pone.0328697.ref009","doi-asserted-by":"crossref","first-page":"102096","DOI":"10.1016\/j.artmed.2021.102096","article-title":"Evaluation of clustering and topic modeling methods over health-related tweets and emails","volume":"117","author":"JA Lossio-Ventura","year":"2021","journal-title":"Artif Intell Med"},{"key":"pone.0328697.ref010","article-title":"Efficient estimation of word representations in vector space","author":"T Mikolov","year":"2013","journal-title":"arXiv"},{"key":"pone.0328697.ref011","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, 2013. 3111\u20139."},{"key":"pone.0328697.ref012","doi-asserted-by":"crossref","first-page":"886498","DOI":"10.3389\/fsoc.2022.886498","article-title":"A Topic Modeling Comparison Between LDA, NMF, Top2Vec, and BERTopic to Demystify Twitter Posts","volume":"7","author":"R Egger","year":"2022","journal-title":"Front Sociol"},{"key":"pone.0328697.ref013","first-page":"601","article-title":"Latent Dirichlet Allocation","author":"DM Blei","year":"2002","journal-title":"Advances in Neural Information Processing Systems 14. The MIT Press"},{"issue":"2","key":"pone.0328697.ref014","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1109\/TLT.2021.3064798","article-title":"Analyzing Large Collections of Open-Ended Feedback From MOOC Learners Using LDA Topic Modeling and Qualitative Analysis","volume":"14","author":"G Nanda","year":"2021","journal-title":"IEEE Trans Learning Technol"},{"issue":"1","key":"pone.0328697.ref015","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s44217-023-00051-0","article-title":"Using topic modeling to understand comments in student evaluations of teaching","volume":"2","author":"J Sun","year":"2023","journal-title":"Discov Educ"},{"key":"pone.0328697.ref016","doi-asserted-by":"crossref","first-page":"35318","DOI":"10.1109\/ACCESS.2020.2974983","article-title":"Text Mining of Open-Ended Questions in Self-Assessment of University Teachers: An LDA Topic Modeling Approach","volume":"8","author":"D Buenano-Fernandez","year":"2020","journal-title":"IEEE Access"},{"issue":"2","key":"pone.0328697.ref017","doi-asserted-by":"crossref","first-page":"4495","DOI":"10.3233\/JIFS-232971","article-title":"Characteristics of students\u2019 learning behavior preferences \u2014 an analysis of self-commentary data based on the LDA model","volume":"46","author":"D Shi","year":"2024","journal-title":"IFS"},{"issue":"3","key":"pone.0328697.ref018","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/TKDE.2020.2992485","article-title":"Short Text Topic Modeling Techniques, Applications, and Performance: A Survey","volume":"34","author":"J Qiang","year":"2022","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"1","key":"pone.0328697.ref019","doi-asserted-by":"crossref","DOI":"10.24059\/olj.v28i1.3571","article-title":"The Viability of Topic Modeling to Identify Participant Motivations for Enrolling in Online Professional Development","volume":"28","author":"HA Barker","year":"2024","journal-title":"OLJ"},{"key":"pone.0328697.ref020","doi-asserted-by":"crossref","DOI":"10.4324\/9780203936399","author":"TK Landauer","year":"2007","journal-title":"Handbook of latent semantic analysis. New York: Psychology Press"},{"key":"pone.0328697.ref021","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611976410","author":"N Gillis","year":"2020","journal-title":"Nonnegative matrix factorization. Philadelphia: Society for Industrial and Applied Mathematics"},{"issue":"2","key":"pone.0328697.ref022","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1177\/0013164419860575","article-title":"Using Latent Semantic Analysis to Score Short Answer Constructed Responses: Automated Scoring of the Consequences Test","volume":"80","author":"N LaVoie","year":"2020","journal-title":"Educ Psychol Meas"},{"issue":"2","key":"pone.0328697.ref023","doi-asserted-by":"crossref","first-page":"429","DOI":"10.4304\/jsw.9.2.429-436","article-title":"Automated essay scoring using incremental latent semantic analysis","volume":"9","author":"M Zhang","year":"2014","journal-title":"J Softw"},{"issue":"1","key":"pone.0328697.ref024","doi-asserted-by":"crossref","first-page":"67","DOI":"10.2190\/EC.47.1.d","article-title":"On the reliability and validity of human and LSA-based evaluations of complex student-authored texts","volume":"47","author":"E Seifried","year":"2012","journal-title":"J Educ Comput Res"},{"key":"pone.0328697.ref025","doi-asserted-by":"crossref","unstructured":"Hoblos J. Experimenting with Latent Semantic Analysis and Latent Dirichlet Allocation on Automated Essay Grading. In: 2020 Seventh International Conference on Social Networks Analysis, Management and Security (SNAMS), 2020. 1\u20137. https:\/\/doi.org\/10.1109\/snams52053.2020.9336533","DOI":"10.1109\/SNAMS52053.2020.9336533"},{"key":"pone.0328697.ref026","unstructured":"Forster E, Dunbar K. Creativity evaluation through latent semantic analysis. In: Proceedings of the 31st Annual Conference of the Cognitive Science Society, Amsterdam, Netherlands, 2009. 2728\u201333."},{"key":"pone.0328697.ref027","first-page":"939","volume-title":"Automated essay scoring: Applications to educational technology","author":"PW Foltz","year":"1999"},{"key":"pone.0328697.ref028","article-title":"Implementation and Applications of the Intelligent Essay Assessor","author":"PW Foltz","journal-title":"Handbook of Automated Essay Evaluation. Routledge"},{"key":"pone.0328697.ref029","doi-asserted-by":"crossref","DOI":"10.2196\/78371","article-title":"Exploring Gender Perspectives in Medical Education: Latent Semantic Analysis of Israeli First-Year Medical Students\u2019 Reflections","volume":"11","author":"R Khamisy-Farah","year":"2025","journal-title":"JMIR Med Educ"},{"key":"pone.0328697.ref030","doi-asserted-by":"crossref","unstructured":"Kurniawan R, Ibnu Daqiqil ID, Indra Z. Analyzing Student Perspectives on Learning Experience Using Latent Semantic Indexing Algorithm. In: 2023 6th International Conference of Computer and Informatics Engineering (IC2IE), 2023. 287\u201391. https:\/\/doi.org\/10.1109\/ic2ie60547.2023.10331300","DOI":"10.1109\/IC2IE60547.2023.10331300"},{"issue":"6755","key":"pone.0328697.ref031","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1038\/44565","article-title":"Learning the parts of objects by non-negative matrix factorization","volume":"401","author":"DD Lee","year":"1999","journal-title":"Nature"},{"key":"pone.0328697.ref032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.knosys.2018.08.011","article-title":"Experimental explorations on short text topic mining between LDA and NMF based Schemes","volume":"163","author":"Y Chen","year":"2019","journal-title":"Knowledge-Based Systems"},{"issue":"2","key":"pone.0328697.ref033","doi-asserted-by":"crossref","first-page":"268","DOI":"10.62411\/jcta.11635","article-title":"Comprehensive evaluation of LDA, NMF, and BERTopic\u2019s performance on news headline topic modeling","volume":"2","author":"O Babalola","year":"2024","journal-title":"J Comput Theor Appl"},{"issue":"62","key":"pone.0328697.ref034","first-page":"28210","article-title":"Comparison of LDA and NMF topic modeling techniques for restaurant reviews","volume":"10","author":"S George","year":"2020","journal-title":"Indian J Nat Sci"},{"issue":"13","key":"pone.0328697.ref035","doi-asserted-by":"crossref","first-page":"5645","DOI":"10.1016\/j.eswa.2015.02.055","article-title":"An analysis of the coherence of descriptors in topic modeling","volume":"42","author":"D O\u2019Callaghan","year":"2015","journal-title":"Expert Systems with Applications"},{"key":"pone.0328697.ref036","doi-asserted-by":"crossref","unstructured":"Hayat F, Shatnawi S, Haig E. Comparative Analysis of Topic Modelling Approaches on Student Feedback. In: Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, 2024. 226\u201333. https:\/\/doi.org\/10.5220\/0012890400003838","DOI":"10.5220\/0012890400003838"},{"key":"pone.0328697.ref037","article-title":"A case study in text mining: Interpreting twitter data from world cup tweets","author":"D Godfrey","year":"2014","journal-title":"arXiv"},{"key":"pone.0328697.ref038","doi-asserted-by":"crossref","unstructured":"Nanyonga A, Wasswa H, Wild G. Topic Modeling Analysis of Aviation Accident Reports: A Comparative Study between LDA and NMF Models. In: 2023 3rd International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON), 2023. 1\u20132. https:\/\/doi.org\/10.1109\/smartgencon60755.2023.10442471","DOI":"10.1109\/SMARTGENCON60755.2023.10442471"},{"key":"pone.0328697.ref039","doi-asserted-by":"crossref","unstructured":"Suri P, Roy NR. Comparison between LDA & NMF for event-detection from large text stream data. In: 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT), 2017. 1\u20135. https:\/\/doi.org\/10.1109\/ciact.2017.7977281","DOI":"10.1109\/CIACT.2017.7977281"},{"key":"pone.0328697.ref040","doi-asserted-by":"crossref","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), Minneapolis, MN, 2019. 4171\u201386. https:\/\/doi.org\/10.18653\/v1\/N19-1423","DOI":"10.18653\/v1\/N19-1423"},{"key":"pone.0328697.ref041","article-title":"BERTopic: Neural topic modeling with a class-based TF-IDF procedure","author":"M Grootendorst","year":"2022","journal-title":"arXiv"},{"issue":"5","key":"pone.0328697.ref042","doi-asserted-by":"crossref","first-page":"5501","DOI":"10.1007\/s10639-024-13003-4","article-title":"Efficient topic identification for urgent MOOC forum posts using BERTopic and traditional topic modeling techniques","volume":"30","author":"N Khodeir","year":"2024","journal-title":"Educ Inf Technol"},{"key":"pone.0328697.ref043","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-3-031-50755-7_16","article-title":"Multilingual Transformer and BERTopic for Short Text Topic Modeling: The Case of Serbian","author":"D Medvecki","year":"2024","journal-title":"Lecture Notes in Networks and Systems. Springer Nature Switzerland"},{"key":"pone.0328697.ref044","doi-asserted-by":"crossref","first-page":"1608241","DOI":"10.3389\/fpubh.2025.1608241","article-title":"BERTopic_Teen: a multi-module optimization approach for short text topic modeling in adolescent health","volume":"13","author":"Y Feng","year":"2025","journal-title":"Front Public Health"},{"key":"pone.0328697.ref045","doi-asserted-by":"crossref","unstructured":"Julanta Leela RJ, Bhuvaneswari A, Kumudha M. Topic modeling based clustering of disaster tweets using BERTopic. In: 2024 MIT Art, Design and Technology School of Computing International Conference (MITADTSoCiCon), Pune, India, 2024. 1\u20136. https:\/\/doi.org\/10.1109\/MITADTSoCiCon60330.2024.10575424","DOI":"10.1109\/MITADTSoCiCon60330.2024.10575555"},{"key":"pone.0328697.ref046","doi-asserted-by":"crossref","unstructured":"Udupa A, Adarsh KN, Aravinda A, Godihal NH, Kayarvizhy N. An Exploratory Analysis of GSDMM and BERTopic on Short Text Topic Modelling. In: 2022 Fourth International Conference on Cognitive Computing and Information Processing (CCIP), 2022. 1\u20139. https:\/\/doi.org\/10.1109\/ccip57447.2022.10058687","DOI":"10.1109\/CCIP57447.2022.10058687"},{"key":"pone.0328697.ref047","doi-asserted-by":"crossref","first-page":"42","DOI":"10.3389\/frai.2020.00042","article-title":"Using Topic Modeling Methods for Short-Text Data: A Comparative Analysis","volume":"3","author":"R Albalawi","year":"2020","journal-title":"Front Artif Intell"},{"key":"pone.0328697.ref048","first-page":"4363","article-title":"Benchmarking neural topic models: an empirical study","volume":"2021","author":"TN Doan","year":"2021","journal-title":"Findings of the Association for Computational Linguistics: ACL-IJCNLP"},{"issue":"6","key":"pone.0328697.ref049","doi-asserted-by":"crossref","first-page":"495","DOI":"10.32604\/csse.2020.35.495","article-title":"Semantic Analysis Techniques using Twitter Datasets on Big Data: Comparative Analysis Study","volume":"35","author":"B Abdullah Hezam Murshed","year":"2020","journal-title":"Computer Systems Science and Engineering"},{"issue":"12","key":"pone.0328697.ref050","doi-asserted-by":"crossref","DOI":"10.14569\/IJACSA.2023.0141226","article-title":"Comprehensive Analysis of Topic Models for Short and Long Text Data","volume":"14","author":"A Goyal","year":"2023","journal-title":"IJACSA"},{"issue":"1","key":"pone.0328697.ref051","doi-asserted-by":"crossref","first-page":"12003","DOI":"10.1038\/s41598-024-61738-4","article-title":"Investigating topic modeling techniques through evaluation of topics discovered in short texts data across diverse domains","volume":"14","author":"R Muthusami","year":"2024","journal-title":"Sci Rep"},{"key":"pone.0328697.ref052","doi-asserted-by":"crossref","unstructured":"Doi T, Isonuma M, Yanaka H. Topic Modeling for Short Texts with Large Language Models. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), 2024. 21\u201333. https:\/\/doi.org\/10.18653\/v1\/2024.acl-srw.3","DOI":"10.18653\/v1\/2024.acl-srw.3"},{"key":"pone.0328697.ref053","doi-asserted-by":"crossref","unstructured":"Sheils J, Dampier D, Malik H. A Comparative Study of Topic Models for Student Evaluations. In: 2024 ASEE North Central Section Conference Proceedings. https:\/\/doi.org\/10.18260\/1-2--45589","DOI":"10.18260\/1-2--45589"},{"issue":"4","key":"pone.0328697.ref054","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1002\/jee.20542","article-title":"How did the landscape of student belonging shift during COVID\u201019?","volume":"112","author":"S Misra","year":"2023","journal-title":"J of Engineering Edu"},{"key":"pone.0328697.ref055","first-page":"281","article-title":"Some methods for classification and analysis of multivariate observations.","volume-title":"Proceedings of the fifth Berkeley symposium on mathematical statistics and probability","author":"J. MacQueen","year":"1967"},{"key":"pone.0328697.ref056","unstructured":"Scikit-learn developers. Count Vectorizer. Scikit-learn. 2018. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.feature_extraction.text.CountVectorizer.html"},{"key":"pone.0328697.ref057","article-title":"Fundamentals of bag of words and TF-IDF","author":"P Singh","year":"2019","journal-title":"Medium"},{"key":"pone.0328697.ref058","doi-asserted-by":"crossref","unstructured":"Marutho D, Hendra Handaka S, Wijaya E, Muljono. The Determination of Cluster Number at k-Mean Using Elbow Method and Purity Evaluation on Headline News. In: 2018 International Seminar on Application for Technology of Information and Communication, 2018. 533\u20138. https:\/\/doi.org\/10.1109\/isemantic.2018.8549751","DOI":"10.1109\/ISEMANTIC.2018.8549751"},{"key":"pone.0328697.ref059","unstructured":"Stevens K, Kegelmeyer P, Andrzejewski D, Buttler D. Exploring topic coherence over many models and many topics. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jeju Island, Korea, 2012. 952\u201361."},{"issue":"4","key":"pone.0328697.ref060","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/BF02289263","article-title":"Who Belongs in the Family?","volume":"18","author":"RL Thorndike","year":"1953","journal-title":"Psychometrika"},{"issue":"2","key":"pone.0328697.ref061","doi-asserted-by":"crossref","first-page":"01","DOI":"10.5121\/ijdkp.2015.5201","article-title":"A Review on Evaluation Metrics for Data Classification Evaluations","volume":"5","author":"M Hossin","year":"2015","journal-title":"IJDKP"},{"key":"pone.0328697.ref062","doi-asserted-by":"crossref","unstructured":"Yacouby R, Axman D. Probabilistic Extension of Precision, Recall, and F1 Score for More Thorough Evaluation of Classification Models. In: Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems, 2020. 79\u201391. https:\/\/doi.org\/10.18653\/v1\/2020.eval4nlp-1.9","DOI":"10.18653\/v1\/2020.eval4nlp-1.9"},{"issue":"1","key":"pone.0328697.ref063","doi-asserted-by":"crossref","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","article-title":"Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial","volume":"8","author":"KA Hallgren","year":"2012","journal-title":"Tutor Quant Methods Psychol"},{"key":"pone.0328697.ref064","doi-asserted-by":"crossref","unstructured":"Derczynski L. Complementarity, f-score, and nlp evaluation. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916), Portoroz, Slovenia, Paris: European Language Resources Association. 2016. 261\u20136.","DOI":"10.63317\/2qtxhh68xnxz"},{"key":"pone.0328697.ref065","first-page":"526","article-title":"Providing insights for open-response surveys via end-to-end context-aware clustering.","author":"S Esmaeilzadeh","year":"2022","journal-title":"Artificial Intelligence in Education. Durham, UK, Cham: Springer"},{"key":"pone.0328697.ref066","doi-asserted-by":"crossref","first-page":"3398","DOI":"10.24297\/ijrem.v10i0.8495","article-title":"Automated Answer Scoring for Engineering\u2019s Open-Ended Questions","volume":"10","author":"MS Ahmed","year":"2019","journal-title":"IJREM"},{"key":"pone.0328697.ref067","first-page":"348","article-title":"Information theory, inference, and learning algorithms","author":"AM Andrew","year":"2003","journal-title":"Robotica. Cambridge: Cambridge University Press"},{"key":"pone.0328697.ref068","unstructured":"Rosa KD, Shah R, Lin B, Gershman A, Frederking R. Topical clustering of tweets. In: Proceedings of the ACM SIGIR Workshop on Social Web Search and Mining (SWSM). 2011. 63. https:\/\/www.cs.cmu.edu\/~encore\/sigir_swsm2011.pdf"},{"key":"pone.0328697.ref069","doi-asserted-by":"crossref","unstructured":"Mazarura J, de Waal A. A comparison of the performance of latent Dirichlet allocation and the Dirichlet multinomial mixture model on short text. In: 2016 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech). Stellenbosch, South Africa: IEEE. 2016. 1\u20136. https:\/\/doi.org\/10.1109\/ROBOMECH.2016.7813155","DOI":"10.1109\/RoboMech.2016.7813155"},{"key":"pone.0328697.ref070","doi-asserted-by":"crossref","unstructured":"Zuo Y, Wu J, Zhang H, Lin H, Wang F, Xu K. Topic modeling of short texts: a pseudo-document view. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, 2016. 2105\u201314. https:\/\/doi.org\/10.1145\/2939672.2939880","DOI":"10.1145\/2939672.2939880"},{"issue":"1","key":"pone.0328697.ref071","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1002\/aris.1440380105","article-title":"Latent semantic analysis","volume":"38","author":"ST Dumais","year":"2004","journal-title":"Annual Review Info Sci & Tec"},{"issue":"5","key":"pone.0328697.ref072","doi-asserted-by":"crossref","first-page":"1665","DOI":"10.1111\/ssqu.12528","article-title":"Topic Modeling: Latent Semantic Analysis for the Social Sciences","volume":"99","author":"D Valdez","year":"2018","journal-title":"Social Science Quarterly"},{"key":"pone.0328697.ref073","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.eng.2022.04.024","article-title":"Pre-Trained Language Models and Their Applications","volume":"25","author":"H Wang","year":"2023","journal-title":"Engineering"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0328697","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T17:37:53Z","timestamp":1786642673000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0328697"}},"subtitle":[],"editor":[{"given":"Farshid","family":"Danesh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,8,13]]},"references-count":73,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0328697","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,13]]}}}