{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T14:58:30Z","timestamp":1790693910867,"version":"4.1.0"},"reference-count":71,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:00:00Z","timestamp":1790035200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>The process of stemming is a fundamental part of pre-processing in NLP systems in resource-poor and morphologically complex languages in which linguistic data and annotated corpora are limited. This survey presents a a systematic review of stemming techniques across Afro-Asiatic, Indo-Aryan, Turkic, and Uralic language families, with explicit acknowledgment of coverage limitation and it covers rule-based, statistical, unsupervised, hybrid, and emerging neural-assisted approaches. The evolution of stemming is analyzed in the broader context of NLP paradigms, from early suffix-stripping algorithms to modern sub-word-aware and transformer-influenced models. Special emphasis has been given on resource-poor languages such as Arabic, Urdu, Bengali, Assamese, and other low-resource Indo-Aryan, Afro-Asiatic, and agglutinative languages. For these languages performing explicit stemming remains a critical task despite advances in deep learning. This study further reviews application-driven impacts of stemming in information retrieval, text classification, sentiment analysis, topic modeling, and semantic similarity estimation. A unified comparison framework is presented which has incorporated benchmark datasets, shared-task resources, and multi-dimensional evaluation metrics, including precision, recall, F-measure, MAP, NMI, and stemming-specific error indices. Using careful comparative evaluation, this study points out the strengths and weaknesses of current approaches and provides insights into potential areas for future investigation and developments in language-sensitive stemming systems.<\/jats:p>","DOI":"10.3389\/frai.2026.1875268","type":"journal-article","created":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T11:31:34Z","timestamp":1790076694000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Stemming techniques for resource-poor languages: a review of methods, challenges, and applications"],"prefix":"10.3389","volume":"9","author":[{"given":"Sanjiban Sekhar","family":"Roy","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Vellore Institute of Technology","place":["Vellore, Tamil Nadu, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohd","family":"Anas","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Vellore Institute of Technology","place":["Vellore, Tamil Nadu, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saravanakumar","family":"Kandasamy","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Vellore Institute of Technology","place":["Vellore, Tamil Nadu, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,22]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1316457.1316459","article-title":"Stemming indonesian: a confix-stripping approach","volume":"6","author":"Adriani","year":"2007","journal-title":"ACM Trans. Asian Lang. Inf. Proc"},{"key":"B2","article-title":"Quranmorph: morphologically annotated quranic corpus","author":"Akra","year":"2025","journal-title":"arXiv preprint arXiv:2506.18148"},{"key":"B3","doi-asserted-by":"publisher","first-page":"e530","DOI":"10.7717\/peerj-cs.530","article-title":"Effect of stemming on text similarity for arabic language at sentence level","volume":"7","author":"Alhawarat","year":"2021","journal-title":"PeerJ Comput. Sci"},{"key":"B4","doi-asserted-by":"publisher","first-page":"7374","DOI":"10.1109\/ACCESS.2017.2787798","article-title":"Pattern based comprehensive urdu stemmer and short text classification","volume":"6","author":"Ali","year":"2017","journal-title":"IEEE Access"},{"key":"B5","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.eij.2020.02.004","article-title":"An intelligent use of stemmer and morphology analysis for arabic information retrieval","volume":"21","author":"Alnaied","year":"2020","journal-title":"Egypt. Inf. J"},{"key":"B6","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1016\/j.cogsys.2018.07.003","article-title":"A cognitive inspired unsupervised language-independent text stemmer for information retrieval","volume":"52","author":"Alotaibi","year":"2018","journal-title":"Cogn. Syst. Res"},{"key":"B7","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1016\/j.eij.2022.02.006","article-title":"Bpr algorithm: New broken plural rules for an arabic stemmer","volume":"23","author":"Alshalabi","year":"","journal-title":"Egypt. Inf. J"},{"key":"B8","doi-asserted-by":"publisher","first-page":"6635","DOI":"10.1016\/j.jksuci.2021.08.017","article-title":"Arabic light-based stemmer using new rules","volume":"34","author":"Alshalabi","year":"","journal-title":"J. King Saud Univ. Comput. Inf. Sci"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3715120","article-title":"A survey of document stemming algorithms in information retrieval systems","volume":"24","author":"Alyousf","year":"2025","journal-title":"ACM Trans. Asian Low-Resour. Lang. Inf. Proc"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e0300725","DOI":"10.1371\/journal.pone.0300725","article-title":"A deep learning approach for named entity recognition in urdu language","volume":"19","author":"Anam","year":"2024","journal-title":"PLoS ONE"},{"key":"B11","doi-asserted-by":"publisher","first-page":"110245","DOI":"10.1109\/ACCESS.2023.3322101","article-title":"Bert-based sentiment analysis for low-resourced languages: a case study of urdu language","volume":"11","author":"Ashraf","year":"2023","journal-title":"IEEE Access"},{"key":"B12","doi-asserted-by":"publisher","first-page":"45866","DOI":"10.1109\/ACCESS.2019.2908177","article-title":"Root identification tool for arabic verbs","volume":"7","author":"Azman","year":"2019","journal-title":"IEEE Access"},{"key":"B13","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.csl.2013.03.004","article-title":"Comparative experiments using supervised learning and machine translation for multilingual sentiment analysis","volume":"28","author":"Balahur","year":"2014","journal-title":"Comput. Speech Lang"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.conll-1.39","article-title":"\u201cVorm: translations and a constrained hypothesis space support unsupervised morphological segmentation across languages,\u201d","author":"Beekhuizen","year":"2025","journal-title":"Proceedings of the 29th conference on computational natural language learning"},{"key":"B15","first-page":"79","article-title":"\u201cMorpheme segmentation for kannada standing on the shoulder of giants,\u201d","author":"Bhat","year":"2012","journal-title":"Proceedings of the 3rd workshop on south and southeast asian natural language processing"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3292398","article-title":"Unsupervised joint pos tagging and stemming for agglutinative languages","volume":"18","author":"B\u00f6l\u00fcc\u00fc","year":"2019","journal-title":"ACM Trans. Asian Low-Resour. Lang. Inf. Proc"},{"key":"B17","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1002\/(SICI)1097-4571(199401)45:1<12::AID-ASI2>3.0.CO;2-L","article-title":"The relationship between recall and precision","volume":"45","author":"Buckland","year":"1994","journal-title":"J. Am. Soc. Inf. Sci"},{"key":"B18","article-title":"\u201cN-gram-based text categorization,\u201d","volume-title":"Proceedings of SDAIR-94, 3rd annual symposium on document analysis and information retrieval","author":"Cavnar","year":"1994"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1145\/3129416.3129453","article-title":"\u201cMorphological cluster induction of bantu words using a weighted similarity measure,\u201d","author":"Chavula","year":"2017","journal-title":"Proceedings of the South African institute of computer scientists and information technologists"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.SP.500-251.xlingual-berkeley","article-title":"\u201cBuilding an arabic stemmer for information retrieval,\u201d","author":"Chen","year":"2002","journal-title":"TREC"},{"key":"B21","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1007\/s44196-024-00679-2","article-title":"Effective stemmers using trie data structure for enhanced processing of gujarati text","volume":"17","author":"Dave","year":"","journal-title":"Int. J. Comput. Intell. Syst"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3604612","article-title":"A systematic review of stemmers of indian and non-indian vernacular languages","volume":"23","author":"Dave","year":"","journal-title":"ACM Trans. Asian Low-Resour. Lang. Inf. Proc"},{"key":"B23","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1109\/ICCSE.2013.6553926","article-title":"\u201cTwitter news classification using svm,\u201d","author":"Dilrukshi","year":"2013","journal-title":"2013 8th international conference on computer science &education"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511546914","author":"Feldman","year":"2007","journal-title":"The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1080\/0952813X.2023.2165714","article-title":"Kreolstem: A hybrid language-dependent stemmer for kreol morisien","volume":"36","author":"Gobin-Rahimbux","year":"2024","journal-title":"J. Exper. Theor. Artif. Intell"},{"key":"B26","doi-asserted-by":"publisher","first-page":"e1175","DOI":"10.7717\/peerj-cs.1175","article-title":"A selective approach to stemming for minimizing the risk of failure in information retrieval systems","volume":"9","author":"G\u00f6ksel","year":"2023","journal-title":"PeerJ Comput. Sci"},{"key":"B27","first-page":"744","article-title":"\u201cA fully bayesian approach to unsupervised part-of-speech tagging,\u201d","volume-title":"Proceedings of the 45th annual meeting of the association of computational linguistics","author":"Goldwater","year":"2007"},{"key":"B28","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1109\/ACLing.2015.11","article-title":"\u201cArabic natural language processing from software engineering to complex pipeline,\u201d","author":"Jaafar","year":"2015","journal-title":"2015 first international conference on Arabic computational linguistics (ACLing)"},{"key":"B29","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.jksuci.2016.11.010","article-title":"Enhancing arabic stemming process using resources and benchmarking tools","volume":"29","author":"Jaafar","year":"2017","journal-title":"J. King Saud Univ.-Comput. Inf. Sci"},{"key":"B30","doi-asserted-by":"publisher","first-page":"100195","DOI":"10.1016\/j.cosrev.2019.100195","article-title":"A comparative review of urdu stemmers: approaches and challenges","volume":"34","author":"Jabbar","year":"2019","journal-title":"Comput. Sci. Rev"},{"key":"B31","author":"Krishn","year":"2012","journal-title":"Unsupervised Morphological Analysis of Hindi"},{"key":"B32","author":"Krishnakumar","year":"2006","journal-title":"Text categorization building a knn classifier for the reuters-21578 collection"},{"key":"B33","first-page":"349","article-title":"Literature review: stemming algorithms for indian and non-indian languages","volume":"2","author":"Lakshmi","year":"2014","journal-title":"Int. J. Adv. Res. Comput. Sci. Technol"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564425","article-title":"\u201cImproving stemming for arabic information retrieval: light stemming and co-occurrence analysis,\u201d","author":"Larkey","year":"2002","journal-title":"Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017884","article-title":"\u201cDirichlet multinomial mixture with variational manifold regularization: topic modeling over short texts,\u201d","author":"Li","year":"2019","journal-title":"Proceedings of the AAAI conference on artificial intelligence"},{"key":"B36","article-title":"Team ryu's submission to sigmorphon 2024 shared task on subword tokenization","author":"Li","year":"2024","journal-title":"arXiv preprint arXiv:2410.17094"},{"key":"B37","first-page":"22","article-title":"Development of a stemming algorithm","volume":"11","author":"Lovins","year":"1968","journal-title":"Mech. Transl. Comput. Linguistics"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3405843","article-title":"The impact of weighting schemes and stemming process on topic modeling of arabic long and short texts","volume":"19","author":"Ma","year":"2020","journal-title":"ACM Trans. Asian Low Resour. Lang. Inf. Proc"},{"key":"B39","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1007\/978-3-031-50755-7_16","article-title":"\u201cMultilingual transformer and bertopic for short text topic modeling: the case of serbian,\u201d","author":"Medvecki","year":"2023","journal-title":"Conference on information technology and its applications"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1145\/956863.956889","article-title":"\u201cA novel method for stemmer generation based on hidden markov models,\u201d","author":"Melucci","year":"2003","journal-title":"Proceedings of the twelfth international conference on Information and knowledge management"},{"key":"B41","first-page":"155","article-title":"Tagging English text with a probabilistic model","volume":"20","author":"Merialdo","year":"1994","journal-title":"Comput. Ling"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4236\/iim.2019.111001","article-title":"Developing two different novel techniques for Arabic text stemming","volume":"11","author":"Mustafa","year":"2019","journal-title":"Intell. Inf. Manag"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1016\/j.procs.2020.03.212","article-title":"Design and development of unsupervised stemmer for Sindhi language","volume":"167","author":"Nathani","year":"2020","journal-title":"Procedia Comput. Sci"},{"key":"B44","first-page":"4034","article-title":"\u201cUniversal dependencies v2: an evergrowing multilingual treebank collection,\u201d","author":"Nivre","year":"2020","journal-title":"Proceedings of the twelfth language resources and evaluation conference"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ASYU52992.2021.9599035","article-title":"\u201cUnsupervised lexicon-based stemming by dual dictionary models,\u201d","author":"\u00d6zbey","year":"2021","journal-title":"2021 innovations in intelligent systems and applications conference (ASYU)"},{"key":"B46","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1007\/978-1-4471-2099-5_5","article-title":"\u201cAn evaluation method for stemming algorithms,\u201d","author":"Paice","year":"1994","journal-title":"SIGIR'94: proceedings of the seventeenth annual international ACM-SIGIR conference on research and development in information retrieval, organised by Dublin City University"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010031","article-title":"\u201cA novel corpus-based stemming algorithm using co-occurrence statistics,\u201d","author":"Paik","year":"2011","journal-title":"Proceedings of the 34th international ACM SIGIR conference on research and development in information retrieval"},{"key":"B48","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1017\/nlp.2024.33","article-title":"Natural language processing applications for low-resource languages","volume":"31","author":"Pakray","year":"2025","journal-title":"Nat. Lang. Proc"},{"key":"B49","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1108\/eb046814","article-title":"An algorithm for suffix stripping","volume":"14","author":"Porter","year":"1980","journal-title":"Program"},{"key":"B50","doi-asserted-by":"publisher","first-page":"107477","DOI":"10.1016\/j.rineng.2025.107477","article-title":"Enhancing word sense disambiguation for Hindi agriculture domain: feature engineering and machine learning approaches","volume":"28","author":"Purohit","year":"2025","journal-title":"Results Eng"},{"key":"B51","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MASSP.1986.1165342","article-title":"An introduction to hidden markov models","volume":"3","author":"Rabiner","year":"2003","journal-title":"IEEE ASSP Mag"},{"key":"B52","doi-asserted-by":"publisher","first-page":"101464","DOI":"10.1016\/j.csl.2022.101464","article-title":"Hottest: hate and offensive content identification in Tamil using transformers and enhanced stemming","volume":"78","author":"Rajalakshmi","year":"2023","journal-title":"Comput. Speech Lang"},{"key":"B53","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s40537-021-00413-1","article-title":"Improving the accuracy of text classification using stemming method, a case of non-formal indonesian conversation","volume":"8","author":"Rianto","year":"2021","journal-title":"J. Big Data"},{"key":"B54","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1007\/978-3-642-37247-6_14","article-title":"\u201cAn improved stemming approach using hmm for a highly inflectional language,\u201d","author":"Saharia","year":"2013","journal-title":"International conference on intelligent text processing and computational linguistics"},{"key":"B55","doi-asserted-by":"publisher","first-page":"1540","DOI":"10.30574\/ijsra.2025.14.2.0518","article-title":"Trends in natural language processing for text classification: a comprehensive survey","volume":"14","author":"Said","year":"2025","journal-title":"Int. J. Sci. Res. Arch"},{"key":"B56","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1007\/978-3-540-39984-1_18","article-title":"\u201cFindstem: analysis and evaluation of a Turkish stemming algorithm,\u201d","author":"Sever","year":"2003","journal-title":"International symposium on string processing and information retrieval"},{"key":"B57","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1561\/1500000107","article-title":"From foundations to gpt in text classification: a comprehensive survey on current approaches and future trends","volume":"19","author":"Siino","year":"2025","journal-title":"Found. Trends Inf. Retr"},{"key":"B58","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.knosys.2019.05.025","article-title":"A novel unsupervised corpus-based stemming technique using lexicon and corpus statistics","volume":"180","author":"Singh","year":"2019","journal-title":"Knowl.-Based Syst"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/E14-2006","article-title":"\u201cMorfessor 2.0: toolkit for statistical morphological segmentation,\u201d","author":"Smit","year":"2014","journal-title":"Proceedings of the demonstrations at the 14th conference of the european chapter of the association for computational linguistics"},{"key":"B60","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/s10579-011-9165-9","article-title":"A survey of methods to ease the development of highly multilingual text mining applications","volume":"46","author":"Steinberger","year":"2012","journal-title":"Lang. Resour. Eval"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5003","article-title":"\u201cOpen-source tools for morphology, lemmatization, pos tagging and named entity recognition,\u201d","author":"Strakov\u00e1","year":"2014","journal-title":"Proceedings of 52nd annual meeting of the association for computational linguistics: system demonstrations"},{"key":"B62","doi-asserted-by":"publisher","first-page":"3807","DOI":"10.1016\/j.jksuci.2021.01.006","article-title":"Stemmer and phonotactic rules to improve n-gram tagger-based indonesian phonemicization","volume":"34","author":"Suyanto","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci"},{"key":"B63","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1109\/ICIEV.2016.7760117","article-title":"\u201cA corpus based unsupervised bangla word stemming using n-gram language model,\u201d","author":"Urmi","year":"2016","journal-title":"2016 5th international conference on informatics, electronics and vision (ICIEV)"},{"key":"B64","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1109\/CCTAE.2010.5544382","article-title":"\u201cAn improved TF-IDF weights function based on information theory,\u201d","author":"Wang","year":"2010","journal-title":"2010 international conference on computer and communication technologies in agriculture engineering"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657949","article-title":"\u201cLarge language models based stemming for information retrieval: promises, pitfalls and failures,\u201d","author":"Wang","year":"2024","journal-title":"Proceedings of the 47th international acm sigir conference on research and development in information retrieval"},{"key":"B66","first-page":"465","article-title":"\u201cTerm weighting schemes for latent dirichlet allocation,\u201d","author":"Wilson","year":"2010","journal-title":"Human language technologies: the 2010 annual conference of the North American chapter of the association for computational linguistics"},{"key":"B67","first-page":"74","article-title":"\u201cDudu: a treebank for ottoman turkish in ud style,\u201d","author":"Y\u0131landilo\u011flu","year":"2025","journal-title":"Proceedings of the third workshop on resources and representations for under-resourced languages and domains (RESOURCEFUL-2025)"},{"key":"B68","doi-asserted-by":"publisher","author":"Yin","year":"2014","DOI":"10.1145\/2623330.2623715"},{"key":"B69","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1109\/IC3INA.2018.8629531","article-title":"\u201cOn empirical evaluation of deep architectures for indonesian pos tagging problem,\u201d","author":"Yuwana","year":"2018","journal-title":"2018 international conference on computer, control, informatics and its applications (IC3INA)"},{"key":"B70","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ISACV.2017.8054932","article-title":"\u201cArabic information retrieval: stemming or lemmatization?,\u201d","author":"Zeroual","year":"2017","journal-title":"2017 intelligent systems and computer vision (ISCV)"},{"key":"B71","article-title":"On the importance of subword information for morphological tasks in truly low-resource languages","author":"Zhu","year":"2019","journal-title":"arXiv preprint arXiv:1909.12375"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1875268\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T14:03:27Z","timestamp":1790690607000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1875268\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,22]]},"references-count":71,"alternative-id":["10.3389\/frai.2026.1875268"],"URL":"https:\/\/doi.org\/10.3389\/frai.2026.1875268","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,22]]},"article-number":"1875268"}}