{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T07:14:30Z","timestamp":1778742870594,"version":"3.51.4"},"reference-count":52,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T00:00:00Z","timestamp":1738108800000},"content-version":"vor","delay-in-days":28,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Bidirectional encoder representation from transformer (BERT) models are increasingly being employed in the development of natural language processing (NLP) systems, predominantly for English and other European languages. However, because of the complexity of the language\u2019s morphology and the scarcity of models and resources, the BERT model is not widely employed for Amharic text processing and other NLP applications. This paper describes the fine\u2010tuning of a pretrained BERT model to classify Amharic news documents into different news labels. We modified and retrained the model using a custom news document dataset separated into seven key categories. We utilized 2181 distinct Amharic news articles, each comprising a title, a summary lead, and a comprehensive main body. An experiment was carried out to assess the performance of the fine\u2010tuned BERT model, which achieved 88% accuracy, 88% precision, 87.61% recall, and 87.59% F1\u2010score, respectively. In addition, we evaluated our fine\u2010tuned model against baseline models such as bag\u2010of\u2010words with MLP, Word2Vec with MLP, and fastText classifier utilizing the identical dataset and preprocessing module. Our model outperformed these baselines by 6.3%, 14%, and 8% in terms of accuracy, respectively. In conclusion, our refined BERT model has demonstrated encouraging outcomes in the categorization of Amharic news documents, surpassing conventional methods. Future research could explore further fine\u2010tuning techniques and larger datasets to enhance performance.<\/jats:p>","DOI":"10.1155\/cplx\/1884264","type":"journal-article","created":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T06:06:06Z","timestamp":1738130766000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Fine\u2010Tuning BERT Models for Multiclass Amharic News Document Categorization"],"prefix":"10.1155","volume":"2025","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2476-6217","authenticated-orcid":false,"given":"Demeke","family":"Endalie","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2025,1,29]]},"reference":[{"key":"e_1_2_11_1_2","unstructured":"ZhangR. CordeiroJ. LiX. ZhangZ. andZhangJ. Document Classification-Combining Structure and Content ICEIS 2011-Proceedings of the 13th International Conference on Enterprise Information Systems June 2011 Beijing China."},{"key":"e_1_2_11_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.susoc.2022.03.001"},{"key":"e_1_2_11_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aej.2021.02.009"},{"key":"e_1_2_11_4_2","doi-asserted-by":"crossref","unstructured":"YangL. A Brief Introduction of the Text Classification Methods 2022 IEEE International Conference on Electrical Engineering Big Data and Algorithms (EEBDA) February 2022 Changchun China.","DOI":"10.1109\/EEBDA53927.2022.9744845"},{"key":"e_1_2_11_5_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-40062-3"},{"key":"e_1_2_11_6_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics12061425"},{"key":"e_1_2_11_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.119984"},{"key":"e_1_2_11_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-023-10419-1"},{"key":"e_1_2_11_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2024.124123"},{"key":"e_1_2_11_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2021.103867"},{"key":"e_1_2_11_11_2","doi-asserted-by":"publisher","DOI":"10.28991\/hij-2023-04-02-015"},{"key":"e_1_2_11_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/info14030187"},{"key":"e_1_2_11_13_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12030976"},{"key":"e_1_2_11_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym15020395"},{"key":"e_1_2_11_15_2","doi-asserted-by":"publisher","DOI":"10.3390\/fi13110275"},{"key":"e_1_2_11_16_2","doi-asserted-by":"publisher","DOI":"10.3390\/info14030195"},{"key":"e_1_2_11_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42452-019-1340-4"},{"key":"e_1_2_11_18_2","doi-asserted-by":"crossref","unstructured":"Alemu ArgawA.andAskerL. An Amharic Stemmer: Reducing Words to Their Citation Forms Proceedings of the 5th Workshop on Important Unresolved Matters May 2007 Prague Czech Republic.","DOI":"10.3115\/1654576.1654594"},{"key":"e_1_2_11_19_2","doi-asserted-by":"crossref","unstructured":"AbateS. T. Yifiru TachbelieM. andSchultzT. Multilingual Acoustic and Language Modeling for Ethio-Semitic Languages Proc. Interspeech 2020 June 2020 Shanghai China.","DOI":"10.21437\/Interspeech.2020-2856"},{"key":"e_1_2_11_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eng.2022.04.024"},{"key":"e_1_2_11_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.6486"},{"key":"e_1_2_11_22_2","unstructured":"Neshir AlemnehG. AtnafuS. andRauberA. BERT Fine-Tuning for Amharic Sentiment Classification Eighth Swedish Language Technology Conference (SLTC) May 2020 Stockholm Sweden University of Gothenburg."},{"key":"e_1_2_11_23_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/3774607"},{"key":"e_1_2_11_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2021.02.005"},{"key":"e_1_2_11_25_2","article-title":"Automated Arabic Long-Tweet Classification Using Transfer Learning With BERT","volume":"13","author":"Alruily M.","year":"2023","journal-title":"Applied Scienes"},{"key":"e_1_2_11_26_2","doi-asserted-by":"crossref","unstructured":"OzdemirS. News Classification with State-of-the-Art Deep Learning Methods 2024 8th International Artificial Intelligence and Data Processing Symposium (IDAP) September 2024 Malatya T\u00fcrkiye.","DOI":"10.1109\/IDAP64064.2024.10710921"},{"key":"e_1_2_11_27_2","article-title":"Automatic Amharic Text News Classification: Aneural Networks Approach","volume":"6","author":"Kelemework W.","year":"2013","journal-title":"Ethiopian Journal of Science and Technology"},{"key":"e_1_2_11_28_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/5516262"},{"key":"e_1_2_11_29_2","doi-asserted-by":"publisher","DOI":"10.3390\/app14188388"},{"key":"e_1_2_11_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2020.101164"},{"key":"e_1_2_11_31_2","doi-asserted-by":"publisher","DOI":"10.1080\/02500167.2015.1018288"},{"key":"e_1_2_11_32_2","doi-asserted-by":"publisher","DOI":"10.1142\/s0218001409007326"},{"key":"e_1_2_11_33_2","doi-asserted-by":"crossref","unstructured":"Destaw BelayT. Ali AyeleA. GelayeG. YimamS. M. andBiemannC. Impacts of Homophone Normalization on Semantic Models for Amharic 2021 International Conference on Information and Communication Technology for Development for Africa (ICT4DA) July 2021 Bahir Dar Ethiopia.","DOI":"10.1109\/ICT4DA53266.2021.9672229"},{"key":"e_1_2_11_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acorp.2022.100033"},{"key":"e_1_2_11_35_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0295339"},{"key":"e_1_2_11_36_2","doi-asserted-by":"publisher","DOI":"10.14569\/ijacsa.2024.0150235"},{"key":"e_1_2_11_37_2","unstructured":"JacobD. ChangM.-W. LeeK. andToutanovaK. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding Proceedings of NAACL-HLT 2019 June 2019 Minneapolis MN."},{"key":"e_1_2_11_38_2","doi-asserted-by":"crossref","unstructured":"ConneauA. KhandelwalK. GoyalN.et al. Unsupervised Cross-Lingual Representation Learning at Scale Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL) July 2020 Bangkok Thailand 8440\u20138451.","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"e_1_2_11_39_2","unstructured":"WenzekG. LachauxM.-A. ConneauA.et al. CCNet: Extracting High Quality Monolingual Datasets From Web Crawl Data Proceedings of the 12th Language Resources and Evaluation Conference (LREC) May 2020 Marseille France 4003\u20134012."},{"key":"e_1_2_11_40_2","unstructured":"GraveE. BojanowskiP. GuptaP. JoulinA. andMikolovT. Learning Word Vectors for 157 Languages Proceedings of the International Conference on Language Resources and Evaluation June 2018 Miyazaki Japan."},{"key":"e_1_2_11_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.10.463"},{"key":"e_1_2_11_42_2","doi-asserted-by":"crossref","unstructured":"Abdulazeez QaderW. AmeenM. M. andAhmedB. I. An Overview of Bag of Words; Importance Implementation Applications and Challenges 2019 International Engineering Conference (IEC) June 2019 Erbil Iraq.","DOI":"10.1109\/IEC47844.2019.8950616"},{"key":"e_1_2_11_43_2","doi-asserted-by":"crossref","unstructured":"GoyalR. Evaluation of Rule-Based CountVectorizer and Word2Vec Machine Learning Models for Tweet Analysis to Improve Disaster Relief 2021 IEEE Global Humanitarian Technology Conference (GHTC) October 2021 Seattle WA.","DOI":"10.1109\/GHTC53159.2021.9612486"},{"key":"e_1_2_11_44_2","doi-asserted-by":"publisher","DOI":"10.3390\/computers12050091"},{"key":"e_1_2_11_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cageo.2007.03.011"},{"key":"e_1_2_11_46_2","doi-asserted-by":"crossref","unstructured":"SilvaA.andAmarathungaC. On Learning Word Embeddings from Linguistically Augmented Text Corpora International Conference on Computational Semantics June 2019 Gothenburg Sweden.","DOI":"10.18653\/v1\/W19-0508"},{"key":"e_1_2_11_47_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/2634\/1\/012052"},{"key":"e_1_2_11_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2022.3220744"},{"key":"e_1_2_11_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaceta.2021.10.093"},{"key":"e_1_2_11_50_2","doi-asserted-by":"publisher","DOI":"10.13189\/ujer.2020.080317"},{"key":"e_1_2_11_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2022.09.132"},{"key":"e_1_2_11_52_2","doi-asserted-by":"crossref","unstructured":"MaL.andZhangY. Using Word2Vec to Process Big Text Data Big Data (Big Data) 2015 IEEE International Conference June 2016 San Jose CA.","DOI":"10.1109\/BigData.2015.7364114"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/cplx\/1884264","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/cplx\/1884264","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/cplx\/1884264","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T03:52:17Z","timestamp":1773028337000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/cplx\/1884264"}},"subtitle":[],"editor":[{"given":"Hassan","family":"Zargarzadeh","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1155\/cplx\/1884264"],"URL":"https:\/\/doi.org\/10.1155\/cplx\/1884264","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"value":"1076-2787","type":"print"},{"value":"1099-0526","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2023-12-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"1884264"}}