{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T12:30:56Z","timestamp":1785501056274,"version":"3.56.0"},"reference-count":46,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2022,4,23]],"date-time":"2022-04-23T00:00:00Z","timestamp":1650672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972455"],"award-info":[{"award-number":["61972455"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Peiyang Young Scholars in Tianjin University","award":["2019XRX-0032"],"award-info":[{"award-number":["2019XRX-0032"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,8,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Named entity recognition (NER) is a fundamental part of other natural language processing tasks such as information retrieval, question answering systems and machine translation. Progress and success have already been achieved in research on the English NER systems. However, the Urdu NER system is still in its infancy due to the complexity and morphological richness of the Urdu language. Existing Urdu NER systems are highly dependent on manual feature engineering and word embedding to capture similarity. Their performance lags if the words are previously unknown or infrequent. The feature-based models suffer from complicated feature engineering and are often highly reliant on external resources. To overcome these limitations in this study, we present several deep neural approaches that automatically learn features from the data and eliminate manual feature engineering. Our extension involved convolutional neural network to extract character-level features and combine them with word embedding to handle out-of-vocabulary words. The study also presents a tweets dataset in Urdu, annotated manually for five named entity classes. The effectiveness of the deep learning approaches is demonstrated on four benchmarks datasets. The proposed method demonstrates notable progress upon current state-of-the-art NER approaches in Urdu. The results show an improvement of 6.26% in the F1 score.<\/jats:p>","DOI":"10.1093\/comjnl\/bxac047","type":"journal-article","created":{"date-parts":[[2022,4,22]],"date-time":"2022-04-22T19:09:03Z","timestamp":1650654543000},"page":"1856-1869","source":"Crossref","is-referenced-by-count":15,"title":["Urdu Named Entity Recognition System Using Deep Learning Approaches"],"prefix":"10.1093","volume":"66","author":[{"given":"Rafiul","family":"Haq","sequence":"first","affiliation":[{"name":"College of Intelligence and Computing , Tianjin University, Tianjin, 300350 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaowang","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Intelligence and Computing , Tianjin University, Tianjin, 300350 China"},{"name":"Tianjin University-Aishu Data Intelligence Joint Laboratory , Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wahab","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of Science and technology , Bannu, PK 28100"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiyong","family":"Feng","sequence":"additional","affiliation":[{"name":"College of Intelligence and Computing , Tianjin University, Tianjin, 300350 China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,4,23]]},"reference":[{"key":"2023081805144969700_ref1","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/TKDE.2020.2981314","article-title":"A survey on deep learning for named entity recognition","volume":"34","author":"Li","year":"2022","journal-title":"IEEE Transactions on Knowledge and Data Engineering."},{"key":"2023081805144969700_ref2","article-title":"A survey on recent advances in named entity recognition from deep learning models","author":"Yadav","year":"2019","journal-title":"CoRR."},{"key":"2023081805144969700_ref3","doi-asserted-by":"crossref","DOI":"10.1016\/j.knosys.2020.105842","article-title":"ASTRAL: Adversarial trained LSTM-CNN for named entity recognition","volume":"197","author":"Wang","year":"2020","journal-title":"Knowledge-Based Systems."},{"key":"2023081805144969700_ref4","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.eij.2020.04.003","article-title":"A survey on sentiment analysis in Urdu: A resource-poor language","volume":"22","author":"Khattak","year":"2021","journal-title":"Egyptian Informatics Journal."},{"key":"2023081805144969700_ref5","first-page":"3","article-title":"A review of Urdu sentiment analysis with multilingual perspective: A case of Urdu and roman Urdu language","volume":"11","author":"Khan","year":"2022","journal-title":"Comput. Secur."},{"key":"2023081805144969700_ref6","first-page":"126","volume-title":"Proceedings of the 2010 named entities workshop","author":"Riaz","year":"2010"},{"key":"2023081805144969700_ref7","article-title":"Urdu named entity recognition and classification system using conditional random field","author":"Malik","year":"2015"},{"key":"2023081805144969700_ref8","first-page":"17","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages","author":"Saha","year":"2008"},{"key":"2023081805144969700_ref9","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2020.103381","article-title":"Combinatorial feature embedding based on CNN and LSTM for biomedical named entity recognition","volume":"103","author":"Cho","year":"2020","journal-title":"J. Biomed. Inform."},{"key":"2023081805144969700_ref10","article-title":"End-to-end sequence Labeling via bi-directional LSTM-CNNs-CRF","author":"Ma","year":"2016","journal-title":"CoRR."},{"key":"2023081805144969700_ref11","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/s10462-016-9482-x","article-title":"Urdu language processing: A survey","volume":"47","author":"Daud","year":"2017","journal-title":"Artif. Intell. Rev."},{"key":"2023081805144969700_ref12","article-title":"Beheshti-NER: Persian named entity recognition using BERT","author":"Taher","year":"2020","journal-title":"CoRR."},{"key":"2023081805144969700_ref13","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1017\/S1351324915000133","article-title":"Morphologically rich Urdu grammar parsing using Earley algorithm","volume":"22","author":"Abbas","year":"2016","journal-title":"Natural Language Engineering."},{"key":"2023081805144969700_ref14","article-title":"End-to-end named entity recognition and relation extraction using pre-trained language models","author":"Giorgi","year":"2019","journal-title":"CoRR."},{"key":"2023081805144969700_ref15","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.19026\/rjaset.8.1095","article-title":"Challenges of Urdu named entity recognition: A scarce resourced language","volume":"8","author":"Naz","year":"2014","journal-title":"Research Journal of Applied Sciences, Engineering and Technology."},{"key":"2023081805144969700_ref16","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1093\/comjnl\/bxaa131","article-title":"Sentiment analysis of fast food companies with deep learning models","volume":"64","author":"Abdalla","year":"2021","journal-title":"The Computer Journal."},{"key":"2023081805144969700_ref17","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1093\/comjnl\/bxaa172","article-title":"Deep learning-based sentiment analysis of Facebook data: The case of Turkish users","volume":"64","author":"\u00c7oban","year":"2021","journal-title":"The Computer Journal."},{"key":"2023081805144969700_ref18","doi-asserted-by":"crossref","first-page":"38918","DOI":"10.1109\/ACCESS.2019.2897327","article-title":"Part of speech tagging in urdu: Comparison of machine and deep learning approaches","volume":"7","author":"Khan","year":"2019","journal-title":"IEEE Access."},{"key":"2023081805144969700_ref19","doi-asserted-by":"crossref","first-page":"90","DOI":"10.4218\/etrij.2018-0553","article-title":"Deep recurrent neural networks with word embeddings for Urdu named entity recognition","volume":"42","author":"Khan","year":"2020","journal-title":"ETRI Journal."},{"key":"2023081805144969700_ref20","article-title":"Complex structure leads to overfitting: A structure regularization decoding method for natural language processing","author":"Sun","year":"2017","journal-title":"CoRR."},{"key":"2023081805144969700_ref21","doi-asserted-by":"crossref","DOI":"10.1111\/exsy.12397","article-title":"Creating sentiment lexicon for sentiment analysis in Urdu: The case of a resource-poor language","volume":"36","author":"Asghar","year":"2019","journal-title":"Expert Systems."},{"key":"2023081805144969700_ref22","article-title":"A survey on the state-of-the-art machine learning models in the context of NLP","volume":"43","author":"Khan","year":"2016","journal-title":"Kuwait journal of Science."},{"key":"2023081805144969700_ref23","volume-title":"Proceedings of the Conference on Language and Technology","author":"Raza","year":"2010"},{"key":"2023081805144969700_ref24","first-page":"703","article-title":"An improved Urdu stemming algorithm for text mining based on multi-step hybrid approach","volume":"30","author":"Jabbar","year":"2018","journal-title":"Journal of Experimental & Theoretical Artificial Intelligence."},{"key":"2023081805144969700_ref25","first-page":"2507","article-title":"Named entity recognition system for Urdu","volume":"2012","author":"Singh","year":"2012","journal-title":"Proceedings of COLING"},{"key":"2023081805144969700_ref26","first-page":"95","volume-title":"Proceedings of the 10th Workshop on Asian Language Resources","author":"Jahangir","year":"2012"},{"key":"2023081805144969700_ref27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1838751.1838754","article-title":"An information-extraction system for Urdu\u2014A resource-poor language","volume":"9","author":"Mukund","year":"2010","journal-title":"ACM Transactions on Asian Language Information Processing (TALIP)."},{"key":"2023081805144969700_ref28","first-page":"1","article-title":"Urdu named entity recognition and classification system using artificial neural network","volume":"17","author":"Malik","year":"2017","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)."},{"key":"2023081805144969700_ref29","first-page":"1","article-title":"Urdu named entity recognition: Corpus generation and deep learning applications","volume":"19","author":"Kanwal","year":"2019","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)."},{"key":"2023081805144969700_ref30","doi-asserted-by":"crossref","first-page":"123","DOI":"10.3390\/fi10120123","article-title":"Bidirectional recurrent neural network approach for Arabic named entity recognition","volume":"10","author":"Ali","year":"2018","journal-title":"Future Internet."},{"key":"2023081805144969700_ref31","first-page":"186","article-title":"An improved word representation for deep learning based NER in Indian languages","volume":"10","author":"AP","year":"2019","journal-title":"Inf. Dent."},{"key":"2023081805144969700_ref32","article-title":"Neural Chinese named entity recognition via CNN-LSTM-CRF and joint training with word segmentation","author":"Wu","year":"2019","journal-title":"CoRR."},{"key":"2023081805144969700_ref33","doi-asserted-by":"crossref","first-page":"97","DOI":"10.18653\/v1\/W17-4114","volume-title":"Proceedings of the first workshop on subword and character level models in NLP","author":"Misawa","year":"2017"},{"key":"2023081805144969700_ref34","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1109\/CIC48465.2019.00031","volume-title":"Proceedings of the 2019 IEEE 5th International Conference on Collaboration and Internet Computing (CIC)","author":"Singh","year":"2019"},{"key":"2023081805144969700_ref35","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.csl.2018.09.005","article-title":"Improving LSTM CRFs using character-based compositions for Korean named entity recognition","volume":"54","author":"Na","year":"2019","journal-title":"Comput. Speech Lang."},{"key":"2023081805144969700_ref36","doi-asserted-by":"crossref","first-page":"954","DOI":"10.1016\/j.ipm.2013.03.002","article-title":"Named entity recognition with multiple segment representations","volume":"49","author":"Cho","year":"2013","journal-title":"Inf. Process. Manag."},{"key":"2023081805144969700_ref37","article-title":"Bidirectional LSTM-CRF models for sequence tagging","author":"Huang","year":"2015","journal-title":"CoRR."},{"key":"2023081805144969700_ref38","first-page":"2741","volume-title":"Proceedings of the Thirtieth AAAI conference on artificial intelligence","author":"Kim","year":"2016"},{"key":"2023081805144969700_ref39","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1162\/tacl_a_00104","article-title":"Named entity recognition with bidirectional LSTM-CNNs","volume":"4","author":"Chiu","year":"2016","journal-title":"Trans. Assoc. Comput. Linguistics."},{"key":"2023081805144969700_ref40","first-page":"2920","volume-title":"Proceedings of the LREC 2014, Ninth International Conference on Language Resources and Evaluation","author":"Urooj","year":"2014"},{"key":"2023081805144969700_ref41","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM."},{"key":"2023081805144969700_ref42","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1162\/neco_a_01199","article-title":"A review of recurrent neural networks: LSTM cells and network architectures","volume":"31","author":"Yu","year":"2019","journal-title":"Neural Comput."},{"key":"2023081805144969700_ref43","article-title":"Empirical evaluation of gated recurrent neural networks on sequence Modeling","author":"Chung","year":"2014","journal-title":"CoRR."},{"key":"2023081805144969700_ref44","article-title":"Neural architectures for named entity recognition","author":"Lample","year":"2016","journal-title":"CoRR."},{"key":"2023081805144969700_ref45","article-title":"Named entity dataset for urdu named entity recognition task","volume":"51","author":"Khana","year":"2016","journal-title":"LANGUAGE & TECHNOLOGY"},{"key":"2023081805144969700_ref46","first-page":"99","volume-title":"Proceedings of the 6th workshop on Asian Language Resources","author":"Hussain","year":"2008"}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/66\/8\/1856\/51107587\/bxac047.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/66\/8\/1856\/51107587\/bxac047.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,18]],"date-time":"2023-08-18T05:16:05Z","timestamp":1692335765000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/66\/8\/1856\/6572657"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,23]]},"references-count":46,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,4,23]]},"published-print":{"date-parts":[[2023,8,14]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxac047","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"value":"0010-4620","type":"print"},{"value":"1460-2067","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,8]]},"published":{"date-parts":[[2022,4,23]]}}}