{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T14:19:08Z","timestamp":1754144348671,"version":"3.41.2"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"7","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2025,7,31]]},"abstract":"<jats:p>This research addresses the limitations of existing entity-naming algorithms in natural language processing when the algorithm faces the complexities of polysemy and intricate sentence structures. We propose a novel Transformer-multi-level fusion recurrent Neural Network (T-MFRNN) model that integrates transformer-based layers for contextual understanding with a multi-level fusion recurrent neural network to capture temporal dependencies. Through rigorous experimentation on prominent NLP models like BERT, GPT2, ELECTRA, and XNet, the proposed T-MFRNN demonstrated a significant performance enhancement. Compared to existing methods, such as the boundary assembly model (BAM), the T-MFRNN exhibits a marked improvement of up to 18.66% in the F1-score, highlighting its superior ability to accurately label entities in complex biomedical texts. The T-MFRNN model\u2019s outstanding performance underscores its potential as a robust solution for biomedical entity naming applications.<\/jats:p>","DOI":"10.1145\/3744903","type":"journal-article","created":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T07:13:13Z","timestamp":1750144393000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Entity Naming in NLP: Hybrid Approach GPT Transformer and Multi-level RNN"],"prefix":"10.1145","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7932-0581","authenticated-orcid":false,"given":"Ahmed","family":"Abdulhamed","sequence":"first","affiliation":[{"name":"School of Computer Science and Artificial Intelligence, Wuhan University of Technology - Mafangshan Campus","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4847-7417","authenticated-orcid":false,"given":"Prabhat","family":"Ranjan","sequence":"additional","affiliation":[{"name":"School of Computer Science, UPES","place":["Dehradun, India"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4006-7029","authenticated-orcid":false,"given":"Shengwu","family":"Xiong","sequence":"additional","affiliation":[{"name":"Interdisciplinary Artificial Intelligence Research Institute, Wuhan College","place":["Wuhan, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Tanjim Taharat Aurpa and Md Shoaib Ahmed. 2024. An ensemble novel architecture for Bangla Mathematical Entity Recognition (MER) using transformer based learning. Heliyon 10 3 (2024) 1\u201314.","DOI":"10.1016\/j.heliyon.2024.e25467"},{"key":"e_1_3_1_3_2","unstructured":"Hao Chen Yun Li and Wei Zhang. 2023. Recurrent neural networks for sequence modeling: Advances and applications. Journal of Machine Learning Research 24 12 (2023) 3456\u20133478."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","unstructured":"Yanping Chen Ying Hu Yijing Li Ruizhang Huang Yongbin Qin Yuefei Wu Qinghua Zheng and Ping Chen. 2020. A boundary assembling method for nested biomedical named entity recognition. IEEE Access 8 (2020) 214141\u2013214152. DOI:10.1109\/ACCESS.2020.3040182","DOI":"10.1109\/ACCESS.2020.3040182"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TQCEBT54229.2022.10041261"},{"key":"e_1_3_1_6_2","unstructured":"Le An Ha Maggie Ryan Holbrook and Victoria Yaneva. 2022. NBME - Score Clinical Patient Notes. Retrieved from https:\/\/www.kaggle.com\/competitions\/nbme-score-clinical-patient-notes. (2022)."},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","unstructured":"Samira Hazmoune and Fateh Bougamouza. 2024. Using transformers for multimodal emotion recognition: Taxonomies and state of the art review. Engineering Applications of Artificial Intelligence 133 Part D (2024) 108339.","DOI":"10.1016\/j.engappai.2024.108339"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIS54925.2022.9882432"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1131"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/JCSSE61278.2024.10613644"},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","unstructured":"Antonio Lavecchia. 2024. Advancing drug discovery with deep attention neural networks. Drug Discovery Today 29 1 (2024) 104067.","DOI":"10.1016\/j.drudis.2024.104067"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/AINIT61980.2024.10581758"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCIPT61983.2024.10673354"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1511"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSCWD61410.2024.10580715"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1360"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6363"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/EUROCON56442.2023.10199075"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.5555\/1795943"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICNWC57852.2023.10127351"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Bo Peng Tao Zhang Kundong Han Zhe Zhang Yuquan Ma and Mengnan Ma. 2024. BVMHA: Text classification model with variable multihead hybrid attention based on BERT. Journal of Intelligent & Fuzzy SystemsPreprint 46 1 (2024) 1\u201312.","DOI":"10.3233\/JIFS-231368"},{"key":"e_1_3_1_22_2","first-page":"1507","volume-title":"Proceedings of the International Conference on Big Data (Big Data\u201920)","author":"Piwowarski Robert","year":"2020","unstructured":"Robert Piwowarski, Francesco Cruciani, and Gauthier Lejeune. 2020. Deep learning for detecting illicit drug trafficking on the darkweb. In Proceedings of the International Conference on Big Data (Big Data\u201920). 1507\u20131516."},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Kruti Lavingia Priya Mehta Yash Koringa Ami Lavingia and Vrutik Patel. 2025. Parallel learning based Bi-LSTM model for Named Entity Recognition. International Journal of System Assurance Engineering and Management (2025). 1\u20138.","DOI":"10.1007\/s13198-025-02859-5"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/IConSCEPT57958.2023.10170554"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISDFS60797.2024.10527329"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/IConSCEPT61884.2024.10627815"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Thanveer Shaik Xiaohui Tao Yan Li Christopher Dann Jacquie McDonald Petrea Redmond and Linda Galligan. 2022. A review of the trends and challenges in adopting natural language processing methods for education feedback analysis. IEEE Access 10 (2022) 56720\u201356739. DOI:10.1109\/ACCESS.2022.3177752","DOI":"10.1109\/ACCESS.2022.3177752"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSIT52700.2021.9648768"},{"key":"e_1_3_1_29_2","doi-asserted-by":"crossref","unstructured":"Binbin Shi Lijuan Zhang Jie Huang Huilin Zheng Jian Wan and Lei Zhang. 2022. MDA: An intelligent medical data augmentation scheme based on medical knowledge graph for chinese medical tasks. Applied Sciences 12 20 (2022) 10655.","DOI":"10.3390\/app122010655"},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","unstructured":"S. Shreyashree Pramod Sunagar S. Rajarajeswari and Anita Kanavalli. 2022. BERT-based hybrid RNN model for multi-class text classification to study the effect of pre-trained word embeddings. International Journal of Advanced Computer Science and Applications 13 9 (2022) 667\u2013674.","DOI":"10.14569\/IJACSA.2022.0130979"},{"key":"e_1_3_1_31_2","unstructured":"Nina Smirnova and Philipp Mayr. 2023. Embedding models for supervised automatic extraction and classification of named entities in scientific acknowledgements. Scientometrics 128 3 (2023) 1\u201325."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","unstructured":"Guido Rocchietti Cosimo Rulli Franco Maria Nardini Cristina Ioana Muntean Raffaele Perego and Ophir Frieder. 2025. ChatGPT vs. Modest Large Language Models: An extensive study on benefits and drawbacks for conversational search. IEEE Access 13 (2025) 15253\u201315271. DOI:10.1109\/ACCESS.2025.3529741","DOI":"10.1109\/ACCESS.2025.3529741"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","unstructured":"Zaifu Zhan Shuang Zhou Mingchen Li and Rui Zhang. 2025. RAMIE: Retrieval-augmented multi-task information extraction with large language models on dietary supplements. Journal of the American Medical Informatics Association 32 3 (March 2025) 545\u2013554. DOI:10.1093\/jamia\/ocaf002","DOI":"10.1093\/jamia\/ocaf002"},{"key":"e_1_3_1_34_2","first-page":"5998","volume-title":"Proceedings of the Advances in Neural Information Processing Systems (NeurIPS\u201917)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS\u201917). 5998\u20136008."},{"key":"e_1_3_1_35_2","first-page":"8336","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL\u201920)","author":"Wang Bingsheng","year":"2020","unstructured":"Bingsheng Wang, Yucheng Shen, Hongjin Jin, and Liang Liu. 2020. Nested named entity recognition with partially-observed TreeCRFs. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL\u201920). 8336\u20138347."},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Haochun Wang Sendong Zhao Zewen Qiang Zijian Li Chi Liu Nuwa Xi Yanrui Du Bing Qin and Ting Liu. 2025. Knowledge-tuning large language models with structured medical knowledge bases for trustworthy response generation in Chinese. ACM Transactions on Knowledge Discovery from Data 19 2 (2025) 1\u201317.","DOI":"10.1145\/3686807"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/CBASE60015.2023.10439084"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","unstructured":"YongPeng Wang and ChunMao Jiang. 2024. Fine-grained multimodal named entity recognition with heterogeneous image-text similarity graphs. International Journal of Machine Learning and Cybernetics 15 6 (2024) 1\u201315. DOI:10.1007\/s13042-024-02398-8","DOI":"10.1007\/s13042-024-02398-8"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI59109.2023.00122"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","unstructured":"Gokul Yenduri M. Ramalingam G. Chemmalar Selvi Y. Supriya Gautam Srivastava Praveen Kumar Reddy Maddikunta G. Deepti Raj Rutvij H. Jhaveri B. Prabadevi Weizheng Wang Athanasios V. Vasilakos and Thippa Reddy Gadekallu. 2024. Gpt (generative pre-trained transformer)\u2013a comprehensive review on enabling technologies potential applications emerging challenges and future directions. IEEE Access 12 (2024) 54608\u201354649. DOI:10.1109\/ACCESS.2024.3389497","DOI":"10.1109\/ACCESS.2024.3389497"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/IAEAC59436.2024.10503851"},{"key":"e_1_3_1_42_2","doi-asserted-by":"crossref","unstructured":"H. Zhou R. Austin S.-C. Lu G. M. Silverman Y. Zhou H. Kilicoglu H. Xu and R. Zhang. 2024. Complementary and integrative health information in the literature: Its lexicon and named entity recognition. Journal of the American Medical Informatics Association 31 2 (2024) 426\u2013434.","DOI":"10.1093\/jamia\/ocad216"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3744903","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T12:20:09Z","timestamp":1752582009000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3744903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,10]]},"references-count":41,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,7,31]]}},"alternative-id":["10.1145\/3744903"],"URL":"https:\/\/doi.org\/10.1145\/3744903","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2025,7,10]]},"assertion":[{"value":"2024-04-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}