{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:00:23Z","timestamp":1781103623082,"version":"3.54.1"},"reference-count":32,"publisher":"IGI Global Scientific Publishing","issue":"1","license":[{"start":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T00:00:00Z","timestamp":1744416000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"},{"start":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T00:00:00Z","timestamp":1744416000000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"},{"start":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T00:00:00Z","timestamp":1744416000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,4,12]]},"abstract":"<p>Named entity recognition (NER) is crucial in tasks such as information extraction, question and answer systems, and opinion analysis, but the existing methods still have deficiencies in cross-modal feature alignment and fusion, and it is difficult to make full use of visual information and structured knowledge to improve the recognition accuracy. To this end, this paper proposes CoAtt-NER, a multimodal NER model supporting semantic web, which combines textual representation generated by ALBERT with knowledge graph embedding to enrich the semantic information of entities; and adopts CLIP-ViT for better visual feature extraction. In addition, Co-Attention is proposed to establish two-way interaction between text and visual modalities to achieve dynamic modelling and deep fusion of information. Experiments on Twitter-2015 and Twitter-2017 datasets show that the F1 scores of CoAtt-NER reach 76.25% and 87.31%, respectively, which achieve significant improvement compared with existing methods, verifying the effectiveness of this study in multimodal entity recognition tasks.<\/p>","DOI":"10.4018\/ijswis.373310","type":"journal-article","created":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T16:43:44Z","timestamp":1744476224000},"page":"1-17","source":"Crossref","is-referenced-by-count":1,"title":["Semantic Web-Enabled Multimodal Entity Recognition Using Collaborative Cross-Attention Mechanism"],"prefix":"10.4018","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-8171-1463","authenticated-orcid":true,"given":"Dongxiu","family":"Wang","sequence":"first","affiliation":[{"name":"School of Economics and Management, Guangxi University of Science and Technology, Liuzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8392-6742","authenticated-orcid":true,"given":"Yulan","family":"Wen","sequence":"additional","affiliation":[{"name":"Wuzhou University, Wuzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengxiang","family":"Qiu","sequence":"additional","affiliation":[{"name":"Guangxi Boda Software Co., Ltd., Liuzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"IJSWIS.373310-0","article-title":"Learning in-context learning for named entity recognition.","author":"J.Chen","year":"2023","journal-title":"Annual Meeting of the Association for Computational Linguistics"},{"key":"IJSWIS.373310-1","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2023.3326416"},{"key":"IJSWIS.373310-2","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.2298\/CSIS240418061G","article-title":"MFE-transformer: Adaptive English text named entity recognition method based on multi-feature extraction and transformer.","volume":"21","author":"L.Gao","year":"2024","journal-title":"Computer Science and Information Systems"},{"key":"IJSWIS.373310-3","first-page":"1","article-title":"PCEN: Potential correlation-enhanced network for multimodal named entity recognition.","author":"J.Geng","year":"2023","journal-title":"2023 IEEE International Conference on Intelligence and Security Informatics (ISI)"},{"key":"IJSWIS.373310-4","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3614967"},{"key":"IJSWIS.373310-5","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2023.3323402"},{"key":"IJSWIS.373310-6","doi-asserted-by":"publisher","DOI":"10.4018\/IJSWIS.333711"},{"key":"IJSWIS.373310-7","unstructured":"Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019). ALBERT: A lite BERT for self-supervised learning of language representations. ArXiv, abs\/1909.11942."},{"key":"IJSWIS.373310-8","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3400250"},{"key":"IJSWIS.373310-9","doi-asserted-by":"crossref","unstructured":"Liu, F., Ren, X., Liu, Y., Lei, K., & Sun, X. (2019). Exploring and distilling cross-modal information for image captioning. ArXiv, abs\/2002.12585.","DOI":"10.24963\/ijcai.2019\/708"},{"key":"IJSWIS.373310-10","unstructured":"Liu, P., Li, H., Ren, Y., Liu, J., Si, S., Zhu, H., & Sun, L. (2023). A novel framework for multimodal named entity recognition with multi-level alignments. ArXiv, abs\/2305.08372."},{"key":"IJSWIS.373310-11","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1185"},{"key":"IJSWIS.373310-12","doi-asserted-by":"crossref","unstructured":"Ma, J., Jin, W., Chen, Y., Zhang, F., Qian, S., & Qiao, Y. (2024). CLMSI: A novel image-text named entity recognition method based on contrast learning and multimodal semantic interaction. 2024 11th International Conference on Behavioural and Social Computing (BESC), 1\u20137.","DOI":"10.1109\/BESC64747.2024.10780757"},{"key":"IJSWIS.373310-13","unstructured":"Ma, Y., Liu, H., Zhang, D., Gao, C., Liu, Y., & Liu, Y. (2023). A named entity recognition method enhanced with lexicon information and text local feature. Tehnicki vjesnik - Technical Gazette."},{"key":"IJSWIS.373310-14","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2023.3303027"},{"key":"IJSWIS.373310-15","doi-asserted-by":"crossref","unstructured":"Meng, L., Qi, W., Zhou, Y., & Chen, Y. (2022). News text named entity recognition based on BI-LSTM-CRF model. 2022 41st Chinese Control Conference (CCC), 7217\u20137222.","DOI":"10.23919\/CCC55666.2022.9902400"},{"key":"IJSWIS.373310-16","article-title":"mCL-NER: Cross-lingual named entity recognition via multi-view contrastive learning.","author":"Y.Mo","year":"2023","journal-title":"AAAI Conference on Artificial Intelligence"},{"key":"IJSWIS.373310-17","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1078"},{"key":"IJSWIS.373310-18","doi-asserted-by":"publisher","DOI":"10.3724\/2096-7004.di.2024.0049"},{"key":"IJSWIS.373310-19","article-title":"Learning transferable visual models from natural language supervision.","author":"A.Radford","year":"2021","journal-title":"International Conference on Machine Learning"},{"key":"IJSWIS.373310-20","unstructured":"Sang, E. F., & De Meulder, F. (2003). Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. arxiv preprint cs\/0306050."},{"key":"IJSWIS.373310-21","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2503.01217"},{"key":"IJSWIS.373310-22","unstructured":"Tourani, A., Ejaz, S., Bavle, H., Morilla-Cabello, D., Sanchez-Lopez, J. L., & Voos, H. (2025). VS-Graphs: Integrating visual SLAM and situational graphs through multi-level scene understanding. arXiv."},{"key":"IJSWIS.373310-23","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2022.3221017"},{"key":"IJSWIS.373310-24","doi-asserted-by":"crossref","unstructured":"Wang, X., Gui, M., Jiang, Y., Jia, Z., Bach, N., Wang, T., Huang, Z., Huang, F., & Tu, K. (2021). ITA: Image-text alignments for multi-modal named entity recognition. ArXiv, abs\/2112.06482.","DOI":"10.18653\/v1\/2022.naacl-main.232"},{"key":"IJSWIS.373310-25","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN60899.2024.10651087"},{"key":"IJSWIS.373310-26","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/3990563"},{"key":"IJSWIS.373310-27","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2023.1181143"},{"key":"IJSWIS.373310-28","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11962"},{"issue":"1","key":"IJSWIS.373310-29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/IJSWIS.335113","article-title":"A web semantic-based text analysis approach for enhancing named entity recognition using PU-learning and negative sampling.","volume":"20","author":"S.Zhang","year":"2024","journal-title":"International Journal on Semantic Web and Information Systems"},{"key":"IJSWIS.373310-30","doi-asserted-by":"publisher","DOI":"10.1109\/CLNLP64123.2024.00015"},{"key":"IJSWIS.373310-31","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-023-01170-2"}],"container-title":["International Journal on Semantic Web and Information Systems"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=373310","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T22:06:55Z","timestamp":1765577215000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJSWIS.373310"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2025,4,12]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"URL":"https:\/\/doi.org\/10.4018\/ijswis.373310","relation":{},"ISSN":["1552-6283","1552-6291"],"issn-type":[{"value":"1552-6283","type":"print"},{"value":"1552-6291","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,12]]}}}