{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T06:43:28Z","timestamp":1740120208855,"version":"3.37.3"},"reference-count":43,"publisher":"World Scientific Pub Co Pte Ltd","issue":"06","funder":[{"DOI":"10.13039\/501100003787","name":"Hebei Natural Science Foundation","doi-asserted-by":"crossref","award":["F2022208002"],"award-info":[{"award-number":["F2022208002"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Project of Hebei Education Department","award":["ZD2021048"],"award-info":[{"award-number":["ZD2021048"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p> Multimodal entity linking aims to link mentions to target entities in the multimodal knowledge graph. The current multimodal entity linking mainly focuses on the global fusion of text and image, seldom fully exploring the correlation between modalities. In order to improve the fusion effect of multimodal feature, we propose a multimodal entity linking model based on a Multimodal Co-Attention Fusion strategy. This strategy is designed to enable text and image to guide each other for extracting features, thus making full exploration of the correlation between modalities to improve the fine-grained feature fusion effect. Furthermore, we also design a candidate entity generation strategy based on Transformer, which combines multiple candidate entity sets and adjusts the candidate entity ranking to obtain high-quality candidate entity sets. We perform experiments on domain datasets and public datasets, and the experimental results demonstrate that our model has a good performance in candidate entity generation and multimodal feature fusion, outperforming the state-of-the-art baseline models. <\/jats:p>","DOI":"10.1142\/s021819402450013x","type":"journal-article","created":{"date-parts":[[2024,3,22]],"date-time":"2024-03-22T09:50:36Z","timestamp":1711101036000},"page":"973-997","source":"Crossref","is-referenced-by-count":0,"title":["TRAFMEL: Multimodal Entity Linking Based on Transformer Reranking and Multimodal Co-Attention Fusion"],"prefix":"10.1142","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7091-1155","authenticated-orcid":false,"given":"Xiaoming","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0398-3693","authenticated-orcid":false,"given":"Kaikai","family":"Meng","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3107-729X","authenticated-orcid":false,"given":"Huiyong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2024,5,16]]},"reference":[{"key":"S021819402450013XBIB001","first-page":"708","volume-title":"Proc. 2007 Joint Conf. Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Cucerzan S.","year":"2007"},{"key":"S021819402450013XBIB002","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458150"},{"key":"S021819402450013XBIB003","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/978-3-030-21348-0_30","volume-title":"ESWC 2019: The Semantic Web","volume":"11503","author":"Liu Y.","year":"2019"},{"key":"S021819402450013XBIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.bdr.2020.100159"},{"key":"S021819402450013XBIB005","first-page":"4285","volume-title":"Proc. Twelfth Language Resources and Evaluation Conf.","author":"Adjali O.","year":"2020"},{"key":"S021819402450013XBIB006","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475400"},{"key":"S021819402450013XBIB008","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-45439-5_31"},{"key":"S021819402450013XBIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2021.101975"},{"key":"S021819402450013XBIB010","doi-asserted-by":"publisher","DOI":"10.1109\/WACV48630.2021.00360"},{"issue":"7","key":"S021819402450013XBIB011","first-page":"11418","volume":"34","author":"Li X.","year":"2020","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"S021819402450013XBIB012","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1126"},{"key":"S021819402450013XBIB013","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531867"},{"key":"S021819402450013XBIB014","doi-asserted-by":"publisher","DOI":"10.3390\/electronics11142134"},{"key":"S021819402450013XBIB015","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2327028"},{"key":"S021819402450013XBIB016","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3373883"},{"key":"S021819402450013XBIB017","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.136"},{"key":"S021819402450013XBIB018","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1400"},{"key":"S021819402450013XBIB019","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.findings-acl.292"},{"key":"S021819402450013XBIB020","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380146"},{"key":"S021819402450013XBIB021","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00303"},{"key":"S021819402450013XBIB023","first-page":"1375","volume-title":"Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Ratinov L.","year":"2011"},{"key":"S021819402450013XBIB024","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K18-1046"},{"key":"S021819402450013XBIB025","first-page":"2429","volume-title":"Proc. 29th Int. Conf. Computational Linguistics","author":"Sui X.","year":"2022"},{"key":"S021819402450013XBIB026","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1005"},{"key":"S021819402450013XBIB027","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.604"},{"key":"S021819402450013XBIB028","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00460"},{"key":"S021819402450013XBIB029","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.519"},{"key":"S021819402450013XBIB030","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.228"},{"key":"S021819402450013XBIB031","first-page":"200161","volume":"17","author":"D\u2019Auria D.","year":"2023","journal-title":"Intell. Syst. Appl."},{"key":"S021819402450013XBIB033","doi-asserted-by":"publisher","DOI":"10.1109\/CISAI54367.2021.00100"},{"key":"S021819402450013XBIB034","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-30675-4_45"},{"key":"S021819402450013XBIB035","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-industry.24"},{"key":"S021819402450013XBIB036","doi-asserted-by":"publisher","DOI":"10.1162\/dint_a_00146"},{"key":"S021819402450013XBIB037","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-6471-7_27"},{"key":"S021819402450013XBIB038","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.2100495"},{"key":"S021819402450013XBIB039","first-page":"14200","volume":"34","author":"Nagrani A.","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S021819402450013XBIB041","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2967286"},{"key":"S021819402450013XBIB042","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.450"},{"key":"S021819402450013XBIB043","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11962"},{"key":"S021819402450013XBIB044","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-73197-7_35"},{"key":"S021819402450013XBIB045","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412777"},{"key":"S021819402450013XBIB046","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04097-w"},{"key":"S021819402450013XBIB047","first-page":"4171","volume-title":"Proc. 2019 Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin J.","year":"2019"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021819402450013X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T03:55:08Z","timestamp":1720151708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S021819402450013X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,16]]},"references-count":43,"journal-issue":{"issue":"06","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1142\/S021819402450013X"],"URL":"https:\/\/doi.org\/10.1142\/s021819402450013x","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"type":"print","value":"0218-1940"},{"type":"electronic","value":"1793-6403"}],"subject":[],"published":{"date-parts":[[2024,5,16]]}}}