{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T12:30:32Z","timestamp":1753360232492,"version":"3.40.5"},"reference-count":34,"publisher":"World Scientific Pub Co Pte Ltd","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:p> Video Multimodal Entity Linking (VMEL) is a task to link entities mentioned in videos to entities in multimodal knowledge bases. However, current entity linking methods primarily focus on text and image modalities, neglecting the significance of video modality. To address this challenge, we propose a novel framework called the multi-perspective enhanced Subgraph Contrastive Network (SCMEL) and construct a VMEL dataset named SceneMEL, based on tourism domain. We first integrate textual, auditory and visual modal contexts of videos to generate a comprehensive high-recall candidate entity set. Furthermore, a semantic-enhanced video description subgraph generation module is utilized to convert videos into a multimodal feature graph structure and perform subgraph sampling on the domain-specific knowledge graph. Lastly, we conduct contrastive learning on local perspectives (text, audio, visual) within the video subgraphs and the knowledge graph subgraphs, as well as global perspectives, to capture fine-grained semantic information about videos and entities. A series of experimental results on SceneMel demonstrate the effectiveness of the proposed approach. <\/jats:p>","DOI":"10.1142\/s0218194024500360","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T12:43:00Z","timestamp":1721392980000},"page":"1757-1781","source":"Crossref","is-referenced-by-count":1,"title":["Video Multimodal Entity Linking via Multi-Perspective Enhanced Subgraph Contrastive Network"],"prefix":"10.1142","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2090-3560","authenticated-orcid":false,"given":"Huayu","family":"Li","sequence":"first","affiliation":[{"name":"Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao, Shandong Province 266000, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3086-9709","authenticated-orcid":false,"given":"Yang","family":"Yue","sequence":"additional","affiliation":[{"name":"Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao, Shandong Province 266000, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5785-6929","authenticated-orcid":false,"given":"Xiaojun","family":"Man","sequence":"additional","affiliation":[{"name":"Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao, Shandong Province 266000, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2958-0263","authenticated-orcid":false,"given":"Haiyang","family":"Li","sequence":"additional","affiliation":[{"name":"Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Qingdao, Shandong Province 266000, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2024,8,30]]},"reference":[{"doi-asserted-by":"publisher","key":"S0218194024500360BIB001","DOI":"10.3233\/SW-222986"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB002","DOI":"10.1145\/3474085.3475400"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB003","DOI":"10.1016\/j.aiopen.2021.08.002"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB004","DOI":"10.1109\/TNNLS.2021.3070843"},{"volume-title":"Proc. 5th International Conference on Learning Representations (ICLR 2017)","year":"2017","author":"Kipf T. N.","key":"S0218194024500360BIB006"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB007","DOI":"10.1145\/3581783.3612575"},{"key":"S0218194024500360BIB008","first-page":"2556","volume":"35","author":"Wei S.","year":"2021","journal-title":"IEEE Trans. Knowl. Data Eng."},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB009","DOI":"10.18653\/v1\/2020.emnlp-main.519"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB010","DOI":"10.1007\/s11390-023-2835-4"},{"key":"S0218194024500360BIB011","first-page":"4285","volume-title":"Proc. Twelfth Language Resources and Evaluation Conference","author":"Adjali O.","year":"2020"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB012","DOI":"10.18653\/v1\/2022.acl-long.328"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB013","DOI":"10.1007\/978-981-16-6471-7_27"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB014","DOI":"10.18653\/v1\/P18-1186"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB015","DOI":"10.1007\/978-3-030-45439-5_31"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB016","DOI":"10.1007\/978-3-030-73197-7_35"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB017","DOI":"10.1145\/3477495.3531867"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB018","DOI":"10.1145\/3580305.3599439"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB019","DOI":"10.1007\/978-3-031-30675-4_45"},{"key":"S0218194024500360BIB020","first-page":"19008","volume-title":"Proc. AAAI Conference on Artificial Intelligence","author":"Song S.","year":"2023"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB021","DOI":"10.18653\/v1\/2023.findings-acl.497"},{"volume-title":"Proc. International Conference on Language Resources and Evaluation","year":"2023","author":"Shi S.","key":"S0218194024500360BIB022"},{"key":"S0218194024500360BIB024","first-page":"4171","volume-title":"Proc. North American Chapter of the Association for Computational Linguistics","author":"Devlin J.","year":"2019"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB025","DOI":"10.1109\/CVPR.2016.90"},{"key":"S0218194024500360BIB026","first-page":"8748","volume-title":"Proc. 38th International Conference on Machine Learning","author":"Radford A.","year":"2021"},{"volume-title":"Proc. 3rd International Conference on Learning Representations (ICLR 2015)","year":"2015","author":"Simonyan K.","key":"S0218194024500360BIB027"},{"key":"S0218194024500360BIB028","first-page":"2816","volume-title":"Proc. 18th Conference of the European Chapter of the Association for Computational Linguistics","author":"Yao B.","year":"2024"},{"key":"S0218194024500360BIB029","first-page":"2411","volume-title":"Proc. Thirty-Ninth Conference on Uncertainty in Artificial Intelligence","author":"Yang C.","year":"2023"},{"volume-title":"Proc. Eleventh International Conference on Learning Representations (ICLR 2023)","year":"2023","author":"Chen X.","key":"S0218194024500360BIB030"},{"issue":"3","key":"S0218194024500360BIB031","first-page":"1140","volume":"35","author":"Zhao H.","year":"2024","journal-title":"Journal of Software"},{"volume-title":"Proc. 9th International Conference on Learning Representations (ICLR 2021)","year":"2021","author":"Dosovitskiy A.","key":"S0218194024500360BIB033"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB034","DOI":"10.1109\/TKDE.2022.3224228"},{"volume-title":"Proc. International Conference on Learning Representations","year":"2013","author":"Mikolov T.","key":"S0218194024500360BIB035"},{"doi-asserted-by":"publisher","key":"S0218194024500360BIB036","DOI":"10.1016\/j.neucom.2022.07.028"},{"key":"S0218194024500360BIB037","first-page":"1025","volume-title":"Proc. 31st International Conference on Neural Information Processing Systems (NIPS\u201917)","author":"William L.","year":"2017"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194024500360","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T05:13:41Z","timestamp":1732079621000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218194024500360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,30]]},"references-count":34,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["10.1142\/S0218194024500360"],"URL":"https:\/\/doi.org\/10.1142\/s0218194024500360","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"type":"print","value":"0218-1940"},{"type":"electronic","value":"1793-6403"}],"subject":[],"published":{"date-parts":[[2024,8,30]]}}}