{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T02:07:55Z","timestamp":1740103675642,"version":"3.37.3"},"reference-count":17,"publisher":"Wiley","license":[{"start":{"date-parts":[[2020,3,28]],"date-time":"2020-03-28T00:00:00Z","timestamp":1585353600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41571401","41871226","cstc2019jcyj-msxmX0131"],"award-info":[{"award-number":["41571401","41871226","cstc2019jcyj-msxmX0131"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41571401","41871226","cstc2019jcyj-msxmX0131"],"award-info":[{"award-number":["41571401","41871226","cstc2019jcyj-msxmX0131"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005230","name":"Natural Science Foundation of Chongqing","doi-asserted-by":"publisher","award":["41571401","41871226","cstc2019jcyj-msxmX0131"],"award-info":[{"award-number":["41571401","41871226","cstc2019jcyj-msxmX0131"]}],"id":[{"id":"10.13039\/501100005230","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2020,3,28]]},"abstract":"<jats:p>The rapid developments in sensor technology and mobile devices bring a flourish of social images, and large-scale social images have attracted increasing attention to researchers. Existing approaches generally rely on recognizing object instances individually with geo-tags, visual patterns, etc. However, the social image represents a web of interconnected relations; these relations between entities carry semantic meaning and help a viewer differentiate between instances of a substance. This article forms the perspective of the spatial relationship to exploring the joint learning of social images. Precisely, the model consists of three parts: (a) a module for deep semantic understanding of images based on residual network (ResNet); (b) a deep semantic analysis module of text beyond traditional word bag methods; (c) a joint reasoning module from which the text weights obtained using image features on self-attention and a novel tree-based clustering algorithm. The experimental results demonstrate the effectiveness of using Flickr30k and Microsoft COCO datasets. Meanwhile, our method considers spatial relations while matching.<\/jats:p>","DOI":"10.1155\/2020\/1543947","type":"journal-article","created":{"date-parts":[[2020,3,28]],"date-time":"2020-03-28T23:30:29Z","timestamp":1585438229000},"page":"1-11","source":"Crossref","is-referenced-by-count":0,"title":["Image-Text Joint Learning for Social Images with Spatial Relation Model"],"prefix":"10.1155","volume":"2020","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9155-1865","authenticated-orcid":true,"given":"Jiangfan","family":"Feng","sequence":"first","affiliation":[{"name":"Chongqing University of Posts and Telecommunications, College of Computer Science and Technology, Space Big Data Intelligent Technology Chongqing Engineering Research Center, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuejun","family":"Fu","sequence":"additional","affiliation":[{"name":"Chongqing University of Posts and Telecommunications, College of Computer Science and Technology, Space Big Data Intelligent Technology Chongqing Engineering Research Center, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yao","family":"Zhou","sequence":"additional","affiliation":[{"name":"Chongqing University of Posts and Telecommunications, College of Computer Science and Technology, Space Big Data Intelligent Technology Chongqing Engineering Research Center, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuling","family":"Zhu","sequence":"additional","affiliation":[{"name":"Chongqing University of Posts and Telecommunications, College of Computer Science and Technology, Space Big Data Intelligent Technology Chongqing Engineering Research Center, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaobo","family":"Luo","sequence":"additional","affiliation":[{"name":"Chongqing University of Posts and Telecommunications, College of Computer Science and Technology, Space Big Data Intelligent Technology Chongqing Engineering Research Center, Chongqing 400065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1109\/lgrs.2018.2830403"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2013.2280895"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2014.2306655"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2016.2520087"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2016.2642953"},{"issue":"2","key":"8","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TPAMI.2011.119","volume":"34","year":"2012","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2018.2881928"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90087-6"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1017\/s0140525x16001837"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1109\/tkde.2018.2840127"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00166"},{"issue":"9","key":"36","volume":"32","year":"2010","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.1109\/tnnls.2018.2856253"},{"key":"40","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"41","doi-asserted-by":"publisher","DOI":"10.1109\/access.2019.2922006"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2019.2917229"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2016.2598339"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/1543947.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/1543947.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/1543947.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,3,28]],"date-time":"2020-03-28T23:30:32Z","timestamp":1585438232000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/complexity\/2020\/1543947\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,28]]},"references-count":17,"alternative-id":["1543947","1543947"],"URL":"https:\/\/doi.org\/10.1155\/2020\/1543947","relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"type":"print","value":"1076-2787"},{"type":"electronic","value":"1099-0526"}],"subject":[],"published":{"date-parts":[[2020,3,28]]}}}