{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T01:02:21Z","timestamp":1767920541742,"version":"3.49.0"},"reference-count":46,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","funder":[{"DOI":"10.13039\/501100017691","name":"Guangxi Key Research and Development Program","doi-asserted-by":"crossref","award":["AB17195053"],"award-info":[{"award-number":["AB17195053"]}],"id":[{"id":"10.13039\/501100017691","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100017691","name":"Guangxi Key Research and Development Program","doi-asserted-by":"crossref","award":["AB18126053"],"award-info":[{"award-number":["AB18126053"]}],"id":[{"id":"10.13039\/501100017691","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Guilin Science and Technology Development Program","award":["20180107-4"],"award-info":[{"award-number":["20180107-4"]}]},{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61762025"],"award-info":[{"award-number":["61762025"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004607","name":"Guangxi Natural Science Foundation","doi-asserted-by":"crossref","award":["2017GXNSFAA198226"],"award-info":[{"award-number":["2017GXNSFAA198226"]}],"id":[{"id":"10.13039\/501100004607","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004607","name":"Guangxi Natural Science Foundation","doi-asserted-by":"crossref","award":["2019GXNSFDA185007"],"award-info":[{"award-number":["2019GXNSFDA185007"]}],"id":[{"id":"10.13039\/501100004607","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Guangxi Key Laboratory of Trusted Software","award":["kx201703"],"award-info":[{"award-number":["kx201703"]}]},{"name":"Guangxi Key Laboratory of Cryptography and Information Security","award":["GCIS201709"],"award-info":[{"award-number":["GCIS201709"]}]},{"name":"the Innovation Project of GUET Graduate Education","award":["2019YCXS051"],"award-info":[{"award-number":["2019YCXS051"]}]},{"name":"Guangxi Colleges and Universities Key Laboratory of Intelligent Processing of Computer Image and Graphics","award":["GIIP201603"],"award-info":[{"award-number":["GIIP201603"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p> In this paper, we propose the hybrid deep neural network-based cross-modal image and text retrieval method to explore complex cross-modal correlation by considering multi-layer learning. First, we propose intra-modal and inter-modal representations to achieve a complementary single-modal representation that preserves the correlation between the modalities. Second, we build an association between different modalities through hierarchical learning to further mine the fine-grained latent semantic association among multimodal data. The experimental results show that our algorithm substantially enhances retrieval performance and consistently outperforms four comparison methods. <\/jats:p>","DOI":"10.1142\/s0218126621500183","type":"journal-article","created":{"date-parts":[[2020,5,19]],"date-time":"2020-05-19T05:09:11Z","timestamp":1589864951000},"page":"2150018","source":"Crossref","is-referenced-by-count":4,"title":["Hybrid Deep Neural Network-Based Cross-Modal Image and Text Retrieval Method for Large-Scale Data"],"prefix":"10.1142","volume":"30","author":[{"given":"Baohua","family":"Qiang","sequence":"first","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruidong","family":"Chen","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuan","family":"Xie","sequence":"additional","affiliation":[{"name":"Guangxi Colleges and Universities Key Laboratory of Intelligent Processing of Computer Image and Graphics, Guilin University of Electronic Technology, Guilin 541004, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1874-3641","authenticated-orcid":false,"given":"Mingliang","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science, Chongqing University, 174 Shazheng Street, Shapingba District, Chongqing, P. R. China"},{"name":"State Key Laboratory of Internet of Things for Smart, City Faculty of Science and Technology, University of Macau, Macau SAR, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Riwei","family":"Pan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tian","family":"Zhao","sequence":"additional","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2020,8,5]]},"reference":[{"key":"S0218126621500183BIB001","doi-asserted-by":"publisher","DOI":"10.1142\/S0218126619300095"},{"key":"S0218126621500183BIB002","doi-asserted-by":"publisher","DOI":"10.1142\/S0218126618300076"},{"key":"S0218126621500183BIB004","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.1109\/TC.2019.2935042","volume":"68","author":"Zhou J.","year":"2019","journal-title":"IEEE Trans. Comput."},{"key":"S0218126621500183BIB005","doi-asserted-by":"crossref","first-page":"2215","DOI":"10.1109\/TCAD.2018.2883993","volume":"38","author":"Zhou J.","year":"2019","journal-title":"IEEE Trans. Comput-Aided Des. Integr. Circuits Syst."},{"key":"S0218126621500183BIB006","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1109\/TSUSC.2017.2777503","volume":"4","author":"Wang X.","year":"2019","journal-title":"IEEE Trans. Sustain. Comput."},{"key":"S0218126621500183BIB007","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1109\/TBDATA.2017.2757942","volume":"4","author":"Wang X.","year":"2018","journal-title":"IEEE Trans. Big Data."},{"key":"S0218126621500183BIB008","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.sysarc.2017.09.007","volume":"82","author":"Zhou J.","year":"2018","journal-title":"J. Syst. Architect. Embedded Syst. Des."},{"key":"S0218126621500183BIB009","author":"Wu C.","year":"2019","journal-title":"J. Circuits Syst. Comput."},{"key":"S0218126621500183BIB010","author":"Kumar P. S.","year":"2019","journal-title":"J. Circuits Syst. Comput."},{"key":"S0218126621500183BIB011","doi-asserted-by":"publisher","DOI":"10.1142\/S021812661850189X"},{"key":"S0218126621500183BIB013","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1631\/FITEE.1601787","volume":"18","author":"Peng Y. X.","year":"2017","journal-title":"Front. Inform. Technol. Electr. Eng."},{"key":"S0218126621500183BIB014","first-page":"1185","volume-title":"Proceedings of the 3th International Conference on Intelligent System Design and Engineering Applications","author":"Wang X.","year":"2013"},{"key":"S0218126621500183BIB015","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1145\/3343031.3350974","volume-title":"Proc. 27th ACM International Conference on Multimedia","author":"He X.","year":"2019"},{"key":"S0218126621500183BIB016","doi-asserted-by":"crossref","first-page":"4283","DOI":"10.3390\/s19194283","volume":"19","author":"Rub\u00ed S.","year":"2019","journal-title":"Sensors"},{"key":"S0218126621500183BIB017","doi-asserted-by":"crossref","first-page":"2612","DOI":"10.3390\/s19112612","volume":"19","author":"Bustamante A.","year":"2019","journal-title":"Sensors"},{"key":"S0218126621500183BIB018","first-page":"689","volume-title":"Proceeding of the 28th International Conference on Machine Learning","author":"Ngiam J.","year":"2011"},{"key":"S0218126621500183BIB019","first-page":"2222","volume-title":"Proceeding of the 2012 International Conference on Neural Information Processing System (NIPS)","author":"Srivastava N.","year":"2012"},{"key":"S0218126621500183BIB020","first-page":"7","volume-title":"Proceeding of the ACM International Conference on Multimedia (ACM MM)","author":"Feng F."},{"key":"S0218126621500183BIB021","first-page":"7181","volume-title":"Proceeding of the2018 IEEE Conference on Computational Vision and Pattern Recognition (CVPR)","author":"Gu J.","year":"2018"},{"key":"S0218126621500183BIB022","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1109\/TMM.2011.2181343","volume":"14","author":"Daras P.","year":"2011","journal-title":"IEEE Trans. Multimedia."},{"key":"S0218126621500183BIB023","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1109\/TMM.2016.2646219","volume":"19","author":"Zhang L.","year":"2016","journal-title":"IEEE Trans. Multimedia."},{"key":"S0218126621500183BIB024","first-page":"251","volume-title":"Proc. 18th Int. Conf. Multimedia (MM)","author":"Rasiwasia N.","year":"2010"},{"key":"S0218126621500183BIB025","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1109\/TPAMI.2013.142","volume":"36","author":"Pereira J. C.","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"S0218126621500183BIB026","doi-asserted-by":"crossref","first-page":"2160","DOI":"10.1109\/CVPR.2012.6247923","volume-title":"Proc. 2012 IEEE Conference on Computer Vision Pattern Recognition (CVPR)","author":"Sharma A.","year":"2012"},{"key":"S0218126621500183BIB027","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1007\/s11263-013-0658-4","volume":"106","author":"Gong Y.","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"S0218126621500183BIB028","doi-asserted-by":"crossref","first-page":"4094","DOI":"10.1109\/ICCV.2015.466","volume-title":"Proc. 2015 IEEE Int. Conf. Computer Vision (ICCV)","author":"Ranjan V.","year":"2015"},{"key":"S0218126621500183BIB029","first-page":"225","volume-title":"Proc. 34th Int. ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Zhang D.","year":"2011"},{"key":"S0218126621500183BIB030","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1109\/TMM.2013.2291214","volume":"16","author":"Wu F.","year":"2014","journal-title":"IEEE Trans. Multimedia."},{"key":"S0218126621500183BIB031","first-page":"1376","volume-title":"Proc. 2012 Int. Conference on Neural Information Processing Systems (NIPS)","author":"Zhen Y.","year":"2012"},{"key":"S0218126621500183BIB032","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1145\/2647868.2654906","volume-title":"Proc. ACM International Conference on Multimedia (ACM MM)","author":"Hu Y.","year":"2014"},{"key":"S0218126621500183BIB033","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1145\/2339530.2339678","volume-title":"Proc. 18th ACM SIGKDD International Conference on Knowledge Discovery Data Mining","author":"Zhen Y.","year":"2012"},{"key":"S0218126621500183BIB034","first-page":"395","volume-title":"Proc. 37th International ACM SIGIR Conference on Research Development and Information Retrieval","author":"Yu Z.","year":"2014"},{"key":"S0218126621500183BIB035","first-page":"579","volume-title":"Proc. 39th International ACM SIGIR erence on Research Development and Information Retrieval","author":"Long M.","year":"2016"},{"key":"S0218126621500183BIB036","first-page":"3342","volume-title":"Proceedings of the 2018 AAAI Conference on Artificial Intelligence","author":"Jiang Q. Y.","year":"2018"},{"key":"S0218126621500183BIB037","doi-asserted-by":"crossref","first-page":"3269","DOI":"10.3390\/s19153269","volume":"19","author":"Gao H.","year":"2019","journal-title":"Sensors"},{"key":"S0218126621500183BIB038","doi-asserted-by":"crossref","first-page":"5356","DOI":"10.3390\/s19245356","volume":"19","author":"Pastor F.","year":"2019","journal-title":"Sensors"},{"key":"S0218126621500183BIB039","first-page":"3441","volume-title":"Proc. 2015 IEEE Conf. Comput. Vis. Pattern Recognition (CVPR)","author":"Yan F.","year":"2015"},{"key":"S0218126621500183BIB040","first-page":"579","volume-title":"Proc. 24th International Conference on Computational Linguistics","author":"Kim J.","year":"2012"},{"key":"S0218126621500183BIB041","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/TMM.2017.2742704","volume":"20","author":"Peng Y.","year":"2017","journal-title":"IEEE Trans. Multimedia."},{"key":"S0218126621500183BIB042","first-page":"79","volume-title":"Proc. 29th International Conference on Machine Learning (ICML)","author":"Srivastava N.","year":"2012"},{"key":"S0218126621500183BIB043","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","volume":"313","author":"Hinton G. E.","year":"2006","journal-title":"Science"},{"key":"S0218126621500183BIB045","first-page":"1070","volume-title":"Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence","author":"Zhuang Y. T.","year":"2013"},{"key":"S0218126621500183BIB046","first-page":"48","volume-title":"Proc. 8th ACM International Conference on Image Video Retrieval","author":"Chua T. S.","year":"2009"},{"key":"S0218126621500183BIB048","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/978-3-642-15561-1_2","volume-title":"Proc. 2010 European Conference on Computer Vision (ECCV)","author":"Farhadi A.","year":"2010"},{"key":"S0218126621500183BIB049","doi-asserted-by":"crossref","first-page":"2088","DOI":"10.1109\/ICCV.2013.261","volume-title":"Proc. 2013 IEEE International Conference on Computer Vision (ICCV)","author":"Wang K.","year":"2013"},{"key":"S0218126621500183BIB050","doi-asserted-by":"crossref","first-page":"2639","DOI":"10.1162\/0899766042321814","volume":"16","author":"Hardoon D. R.","year":"2004","journal-title":"Neural Comput."}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126621500183","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,3]],"date-time":"2021-02-03T04:06:19Z","timestamp":1612325179000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218126621500183"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,5]]},"references-count":46,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1142\/S0218126621500183"],"URL":"https:\/\/doi.org\/10.1142\/s0218126621500183","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,5]]}}}