{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:02:37Z","timestamp":1777705357422,"version":"3.51.4"},"reference-count":14,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2024,2,14]]},"abstract":"<jats:p>Visual attention has emerged as a prominent approach for improving the effectiveness of image captioning, as it enables the decoder network to focus selectively on the most salient regions in the image content, thereby facilitating the generation of precise and informative captions. Although visual attention achieves the improvement, the small numerical values of its input have a negative impact on its softmax, decreasing its effectiveness. To address this limitation, we propose a refined visual attention (RVA) framework that internally reweights visual attention by leveraging the language context of previously generated words. We first feed the language context into a fully connected layer to obtain appropriate dimensions for the visual features. Then, we use a sigmoid function to obtain a probability distribution to reweight the softmax\u2019s input by applying the multiplication process. Experiments conducted on the MS COCO dataset demonstrate that RVA outperforms traditional visual attention and other existing image captioning methods, highlighting its effectiveness in enhancing the accuracy and informativeness of image captions.<\/jats:p>","DOI":"10.3233\/jifs-233004","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T12:16:44Z","timestamp":1702988204000},"page":"3447-3459","source":"Crossref","is-referenced-by-count":6,"title":["RVAIC: Refined visual attention for improved image captioning"],"prefix":"10.1177","volume":"46","author":[{"given":"Majjed","family":"Al-Qatf","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China"},{"name":"Insight Centre for Data Analytics, University of Galway, Galway, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ammar","family":"Hawbani","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China"},{"name":"School of Computer Science, Shenyang Aerospace University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"XingFu","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amr","family":"Abdusallam","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering and Information Science, University of Science and Technology of China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saeed","family":"Alsamhi","sequence":"additional","affiliation":[{"name":"Insight Centre for Data Analytics, University of Galway, Galway, Ireland"},{"name":"Faculty of Engineering, IBB University, IBB, Yemen"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammed","family":"Alhabib","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Centeral South University, Changsha, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edward","family":"Curry","sequence":"additional","affiliation":[{"name":"Insight Centre for Data Analytics, University of Galway, Galway, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"8","key":"10.3233\/JIFS-233004_ref1","doi-asserted-by":"crossref","first-page":"2149","DOI":"10.1109\/TMM.2019.2951226","article-title":"Show, tell, and polish: Ruminant decoding for image captioning","volume":"22","author":"Guo","year":"2019","journal-title":"IEEE Transactions on Multimedia"},{"issue":"4","key":"10.3233\/JIFS-233004_ref2","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/TPAMI.2016.2587640","article-title":"Show and tell: Lessons learned from the mscoco image captioning challenge,pp","volume":"39","author":"Vinyals","year":"2016","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"11","key":"10.3233\/JIFS-233004_ref3","doi-asserted-by":"crossref","first-page":"4688","DOI":"10.1109\/TNNLS.2019.2957276","article-title":"Neural machine translation with GRU-gated attention model","volume":"31","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"11","key":"10.3233\/JIFS-233004_ref4","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proceedings of the IEEE"},{"issue":"8","key":"10.3233\/JIFS-233004_ref5","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"issue":"3","key":"10.3233\/JIFS-233004_ref12","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1109\/TMM.2019.2931815","article-title":"Recall what you see continually using gridlstm in image captioning","volume":"22","author":"Wu","year":"2019","journal-title":"IEEE Transactions on Multimedia"},{"key":"10.3233\/JIFS-233004_ref15","doi-asserted-by":"crossref","first-page":"57943","DOI":"10.1109\/ACCESS.2020.2981513","article-title":"Hierarchicalattention-based fusion for image caption with multigrained rewards","volume":"8","author":"Wu","year":"2020","journal-title":"IEEE Access"},{"issue":"12","key":"10.3233\/JIFS-233004_ref17","doi-asserted-by":"crossref","first-page":"18413","DOI":"10.1007\/s11042-021-10578-9","article-title":"MRRC: multiple role representation crossover interpretationfor image captioning with R-CNN feature distribution composition(FDC)","volume":"80","author":"Sur","year":"2021","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/JIFS-233004_ref18","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.patrec.2020.12.020","article-title":"Image captioning withtransformer and knowledge graph","volume":"143","author":"Zhang","year":"2021","journal-title":"Pattern Recognition Letters"},{"key":"10.3233\/JIFS-233004_ref22","doi-asserted-by":"crossref","first-page":"11531","DOI":"10.1007\/s11042-019-08567-0","article-title":"GateCap: Gated spatial andsemantic attention model for image captioning","volume":"79","author":"Wang","year":"2020","journal-title":"Multimedia Toolsand Applications"},{"key":"10.3233\/JIFS-233004_ref28","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2022.3202690"},{"key":"10.3233\/JIFS-233004_ref33","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/TIP.2019.2928144","article-title":"Re-caption: Saliency-enhanced image captioning through twophase learning","volume":"29","author":"Zhou","year":"2019","journal-title":"IEEE Transactions on Image Processing"},{"issue":"1","key":"10.3233\/JIFS-233004_ref34","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TCSVT.2021.3067449","article-title":"Task-adaptive attention for image captioning","volume":"32","author":"Yan","year":"2021","journal-title":"IEEE Transactions on Circuits and Systems for Video technology"},{"key":"10.3233\/JIFS-233004_ref35","doi-asserted-by":"crossref","first-page":"2413","DOI":"10.1109\/TMM.2020.3011317","article-title":"Fine-grainedimage captioning with global-local discriminative objective","volume":"23","author":"Wu","year":"2020","journal-title":"IEEE Transactions on Multimedia"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-233004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:43:37Z","timestamp":1777455817000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-233004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,14]]},"references-count":14,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/jifs-233004","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,14]]}}}