{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T02:47:39Z","timestamp":1761878859429,"version":"build-2065373602"},"reference-count":60,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:p>Recently, the transformer model has been utilized for a variety of tasks such as image captioning, image classification natural language generation, and natural language understanding. As a key component of the transformer model, self-attention calculates the attention values by mapping the relationships among the head elements of the source and target sequence, yet there is no explicit mechanism to refine and intensify the attention values with respect to the context of the input and target sequences. Based on this intuition, we introduce a novel refine and intensify attention mechanism that is called Zoneup Dropout Injection Attention Calculation (ZoDIAC), in which the intensities of attention values in the elements of the input source and target sequences are first refined using GELU and dropout and then intensified using a proposed zoneup process which includes the injection of a learned scalar factor. Our extensive experiments show that ZoDIAC achieves statistically significant higher scores under all image captioning metrics. The code for our experiments is publicly available at: https:\/\/github.com\/zanyarz\/zodiac .<\/jats:p>","DOI":"10.1142\/s1793351x25440039","type":"journal-article","created":{"date-parts":[[2025,9,12]],"date-time":"2025-09-12T08:28:43Z","timestamp":1757665723000},"page":"455-477","source":"Crossref","is-referenced-by-count":0,"title":["An Ablation Study on ZoDIAC Via Utilization of Convolutional Features"],"prefix":"10.1142","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0397-3962","authenticated-orcid":false,"given":"Zanyar","family":"Zohourianshahzadi","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Colorado Colorado Springs, 1420 Austin Bluffs Pkwy, Colorado Springs, CO 80918, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5007-2529","authenticated-orcid":false,"given":"Terrance E.","family":"Boult","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Colorado Colorado Springs, 1420 Austin Bluffs Pkwy, Colorado Springs, CO 80918, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8765-7018","authenticated-orcid":false,"given":"Jugal K.","family":"Kalita","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Colorado Colorado Springs, 1420 Austin Bluffs Pkwy, Colorado Springs, CO 80918, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2025,9,24]]},"reference":[{"key":"S1793351X25440039BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_24"},{"key":"S1793351X25440039BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00636"},{"key":"S1793351X25440039BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"S1793351X25440039BIB005","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1075"},{"key":"S1793351X25440039BIB006","first-page":"1877","volume":"33","author":"Brown T.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S1793351X25440039BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01059"},{"key":"S1793351X25440039BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"S1793351X25440039BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"S1793351X25440039BIB011","first-page":"1573","author":"Dosovitskiy A.","year":"2017","journal-title":"Int. J. Comput. Vision"},{"volume-title":"Proc. Int. Conf. Learning Representations","year":"2021","author":"Dosovitskiy A.","key":"S1793351X25440039BIB012"},{"key":"S1793351X25440039BIB013","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15561-1_2"},{"key":"S1793351X25440039BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01034"},{"key":"S1793351X25440039BIB016","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"S1793351X25440039BIB018","first-page":"11135","volume-title":"Proc. Advances in Neural Information Processing Systems","author":"Herdade S.","year":"2019"},{"key":"S1793351X25440039BIB019","first-page":"17980","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Hu X.","year":"2022"},{"key":"S1793351X25440039BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00473"},{"key":"S1793351X25440039BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(99)00163-7"},{"key":"S1793351X25440039BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.494"},{"key":"S1793351X25440039BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"S1793351X25440039BIB024","first-page":"1889","volume-title":"Proc. Advances in Neural Information Processing Systems","author":"Karpathy A.","year":"2014"},{"volume-title":"Proc. Int. Conf. Learning Representations","year":"2015","author":"Kingma D. P.","key":"S1793351X25440039BIB025"},{"key":"S1793351X25440039BIB026","doi-asserted-by":"crossref","unstructured":"C. Koch and  S. Ullman,  Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry  (Springer Netherlands, 1987),  pp. 115\u2013141.","DOI":"10.1007\/978-94-009-3833-5_5"},{"volume-title":"Proc. Int. Conf. Learning Representations","year":"2017","author":"Krueger D.","key":"S1793351X25440039BIB027"},{"key":"S1793351X25440039BIB028","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.162"},{"key":"S1793351X25440039BIB029","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-020-01316-z"},{"key":"S1793351X25440039BIB030","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-009-9059-4"},{"key":"S1793351X25440039BIB031","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.488"},{"key":"S1793351X25440039BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00902"},{"key":"S1793351X25440039BIB033","first-page":"220","volume-title":"Proc. Conf. Natural Language Learning","author":"Li S.","year":"2011"},{"key":"S1793351X25440039BIB034","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin C.-Y.","year":"2004"},{"key":"S1793351X25440039BIB035","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"S1793351X25440039BIB036","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/708"},{"key":"S1793351X25440039BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"S1793351X25440039BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"S1793351X25440039BIB040","first-page":"3111","volume-title":"Proc. Advances in Neural Information Processing Systems","author":"Mikolov T.","year":"2013"},{"volume-title":"Proc. Neural Information Processing Systems","year":"2011","author":"Ordonez V.","key":"S1793351X25440039BIB041"},{"key":"S1793351X25440039BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01098"},{"volume-title":"Proc. 40th Annual Meeting Association for Computational Linguistics","year":"2002","author":"Papineni K.","key":"S1793351X25440039BIB043"},{"key":"S1793351X25440039BIB044","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"S1793351X25440039BIB045","first-page":"8748","volume-title":"Proc. 38th Int. Conf. Machine Learning","volume":"139","author":"Radford A.","year":"2021"},{"key":"S1793351X25440039BIB046","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1264"},{"key":"S1793351X25440039BIB047","first-page":"91","volume-title":"Proc. Advances in Neural Information Processing Systems","author":"Ren S.","year":"2015"},{"key":"S1793351X25440039BIB048","doi-asserted-by":"publisher","DOI":"10.1037\/h0042519"},{"key":"S1793351X25440039BIB050","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1238"},{"issue":"56","key":"S1793351X25440039BIB051","first-page":"1929","volume":"15","author":"Srivastava N.","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"S1793351X25440039BIB052","doi-asserted-by":"publisher","DOI":"10.1145\/2812802"},{"key":"S1793351X25440039BIB053","first-page":"5998","volume-title":"Proc. Advances in Neural Information Processing Systems","author":"Vaswani A.","year":"2017"},{"key":"S1793351X25440039BIB054","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"S1793351X25440039BIB055","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"S1793351X25440039BIB056","volume":"32","author":"Wang A.","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S1793351X25440039BIB057","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5446"},{"key":"S1793351X25440039BIB058","first-page":"23318","volume-title":"Proc. Int. Conf. Machine Learning","author":"Wang P.","year":"2022"},{"volume-title":"Proc. Int. Conf. Learning Representations","year":"2022","author":"Wang Z.","key":"S1793351X25440039BIB060"},{"key":"S1793351X25440039BIB061","first-page":"23965","volume-title":"Proc. 39th Int. Conf. Machine Learning","volume":"162","author":"Wortsman M.","year":"2022"},{"key":"S1793351X25440039BIB063","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_28"},{"key":"S1793351X25440039BIB064","first-page":"2048","volume-title":"Proc. Int. Conf. Machine Learning","volume":"37","author":"Xu K.","year":"2015"},{"key":"S1793351X25440039BIB065","volume":"2022","author":"Yu J.","year":"2022","journal-title":"Trans. Mach. Learn. Res."},{"key":"S1793351X25440039BIB066","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2947482"},{"key":"S1793351X25440039BIB067","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i07.7005"},{"key":"S1793351X25440039BIB068","doi-asserted-by":"publisher","DOI":"10.1109\/AIxSET62544.2024.00008"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X25440039","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T02:09:26Z","timestamp":1761876566000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1793351X25440039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":60,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["10.1142\/S1793351X25440039"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x25440039","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"type":"print","value":"1793-351X"},{"type":"electronic","value":"1793-7108"}],"subject":[],"published":{"date-parts":[[2025,9]]}}}