{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T17:37:17Z","timestamp":1781890637846,"version":"3.54.5"},"reference-count":47,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","funder":[{"name":"NSFC, China","award":["61876107"],"award-info":[{"award-number":["61876107"]}]},{"name":"NSFC, China","award":["U1803261"],"award-info":[{"award-number":["U1803261"]}]},{"name":"Committee of Science and Technology, Shanghai, China","award":["19510711200"],"award-info":[{"award-number":["19510711200"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:p> Detection of violent human behavior is necessary for public safety and monitoring. However, it demands constant human observation and attention in human-based surveillance systems, which is a challenging task. Autonomous detection of violent human behavior is therefore essential for continuous uninterrupted video surveillance. In this paper, we propose a novel method for violence detection and localization in videos using the fusion of spatio-temporal features and attention model. The model consists of Fusion Convolutional Neural Network (Fusion-CNN), spatio-temporal attention modules and Bi-directional Convolutional LSTMs (BiConvLSTM). The Fusion-CNN learns both spatial and temporal features by combining multi-level inter-layer features from both RGB and Optical flow input frames. The spatial attention module is used to generate an importance mask to focus on the most important areas of the image frame. The temporal attention part, which is based on BiConvLSTM, identifies the most significant video frames which are related to violent activity. The proposed model can also localize and discriminate prominent regions in both spatial and temporal domains, given the weakly supervised training with only video-level classification labels. Experimental results evaluated on different publicly available benchmarking datasets show the superior performance of the proposed model in comparison with the existing methods. Our model achieves the improved accuracies (ACC) of 89.1%, 99.1% and 98.15% for RWF-2000, HockeyFight and Crowd-Violence datasets, respectively. For CCTV-FIGHTS dataset, we choose the mean average precision (mAp) performance metric and our model obtained 80.7% mAp. <\/jats:p>","DOI":"10.1142\/s0218001422550023","type":"journal-article","created":{"date-parts":[[2021,12,9]],"date-time":"2021-12-09T02:49:57Z","timestamp":1639018197000},"source":"Crossref","is-referenced-by-count":13,"title":["Multi-Level Two-Stream Fusion-Based Spatio-Temporal Attention Model for Violence Detection and Localization"],"prefix":"10.1142","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0318-7379","authenticated-orcid":false,"given":"Mujtaba","family":"Asad","sequence":"first","affiliation":[{"name":"Institute of Image Processing & Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"He","family":"Jiang","sequence":"additional","affiliation":[{"name":"Institute of Image Processing & Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Institute of Image Processing & Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Enmei","family":"Tu","sequence":"additional","affiliation":[{"name":"Institute of Image Processing & Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aftab A.","family":"Malik","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Lahore Garrison University,  Lahore 54810, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2021,12,8]]},"reference":[{"issue":"6","key":"S0218001422550023BIB001","first-page":"1415","volume-title":"The Visual Computer","volume":"37","author":"Asad M.","year":"2020"},{"key":"S0218001422550023BIB002","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-36708-4_33"},{"key":"S0218001422550023BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2831447"},{"key":"S0218001422550023BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"S0218001422550023BIB006","first-page":"5238","volume-title":"2008 30th Annual Int. Conf. IEEE Engineering in Medicine and Biology Society","author":"Chen D.","year":"2008"},{"key":"S0218001422550023BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2006.886263"},{"key":"S0218001422550023BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.177"},{"key":"S0218001422550023BIB010","doi-asserted-by":"publisher","DOI":"10.1007\/11744047_33"},{"key":"S0218001422550023BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2002.1044748"},{"key":"S0218001422550023BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/SIBGRAPI.2010.38"},{"key":"S0218001422550023BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"S0218001422550023BIB014","first-page":"478","volume-title":"2014 Int. Conf. Computer Vision Theory and Applications (VISAPP)","volume":"2","author":"Deniz O.","year":"2014"},{"key":"S0218001422550023BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-3002-4_43"},{"key":"S0218001422550023BIB016","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-019-00821-3"},{"key":"S0218001422550023BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2016.01.006"},{"key":"S0218001422550023BIB018","doi-asserted-by":"publisher","DOI":"10.1007\/11752912_55"},{"key":"S0218001422550023BIB019","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.793"},{"key":"S0218001422550023BIB020","first-page":"34","volume-title":"Advances in Neural Information Processing Systems","author":"Girdhar R.","year":"2017"},{"issue":"4","key":"S0218001422550023BIB021","doi-asserted-by":"crossref","first-page":"e0120448","DOI":"10.1371\/journal.pone.0120448","volume":"10","author":"Gracia I. S.","year":"2015","journal-title":"PLoS One"},{"key":"S0218001422550023BIB022","volume-title":"Proc. Eur. Conf. Computer Vision (ECCV)","author":"Hanson A.","year":"2018"},{"key":"S0218001422550023BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2012.6239348"},{"key":"S0218001422550023BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"S0218001422550023BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00745"},{"key":"S0218001422550023BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"S0218001422550023BIB027","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-1838-7"},{"key":"S0218001422550023BIB028","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2017.10.011"},{"key":"S0218001422550023BIB029","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2015.7301787"},{"key":"S0218001422550023BIB030","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_1"},{"key":"S0218001422550023BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2017.50"},{"key":"S0218001422550023BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.1998.723496"},{"key":"S0218001422550023BIB033","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23678-5_39"},{"key":"S0218001422550023BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683676"},{"key":"S0218001422550023BIB035","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-012-0768-y"},{"key":"S0218001422550023BIB036","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(92)90242-F"},{"key":"S0218001422550023BIB037","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2725820"},{"key":"S0218001422550023BIB038","first-page":"568","volume-title":"Advances in Neural Information Processing Systems","author":"Simonyan K.","year":"2014"},{"key":"S0218001422550023BIB041","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2818328"},{"key":"S0218001422550023BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2017.8078468"},{"key":"S0218001422550023BIB043","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"S0218001422550023BIB044","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2020.11.018"},{"key":"S0218001422550023BIB045","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58577-8_20"},{"key":"S0218001422550023BIB046","first-page":"802","volume-title":"Advances in Neural Information Processing Systems","author":"Xingjian S.","year":"2015"},{"key":"S0218001422550023BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2014.6854259"},{"key":"S0218001422550023BIB048","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2016.10.010"},{"key":"S0218001422550023BIB049","first-page":"3320","volume-title":"Advances in Neural Information Processing Systems","author":"Yosinski J.","year":"2014"},{"key":"S0218001422550023BIB050","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298735"},{"key":"S0218001422550023BIB052","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2016.2589858"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001422550023","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T07:59:10Z","timestamp":1646294350000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218001422550023"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,8]]},"references-count":47,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1142\/S0218001422550023"],"URL":"https:\/\/doi.org\/10.1142\/s0218001422550023","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"value":"0218-0014","type":"print"},{"value":"1793-6381","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,8]]},"article-number":"2255002"}}