{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:46:35Z","timestamp":1784133995611,"version":"3.55.0"},"reference-count":93,"publisher":"Springer Science and Business Media LLC","issue":"21","license":[{"start":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T00:00:00Z","timestamp":1724630400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T00:00:00Z","timestamp":1724630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008982","name":"Qatar National Research Fund","doi-asserted-by":"publisher","award":["AICC03-0324-200005"],"award-info":[{"award-number":["AICC03-0324-200005"]}],"id":[{"id":"10.13039\/100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:sec><jats:title>Abstract<\/jats:title><jats:p>In recent years, crowd behavior detection has posed significant challenges in the realm of public safety and security, even with the advancements in surveillance technologies. The ability to perform real-time surveillance and accurately identify crowd behavior by considering factors such as crowd size and violence levels can avert potential crowd-related disasters and hazards to a considerable extent. However, most existing approaches are not viable to deal with the complexities of crowd dynamics and fail to distinguish different violence levels within crowds. Moreover, the prevailing approach to crowd behavior recognition, which solely relies on the analysis of closed-circuit television (CCTV) footage and overlooks the integration of online social media video content, leads to a primarily reactive methodology. This paper proposes a crowd behavior detection framework based on the swin transformer architecture, which leverages crowd counting maps and optical flow maps to detect crowd behavior across various sizes and violence levels. To support this framework, we created a dataset comprising videos capable of recognizing crowd behaviors based on size and violence levels sourced from CCTV camera footage and online videos. Experimental analysis conducted on benchmark datasets and our proposed dataset substantiates the superiority of our proposed approach over existing state-of-the-art methods, showcasing its ability to effectively distinguish crowd behaviors concerning size and violence level. Our method\u2019s validation through Nvidia\u2019s DeepStream Software Development Kit (SDK) highlights its competitive performance and potential for real-time intelligent surveillance applications.<\/jats:p><\/jats:sec><jats:sec><jats:title>Graphical abstract<\/jats:title><\/jats:sec>","DOI":"10.1007\/s10489-024-05775-6","type":"journal-article","created":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T07:02:16Z","timestamp":1724655736000},"page":"10709-10730","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Crowd behavior detection: leveraging video swin transformer for crowd size and violence level analysis"],"prefix":"10.1007","volume":"54","author":[{"given":"Marwa","family":"Qaraqe","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yin David","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4274-7092","authenticated-orcid":false,"given":"Elizabeth B","family":"Varghese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emrah","family":"Basaran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Almiqdad","family":"Elzein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,8,26]]},"reference":[{"issue":"5","key":"5775_CR1","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MSP.2010.937451","volume":"27","author":"CS Regazzoni","year":"2010","unstructured":"Regazzoni CS, Cavallaro A, Wu Y, Konrad J, Hampapur A (2010) Video analytics for surveillance: Theory and practice [from the guest editors]. IEEE Signal Process Mag 27(5):16\u201317","journal-title":"IEEE Signal Process Mag"},{"key":"5775_CR2","unstructured":"Varghese EB, Thampi SM (2023) A comprehensive review of crowd behavior and social group analysis techniques in smart surveillance. Intell Image Video Anal 57\u201384"},{"issue":"4","key":"5775_CR3","doi-asserted-by":"crossref","first-page":"1992","DOI":"10.1109\/TIP.2017.2670780","volume":"26","author":"M Sabokrou","year":"2017","unstructured":"Sabokrou M, Fayyaz M, Fathy M, Klette R (2017) Deep-cascade: Cascading 3d deep neural networks for fast anomaly detection and localization in crowded scenes. IEEE Trans Image Process 26(4):1992\u20132004","journal-title":"IEEE Trans Image Process"},{"key":"5775_CR4","first-page":"358","volume":"47","author":"S Zhou","year":"2016","unstructured":"Zhou S, Shen W, Zeng D, Fang M, Wei Y, Zhang Z (2016) Spatial-temporal convolutional neural networks for anomaly detection and localization in crowded scenes. Signal Process: Image Commun 47:358\u2013368","journal-title":"Signal Process: Image Commun"},{"key":"5775_CR5","doi-asserted-by":"crossref","unstructured":"Sumon SA, Shahria MT, Goni MR, Hasan N, Almarufuzzaman A, Rahman RM (2019) Violent crowd flow detection using deep learning. In: Intelligent information and database systems: 11th Asian Conference, ACIIDS 2019, Yogyakarta, Indonesia, April 8\u201311, 2019, Proceedings, Part I 11, Springer, pp 613\u2013625","DOI":"10.1007\/978-3-030-14799-0_53"},{"key":"5775_CR6","doi-asserted-by":"crossref","unstructured":"Ravanbakhsh M, Nabi M, Sangineto E, Marcenaro L, Regazzoni C, Sebe N (2017) Abnormal event detection in videos using generative adversarial nets. In: 2017 IEEE International conference on image processing (ICIP), IEEE, pp 1577\u20131581","DOI":"10.1109\/ICIP.2017.8296547"},{"key":"5775_CR7","doi-asserted-by":"crossref","unstructured":"Marsden M, McGuinness K, Little S, O\u2019Connor NE (2017) Resnetcrowd: A residual deep learning architecture for crowd counting, violent behaviour detection and crowd density level classification. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), IEEE, pp 1\u20137","DOI":"10.1109\/AVSS.2017.8078482"},{"key":"5775_CR8","doi-asserted-by":"crossref","DOI":"10.7249\/RR2736","volume-title":"How Can Crowd Behaviour Modelling Be Used to Prevent and Respond to Violence and Antisocial Behaviour at Qatar 2022?","author":"J Glenesk","year":"2018","unstructured":"Glenesk J, Strang L, Disley E (2018) How Can Crowd Behaviour Modelling Be Used to Prevent and Respond to Violence and Antisocial Behaviour at Qatar 2022? RAND Corporation, Cambridge, UK"},{"key":"5775_CR9","unstructured":"DeepStream SDK NVIDIA Developer. https:\/\/developer.nvidia.com\/deepstream-sdk. Last accessed 5 July 2023"},{"key":"5775_CR10","doi-asserted-by":"crossref","unstructured":"Zhiqiang W, Jun L (2017) A review of object detection based on convolutional neural network. In: 2017 36th Chinese Control Conference (CCC), IEEE, pp 11104\u201311109","DOI":"10.23919\/ChiCC.2017.8029130"},{"key":"5775_CR11","doi-asserted-by":"crossref","unstructured":"Chu Q, Ouyang W, Li H, Wang X, Liu B, Yu N (2017) Online multi-object tracking using cnn-based single object tracker with spatial-temporal attention mechanism. In: Proceedings of the IEEE international conference on computer vision, pp 4836\u20134845","DOI":"10.1109\/ICCV.2017.518"},{"key":"5775_CR12","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.patrec.2018.05.018","volume":"118","author":"G Yao","year":"2019","unstructured":"Yao G, Lei T, Zhong J (2019) A review of convolutional-neural-network-based action recognition. Pattern Recognit Lett 118:14\u201322","journal-title":"Pattern Recognit Lett"},{"key":"5775_CR13","doi-asserted-by":"crossref","unstructured":"Dupont C, Tobias L, Luvison B (2017) Crowd-11: A dataset for fine grained crowd behaviour analysis. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 9\u201316","DOI":"10.1109\/CVPRW.2017.271"},{"key":"5775_CR14","unstructured":"Varghese EB, Thampi SM (2018) A deep learning approach to predict crowd behavior based on emotion. In: Smart Multimedia: First International Conference, ICSM 2018, Toulon, France, August 24\u201326, 2018, Revised Selected Papers 1, Springer pp 296\u2013307"},{"key":"5775_CR15","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"5775_CR16","unstructured":"Ng JY-H, Choi J, Neumann J, Davis LS (2018) Actionflownet: Learning motion representation for action recognition. In: 2018 IEEE Winter conference on applications of computer vision (WACV), IEEE, pp 1616\u20131624"},{"key":"5775_CR17","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.neucom.2023.02.045","volume":"533","author":"J Zhang","year":"2023","unstructured":"Zhang J, Wang X, Wan Y, Wang L, Wang J, Philip SY (2023) Sor-tc: Self-attentive octave resnet with temporal consistency for compressed video action recognition. Neurocomputing 533:191\u2013205","journal-title":"Neurocomputing"},{"key":"5775_CR18","doi-asserted-by":"crossref","unstructured":"Kakamu Y, Hotta K (2022) Predicting human behavior using 3d loop resnet. In: 2022 26th International conference on pattern recognition (ICPR), IEEE, pp 3259\u20133264","DOI":"10.1109\/ICPR56361.2022.9956136"},{"issue":"5","key":"5775_CR19","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.3390\/electronics12051165","volume":"12","author":"T Alafif","year":"2023","unstructured":"Alafif T, Hadi A, Allahyani M, Alzahrani B, Alhothali A, Alotaibi R, Barnawi A (2023) Hybrid classifiers for spatio-temporal abnormal behavior detection, tracking, and recognition in massive hajj crowds. Electronics 12(5):1165","journal-title":"Electronics"},{"key":"5775_CR20","doi-asserted-by":"crossref","unstructured":"Mandal B, Fajtl J, Argyriou V, Monekosso D, Remagnino P (2018) Deep residual network with subclass discriminant analysis for crowd behavior recognition. In: 2018 25th IEEE International Conference on Image Processing (ICIP), IEEE, pp 938\u2013942","DOI":"10.1109\/ICIP.2018.8451190"},{"issue":"3","key":"5775_CR21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.46253\/j.mr.v3i3.a1","volume":"3","author":"Y Chen","year":"2020","unstructured":"Chen Y (2020) Crowd behaviour recognition using enhanced butterfly optimization algorithm based recurrent neural network. Multimed Res 3(3):1\u201320","journal-title":"Multimed Res"},{"key":"5775_CR22","doi-asserted-by":"crossref","unstructured":"Ebrahimi\u00a0Kahou S, Michalski V, Konda K, Memisevic R, Pal C (2015) Recurrent neural networks for emotion recognition in video. In: Proceedings of the 2015 ACM on international conference on multimodal interaction, pp 467\u2013474","DOI":"10.1145\/2818346.2830596"},{"key":"5775_CR23","doi-asserted-by":"crossref","first-page":"139489","DOI":"10.1109\/ACCESS.2021.3118541","volume":"9","author":"V Sharma","year":"2021","unstructured":"Sharma V, Gupta M, Kumar A, Mishra D (2021) Video processing using deep learning techniques: A systematic literature review. IEEE Access 9:139489\u2013139507","journal-title":"IEEE Access"},{"key":"5775_CR24","doi-asserted-by":"crossref","unstructured":"Ibrahim MS, Muralidharan S, Deng Z, Vahdat A, Mori G (2016) A hierarchical deep temporal model for group activity recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1971\u20131980","DOI":"10.1109\/CVPR.2016.217"},{"issue":"2","key":"5775_CR25","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1109\/TAFFC.2020.2987021","volume":"13","author":"EB Varghese","year":"2020","unstructured":"Varghese EB, Thampi SM, Berretti S (2020) A psychologically inspired fuzzy cognitive deep learning framework to predict crowd behavior. IEEE Trans Affective Comput 13(2):1005\u20131022","journal-title":"IEEE Trans Affective Comput"},{"key":"5775_CR26","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30"},{"key":"5775_CR27","unstructured":"Lepikhin D, Lee H, Xu Y, Chen D, Firat O, Huang Y, Krikun M, Shazeer N, Chen Z (2020) Gshard: Scaling giant models with conditional computation and automatic sharding. In: International conference on learning representations"},{"key":"5775_CR28","volume-title":"Deep Learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep Learning. MIT press, London"},{"key":"5775_CR29","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby N (2021) An image is worth 16x16 words: Transformers for image recognition at scale. In: International conference on learning representations"},{"key":"5775_CR30","unstructured":"Zhu X, Su W, Lu L, Li B, Wang X, Dai J (2021) Deformable {detr}: Deformable transformers for end-to-end object detection. In: International conference on learning representations"},{"key":"5775_CR31","doi-asserted-by":"crossref","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B (2021) Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 10012\u201310022","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"5775_CR32","doi-asserted-by":"crossref","unstructured":"Arnab A, Dehghani M, Heigold G, Sun C, Lu\u010di\u0107 M, Schmid C (2021) Vivit: A video vision transformer. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 6836\u20136846","DOI":"10.1109\/ICCV48922.2021.00676"},{"key":"5775_CR33","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.cviu.2017.10.011","volume":"166","author":"Z Li","year":"2018","unstructured":"Li Z, Gavrilyuk K, Gavves E, Jain M, Snoek CG (2018) Videolstm convolves, attends and flows for action recognition. Comput Vision Image Underst 166:41\u201350","journal-title":"Comput Vision Image Underst"},{"key":"5775_CR34","unstructured":"Zhang L, Zhu G, Mei L, Shen P, Shah SAA, Bennamoun M (2018) Attention in convolutional lstm for gesture recognition. Adv Neural Inf Process Syst 31"},{"key":"5775_CR35","doi-asserted-by":"crossref","unstructured":"Liu Z, Ning J, Cao Y, Wei Y, Zhang Z, Lin S, Hu H (2022) Video swin transformer. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 3202\u20133211","DOI":"10.1109\/CVPR52688.2022.00320"},{"key":"5775_CR36","doi-asserted-by":"crossref","unstructured":"Wang Y, Neves L, Metze F (2016) Audio-based multimedia event detection using deep recurrent neural networks. In: 2016 IEEE International conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 2742\u20132746","DOI":"10.1109\/ICASSP.2016.7472176"},{"key":"5775_CR37","unstructured":"Lan Z (2017) Towards usable multimedia event detection. PhD thesis, PhD Thesis, Carnegie Mellon University"},{"key":"5775_CR38","doi-asserted-by":"crossref","unstructured":"Ye G, Li Y, Xu H, Liu D, Chang S-F (2015) Eventnet: A large scale structured concept library for complex event detection in video. In: Proceedings of the 23rd ACM international conference on multimedia, pp 471\u2013480","DOI":"10.1145\/2733373.2806221"},{"key":"5775_CR39","doi-asserted-by":"crossref","unstructured":"Amrutha C, Jyotsna C, Amudha J (2020) Deep learning approach for suspicious activity detection from surveillance video. In: 2020 2nd International conference on innovative mechanisms for industry applications (ICIMIA), IEEE, pp 335\u2013339","DOI":"10.1109\/ICIMIA48430.2020.9074920"},{"issue":"17","key":"5775_CR40","doi-asserted-by":"crossref","first-page":"6563","DOI":"10.3390\/s22176563","volume":"22","author":"SW Khan","year":"2022","unstructured":"Khan SW, Hafeez Q, Khalid MI, Alroobaea R, Hussain S, Iqbal J, Almotiri J, Ullah SS (2022) Anomaly detection in traffic surveillance videos using deep learning. Sensors 22(17):6563","journal-title":"Sensors"},{"key":"5775_CR41","doi-asserted-by":"crossref","unstructured":"Aboah A (2021) A vision-based system for traffic anomaly detection using deep learning and decision trees. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 4207\u20134212","DOI":"10.1109\/CVPRW53098.2021.00475"},{"key":"5775_CR42","unstructured":"Baqui M, L\u00f6hner R (2017) Real-time crowd safety and comfort management from cctv images. In: Real-Time image and video processing 2017, SPIE, vol. 10223, pp 10\u201323"},{"issue":"4","key":"5775_CR43","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MWC.021.2000497","volume":"28","author":"Q Yu","year":"2021","unstructured":"Yu Q, Hu L, Alzahrani B, Baranawi A, Alhindi A, Chen M (2021) Intelligent visual-iot-enabled real-time 3d visualization for autonomous crowd management. IEEE Wireless Commun 28(4):34\u201341","journal-title":"IEEE Wireless Commun"},{"key":"5775_CR44","unstructured":"Movie Actions Datasaet. https:\/\/www.di.ens.fr\/~laptev\/actions\/. Last accessed 16 July 2023"},{"key":"5775_CR45","unstructured":"U.C. for Research in Computer Vision. https:\/\/www.crcv.ucf.edu\/data\/UCF50.php. Last accessed 16 July 2023"},{"key":"5775_CR46","unstructured":"Soomro K, Zamir AR, Shah M (2012) A dataset of 101 human action classes from videos in the wild. Center for Research in Computer Vision 2(11)"},{"key":"5775_CR47","unstructured":"Kay W, Carreira J, Simonyan K, Zhang B, Hillier C, Vijayanarasimhan S, Viola F, Green T, Back T, Natsev P, et al (2017) The kinetics human action video dataset. arXiv:1705.06950"},{"key":"5775_CR48","unstructured":"Carreira J, Noland E, Banki-Horvath A, Hillier C, Zisserman A (2018) A short note about kinetics-600. arXiv:1808.01340"},{"key":"5775_CR49","unstructured":"Carreira J, Noland E, Hillier C, Zisserman A (2019) A short note on the kinetics-700 human action dataset. arXiv:1907.06987"},{"key":"5775_CR50","doi-asserted-by":"crossref","unstructured":"Hassner T, Itcher Y, Kliper-Gross O (2012) Violent flows: Real-time detection of violent crowd behavior. In: 2012 IEEE Computer society conference on computer vision and pattern recognition workshops, IEEE, pp 1\u20136","DOI":"10.1109\/CVPRW.2012.6239348"},{"key":"5775_CR51","doi-asserted-by":"crossref","unstructured":"Sultani W, Chen C, Shah M (2018) Real-world anomaly detection in surveillance videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6479\u20136488","DOI":"10.1109\/CVPR.2018.00678"},{"key":"5775_CR52","doi-asserted-by":"crossref","unstructured":"Perez M, Kot AC, Rocha A (2019) Detection of real-world fights in surveillance videos. In: ICASSP 2019-2019 IEEE International conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 2662\u20132666","DOI":"10.1109\/ICASSP.2019.8683676"},{"key":"5775_CR53","unstructured":"Akt\u0131 \u015e, Tataro\u011flu G.A, Ekenel HK (2019) Vision-based fight detection from surveillance cameras. In: 2019 Ninth international conference on image processing theory, tools and applications (IPTA), IEEE, pp 1\u20136"},{"key":"5775_CR54","unstructured":"Detection of unusual crowd activity. http:\/\/mha.cs.umn.edu\/proj_events.shtml#crowd. Last accessed 16 July 2023"},{"key":"5775_CR55","doi-asserted-by":"crossref","unstructured":"Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp 935\u2013942","DOI":"10.1109\/CVPR.2009.5206641"},{"key":"5775_CR56","unstructured":"Political protest movements: Data. https:\/\/guides.library.yale.edu\/c.php?g=956915amp;p=6961578. Last accessed 16 July 2023"},{"key":"5775_CR57","unstructured":"Political protest movements: MetaData. https:\/\/dataverse.harvard.edu\/dataverse\/MMdata. Last accessed 16 July 2023"},{"key":"5775_CR58","unstructured":"Chromiak M (2021) Exploring recent advancements of transformer based architectures in computer vision. Selected Topics Appl Comput Sci 59\u201375"},{"key":"5775_CR59","doi-asserted-by":"crossref","unstructured":"Wan J, Liu Z, Chan AB (2021) A generalized loss function for crowd counting and localization. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 1974\u20131983","DOI":"10.1109\/CVPR46437.2021.00201"},{"key":"5775_CR60","doi-asserted-by":"crossref","unstructured":"Leibe B, Seemann E, Schiele B (2005) Pedestrian detection in crowded scenes. In: 2005 IEEE Computer society conference on computer vision and pattern recognition (CVPR\u201905), IEEE, vol. 1:878\u2013885","DOI":"10.1109\/CVPR.2005.272"},{"key":"5775_CR61","doi-asserted-by":"crossref","unstructured":"Chan AB, Liang Z-SJ, Vasconcelos N (2008) Privacy preserving crowd monitoring: Counting people without people models or tracking. In: 2008 IEEE Conference on computer vision and pattern recognition, IEEE, pp 1\u20137","DOI":"10.1109\/CVPR.2008.4587569"},{"key":"5775_CR62","unstructured":"Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International conference on learning representations (ICLR 2015). Computational and Biological Learning Society"},{"key":"5775_CR63","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","volume":"17","author":"B Horn","year":"1981","unstructured":"Horn B, Schunck B (1981) Determining optical flow. Artif Intell 17:185\u2013203","journal-title":"Artif Intell"},{"key":"5775_CR64","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1007\/978-3-030-58536-5_24","volume-title":"Computer Vision - ECCV 2020","author":"Z Teed","year":"2020","unstructured":"Teed Z, Deng J (2020) Raft: Recurrent all-pairs field transforms for optical flow. In: Vedaldi A, Bischof H, Brox T, Frahm J-M (eds) Computer Vision - ECCV 2020. Springer, Cham, pp 402\u2013419"},{"key":"5775_CR65","doi-asserted-by":"crossref","unstructured":"Wang Y, Yue Y, Lin Y, Jiang H, Lai Z, Kulikov V, Orlov N, Shi H, Huang G (2022) Adafocus v2: End-to-end training of spatial dynamic networks for video recognition. In: 2022 IEEE\/CVF Conference on computer vision and pattern recognition (CVPR), IEEE pp 20030\u201320040","DOI":"10.1109\/CVPR52688.2022.01943"},{"key":"5775_CR66","doi-asserted-by":"crossref","unstructured":"Tran D, Wang H, Torresani L, Ray J, LeCun Y, Paluri M (2018) A closer look at spatiotemporal convolutions for action recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 6450\u20136459","DOI":"10.1109\/CVPR.2018.00675"},{"issue":"2","key":"5775_CR67","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1109\/TCSVT.2023.3287201","volume":"34","author":"Z Zheng","year":"2024","unstructured":"Zheng Z, Yang L, Wang Y, Zhang M, He L, Huang G, Li F (2024) Dynamic spatial focus for efficient compressed video action recognition. IEEE Trans Circuits Syst Video Technol 34(2):695\u2013708","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"5775_CR68","unstructured":"Nievas EB, Suarez OD, Garcia GB, Sukthankar R (2011) Hockey fight detection dataset. In: Computer Analysis of Images and Patterns, Springer, pp 332\u2013339. http:\/\/visilab.etsii.uclm.es\/personas\/oscar\/FightDetection\/"},{"key":"5775_CR69","doi-asserted-by":"crossref","unstructured":"Cheng M, Cai K, Li M (2021) Rwf-2000: an open large scale video database for violence detection. In: 2020 25th International conference on pattern recognition (ICPR), IEEE, pp 4183\u20134190","DOI":"10.1109\/ICPR48806.2021.9412502"},{"key":"5775_CR70","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.imavis.2016.01.006","volume":"48","author":"Y Gao","year":"2016","unstructured":"Gao Y, Liu H, Sun X, Wang C, Liu Y (2016) Violence detection using oriented violent flows. Image Vision Comput 48:37\u201341","journal-title":"Image Vision Comput"},{"issue":"9","key":"5775_CR71","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3390\/computers12090175","volume":"12","author":"SA Jebur","year":"2023","unstructured":"Jebur SA, Hussein KA, Hoomod HK, Alzubaidi L (2023) Novel deep feature fusion framework for multi-scenario violence detection. Computers 12(9):175","journal-title":"Computers"},{"key":"5775_CR72","unstructured":"Dong Z, Qin J, Wang Y (2016) Multi-stream deep networks for person to person violence detection in videos. In: Pattern Recognition: 7th Chinese Conference, CCPR 2016, Chengdu, China, November 5-7, 2016, Proceedings, Part I 7, Springer, pp 517\u2013531"},{"key":"5775_CR73","doi-asserted-by":"crossref","unstructured":"Xu L, Gong C, Yang J, Wu Q, Yao L (2014) Violent video detection based on mosift feature and sparse coding. In: 2014 IEEE International conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 3538\u20133542","DOI":"10.1109\/ICASSP.2014.6854259"},{"key":"5775_CR74","doi-asserted-by":"crossref","unstructured":"Su Y, Lin G, Zhu J, Wu Q (2020) Human interaction learning on 3d skeleton point clouds for video violence recognition. In: Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK, August 23\u201328, 2020, Proceedings, Part IV 16, Springer, pp 74\u201390","DOI":"10.1007\/978-3-030-58548-8_5"},{"key":"5775_CR75","doi-asserted-by":"crossref","unstructured":"Sudhakaran S, Lanz O (2017) Learning to detect violent videos using convolutional long short-term memory. In: 2017 14th IEEE International CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), IEEE, pp 1\u20136","DOI":"10.1109\/AVSS.2017.8078468"},{"key":"5775_CR76","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00138-021-01264-9","volume":"33","author":"D Freire-Obreg\u00f3n","year":"2022","unstructured":"Freire-Obreg\u00f3n D, Barra P, Castrill\u00f3n-Santana M, Marsico MD (2022) Inflated 3d convnet context analysis for violence detection. Mach Vision Appl 33:1\u201313","journal-title":"Mach Vision Appl"},{"key":"5775_CR77","unstructured":"Abdali A-MR, Al-Tuma RF (2019) Robust real-time violence detection in video using cnn and lstm. In: 2019 2nd Scientific Conference of Computer Sciences (SCCS), IEEE, pp 104\u2013108"},{"issue":"8","key":"5775_CR78","doi-asserted-by":"crossref","first-page":"5359","DOI":"10.1109\/TII.2021.3116377","volume":"18","author":"FUM Ullah","year":"2021","unstructured":"Ullah FUM, Muhammad K, Haq IU, Khan N, Heidari AA, Baik SW, de Albuquerque VHC (2021) Ai-assisted edge vision for violence detection in iot-based industrial surveillance networks. IEEE Trans Indust Inf 18(8):5359\u20135370","journal-title":"IEEE Trans Indust Inf"},{"issue":"6","key":"5775_CR79","first-page":"2216","volume":"22","author":"R Vijeikis","year":"2022","unstructured":"Vijeikis R, Raudonis V, Dervinis G (2022) Efficient violence detection in surveillance. Sensors 22(6):2216","journal-title":"Efficient violence detection in surveillance. Sensors"},{"key":"5775_CR80","doi-asserted-by":"crossref","unstructured":"Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489\u20134497","DOI":"10.1109\/ICCV.2015.510"},{"issue":"1","key":"5775_CR81","doi-asserted-by":"crossref","first-page":"13474","DOI":"10.1111\/exsy.13474","volume":"41","author":"K Chaturvedi","year":"2024","unstructured":"Chaturvedi K, Dhiman C, Vishwakarma DK (2024) Fight detection with spatial and channel wise attention-based convlstm model. Expert Syst 41(1):13474","journal-title":"Expert Syst"},{"key":"5775_CR82","doi-asserted-by":"crossref","unstructured":"Zhou L (2022) End-to-end video violence detection with transformer. In: 2022 5th International conference on pattern recognition and artificial intelligence (PRAI), IEEE, pp 880\u2013884","DOI":"10.1109\/PRAI55851.2022.9904115"},{"key":"5775_CR83","doi-asserted-by":"crossref","unstructured":"Pan C, Fei S (2022) Violence detection based on attention mechanism. In: 2022 41st Chinese Control Conference (CCC), IEEE, pp 6438\u20136443","DOI":"10.23919\/CCC55666.2022.9901930"},{"key":"5775_CR84","doi-asserted-by":"crossref","unstructured":"Ravanbakhsh M, Mousavi H, Nabi M, Marcenaro L, Regazzoni C (2018) Fast but not deep: Efficient crowd abnormality detection with local binary tracklets. In: 2018 15th IEEE International conference on advanced video and signal based surveillance (AVSS), IEEE, pp 1\u20136","DOI":"10.1109\/AVSS.2018.8639172"},{"key":"5775_CR85","doi-asserted-by":"crossref","unstructured":"Mousavi H, Mohammadi S, Perina A, Chellali R, Murino V (2015) Analyzing tracklets for the detection of abnormal crowd behavior. In: 2015 IEEE Winter conference on applications of computer vision, IEEE, pp 148\u2013155","DOI":"10.1109\/WACV.2015.27"},{"key":"5775_CR86","doi-asserted-by":"crossref","unstructured":"Gao M, Jiang J, Ma L, Zhou S, Zou G, Pan J, Liu Z (2019) Violent crowd behavior detection using deep learning and compressive sensing. In: 2019 Chinese control and decision conference (CCDC), IEEE, pp 5329\u20135333","DOI":"10.1109\/CCDC.2019.8832598"},{"issue":"3","key":"5775_CR87","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1109\/TCSVT.2016.2589858","volume":"27","author":"T Zhang","year":"2016","unstructured":"Zhang T, Jia W, He X, Yang J (2016) Discriminative dictionary learning with motion weber local descriptor for violence detection. IEEE Trans Circuits Syst Video Technol 27(3):696\u2013709","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"5775_CR88","doi-asserted-by":"crossref","unstructured":"Hachiuma R, Sato F, Sekii T (2023) Unified keypoint-based action recognition framework via structured keypoint pooling. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 22962\u201322971","DOI":"10.1109\/CVPR52729.2023.02199"},{"issue":"11","key":"5775_CR89","doi-asserted-by":"crossref","first-page":"2472","DOI":"10.3390\/s19112472","volume":"19","author":"FUM Ullah","year":"2019","unstructured":"Ullah FUM, Ullah A, Muhammad K, Haq IU, Baik SW (2019) Violence detection using spatiotemporal features with 3d convolutional neural network. Sensors 19(11):2472","journal-title":"Sensors"},{"issue":"4","key":"5775_CR90","doi-asserted-by":"crossref","first-page":"4218","DOI":"10.1007\/s10489-022-03708-9","volume":"53","author":"T Zhenhua","year":"2023","unstructured":"Zhenhua T, Zhenche X, Pengfei W, Chang D, Weichao Z (2023) Ftcf: Full temporal cross fusion network for violence detection in videos. Appl Intell 53(4):4218\u20134230","journal-title":"Appl Intell"},{"issue":"12","key":"5775_CR91","doi-asserted-by":"crossref","first-page":"10400","DOI":"10.1002\/int.22537","volume":"37","author":"FUM Ullah","year":"2022","unstructured":"Ullah FUM, Obaidat MS, Muhammad K, Ullah A, Baik SW, Cuzzolin F, Rodrigues JJ, de Albuquerque VHC (2022) An intelligent system for complex violence pattern analysis and detection. Int J Intell Syst 37(12):10400\u201310422","journal-title":"Int J Intell Syst"},{"key":"5775_CR92","unstructured":"Rao A, Lanphier R (1996) Real Time Streaming Protocol(RTSP). Internet-Draft draft-rao-rtsp-00, Internet Engineering Task Force. Work in Progress. https:\/\/datatracker.ietf.org\/doc\/draft-rao-rtsp\/00\/"},{"key":"5775_CR93","unstructured":"Bai J, Lu F, Zhang K, et al (2019) ONNX: Open Neural Network Exchange. GitHub"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05775-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-024-05775-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05775-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T06:30:15Z","timestamp":1732689015000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-024-05775-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,26]]},"references-count":93,"journal-issue":{"issue":"21","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["5775"],"URL":"https:\/\/doi.org\/10.1007\/s10489-024-05775-6","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,26]]},"assertion":[{"value":"12 August 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare they have no competing interests to report regarding the present study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"No ethics approval was required for the study","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"All authors have approved the manuscript and agree with its publication.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}