{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T03:38:43Z","timestamp":1775705923586,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T00:00:00Z","timestamp":1639180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Background and motivation: Every year, millions of Muslims worldwide come to Mecca to perform the Hajj. In order to maintain the security of the pilgrims, the Saudi government has installed about 5000 closed circuit television (CCTV) cameras to monitor crowd activity efficiently. Problem: As a result, these cameras generate an enormous amount of visual data through manual or offline monitoring, requiring numerous human resources for efficient tracking. Therefore, there is an urgent need to develop an intelligent and automatic system in order to efficiently monitor crowds and identify abnormal activity. Method: The existing method is incapable of extracting discriminative features from surveillance videos as pre-trained weights of different architectures were used. This paper develops a lightweight approach for accurately identifying violent activity in surveillance environments. As the first step of the proposed framework, a lightweight CNN model is trained on our own pilgrim\u2019s dataset to detect pilgrims from the surveillance cameras. These preprocessed salient frames are passed to a lightweight CNN model for spatial features extraction in the second step. In the third step, a Long Short Term Memory network (LSTM) is developed to extract temporal features. Finally, in the last step, in the case of violent activity or accidents, the proposed system will generate an alarm in real time to inform law enforcement agencies to take appropriate action, thus helping to avoid accidents and stampedes. Results: We have conducted multiple experiments on two publicly available violent activity datasets, such as Surveillance Fight and Hockey Fight datasets; our proposed model achieved accuracies of 81.05 and 98.00, respectively.<\/jats:p>","DOI":"10.3390\/s21248291","type":"journal-article","created":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T01:29:33Z","timestamp":1639358973000},"page":"8291","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Abnormal Activity Recognition from Surveillance Videos Using Convolutional Neural Network"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6543-2520","authenticated-orcid":false,"given":"Shabana","family":"Habib","sequence":"first","affiliation":[{"name":"Department of Information Technology, College of Computer, Qassim University, Buraydah 52571, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Altaf","family":"Hussain","sequence":"additional","affiliation":[{"name":"Institute of Management Sciences (IMSciences), Peshawar 25000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0292-7304","authenticated-orcid":false,"given":"Waleed","family":"Albattah","sequence":"additional","affiliation":[{"name":"Department of Information Technology, College of Computer, Qassim University, Buraydah 52571, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2379-4451","authenticated-orcid":false,"given":"Muhammad","family":"Islam","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering and Information Technology, Unaizah Colleges, Unaizah 56447, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5749-8538","authenticated-orcid":false,"given":"Sheroz","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering and Information Technology, Unaizah Colleges, Unaizah 56447, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3323-2732","authenticated-orcid":false,"given":"Rehan Ullah","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Information Technology, College of Computer, Qassim University, Buraydah 52571, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0864-5255","authenticated-orcid":false,"given":"Khalil","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Information Technology and Computer Science, Pak-Austria Fachhochschule Institute of Applied Sciences and Technology, Haripur 22620, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,11]]},"reference":[{"key":"ref_1","first-page":"2183","article-title":"Hajj Crowd Management Using CNN-Based Approach","volume":"66","author":"Albattah","year":"2021","journal-title":"CMC-Comput. Mater. Contin. Comput. Mater. Contin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"208583","DOI":"10.1109\/ACCESS.2020.3037396","article-title":"Digital revolution for Hajj crowd management: A technology survey","volume":"8","author":"Felemban","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ibadah, N., Benavente-Peces, C., Minaoui, K., Rziza, M., and Oumsis, M. (2020). Systematic Crowd Mobility Management to Avoid Catastrophic Disasters of Human Stampedes: The Case of Mina Hajj. PECCS, 66\u201373.","DOI":"10.5220\/0010147700660073"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Khan, K., Albattah, W., Khan, R.U., Qamar, A.M., and Nayab, D. (2020). Advances and trends in real time visual crowd analysis. Sensors, 20.","DOI":"10.3390\/s20185073"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dirgahayu, T., and Hidayat, S. (2018, January 11\u201312). An architectural design of geo-fencing emergency alerts system for Hajj pilgrims. Proceedings of the 8th International Conference on Computer Science and Information Technology (CSIT), Amman, Jordan.","DOI":"10.1109\/CSIT.2018.8486189"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mohandes, M., Haleem, M.A., Abul-Hussain, A., and Balakrishnan, K. (2011, January 22\u201325). Pilgrims tracking using wireless sensor network. Proceedings of the IEEE Workshops of International Conference on Advanced Information Networking and Applications, Singapore.","DOI":"10.1109\/WAINA.2011.123"},{"key":"ref_7","unstructured":"Liu, Z., Cai, Y., Wang, H., Chen, L., Gao, H., Jia, Y., and Li, Y. (2021, January 19\u201322). Robust target recognition and tracking of self-driving cars with radar and camera information fusion under severe weather conditions. Proceedings of the IEEE Transactions on Intelligent Transportation Systems, Indianapolis, IN, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3439870","article-title":"Indirectly Supervised Anomaly Detection of Clinically Meaningful Health Events from Smart Home Data","volume":"12","author":"Dahmen","year":"2021","journal-title":"ACM Trans. Intell. Syst. Technol. TIST"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yar, H., Imran, A.S., Khan, Z.A., Sajjad, M., and Kastrati, Z. (2021). Towards smart home automation using IoT-enabled edge-computing paradigm. Sensors, 21.","DOI":"10.3390\/s21144932"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"7253","DOI":"10.1007\/s11227-020-03582-7","article-title":"SS-ITS: Secure scalable intelligent transportation systems","volume":"77","author":"Belhadi","year":"2021","journal-title":"J. Supercomput."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Khan, K., Khan, R.U., Albattah, W., Nayab, D., Qamar, A.M., Habib, S., and Islam, M. (2021). Crowd Counting Using End-to-End Semantic Image Segmentation. Electronics, 10.","DOI":"10.3390\/electronics10111293"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khan, A., Shah, J.A., Kadir, K., Albattah, W., and Khan, F. (2020). Crowd monitoring and localization using deep convolutional neural network: A review. Appl. Sci., 10.","DOI":"10.3390\/app10144781"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hassner, T., Itcher, Y., and Kliper-Gross, O. (2012, January 16\u201321). Violent flows: Real-time detection of violent crowd behavior. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6239348"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.imavis.2016.01.006","article-title":"Violence detection using oriented violent flows","volume":"48","author":"Gao","year":"2016","journal-title":"Image Vis. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Khan, S.U., Haq, I.U., Rho, S., Baik, S.W., and Lee, M.Y. (2019). Cover the violence: A novel Deep-Learning-Based approach towards violence-detection in movies. Appl. Sci., 9.","DOI":"10.3390\/app9224963"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bilinski, P., and Bremond, F. (2016, January 23\u201326). Human violence recognition and detection in surveillance videos. Proceedings of the 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Colorado Springs, CO, USA.","DOI":"10.1109\/AVSS.2016.7738019"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4787","DOI":"10.1109\/TIP.2018.2845742","article-title":"Fight recognition in video using hough forests and 2D convolutional neural network","volume":"27","author":"Serrano","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8497","DOI":"10.1007\/s11042-018-6923-3","article-title":"Violent scene detection algorithm based on kernel extreme learning machine and three-dimensional histograms of gradient orientation","volume":"78","author":"Yu","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Habib, S., Hussain, A., Islam, M., Khan, S., and Albattah, W. (2021, January 6\u20137). Towards Efficient Detection and Crowd Management for Law Enforcing Agencies. Proceedings of the 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), Riyadh, Saudi Arabia.","DOI":"10.1109\/CAIDA51941.2021.9425076"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"13849","DOI":"10.1109\/JIOT.2021.3088875","article-title":"A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things","volume":"8","author":"Chang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_21","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"31002","DOI":"10.1088\/1741-2552\/abc902","article-title":"A survey on deep learning-based non-invasive brain signals: Recent advances and new frontiers","volume":"18","author":"Zhang","year":"2020","journal-title":"J. Neural Eng."},{"key":"ref_23","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y.Y., Porikli, F., Plaza, A.J., Kehtarnavaz, N., and Terzopoulos, D. (2021). Image segmentation using deep learning: A survey. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1007\/s00371-020-01848-y","article-title":"A survey on online learning for visual tracking","volume":"37","author":"Abbass","year":"2021","journal-title":"Visual. Comput."},{"key":"ref_26","first-page":"2171","article-title":"Anomaly Based Camera Prioritization in Large Scale Surveillance Networks","volume":"70","author":"Hussain","year":"2021","journal-title":"Comput. Mater. Contin."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Habib, S., Khan, I., Islam, M., Albattah, W., Alyahya, S.M., Khan, S., and Hassan, M.K. (2021, January 6\u20137). Wavelet Frequency Transformation for Specific Weeds Recognition. Proceedings of the 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), Riyadh, Saudi Arabia.","DOI":"10.1109\/CAIDA51941.2021.9425249"},{"key":"ref_28","unstructured":"Hussain, A., Khan, A., and Yar, H. (2019, January 20\u201321). Efficient Deep learning Approach for Classification of Pneumonia using Resources Constraint Devices in Healthcare. Proceedings of the 5th International Conference on Next Generation Computing, Bidholi Via-Prem Nagar, India."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_30","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_31","unstructured":"Nievas, E.B., Suarez, O.D., Garc\u00eda, G.B., and Sukthankar, R. (2011, January 29\u201331). Violence detection in video using computer vision techniques, In Proceedings of the International Conference on Computer Analysis of Images and Patterns, Seville, Spain."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ullah, F.U.M., Obaidat, M.S., Muhammad, K., Ullah, A., Baik, S.W., Cuzzolin, F., Rodrigues, J.J., and de Albuquerque, V.H.C. (2021). An intelligent system for complex violence pattern analysis and detection. Int. J. Intell. Syst.","DOI":"10.1002\/int.22537"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8291\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:45:36Z","timestamp":1760168736000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8291"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,11]]},"references-count":32,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21248291"],"URL":"https:\/\/doi.org\/10.3390\/s21248291","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,11]]}}}