{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T07:10:33Z","timestamp":1763017833540,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,2,1]],"date-time":"2018-02-01T00:00:00Z","timestamp":1517443200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The change of crowd energy is a fundamental measurement for describing a crowd behavior. In this paper, we present a crowd abnormal detection method based on the change of energy-level distribution. The method can not only reduce the camera perspective effect, but also detect crowd abnormal behavior in time. Pixels in the image are treated as particles, and the optical flow method is adopted to extract the velocities of particles. The qualities of different particles are distributed as different value according to the distance between the particle and the camera to reduce the camera perspective effect. Then a crowd motion segmentation method based on flow field texture representation is utilized to extract the motion foreground, and a linear interpolation calculation is applied to pedestrian\u2019s foreground area to determine their distance to the camera. This contributes to the calculation of the particle qualities in different locations. Finally, the crowd behavior is analyzed according to the change of the consistency, entropy and contrast of the three descriptors for co-occurrence matrix. By calculating a threshold, the timestamp when the crowd abnormal happens is determined. In this paper, multiple sets of videos from three different scenes in UMN dataset are employed in the experiment. The results show that the proposed method is effective in characterizing anomalies in videos.<\/jats:p>","DOI":"10.3390\/s18020423","type":"journal-article","created":{"date-parts":[[2018,2,2]],"date-time":"2018-02-02T04:20:50Z","timestamp":1517545250000},"page":"423","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Energy Level-Based Abnormal Crowd Behavior Detection"],"prefix":"10.3390","volume":"18","author":[{"given":"Xuguang","family":"Zhang","sequence":"first","affiliation":[{"name":"The Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, China"},{"name":"School of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China"}]},{"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"The Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, China"},{"name":"LargeV Instrument Corporation Limited, Beijing 100084, China"}]},{"given":"Shuo","family":"Hu","sequence":"additional","affiliation":[{"name":"The Institute of Electrical Engineering, YanShan University, Qinhuangdao 066004, China"}]},{"given":"Chunsheng","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310018, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7655-9228","authenticated-orcid":false,"given":"Hui","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Creative Technologies, University of Portsmouth, Portsmouth PO1 2DJ, UK"}]}],"member":"1968","published-online":{"date-parts":[[2018,2,1]]},"reference":[{"key":"ref_1","unstructured":"Wu, X., Qu, Y., Qian, H., and Xu, Y. (2005, January 2\u20136). A detection system for human abnormal behavior. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mahadevan, V., Li, W., Bhalodia, V., and Vasconcelos, N. (2010, January 13\u201318). Anomaly detection in crowded scenes. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539872"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liao, Z., Yang, S., and Liang, J. (2010, January 18\u201320). Detection of abnormal crowd distribution. Proceedings of the 2010 IEEE\/ACM Int\u2019l Conference on Green Computing and Communications & Int\u2019l Conference on Cyber, Physical and Social Computing, Hangzhou, China.","DOI":"10.1109\/GreenCom-CPSCom.2010.51"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Viola, P., Jones, M.J., and Snow, D. (2003, January 13\u201316). Detecting Pedestrians Using Patterns of Motion and Appearance. Proceedings of the International Conference on Compute Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238422"},{"key":"ref_5","unstructured":"Leibe, B., Seemann, E., and Schiele, B. (2005, January 20\u201325). Pedestrian detection in crowded scenes. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1007\/s11263-013-0624-1","article-title":"Multiframe many\u2013many point correspondence for vehicle tracking in high density wide area aerial videos","volume":"104","author":"Saleemi","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1109\/TPAMI.2007.70770","article-title":"Segmentation and tracking of multiple humans in crowded environments","volume":"30","author":"Zhao","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1049\/iet-cvi.2016.0022","article-title":"Extended social force model-based mean shift for pedestrian tracking under obstacle avoidance","volume":"11","author":"Zhang","year":"2016","journal-title":"IET Comput. Vis."},{"key":"ref_9","unstructured":"Yu, H., Sun, G., Song, W., and Li, X. (2005, January 27\u201330). Human motion recognition based on neural network. Proceedings of the 2005 International Conference on Communications, Circuits and Systems, Hong Kong, China."},{"key":"ref_10","unstructured":"Bauer, D., Seer, S., and Br\u00e4ndle, N. (2007, January 16\u201319). Macroscopic pedestrian flow simulation for designing crowd control measures in public transport after special events. Proceedings of the 2007 Summer Computer Simulation Conference, San Diego, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cong, Y., Yuan, J., and Liu, J. (2011, January 20\u201325). Sparse reconstruction cost for abnormal event detection. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995434"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kim, J., and Grauman, K. (2009, January 20\u201325). Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206569"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1109\/TPAMI.2007.70825","article-title":"Robust real-time unusual event detection using multiple fixed-location monitors","volume":"Volume 30","author":"Adam","year":"2008","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"ref_14","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_15","unstructured":"Zhu, Q., Yeh, M.C., Cheng, K.T., and Avidan, S. (2006, January 17\u201322). Fast human detection using a cascade of histograms of oriented gradients. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chan, A.B., and Vasconcelos, N. (2005, January 17\u201321). Mixtures of dynamic textures. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV\u201905), Beijing, China.","DOI":"10.1109\/ICCV.2005.151"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xiong, G., Wu, X., Chen, Y.L., and Qu, Y. (2011, January 6\u20138). Abnormal crowd behavior detection based on the energy model. Proceedings of the 2011 IEEE International Conference on Information and Automation (ICIA), Shenzhen, China.","DOI":"10.1109\/ICINFA.2011.5949043"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mehran, R., Oyama, A., and Shah, M. (2009, January 20\u201325). Abnormal crowd behavior detection using social force model. Proceedings of the 2009 CVPR 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206641"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kratz, L., and Nishino, K. (2009, January 20\u201325). Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009), Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206771"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1007\/s00138-015-0703-0","article-title":"Flow field texture representation-based motion segmentation for crowd counting","volume":"26","author":"Zhang","year":"2015","journal-title":"Mach. Vis. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cabral, B., and Leedom, L.C. (1993, January 2\u20136). Imaging vector fields using line integral convolution. Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, Anaheim, CA, USA.","DOI":"10.1145\/166117.166151"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1109\/TVCG.2005.21","article-title":"Accelerated unsteady flow line integral convolution","volume":"11","author":"Liu","year":"2005","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_24","first-page":"113","article-title":"An entropy-based image registration method using image intensity difference on overlapped region","volume":"11","author":"Fan","year":"2011","journal-title":"Mach. Vis. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1016\/j.patcog.2011.12.013","article-title":"AdOtsu: An adaptive and parameterless generalization of Otsu\u2019s method for document image binarization","volume":"45","author":"Moghaddam","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1016\/j.robot.2010.08.002","article-title":"Target tracking for mobile robot platforms via object matching and background anti-matching","volume":"58","author":"Zhang","year":"2010","journal-title":"Robot. Auton. Syst."},{"key":"ref_27","unstructured":"Gonzalez, R.C., Woods, R.E., and Masters, B.R. (2006). Representation and Description. Digital Image Processing, Prentice-Hall Inc.. [3rd ed.]."},{"key":"ref_28","unstructured":"(2018, February 01). Unusual Crowd Activity Dataset of University of Minnesota. Available online: http:\/\/mha.cs.umn.edu\/Movies\/Crowd-Activity-All.avi."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2543","DOI":"10.1016\/j.patcog.2011.11.023","article-title":"An entropy approach for abnormal activities detection in video streams","volume":"45","author":"Sharif","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.neucom.2011.12.007","article-title":"An energy model approach to people counting for abnormal crowd behavior detection","volume":"83","author":"Xiong","year":"2012","journal-title":"Neurocomputing"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ihaddadene, N., and Djeraba, C. (2008, January 8\u201311). Real-time crowd motion analysis. Proceedings of the ICPR 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761041"},{"key":"ref_32","first-page":"844","article-title":"Gaussian process latent variable models for visualisation of high dimensional data","volume":"Volume 16","author":"Lawrence","year":"2003","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mousas, C. (2017). Full-Body Locomotion Reconstruction of Virtual Characters Using a Single Inertial Measurement Unit. Sensors, 17.","DOI":"10.3390\/s17112589"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1145\/1073204.1073248","article-title":"Performance animation from low-dimensional control signals","volume":"24","author":"Chai","year":"2005","journal-title":"ACM Trans. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.113.238701","article-title":"Universal power law governing pedestrian interactions","volume":"113","author":"Karamouzas","year":"2014","journal-title":"Phys. Rev. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/TVCG.2011.133","article-title":"Simulating and evaluating the local behavior of small pedestrian groups","volume":"18","author":"Karamouzas","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1080\/2165347X.2013.872586","article-title":"The minimum energy expenditure shortest path method","volume":"17","author":"Mousas","year":"2013","journal-title":"J. Graph. Tools"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/2\/423\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:53:22Z","timestamp":1760194402000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/2\/423"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,1]]},"references-count":37,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,2]]}},"alternative-id":["s18020423"],"URL":"https:\/\/doi.org\/10.3390\/s18020423","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,2,1]]}}}