{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T11:30:36Z","timestamp":1784633436143,"version":"3.55.0"},"reference-count":60,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2013,1,25]],"date-time":"2013-01-25T00:00:00Z","timestamp":1359072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the wide applications of vision based intelligent systems, image and video analysis technologies have attracted the attention of researchers in the computer vision field. In image and video analysis, human activity recognition is an important research direction. By interpreting and understanding human activity, we can recognize and predict the occurrence of crimes and help the police or other agencies react immediately. In the past, a large number of papers have been published on human activity recognition in video and image sequences. In this paper, we provide a comprehensive survey of the recent development of the techniques, including methods, systems, and quantitative evaluation towards the performance of human activity recognition.<\/jats:p>","DOI":"10.3390\/s130201635","type":"journal-article","created":{"date-parts":[[2013,1,25]],"date-time":"2013-01-25T11:06:55Z","timestamp":1359112015000},"page":"1635-1650","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["Exploring Techniques for Vision Based Human Activity Recognition: Methods, Systems, and Evaluation"],"prefix":"10.3390","volume":"13","author":[{"given":"Xin","family":"Xu","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Science and Technology, NO. 947 Heping Road, Wuhan 430081, Hubei, China"},{"name":"Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, NO. 1 Huangjiahu West Road, Wuhan 430065, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinshan","family":"Tang","sequence":"additional","affiliation":[{"name":"Computer Network and System Administration Program, Michigan Technological University, Houghton, MI 49931, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Science and Technology, NO. 947 Heping Road, Wuhan 430081, Hubei, China"},{"name":"Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, NO. 1 Huangjiahu West Road, Wuhan 430065, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoming","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Science and Technology, NO. 947 Heping Road, Wuhan 430081, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Science and Technology, NO. 947 Heping Road, Wuhan 430081, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yimin","family":"Qiu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Wuhan University of Science and Technology, NO. 947 Heping Road, Wuhan 430081, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2013,1,25]]},"reference":[{"key":"ref_1","unstructured":"Lacko, D. (2011). Motion Capture and Guidance Using Open Source Hardware. [Master Thesis, Artesis University College of Antwerp]."},{"key":"ref_2","unstructured":"Kautz, H. A. (1987). Formal Theory of Plan Recognition. [Ph.D. Thesis, University of Rochester]."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TPAMI.2005.213","article-title":"Bayesian modeling of dynamic scenes for object detection","volume":"27","author":"Sheikh","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"art no. 13","DOI":"10.1145\/1177352.1177355","article-title":"Object tracking: A survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput Surv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ko, T., and Shah, M. (2008, January 15\u201317). A survey on behavior analysis in video surveillance for homeland security applications. Washington, DC, USA.","DOI":"10.1109\/AIPR.2008.4906450"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TSMCC.2009.2023380","article-title":"Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video","volume":"39","author":"Lavee","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern Part C"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1109\/TSMCC.2011.2178594","article-title":"Video-Based Abnormal Human Behavior Recognition\u2014A Review","volume":"42","author":"Popoola","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern Part C"},{"key":"ref_8","unstructured":"Liao, L. (2006). Location-Based Activity Recognition. [Ph.D. Thesis, Department of Computer Science and Engineering, University of Washington]."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"art no. 16","DOI":"10.1145\/1922649.1922653","article-title":"Human activity analysis: A review","volume":"43","author":"Aggarwal","year":"2011","journal-title":"ACM Comput. Surv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/0167-2789(91)90222-U","article-title":"State space reconstruction in the presence of noise","volume":"51","author":"Casdagli","year":"1991","journal-title":"Physica D"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/34.910878","article-title":"The recognition of human movement using temporal templates","volume":"23","author":"Bobick","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","unstructured":"Oren, M., Papageorgiou, C., Sinha, P., Osuna, E., and Poggio, T. (1997, January 17\u201319). Pedestrian detection using wavelet templates. San Juan, Argentina."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1091","DOI":"10.1109\/TPAMI.2002.1023805","article-title":"Human activity recognition using multidimensional indexing","volume":"24","author":"Wang","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.imavis.2008.02.008","article-title":"Tracking and recognizing actions of multiple hockey players using the boosted particle filter","volume":"27","author":"Lu","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Khalid, S., and Naftel, A. (2005, January 1\u20132). Classifying spatiotemporal object trajectories using unsupervised learning of basis function coefficients. New York, NY, USA.","DOI":"10.1145\/1099396.1099404"},{"key":"ref_16","unstructured":"Wilson, A.D., and Bobick, A.F. (1998, January 4\u20137). Recognition and interpretation of parametric gesture. Bombay, India."},{"key":"ref_17","unstructured":"Duong, T., Bui, H., Phung, D., and Venkatesh, S. (2005, January 20\u201326). Activity recognition and abnormality detection with the switching hidden semi-Markov model. San Diego, CA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.artint.2008.12.005","article-title":"Efficient duration and hierarchical modeling for human activity recognition","volume":"173","author":"Duong","year":"2009","journal-title":"Artif. Intell."},{"key":"ref_19","unstructured":"Chieu, H., Lee, W., and Kaelbling, L. (2006). Activity recognition from physiological data using conditional random fields. Tech. Rep. Singapore MIT Alliance Symp."},{"key":"ref_20","unstructured":"Yin, J., Hu, D., and Yang, Q. (2009, January 11\u201317). Spatio-temporal event detection using dynamic conditional random fields. Pasadena, CA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1007\/978-3-642-02611-9_34","article-title":"Abnormal behavior recognition using self-adaptive hidden markov models","volume":"5627","author":"Yin","year":"2009","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"74860E","DOI":"10.1117\/12.832188","article-title":"Surveillance video behaviour profiling and anomaly detection","volume":"7486","author":"Loy","year":"2009","journal-title":"Proc. SPIE"},{"key":"ref_23","unstructured":"Hu, D.H., and Yang, Q. (2008, January 13\u201317). CIGAR: Concurrent and interleaving goal and activity recognition. Chicago, IL, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1016\/S0031-3203(02)00100-0","article-title":"Recent developments in human motion analysis","volume":"36","author":"Wang","year":"2003","journal-title":"Pattern Recognit"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/TPAMI.2007.70731","article-title":"Video behavior profiling for anomaly detection","volume":"30","author":"Xiang","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.cviu.2006.07.006","article-title":"A general method for human activity recognition in video","volume":"104","author":"Robertson","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_27","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Vail, D.L., Veloso, M., and Lafferty, J.D. (2007, January 14\u201318). Conditional random fields for activity recognition. Honolulu, HI, USA.","DOI":"10.1109\/IROS.2007.4399441"},{"key":"ref_29","unstructured":"Lui, Y., Beveridge, J.R., and Kirby, M. (June, January 13\u2013). Action classification on product manifolds. San Francisco, CA, USA."},{"key":"ref_30","unstructured":"Harandi, M.T., Sanderson, C., Wiliem, A., and Lovell, B.C. (January, January 9\u2013). Kernel analysis over riemannian manifolds for visual recognition of actions, pedestrians and textures. Breckenridge, CO, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.imavis.2011.08.002","article-title":"Advances in Matrix Manifolds for Computer Vision","volume":"30","author":"Lui","year":"2012","journal-title":"Image Vision Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.rti.2005.03.006","article-title":"Optical flow-based real-time object tracking using non-prior training active feature model","volume":"11","author":"Shin","year":"2005","journal-title":"Real Time Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.rti.2005.06.001","article-title":"Introduction to the special issue on video object processing for surveillance applications","volume":"11","author":"Amer","year":"2005","journal-title":"Real Time Imaging"},{"key":"ref_34","first-page":"63","article-title":"Study of robust and intelligent surveillance in visible and multi-modal framework","volume":"32","author":"Kumar","year":"2008","journal-title":"Informatica"},{"key":"ref_35","unstructured":"Nwagboso, C. (1998). Advanced Video-based Surveillance Systems, Kluwer Academic Publishers. Chapter 1.1."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/34.598236","article-title":"Pfinder: Real-time tracking of the human body","volume":"19","author":"Wren","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/34.868683","article-title":"W4: Real-time surveillance of people and their activities","volume":"22","author":"Haritaoglu","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1109\/TPAMI.2005.90","article-title":"A video database of moving faces and people","volume":"27","author":"Toole","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","unstructured":"List, T., Bins, J., Fisher, R.B., Tweed, D., and Thorisson, K.R. (2005, January 10). Two approaches to a plug-and-play vision architecture\u2014CAVIAR and psyclone. Pittsburgh, PA, USA."},{"key":"ref_40","unstructured":"Tweed, D., Fang, W., Fisher, R., Bins, J., and List, T. (, January October). Exploring techniques for behavior recognition via the CAVIAR modular vision framework. Oxford, UK."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Andrade, E.L., Blunsden, S., and Fisher, R.B. (2006, January 20\u201324). Modelling Crowd Scenes for Event Detection. Hong Kong, China.","DOI":"10.1109\/ICPR.2006.806"},{"key":"ref_42","unstructured":"Collins, R.T., Lipton, A.J., Kanade, T., Fujiyoshi, H., Duggins, D., Tsin, Y., Tolliver, D., Enomoto, N., Hasegawa, O., and Burt, P. (2000). A System for Video Surveillance and Monitoring: VSAM Final Report, Carnegie Mellon University. CMU-RI-TR-00-12, Technical Report."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/TCSVT.2003.821972","article-title":"Fusion of Static and Dynamic Body Biometrics for Gait Recognition","volume":"14","author":"Wang","year":"2004","journal-title":"IEEE Trans Circuits Syst. Video Technol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s00138-008-0153-z","article-title":"IBM smart surveillance system (S3): Event based video surveillance system with an open and extensible framework","volume":"19","author":"Tian","year":"2008","journal-title":"Mach. Vis. Appl."},{"key":"ref_45","unstructured":"Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Boonstra, M., and Korzhova, V. (2005). Performance Evaluation Protocol for Text, Face, Hands, Person and Vehicle Detection & Tracking in Video Analysis and Content Extraction (VACE-II), University of South Florida. Technical Report."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Manohar, V., Soundararajan, P., Raju, H., Goldgof, D., Kasturi, R., and Garofolo, J. (2006, January 13\u201316). Performance evaluation of object detection and tracking in video. Hyderabad, India.","DOI":"10.1007\/11669487_51"},{"key":"ref_47","unstructured":"Raju, H., Prasad, S., and Sharma, P. (2006). Annotation Guidelines for Video Analysis and Content Extraction (VACE-II), Video Mining Inc.. Technical Report."},{"key":"ref_48","unstructured":"Collins, R., Zhou, X., and Teh, S.K. (2005, January 15\u201316). An open source tracking testbed and evaluation web site. Beijing, China."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Smeaton, A.F., Over, P., and Kraaij, W. (2006, January 26\u201327). Evaluation campaigns and TRECVid. Santa Barbara, CA, USA.","DOI":"10.1145\/1178677.1178722"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Nghiem, A.T., Bremond, F., Thonnat, M., and Valentin, V. (2007, January 5\u20137). ETISEO, performance evaluation for video surveillance systems. London, UK.","DOI":"10.1109\/AVSS.2007.4425357"},{"key":"ref_51","unstructured":"Brown, L.M., Senior, A.W., Tian, Y., Connell, J., Hampapur, A., Shu, C., Merkl, H., and Lu, M. (2005, January 15\u201316). Performance evaluation of surveillance systems under varying conditions. Beijing, China."},{"key":"ref_52","unstructured":"Young, D., and Ferryman, J. (2005, January 15\u201316). PETS metrics: On-line performance evaluation service. Beijing, China."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1109\/TPAMI.2008.57","article-title":"Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol","volume":"31","author":"Kasturi","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_54","unstructured":"Stiefelhagen, R., Steusloff, H., and Waibel, A. (2004, January 21\u201323). CHIL: Computers in the human interaction loop. Lisbon, Portugal."},{"key":"ref_55","unstructured":"Ziliani, F., Velastin, S., Porikli, F., Marcenaro, L., Kelliher, T., Cavallaro, A., and Bruneaut, P. (2005, January 15\u201316). Performance evaluation of event detection solutions: The CREDS experience. Como, Italy."},{"key":"ref_56","unstructured":"Desurmont, X., Carincotte, C., and Bremond, F. (September, January 29). Intelligent video systems: A review of performance evaluation metrics that use mapping procedures. Boston, MA, USA."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1007\/s10579-007-9054-4","article-title":"The CHIL audiovisual corpus for lecture and meeting analysis inside smart rooms","volume":"41","author":"Mostefa","year":"2007","journal-title":"Lang. Resour. Eval."},{"key":"ref_58","unstructured":"Manohar, V., Boonstra, M., Korzhova, V., Soundararajan, P., Goldgof, D., and Kasturi, R. (2006, January 18). PETS vs. VACE evaluation programs: A comparative study. New York, NY, USA."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Ellis, A., and Ferryman, J. (September, January 29). PETS2010 and PETS2009 evaluation of results using individual ground truthed single views. Boston, MA, USA.","DOI":"10.1109\/AVSS.2010.89"},{"key":"ref_60","unstructured":"Desurmont, X., Sebbe, R., Martin, F., Machy, C., and Delaigle, J.F. (2006, January 18). Performance evaluation of frequent events detection systems. New York, NY, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/2\/1635\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:44:34Z","timestamp":1760219074000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/2\/1635"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,1,25]]},"references-count":60,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2013,2]]}},"alternative-id":["s130201635"],"URL":"https:\/\/doi.org\/10.3390\/s130201635","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,1,25]]}}}