{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T02:15:54Z","timestamp":1782440154875,"version":"3.54.5"},"reference-count":102,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2011,4,1]],"date-time":"2011-04-01T00:00:00Z","timestamp":1301616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004926","name":"Texas Higher Education Coordinating Board","doi-asserted-by":"publisher","award":["003658-0140-2007"],"award-info":[{"award-number":["003658-0140-2007"]}],"id":[{"id":"10.13039\/100004926","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2011,4]]},"abstract":"<jats:p>Human activity recognition is an important area of computer vision research. Its applications include surveillance systems, patient monitoring systems, and a variety of systems that involve interactions between persons and electronic devices such as human-computer interfaces. Most of these applications require an automated recognition of high-level activities, composed of multiple simple (or atomic) actions of persons. This article provides a detailed overview of various state-of-the-art research papers on human activity recognition. We discuss both the methodologies developed for simple human actions and those for high-level activities. An approach-based taxonomy is chosen that compares the advantages and limitations of each approach.<\/jats:p>\n          <jats:p>Recognition methodologies for an analysis of the simple actions of a single person are first presented in the article. Space-time volume approaches and sequential approaches that represent and recognize activities directly from input images are discussed. Next, hierarchical recognition methodologies for high-level activities are presented and compared. Statistical approaches, syntactic approaches, and description-based approaches for hierarchical recognition are discussed in the article. In addition, we further discuss the papers on the recognition of human-object interactions and group activities. Public datasets designed for the evaluation of the recognition methodologies are illustrated in our article as well, comparing the methodologies' performances. This review will provide the impetus for future research in more productive areas.<\/jats:p>","DOI":"10.1145\/1922649.1922653","type":"journal-article","created":{"date-parts":[[2011,5,3]],"date-time":"2011-05-03T12:48:53Z","timestamp":1304426933000},"page":"1-43","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1663,"title":["Human activity analysis"],"prefix":"10.1145","volume":"43","author":[{"given":"J.K.","family":"Aggarwal","sequence":"first","affiliation":[{"name":"University of Texas at Austin, Austin, TX"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M.S.","family":"Ryoo","sequence":"additional","affiliation":[{"name":"Electronics and Telecommunications Research Institute, Daejeon, Korea and University of Texas at Austin, Austin, TX"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2011,4,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1998.0744"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1975.224102"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/182.358434"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/logcom\/4.5.531"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2007.4425322"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.28"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.910878"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.643892"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Los Alamitos, CA.","author":"Bregonzio M."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE Los Alamitos, CA, 624--630","author":"Campbell L. W."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/0262-8856(95)93154-K"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Chomat O."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV). IEEE","author":"Cupillard F."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2007.909939"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Damen D."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Darrell T."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS). IEEE","author":"Dollar P."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV).","volume":"2","author":"Efros A."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the International Workshop on Face and Gesture Recognition. 272--277","author":"Gavrila D."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1998.0716"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW). IEEE","author":"Ghanem N."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE","author":"Gong S."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Gupta A."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Gupta A."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 20th National Conference on Artificial Intelligence (AAAI). 263--268","author":"Hakeem A."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Alvey Vision Conference. 147--152","author":"Harris C."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.02.005"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the AAAI Conference on Innovative Applications of Artificial Intelligence. AAAI\/IAAI. 518--525","author":"Intille S. S."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.868686"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE","author":"Jhuang H."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.297"},{"key":"e_1_2_1_32_1","first-page":"76","article-title":"Visual motion perception. Sci","volume":"232","author":"Johansson G.","year":"1975","journal-title":"Amer."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2006.32"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Ke Y."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101237"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Kim T.-K."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS). IEEE","author":"Kitani K. M."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/WMVC.2007.34"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1163\/156855307782148578"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the International Conference on Computer Vision Theory and Applications. 110--115","author":"la Torre Frade F. D."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE","author":"Laptev I."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Laptev I."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE","author":"Laptev I."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1459359.1459456"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Liu J."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Liu J."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851523"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.210"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS). IEEE","author":"Lv F."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Lv F."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Minnen D."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the AAAI Conference on Innovative Applications of Artificial Intelligence. 770--776","author":"Moore D. J."},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV).","volume":"1","author":"Moore D. J."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/3468.784178"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/WMVC.2007.12"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW).","volume":"7","author":"Nevatia R."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the IEEE Workshop on Event Mining. IEEE","author":"Nevatia R."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.203"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the British Machine Vision Conference (BMVC).","author":"Niebles J. C."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0122-4"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Niyogi S."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMI.2002.1166960"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.868684"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-004-0148-1"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.57"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Pinhanez C. S."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Rao C."},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Rapantzikos K."},{"key":"e_1_2_1_69_1","volume-title":"Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS). IEEE","author":"Ribeiro P. C."},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Rodriguez M. D."},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of the IEEE\/ACM\/IFIP Workshop on Embedded Systems for Real-Time Multimedia (ESTImedia). ACM","author":"Rofouei M."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0181-1"},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV), IEEE","author":"Ryoo M. S."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/WMVC.2008.4544065"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 2nd International Workshop on Semantic Learning Applications in Multimedia (SLAM).","author":"Ryoo M. S."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.242"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.1043"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/WMVC.2008.4544068"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018429.1020906"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/1291233.1291311"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.328"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.90"},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Shi Y."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.790"},{"key":"e_1_2_1_85_1","volume-title":"Proceedings of the International Symposium on Computer Vision. 265","author":"Starner T."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88688-4_45"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2008.2005594"},{"key":"e_1_2_1_88_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Vaswani N."},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.304"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2007.4425317"},{"key":"e_1_2_1_91_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). 1295--1302","author":"Vu V.-T."},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(82)90023-6"},{"key":"e_1_2_1_93_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Wong S.-F."},{"key":"e_1_2_1_94_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE","author":"Yacoob Y."},{"key":"e_1_2_1_95_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE","author":"Yamato J."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP.2006.285263"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.58"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.201"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.440"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/3468.759269"},{"key":"e_1_2_1_101_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Zelnik-Manor L."},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2006.870735"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1922649.1922653","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1922649.1922653","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:26:08Z","timestamp":1750278368000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1922649.1922653"}},"subtitle":["A review"],"short-title":[],"issued":{"date-parts":[[2011,4]]},"references-count":102,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,4]]}},"alternative-id":["10.1145\/1922649.1922653"],"URL":"https:\/\/doi.org\/10.1145\/1922649.1922653","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,4]]},"assertion":[{"value":"2008-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-04-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}