{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T06:16:25Z","timestamp":1764828985612,"version":"3.41.2"},"reference-count":90,"publisher":"Wiley","issue":"9","license":[{"start":{"date-parts":[[2022,6,17]],"date-time":"2022-06-17T00:00:00Z","timestamp":1655424000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Trans Emerging Tel Tech"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years, understanding human behavior has become one of the most important topics in the field of computer vision research. The reason for this growing attention is the wide range of applications that can benefit from the results of this field of research. The human behavior analysis (HBA) includes a wide range of research areas from the detection of human motion and action. Datasets created through actions and detection of human activities make it possible to compare different detection methods with the same input data. Data mining and big data approaches are very popular for analyzing data related to human behavior and can be used to address the challenges of fast processing. This article provides a systematic survey of data mining and big data in the HBA. We focus on current datasets and models related to the detection of human behavior patterns in the literature. The purpose of this survey is to assist researchers in select appropriate datasets and models to evaluate algorithms, as well as to identify research gaps for future work. To achieve this goal, articles published between 2010 and 2021 have been reviewed. These articles fall into five general categories in terms of dataset focus: object detection, motion, action, activity, and behavior. This article provides a summary of data mining and big data models in the HBA, as well as related datasets based on these categories, to highlight promising research avenues for future work.<\/jats:p>","DOI":"10.1002\/ett.4574","type":"journal-article","created":{"date-parts":[[2022,6,18]],"date-time":"2022-06-18T05:45:21Z","timestamp":1655531121000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A systematic survey of data mining and big data in human behavior analysis: Current datasets and models"],"prefix":"10.1002","volume":"33","author":[{"given":"Xuefeng","family":"Ding","sequence":"first","affiliation":[{"name":"College of Computer Science Sichuan University Chengdu Sichuan China"}]},{"given":"Qihong","family":"Gan","sequence":"additional","affiliation":[{"name":"Informatization Construction and Management Office Sichuan University Chengdu Sichuan China"}]},{"given":"Sara","family":"Bahrami","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, North Tehran Branch Islamic Azad University Tehran Iran"}]}],"member":"311","published-online":{"date-parts":[[2022,6,17]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/en11020452"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2018.04.001"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2817253"},{"key":"e_1_2_10_5_1","doi-asserted-by":"crossref","unstructured":"BlankM GorelickL ShechtmanE IraniM BasriR.Actions as space\u2010time shapes. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV'05); Vol. 2 2005:1395\u20101402; IEEE.","DOI":"10.1109\/ICCV.2005.28"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/01441647.2019.1649315"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104772"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-020-05409-2"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-017-2156-x"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.2174\/1574893616999210128175715"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rti.2003.08.001"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-018-1499-5"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2021.102974"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.6829"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622020500522"},{"key":"e_1_2_10_16_1","first-page":"100514","article-title":"AI for next generation computing: emerging trends and future directions","volume":"19","author":"Gill SS","year":"2022","journal-title":"IoT"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-019-0149-9"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/itl2.355"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-019-01247-4"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-020-03296-w"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652\u2010021\u201003551\u20109"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104933"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/ett.4057"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/0952813X.2017.1310308"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00712-2"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxaa109"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3140409"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-021-03430-0"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/jas\/sky014"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2020.08.003"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-019-02972-8"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.2316\/J.2021.206-0393"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1341"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2290086"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-2143-3_1"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.09.002"},{"key":"e_1_2_10_37_1","doi-asserted-by":"crossref","unstructured":"JaouediN BoujnahN HtiwichO BouhlelMS.Human action recognition to human behavior analysis. Proceedings of the 2016 7th International Conference on Sciences of Electronics Technologies of Information and Telecommunications (SETIT); December2016:263\u2010266; IEEE.","DOI":"10.1109\/SETIT.2016.7939877"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.03.005"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18113979"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJACI.2016070104"},{"key":"e_1_2_10_41_1","doi-asserted-by":"crossref","unstructured":"ThurauC Hlav\u00e1cV.Pose primitive based human action recognition in videos or still images. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition;2008:1\u20108; IEEE.","DOI":"10.1109\/CVPR.2008.4587721"},{"key":"e_1_2_10_42_1","doi-asserted-by":"crossref","unstructured":"AchantaR HemamiS EstradaF SusstrunkS.Frequency\u2010tuned salient region detection. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition; June2009:1597\u20101604; IEEE.","DOI":"10.1109\/CVPR.2009.5206596"},{"key":"e_1_2_10_43_1","doi-asserted-by":"crossref","unstructured":"YanQ XuL ShiJ JiaJ.Hierarchical saliency detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition;2013:1155\u20101162; IEEE).","DOI":"10.1109\/CVPR.2013.153"},{"key":"e_1_2_10_44_1","doi-asserted-by":"crossref","unstructured":"LiY HouX KochC RehgJM YuilleAL.The secrets of salient object segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition;2014:280\u2010287; IEEE.","DOI":"10.1109\/CVPR.2014.43"},{"key":"e_1_2_10_45_1","doi-asserted-by":"crossref","unstructured":"MovahediV ElderJH.Design and perceptual validation of performance measures for salient object segmentation. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2010Workshops; June2010:49\u201056; IEEE.","DOI":"10.1109\/CVPRW.2010.5543739"},{"key":"e_1_2_10_46_1","doi-asserted-by":"crossref","unstructured":"YangC ZhangL LuH RuanX YangMH.Saliency detection via graph\u2010based manifold ranking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition;2013:3166\u20103173.","DOI":"10.1109\/CVPR.2013.407"},{"key":"e_1_2_10_47_1","doi-asserted-by":"crossref","unstructured":"DalalN TriggsB.Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05); Vol. 1 June2005:886\u2010893; IEEE.","DOI":"10.1109\/CVPR.2005.177"},{"key":"e_1_2_10_48_1","doi-asserted-by":"crossref","unstructured":"Doll\u00e1rP WojekC SchieleB PeronaP.Pedestrian detection: a benchmark. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition; June 2009:304\u2010311; IEEE.","DOI":"10.1109\/CVPR.2009.5206631"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008162616689"},{"key":"e_1_2_10_50_1","doi-asserted-by":"crossref","unstructured":"KoestingerM WohlhartP RothPM BischofH.Annotated facial landmarks in the wild: a large\u2010scale real\u2010world database for facial landmark localization. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops); November 2011:2144\u20102151; IEEE.","DOI":"10.1109\/ICCVW.2011.6130513"},{"key":"e_1_2_10_51_1","doi-asserted-by":"crossref","unstructured":"ZhangZ LuoP LoyCC TangX.Facial landmark detection by deep multi\u2010task learning. Proceedings of the European Conference on Computer Vision; September 2014:94\u2010108; Springer Cham.","DOI":"10.1007\/978-3-319-10599-4_7"},{"key":"e_1_2_10_52_1","doi-asserted-by":"crossref","unstructured":"YangS LuoP LoyCC TangX.Wider face: a face detection benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016:5525\u20105533; IEEE.","DOI":"10.1109\/CVPR.2016.596"},{"key":"e_1_2_10_53_1","doi-asserted-by":"crossref","unstructured":"SilbermanN HoiemD KohliP FergusR.Indoor segmentation and support inference from RGBD images. Proceedings of the European Conference on Computer Vision; October 2012:746\u2010760; Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-33715-4_54"},{"key":"e_1_2_10_54_1","doi-asserted-by":"crossref","unstructured":"Zelnik\u2010ManorL IraniM.Event\u2010based analysis of video. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001; Vol. 2 2001:II\u2010II; IEEE.","DOI":"10.1109\/CVPR.2001.990935"},{"key":"e_1_2_10_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70711"},{"key":"e_1_2_10_56_1","doi-asserted-by":"crossref","unstructured":"SchuldtC LaptevI CaputoB.Recognizing human actions: a local SVM approach. Proceedings of the 17th International Conference on Pattern Recognition 2004. ICPR 2004; Vol. 3 August 2004:32\u201036; IEEE.","DOI":"10.1109\/ICPR.2004.1334462"},{"key":"e_1_2_10_57_1","doi-asserted-by":"crossref","unstructured":"FuL YuS JiaY.A pedestrian tracking algorithm based on mean shift using color histogram equalization method. Proceedings of the 2017 IEEE 13th International Symposium on Autonomous Decentralized System (ISADS); 2017:235\u2010240; IEEE.","DOI":"10.1109\/ISADS.2017.52"},{"key":"e_1_2_10_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-009-0402-9"},{"key":"e_1_2_10_59_1","doi-asserted-by":"crossref","unstructured":"LertniphonphanK AramvithS ChalidabhongseTH.Feature extraction for human action classification using adaptive key frame interval. Proceedings of the Signal and Information Processing Association Annual Summit and Conference (APSIPA) 2014 Asia\u2010Pacific; 2014:1\u20106; IEEE.","DOI":"10.1109\/APSIPA.2014.7041766"},{"key":"e_1_2_10_60_1","doi-asserted-by":"crossref","unstructured":"Go\u015bciewskaK FrejlichowskiD.A combination of moment descriptors Fourier transform and matching measures for action recognition based on shape. Proceedings of the International Conference on Computational Science:372\u2010386; Springer.","DOI":"10.1007\/978-3-030-50417-5_28"},{"key":"e_1_2_10_61_1","doi-asserted-by":"crossref","unstructured":"LaptevI MarszalekM SchmidC RozenfeldB.Learning realistic human actions from movies. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition; 2008:1\u20108; IEEE.","DOI":"10.1109\/CVPR.2008.4587756"},{"key":"e_1_2_10_62_1","doi-asserted-by":"crossref","unstructured":"RodriguezMD AhmedJ ShahM.Action mach a spatio\u2010temporal maximum average correlation height filter for action recognition. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition; 2008:1\u20108; IEEE.","DOI":"10.1109\/CVPR.2008.4587727"},{"key":"e_1_2_10_63_1","doi-asserted-by":"crossref","unstructured":"LiuJ LuoJ ShahM.Recognizing realistic actions from videos \"in the wild\". Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition; 2009:1996\u20102003; IEEE.","DOI":"10.1109\/CVPR.2009.5206744"},{"key":"e_1_2_10_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-012-0450-4"},{"key":"e_1_2_10_65_1","doi-asserted-by":"crossref","unstructured":"NieblesJC ChenCW Fei\u2010FeiL.Modeling temporal structure of decomposable motion segments for activity classification. Proceedings of the European Conference on Computer Vision; 2010:392\u2010405; Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-15552-9_29"},{"key":"e_1_2_10_66_1","doi-asserted-by":"crossref","unstructured":"ChenCC AggarwalJK.Recognizing human action from a far field of view. Proceedings of the 2009 Workshop on Motion and Video Computing (WMVC); 2009:1\u20107; IEEE.","DOI":"10.1109\/WMVC.2009.5399231"},{"key":"e_1_2_10_67_1","doi-asserted-by":"crossref","unstructured":"NiB WangG MoulinP.Rgbd\u2010hudaact: a color\u2010depth video database for human daily activity recognition. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops); 2011:1147\u20101153; IEEE.","DOI":"10.1109\/ICCVW.2011.6130379"},{"key":"e_1_2_10_68_1","doi-asserted-by":"crossref","unstructured":"SinghS VelastinSA RaghebH.Muhavi: a multicamera human action video dataset for the evaluation of action recognition methods. Proceedings of the 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance; 2010:48\u201055; IEEE.","DOI":"10.1109\/AVSS.2010.63"},{"key":"e_1_2_10_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995586"},{"key":"e_1_2_10_70_1","doi-asserted-by":"crossref","unstructured":"LaptevI P\u00e9rezP.Retrieving actions in movies. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision; 2007:1\u20108; IEEE.","DOI":"10.1109\/ICCV.2007.4409105"},{"key":"e_1_2_10_71_1","doi-asserted-by":"crossref","unstructured":"FerrymanJ ShahrokniA.Pets2009: dataset and challenge. Proceedings of the 2009 12th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance; 2009:1\u20106; IEEE.","DOI":"10.1109\/PETS-WINTER.2009.5399556"},{"key":"e_1_2_10_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.07.013"},{"key":"e_1_2_10_73_1","doi-asserted-by":"crossref","unstructured":"SantofimiaMJ Martinez\u2010del\u2010RinconJ NebelJC.Common\u2010sense knowledge for a computer vision system for human action recognition. Proceedings of the International Workshop on Ambient Assisted Living; 2012:159\u2010166; Springer.","DOI":"10.1007\/978-3-642-35395-6_22"},{"key":"e_1_2_10_74_1","doi-asserted-by":"crossref","unstructured":"LeeJT ChenCC AggarwalJK.Recognizing human\u2010vehicle interactions from aerial video without training. Proceedings of the CVPR 2011 Workshops; 2011:53\u201060; IEEE.","DOI":"10.1109\/CVPRW.2011.5981794"},{"key":"e_1_2_10_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1137"},{"key":"e_1_2_10_76_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.06.011"},{"key":"e_1_2_10_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.04.037"},{"key":"e_1_2_10_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.03.006"},{"key":"e_1_2_10_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.12.038"},{"key":"e_1_2_10_80_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.04.039"},{"key":"e_1_2_10_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2018.01.012"},{"key":"e_1_2_10_82_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.01.092"},{"key":"e_1_2_10_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bdr.2017.06.002"},{"key":"e_1_2_10_84_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.01.055"},{"key":"e_1_2_10_85_1","doi-asserted-by":"crossref","unstructured":"LiT LiuJ ZhangW NiY WangW LiZ.UAV\u2010human: a large benchmark for human behavior understanding with unmanned aerial vehicles. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition; 2021:16266\u201016275.","DOI":"10.1109\/CVPR46437.2021.01600"},{"key":"e_1_2_10_86_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.10.016"},{"key":"e_1_2_10_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2008.927109"},{"key":"e_1_2_10_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/1922649.1922653"},{"key":"e_1_2_10_89_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.08.050"},{"key":"e_1_2_10_90_1","doi-asserted-by":"crossref","unstructured":"FathiA MoriG.Action recognition by learning mid\u2010level motion features. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition; 2008:1\u20108; IEEE.","DOI":"10.1109\/CVPR.2008.4587735"},{"key":"e_1_2_10_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2005.852197"}],"container-title":["Transactions on Emerging Telecommunications Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ett.4574","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ett.4574","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ett.4574","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T04:50:30Z","timestamp":1727412630000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ett.4574"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,17]]},"references-count":90,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["10.1002\/ett.4574"],"URL":"https:\/\/doi.org\/10.1002\/ett.4574","archive":["Portico"],"relation":{},"ISSN":["2161-3915","2161-3915"],"issn-type":[{"type":"print","value":"2161-3915"},{"type":"electronic","value":"2161-3915"}],"subject":[],"published":{"date-parts":[[2022,6,17]]},"assertion":[{"value":"2021-12-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-24","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e4574"}}