{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T19:14:03Z","timestamp":1780514043329,"version":"3.54.1"},"reference-count":53,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2013,1,14]],"date-time":"2013-01-14T00:00:00Z","timestamp":1358121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Associating attributes to pedestrians in a crowd is relevant for various areas like surveillance, customer profiling and service providing. The attributes of interest greatly depend on the application domain and might involve such social relations as friends or family as well as the hierarchy of the group including the leader or subordinates. Nevertheless, the complex social setting inherently complicates this task. We attack this problem by exploiting the small group structures in the crowd. The relations among individuals and their peers within a social group are reliable indicators of social attributes. To that end, this paper identifies social groups based on explicit motion models integrated through a hypothesis testing scheme. We develop two models relating positional and directional relations. A pair of pedestrians is identified as belonging to the same group or not by utilizing the two models in parallel, which defines a compound hypothesis testing scheme. By testing the proposed approach on three datasets with different environmental properties and group characteristics, it is demonstrated that we achieve an identification accuracy of 87% to 99%. The contribution of this study lies in its definition of positional and directional relation models, its description of compound evaluations, and the resolution of ambiguities with our proposed uncertainty measure based on the local and global indicators of group relation.<\/jats:p>","DOI":"10.3390\/s130100875","type":"journal-article","created":{"date-parts":[[2013,1,15]],"date-time":"2013-01-15T02:36:29Z","timestamp":1358217389000},"page":"875-897","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Deciphering the Crowd: Modeling and Identification of Pedestrian Group Motion"],"prefix":"10.3390","volume":"13","author":[{"given":"Zeynep","family":"Y\u00fccel","sequence":"first","affiliation":[{"name":"Intelligent Robotics and Communication Laboratories, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesco","family":"Zanlungo","sequence":"additional","affiliation":[{"name":"Intelligent Robotics and Communication Laboratories, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tetsushi","family":"Ikeda","sequence":"additional","affiliation":[{"name":"Intelligent Robotics and Communication Laboratories, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takahiro","family":"Miyashita","sequence":"additional","affiliation":[{"name":"Intelligent Robotics and Communication Laboratories, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norihiro","family":"Hagita","sequence":"additional","affiliation":[{"name":"Intelligent Robotics and Communication Laboratories, Advanced Telecommunications Research Institute International, Kyoto 619-0288, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2013,1,14]]},"reference":[{"key":"ref_1","unstructured":"Haritaoglu, I., and Flickner, M. (December, January 8\u2013). Detection and Tracking of Shopping Groups in Stores. Kauai, HI, USA."},{"key":"ref_2","unstructured":"Chang, M.C., Krahnstoever, N., and Ge, W. (November, January 6\u2013). Probabilistic Group-Level Motion Analysis and Scenario Recognition. Barcelona, Spain."},{"key":"ref_3","unstructured":"Yu, T., Lim, S.N., Patwardhan, K.A., and Krahnstoever, N. (June, January 20\u2013). Monitoring, Recognizing and Discovering Social Networks. Miami, FL, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1177\/0049124182010003007","article-title":"Using film to analyze pedestrian behavior","volume":"10","author":"McPhail","year":"1982","journal-title":"Sociol. Method. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s00138-008-0132-4","article-title":"Crowd analysis: A survey","volume":"19","author":"Zhan","year":"2008","journal-title":"Mach. Vision. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Aggarwal, J.K., and Ryoo, M.S. (2011). Human activity analysis: A review. ACM Comput. Surv.","DOI":"10.1145\/1922649.1922653"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.neucom.2011.12.038","article-title":"Human behavior analysis in video surveillance: A social signal processing perspective","volume":"100","author":"Cristani","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1016\/j.imavis.2009.01.004","article-title":"Automatic nonverbal analysis of social interaction in small groups: A review","volume":"27","year":"2009","journal-title":"Image Vision Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s10919-009-0077-y","article-title":"Interpersonal distances in group walking","volume":"34","author":"Costa","year":"2010","journal-title":"J. Nonverbal Behav."},{"key":"ref_10","unstructured":"Chen, Y.Y., Hsu, W.H., and Liao, H.Y.M. (November, January 29). Discovering Informative Social Subgraphs and Predicting Pairwise Relationships from Group Photos. Nara, Japan."},{"key":"ref_11","unstructured":"Singla, P., Kautz, H., Luo, J., and Gallagher, A. (June, January 23\u2013). Discovery of Social Relationships in Consumer Photo Collections Using Markov Logic. Anchorage, AK, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1109\/TMM.2012.2187436","article-title":"Understanding kin relationships in a photo","volume":"14","author":"Xia","year":"2012","journal-title":"IEEE Trans. Multimed."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/978-3-642-15555-0_13","article-title":"Seeing people in social context: Recognizing people and social relationships","volume":"6315","author":"Wang","year":"2010","journal-title":"Lect. Note. Comput. Sci."},{"key":"ref_14","unstructured":"Gallagher, A.C., and Chen, T. (June, January 20\u2013). Understanding Images of Groups of People. Miami, FL, USA."},{"key":"ref_15","unstructured":"Murillo, A., Kwak, I., Bourdev, L., Kriegman, D., and Belongie, S. (June, January 16\u2013). Urban Tribes: Analyzing Group Photos from a Social Perspective. Providence, RI, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1007\/978-3-642-15561-1_30","article-title":"Learning relations among movie characters: A social network perspective","volume":"6314","author":"Ding","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/TPAMI.2008.241","article-title":"Correspondence-free activity analysis and scene modeling in multiple camera views","volume":"32","author":"Wang","year":"2010","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s11263-008-0194-9","article-title":"Detection and segmentation of multiple, partially occluded objects by grouping, merging, assigning part detection responses","volume":"82","author":"Wu","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","unstructured":"Jorge, P., Abrantes, A., and Marques, J. (2004, January 10). On-Line Tracking Groups of Pedestrians with Bayesian Networks. Prague, Czech Republic."},{"key":"ref_20","unstructured":"Pellegrini, S., Ess, A., Schindler, K., and Gool, L.J.V. (2, January 29). You'll Never Walk Alone: Modeling Social Behavior for Multi-Target Tracking."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1007\/978-3-642-15549-9_33","article-title":"Improving data association by joint modeling of pedestrian trajectories and groupings","volume":"6311","author":"Pellegrini","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_22","unstructured":"Bose, B., Wang, X., and Grimson, E. (June, January 17\u2013). Multi-Class Object Tracking Algorithm that Handles Fragmentation and Grouping. Minneapolis, MN, USA."},{"key":"ref_23","unstructured":"Wertheimer, M. (1938). A Source Book of Gestalt Psychology, Routledge and Kegan Paul."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s11263-011-0459-6","article-title":"Trajectory analysis and semantic region modeling using nonparametric hierarchical bayesian models","volume":"95","author":"Wang","year":"2011","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","unstructured":"Yan, W., and Forsyth, D.A. (January, January 5\u2013). Learning the Behavior of Users in a Public Space through Video Tracking. Breckenridge, CO USA."},{"key":"ref_26","unstructured":"Habe, H., Honda, K., and Kidode, M. (2, January 30). Human Interaction Analysis Based on Walking Pattern Transitions. Como, Italy."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zen, G., Lepri, B., Ricci, E., and Lanz, O. (2010, January 25\u201329). Space Speaks: Towards Socially and Personality Aware Visual Surveillance. Florence, Italy.","DOI":"10.1145\/1878039.1878048"},{"key":"ref_28","unstructured":"Choi, W., Shahid, K., and Savarese, S. (June, January 20\u2013). Learning Context for Collective Activity Recognition. Providence, RI, USA."},{"key":"ref_29","unstructured":"French, A.P., Naeem, A., Dryden, I.L., and Pridmore, T.P. (September, January 5\u2013). Using Social Effects to Guide Rracking in Complex Scenes. London, UK."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1109\/TCSVT.2011.2125550","article-title":"Mixtures of von mises distributions for people trajectory shape analysis","volume":"21","author":"Calderara","year":"2011","journal-title":"IEEE Trans. Circuit. Syst. Video Technol."},{"key":"ref_31","unstructured":"Y\u00fccel, Z., Ikeda, T., Miyashita, T., and Hagita, N. (September, January 25\u2013). Identification of Mobile Entities Based on Trajectory and Shape Information. San Francisco, CA, USA."},{"key":"ref_32","unstructured":"Y\u00fccel, Z., Zanlungo, F., Ikeda, T., Miyashita, T., and Hagita, N. (October, January 7\u2013). Modeling Indicators of Coherent Motion. Vilamoura-Algarve, Portugal."},{"key":"ref_33","unstructured":"Y\u00fccel, Z., Miyashita, T., and Hagita, N. (2012, January 11\u201315). Modeling and Identification of Group Motion via Compound Evaluation of Positional and Directional Cues. Tsukuba, Japan."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1109\/TPAMI.2011.176","article-title":"Vision-based analysis of small groups in pedestrian crowds","volume":"34","author":"Ge","year":"2012","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/978-3-642-23687-7_46","article-title":"Detection of human groups in videos","volume":"6915","author":"Sandikci","year":"2011","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.patcog.2005.05.012","article-title":"Directional features in online handwriting recognition","volume":"39","author":"Bahlmann","year":"2006","journal-title":"Patt. Recog."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4282","DOI":"10.1103\/PhysRevE.51.4282","article-title":"Social force model for pedestrian dynamics","volume":"51","author":"Helbing","year":"1995","journal-title":"Phys. Rev. E"},{"key":"ref_38","unstructured":"Mehran, R., Oyama, A., and Shah, M. (June, January 20\u2013). Abnormal Crowd Behavior Detection Using Social Force Model. Miami, FL, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1111\/j.1467-8659.2007.01089.x","article-title":"Crowds by example","volume":"26","author":"Lerner","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_40","unstructured":"Fisher, R. (2004, January 10). The PETS04 Surveillance Ground-Truth Data Sets. Prague, Czech Republic."},{"key":"ref_41","unstructured":"Zeynep Y\u00fccel. Available online: http:\/\/www.irc.atr.jp\/zeynep\/research (accessed on 9 January 2013)."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Moussa\u00efd, M., Perozo, N., Garnier, S., Helbing, D., and Theraulaz, G. (2010). The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PLoS One.","DOI":"10.1371\/journal.pone.0010047"},{"key":"ref_43","unstructured":"Glas, D., Miyashita, T., Ishiguro, H., and Hagita, N. (November, January 29). Laser Tracking of Human Body Motion Using Adaptive Shape Modeling. San Diego, CA, USA."},{"key":"ref_44","unstructured":"ETH Zurich\u2014Department of Information Technology and Electrical Engineering Computer Vision Laboratory. Available online: http:\/\/www.vision.ee.ethz.ch\/datasets\/index.en.html (accessed on 9 January 2013)."},{"key":"ref_45","unstructured":"Benchmark Data for PETS-ECCV 2004. Available online: http:\/\/www-prima.inrialpes.fr\/PETS04\/caviar_data.html (accessed on 9 January 2013)."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Moussa\u00efd, M., Helbing, D., Garnier, S., Johansson, A., Combe, M., and Theraulaz, G. (2009). Experimental study of the behavioural mechanisms underlying self-organization in human crowds. Proc. R. Soc. B.","DOI":"10.1098\/rspb.2009.0405"},{"key":"ref_47","unstructured":"Helbing, D., Farkas, I., Molnar, P., and Vicsek, T. (2002). Pedestrian and Evacuation Dynamics, Springer."},{"key":"ref_48","unstructured":"Daamen, W., and Hoogendoorn, S. (January, January 22\u2013). Free Speed Distributions for Pedestrian Traffic. Washington DC, USA."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Abramowitz, M., and Stegun, I. (1965). Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, Courier Dover.","DOI":"10.1063\/1.3047921"},{"key":"ref_50","unstructured":"Francesco Zanlungo. Available online: https:\/\/sites.google.com\/site\/francescozanlungo\/squarelinepicking (accessed on 9 January 2013)."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mardia, K.V., and Jupp, P.E. (2000). Directional Statistics, John Wiley and Sons Ltd.","DOI":"10.1002\/9780470316979"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kose, C., and Wesel, R. (2001, January 4\u20137). Robustness of Likelihood Ratio Tests: Hypothesis Testing under Incorrect Models. Pacific Grove, CA, USA.","DOI":"10.1109\/ACSSC.2001.987782"},{"key":"ref_53","unstructured":"Hall, E.T. (1966). The Hidden Dimension, Doubleday."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/1\/875\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:44:16Z","timestamp":1760219056000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/1\/875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,1,14]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2013,1]]}},"alternative-id":["s130100875"],"URL":"https:\/\/doi.org\/10.3390\/s130100875","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,1,14]]}}}