{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T07:38:20Z","timestamp":1770536300674,"version":"3.49.0"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T00:00:00Z","timestamp":1632268800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2021,9,22]]},"abstract":"<jats:p>Simulating crowds requires controlling a very large number of trajectories and is usually performed using crowd motion algorithms for which appropriate parameter values need to be found. The study of the relation between parametric values for simulation techniques and the quality of the resulting trajectories has been studied either through perceptual experiments or by comparison with real crowd trajectories. In this paper, we integrate both strategies. A quality metric, QF, is proposed to abstract from reference data while capturing the most salient features that affect the perception of trajectory realism. QF weights and combines cost functions that are based on several individual, local and global properties of trajectories. These trajectory features are selected from the literature and from interviews with experts. To validate the capacity of QF to capture perceived trajectory quality, we conduct an online experiment that demonstrates the high agreement between the automatic quality score and non-expert users. To further demonstrate the usefulness of QF, we use it in a data-free parameter tuning application able to tune any parametric microscopic crowd simulation model that outputs independent trajectories for characters. The learnt parameters for the tuned crowd motion model maintain the influence of the reference data which was used to weight the terms of QF.<\/jats:p>","DOI":"10.1145\/3480136","type":"journal-article","created":{"date-parts":[[2021,9,28]],"date-time":"2021-09-28T04:43:36Z","timestamp":1632804216000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["A Perceptually-Validated Metric for Crowd Trajectory Quality Evaluation"],"prefix":"10.1145","volume":"4","author":[{"given":"Beatr\u00edz Cabrero","family":"Daniel","sequence":"first","affiliation":[{"name":"Universitat Pompeu Fabra, Barcelona, Spain"}]},{"given":"Ricardo","family":"Marques","sequence":"additional","affiliation":[{"name":"Universitat de Barcelona, Barcelona, Spain"}]},{"given":"Ludovic","family":"Hoyet","sequence":"additional","affiliation":[{"name":"Inria, Univ Rennes, CNRS, IRISA, Rennes, France"}]},{"given":"Julien","family":"Pettr\u00e9","sequence":"additional","affiliation":[{"name":"Inria, Univ Rennes, CNRS, IRISA, Rennes, France"}]},{"given":"Josep","family":"Blat","sequence":"additional","affiliation":[{"name":"Universitat Pompeu Fabra, Barcelona, Spain"}]}],"member":"320","published-online":{"date-parts":[[2021,9,27]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Social LSTM: Human Trajectory Prediction in Crowded Spaces. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE","author":"Alahi A.","year":"2016","unstructured":"A. Alahi , K. Goel , V. Ramanathan , A. Robicquet , L. Fei-Fei , and S. Savarese . 2016 . Social LSTM: Human Trajectory Prediction in Crowded Spaces. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE , Las Vegas, NV, USA, 961--971. https:\/\/doi.org\/10.1109\/CVPR. 2016 .110 10.1109\/CVPR.2016.110 A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese. 2016. Social LSTM: Human Trajectory Prediction in Crowded Spaces. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Las Vegas, NV, USA, 961--971. https:\/\/doi.org\/10.1109\/CVPR.2016.110"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328756.3328769"},{"key":"e_1_2_2_3_1","volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation","author":"Berseth Glen","year":"2014","unstructured":"Glen Berseth , Mubbasir Kapadia , Brandon Haworth , and Petros Faloutsos . 2014 . SteerFit: Automated Parameter Fitting for Steering Algorithms . In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation ( Copenhagen, Denmark) (SCA '14). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 113--122. http:\/\/dl.acm.org\/citation.cfm?id=2849517.2849536 Glen Berseth, Mubbasir Kapadia, Brandon Haworth, and Petros Faloutsos. 2014. SteerFit: Automated Parameter Fitting for Steering Algorithms. In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation (Copenhagen, Denmark) (SCA '14). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 113--122. http:\/\/dl.acm.org\/citation.cfm?id=2849517.2849536"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12403"},{"key":"e_1_2_2_5_1","volume-title":"A Data-Driven Framework for Visual Crowd Analysis. Computer Graphics Forum 33 (10","author":"Charalambous Panayiotis","year":"2014","unstructured":"Panayiotis Charalambous , Ioannis Karamouzas , Stephen Guy , and Yiorgos Chrysanthou . 2014. A Data-Driven Framework for Visual Crowd Analysis. Computer Graphics Forum 33 (10 2014 ). https:\/\/doi.org\/10.1111\/cgf.12472 10.1111\/cgf.12472 Panayiotis Charalambous, Ioannis Karamouzas, Stephen Guy, and Yiorgos Chrysanthou. 2014. A Data-Driven Framework for Visual Crowd Analysis. Computer Graphics Forum 33 (10 2014). https:\/\/doi.org\/10.1111\/cgf.12472"},{"key":"e_1_2_2_6_1","volume-title":"Comparison of Pedestrian Fundamental Diagram Across Cultures. Advances in Complex Systems (ACS) 12 (06","author":"Chattaraj Ujjal","year":"2009","unstructured":"Ujjal Chattaraj , Armin Seyfried , and Partha Chakroborty . 2009. Comparison of Pedestrian Fundamental Diagram Across Cultures. Advances in Complex Systems (ACS) 12 (06 2009 ), 393--405. https:\/\/doi.org\/10.1142\/S0219525909002209 10.1142\/S0219525909002209 Ujjal Chattaraj, Armin Seyfried, and Partha Chakroborty. 2009. Comparison of Pedestrian Fundamental Diagram Across Cultures. Advances in Complex Systems (ACS) 12 (06 2009), 393--405. https:\/\/doi.org\/10.1142\/S0219525909002209"},{"key":"e_1_2_2_7_1","volume-title":"Gradient-based steering for vision-based crowd simulation algorithms. Computer Graphics Forum 36 (05","author":"Dutra Te\u00f3filo","year":"2017","unstructured":"Te\u00f3filo Dutra , Ricardo Marques , Joaquim Cavalcante-Neto , Creto Vidal , and Julien Pettre . 2017. Gradient-based steering for vision-based crowd simulation algorithms. Computer Graphics Forum 36 (05 2017 ). https:\/\/doi.org\/10.1111\/cgf.13130 10.1111\/cgf.13130 Te\u00f3filo Dutra, Ricardo Marques, Joaquim Cavalcante-Neto, Creto Vidal, and Julien Pettre. 2017. Gradient-based steering for vision-based crowd simulation algorithms. Computer Graphics Forum 36 (05 2017). https:\/\/doi.org\/10.1111\/cgf.13130"},{"key":"e_1_2_2_8_1","volume-title":"Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE","author":"Gupta A.","unstructured":"A. Gupta , J. Johnson , L. Fei-Fei , S. Savarese , and A. Alahi . 2018 . Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE , Las Vegas, NV, USA, 2255--2264. A. Gupta, J. Johnson, L. Fei-Fei, S. Savarese, and A. Alahi. 2018. Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, Las Vegas, NV, USA, 2255--2264."},{"key":"e_1_2_2_9_1","first-page":"119","volume-title":"Proc. of Eurographics\/ACM SIGGRAPH Symposium on Computer Animation","author":"Guy Stephen J","year":"2010","unstructured":"Stephen J Guy , Jatin Chhugani , Sean Curtis , Pradeep Dubey , Ming C Lin , and Dinesh Manocha . 2010 . PLEdestrians: A Least-Effort Approach to Crowd Simulation, In Eurographics\/ ACM SIGGRAPH Symposium on Computer Animation . Proc. of Eurographics\/ACM SIGGRAPH Symposium on Computer Animation 2010, 1, 119--128. https:\/\/doi.org\/10.2312\/SCA\/SCA10\/ 119 - 128 10.2312\/SCA Stephen J Guy, Jatin Chhugani, Sean Curtis, Pradeep Dubey, Ming C Lin, and Dinesh Manocha. 2010. PLEdestrians: A Least-Effort Approach to Crowd Simulation, In Eurographics\/ ACM SIGGRAPH Symposium on Computer Animation. Proc. of Eurographics\/ACM SIGGRAPH Symposium on Computer Animation 2010, 1, 119--128. https:\/\/doi.org\/10.2312\/SCA\/SCA10\/119-128"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366209"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.51.4282"},{"key":"e_1_2_2_12_1","volume-title":"Perceptual Effect of Shoulder Motions on Crowd Animations. ACM Transactions on Graphics 35 (07","author":"Hoyet Ludovic","year":"2016","unstructured":"Ludovic Hoyet , Anne-H\u00e9l\u00e8ne Olivier , Richard Kulpa , and Julien Pettre . 2016. Perceptual Effect of Shoulder Motions on Crowd Animations. ACM Transactions on Graphics 35 (07 2016 ), 1--10. https:\/\/doi.org\/10.1145\/2897824.2925931 10.1145\/2897824.2925931 Ludovic Hoyet, Anne-H\u00e9l\u00e8ne Olivier, Richard Kulpa, and Julien Pettre. 2016. Perceptual Effect of Shoulder Motions on Crowd Animations. ACM Transactions on Graphics 35 (07 2016), 1--10. https:\/\/doi.org\/10.1145\/2897824.2925931"},{"key":"e_1_2_2_13_1","volume-title":"The flow of human crowds. Annual review of fluid mechanics 35, 1","author":"Hughes Roger L","year":"2003","unstructured":"Roger L Hughes . 2003. The flow of human crowds. Annual review of fluid mechanics 35, 1 ( 2003 ), 169--182. Asja Jeli\u0107, Cecile Appert-Rolland, Samuel Lemercier, and Julien Pettre. 2012. Properties of pedestrians walking in line: Fundamental diagrams. Physical review. E, Statistical , nonlinear, and soft matter physics 85 (03 2012), 036111. https:\/\/doi.org\/10.1103\/PhysRevE.85.036111 10.1103\/PhysRevE.85.036111 Roger L Hughes. 2003. The flow of human crowds. Annual review of fluid mechanics 35, 1 (2003), 169--182. Asja Jeli\u0107, Cecile Appert-Rolland, Samuel Lemercier, and Julien Pettre. 2012. Properties of pedestrians walking in line: Fundamental diagrams. Physical review. E, Statistical, nonlinear, and soft matter physics 85 (03 2012), 036111. https:\/\/doi.org\/10.1103\/PhysRevE.85.036111"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599470.1599497"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019414"},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of the 2nd International Workshop on Motion in Games","author":"Karamouzas Ioannis","unstructured":"Ioannis Karamouzas , Peter Heil , Pascal Beek , and Mark H. Overmars . 2009. A Predictive Collision Avoidance Model for Pedestrian Simulation . In Proceedings of the 2nd International Workshop on Motion in Games ( Zeist, The Netherlands) (MIG '09). Springer-Verlag, Berlin, Heidelberg, 41--52. https:\/\/doi.org\/10.1007\/978-3-642-10347-6_4 10.1007\/978-3-642-10347-6_4 Ioannis Karamouzas, Peter Heil, Pascal Beek, and Mark H. Overmars. 2009. A Predictive Collision Avoidance Model for Pedestrian Simulation. In Proceedings of the 2nd International Workshop on Motion in Games (Zeist, The Netherlands) (MIG '09). Springer-Verlag, Berlin, Heidelberg, 41--52. https:\/\/doi.org\/10.1007\/978-3-642-10347-6_4"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.113.238701"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024172"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2007.01089.x"},{"key":"e_1_2_2_20_1","volume-title":"Clone attack! Perception of crowd variety. ACM Transactions on Graphics 27 (08","author":"McDonnell Rachel","year":"2008","unstructured":"Rachel McDonnell , Mich\u00e9al Larkin , Simon Dobbyn , Steven Collins , and Carol O'Sullivan . 2008. Clone attack! Perception of crowd variety. ACM Transactions on Graphics 27 (08 2008 ). https:\/\/doi.org\/10.1145\/1360612.1360625 10.1145\/1360612.1360625 Rachel McDonnell, Mich\u00e9al Larkin, Simon Dobbyn, Steven Collins, and Carol O'Sullivan. 2008. Clone attack! Perception of crowd variety. ACM Transactions on Graphics 27 (08 2008). https:\/\/doi.org\/10.1145\/1360612.1360625"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531361"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778860"},{"key":"e_1_2_2_23_1","volume-title":"Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach Abstract. Comput. Graph. Forum 26 (09","author":"Paris S\u00e9bastien","year":"2007","unstructured":"S\u00e9bastien Paris , Julien Pettre , and St\u00e9phane Donikian . 2007. Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach Abstract. Comput. Graph. Forum 26 (09 2007 ), 665--674. https:\/\/doi.org\/10.1111\/j.1467-8659.2007.01090.x 10.1111\/j.1467-8659.2007.01090.x S\u00e9bastien Paris, Julien Pettre, and St\u00e9phane Donikian. 2007. Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach Abstract. Comput. Graph. Forum 26 (09 2007), 665--674. https:\/\/doi.org\/10.1111\/j.1467-8659.2007.01090.x"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/37402.37406"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1142008"},{"key":"e_1_2_2_26_1","volume-title":"2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO). 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO)","author":"Turnwald A.","year":"2015","unstructured":"A. Turnwald , S. Eger , and D. Wollherr . 2015. Investigating similarity measures for locomotor trajectories based on the human perception of differences in motions . In 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO). 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO) , Lyon, France, 1--6. https:\/\/doi.org\/10.1109\/ARSO. 2015 .7428196 10.1109\/ARSO.2015.7428196 A. Turnwald, S. Eger, and D. Wollherr. 2015. Investigating similarity measures for locomotor trajectories based on the human perception of differences in motions. In 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO). 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO), Lyon, France, 1--6. https:\/\/doi.org\/10.1109\/ARSO.2015.7428196"},{"key":"e_1_2_2_27_1","volume-title":"2008 IEEE International Conference on Robotics and Automation. IEEE","author":"van den Berg J.","year":"1928","unstructured":"J. van den Berg , Ming Lin , and D. Manocha . 2008. Reciprocal Velocity Obstacles for real-time multi-agent navigation . In 2008 IEEE International Conference on Robotics and Automation. IEEE , New York, NY , 1928 --1935. https:\/\/doi.org\/10.1109\/ROBOT.2008.4543489 10.1109\/ROBOT.2008.4543489 J. van den Berg, Ming Lin, and D. Manocha. 2008. Reciprocal Velocity Obstacles for real-time multi-agent navigation. In 2008 IEEE International Conference on Robotics and Automation. IEEE, New York, NY, 1928--1935. https:\/\/doi.org\/10.1109\/ROBOT.2008.4543489"},{"key":"e_1_2_2_28_1","first-page":"2","article-title":"Parameter Estimation and Comparative Evaluation of Crowd","volume":"33","author":"Wolinski D.","year":"2014","unstructured":"D. Wolinski , S. J. Guy , A.-H. Olivier , M. Lin , D. Manocha , and J. Pettr\u00e9 . 2014 . Parameter Estimation and Comparative Evaluation of Crowd Simulations. Comput. Graph. Forum 33 , 2 (May 2014), 303--312. https:\/\/doi.org\/10.1111\/cgf.12328 10.1111\/cgf.12328 D. Wolinski, S. J. Guy, A.-H. Olivier, M. Lin, D. Manocha, and J. Pettr\u00e9. 2014. Parameter Estimation and Comparative Evaluation of Crowd Simulations. Comput. Graph. Forum 33, 2 (May 2014), 303--312. https:\/\/doi.org\/10.1111\/cgf.12328","journal-title":"Simulations. Comput. Graph. Forum"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480136","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3480136","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:16Z","timestamp":1750188676000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480136"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,22]]},"references-count":28,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,22]]}},"alternative-id":["10.1145\/3480136"],"URL":"https:\/\/doi.org\/10.1145\/3480136","relation":{},"ISSN":["2577-6193"],"issn-type":[{"value":"2577-6193","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,22]]},"assertion":[{"value":"2021-09-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}