{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T05:16:33Z","timestamp":1773551793401,"version":"3.50.1"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100018341","name":"Leuphana Universit\u00e4t L\u00fcneburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100018341","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Understanding spatiotemporal coordination of players in team sports is key to movement models, pattern detection, and computational tactics. Existing generative models propose to capture all stochasticity by a single latent variable and may suffer from entangled representations, or aim to uncover interaction structures of players but then do not focus on their generative ability. As a remedy, we propose a hierarchical latent variable model for predicting trajectories of multiple players. In the generative model, both, discrete role assignments and a latent interaction graph are sampled to allow for different models in subsequent node updates and message passing operations between nodes, where standard Gaussian latent variables are employed per agent and timestep. We cast our approach as a variational autoencoder that provides a disentangled latent space to capture variability in team sport movements and propose a neural architecture for its optimization. We empirically evaluate our approach on tracking data from basketball and soccer and observe that our contribution outperforms the state-of-art in all experiments.<\/jats:p>","DOI":"10.1007\/s10994-024-06648-2","type":"journal-article","created":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T21:18:57Z","timestamp":1738012737000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Interactive sequential generative models for team sports"],"prefix":"10.1007","volume":"114","author":[{"given":"Dennis","family":"Fassmeyer","sequence":"first","affiliation":[]},{"given":"Moritz","family":"Cordes","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9600-6463","authenticated-orcid":false,"given":"Ulf","family":"Brefeld","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,27]]},"reference":[{"key":"6648_CR1","doi-asserted-by":"crossref","unstructured":"Alahi, A., Ramanathan, V., & Fei-Fei, L. (2014). Socially-aware large-scale crowd forecasting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2203\u20132210.","DOI":"10.1109\/CVPR.2014.283"},{"key":"6648_CR2","unstructured":"Battaglia, P. W., Hamrick, J. B., Bapst, V., et\u00a0al. (2018). Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261."},{"key":"6648_CR3","unstructured":"Bayer, J., & Osendorfer, C. (2014). Learning stochastic recurrent networks. arXiv preprint arXiv:1411.7610."},{"key":"6648_CR4","doi-asserted-by":"crossref","unstructured":"Bhattacharyya, A., Reino, D. O., Fritz, M., et\u00a0al. (2021). Euro-pvi: Pedestrian vehicle interactions in dense urban centers. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 6408\u20136417.","DOI":"10.1109\/CVPR46437.2021.00634"},{"key":"6648_CR5","doi-asserted-by":"crossref","unstructured":"Bowman, S. R., Vilnis, L., Vinyals, O., et\u00a0al. (2016). Generating sentences from a continuous space. In: 20th SIGNLL Conference on Computational Natural Language Learning, CoNLL 2016, Association for Computational Linguistics (ACL), pp 10\u201321.","DOI":"10.18653\/v1\/K16-1002"},{"issue":"1","key":"6648_CR6","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/s10994-018-5725-1","volume":"108","author":"U Brefeld","year":"2019","unstructured":"Brefeld, U., Lasek, J., & Mair, S. (2019). Probabilistic movement models and zones of control. Machine Learning, 108(1), 127\u2013147.","journal-title":"Machine Learning"},{"key":"6648_CR7","doi-asserted-by":"crossref","unstructured":"Casas, S., Gulino, C., Suo, S., et\u00a0al. (2020). Implicit latent variable model for scene-consistent motion forecasting. In: European Conference on Computer Vision, pp 624\u2013641.","DOI":"10.1007\/978-3-030-58592-1_37"},{"key":"6648_CR8","unstructured":"Choi, C., Malla, S., Patil, A., et\u00a0al. (2021). Drogon: A trajectory prediction model based on intention-conditioned behavior reasoning. In: Conference on Robot Learning, PMLR, pp 49\u201363."},{"key":"6648_CR9","unstructured":"Chung, J., Gulcehre, C., Cho, K., et\u00a0al. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555."},{"key":"6648_CR10","unstructured":"Chung, J., Kastner, K., Dinh, L., et\u00a0al. (2015). A recurrent latent variable model for sequential data. Advances in neural information processing systems 28."},{"issue":"3","key":"6648_CR11","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1007\/s10618-022-00827-2","volume":"36","author":"U Dick","year":"2022","unstructured":"Dick, U., Link, D., & Brefeld, U. (2022). Who can receive the pass? a computational model for quantifying availability in soccer. Data Mining and Knowledge Discovery, 36(3), 987\u20131014.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"6648_CR12","doi-asserted-by":"crossref","unstructured":"Fan, S., Li, X., & Li, F. (2021). Intention-driven trajectory prediction for autonomous driving. In: 2021 IEEE Intelligent Vehicles Symposium (IV), IEEE, pp 107\u2013113.","DOI":"10.1109\/IV48863.2021.9575253"},{"key":"6648_CR13","unstructured":"Fraccaro, M., S\u00f8nderby, S. K., Paquet, U., et\u00a0al. (2016). Sequential neural models with stochastic layers. Advances in neural information processing systems 29."},{"key":"6648_CR14","unstructured":"Gilmer, J., Schoenholz, S. S., Riley, P. F., et\u00a0al. (2017). Neural message passing for quantum chemistry. In: International conference on machine learning, PMLR, pp 1263\u20131272."},{"key":"6648_CR15","doi-asserted-by":"crossref","unstructured":"Girase, H., Gang, H., Malla, S., et\u00a0al. (2021). Loki: Long term and key intentions for trajectory prediction. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp 9803\u20139812.","DOI":"10.1109\/ICCV48922.2021.00966"},{"key":"6648_CR16","unstructured":"Girgis, R., Golemo, F., Codevilla, F., et\u00a0al. (2021). Latent variable sequential set transformers for joint multi-agent motion prediction. In: International Conference on Learning Representations."},{"key":"6648_CR17","unstructured":"Goyal, A., Sordoni, A., C\u00f4t\u00e9, M. A., et\u00a0al. (2017). Z-forcing: Training stochastic recurrent networks. arXiv preprint arXiv:1711.05411."},{"key":"6648_CR18","doi-asserted-by":"crossref","unstructured":"Graber, C., & Schwing, A. (2020). Dynamic neural relational inference for forecasting trajectories. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 1018\u20131019.","DOI":"10.1109\/CVPR42600.2020.00854"},{"key":"6648_CR19","unstructured":"Jang, E., Gu, S., & Poole, B. (2017). Categorical reparametrization with gumble-softmax. In: International Conference on Learning Representations (ICLR 2017), OpenReview. net."},{"key":"6648_CR20","unstructured":"Kingma, D. P., & Welling, M. (2013). Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114."},{"key":"6648_CR21","unstructured":"Kipf, T., Fetaya, E., Wang, K. C., et\u00a0al. (2018). Neural relational inference for interacting systems. In: International Conference on Machine Learning, PMLR, pp 2688\u20132697."},{"key":"6648_CR22","unstructured":"Kipf, T. N., & Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907."},{"key":"6648_CR23","unstructured":"Le, H. M., Yue, Y., Carr, P., et\u00a0al. (2017). Coordinated multi-agent imitation learning. In: International Conference on Machine Learning, PMLR, pp 1995\u20132003."},{"key":"6648_CR24","doi-asserted-by":"crossref","unstructured":"Li, J., Yang, F., Ma, H., et\u00a0al. (2021a). Rain: Reinforced hybrid attention inference network for motion forecasting. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp 16096\u201316106.","DOI":"10.1109\/ICCV48922.2021.01579"},{"key":"6648_CR25","first-page":"27107","volume":"34","author":"L Li","year":"2021","unstructured":"Li, L., Yao, J., Wenliang, L., et al. (2021). Grin: Generative relation and intention network for multi-agent trajectory prediction. Advances in Neural Information Processing Systems, 34, 27107\u201327118.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6648_CR26","first-page":"18704","volume":"33","author":"G Liu","year":"2020","unstructured":"Liu, G., Schulte, O., Poupart, P., et al. (2020). Learning agent representations for ice hockey. Advances in Neural Information Processing Systems, 33, 18704\u201318715.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6648_CR27","unstructured":"L\u00f6we, S., Madras, D., Zemel, R., et\u00a0al. (2022). Amortized causal discovery: Learning to infer causal graphs from time-series data. In: Conference on Causal Learning and Reasoning, PMLR, pp 509\u2013525."},{"key":"6648_CR28","unstructured":"Maddison, C., Mnih, A., & Teh, Y. (2017). The concrete distribution: A continuous relaxation of discrete random variables. In: Proceedings of the international conference on learning Representations, International Conference on Learning Representations."},{"key":"6648_CR29","unstructured":"Makansi, O., von K\u00fcgelgen, J., Locatello, F., et\u00a0al. (2022). You mostly walk alone: Analyzing feature attribution in trajectory prediction. In: International Conference on Learning Representations (ICLR)."},{"key":"6648_CR30","doi-asserted-by":"crossref","unstructured":"Mangalam, K., Girase, H., Agarwal, S., et\u00a0al. (2020). It is not the journey but the destination: Endpoint conditioned trajectory prediction. In: European conference on computer vision, Springer, pp 759\u2013776.","DOI":"10.1007\/978-3-030-58536-5_45"},{"key":"6648_CR31","doi-asserted-by":"crossref","unstructured":"Mangalam, K., An, Y., Girase, H., et\u00a0al. (2021). From goals, waypoints & paths to long term human trajectory forecasting. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp 15233\u201315242.","DOI":"10.1109\/ICCV48922.2021.01495"},{"key":"6648_CR32","doi-asserted-by":"crossref","unstructured":"Mohamed, A., Qian, K., Elhoseiny, M., et\u00a0al. (2020). Social-stgcnn: A social spatio-temporal graph convolutional neural network for human trajectory prediction. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 14424\u201314432.","DOI":"10.1109\/CVPR42600.2020.01443"},{"key":"6648_CR33","doi-asserted-by":"crossref","unstructured":"Monti, A., Bertugli, A., Calderara, S., et\u00a0al. (2021). Dag-net: Double attentive graph neural network for trajectory forecasting. In: 2020 25th International Conference on Pattern Recognition (ICPR), IEEE, pp 2551\u20132558.","DOI":"10.1109\/ICPR48806.2021.9412114"},{"issue":"1","key":"6648_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-022-12547-0","volume":"12","author":"S Omidshafiei","year":"2022","unstructured":"Omidshafiei, S., Hennes, D., Garnelo, M., et al. (2022). Multiagent off-screen behavior prediction in football. Scientific reports, 12(1), 1\u201313.","journal-title":"Scientific reports"},{"key":"6648_CR35","doi-asserted-by":"crossref","unstructured":"Passos, P., & Davids, K. (2015). Learning design to facilitate interactive behaviours in team sports. RICYDE Revista internacional de ciencias del deporte 39(11).","DOI":"10.5232\/ricyde2015.03902"},{"key":"6648_CR36","unstructured":"Radke, D., & Orchard, A. (2023). Presenting multiagent challenges in team sports analytics. Tech. Rep. arXiv:2303.13660."},{"key":"6648_CR37","unstructured":"Rezende, D. J., Mohamed, S., & Wierstra, D. (2014). Stochastic backpropagation and approximate inference in deep generative models. In: International conference on machine learning, PMLR, pp 1278\u20131286."},{"issue":"8","key":"6648_CR38","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1177\/0278364920917446","volume":"39","author":"A Rudenko","year":"2020","unstructured":"Rudenko, A., Palmieri, L., Herman, M., et al. (2020). Human motion trajectory prediction: A survey. The International Journal of Robotics Research, 39(8), 895\u2013935.","journal-title":"The International Journal of Robotics Research"},{"key":"6648_CR39","doi-asserted-by":"crossref","unstructured":"Salzmann, T., Ivanovic, B., Chakravarty, P., et\u00a0al. (2020). Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data. In: European Conference on Computer Vision, Springer, pp 683\u2013700.","DOI":"10.1007\/978-3-030-58523-5_40"},{"key":"6648_CR40","doi-asserted-by":"crossref","unstructured":"Shen, T., Zhou, T., Long, G., et\u00a0al. (2018). Reinforced self-attention network: A hybrid of hard and soft attention for sequence modeling. In: IJCAI International Joint Conference on Artificial Intelligence.","DOI":"10.24963\/ijcai.2018\/604"},{"key":"6648_CR41","unstructured":"Sohn, K., Lee, H., & Yan, X. (2015). Learning structured output representation using deep conditional generative models. Advances in neural information processing systems 28."},{"key":"6648_CR42","unstructured":"S\u00f8nderby, C. K., Raiko, T., Maal\u00f8e, L., et\u00a0al. (2016). Ladder variational autoencoders. Advances in neural information processing systems 29."},{"key":"6648_CR43","unstructured":"Sun, C., Karlsson, P., Wu, J., et\u00a0al. (2019). Stochastic prediction of multi-agent interactions from partial observations. arXiv preprint arXiv:1902.09641."},{"key":"6648_CR44","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., et\u00a0al. (2017). Attention is all you need. Advances in neural information processing systems 30."},{"key":"6648_CR45","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., et\u00a0al. (2017). Graph attention networks. arXiv preprint arXiv:1710.10903."},{"key":"6648_CR46","doi-asserted-by":"crossref","unstructured":"Vemula, A., Muelling, K., & Oh, J. (2018). Social attention: Modeling attention in human crowds. In: 2018 IEEE international Conference on Robotics and Automation (ICRA), IEEE, pp 4601\u20134607.","DOI":"10.1109\/ICRA.2018.8460504"},{"key":"6648_CR47","doi-asserted-by":"crossref","unstructured":"Yeh, R. A., Schwing, A. G., Huang, J., et\u00a0al. (2019). Diverse generation for multi-agent sports games. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 4610\u20134619.","DOI":"10.1109\/CVPR.2019.00474"},{"key":"6648_CR48","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Weng, X., Ou, Y., et\u00a0al. (2021). Agentformer: Agent-aware transformers for socio-temporal multi-agent forecasting. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp 9813\u20139823.","DOI":"10.1109\/ICCV48922.2021.00967"},{"key":"6648_CR49","doi-asserted-by":"crossref","unstructured":"Yue, Y., Lucey, P., Carr, P., et\u00a0al. (2014). Learning fine-grained spatial models for dynamic sports play prediction. In: 2014 IEEE international conference on data mining, IEEE, pp 670\u2013679.","DOI":"10.1109\/ICDM.2014.106"},{"key":"6648_CR50","unstructured":"Zhan, E., Zheng, S., Yue, Y., et\u00a0al. (2019). Generating multi-agent trajectories using programmatic weak supervision. In: International Conference on Learning Representations."},{"key":"6648_CR51","unstructured":"Zhao, H., Gao, J., Lan, T., et\u00a0al. (2021). Tnt: Target-driven trajectory prediction. In: Conference on Robot Learning, PMLR, pp 895\u2013904."}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06648-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-024-06648-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06648-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,18]],"date-time":"2025-02-18T02:01:45Z","timestamp":1739844105000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-024-06648-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,27]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["6648"],"URL":"https:\/\/doi.org\/10.1007\/s10994-024-06648-2","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,27]]},"assertion":[{"value":"8 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"38"}}