{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T15:48:02Z","timestamp":1786722482330,"version":"3.56.0"},"reference-count":48,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hong Kong Polytechnic University College of Undergraduate","award":["9-AAE-44"],"award-info":[{"award-number":["9-AAE-44"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Predicting the trajectories of surrounding vehicles is an essential task in autonomous driving, especially in a highway setting, where minor deviations in motion can cause serious road accidents. The future trajectory prediction is often not only based on historical trajectories but also on a representation of the interaction between neighbouring vehicles. Current state-of-the-art methods have extensively utilized RNNs, CNNs and GNNs to model this interaction and predict future trajectories, relying on a very popular dataset known as NGSIM, which, however, has been criticized for being noisy and prone to overfitting issues. Moreover, transformers, which gained popularity from their benchmark performance in various NLP tasks, have hardly been explored in this problem, presumably due to the accumulative errors in their autoregressive decoding nature of time-series forecasting. Therefore, we propose MALS-Net, a Multi-Head Attention-based LSTM Sequence-to-Sequence model that makes use of the transformer\u2019s mechanism without suffering from accumulative errors by utilizing an attention-based LSTM encoder-decoder architecture. The proposed model was then evaluated in BLVD, a more practical dataset without the overfitting issue of NGSIM. Compared to other relevant approaches, our model exhibits state-of-the-art performance for both short and long-term prediction.<\/jats:p>","DOI":"10.3390\/s23010530","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T03:27:44Z","timestamp":1672802864000},"page":"530","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["MALS-Net: A Multi-Head Attention-Based LSTM Sequence-to-Sequence Network for Socio-Temporal Interaction Modelling and Trajectory Prediction"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7228-065X","authenticated-orcid":false,"given":"Fuad","family":"Hasan","sequence":"first","affiliation":[{"name":"Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2667-6423","authenticated-orcid":false,"given":"Hailong","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1109\/TIV.2020.2991952","article-title":"Attention based Vehicle Trajectory Prediction","volume":"6","author":"Messaoud","year":"2021","journal-title":"IEEE Trans. Intell. Vehicles"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., and Savarese, S. (2016, January 18\u201320). Social LSTM: Human Trajectory Prediction in Crowded Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2016.110"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Deo, N., and Trivedi, M.M. (2018, January 18\u201322). Convolutional Social Pooling for Vehicle Trajectory Prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00196"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, R., Li, M., Zhang, P., and Wen, F. (2021, January 1\u20133). Graph Partition Convolution Neural Network for Pedestrian Trajectory Prediction. Proceedings of the 2021 IEEE 33rd International Conference on Tools with Artificial Intelligence (ICTAI), Washington, DC, USA.","DOI":"10.1109\/ICTAI52525.2021.00074"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1109\/TITS.2020.3009762","article-title":"Multi-Vehicle Collaborative Learning for Trajectory Prediction with Spatio-Temporal Tensor Fusion","volume":"23","author":"Wang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, X., Ying, X., and Chuah, M.C. (2019). GRIP++: Enhanced Graph-based Interaction-Aware Trajectory Prediction for Autonomous Driving. arXiv.","DOI":"10.1109\/ITSC.2019.8917228"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1016\/j.neucom.2021.03.024","article-title":"AST-GNN: An Attention-based Spatio-Temporal Graph Neural Network for Interaction-Aware Pedestrian Trajectory Prediction","volume":"445","author":"Zhou","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_8","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. IEEE Adv. Neural Inf. Process. Syst., 5998\u20136008."},{"key":"ref_9","unstructured":"Chen, K., Chen, G., Xu, D., Zhang, L., Huang, Y., and Knoll, A. (2021). NAST: Non-autoregressive Spatial-Temporal Transformer for Time Series Forecasting. arXiv."},{"key":"ref_10","unstructured":"(2022, September 20). Next Generation Simulation (NGSIM), Available online: http:\/\/ops.fhwa.dot.gov\/trafficanalysistools\/ngsim.html."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1016\/j.trb.2017.09.018","article-title":"A Critical Evaluation of the Next Generation Simulation (NGSIM) Vehicle Trajectory Dataset","volume":"105","author":"Coifman","year":"2017","journal-title":"Transp. Res. Part B Methodol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"90","DOI":"10.3141\/2088-10","article-title":"Estimating Acceleration and Lane-Changing Dynamics from Next Generation Simulation Trajectory Data","volume":"2088","author":"Thiemann","year":"2008","journal-title":"Trans. Res. Rec."},{"key":"ref_13","unstructured":"Hamdar, S., and Mahmassani, H. (2008, January 13\u201317). Driver Car-Following Behavior: From Discrete Event Process to Continuous Set of Episodes. Proceedings of the 87th Annual Meeting of the Transportation Research Board, Washington, DC, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"188","DOI":"10.3141\/2088-20","article-title":"Estimating Individual Speed-Spacing Relationship and Assessing Ability of Newell\u2019s Car-following Model to Reproduce Trajectories","volume":"2088","author":"Duret","year":"2008","journal-title":"Trans. Res. Rec."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.trb.2015.06.010","article-title":"Trajectory Data Reconstruction and Simulation-based Validation against Macroscopic Traffic Patterns","volume":"80","author":"Montanino","year":"2015","journal-title":"Trans. Res. Part B"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"391","DOI":"10.3233\/JIFS-179414","article-title":"A Motion Simulation Model for Road Network based Crowdsourced Map Datum","volume":"38","author":"Fei","year":"2020","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Houenou, A., Bonnifait, P., Cherfaoui, V., and Yao, W. (2013, January 3\u20137). Vehicle Trajectory Prediction based on Motion Model and Maneuver Recognition. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696982"},{"key":"ref_18","unstructured":"Elnagar, P. (August, January 29). Prediction of Moving Objects in Dynamic Environments using Kalman Filters. Proceedings of the 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515), Banff, AB, Canada."},{"key":"ref_19","first-page":"1048","article-title":"Trajectory Prediction Algorithm based on Gaussian Mixture Model","volume":"26","author":"Qiao","year":"2015","journal-title":"J. Softw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1109\/TITS.2014.2331758","article-title":"A Self-Adaptive Parameter Selection Trajectory Prediction Approach via Hidden Markov Models","volume":"16","author":"Qiao","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1103\/PhysRevE.62.1805","article-title":"Congested Traffic States in Empirical Observations and Microscopic Simulations","volume":"62","author":"Treiber","year":"2000","journal-title":"Phys. Rev. E"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIV.2018.2804159","article-title":"How Would Surround Vehicles Move? a unified framework for maneuver classification and motion prediction","volume":"3","author":"Deo","year":"2018","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"12050","DOI":"10.1109\/TITS.2021.3109596","article-title":"Human-Machine Cooperative Trajectory Planning and Tracking for Safe Automated Driving","volume":"23","author":"Huang","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9752","DOI":"10.1109\/TVT.2021.3102251","article-title":"Collision-Probability-Aware Human-Machine Cooperative Planning for Safe Automated Driving IEEE Trans","volume":"70","author":"Huang","year":"2021","journal-title":"Veh. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2100211","DOI":"10.1002\/aisy.202100211","article-title":"Human-Like Interactive Behavior Generation for Autonomous Vehicles: A Bayesian Game-Theoretic Approach with Turing Test","volume":"4","author":"Zhang","year":"2022","journal-title":"Adv. Intell. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gomes, I., and Wolf, D. (2022, November 15). A Review on Intention-aware and Interaction-aware Trajectory Prediction for Autonomous Vehicles. TechRxiv 2022, 14. Available online: https:\/\/www.techrxiv.org\/articles\/preprint\/A_Review_on_Intention-aware_and_Interaction-aware_Trajectory_Prediction_for_Autonomous_Vehicles\/19337447\/1.","DOI":"10.36227\/techrxiv.19337447.v1"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tomar, R.S., Verma, S., and Tomar, G.S. (2011, January 7\u20139). SVM Based Trajectory Predictions of Lane Changing Vehicles. Proceedings of the 2011 International Conference on Computational Intelligence and Communication Networks, Gwalior, India.","DOI":"10.1109\/CICN.2011.156"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2643","DOI":"10.1016\/j.patcog.2011.03.001","article-title":"Recursive Projection Twin Support Vector Machine via Within-class Variance Minimization","volume":"44","author":"Chen","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Goli, S.A., Far, B.H., and Fapojuwo, A.O. (2018, January 26\u201330). Vehicle Trajectory Prediction with Gaussian Process Regression in Connected Vehicle Environment. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500614"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_31","unstructured":"Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2016). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1109\/TITS.2011.2157342","article-title":"Comparison of Markov Chain Abstraction and Monte Carlo Simulation for the Safety Assessment of Autonomous Cars","volume":"12","author":"Althoff","year":"2011","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TITS.2006.883115","article-title":"A Multilevel Collision Mitigation Approach\u2014Its Situation Assessment, Decision Making, and Performance Tradeoffs","volume":"7","author":"Hillenbrand","year":"2006","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4267","DOI":"10.1109\/TITS.2021.3052786","article-title":"Toward Safe and Smart Mobility: Energy-Aware Deep Learning for Driving Behavior Analysis and Prediction of Connected Vehicles IEEE Trans","volume":"22","author":"Xing","year":"2021","journal-title":"Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xing, Y., Huang, C., Lv, C., Liu, Y., Wang, H., and Cao, D. (2020). A Personalized Deep Learning Approach for Trajectory Prediction of Connected Vehicles, SAE International.","DOI":"10.4271\/2020-01-0759"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., and Alahi, A. (2018, January 18\u201323). Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00240"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Mo, X., Xing, Y., and Lv, C. (2020, January 18\u201321). Interaction-Aware Trajectory Prediction of Connected Vehicles using CNN-LSTM Networks. Proceedings of the IECON 2020 The 46th Annual Conference of the IEEE Industrial Electronics Society, Singapore.","DOI":"10.1109\/IECON43393.2020.9255162"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, P., Ouyang, W., Zhang, P., Xue, J., and Zheng, N. (2019). SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction. arXiv.","DOI":"10.1109\/CVPR.2019.01236"},{"key":"ref_39","first-page":"507","article-title":"Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction","volume":"Volume 12357","author":"Yu","year":"2020","journal-title":"European Conference on Computer Vision"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Pang, Y., Zhao, X., Hu, J., Yan, H., and Liu, Y. (2022, September 30). Bayesian Spatio-Temporal Graph Transformer Network (B-Star) for Multi-Aircraft Trajectory Prediction. Available online: https:\/\/ssrn.com\/abstract=3981312.","DOI":"10.2139\/ssrn.3981312"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Xue, J., Fang, J., Li, T., Zhang, B., Zhang, P., Ye, Z., and Dou, J. (2019). Blvd: Building a Large-Scale 5D Semantics Benchmark for Autonomous Driving. arXiv.","DOI":"10.1109\/ICRA.2019.8793523"},{"key":"ref_42","unstructured":"Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A. (2018). How Does Batch Normalization Help Optimization?. arXiv."},{"key":"ref_43","first-page":"249","article-title":"Understanding the difficulty of training deep feedforward neural networks","volume":"9","author":"Glorot","year":"2010","journal-title":"J. Mach. Learn. Res. Proc. Track"},{"key":"ref_44","unstructured":"Pascanu, R., Mikolov, T., and Bengio, Y. (2012). On the difficulty of training Recurrent Neural Networks. arXiv."},{"key":"ref_45","unstructured":"Kingma, D.P., and Ba, J. (2012). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Yu, J., Zhou, M., Wang, X., Pu, G., Cheng, C., and Chen, B. (2021). A Dynamic and Static Context-Aware Attention Network for Trajectory Prediction. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10050336"},{"key":"ref_47","unstructured":"Xue, Q., Li, S., Li, X., Zhao, J., and Zhang, W. (2021). Hierarchical motion encoder\u2013decoder network for trajectory forecasting. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Krajewski, R., Bock, J., Kloeker, L., and Eckstein, L. (2018, January 4\u20137). The highD dataset: A drone dataset of naturalistic vehicle trajectories on German highways for validation of highly automated driving systems. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569552"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/530\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T17:57:16Z","timestamp":1760119036000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/530"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,3]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010530"],"URL":"https:\/\/doi.org\/10.3390\/s23010530","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,3]]}}}