{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:31:21Z","timestamp":1790703081760,"version":"4.1.0"},"reference-count":34,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,6,5]],"date-time":"2022-06-05T00:00:00Z","timestamp":1654387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52002285"],"award-info":[{"award-number":["52002285"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2020PJD075"],"award-info":[{"award-number":["2020PJD075"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["21ZR1467400"],"award-info":[{"award-number":["21ZR1467400"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["TPD-TC202110-03"],"award-info":[{"award-number":["TPD-TC202110-03"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shanghai Pujiang Program","award":["52002285"],"award-info":[{"award-number":["52002285"]}]},{"name":"Shanghai Pujiang Program","award":["2020PJD075"],"award-info":[{"award-number":["2020PJD075"]}]},{"name":"Shanghai Pujiang Program","award":["21ZR1467400"],"award-info":[{"award-number":["21ZR1467400"]}]},{"name":"Shanghai Pujiang Program","award":["TPD-TC202110-03"],"award-info":[{"award-number":["TPD-TC202110-03"]}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"publisher","award":["52002285"],"award-info":[{"award-number":["52002285"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"publisher","award":["2020PJD075"],"award-info":[{"award-number":["2020PJD075"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"publisher","award":["21ZR1467400"],"award-info":[{"award-number":["21ZR1467400"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"publisher","award":["TPD-TC202110-03"],"award-info":[{"award-number":["TPD-TC202110-03"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Perspective Study Funding of Nanchang Automotive Institute of Intelligence and New Energy","award":["52002285"],"award-info":[{"award-number":["52002285"]}]},{"name":"Perspective Study Funding of Nanchang Automotive Institute of Intelligence and New Energy","award":["2020PJD075"],"award-info":[{"award-number":["2020PJD075"]}]},{"name":"Perspective Study Funding of Nanchang Automotive Institute of Intelligence and New Energy","award":["21ZR1467400"],"award-info":[{"award-number":["21ZR1467400"]}]},{"name":"Perspective Study Funding of Nanchang Automotive Institute of Intelligence and New Energy","award":["TPD-TC202110-03"],"award-info":[{"award-number":["TPD-TC202110-03"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accurate trajectory prediction is an essential task in automated driving, which is achieved by sensing and analyzing the behavior of surrounding vehicles. Although plenty of research works have been invested in this field, it is still a challenging subject due to the environment\u2019s complexity and the driving intention uncertainty. In this paper, we propose a joint learning architecture to incorporate the lane orientation, vehicle interaction, and driving intention in vehicle trajectory forecasting. This work employs a coordinate transform to encode the vehicle trajectory with lane orientation information, which is further incorporated into various interaction models to explore the mutual trajectory relations. Extracted features are applied in a dual-level stochastic choice learning to distinguish the trajectory modality at both the intention and motion levels. By collaborative learning of lane orientation, interaction, and intention, our approach can be applied to both highway and urban scenes. Experiments on the NGSIM, HighD, and Argoverse datasets demonstrate that the proposed method achieves a significant improvement in prediction accuracy compared with the baseline.<\/jats:p>","DOI":"10.3390\/s22114295","type":"journal-article","created":{"date-parts":[[2022,6,5]],"date-time":"2022-06-05T10:47:11Z","timestamp":1654426031000},"page":"4295","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Multi-Modal Vehicle Trajectory Prediction by Collaborative Learning of Lane Orientation, Vehicle Interaction, and Intention"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5085-7219","authenticated-orcid":false,"given":"Wei","family":"Tian","sequence":"first","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Songtao","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zehan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingzhi","family":"Wu","sequence":"additional","affiliation":[{"name":"Nanchang Automotive Institute of Intelligence & New Energy, Nanchang 330044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sihong","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Bi","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Trabelsi, R., Khemmar, R., Decoux, B., Ertaud, J.-Y., and Butteau, R. (2022). Recent Advances in Vision-Based On-Road Behaviors Understanding: A Critical Survey. Sensors, 22.","DOI":"10.3390\/s22072654"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., and Savarese, S. (2016, January 27\u201330). Social lstm: Human trajectory prediction in crowded spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.110"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Deo, N., and Trivedi, M.M. (2018, January 18\u201322). Convolutional social pooling for vehicle trajectory prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00196"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gupta, A., Johnson, J., Li, F.F., Savarese, S., and Alahi, A. (2018, January 18\u201323). Social gan: Socially acceptable trajectories with generative adversarial networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00240"},{"key":"ref_5","first-page":"1","article-title":"An improved real-time slip model identification method for autonomous tracked vehicles using forward trajectory prediction compensation","volume":"70","author":"Qin","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gao, J., Sun, C., Zhao, H., Shen, Y., Anguelov, D., Li, C., and Schmid, C. (2020, January 13\u201319). Vectornet: Encoding hd maps and agent dynamics from vectorized representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01154"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhao, T., Xu, Y., Monfort, M., Choi, W., Baker, C., Zhao, Y., Wang, Y., and Wu, Y.N. (2019, January 15\u201320). Multi-agent tensor fusion for contextual trajectory prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01240"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vemula, A., Muelling, K., and Oh, J. (2018, January 21\u201325). Social attention: Modeling attention in human crowds. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460504"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, P., Ouyang, W., Zhang, P., Xue, J., and Zheng, N. (2019, January 15\u201320). Sr-lstm: State refinement for lstm towards pedestrian trajectory prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01236"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhou, L., Zhao, Y., Yang, D., and Liu, J. (2022). Gchgat: Pedestrian trajectory prediction using group constrained hierarchical graph attention networks. Appl. Intell., 1573\u20137497.","DOI":"10.1007\/s10489-021-02997-w"},{"key":"ref_11","unstructured":"Saeed, T.U. (2019). Road infrastructure readiness for autonomous vehicles. [Ph.D. Thesis, Purdue University Graduate School]."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"06020003","DOI":"10.1061\/(ASCE)IS.1943-555X.0000593","article-title":"Preparing road infrastructure to accommodate connected and automated vehicles: System-level perspective","volume":"27","author":"Saeed","year":"2020","journal-title":"J. Infrastruct. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Park, S.H., Lee, G., Seo, J., Bhat, M., Kang, M., Francis, J., Jadhav, A., Liang, P.P., and Morency, L.P. (2020). Diverse and admissible trajectory forecasting through multimodal context understanding. European Conference on Computer Vision (ECCV), Springer.","DOI":"10.1007\/978-3-030-58621-8_17"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cui, H., Nguyen, T., Chou, F.C., Lin, T.H., Schneider, J., Bradley, D., and Djuric, N. (2019). Deep kinematic models for physically realistic prediction of vehicle trajectories. arXiv.","DOI":"10.1109\/ICRA40945.2020.9197560"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cui, H., Radosavljevic, V., Chou, F.C., Lin, T.H., Nguyen, T., Huang, T.K., Schneider, J., and Djuric, N. (2019, January 20\u201324). Multimodal trajectory predictions for autonomous driving using deep convolutional networks. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793868"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Djuric, N., Radosavljevic, V., Cui, H., Nguyen, T., Chou, F.C., Lin, T.H., Singh, N., and Schneider, J. (2020, January 1\u20135). Uncertainty-aware short-term motion prediction of traffic actors for autonomous driving. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Snowmass, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093332"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yalamanchi, S., Huang, T.K., Haynes, G.C., and Djuric, N. (2020, January 20\u201323). Long-term prediction of vehicle behavior using short-term uncertaintyaware trajectories and high-definition maps. Proceedings of the IEEE International Conference on Intelligent Transportation Systems (ITSC), Rhodes, Greece.","DOI":"10.1109\/ITSC45102.2020.9294553"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Luo, C., Sun, L., Dabiri, D., and Yuille, A. (2020\u201324, January 24). Probabilistic multi-modal trajectory prediction with lane attention for autonomous vehicles. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341034"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4907","DOI":"10.1109\/LRA.2021.3068919","article-title":"Trajectory prediction in autonomous driving with a lane heading auxiliary loss","volume":"6","author":"Greer","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hu, Y., Zhan, W., and Tomizuka, M. (2018, January 4\u20137). A framework for probabilistic generic traffic scene prediction. Proceedings of the IEEE International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569943"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5089","DOI":"10.1109\/LRA.2020.3005369","article-title":"Diversitygan: Diversity-aware vehicle motion prediction via latent semantic sampling","volume":"5","author":"Huang","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_22","first-page":"2119","article-title":"Stochastic multiple choice learning for training diverse deep ensembles","volume":"29","author":"Lee","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhou, S., Huang, Y., and Tian, W. (2020, January 20\u201323). Dsmcl: Dual-level stochastic multiple choice learning for multi-modal trajectory prediction. Proceedings of the IEEE International Conference on Intelligent Transportation Systems (ITSC), Rhodes, Greece.","DOI":"10.1109\/ITSC45102.2020.9294420"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Park, S.H., Kim, B.D., Kang, C.M., Chung, C.C., and Choi, J.W. (2018, January 26\u201330). Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM encoder\u2013decoder Architecture. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500658"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1016\/j.trb.2017.09.018","article-title":"A critical evaluation of the Next Generation Simulation (NGSIM) vehicle trajectory dataset","volume":"105","author":"Coifman","year":"2017","journal-title":"Transp. Part B-Methodol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Krajewski, R., Bock, J., Kloeker, L., and Eckstein, L. (2018, January 4\u20137). The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems. Proceedings of the IEEE International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569552"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chang, M.F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., and Ramanan, D. (2019, January 15\u201320). Argoverse: 3d tracking and forecasting with rich maps. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00895"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1103\/PhysRevE.62.1805","article-title":"Congested traffic states in empirical observations and microscopic simulations","volume":"62","author":"Treiber","year":"2000","journal-title":"Phys. Rev. E"},{"key":"ref_30","first-page":"15424","article-title":"Multiple futures prediction","volume":"32","author":"Tang","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zeng, W., Liang, M., Liao, R., and Urtasun, R. (October, January 27). LaneRCNN: Distributed Representations for Graph-Centric Motion Forecasting. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636035"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gilles, T., Sabatini, S., Tsishkou, D., Stanciulescu, B., and Moutarde, F. (2021, January 19\u201322). HOME: Heatmap Output for future Motion Estimation. Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA.","DOI":"10.1109\/ITSC48978.2021.9564944"},{"key":"ref_33","unstructured":"Khandelwal, S., Qi, W., Singh, J., Hartnett, A., and Ramanan, D. (2020). What-if motion prediction for autonomous driving. arXiv."},{"key":"ref_34","unstructured":"Ngiam, J., Caine, B., Vasudevan, V., Zhang, Z., Chiang, H.-T.L., Ling, J., Roelofs, R., Bewley, A., Liu, C., and Venugopal, A. (2022, January 17\u201323). Scene Transformer: A unified multi-task model for behavior prediction and planning. Proceedings of the International Conference on Machine Learning, Baltimore, MD, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4295\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:24:44Z","timestamp":1760138684000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4295"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,5]]},"references-count":34,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114295"],"URL":"https:\/\/doi.org\/10.3390\/s22114295","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,5]]}}}