{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T19:02:25Z","timestamp":1774983745652,"version":"3.50.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62032003, 62425203"],"award-info":[{"award-number":["62032003, 62425203"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing Natural Science Foundation","award":["L212032"],"award-info":[{"award-number":["L212032"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,2,10]]},"abstract":"<jats:p>En Route Travel Time Estimation (ER-TTE) aims to learn driving patterns from traveled routes to achieve rapid and accurate real-time predictions. However, existing methods ignore the complexity and dynamism of real-world traffic systems, resulting in significant gaps in efficiency and accuracy in real-time scenarios. Addressing this issue is a critical yet challenging task. This paper proposes a novel framework that redefines the implementation path of ER-TTE to achieve highly efficient and effective predictions. Firstly, we introduce a novel pipeline consisting of a Decision Maker and a Predictor to rectify the inefficient prediction strategies of current methods. The Decision Maker performs efficient real-time decisions to determine whether the high-complexity prediction model in the Predictor needs to be invoked, and the Predictor recalculates the travel time or infers from historical prediction results based on these decisions. Next, to tackle the dynamic and uncertain real-time scenarios, we model the online decision-making problem as a Markov decision process and design an intelligent agent based on reinforcement learning for autonomous decision-making. Moreover, to fully exploit the spatio-temporal correlation between online data and offline data, we meticulously design feature representation and encoding techniques based on the attention mechanism. Finally, to improve the flawed training and evaluation strategies of existing methods, we propose an end-to-end training and evaluation approach, incorporating curriculum learning strategies to manage spatio-temporal data for more advanced training algorithms. Extensive evaluations on three real-world datasets confirm that our method significantly outperforms state-of-the-art solutions in both accuracy and efficiency.<\/jats:p>","DOI":"10.1145\/3709721","type":"journal-article","created":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T15:45:06Z","timestamp":1739288706000},"page":"1-26","source":"Crossref","is-referenced-by-count":3,"title":["RLER-TTE: An Efficient and Effective Framework for En Route Travel Time Estimation with Reinforcement Learning"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8896-4222","authenticated-orcid":false,"given":"Zhihan","family":"Zheng","sequence":"first","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6721-065X","authenticated-orcid":false,"given":"Haitao","family":"Yuan","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0476-6174","authenticated-orcid":false,"given":"Minxiao","family":"Chen","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7245-1298","authenticated-orcid":false,"given":"Shangguang","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2025,2,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2024. https:\/\/www.tianqi5.cn\/lishitianqi\/"},{"key":"e_1_2_1_2_1","unstructured":"2024. OpenStreetMap. https:\/\/www.openstreetmap.org"},{"key":"e_1_2_1_3_1","first-page":"1","article-title":"A Neural Approach to Spatio-Temporal Data Release with User-Level Differential Privacy","volume":"1","author":"Ahuja Ritesh","year":"2023","unstructured":"Ritesh Ahuja, Sepanta Zeighami, Gabriel Ghinita, and Cyrus Shahabi. 2023. A Neural Approach to Spatio-Temporal Data Release with User-Level Differential Privacy. In SIGMOD, Vol. 1. 21:1--21:25.","journal-title":"SIGMOD"},{"key":"e_1_2_1_4_1","volume-title":"On Map-Matching Vehicle Tracking Data","author":"Brakatsoulas Sotiris","unstructured":"Sotiris Brakatsoulas, Dieter Pfoser, Randall Salas, and Carola Wenk. 2005. On Map-Matching Vehicle Tracking Data. In VLDB, Klemens B\u00f6hm, Christian S. Jensen, Laura M. Haas, Martin L. Kersten, Per-\u00c5ke Larson, and Beng Chin Ooi (Eds.). ACM, 853--864."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3627673.3679567"},{"key":"e_1_2_1_6_1","volume-title":"IJCAI, Luc De Raedt (Ed.). ijcai.org","author":"Fan Yu","year":"2023","unstructured":"Yu Fan, Jiajie Xu, Rui Zhou, Jianxin Li, Kai Zheng, Lu Chen, and Chengfei Liu. 2022. MetaER-TTE: An Adaptive Meta-learning Model for En Route Travel Time Estimation. In IJCAI, Luc De Raedt (Ed.). ijcai.org, 2023--2029."},{"key":"e_1_2_1_7_1","volume-title":"SSML: Self-Supervised Meta-Learner for En Route Travel Time Estimation at Baidu Maps","author":"Fang Xiaomin","year":"2021","unstructured":"Xiaomin Fang, Jizhou Huang, Fan Wang, Lihang Liu, Yibo Sun, and Haifeng Wang. 2021. SSML: Self-Supervised Meta-Learner for En Route Travel Time Estimation at Baidu Maps. In SIGKDD, Feida Zhu, Beng Chin Ooi, and Chunyan Miao (Eds.). ACM, 2840--2848."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403320"},{"key":"e_1_2_1_9_1","volume-title":"ICML (Proceedings of Machine Learning Research","volume":"1135","author":"Finn Chelsea","year":"2017","unstructured":"Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In ICML (Proceedings of Machine Learning Research, Vol. 70), Doina Precup and Yee Whye Teh (Eds.). PMLR, 1126--1135."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403386"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939754"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Jindong Han Hao Liu Shui Liu Xi Chen Naiqiang Tan Hua Chai and Hui Xiong. 2023. iETA: A Robust and Scalable Incremental Learning Framework for Time-of-Arrival Estimation. In SIGKDD Ambuj K. Singh Yizhou Sun Leman Akoglu Dimitrios Gunopulos Xifeng Yan Ravi Kumar Fatma Ozcan and Jieping Ye (Eds.). ACM 4100--4111.","DOI":"10.1145\/3580305.3599842"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2888561"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2016.7498433"},{"key":"e_1_2_1_15_1","volume-title":"Towards Effective Next POI Prediction: Spatial and Semantic Augmentation with Remote Sensing Data","author":"Jiang Nan","unstructured":"Nan Jiang, Haitao Yuan, Jianing Si, Minxiao Chen, and ShangguangWang. 2024. Towards Effective Next POI Prediction: Spatial and Semantic Augmentation with Remote Sensing Data. In ICDE. IEEE, 5061--5074."},{"key":"e_1_2_1_16_1","volume-title":"A Unified Neural Network Approach for Estimating Travel Time and Distance for a Taxi Trip. CoRR abs\/1710.04350","author":"Jindal Ishan","year":"2017","unstructured":"Ishan Jindal, Zhiwei (Tony) Qin, Xue-wen Chen, Matthew S. Nokleby, and Jieping Ye. 2017. A Unified Neural Network Approach for Estimating Travel Time and Distance for a Taxi Trip. CoRR abs\/1710.04350 (2017)."},{"key":"e_1_2_1_17_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR, Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220033"},{"key":"e_1_2_1_19_1","first-page":"1","article-title":"Origin-Destination Travel Time Oracle for Map-based Services","volume":"1","author":"Lin Yan","year":"2023","unstructured":"Yan Lin, HuaiyuWan, Jilin Hu, Shengnan Guo, Bin Yang, Youfang Lin, and Christian S. Jensen. 2023. Origin-Destination Travel Time Oracle for Map-based Services. In SIGMOD, Vol. 1. 217:1--217:27.","journal-title":"SIGMOD"},{"key":"e_1_2_1_20_1","first-page":"2541","article-title":"An Efficient Hierarchical-Reduction Architecture for Aggregation in Route Travel Time Estimation","volume":"34","author":"Liu Zhao","year":"2023","unstructured":"Zhao Liu, Mengquan Li, Mincan Li, Lei Liao, and Kenli Li. 2023. An Efficient Hierarchical-Reduction Architecture for Aggregation in Route Travel Time Estimation. In TPDS, Vol. 34. 2541--2552.","journal-title":"TPDS"},{"key":"e_1_2_1_21_1","volume-title":"STAN: Spatio-Temporal Attention Network for Next Location Recommendation","author":"Luo Yingtao","year":"2021","unstructured":"Yingtao Luo, Qiang Liu, and Zhaocheng Liu. 2021. STAN: Spatio-Temporal Attention Network for Next Location Recommendation. In WWW, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM \/ IW3C2, 2177--2185."},{"key":"e_1_2_1_22_1","volume-title":"Asynchronous Methods for Deep Reinforcement Learning. In ICML (JMLR Workshop and Conference Proceedings","volume":"1937","author":"Mnih Volodymyr","year":"2016","unstructured":"Volodymyr Mnih, Adri\u00e0 Puigdom\u00e8nech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous Methods for Deep Reinforcement Learning. In ICML (JMLR Workshop and Conference Proceedings, Vol. 48), Maria-Florina Balcan and Kilian Q. Weinberger (Eds.). JMLR.org, 1928--1937."},{"key":"e_1_2_1_23_1","volume-title":"CoRR","author":"Schulman John","unstructured":"John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. In CoRR, Vol. abs\/1707.06347."},{"key":"e_1_2_1_24_1","volume-title":"Li","author":"Tan Cheng","year":"2023","unstructured":"Cheng Tan, Zhangyang Gao, Lirong Wu, Yongjie Xu, Jun Xia, Siyuan Li, and Stan Z. Li. 2023. Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning. In CVPR. IEEE, 18770--18782."},{"key":"e_1_2_1_25_1","first-page":"2957","article-title":"DeepTRANS: A Deep Learning System for Public Bus Travel Time Estimation using Traffic Forecasting","volume":"13","author":"Tran Luan V.","year":"2020","unstructured":"Luan V. Tran, Minyoung Mun, Matthew Lim, Jonah Yamato, Nathan Huh, and Cyrus Shahabi. 2020. DeepTRANS: A Deep Learning System for Public Bus Travel Time Estimation using Traffic Forecasting. In VLDB, Vol. 13. 2957--2960.","journal-title":"VLDB"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247617"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_2_1_28_1","first-page":"38","article-title":"Online Learning Solutions for Freeway Travel Time Prediction","volume":"9","author":"van Lint J. W. C.","year":"2008","unstructured":"J. W. C. van Lint. 2008. Online Learning Solutions for Freeway Travel Time Prediction. In TITS, Vol. 9. 38--47.","journal-title":"TITS"},{"key":"e_1_2_1_29_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is All you Need. In NIPS. 5998--6008."},{"key":"e_1_2_1_30_1","first-page":"15716","article-title":"Fine-Grained Trajectory-Based Travel Time Estimation for Multi-City Scenarios Based on Deep Meta-Learning","volume":"23","author":"Wang Chenxing","year":"2022","unstructured":"Chenxing Wang, Fang Zhao, Haichao Zhang, Haiyong Luo, Yanjun Qin, and Yuchen Fang. 2022. Fine-Grained Trajectory-Based Travel Time Estimation for Multi-City Scenarios Based on Deep Meta-Learning. In TITS, Vol. 23. 15716--15728.","journal-title":"TITS"},{"key":"e_1_2_1_31_1","volume-title":"When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks","author":"Zhang Junbo","unstructured":"DongWang, Junbo Zhang,Wei Cao, Jian Li, and Yu Zheng. 2018. When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks. In AAAI, Sheila A. McIlraith and Kilian Q. Weinberger (Eds.). AAAI Press, 2500--2507."},{"key":"e_1_2_1_32_1","first-page":"1","article-title":"A Simple Baseline for Travel Time Estimation using Large-scale Trip Data","volume":"10","author":"Wang Hongjian","year":"2019","unstructured":"Hongjian Wang, Xianfeng Tang, Yu-Hsuan Kuo, Daniel Kifer, and Zhenhui Li. 2019. A Simple Baseline for Travel Time Estimation using Large-scale Trip Data. In TITS, Vol. 10. 19:1--19:22.","journal-title":"TITS"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3574245.3574277"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623656"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219900"},{"key":"e_1_2_1_36_1","volume-title":"Addressing the Need for Map-Matching Speed: Localizing Globalb Curve-Matching Algorithms","author":"Salas Randall","unstructured":"CarolaWenk, Randall Salas, and Dieter Pfoser. 2006. Addressing the Need for Map-Matching Speed: Localizing Globalb Curve-Matching Algorithms. In SSDBM. IEEE Computer Society, 379--388."},{"key":"e_1_2_1_37_1","first-page":"1","article-title":"AutoCTS: Joint Neural Architecture and Hyperparameter Search for Correlated Time Series Forecasting","volume":"1","author":"Wu Xinle","year":"2023","unstructured":"Xinle Wu, Dalin Zhang, Miao Zhang, Chenjuan Guo, Bin Yang, and Christian S. Jensen. 2023. AutoCTS: Joint Neural Architecture and Hyperparameter Search for Correlated Time Series Forecasting. In SIGMOD, Vol. 1. 97:1--97:26.","journal-title":"SIGMOD"},{"key":"e_1_2_1_38_1","first-page":"1605","article-title":"Nuhuo: An Effective Estimation Model for Traffic Speed Histogram Imputation on A Road Network","volume":"17","author":"Yuan Haitao","year":"2024","unstructured":"Haitao Yuan, Gao Cong, and Guoliang Li. 2024. Nuhuo: An Effective Estimation Model for Traffic Speed Histogram Imputation on A Road Network. In VLDB, Vol. 17. 1605--1617.","journal-title":"VLDB"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00115"},{"key":"e_1_2_1_40_1","first-page":"63","article-title":"A Survey of Traffic Prediction: from Spatio-Temporal Data to Intelligent Transportation. Data Sci","volume":"6","author":"Yuan Haitao","year":"2021","unstructured":"Haitao Yuan and Guoliang Li. 2021. A Survey of Traffic Prediction: from Spatio-Temporal Data to Intelligent Transportation. Data Sci. Eng. 6, 1 (2021), 63--85.","journal-title":"Eng."},{"key":"e_1_2_1_41_1","first-page":"393","article-title":"Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity","volume":"16","author":"Yuan Haitao","year":"2022","unstructured":"Haitao Yuan, Guoliang Li, and Zhifeng Bao. 2022. Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity. In VLDB, Vol. 16. 393--405.","journal-title":"VLDB"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389771"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00037"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Hanyuan Zhang Hao Wu Weiwei Sun and Baihua Zheng. 2018. DeepTravel: a Neural Network Based Travel Time Estimation Model with Auxiliary Supervision. In IJCAI J\u00e9r\u00f4me Lang (Ed.). ijcai.org 3655--3661.","DOI":"10.24963\/ijcai.2018\/508"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432192"},{"key":"e_1_2_1_46_1","first-page":"6910","article-title":"A Hybrid Deep Learning Model With Attention-Based Conv-LSTM Networks for Short-Term Traffic Flow Prediction","volume":"22","author":"Zheng Haifeng","year":"2021","unstructured":"Haifeng Zheng, Feng Lin, Xinxin Feng, and Youjia Chen. 2021. A Hybrid Deep Learning Model With Attention-Based Conv-LSTM Networks for Short-Term Traffic Flow Prediction. In TITS, Vol. 22. 6910--6920.","journal-title":"TITS"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709721","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3709721","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:22:29Z","timestamp":1774981349000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709721"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2,10]]}},"alternative-id":["10.1145\/3709721"],"URL":"https:\/\/doi.org\/10.1145\/3709721","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,10]]}}}