{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T06:59:09Z","timestamp":1760597949308,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,1,17]],"date-time":"2020-01-17T00:00:00Z","timestamp":1579219200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"DiDi Chuxing Inc."},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["CNS-1657350, CMMI-1831140, IIS-1566386, IIS-1755769 and DMS-1555244"],"award-info":[{"award-number":["CNS-1657350, CMMI-1831140, IIS-1566386, IIS-1755769 and DMS-1555244"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2020,2,29]]},"abstract":"<jats:p>Many real-world human behaviors can be modeled and characterized as sequential decision-making processes, such as a taxi driver\u2019s choices of working regions and times. Each driver possesses unique preferences on the sequential choices over time and improves the driver\u2019s working efficiency. Understanding the dynamics of such preferences helps accelerate the learning process of taxi drivers. Prior works on taxi operation management mostly focus on finding optimal driving strategies or routes, lacking in-depth analysis on what the drivers learned during the process and how they affect the performance of the driver. In this work, we make the first attempt to establish Dynamic Human Preference Analytics. We inversely learn the taxi drivers\u2019 preferences from data and characterize the dynamics of such preferences over time. We extract two types of features (i.e., profile features and habit features) to model the decision space of drivers. Then through inverse reinforcement learning, we learn the preferences of drivers with respect to these features. The results illustrate that self-improving drivers tend to keep adjusting their preferences to habit features to increase their earning efficiency while keeping the preferences to profile features invariant. However, experienced drivers have stable preferences over time. The exploring drivers tend to randomly adjust the preferences over time.<\/jats:p>","DOI":"10.1145\/3360312","type":"journal-article","created":{"date-parts":[[2020,4,3]],"date-time":"2020-04-03T22:12:06Z","timestamp":1585951926000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["DHPA"],"prefix":"10.1145","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8390-7147","authenticated-orcid":false,"given":"Menghai","family":"Pan","sequence":"first","affiliation":[{"name":"Worcester Polytechnic Institute"}]},{"given":"Weixiao","family":"Huang","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8972-503X","authenticated-orcid":false,"given":"Yanhua","family":"Li","sequence":"additional","affiliation":[{"name":"Worcester Polytechnic Institute"}]},{"given":"Xun","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Iowa"}]},{"given":"Zhenming","family":"Liu","sequence":"additional","affiliation":[{"name":"College of William 8 Mary"}]},{"given":"Rui","family":"Song","sequence":"additional","affiliation":[{"name":"North Carolina State University"}]},{"given":"Hui","family":"Lu","sequence":"additional","affiliation":[{"name":"Guangzhou University"}]},{"given":"Zhihong","family":"Tian","sequence":"additional","affiliation":[{"name":"Guangzhou University"}]},{"given":"Jun","family":"Luo","sequence":"additional","affiliation":[{"name":"Lenovo Group Limited"}]}],"member":"320","published-online":{"date-parts":[[2020,1,17]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"OpenStreetMap. [n.d.]. Home Page. Retrieved November 23 2019 from http:\/\/www.openstreetmap.org\/  OpenStreetMap. [n.d.]. Home Page. Retrieved November 23 2019 from http:\/\/www.openstreetmap.org\/"},{"key":"e_1_2_1_2_1","volume-title":"Retrieved","author":"Website Project","year":"2019","unstructured":"[n.d.]. Project Website : Dissecting the Learning Curve of Taxi Drivers . Retrieved November 23, 2019 from http:\/\/urban.cs.wpi.edu\/DLCTD\/. [n.d.]. Project Website: Dissecting the Learning Curve of Taxi Drivers. Retrieved November 23, 2019 from http:\/\/urban.cs.wpi.edu\/DLCTD\/."},{"volume-title":"Proceedings of the 21st International Conference on Machine Learning. ACM","author":"Abbeel Pieter","key":"e_1_2_1_3_1","unstructured":"Pieter Abbeel and Andrew Y. Ng . 2004. Apprenticeship learning via inverse reinforcement learning . In Proceedings of the 21st International Conference on Machine Learning. ACM , New York, NY, 1. Pieter Abbeel and Andrew Y. Ng. 2004. Apprenticeship learning via inverse reinforcement learning. In Proceedings of the 21st International Conference on Machine Learning. ACM, New York, NY, 1."},{"key":"e_1_2_1_4_1","first-page":"679","article-title":"A Markovian decision process","volume":"6","author":"Bellman Richard","year":"1957","unstructured":"Richard Bellman . 1957 . A Markovian decision process . Journal of Mathematics and Mechanics 6 , 5 (1957), 679 -- 684 . IUMJAB Richard Bellman. 1957. A Markovian decision process. Journal of Mathematics and Mechanics 6, 5 (1957), 679--684. IUMJAB","journal-title":"Journal of Mathematics and Mechanics"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 182--189","author":"Boularias Abdeslam","year":"2011","unstructured":"Abdeslam Boularias , Jens Kober , and Jan Peters . 2011 . Relative entropy inverse reinforcement learning . In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 182--189 . Abdeslam Boularias, Jens Kober, and Jan Peters. 2011. Relative entropy inverse reinforcement learning. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 182--189."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2016.2623320"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219887"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.153"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078850"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113384"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816726"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0037"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2996913.2996970"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623668"},{"volume-title":"Proceedings of the 17th International Conference on Machine Learning (ICML\u201900)","author":"Andrew","key":"e_1_2_1_15_1","unstructured":"Andrew Y. Ng and Stuart J. Russell. 2000. Algorithms for inverse reinforcement learning . In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900) . 663--670. Andrew Y. Ng and Stuart J. Russell. 2000. Algorithms for inverse reinforcement learning. In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900). 663--670."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611975673.88"},{"key":"e_1_2_1_17_1","first-page":"1","article-title":"Bayesian inverse reinforcement learning","volume":"51","author":"Ramachandran Deepak","year":"2007","unstructured":"Deepak Ramachandran and Eyal Amir . 2007 . Bayesian inverse reinforcement learning . Urbana 51 , 61801 (2007), 1 -- 4 . Deepak Ramachandran and Eyal Amir. 2007. Bayesian inverse reinforcement learning. Urbana 51, 61801 (2007), 1--4.","journal-title":"Urbana"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983689"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 29th International Conference on Data Engineering (ICDE\u201913)","author":"Ma Wolfson S.","year":"2013","unstructured":"Wolfson S. Ma , Y. Zheng . 2013 . A large-scale dynamic taxi ridesharing service . In Proceedings of the 29th International Conference on Data Engineering (ICDE\u201913) . IEEE, Los Alamitos, CA, 410--421. Wolfson S. Ma, Y. Zheng. 2013. A large-scale dynamic taxi ridesharing service. In Proceedings of the 29th International Conference on Data Engineering (ICDE\u201913). IEEE, Los Alamitos, CA, 410--421."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098018"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/19439962.2018.1551257"},{"key":"e_1_2_1_22_1","unstructured":"R. S. Witte and J. S. Witte. 2013. Statistics (10th ed.). John Wiley 8 Sons.  R. S. Witte and J. S. Witte. 2013. Statistics (10th ed.). John Wiley 8 Sons."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939799"},{"volume-title":"Proceedings of the 16th International Conference on Knowledge Discovery and Data Mining. ACM","author":"Ge Y.","key":"e_1_2_1_24_1","unstructured":"Y. Ge , H. Xiong , A. Tuzhilin , K. Xiao , and M. Gruteser . 2010. An energy-efficient mobile recommender system . In Proceedings of the 16th International Conference on Knowledge Discovery and Data Mining. ACM , New York, NY, 899--908. Y. Ge, H. Xiong, A. Tuzhilin, K. Xiao, and M. Gruteser. 2010. An energy-efficient mobile recommender system. In Proceedings of the 16th International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 899--908."},{"volume-title":"Proceedings of the 17th International Conference on Knowledge Discovery and Data Mining. ACM","author":"Ge Y.","key":"e_1_2_1_25_1","unstructured":"Y. Ge , C. Liu , H. Xiong , and J. Chen . 2011. A taxi business intelligence system . In Proceedings of the 17th International Conference on Knowledge Discovery and Data Mining. ACM , New York, NY, 735--738. Y. Ge, C. Liu, H. Xiong, and J. Chen. 2011. A taxi business intelligence system. In Proceedings of the 17th International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 735--738."},{"volume-title":"Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC\u201918)","author":"Yang Zi","key":"e_1_2_1_26_1","unstructured":"Zi Yang , Xinpeng Wang , Xin Pei , Shuo Feng , Dajun Wang , Jianqiang Wang , and S. C. Wong . 2018. Longitudinal safety analysis for heterogeneous platoon of automated and human vehicles . In Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC\u201918) . IEEE, Los Alamitos, CA, 3300--3305. Zi Yang, Xinpeng Wang, Xin Pei, Shuo Feng, Dajun Wang, Jianqiang Wang, and S. C. Wong. 2018. Longitudinal safety analysis for heterogeneous platoon of automated and human vehicles. In Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC\u201918). IEEE, Los Alamitos, CA, 3300--3305."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219822"},{"volume-title":"Proceedings of the 13th International Conference on Ubiquitous Computing. ACM","author":"Yuan J.","key":"e_1_2_1_28_1","unstructured":"J. Yuan , Y. Zheng , L. Zhang , X. Xie , and G. Sun . 2011. Where to find my next passenger . In Proceedings of the 13th International Conference on Ubiquitous Computing. ACM , New York, NY, 109--118. J. Yuan, Y. Zheng, L. Zhang, X. Xie, and G. Sun. 2011. Where to find my next passenger. In Proceedings of the 13th International Conference on Ubiquitous Computing. ACM, New York, NY, 109--118."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219922"},{"volume-title":"Modeling Purposeful Adaptive Behavior with the Principle of Maximum Causal Entropy. Master\u2019s Thesis","author":"Ziebart Brian D.","key":"e_1_2_1_30_1","unstructured":"Brian D. Ziebart . 2010. Modeling Purposeful Adaptive Behavior with the Principle of Maximum Causal Entropy. Master\u2019s Thesis . Carnegie Mellon University . Brian D. Ziebart. 2010. Modeling Purposeful Adaptive Behavior with the Principle of Maximum Causal Entropy. Master\u2019s Thesis. Carnegie Mellon University."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201908)","volume":"8","author":"Ziebart Brian D.","unstructured":"Brian D. Ziebart , Andrew L. Maas , J. Andrew Bagnell , and Anind K. Dey . 2008. Maximum entropy inverse reinforcement learning . In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201908) , Vol. 8 . 1433--1438. Brian D. Ziebart, Andrew L. Maas, J. Andrew Bagnell, and Anind K. Dey. 2008. Maximum entropy inverse reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201908), Vol. 8. 1433--1438."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360312","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3360312","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3360312","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:29Z","timestamp":1750203869000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360312"}},"subtitle":["Dynamic Human Preference Analytics Framework: A Case Study on Taxi Drivers\u2019 Learning Curve Analysis"],"short-title":[],"issued":{"date-parts":[[2020,1,17]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,2,29]]}},"alternative-id":["10.1145\/3360312"],"URL":"https:\/\/doi.org\/10.1145\/3360312","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2020,1,17]]},"assertion":[{"value":"2019-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-01-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}