{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:16:09Z","timestamp":1750220169403,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T00:00:00Z","timestamp":1666742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Wells Fargo Company through the Membership Program of the MIT-IBM Watson AI Lab"},{"name":"MIT-IBM Watson AI Lab"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,2]]},"DOI":"10.1145\/3533271.3561761","type":"proceedings-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T22:20:22Z","timestamp":1666304422000},"page":"386-393","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Cost-Efficient Reinforcement Learning for Optimal Trade Execution on Dynamic Market Environment"],"prefix":"10.1145","author":[{"given":"Di","family":"Chen","sequence":"first","affiliation":[{"name":"Cornell University, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yada","family":"Zhu","sequence":"additional","affiliation":[{"name":"MIT-IBM Watson AI Lab, IBM Research, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miao","family":"Liu","sequence":"additional","affiliation":[{"name":"IBM Research, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianbo","family":"Li","sequence":"additional","affiliation":[{"name":"Three Bridges Capital, US"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,26]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.21314\/JOR.2001.041"},{"key":"e_1_3_2_1_2_1","volume-title":"Deep Execution - Value and Policy Based Reinforcement Learning for Trading and Beating Market Benchmarks. SSRN Electronic Journal (01","author":"Dab\u00e9rius Kevin","year":"2019","unstructured":"Kevin Dab\u00e9rius , Elvin Granat , and Patrik Karlsson . 2019. Deep Execution - Value and Policy Based Reinforcement Learning for Trading and Beating Market Benchmarks. SSRN Electronic Journal (01 2019 ). https:\/\/doi.org\/10.2139\/ssrn.3374766 10.2139\/ssrn.3374766 Kevin Dab\u00e9rius, Elvin Granat, and Patrik Karlsson. 2019. Deep Execution - Value and Policy Based Reinforcement Learning for Trading and Beating Market Benchmarks. SSRN Electronic Journal (01 2019). https:\/\/doi.org\/10.2139\/ssrn.3374766"},{"key":"e_1_3_2_1_3_1","unstructured":"Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. arXiv preprint arXiv:1801.01290(2018).  Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. arXiv preprint arXiv:1801.01290(2018)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016191"},{"key":"e_1_3_2_1_5_1","volume-title":"Article arXiv:1807.02787 (Jul","author":"Huang Chien\u00a0Yi","year":"2018","unstructured":"Chien\u00a0Yi Huang . 2018. Financial Trading as a Game: A Deep Reinforcement Learning Approach. arXiv e-prints , Article arXiv:1807.02787 (Jul 2018 ), arXiv:1807.02787\u00a0pages. arxiv:1807.02787\u00a0[q-fin.TR] Chien\u00a0Yi Huang. 2018. Financial Trading as a Game: A Deep Reinforcement Learning Approach. arXiv e-prints, Article arXiv:1807.02787 (Jul 2018), arXiv:1807.02787\u00a0pages. arxiv:1807.02787\u00a0[q-fin.TR]"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2014.982278"},{"key":"e_1_3_2_1_7_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).","author":"Kingma P","year":"2014","unstructured":"Diederik\u00a0 P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014). Diederik\u00a0P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5415"},{"key":"e_1_3_2_1_9_1","unstructured":"Timothy\u00a0P Lillicrap Jonathan\u00a0J Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971(2015).  Timothy\u00a0P Lillicrap Jonathan\u00a0J Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971(2015)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/627"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"#cr-split#-e_1_3_2_1_12_1.1","doi-asserted-by":"crossref","unstructured":"Yuriy Nevmyvaka Yi Feng and Michael\u00a0J. Kearns. 2006. Reinforcement learning for optimized trade execution. In ICML. 673-680. https:\/\/doi.org\/10.1145\/1143844.1143929 10.1145\/1143844.1143929","DOI":"10.1145\/1143844.1143929"},{"key":"#cr-split#-e_1_3_2_1_12_1.2","doi-asserted-by":"crossref","unstructured":"Yuriy Nevmyvaka Yi Feng and Michael\u00a0J. Kearns. 2006. Reinforcement learning for optimized trade execution. In ICML. 673-680. https:\/\/doi.org\/10.1145\/1143844.1143929","DOI":"10.1145\/1143844.1143929"},{"key":"e_1_3_2_1_13_1","volume-title":"Franco Ho\u00a0Ting Ling, and Sebastian Jaimungal","author":"Ning Brian","year":"2018","unstructured":"Brian Ning , Franco Ho\u00a0Ting Ling, and Sebastian Jaimungal . 2018 . Double Deep Q-Learning for Optimal Execution . arxiv:1812.06600\u00a0[q-fin.TR] Brian Ning, Franco Ho\u00a0Ting Ling, and Sebastian Jaimungal. 2018. Double Deep Q-Learning for Optimal Execution. arxiv:1812.06600\u00a0[q-fin.TR]"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1203"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1142\/S2382626618500089"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3237383.3237450"},{"key":"e_1_3_2_1_17_1","volume-title":"Reinforcement Learning: An Introduction. A Bradford Book","author":"Sutton S.","year":"2018","unstructured":"Richard\u00a0 S. Sutton and Andrew\u00a0 G. Barto . 2018 . Reinforcement Learning: An Introduction. A Bradford Book , Cambridge, MA , USA. Richard\u00a0S. Sutton and Andrew\u00a0G. Barto. 2018. Reinforcement Learning: An Introduction. A Bradford Book, Cambridge, MA, USA."},{"volume-title":"Market Impact Model Handbook","author":"Torre G.","key":"e_1_3_2_1_18_1","unstructured":"N.\u00a0 G. Torre . 1997. Market Impact Model Handbook . BARRA Inc., Berkeley . N.\u00a0G. Torre. 1997. Market Impact Model Handbook. BARRA Inc., Berkeley."},{"key":"e_1_3_2_1_19_1","volume-title":"International conference on machine learning. 1995\u20132003","author":"Wang Ziyu","year":"2016","unstructured":"Ziyu Wang , Tom Schaul , Matteo Hessel , Hado Hasselt , Marc Lanctot , and Nando Freitas . 2016 . Dueling network architectures for deep reinforcement learning . In International conference on machine learning. 1995\u20132003 . Ziyu Wang, Tom Schaul, Matteo Hessel, Hado Hasselt, Marc Lanctot, and Nando Freitas. 2016. Dueling network architectures for deep reinforcement learning. In International conference on machine learning. 1995\u20132003."},{"key":"e_1_3_2_1_20_1","unstructured":"Haoran Wei Yuanbo Wang Lidia Mangu and Keith Decker. 2019. Model-based reinforcement learning for predictions and control for limit order books. arXiv preprint arXiv:1910.03743(2019).  Haoran Wei Yuanbo Wang Lidia Mangu and Keith Decker. 2019. Model-based reinforcement learning for predictions and control for limit order books. arXiv preprint arXiv:1910.03743(2019)."},{"volume-title":"The Free Encyclopedia","key":"e_1_3_2_1_21_1","unstructured":"Wikipedia. 2021. Stars and bars (combinatorics) \u2014 Wikipedia , The Free Encyclopedia . http:\/\/en.wikipedia.org\/w\/index.php?title=Stars%20and%20bars%20(combinatorics)&oldid=997315407. [Online; accessed 09-January-2021]. Wikipedia. 2021. Stars and bars (combinatorics) \u2014 Wikipedia, The Free Encyclopedia. http:\/\/en.wikipedia.org\/w\/index.php?title=Stars%20and%20bars%20(combinatorics)&oldid=997315407. [Online; accessed 09-January-2021]."},{"key":"e_1_3_2_1_22_1","unstructured":"Zihao Zhang and Stefan Zohren. 2021. Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Units. arxiv:2105.10430\u00a0[cs.LG]  Zihao Zhang and Stefan Zohren. 2021. Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Units. arxiv:2105.10430\u00a0[cs.LG]"}],"event":{"name":"ICAIF '22: 3rd ACM International Conference on AI in Finance","sponsor":["ACM Association for Computing Machinery"],"location":"New York NY USA","acronym":"ICAIF '22"},"container-title":["Proceedings of the Third ACM International Conference on AI in Finance"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533271.3561761","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3533271.3561761","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:39Z","timestamp":1750186839000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533271.3561761"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,26]]},"references-count":23,"alternative-id":["10.1145\/3533271.3561761","10.1145\/3533271"],"URL":"https:\/\/doi.org\/10.1145\/3533271.3561761","relation":{},"subject":[],"published":{"date-parts":[[2022,10,26]]},"assertion":[{"value":"2022-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}