{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:20:49Z","timestamp":1780471249267,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,3]],"date-time":"2021-11-03T00:00:00Z","timestamp":1635897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,3]]},"DOI":"10.1145\/3490354.3494403","type":"proceedings-article","created":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T03:50:06Z","timestamp":1651722606000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Learning FX trading strategies with FQI and persistent actions"],"prefix":"10.1145","author":[{"given":"Antonio","family":"Riva","sequence":"first","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lorenzo","family":"Bisi","sequence":"additional","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pierre","family":"Liotet","sequence":"additional","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Sabbioni","sequence":"additional","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edoardo","family":"Vittori","sequence":"additional","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Pinciroli","sequence":"additional","affiliation":[{"name":"Intesa Sanpaolo"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michele","family":"Trapletti","sequence":"additional","affiliation":[{"name":"Intesa Sanpaolo"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcello","family":"Restelli","sequence":"additional","affiliation":[{"name":"Politecnico di Milano"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,5,4]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"The adaptive markets hypothesis. The journal of portfolio management 30, 5","author":"Andrew W","year":"2004","unstructured":"W Andrew . 2004. Lo. The adaptive markets hypothesis. The journal of portfolio management 30, 5 ( 2004 ), 15--29. W Andrew. 2004. Lo. The adaptive markets hypothesis. The journal of portfolio management 30, 5 (2004), 15--29."},{"key":"e_1_3_2_1_2_1","volume-title":"Idiosyncrasies and challenges of data driven learning in electronic trading. arXiv preprint arXiv:1811.09549","author":"Bacoyannis Vangelis","year":"2018","unstructured":"Vangelis Bacoyannis , Vacslav Glukhov , Tom Jin , Jonathan Kochems , and Doo Re Song . 2018. Idiosyncrasies and challenges of data driven learning in electronic trading. arXiv preprint arXiv:1811.09549 ( 2018 ). Vangelis Bacoyannis, Vacslav Glukhov, Tom Jin, Jonathan Kochems, and Doo Re Song. 2018. Idiosyncrasies and challenges of data driven learning in electronic trading. arXiv preprint arXiv:1811.09549 (2018)."},{"key":"e_1_3_2_1_3_1","volume-title":"Sur les op\u00e9rations dans les ensembles abstraits et leur application aux \u00e9quations int\u00e9grales. Fund. math 3, 1","author":"Banach Stefan","year":"1922","unstructured":"Stefan Banach . 1922. Sur les op\u00e9rations dans les ensembles abstraits et leur application aux \u00e9quations int\u00e9grales. Fund. math 3, 1 ( 1922 ), 133--181. Stefan Banach. 1922. Sur les op\u00e9rations dans les ensembles abstraits et leur application aux \u00e9quations int\u00e9grales. Fund. math 3, 1 (1922), 133--181."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383455.3422571"},{"key":"e_1_3_2_1_5_1","volume-title":"Risk-Averse Trust Region Optimization for Reward-Volatility Reduction. In 29th International Joint Conference on Artificial Intelligence, IJCAI","author":"Bisi L","year":"2020","unstructured":"L Bisi , L Sabbioni , E Vittori , M Papini , and M Restelli . 2020 . Risk-Averse Trust Region Optimization for Reward-Volatility Reduction. In 29th International Joint Conference on Artificial Intelligence, IJCAI 2020. 4583--4589. L Bisi, L Sabbioni, E Vittori, M Papini, and M Restelli. 2020. Risk-Averse Trust Region Optimization for Reward-Volatility Reduction. In 29th International Joint Conference on Artificial Intelligence, IJCAI 2020. 4583--4589."},{"key":"e_1_3_2_1_6_1","volume-title":"Theory of financial risk and derivative pricing: from statistical physics to risk management","author":"Bouchaud Jean-Philippe","unstructured":"Jean-Philippe Bouchaud and Marc Potters . 2003. Theory of financial risk and derivative pricing: from statistical physics to risk management . Cambridge university press . Jean-Philippe Bouchaud and Marc Potters. 2003. Theory of financial risk and derivative pricing: from statistical physics to risk management. Cambridge university press."},{"key":"e_1_3_2_1_7_1","volume-title":"Classification and regression trees","author":"Breiman Leo","unstructured":"Leo Breiman , Jerome Friedman , Charles J Stone , and Richard A Olshen . 1984. Classification and regression trees . CRC press . Leo Breiman, Jerome Friedman, Charles J Stone, and Richard A Olshen. 1984. Classification and regression trees. CRC press."},{"key":"e_1_3_2_1_8_1","volume-title":"Deep Reinforcement Learning for Active High Frequency Trading. arXiv preprint arXiv:2101.07107","author":"Briola Antonio","year":"2021","unstructured":"Antonio Briola , Jeremy Turiel , Riccardo Marcaccioli , and Tomaso Aste . 2021. Deep Reinforcement Learning for Active High Frequency Trading. arXiv preprint arXiv:2101.07107 ( 2021 ). Antonio Briola, Jeremy Turiel, Riccardo Marcaccioli, and Tomaso Aste. 2021. Deep Reinforcement Learning for Active High Frequency Trading. arXiv preprint arXiv:2101.07107 (2021)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2018.09.017"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.17578\/6-2-1"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.935088"},{"key":"e_1_3_2_1_12_1","volume-title":"Scaling behaviors in differently developed markets. Physica A: Statistical Mechanics and its Applications 324, 1--2","author":"Matteo Tiziana Di","year":"2003","unstructured":"Tiziana Di Matteo , Tomaso Aste , and Michel M Dacorogna . 2003. Scaling behaviors in differently developed markets. Physica A: Statistical Mechanics and its Applications 324, 1--2 ( 2003 ), 183--188. Tiziana Di Matteo, Tomaso Aste, and Michel M Dacorogna. 2003. Scaling behaviors in differently developed markets. Physica A: Statistical Mechanics and its Applications 324, 1--2 (2003), 183--188."},{"key":"e_1_3_2_1_14_1","first-page":"503","article-title":"Tree-based batch mode reinforcement learning","author":"Ernst Damien","year":"2005","unstructured":"Damien Ernst , Pierre Geurts , and Louis Wehenkel . 2005 . Tree-based batch mode reinforcement learning . Journal of Machine Learning Research 6 , Apr (2005), 503 -- 556 . Damien Ernst, Pierre Geurts, and Louis Wehenkel. 2005. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research 6, Apr (2005), 503--556.","journal-title":"Journal of Machine Learning Research 6"},{"key":"e_1_3_2_1_16_1","unstructured":"Matthieu Garcin. 2019. Fractal analysis of the multifractality of foreign exchange rates. (2019).  Matthieu Garcin. 2019. Fractal analysis of the multifractality of foreign exchange rates. (2019)."},{"key":"e_1_3_2_1_17_1","volume-title":"Extremely randomized trees. Machine learning 63, 1","author":"Geurts Pierre","year":"2006","unstructured":"Pierre Geurts , Damien Ernst , and Louis Wehenkel . 2006. Extremely randomized trees. Machine learning 63, 1 ( 2006 ), 3--42. Pierre Geurts, Damien Ernst, and Louis Wehenkel. 2006. Extremely randomized trees. Machine learning 63, 1 (2006), 3--42."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIFER.2003.1196283"},{"key":"e_1_3_2_1_19_1","unstructured":"HistData.com. [n.d.]. Free Forex Historical Data. https:\/\/www.histdata.com\/download-free-forex-data\/  HistData.com. [n.d.]. Free Forex Historical Data. https:\/\/www.histdata.com\/download-free-forex-data\/"},{"key":"e_1_3_2_1_20_1","volume-title":"Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy. In ICAIF '20: ACM International Conference on AI in Finance.","author":"Hongyang Yang","year":"2020","unstructured":"Yang Hongyang , Liu Xiao-Yang , Zhong Shan , and Walid Anwar . 2020 . Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy. In ICAIF '20: ACM International Conference on AI in Finance. Yang Hongyang, Liu Xiao-Yang, Zhong Shan, and Walid Anwar. 2020. Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy. In ICAIF '20: ACM International Conference on AI in Finance."},{"key":"e_1_3_2_1_21_1","volume-title":"Financial trading as a game: A deep reinforcement learning approach. arXiv preprint arXiv:1807.02787","author":"Huang Chien Yi","year":"2018","unstructured":"Chien Yi Huang . 2018. Financial trading as a game: A deep reinforcement learning approach. arXiv preprint arXiv:1807.02787 ( 2018 ). Chien Yi Huang. 2018. Financial trading as a game: A deep reinforcement learning approach. arXiv preprint arXiv:1807.02787 (2018)."},{"key":"e_1_3_2_1_22_1","volume-title":"Deep Reinforcement Learning for Asset Allocation in US Equities. CompSciRN: Other Machine Learning (Topic)","author":"Alonso Miquel Noguer","year":"2020","unstructured":"Miquel Noguer i Alonso and Sonam Srivastava . 2020. Deep Reinforcement Learning for Asset Allocation in US Equities. CompSciRN: Other Machine Learning (Topic) ( 2020 ). Miquel Noguer i Alonso and Sonam Srivastava. 2020. Deep Reinforcement Learning for Asset Allocation in US Equities. CompSciRN: Other Machine Learning (Topic) (2020)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2005.10.009"},{"key":"e_1_3_2_1_24_1","volume-title":"A deep reinforcement learning framework for the financial portfolio management problem. arXiv preprint arXiv:1706.10059","author":"Jiang Zhengyao","year":"2017","unstructured":"Zhengyao Jiang , Dixing Xu , and Jinjun Liang . 2017. A deep reinforcement learning framework for the financial portfolio management problem. arXiv preprint arXiv:1706.10059 ( 2017 ). Zhengyao Jiang, Dixing Xu, and Jinjun Liang. 2017. A deep reinforcement learning framework for the financial portfolio management problem. arXiv preprint arXiv:1706.10059 (2017)."},{"key":"e_1_3_2_1_25_1","volume-title":"Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971","author":"Lillicrap Timothy P","year":"2015","unstructured":"Timothy P Lillicrap , Jonathan J Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 ( 2015 ). Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015)."},{"key":"e_1_3_2_1_26_1","volume-title":"Fractal and multifractal analysis: a review. Medical image analysis 13, 4","author":"Lopes Renaud","year":"2009","unstructured":"Renaud Lopes and Nacim Betrouni . 2009. Fractal and multifractal analysis: a review. Medical image analysis 13, 4 ( 2009 ), 634--649. Renaud Lopes and Nacim Betrouni. 2009. Fractal and multifractal analysis: a review. Medical image analysis 13, 4 (2009), 634--649."},{"key":"e_1_3_2_1_27_1","volume-title":"Introduction to econophysics: correlations and complexity in finance","author":"Mantegna Rosario N","unstructured":"Rosario N Mantegna and H Eugene Stanley . 1999. Introduction to econophysics: correlations and complexity in finance . Cambridge university press . Rosario N Mantegna and H Eugene Stanley. 1999. Introduction to econophysics: correlations and complexity in finance. Cambridge university press."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3390\/data4030110"},{"key":"e_1_3_2_1_29_1","volume-title":"International Conference on Machine Learning. PMLR, 6862--6873","author":"Metelli Alberto Maria","year":"2020","unstructured":"Alberto Maria Metelli , Flavio Mazzolini , Lorenzo Bisi , Luca Sabbioni , and Marcello Restelli . 2020 . Control frequency adaptation via action persistence in batch reinforcement learning . In International Conference on Machine Learning. PMLR, 6862--6873 . Alberto Maria Metelli, Flavio Mazzolini, Lorenzo Bisi, Luca Sabbioni, and Marcello Restelli. 2020. Control frequency adaptation via action persistence in batch reinforcement learning. In International Conference on Machine Learning. PMLR, 6862--6873."},{"key":"e_1_3_2_1_30_1","volume-title":"Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , and Martin Riedmiller . 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 ( 2013 ). Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.935097"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2018.02.032"},{"key":"e_1_3_2_1_33_1","volume-title":"Markov decision processes. Handbooks in operations research and management science 2","author":"Puterman Martin L","year":"1990","unstructured":"Martin L Puterman . 1990. Markov decision processes. Handbooks in operations research and management science 2 ( 1990 ), 331--434. Martin L Puterman. 1990. Markov decision processes. Handbooks in operations research and management science 2 (1990), 331--434."},{"key":"e_1_3_2_1_34_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_3_2_1_35_1","article-title":"Robust forex trading with deep q network (dqn)","volume":"39","author":"Sornmayura Sutta","year":"2019","unstructured":"Sutta Sornmayura . 2019 . Robust forex trading with deep q network (dqn) . ABAC Journal 39 , 1 (2019). Sutta Sornmayura. 2019. Robust forex trading with deep q network (dqn). ABAC Journal 39, 1 (2019).","journal-title":"ABAC Journal"},{"key":"e_1_3_2_1_36_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","unstructured":"Richard S Sutton and Andrew G Barto . 2018. Reinforcement learning: An introduction . MIT press . Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.114632"}],"event":{"name":"ICAIF'21: 2nd ACM International Conference on AI in Finance","location":"Virtual Event","acronym":"ICAIF'21","sponsor":["ACM Association for Computing Machinery"]},"container-title":["Proceedings of the Second ACM International Conference on AI in Finance"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490354.3494403","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3490354.3494403","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:42Z","timestamp":1750188642000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490354.3494403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,3]]},"references-count":35,"alternative-id":["10.1145\/3490354.3494403","10.1145\/3490354"],"URL":"https:\/\/doi.org\/10.1145\/3490354.3494403","relation":{},"subject":[],"published":{"date-parts":[[2021,11,3]]},"assertion":[{"value":"2022-05-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}