{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T21:24:18Z","timestamp":1785965058181,"version":"3.56.0"},"reference-count":12,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T00:00:00Z","timestamp":1677024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>We show how reinforcement learning can be used in conjunction with quantile regression to develop a hedging strategy for a trader responsible for derivatives that arrive stochastically and depend on a single underlying asset. We assume that the trader makes the portfolio delta-neutral at the end of each day by taking a position in the underlying asset. We focus on how trades in options can be used to manage gamma and vega. The option trades are subject to transaction costs. We consider three different objective functions. We reach conclusions on how the optimal hedging strategy depends on the trader's objective function, the level of transaction costs, and the maturity of the options used for hedging. We also investigate the robustness of the hedging strategy to the process assumed for the underlying asset.<\/jats:p>","DOI":"10.3389\/frai.2023.1129370","type":"journal-article","created":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T08:25:05Z","timestamp":1677054305000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Gamma and vega hedging using deep distributional reinforcement learning"],"prefix":"10.3389","volume":"6","author":[{"given":"Jay","family":"Cao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacky","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soroush","family":"Farghadani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Hull","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zissis","family":"Poulos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zeyu","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Yuan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,2,22]]},"reference":[{"key":"B1","article-title":"Distributed distributional deterministic policy gradients","author":"Barth-Maron","year":"2018","journal-title":"arXiv."},{"key":"B2","first-page":"449","article-title":"\u201cA distributional perspective on reinforcement learning,\u201d","author":"Bellemare","year":"2017","journal-title":"ICML'17 in proceedings of the 34th international conference on machine learning, vol. 70"},{"key":"B3","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1086\/260062","article-title":"The pricing of options and corporate liabilities","volume":"81","author":"Black","year":"1973","journal-title":"J. Polit. Econ."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1080\/14697688.2019.1571683","article-title":"Deep hedging","volume":"19","author":"Buehler","year":"2019","journal-title":"Quant. Finan."},{"key":"B5","doi-asserted-by":"publisher","first-page":"10","DOI":"10.3905\/jfds.2020.1.052","article-title":"Deep hedging of derivatives using reinforcement learning","volume":"3","author":"Cao","year":"2021","journal-title":"J. Finan. Data Sci. Winter"},{"key":"B6","doi-asserted-by":"crossref","first-page":"2892","DOI":"10.1609\/aaai.v32i1.11791","article-title":"\u201cDistributional reinforcement learning with quantile regression,\u201d","volume":"32","author":"Dabney","year":"2018","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"B7","article-title":"\u201cJoint dynamics for the underlying asset and its implied volatility surface: a new methodology for option risk management,\u201d","author":"Francois","year":"2023","journal-title":"Working Paper. ssrn: 4319972"},{"key":"B8","first-page":"84","volume-title":"Managing Smile Risk","author":"Hagan","year":"2002"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3087076","article-title":"QLBS: Q-learner in the Black-Scholes (-Merton) worlds","author":"Halperin","year":"2017","journal-title":"arXiv"},{"key":"B10","doi-asserted-by":"publisher","first-page":"159","DOI":"10.3905\/jfds.2019.1.1.159","article-title":"Dynamic replication and hedging: a reinforcement learning approach","volume":"2","author":"Kolm","year":"2019","journal-title":"J. Finan. Data Sci. Winter"},{"key":"B11","doi-asserted-by":"publisher","first-page":"141","DOI":"10.2307\/3003143","article-title":"Theory of rational option pricing","volume":"4","author":"Merton","year":"1973","journal-title":"Bell J. Econ. Manag. Sci."},{"key":"B12","first-page":"1","article-title":"Learning the variance of the reward-to-go","volume":"17","author":"Tamar","year":"2016","journal-title":"J. Mach. Learn."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1129370\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T08:25:15Z","timestamp":1677054315000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1129370\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,22]]},"references-count":12,"alternative-id":["10.3389\/frai.2023.1129370"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1129370","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,22]]},"article-number":"1129370"}}