{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:49:56Z","timestamp":1787320196931,"version":"build-2736575974"},"reference-count":26,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Control Optim."],"published-print":{"date-parts":[[2009,1]]},"abstract":"<jats:p>This work is concerned with rates of convergence of Markov chain approximation methods for controlled switching diffusions. The cost function is defined on an infinite horizon with stopping times and without discount. Displaying both continuous dynamics and discrete events, the discrete events are modeled by continuous-time Markov chains to delineate a random environment and other random factors that cannot be represented by diffusion processes. This paper presents a first attempt using a probabilistic approach to treat such rates of convergence problems. In addition, in contrast to the significant developments in the literature using partial differential equation (PDE) methods for the approximation of controlled diffusions, there do not yet appear to be any PDE results to date for rates of convergence of numerical solutions for controlled switching diffusions, to the best of our knowledge. Although some of the working conditions in this paper such as the one-dimensional continuous state variable, nondegenerate diffusions, and control only on the drift may be seemingly strong, they are adequate as the starting point for using this new approach to treat the rates of convergence problems. Moreover, in the literature, to prove the convergence using Markov chain approximation methods for control problems involving cost functions with stopping (even for uncontrolled diffusion without switching), an added assumption was used to avoid the so-called tangency problem. As a by-product of our approach, by modifying the value function, it is demonstrated that the anticipated tangency problem will not arise in the sense of convergence in probability and in the sense of $L^1$.<\/jats:p>","DOI":"10.1137\/070679843","type":"journal-article","created":{"date-parts":[[2009,5,22]],"date-time":"2009-05-22T18:14:57Z","timestamp":1243016097000},"page":"1831-1857","source":"Crossref","is-referenced-by-count":15,"title":["Rates of Convergence of Numerical Methods for Controlled Regime-Switching Diffusions with Stopping Times in the Costs"],"prefix":"10.1137","volume":"48","author":[{"given":"Q. S.","family":"Song","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G.","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2009,5,22]]},"reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1051\/m2an:2002002"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1137\/S003614290343815X"},{"key":"R3","unstructured":"M. Cs\u00f6rg\u00f6 and P. R\u00e9v\u00e9sz,\n                      Strong Approximations in Probability and Statistics\n                      , Academic Press, New York, 1981."},{"key":"R4","unstructured":"H. Dong and N. V. Krylov,\n                      Rate of convergence of finite-difference approximations for degenerate linear parabolic equations with $C^1$ and $C^2$ coefficients\n                      , Electron. J. Differential Equations, 2005, no. 102 (electronic)."},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1090\/S1061-0022-06-00905-8"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1007\/s00245-007-0879-4"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1137\/0331056"},{"key":"R8","doi-asserted-by":"crossref","unstructured":"W. H. Fleming and R. W. Rishel,\n                      Deterministic and Stochastic Optimal Control\n                      , Springer-Verlag, New York, 1975.","DOI":"10.1007\/978-1-4612-6380-7"},{"key":"R9","unstructured":"P. Hall and C. C. Heyde,\n                      Martingale Limit Theory and Its Application\n                      , Probability and Mathematical Statistics, Academic Press, New York, 1980."},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1109\/9.57016"},{"key":"R11","unstructured":"I. Karatzas and S. E. Shreve,\n                      Brownian Motion and Stochastic Calculus\n                      , Springer-Verlag, New York, 2004."},{"key":"R12","doi-asserted-by":"crossref","unstructured":"N. V. Krylov,\n                      Controlled Diffusion Processes\n                      , English translation, Appl. Math. 14, Springer-Verlag, New York, 1980.","DOI":"10.1007\/978-1-4612-6051-6"},{"key":"R13","first-page":"639","volume":"9","author":"Krylov N. V.","year":"1997","journal-title":"St. Petersburg Math. J."},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1007\/s004400050264"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1137\/0328056"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1109\/9.811211"},{"key":"R17","doi-asserted-by":"crossref","unstructured":"H. J. Kushner and P. Dupuis,\n                      Numerical Methods for Stochastic Control Problems in Continuous Time\n                      , 2nd ed., Springer-Verlag, New York, 2001.","DOI":"10.1007\/978-1-4613-0007-6"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-4149(98)00070-2"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1137\/0327031"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2006.03.016"},{"key":"R21","unstructured":"V. Strassen,\n                      Almost sure behavior of sums of independent random variables and martingales\n                      , in Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 2: Contributions to Probability Theory, Part 1, Berkeley, CA, 1967, pp. 315\u2013343."},{"key":"R22","doi-asserted-by":"crossref","unstructured":"G. Yin and Q. Zhang,\n                      Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach\n                      , Springer-Verlag, New York, 1998.","DOI":"10.1007\/978-1-4612-0627-9"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-06-01876-X"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012999356325"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012902405583"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1137\/060649343"}],"container-title":["SIAM Journal on Control and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/070679843","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T12:55:42Z","timestamp":1787316942000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/070679843"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,1]]},"references-count":26,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2009,1]]}},"alternative-id":["10.1137\/070679843"],"URL":"https:\/\/doi.org\/10.1137\/070679843","relation":{},"ISSN":["0363-0129","1095-7138"],"issn-type":[{"value":"0363-0129","type":"print"},{"value":"1095-7138","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,1]]}}}