{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:59:14Z","timestamp":1787324354982,"version":"build-2736575974"},"reference-count":27,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Control Optim."],"published-print":{"date-parts":[[2015,1]]},"abstract":"<jats:p>This paper considers the discounted continuous-time Markov decision processes (MDPs) in Borel spaces and with unbounded transition rates. The discount factors are allowed to depend on states and actions. Main attention is concentrated on the set $F_g$ of stationary policies attaining a given mean performance $g$ up to the first passage of the continuous-time MDP to an arbitrarily fixed target set. Under suitable conditions, we prove the existence of a $g$-mean-variance optimal policy that minimizes the first passage variance over the set $F_g$ using a transformation technique, and also give the value iteration and policy iteration algorithms for computing the $g$-variance value function and a $g$-mean-variance optimal policy, respectively. Two examples are analytically solved to demonstrate the application of our results.<\/jats:p>","DOI":"10.1137\/140968872","type":"journal-article","created":{"date-parts":[[2015,6,2]],"date-time":"2015-06-02T12:27:53Z","timestamp":1433248073000},"page":"1406-1424","source":"Crossref","is-referenced-by-count":14,"title":["On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes"],"prefix":"10.1137","volume":"53","author":[{"given":"Xianping","family":"Guo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangxiang","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2015,6,2]]},"reference":[{"key":"atypb1","doi-asserted-by":"crossref","unstructured":"N. Bau\u0308erle and U. Rieder,\n                      Markov Decision Processes with Applications to Finance\n                      , Springer, Heidelberg, 2011.","DOI":"10.1007\/978-3-642-18324-9"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1040.0089"},{"key":"atypb3","doi-asserted-by":"crossref","unstructured":"E. A. Feinberg,\n                      Reduction of discounted continuous-time MDPs with unbounded jump and reward rates to discrete-time total-reward MDPs\n                      , in Optimization, Control, and Applications of Stochastic Systems, Systems Control Found. Appl., D. Herna\u0301ndez-Herna\u0301ndez and A. Minjarez-Sosa, eds., Birkha\u0308user\/Springer, New York, 2012, pp. 77-97.","DOI":"10.1007\/978-0-8176-8337-5_5"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2009.01.005"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1060.0210"},{"key":"atypb6","doi-asserted-by":"crossref","unstructured":"X. P. Guo and O. Herna\u0301ndez-Lerma,\n                      Continuous-Time Markov Decision Processes\n                      , Springer, Heidelberg\/Dordrecht\/New York, 2009.","DOI":"10.1007\/978-3-642-02547-1"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1214\/10-AAP749"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2013.2281475"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1100.0477"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2012.01.051"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011970418845"},{"key":"atypb12","doi-asserted-by":"crossref","unstructured":"O. Herna\u0301ndez-Lerma and J. B. Lasserre,\n                      Further Topics on Discrete-Time Markov Control Processes\n                      , Springer-Verlag, New York, 1999.","DOI":"10.1007\/978-1-4612-0561-6"},{"key":"atypb13","doi-asserted-by":"crossref","unstructured":"O. Herna\u0301ndez-Lerma and J. B. Lasserre,\n                      Discrete-Time Markov Control Processes: Basic Optimality Criteria\n                      , Springer-Verlag, New York, 1996.","DOI":"10.1007\/978-1-4612-0729-0"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1006\/jmaa.1996.9999"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176343087"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177693321"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1287\/opre.23.4.687"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1007\/s00245-001-0007-9"},{"key":"atypb19","first-page":"77","volume":"7","author":"Markowitz H. M.","year":"1952","journal-title":"J. Finance"},{"key":"atypb20","unstructured":"H. M. Markowitz,\n                      Mean-Variance Analysis in Portfolio Choice and Capital Markets\n                      , Basil Blackwell, Oxford, UK, 1987."},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1016\/0022-247X(68)90194-7"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1137\/10081366X"},{"key":"atypb23","doi-asserted-by":"crossref","unstructured":"T. Prieto-Rumeau and O. Herna\u0301ndez-Lerma,\n                      Selected Topics on Continuous-Time Controlled Markov Chains and Markov Games\n                      , Imperial College Press, London, 2012.","DOI":"10.1142\/p829"},{"key":"atypb24","doi-asserted-by":"crossref","unstructured":"M. L. Puterman,\n                      Markov Decision Processes\n                      , Wiley, New York, 1994.","DOI":"10.1002\/9780470316887"},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"L. I. Sennott,\n                      Stochastic Dynamic Programming and the Control of Queueing Systems\n                      , Wiley, New York, 1999.","DOI":"10.1002\/9780470317037"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1007\/s10440-012-9669-3"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2004.824479"}],"container-title":["SIAM Journal on Control and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/140968872","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:22:24Z","timestamp":1787322144000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/140968872"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1]]},"references-count":27,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,1]]}},"alternative-id":["10.1137\/140968872"],"URL":"https:\/\/doi.org\/10.1137\/140968872","relation":{},"ISSN":["0363-0129","1095-7138"],"issn-type":[{"value":"0363-0129","type":"print"},{"value":"1095-7138","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,1]]}}}