{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T02:40:02Z","timestamp":1775616002064,"version":"3.50.1"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,10,21]],"date-time":"2024-10-21T00:00:00Z","timestamp":1729468800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,21]],"date-time":"2024-10-21T00:00:00Z","timestamp":1729468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003141","name":"Consejo Nacional de Humanidades, Ciencias y Tecnolog\u00edas","doi-asserted-by":"crossref","award":["87787,BP-PA-20230509183950738-4692595"],"award-info":[{"award-number":["87787,BP-PA-20230509183950738-4692595"]}],"id":[{"id":"10.13039\/501100003141","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Discrete Event Dyn Syst"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper studies discrete-time hybrid control problems where the controller\u2019s payoff function follows a risk-sensitive discounted model. The associated discount factor can depend on state and action variables, which can even take values of zero or one. We prove the existence of optimal control policies under two different hypotheses. The following technique is the dynamic programming method, where we characterize the minimum cost as the solution of the so-called dynamic programming equations and find the above optimal policies through these equations. We illustrate our theory with practical examples involving inventory-manufacturing systems, and pollution management.<\/jats:p>","DOI":"10.1007\/s10626-024-00405-2","type":"journal-article","created":{"date-parts":[[2024,10,21]],"date-time":"2024-10-21T11:02:16Z","timestamp":1729508536000},"page":"659-687","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Discrete-time hybrid control with risk-sensitive discounted costs"],"prefix":"10.1007","volume":"34","author":[{"given":"Rub\u00e9n","family":"Blancas-Rivera","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2502-9219","authenticated-orcid":false,"given":"H\u00e9ctor","family":"Jasso-Fuentes","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,10,21]]},"reference":[{"issue":"11","key":"405_CR1","doi-asserted-by":"publisher","first-page":"2724","DOI":"10.1016\/j.automatica.2008.03.027","volume":"44","author":"A Abate","year":"2008","unstructured":"Abate A, Prandini M, Lygeros J, Sastry S (2008) Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems. Autom J IFAC 44(11):2724\u20132734","journal-title":"Autom J IFAC"},{"key":"405_CR2","volume-title":"Infinite dimensional analysis","author":"C Aliprantis","year":"2006","unstructured":"Aliprantis C, Border K (2006) Infinite dimensional analysis. Springer, A Hitchhiker\u2019s Guide"},{"key":"405_CR3","doi-asserted-by":"crossref","unstructured":"Amin S,\u00a0Abate A,\u00a0Prandini M,\u00a0Lygeros J,\u00a0Sastry S (2006) Reachability analysis for controlled discrete time stochastic hybrid systems. In: Hybrid systems: computation and control, vol 3927 of lecture notes in Comput. Sci., pp 49\u201363. Springer, Berlin","DOI":"10.1007\/11730637_7"},{"issue":"6","key":"405_CR4","doi-asserted-by":"publisher","first-page":"4106","DOI":"10.1214\/21-AAP1758","volume":"32","author":"A Arapostathis","year":"2022","unstructured":"Arapostathis A, Biswas A (2022) Risk-sensitive control for a class of diffusions with jumps. Ann Appl Probab 32(6):4106\u20134142","journal-title":"Ann Appl Probab"},{"issue":"3","key":"405_CR5","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1080\/17442508.2017.1357724","volume":"90","author":"N B\u00e4uerle","year":"2018","unstructured":"B\u00e4uerle N, Popp A (2018) Risk-sensitive stopping problems for continuous-time Markov chains. Stochastics 90(3):411\u2013431","journal-title":"Stochastics"},{"issue":"1","key":"405_CR6","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1287\/moor.2013.0601","volume":"39","author":"N B\u00e4uerle","year":"2014","unstructured":"B\u00e4uerle N, Rieder U (2014) More risk-sensitive Markov decision processes. Math Oper Res 39(1):105\u2013120","journal-title":"Math Oper Res"},{"key":"405_CR7","unstructured":"Bensoussan A (2011) Dynamic programming and inventory control, vol 3. Studies in probability. Optimization and statistics. IOS Press, Amsterdam"},{"key":"405_CR8","unstructured":"Bensoussan, A, Lions J-L (1982) Applications of variational inequalities in stochastic control, vol\u00a012 of studies in mathematics and its applications. North-Holland Publishing Co., Amsterdam-New York. Translated from the French"},{"issue":"4","key":"405_CR9","first-page":"395","volume":"3","author":"A Bensoussan","year":"1997","unstructured":"Bensoussan A, Menaldi JL (1997) Hybrid control and dynamic programming. Dyn Contin Discrete Impuls Syst 3(4):395\u2013442","journal-title":"Dyn Contin Discrete Impuls Syst"},{"issue":"4","key":"405_CR10","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1137\/0323038","volume":"23","author":"A Bensoussan","year":"1985","unstructured":"Bensoussan A, van Schuppen JH (1985) Optimal control of partially observable stochastic systems with an exponential-of-integral performance index. SIAM J Control Optim 23(4):599\u2013613","journal-title":"SIAM J Control Optim"},{"key":"405_CR11","unstructured":"Bensoussan A, Lions J-L (1984) Impulse control and quasivariational inequalities. $$\\mu $$. Gauthier-Villars, Montrouge; Heyden & Son, Inc., Philadelphia, PA. Translated from the French by J. M. Cole"},{"key":"405_CR12","doi-asserted-by":"crossref","unstructured":"Bensoussan A, Menaldi JL (2000) Stochastic hybrid control. vol 249, pp 261\u2013288. Special issue in honor of Richard Bellman","DOI":"10.1006\/jmaa.2000.7102"},{"key":"405_CR13","doi-asserted-by":"crossref","unstructured":"Bielecki, T,\u00a0Hern\u00e1ndez-Hern\u00e1ndez D, Pliska SR (1999) Risk sensitive control of finite state Markov chains in discrete time, with applications to portfolio management. vol\u00a050, pp 167\u2013188. Financial optimization","DOI":"10.1007\/s001860050094"},{"key":"405_CR14","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.arcontrol.2023.03.001","volume":"55","author":"A Biswas","year":"2023","unstructured":"Biswas A, Borkar VS (2023) Ergodic risk-sensitive control\u2014a survey. Ann Rev Control 55:118\u2013141","journal-title":"Ann Rev Control"},{"key":"405_CR15","doi-asserted-by":"crossref","unstructured":"Biswas A,\u00a0Pradhan, S (2022) Ergodic risk-sensitive control of Markov processes on countable state space revisited. ESAIM Control Optim. Calc. Var., 28: Paper No. 26, 50","DOI":"10.1051\/cocv\/2022018"},{"key":"405_CR16","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s00186-019-00689-3","volume":"91","author":"R Blancas-Rivera","year":"2020","unstructured":"Blancas-Rivera R, Cavazos-Cadena R, Cruz-Su\u00e1rez H (2020) Discounted approximations in risk-sensitive average markov cost chains with finite state space. Math Methods Oper Res 91:241\u2013268","journal-title":"Math Methods Oper Res"},{"issue":"1","key":"405_CR17","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1137\/0322009","volume":"22","author":"GL Blankenship","year":"1984","unstructured":"Blankenship GL, Menaldi J-L (1984) Optimal stochastic scheduling of power generation systems with scheduling delays and large cost differentials. SIAM J Control Optim 22(1):121\u2013132","journal-title":"SIAM J Control Optim"},{"issue":"1","key":"405_CR18","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1287\/moor.27.1.192.334","volume":"27","author":"VS Borkar","year":"2002","unstructured":"Borkar VS, Meyn SP (2002) Risk-sensitive optimal control for Markov decision processes with monotone cost. Math Oper Res 27(1):192\u2013209","journal-title":"Math Oper Res"},{"issue":"3","key":"405_CR19","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1023\/A:1021786019871","volume":"101","author":"VS Borkar","year":"1999","unstructured":"Borkar VS, Ghosh MK, Sahay P (1999) Optimal control of a stochastic hybrid system with discounted cost. J Optim Theory Appl 101(3):557\u2013580","journal-title":"J Optim Theory Appl"},{"issue":"1","key":"405_CR20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/9.654885","volume":"43","author":"MS Branicky","year":"1998","unstructured":"Branicky MS, Borkar VS, Mitter SK (1998) A unified framework for hybrid control: model and optimal control theory. IEEE Trans Autom Control 43(1):31\u201345","journal-title":"IEEE Trans Autom Control"},{"issue":"10","key":"405_CR21","doi-asserted-by":"publisher","first-page":"1800","DOI":"10.1109\/TAC.2000.880971","volume":"45","author":"R Cavazos-Cadena","year":"2000","unstructured":"Cavazos-Cadena R, Fern\u00e1ndez-Gaucherand E (2000) The vanishing discount approach in Markov chains with risk-sensitive criteria. IEEE Trans Autom Control 45(10):1800\u20131816","journal-title":"IEEE Trans Autom Control"},{"issue":"1","key":"405_CR22","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1137\/22M1476757","volume":"61","author":"X Chen","year":"2023","unstructured":"Chen X, Wei Q (2023) Risk-sensitive average optimality for discrete-time Markov decision processes. SIAM J Control Optim 61(1):72\u2013104","journal-title":"SIAM J Control Optim"},{"issue":"1","key":"405_CR23","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1137\/040618631","volume":"46","author":"GB Di Masi","year":"2007","unstructured":"Di Masi GB, Stettner L (2007) Infinite horizon risk sensitive control of discrete time Markov processes under minorization property. SIAM J Control Optim 46(1):231\u2013252","journal-title":"SIAM J Control Optim"},{"issue":"6","key":"405_CR24","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1137\/S0363012993258720","volume":"33","author":"WH Fleming","year":"1995","unstructured":"Fleming WH, McEneaney WM (1995) Risk-sensitive control on an infinite time horizon. SIAM J Control Optim 33(6):1881\u20131915","journal-title":"SIAM J Control Optim"},{"issue":"4","key":"405_CR25","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1080\/17442508.2013.872644","volume":"86","author":"MK Ghosh","year":"2014","unstructured":"Ghosh MK, Saha S (2014) Risk-sensitive control of continuous time Markov chains. Stochastics 86(4):655\u2013675","journal-title":"Stochastics"},{"issue":"3","key":"405_CR26","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/0167-6911(88)90055-2","volume":"11","author":"K Glover","year":"1988","unstructured":"Glover K, Doyle JC (1988) State-space formulae for all stabilizing controllers that satisfy an $$h^\\infty $$-norm bound and relations to relations to risk sensitivity. Syst Control Lett 11(3):167\u2013172","journal-title":"Syst Control Lett"},{"issue":"5","key":"405_CR27","doi-asserted-by":"publisher","first-page":"1626","DOI":"10.1137\/S0363012901383837","volume":"41","author":"JI Gonz\u00e1lez-Trejo","year":"2002","unstructured":"Gonz\u00e1lez-Trejo JI, Hern\u00e1ndez-Lerma O, Hoyos-Reyes LF (2002) Minimax control of discrete-time stochastic systems. SIAM J Control Optim 41(5):1626\u20131659","journal-title":"SIAM J Control Optim"},{"issue":"4","key":"405_CR28","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1007\/s10626-019-00292-y","volume":"29","author":"X Guo","year":"2019","unstructured":"Guo X, Zhang J (2019) Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces. Discrete Event Dyn Syst 29(4):445\u2013471","journal-title":"Discrete Event Dyn Syst"},{"issue":"3","key":"405_CR29","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/S0167-6911(96)00051-5","volume":"29","author":"D Hern\u00e1ndez-Hern\u00e1ndez","year":"1996","unstructured":"Hern\u00e1ndez-Hern\u00e1ndez D, Marcus SI (1996) Risk sensitive control of Markov processes in countable state space. Syst Control Lett 29(3):147\u2013155","journal-title":"Syst Control Lett"},{"key":"405_CR30","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez-Lerma O, Lasserre, JB (1996) Discrete-time Markov control processes: basic optimality criteria, vol\u00a030. Springer Science & Business Media","DOI":"10.1007\/978-1-4612-0729-0"},{"key":"405_CR31","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1287\/mnsc.18.7.356","volume":"18","author":"RA Howard","year":"1971","unstructured":"Howard RA, Matheson JE (1971\/72) Risk-sensitive Markov decision processes. Manag Sci 18:356\u2013369","journal-title":"Manag Sci"},{"issue":"2","key":"405_CR32","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1109\/TAC.1973.1100265","volume":"18","author":"D Jacobson","year":"1973","unstructured":"Jacobson D (1973) Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games. IEEE Trans Autom Control 18(2):124\u2013131","journal-title":"IEEE Trans Autom Control"},{"issue":"2","key":"405_CR33","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1016\/j.jmaa.2018.03.007","volume":"462","author":"H Jasso-Fuentes","year":"2018","unstructured":"Jasso-Fuentes H, Menaldi J-L, Prieto-Rumeau T, Robin M (2018) Discrete-time hybrid control in Borel spaces: average cost optimality criterion. J Math Anal Appl 462(2):1695\u20131713","journal-title":"J Math Anal Appl"},{"issue":"2","key":"405_CR34","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1007\/s00186-020-00716-8","volume":"92","author":"H Jasso-Fuentes","year":"2020","unstructured":"Jasso-Fuentes H, Menaldi J-L, Prieto-Rumeau T (2020) Discrete-time control with non-constant discount factor. Math Methods Oper Res 92(2):377\u2013399","journal-title":"Math Methods Oper Res"},{"issue":"2","key":"405_CR35","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1007\/s00245-018-9503-z","volume":"81","author":"H Jasso-Fuentes","year":"2020","unstructured":"Jasso-Fuentes H, Menaldi J-L, Prieto-Rumeau T (2020) Discrete-time hybrid control in Borel spaces. Appl Math Optim 81(2):409\u2013441","journal-title":"Appl Math Optim"},{"issue":"3","key":"405_CR36","first-page":"675","volume":"9","author":"H Jasso-Fuentes","year":"2024","unstructured":"Jasso-Fuentes H, Menaldi J-L, Prieto-Rumeau T (2024) Recent results on discrete-time hybrid control models with general state and action spaces. Pure Appl Funct Anal 9(3):675\u2013704","journal-title":"Pure Appl Funct Anal"},{"issue":"1","key":"405_CR37","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/s11750-014-0323-2","volume":"23","author":"JD L\u00f3pez-Barrientos","year":"2015","unstructured":"L\u00f3pez-Barrientos JD, Jasso-Fuentes H, Escobedo-Trujillo BA (2015) Discounted robust control for Markov diffusion processes. TOP 23(1):53\u201376","journal-title":"TOP"},{"key":"405_CR38","doi-asserted-by":"crossref","unstructured":"Menaldi JL, Robin M (2019) Hybrid models and switching control with constraints. Commun Stoch Anal 13(3):Art. 3, 29","DOI":"10.31390\/cosa.13.3.03"},{"issue":"2","key":"405_CR39","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/BF00046712","volume":"8","author":"J-L Menaldi","year":"1987","unstructured":"Menaldi J-L (1987) Optimal impulse control problems for degenerate diffusions with jumps. Acta Appl Math 8(2):165\u2013198","journal-title":"Acta Appl Math"},{"issue":"3","key":"405_CR40","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1007\/s00245-005-0829-y","volume":"52","author":"J-L Menaldi","year":"2005","unstructured":"Menaldi J-L, Robin M (2005) Remarks on risk-sensitive control problems. Appl Math Optim 52(3):297\u2013310","journal-title":"Appl Math Optim"},{"issue":"4","key":"405_CR41","doi-asserted-by":"publisher","first-page":"591","DOI":"10.4310\/CIS.2021.v21.n4.a4","volume":"21","author":"JL Menaldi","year":"2021","unstructured":"Menaldi JL, Robin M (2021) On ergodic control of switching processes. Commun Inf Syst 21(4):591\u2013621","journal-title":"Commun Inf Syst"},{"issue":"1","key":"405_CR42","doi-asserted-by":"publisher","first-page":"53","DOI":"10.3934\/puqr.2023003","volume":"8","author":"J-L Menaldi","year":"2023","unstructured":"Menaldi J-L, Robin M (2023) Ergodic switching control for diffusion-type processes. Probab Uncertain Quant Risk 8(1):53\u201374","journal-title":"Probab Uncertain Quant Risk"},{"key":"405_CR43","doi-asserted-by":"crossref","unstructured":"Puterman ML (1994) Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons","DOI":"10.1002\/9780470316887"},{"issue":"4","key":"405_CR44","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1080\/15326340600878677","volume":"22","author":"A Schied","year":"2006","unstructured":"Schied A (2006) Risk measures and robust optimization problems. Stoch Models 22(4):753\u2013831","journal-title":"Stoch Models"},{"issue":"12","key":"405_CR45","doi-asserted-by":"publisher","first-page":"1951","DOI":"10.1016\/j.automatica.2010.08.006","volume":"46","author":"S Summers","year":"2010","unstructured":"Summers S, Lygeros J (2010) Verification of discrete time stochastic hybrid systems: a stochastic reach-avoid decision problem. Automatica 46(12):1951\u20131961","journal-title":"Automatica"},{"issue":"5","key":"405_CR46","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1080\/07362994.2015.1050674","volume":"33","author":"K Suresh Kumar","year":"2015","unstructured":"Suresh Kumar K, Pal C (2015) Risk-sensitive ergodic control of continuous time Markov processes with denumerable state space. Stoch Anal Appl 33(5):863\u2013881","journal-title":"Stoch Anal Appl"},{"key":"405_CR47","doi-asserted-by":"crossref","unstructured":"U\u011furlu K (2024) Terminal wealth maximization under drift uncertainty. Optimization, pp 1\u201319","DOI":"10.1080\/02331934.2024.2324143"},{"issue":"10","key":"405_CR48","doi-asserted-by":"publisher","first-page":"2081","DOI":"10.1080\/02331934.2020.1774586","volume":"70","author":"K U\u01e7urlu","year":"2021","unstructured":"U\u01e7urlu K (2021) Robust utility maximization of terminal wealth with drift and volatility uncertainty. Optimization 70(10):2081\u20132102","journal-title":"Optimization"},{"issue":"4","key":"405_CR49","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1080\/02331934.2018.1547382","volume":"68","author":"Q Wei","year":"2019","unstructured":"Wei Q, Chen X (2019) Risk-sensitive average continuous-time Markov decision processes with unbounded rates. Optimization 68(4):773\u2013800","journal-title":"Optimization"},{"key":"405_CR50","unstructured":"Whittle P (1990) Risk-sensitive optimal control. Wiley-interscience series in systems and optimization, John Wiley & Sons, Ltd., Chichester"},{"issue":"4","key":"405_CR51","doi-asserted-by":"publisher","first-page":"764","DOI":"10.2307\/1426972","volume":"13","author":"P Whittle","year":"1981","unstructured":"Whittle P (1981) Risk-sensitive linear\/quadratic\/gaussian control. Adv Appl Probab 13(4):764\u2013777","journal-title":"Adv Appl Probab"}],"container-title":["Discrete Event Dynamic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10626-024-00405-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10626-024-00405-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10626-024-00405-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,9]],"date-time":"2024-12-09T10:06:11Z","timestamp":1733738771000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10626-024-00405-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,21]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["405"],"URL":"https:\/\/doi.org\/10.1007\/s10626-024-00405-2","relation":{},"ISSN":["0924-6703","1573-7594"],"issn-type":[{"value":"0924-6703","type":"print"},{"value":"1573-7594","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,21]]},"assertion":[{"value":"31 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}