Risk-sensitive discounted cost criterion for Continuous-time Markov decision processes on a general state space

2021/04/26 by Pal, Chandan, Golui, Subrata · 1 citation
#FOS: Mathematics #Optimization and Control (math.OC)

paper · doi:10.48550/arxiv.2104.12366

Abstract

In this paper, we consider risk-sensitive discounted control problem for continuous-time jump Markov processes taking values in general state space. The transition rates of underlying continuous-time jump Markov processes and the cost rates are allowed to be unbounded. Under certain Lyapunov condition, we establish the existence and uniqueness of the solution to the Hamilton-Jacobi-Bellman (HJB) equation. Also we prove the existence of optimal risk-sensitive control in the class of Markov control.

Cited by

• Optimizing Predictive Maintenance in Intelligent Manufacturing: An Integrated FNO-DAE-GNN-PPO MDP Framework

Related

• Risk-sensitive control of continuous time Markov chains
• Continuous-time Markov decision processes under the risk-sensitive average cost criterion
• Risk-sensitive Semi-Markov Decision Problems with Discounted Cost and General Utilities
• Risk-sensitive control for a class of diffusions with jumps
• Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates