Dynamic Programming and Minimum Principles for Systems with Jump Markov Disturbances
Raymond Rishel · SIAM Journal on Control · 1975
This paper studies optimum control of random differential equations of the form \[\dot x = f^{r(t)} (t,x,u)\] in which $r(t)$ is a jump Markov process. Optimality conditions of dynamic programming type and stochastic minimum principles are given. The problems posed involve terminal conditions, and transversality conditions are shown to hold.
Cited by 167 works. doi:10.1137/0313020
Authors
References
- The Mathematical Theory of Optimal Processes.
- Introduction to the theory of random processes
- Variational methods in problems of control and programming
- Feedback control of a class of linear systems with jump parameters
- On the stochastic maximum principle: Fixed time of control
- Mathematical Methods of Optimal Control
- Sufficient Conditions for Optimality and the Justification of the Dynamic Programming Method
- Analytical design of controllers in stochastic systems with velocity-limited controlling action
- Theory of Random Evolutions with Applications to Partial Differential Equations
- Optimal control of systems with random properties