Quadratic control of stochastic hybrid systems with renewal transitions

Abstract

We study the quadratic control of a class of stochastic hybrid systems with linear continuous dynamics for which the lengths of time that the system stays in each mode are independent random variables with given probability distribution functions. We derive a condition for finding the optimal feedback policy that minimizes a discounted infinite horizon cost. We show that the optimal cost is the solution to a set of differential equations with unknown boundary conditions. Furthermore, we provide a recursive algorithm for computing the optimal cost and the optimal feedback policy. The applicability of our result is illustrated through a numerical example, motivated by stochastic gene regulation in biology.

ICB Affiliated Authors

Authors
F. R. Pour Safaei, K. Roh, S. R. Proulx, and J. P. Hespanha
Date
Type
Peer-Reviewed Article
Journal
Automatica
Volume
50
Pages
2822–2834