Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control
- 1 July 1990
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 35 (7), 777-788
- https://doi.org/10.1109/9.57016
Abstract
Consideration is given to the control of continuous-time linear systems that possess randomly jumping parameters which can be described by finite-state Markov processes. The relationship between appropriately defined controllability, stabilizability properties, and the solution of the infinite time jump linear quadratic (JLQ) optimal control problems is also examined. Although the solution of the continuous-time Markov JLQ problem with finite or infinite time horizons is known, only sufficient conditions for the existence of finite cost, constant, stabilizing controls for the infinite time problem appear in the literature. In this paper necessary and sufficient conditions are established. These conditions are based on new definitions of controllability, observability, stabilizability, and detectability that are appropriate for continuous-time Markovian jump linear systems. These definitions play the same role for the JLQ problem as the deterministic properties do for the linear quadratic regulator (LQR) problem.<>Keywords
This publication has 21 references indexed in Scilit:
- Optimal quadratic control of jump linear systems with separately controlled transition probabilitiesInternational Journal of Control, 1989
- Bounded sample path control of discrete time jump linear systemsIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Controllability, observability and discrete-time markovian jump linear quadratic controlInternational Journal of Control, 1988
- On Reliable Control System DesignsIEEE Transactions on Systems, Man, and Cybernetics, 1986
- Robust jump linear quadratic control: A mode stabilizing solutionIEEE Transactions on Automatic Control, 1985
- Markov ChainsPublished by Springer Science and Business Media LLC ,1983
- Controllability of stochastic linear systemsSystems & Control Letters, 1981
- Some remarks about stochastic controllabilityIEEE Transactions on Automatic Control, 1977
- Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria †International Journal of Control, 1975
- On a Matrix Riccati Equation of Stochastic ControlSIAM Journal on Control, 1968