Finite time stochastic stability and the analysis of tracking systems
- 1 April 1966
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 11 (2), 219-227
- https://doi.org/10.1109/tac.1966.1098315
Abstract
A (Liapunov-like) method is presented for obtaining upper bounds of the probability P_{x}{\sup_{T\geq t\geq 0} V(X_{t})\geq\lambda} , where x_{0} = x and x t is a Markov process with either discrete or continuous parameter, and V(\cdot) is some function. Such estimates are the quantity of greatest interest in numerous tracking, control, and reliability studies. The method involves finding suitable (stochastic) Liapunov functions. The results are also results in (what may be termed) finite-time stochastic stability. The theorems are based on some theorems of Dynkin [1]. Several illustrative examples are given.Keywords
This publication has 14 references indexed in Scilit:
- A Note on the Maximum Sample Excursions of Stochastic Approximation ProcessesThe Annals of Mathematical Statistics, 1966
- On the construction of stochastic Liapunov functionsIEEE Transactions on Automatic Control, 1965
- ON THE STABILITY OF SYSTEMS DEFINED OVER A FINITE TIME INTERVALProceedings of the National Academy of Sciences of the United States of America, 1965
- Markov ProcessesPublished by Springer Science and Business Media LLC ,1965
- On the stability of the trajectory of markov processesJournal of Applied Mathematics and Mechanics, 1962
- Zero Crossing Probabilities for Gaussian Stationary ProcessesThe Annals of Mathematical Statistics, 1962
- Synthesis of an optimal set of radar track-while-scan smoothing equationsIRE Transactions on Automatic Control, 1962
- The One-Sided Barrier Problem for Gaussian NoiseBell System Technical Journal, 1962
- On the stability of systems with random parametersJournal of Applied Mathematics and Mechanics, 1960
- On stochastic differential equationsMemoirs of the American Mathematical Society, 1951