Approximately Optimal Control of Nonlinear Dynamic Stochastic Problems with Learning: The OPTCON Algorithm
Open Access
- 8 June 2021
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 14 (6), 181
- https://doi.org/10.3390/a14060181
Abstract
OPTCON is an algorithm for the optimal control of nonlinear stochastic systems which is particularly applicable to economic models. It delivers approximate numerical solutions to optimum control (dynamic optimization) problems with a quadratic objective function for nonlinear economic models with additive and multiplicative (parameter) uncertainties. The algorithm was first programmed in C# and then in MATLAB. It allows for deterministic and stochastic control, the latter with open loop (OPTCON1), passive learning (open-loop feedback, OPTCON2), and active learning (closed-loop, dual, or adaptive control, OPTCON3) information patterns. The mathematical aspects of the algorithm with open-loop feedback and closed-loop information patterns are presented in more detail in this paper.Keywords
Funding Information
- Austrian Science Fund FWF (T 1012-GBL)
This publication has 16 references indexed in Scilit:
- Optimal control of nonlinear dynamic econometric models: An algorithm and an applicationComputational Statistics & Data Analysis, 2012
- An Interior Trust Region Approach for Nonlinear Minimization Subject to BoundsSIAM Journal on Optimization, 1996
- Optimal budgetary and monetary policies under uncertainty: A stochastic control approachAnnals of Operations Research, 1995
- Stochastic optimum control of macroeconometric models using the algorithm OPTCONEuropean Journal of Operational Research, 1994
- Active learning Monte Carlo resultsJournal of Economic Dynamics and Control, 1994
- Opticon: An algorithm for the optimal control of nonlinear stochastic modelsAnnals of Operations Research, 1992
- Caution and probing in a macroeconomic modelJournal of Economic Dynamics and Control, 1982
- Dual effect, certainty equivalence, and separation in stochastic controlIEEE Transactions on Automatic Control, 1974
- The role and use of the stochastic linear-quadratic-Gaussian problem in control system designIEEE Transactions on Automatic Control, 1971
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960