Well-posedness of stochastic Riccati equations and closed-loop solvability for stochastic linear quadratic optimal control problems. (English) Zbl 1411.93197
Summary: We study the closed-loop solvability of a stochastic linear quadratic optimal control problem for systems governed by stochastic evolution equations. This solvability is established by means of solvability of the corresponding Riccati equation, which is implied by the uniform convexity of the quadratic cost functional. At last, conditions ensuring the uniform convexity of the cost functional are discussed.
MSC:
| 93E20 | Optimal stochastic control |
| 49N10 | Linear-quadratic optimal control problems |
| 49N35 | Optimal feedback synthesis |
Keywords:
stochastic linear quadratic control problem; stochastic evolution equation; closed-loop solvability; Riccati equationReferences:
| [1] | Ahmed, N. U., Stochastic control on Hilbert space for linear evolution equations with random operator-valued coefficients, SIAM J. Control Optim., 19, 401-430 (1981) · Zbl 0468.49009 |
| [2] | Anderson, B. D.O.; Moore, J. B., Optimal Control: Linear Quadratic Methods (1989), Prentice Hall: Prentice Hall Englewood Cliffs, NJ |
| [3] | Bellman, R.; Glicksberg, I.; Gross, O., Some Aspects of the Mathematical Theory of Control Processes (1958), RAND Corporation: RAND Corporation Santa Monica, CA · Zbl 0086.11703 |
| [4] | Bensoussan, A.; Da Prato, G.; Delfour, M. C.; Mitter, S. K., Representation and Control of Infinite-Dimensional Systems. Vol. II. Systems & Control: Foundations & Applications (1993), Birkhäuser Boston, Inc.: Birkhäuser Boston, Inc. Boston, MA · Zbl 0790.93016 |
| [5] | Beutler, F. J., The operator theory of the pseudo-inverse. II. Unbounded operators with arbitrary range, J. Math. Anal. Appl., 10, 471-493 (1965) · Zbl 0151.19205 |
| [6] | Bismut, J.-M., Contrôle des systèmes linéaires quadratiques: applications de l’intégrale stochastique, Lecture Notes in Math., vol. 649, 180-264 (1978), Springer: Springer Berlin · Zbl 0389.93052 |
| [7] | (Carmona, R. A.; Rozovskii, B., Stochastic Partial Differential Equations: Six Perspectives. Stochastic Partial Differential Equations: Six Perspectives, Math. Surveys Monogr., vol. 64 (1999), AMS: AMS Providence, RI) · Zbl 0904.00017 |
| [8] | Chen, S.; Li, X.; Zhou, X., Stochastic linear quadratic regulators with indefinite control weight costs, SIAM J. Control Optim., 36, 1685-1702 (1998) · Zbl 0916.93084 |
| [9] | Chen, S.; Zhou, X. Y., Stochastic linear quadratic regulators with indefinite control weight costs. II, SIAM J. Control Optim., 39, 1065-1081 (2000) · Zbl 1023.93072 |
| [10] | Curtain, R. F.; Ichikawa, A., The separation principle for stochastic evolution equations, SIAM J. Control Optim., 15, 367-383 (1977) · Zbl 0359.60076 |
| [11] | Curtain, R. F., Estimation and stochastic control for linear infinite-dimensional systems, (Probabilistic Analysis and Related Topics, vol. 1 (1978), Academic Press: Academic Press New York), 45-86 · Zbl 0444.60046 |
| [12] | Da Prato, G.; Zabczyk, J., Stochastic Equations in Infinite Dimensions (1992), Cambridge University Press: Cambridge University Press Cambridge · Zbl 0761.60052 |
| [13] | Guatteri, G.; Tessitore, G., On the backward stochastic Riccati equation in infinite dimensions, SIAM J. Control Optim., 44, 159-194 (2005) · Zbl 1102.93041 |
| [14] | Guatteri, G.; Tessitore, G., Well posedness of operator valued backward stochastic Riccati equations in infinite dimensional spaces, SIAM J. Control Optim., 52, 3776-3806 (2014) · Zbl 1307.93456 |
| [15] | Kohlmann, M.; Tang, S., Multidimensional backward stochastic Riccati equations and applications, SIAM J. Control Optim., 41, 1696-1721 (2003) · Zbl 1175.93242 |
| [16] | Hafizoglu, C.; Lasiecka, I.; Levajković, T.; Mena, H.; Tuffaha, A., The stochastic linear quadratic control problem with singular estimates, SIAM J. Control Optim., 55, 595-626 (2017) · Zbl 1358.49029 |
| [17] | Hu, Y.; Zhou, X. Y., Indefinite stochastic Riccati equations, SIAM J. Control Optim., 42, 123-137 (2003) · Zbl 1039.60058 |
| [18] | Kolokoltsov, V. N., Semiclassical Analysis for Diffusions and Stochastic Processes, Lecture Notes in Mathematics, vol. 1724 (2000), Springer-Verlag: Springer-Verlag Berlin · Zbl 0951.60001 |
| [19] | Kotelenez, P., Stochastic Ordinary and Stochastic Partial Differential Equations. Transition from Microscopic to Macroscopic Equations, Stochastic Modelling and Applied Probability, vol. 58 (2008), Springer: Springer New York · Zbl 1159.60004 |
| [20] | Lasiecka, I.; Triggiani, R., Differential and Algebraic Riccati Equations with Applications to Boundary/Point Controlproblems: Continuous Theory and Approximation Theory, Lecture Notes in Control & Inform. Sci., vol. 164 (1991), Springer-Verlag: Springer-Verlag Berlin · Zbl 0754.93038 |
| [21] | Li, X.; Zhou, X.; Lim, A. E.B., Dynamic mean-variance portfolio selection with no-shorting constraints, SIAM J. Control Optim., 40, 1540-1555 (2002) · Zbl 1027.91040 |
| [22] | Lü, Q.; Wang, T.; Zhang, X., Characterization of optimal feedback for stochastic linear quadratic control problems, Probab. Uncertain. Quant. Risk, 2, Article 11 pp. (2017) · Zbl 1432.93384 |
| [23] | Lü, Q.; Zhang, X., General Pontryagin-Type Stochastic Maximum Principle and Backward Stochastic Evolution Equations in Infinite Dimensions, Springer Briefs in Mathematics (2014), Springer: Springer Cham · Zbl 1316.49004 |
| [24] | Lü, Q.; Zhang, X., Transposition method for backward stochastic evolution equations revisited, and its application, Math. Control Relat. Fields, 5, 529-555 (2015) · Zbl 1316.93126 |
| [25] | Mahmudov, N. I.; McKibben, M. A., On backward stochastic evolution equations in Hilbert spaces and optimal control, Nonlinear Anal., 67, 1260-1274 (2007) · Zbl 1122.60057 |
| [26] | Qian, Z.; Zhou, X. Y., Existence of solutions to a class of indefinite stochastic Riccati equations, SIAM J. Control Optim., 51, 221-229 (2013) · Zbl 1266.60107 |
| [27] | Sun, J.; Li, X.; Yong, J., Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems, SIAM J. Control Optim., 54, 2274-2308 (2016) · Zbl 1347.49033 |
| [28] | Sun, J.; Yong, J., Linear quadratic stochastic differential games: open-loop and closed-loop saddle points, SIAM J. Control Optim., 52, 4082-4121 (2014) · Zbl 1307.93466 |
| [29] | Sun, J.; Yong, J., Stochastic linear quadratic optimal control problems in infinite horizon, Appl. Math. Optim., 78, 145-183 (2018) · Zbl 1398.49028 |
| [30] | Tang, S., General linear quadratic optimal stochastic control problems with random coefficients: linear stochastic Hamilton systems and backward stochastic Riccati equations, SIAM J. Control Optim., 42, 53-75 (2003) · Zbl 1035.93065 |
| [31] | Tessitore, G., Some remarks on the Riccati equation arising in an optimal control problem with state- and control-dependent noise, SIAM J. Control Optim., 30, 717-744 (1992) · Zbl 0776.49007 |
| [32] | Tessitore, G., Linear quadratic optimal control for a stochastic system with control on the boundary and hyperbolic dynamics, J. Math. Syst. Estim. Control, 2, 453-482 (1992) |
| [33] | van Neerven, J. M.A. M.; Veraar, M. C.; Weis, L., Stochastic integration in UMD Banach spaces, Ann. Probab., 35, 1438-1478 (2007) · Zbl 1121.60060 |
| [34] | van Neerven, J. M.A. M., \(γ\)-Radonifying operators—a survey, (The AMSI-ANU Workshop on Spectral Theory and Harmonic Analysis. The AMSI-ANU Workshop on Spectral Theory and Harmonic Analysis, Proc. Centre Math. Appl. Austral. Nat. Univ., vol. 44 (2010), Austral. Nat. Univ.: Austral. Nat. Univ. Canberra), 1-61 · Zbl 1236.47018 |
| [35] | Wonham, W. M., On a matrix Riccati equation of stochastic control, SIAM J. Control Optim., 6, 312-326 (1968) · Zbl 0164.19101 |
| [36] | Yong, J.; Zhou, X. Y., Stochastic Controls: Hamiltonian Systems and HJB Equations (1999), Springer-Verlag: Springer-Verlag New York · Zbl 0943.93002 |
| [37] | Yu, Z., An optimal feedback control-strategy pair for zero-sum linear-quadratic stochastic differential game: the Riccati equation approach, SIAM J. Control Optim., 53, 2141-2167 (2015) · Zbl 1332.60089 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
