Discontinuous solutions of deterministic optimal stopping time problems. (English) Zbl 0629.49017
The deterministic optimal stopping time problem with continuous control as well consists of minimizing the cost
\[
J(x,v,\vartheta,\psi)\equiv \int^{\vartheta}_{0}f(y_ x(s),v(s))e^{-\lambda s}ds+\psi (y_ x(\vartheta))e^{-\lambda \vartheta}
\]
over stopping times \(\vartheta\geq 0\) and controls \(V(\cdot)\in L^{\infty}({\mathbb{R}}^+;V)\) subject to the state y evolving according to \(dy_ x(s)+b(y_ x(s),v(s))ds=0\), \(y_ x(0)=x\in {\mathbb{R}}^ N\). The obstacle is \(\psi\) (\(\cdot)\) and the value function for a given obstacle is denoted \(u[\psi](x)=\inf_{\vartheta,v}J(x,v,\vartheta,\psi)\). When \(\psi\) is bounded and continuous, it is well known that u is characterized as the unique viscosity solution of the Bellman variational inequality \(\max \{H(x,u,Du),u-\psi \}=0\) in \({\mathbb{R}}^ N\) where \(H(x,t,p)=\sup \{b(x,v)\cdot p+\lambda t-f(x,v);v\in V\}\) The objective of this paper is to obtain a similar characterization for u if the obstacle is any arbitrary, possibly discontinuous, but bounded function. An application in which the obstacle is discontinuous is the problem of minimum exit time from a domain.
The study proceeds in this paper by using the upper and lower semicontinuous envelopes of the value function.
The study proceeds in this paper by using the upper and lower semicontinuous envelopes of the value function.
Reviewer: E.Barron
MSC:
49L20 | Dynamic programming in optimal control and differential games |
35F20 | Nonlinear first-order PDEs |
49J40 | Variational inequalities |
60G40 | Stopping times; optimal stopping problems; gambling theory |
35D05 | Existence of generalized solutions of PDE (MSC2000) |
49J45 | Methods involving semicontinuity and convergence; relaxation |
Keywords:
discontinuous obstacle; deterministic optimal stopping time problem; viscosity solution; Bellman variational inequality; minimum exit time from a domainReferences:
[1] | I. CAPUZZO-DOLCETTA and H. ISHII, Approximate solutions of the Bellman Equations of deterministic control theory. Applied Math, andOpt. 11, (1984),pp. 161-181. Zbl0553.49024 MR743925 · Zbl 0553.49024 · doi:10.1007/BF01442176 |
[2] | I. CAPUZZO-DOLCETTA and P. L. LIONS, Hamilton-JacobiEquations and state- constraints problems ; In preparation. · Zbl 0825.49041 |
[3] | M. G. CRANDALL, L. C. EVANS and P. L. LIONS, Some properties of viscosity solutions of Hamilton-Jacobi Equations ; Trans. Amer. Math. Soc., 282 (1984). Zbl0543.35011 MR732102 · Zbl 0543.35011 · doi:10.2307/1999247 |
[4] | M. G. CRANDALL, H. ISHII, and P. L. LIONS, Uniqueness of viscosity solutions revisited ; to appear. · Zbl 0644.35016 |
[5] | M. G. CRANDALL and P. L. LIONS, Viscosity solutions of Hamilton-Jacobi Equations ; Trans. Amer. Math. Soc., 277 (1983). Zbl0599.35024 MR690039 · Zbl 0599.35024 · doi:10.2307/1999343 |
[6] | M. G. CRANDALL and P. L. LIONS, On existence and uniqueness of solutions of Hamilton-Jacobi Equations ; Non Linear Anal. TMA. Vol. 10, N^\circ 6 (1986). Zbl0603.35016 MR836671 · Zbl 0603.35016 · doi:10.1016/0362-546X(86)90133-1 |
[7] | W. H. FLEMING and R. W. RISHEL, Deterministic and stochastic optimal control. Springer, Berlin 1975. Zbl0323.49001 MR454768 · Zbl 0323.49001 |
[8] | H. ISHII, Hamilton-Jacobi Equations with discontinuous Hamiltonians on arbitrary open subsets. Zbl0937.35505 · Zbl 0937.35505 |
[9] | H. ISHII, Perron’s method for Hamilton-Jacobi Equations ; to appear. Zbl0697.35030 · Zbl 0697.35030 · doi:10.1215/S0012-7094-87-05521-9 |
[10] | E. B. LEE and L. MARKUS, Foundations of optimal control theory, J. Wiley, New York (1967). Zbl0159.13201 MR220537 · Zbl 0159.13201 |
[11] | P. L. LIONS, Generalized solutions of Hamilton-Jacobi Equations. Pitman, 1982. Zbl0497.35001 MR667669 · Zbl 0497.35001 |
[12] | P. L. LIONS and B. PERTHAME, Remarks on Hamilton-Jacobi Equations with discontinuous time-dependent coefficients ; Non Linear Anal. TMA. Vol. 11, n^\circ 7 (1987). Zbl0688.35052 MR886652 · Zbl 0688.35052 · doi:10.1016/0362-546X(87)90076-9 |
[13] | P. L. LIONS and P. E. SOUGANIDIS, Differential games, optimal control and directional derivatives of viscosity solutions of Bellman’s and Isaac’s Equations ; SIAM J. Control and Optimization, vol. 23, n^\circ 4 (1985). Zbl0569.49019 MR791888 · Zbl 0569.49019 · doi:10.1137/0323036 |
[14] | J. P. QUADRAT, in Thèse d’Etat, Univ. Paris IX-Dauphine. |
[15] | M. H. SONER, Optimal controlproblems with state-space constraints. SIAM J.on Control and Optimisation. Vol. 24, n^\circ 3, pp. 551-561 and Vol. 24, n^\circ 4, pp. 1110-1122. Zbl0619.49013 MR861089 · Zbl 0619.49013 · doi:10.1137/0324067 |
[16] | J. WARGA, Optimal control of differential and functionnal equations. Academic press, (1972). Zbl0253.49001 MR372708 · Zbl 0253.49001 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.