×

Estimation for partially observed Markov processes. (English) Zbl 0819.60062

Summary: Many stochastic process models for environmental data sets assume a process of relatively simple structure which is in some sense partially observed. That is, there is an underlying process \((X_ n, n \geq 0)\) or \((X_ t, t \geq 0)\) for which the parameters are of interest and physically meaningful, and an observable process \((Y_ n, n \geq 0)\) or \((Y_ t, t \geq 0)\) which depends on the \(X\) process but not otherwise on those parameters. Examples are wide ranging: the \(Y\) process may be the \(X\) process with missing observations; the \(Y\) process may be the \(X\) process observed with a noise component; the \(X\) process might constitute a random environment for the \(Y\) process, as with hidden Markov models; the \(Y\) process might be a lower-dimensional function or reduction of the \(X\) process. In principle, maximum likelihood estimation for the \(X\) process parameters can be carried out by some form of the EM algorithm applied to the \(Y\) process data. We review some current methods for exact and approximate maximum likelihood estimation. We illustrate some of the issues by considering how to estimate the parameters of a stochastic Nash cascade model for runoff. In the case of \(k\) reservoirs, the outputs of these reservoirs form a \(k\)-dimensional vector Markov process, of which only the \(k\)th coordinate process is observed, usually at a discrete sample of time points.

MSC:

60J20 Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.)
86A05 Hydrology, hydrography, oceanography
60G35 Signal detection and filtering (aspects of stochastic processes)
62F10 Point estimation
Full Text: DOI

References:

[1] Andrews, D.F.; Herzberg, A.M. 1985: Data. Springer-Verlag, New York
[2] Baum, L.E. 1972: An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes, Inequalities 3, 1–8
[3] Bickel, P.J.; Ritov, Y. 1993: Inference in hidden Markov models I: local asymptotic normality in the stationary case, Technical Report No. 383, Department of Statistics, University of California, Berkeley · Zbl 1066.62535
[4] Bodo, B.A.; Unny, T.E. 1987: On the outputs of the stochasticized Nash-Dooge linear reservoir cascade. Stochastic Hydrology IV, 131–147
[5] Dempster, A.P.; Laird, N.M.; Rubin, D.B. 1977: Maximum likelihood from incomplete data via the EM algorithm, J. Royal Statist. Soc. Series B 39, 1–38 · Zbl 0364.62022
[6] Fisher, R.A. 1925: Theory of statistical estimation. Proc. Camb. Phil. Soc. 22, 700–725 · JFM 51.0385.01 · doi:10.1017/S0305004100009580
[7] Gelfand, A.E.; Smith, A.F.M. 1990: Sampling-based approaches to calculating marginal densities, J. Amer. Statist. Assoc. 85, 398–409 · Zbl 0702.62020 · doi:10.2307/2289776
[8] Godambe, V.P. 1960: An optimal property of regular maximum likelihood estimation. Ann. Math. Statist. 31, 1208–1212 · Zbl 0118.34301 · doi:10.1214/aoms/1177705693
[9] Godambe, V.P. 1985: The foundations of finite sample estimation in stochastic processes, Biometrika 72, 419–428 · Zbl 0584.62135 · doi:10.1093/biomet/72.2.419
[10] Kitigawa, G. 1987: Non-Gaussian state-space modeling of nonstationary time series. J. Amer. Statist. Assoc. 82, 1032–1041 · Zbl 0644.62088 · doi:10.2307/2289375
[11] Krishnamurthy, V.; Elliott, R.J. 1993: A parallel filtered-based EM algorithm for hidden Markov model and sinusoidal drift parameter estimation, 32nd IEEE Conference on Decision and Control. San Antonio, Texas, Dec. 15–17, 1993. IEEE Press, New York, 726–731
[12] Küchler, U.; Sorensen, M. 1989: Exponential families of stochastic processes: A unifying semimartingale approach, International Statistical Review 57, 123–144 · Zbl 0721.60055 · doi:10.2307/1403382
[13] Leroux, B.C. 1992: Maximum likelihood methods for hidden Markov models. Stoch. Proc. and Appl. 40, 127–143 · Zbl 0738.62081 · doi:10.1016/0304-4149(92)90141-C
[14] McLeish, D.L. 1983: Martingales and estimating equations for censored and aggregate data, Technical Report No. 12, Laboratory for Research in Statistics and Probability, Carleton University
[15] McLeish, D.L. 1984: Estimation for aggregate models: The aggregate Markov chain, Canad. J. of Statist. 12, 265–282 · Zbl 0574.62084 · doi:10.2307/3314810
[16] Naik-Nimbalkar, U.V.; Rajarshi, M.B. 1992: Filtering and smoothing via estimating functions, In Recent Concepts in Statistical Inference, ed. J. Chen, Department of Statistics and Actuarial Science, University of Waterloo · Zbl 0818.62082
[17] Unny, T.E. 1987: Solutions to nonlinear stochastic differential equations in catchment modeling, Stochastic Hydrology IV, 87–111
[18] Unny, T.E.; Karmeshu 1984: Stochastic nature of outputs from conceptual reservoir model cascades, J. Hydrol. 68, 161–180 · doi:10.1016/0022-1694(84)90210-5
[19] West, M.P.; Harrison, P.J.; Migon, H.S. 1985: Dynamic generalized linear model and Bayesian forecasting, J. Amer. Statist. Assoc. 80, 732–796 · Zbl 0568.62032
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.