Effects of statistical dependence on multiple testing under a hidden Markov model. (English) Zbl 1209.62192
Summary: The performance of multiple hypothesis testing is known to be affected by the statistical dependence among random variables involved. The mechanisms responsible for this, however, are not well understood. We study the effects of the dependence structure of a finite state hidden Markov model (HMM) on the likelihood ratios critical for optimal multiple testing on the hidden states. Various convergence results are obtained for the likelihood ratios as the observations of the HMM form an increasing long chain. Analytic expansions of the first and second order derivatives are obtained for the case of binary states, explicitly showing the effects of the parameters of the HMM on the likelihood ratios.
MSC:
| 62M02 | Markov processes: hypothesis testing |
| 62H15 | Hypothesis testing in multivariate analysis |
| 60J20 | Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) |
References:
| [1] | Atar, R. and Zeitouni, O. (1997). Exponential stability for nonlinear filtering. Ann. Inst. H. Poincaré Probab. Statist. 33 697-725. · Zbl 0888.93057 · doi:10.1016/S0246-0203(97)80110-0 |
| [2] | Atar, R. and Zeitouni, O. (1997). Lyapunov exponents for finite state nonlinear filtering. SIAM J. Control Optim. 35 36-55. · Zbl 0940.93073 · doi:10.1137/S0363012994272046 |
| [3] | Baxendale, P., Chigansky, P. and Liptser, R. (2004). Asymptotic stability of the Wonham filter: Ergodic and nonergodic signals. SIAM J. Control Optim. 43 643-669 (electronic). · Zbl 1101.93074 · doi:10.1137/S0363012902416924 |
| [4] | Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300. JSTOR: · Zbl 0809.62014 |
| [5] | Benjamini, Y. and Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188. · Zbl 1041.62061 · doi:10.1214/aos/1013699998 |
| [6] | Chi, Z. (2008). False discovery rate control with multivariate p -values. Electron. J. Stat. 2 368-411. · Zbl 1320.62100 · doi:10.1214/07-EJS147 |
| [7] | Chigansky, P. and Liptser, R. (2004). Stability of nonlinear filters in nonmixing case. Ann. Appl. Probab. 14 2038-2056. · Zbl 1065.93034 · doi:10.1214/105051604000000873 |
| [8] | Chigansky, P. and Liptser, R. (2006). On a role of predictor in the filtering stability. Electron. Comm. Probab. 11 129-140 (electronic). · Zbl 1111.60022 |
| [9] | Di Masi, G. B. and Stettner, Ł. (2005). Ergodicity of hidden Markov models. Math. Control Signals Systems 17 269-296. · Zbl 1098.93036 · doi:10.1007/s00498-005-0153-8 |
| [10] | Douc, R. and Matias, C. (2001). Asymptotics of the maximum likelihood estimator for general hidden Markov models. Bernoulli 7 381-420. · Zbl 0987.62018 · doi:10.2307/3318493 |
| [11] | Douc, R., Moulines, É. and Rydén, T. (2004). Asymptotic properties of the maximum likelihood estimator in autoregressive models with Markov regime. Ann. Statist. 32 2254-2304. · Zbl 1056.62028 · doi:10.1214/009053604000000021 |
| [12] | Efron, B. (2007). Correlation and large-scale simultaneous significance testing. J. Amer. Statist. Assoc. 102 93-103. · Zbl 1284.62340 · doi:10.1198/016214506000001211 |
| [13] | Efron, B., Tibshirani, R., Storey, J. D. and Tusher, V. G. (2001). Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96 1151-1160. JSTOR: · Zbl 1073.62511 · doi:10.1198/016214501753382129 |
| [14] | Farcomeni, A. (2007). Some results on the control of the false discovery rate under dependence. Scand. J. Statist. 34 275-297. · Zbl 1142.62048 · doi:10.1111/j.1467-9469.2006.00530.x |
| [15] | Fleming, W. H. and Hernández-Hernández, D. (1999). Risk-sensitive control of finite state machines on an infinite horizon. II. SIAM J. Control Optim. 37 1048-1069 (electronic). · Zbl 0933.93078 · doi:10.1137/S0363012997321498 |
| [16] | Hall, P. and Jin, J. (2008). Properties of higher criticism under strong dependence. Ann. Statist. 36 381-402. · Zbl 1139.62049 · doi:10.1214/009053607000000767 |
| [17] | Kaijser, T. (1975). A limit theorem for partially observed Markov chains. Ann. Probab. 3 677-696. · Zbl 0315.60038 · doi:10.1214/aop/1176996308 |
| [18] | Kochman, F. and Reeds, J. (2006). A simple proof of Kaijser’s unique ergodicity result for hidden Markov \alpha -chains. Ann. Appl. Probab. 16 1805-1815. · Zbl 1121.60077 · doi:10.1214/105051606000000367 |
| [19] | Le Gland, F. and Mevel, L. (2000). Basic properties of the projective product with application to products of column-allowable nonnegative matrices. Math. Control Signals Systems 13 41-62. · Zbl 0941.93012 · doi:10.1007/PL00009860 |
| [20] | Le Gland, F. and Mevel, L. (2000). Exponential forgetting and geometric ergodicity in hidden Markov models. Math. Control Signals Systems 13 63-93. · Zbl 0941.93053 · doi:10.1007/PL00009861 |
| [21] | Müller, P., Parmigiani, G., Robert, C. and Rousseau, J. (2004). Optimal sample size for multiple testing: The case of gene expression microarrays. J. Amer. Statist. Assoc. 99 990-1001. · Zbl 1055.62127 · doi:10.1198/016214504000001646 |
| [22] | Owen, A. B. (2005). Variance of the number of false discoveries. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 411-426. JSTOR: · Zbl 1069.62102 · doi:10.1111/j.1467-9868.2005.00509.x |
| [23] | Qiu, X., Klebanov, L. and Yakovlev, A. (2005). Correlation between gene expression levels and limitations of the empirical Bayes methodology for finding differentially expressed genes. Stat. Appl. Genet. Mol. Biol. 4 Art. 34, 32 pp. (electronic). · doi:10.2202/1544-6115.1157 |
| [24] | Rudin, W. (1976). Principles of Mathematical Analysis . McGraw-Hill, New York. · Zbl 0346.26002 |
| [25] | Sarkar, S. K. (2006). False discovery and false nondiscovery rates in single-step multiple testing procedures. Ann. Statist. 34 394-415. · Zbl 1091.62060 · doi:10.1214/009053605000000778 |
| [26] | Storey, J. D. (2007). The optimal discovery procedure: A new approach to simultaneous significance testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 69 347-368. · doi:10.1111/j.1467-9868.2007.005592.x |
| [27] | Sun, W. and Cai, T. T. (2009). Large scale multiple testing under dependency. J. Roy. Statist. Soc. Ser. B 71 393-424. · Zbl 1248.62005 |
| [28] | Tadić, V. B. and Doucet, A. (2005). Exponential forgetting and geometric ergodicity for optimal filtering in general state-space models. Stochastic Process. Appl. 115 1408-1436. · Zbl 1074.60051 · doi:10.1016/j.spa.2005.03.005 |
| [29] | Wu, W. B. (2008). On false discovery control under dependence. Ann. Statist. 36 364-380. · Zbl 1139.62040 · doi:10.1214/009053607000000730 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
