Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models. (English) Zbl 1452.62531
Summary: Several tests for a zero random effect variance in linear mixed models are compared. This testing problem is non-regular because the tested parameter is on the boundary of the parameter space. Size and power of the different tests are investigated in an extensive simulation study that covers a variety of important settings. These include testing for polynomial regression versus a general smooth alternative using penalized splines. Among the test procedures considered, three are based on the restricted likelihood ratio test statistic (RLRT), while six are different extensions of the linear model \(F\)-test to the linear mixed model. Four of the tests with unknown null distributions are based on a parametric bootstrap, the other tests rely on approximate or asymptotic distributions. The parametric bootstrap-based tests all have a similar performance. Tests based on approximate \(F\)-distributions are usually the least powerful among the tests under consideration. The chi-square mixture approximation for the RLRT is confirmed to be conservative, with corresponding loss in power. A recently developed approximation to the distribution of the RLRT is identified as a rapid, powerful and reliable alternative to computationally intensive parametric bootstrap procedures. This novel method extends the exact distribution available for models with one random effect to models with several random effects.
MSC:
| 62J10 | Analysis of variance and covariance (ANOVA) |
| 62F03 | Parametric hypothesis testing |
| 62F40 | Bootstrap, jackknife and other resampling methods |
| 62-08 | Computational methods for problems pertaining to statistics |
References:
| [1] | Bates, D., Sarkar, D., lme4: Linear mixed-effects models using S4 classes. R package version 0.995-2; Bates, D., Sarkar, D., lme4: Linear mixed-effects models using S4 classes. R package version 0.995-2 |
| [2] | Brumback, B. A.; Ruppert, D.; Wand, M. P., Comment on Variable selection and function estimation in additive nonparametric regression using a data-based prior, J. Amer. Statist. Assoc., 94, 794-797 (1999) |
| [3] | Cantoni, E.; Hastie, T., Degrees-of-freedom tests for smoothing splines, Biometrika, 89, 2, 251-263 (2002) · Zbl 1019.62038 |
| [4] | Crainiceanu, C.; Ruppert, D., Likelihood ratio tests in linear mixed models with one variance component, JRSS-B, 66, 1, 165-185 (2004) · Zbl 1061.62027 |
| [5] | Crainiceanu, C., Ruppert, D., Claeskens, G., Wand, M., 2002. Likelihood ratio tests of polynomial regression against a general nonparametric alternative. Technical report, Department of Statistical Science, Cornell University. URL: http://www.orie.cornell.edu/ davidr/papers/CRCW.ps; Crainiceanu, C., Ruppert, D., Claeskens, G., Wand, M., 2002. Likelihood ratio tests of polynomial regression against a general nonparametric alternative. Technical report, Department of Statistical Science, Cornell University. URL: http://www.orie.cornell.edu/ davidr/papers/CRCW.ps |
| [6] | Crainiceanu, C.; Ruppert, D.; Claeskens, G.; Wand, M., Exact likelihood ratio tests for penalised splines, Biometrika, 92, 1, 91-103 (2005) · Zbl 1068.62021 |
| [7] | Eilers, P.; Marx, B., Flexible smoothing with \(B\)-splines and penalties, Statist. Sci., 11, 2, 89-121 (1996) · Zbl 0955.62562 |
| [8] | Fahrmeir, L.; Kneib, T.; Lang, S., Penalized structured additive regression for space-time data: A Bayesian perspective, Statist. Sinica, 14, 731-761 (2004) · Zbl 1073.62025 |
| [9] | Fai, A. H.-T.; Cornelius, P. L., Approximate \(F\)-tests of multiple degree of freedom hypotheses in generalized least squares analyses of unbalanced split-plot experiments, J. Stat. Comput. Simul., 54, 4, 363-378 (1996) · Zbl 0925.62081 |
| [10] | Gong, G.; Samaniego, F. J., Pseudo maximum likelihood estimation: Theory and applications, Ann. Statist., 9, 4, 861-869 (1981) · Zbl 0471.62032 |
| [11] | Greven, S., Crainiceanu, C.M., Küchenhoff, H., Peters, A., 2007. Restricted likelihood ratio testing for zero variance components in linear mixed models, J. Comp. Graph. Statist. (in press); Greven, S., Crainiceanu, C.M., Küchenhoff, H., Peters, A., 2007. Restricted likelihood ratio testing for zero variance components in linear mixed models, J. Comp. Graph. Statist. (in press) |
| [12] | Hastie, T.; Tibshirani, R., Generalized Additive Models (1990), CRC Press · Zbl 0747.62061 |
| [13] | Kammann, E. E.; Wand, M. P., Geoadditive models, JRSS-C, 52, 1, 1-18 (2003) · Zbl 1111.62346 |
| [14] | Kenward, M. G.; Roger, J. H., Small sample inference for fixed effects from restricted maximum likelihood, Biometrics, 53, 3, 983-997 (1997) · Zbl 0890.62042 |
| [15] | Lang, S.; Brezger, A., Bayesian \(P\)-splines, J. Comp. Graph. Statist., 13, 1, 183-212 (2004) |
| [16] | Lin, T.-H.; Harville, D. A., Some alternatives to Wald’s confidence interval and test, J. Amer. Statist. Assoc., 86, 413, 179-187 (1991) |
| [17] | McLean, R. A.; Sanders, W. L.; Stroup, W. W., A unified approach to mixed linear models, Amer. Statist., 45, 1, 54-64 (1991) |
| [18] | Morrell, C. H., Likelihood ratio testing of variance components in the linear mixed-effects model using restricted maximum likelihood, Biometrics, 54, 4, 1560-1568 (1998) · Zbl 1058.62541 |
| [19] | Pinheiro, J.; Bates, D., Mixed-Effects Models in \(S\) and \(S\)-Plus (2000), Springer · Zbl 0953.62065 |
| [20] | R Development Core Team, 2006. R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria. URL: http://www.R-project.org; R Development Core Team, 2006. R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria. URL: http://www.R-project.org |
| [21] | Ruppert, D.; Wand, M.; Carroll, R., Semiparametric Regression (2003), Cambridge University Press · Zbl 1038.62042 |
| [22] | SAS/STAT User’s Guide, Version 9.1 (2003), SAS Institute Inc.: SAS Institute Inc. Cary, NC, USA |
| [23] | Seely, J.; El-Bassiouni, Y., Applying Wald’s variance component test, Ann. Statist., 11, 1, 197-201 (1983) · Zbl 0516.62028 |
| [24] | Self, S.; Liang, K.-Y., Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions, J. Amer. Statist. Assoc., 82, 398, 605-610 (1987) · Zbl 0639.62020 |
| [25] | Stram, D.; Lee, J.-W., Variance components testing in the longitudinal mixed effects model, Biometrics, 50, 3, 1171-1177 (1994) · Zbl 0826.62054 |
| [26] | Verbeke, G.; Molenberghs, G., The use of score tests for inference on variance components, Biometrics, 59, 2, 254-262 (2003) · Zbl 1210.62013 |
| [27] | Wald, A., A note on regression analysis, Ann. Math. Stat., 18, 4, 586-589 (1947) · Zbl 0029.30703 |
| [28] | Wood, S., Generalized Additive Models (2006), Chapman and Hall · Zbl 1087.62082 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
