Accounting for time dependence in large-scale multiple testing of event-related potential data. (English) Zbl 1454.62230
Summary: Event-related potentials (ERPs) are recordings of electrical activity along the scalp time-locked to perceptual, motor and cognitive events. Because ERP signals are often rare and weak, relative to the large between-subject variability, establishing significant associations between ERPs and behavioral (or experimental) variables of interest poses major challenges for statistical analysis.
Noting that ERP time dependence exhibits a block pattern suggesting strong local and long-range autocorrelation components, we propose a flexible factor modeling of dependence. An adaptive factor adjustment procedure is derived from a joint estimation of the signal and noise processes, given a prior knowledge of the noise-alone intervals. A simulation study is presented using known signals embedded in a real dependence structure extracted from authentic ERP measurements. The proposed procedure performs well compared with existing multiple testing procedures and is more powerful at discovering interesting ERP features.
Noting that ERP time dependence exhibits a block pattern suggesting strong local and long-range autocorrelation components, we propose a flexible factor modeling of dependence. An adaptive factor adjustment procedure is derived from a joint estimation of the signal and noise processes, given a prior knowledge of the noise-alone intervals. A simulation study is presented using known signals embedded in a real dependence structure extracted from authentic ERP measurements. The proposed procedure performs well compared with existing multiple testing procedures and is more powerful at discovering interesting ERP features.
MSC:
| 62J15 | Paired and multiple comparisons; multiple testing |
| 62P10 | Applications of statistics to biology and medical sciences; meta analysis |
References:
| [1] | Allen, G. I., Grosenick, L. and Taylor, J. (2014). A generalized least-square matrix decomposition. J. Amer. Statist. Assoc. 109 145-159. · Zbl 1367.62184 · doi:10.1080/01621459.2013.852978 |
| [2] | Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B. Stat. Methodol. 57 289-300. · Zbl 0809.62014 |
| [3] | Benjamini, Y. and Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188. · Zbl 1041.62061 · doi:10.1214/aos/1013699998 |
| [4] | Blair, R. C. and Karniski, W. (1993). An alternative method for significance testing of waveform difference potentials. Psychophysiology 30 518-524. |
| [5] | Buja, A. and Eyuboglu, N. (1992). Remarks on parallel analysis. Multivariate Behavioral Research 27 509-540. |
| [6] | Causeur, D. and Sheu, C. F. (2014). ERP: Significance analysis of Event-Related Potentials data. R package version 1.0.1. |
| [7] | Causeur, D., Friguet, C., Houée-Bigot, M. and Kloareg, M. (2011). Factor analysis for multiple testing (FAMT): An R package for large-scale significance testing under dependence. Journal of Statistical Software 40 1-19. |
| [8] | Causeur, D., Chu, M. C., Hsieh, S. and Sheu, C. F. (2012). A factor-adjusted multiple testing procedure for ERP data analysis. Behavior Research Methods 44 635-643. |
| [9] | Donoho, D. and Jin, J. (2008). Higher criticism thresholding: Optimal feature selection when useful features are rare and weak. Proc. Natl. Acad. Sci. USA 105 14790-14795. · Zbl 1357.62212 · doi:10.1073/pnas.0807471105 |
| [10] | Efron, B. (2007). Correlation and large-scale simultaneous significance testing. J. Amer. Statist. Assoc. 102 93-103. · Zbl 1284.62340 · doi:10.1198/016214506000001211 |
| [11] | Efron, B. (2010). Large-Scale Inference : Empirical Bayes Methods for Estimation , Testing , and Prediction. Institute of Mathematical Statistics ( IMS ) Monographs 1 . Cambridge Univ. Press, Cambridge. · Zbl 1277.62016 |
| [12] | Friguet, C., Kloareg, M. and Causeur, D. (2009). A factor model approach to multiple testing under dependence. J. Amer. Statist. Assoc. 104 1406-1415. · Zbl 1205.62071 · doi:10.1198/jasa.2009.tm08332 |
| [13] | Gardiner, J. M., Gawlik, B. and Richardson-Klavehn, A. (1994). Maintenance rehearsal affects knowing, not remembering: Elaborative rehearsal affects remembering, not knowing. Psychonomic Bulletin & Review 1 107-110. |
| [14] | Groppe, D. M., Urbach, T. P. and Kutas, M. (2011a). Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review. Psychophysiology 48 1711-1725. |
| [15] | Groppe, D. M., Urbach, T. P. and Kutas, M. (2011b). Mass univariate analysis of event-related brain potentials/fields II: Simulation studies. Psychophysiology 48 1726-1737. |
| [16] | Guthrie, D. and Buchwald, J. S. (1991). Significance testing of difference potentials. Psychophysiology 28 240-244. |
| [17] | Handy, T. (2004). Event-Related Potentials . MIT Press, Cambridge, MA. |
| [18] | Jin, J. (2009). Impossibility of successful classification when useful features are rare and weak. Proc. Natl. Acad. Sci. USA 106 8859-8864. · Zbl 1203.68064 · doi:10.1073/pnas.0903931106 |
| [19] | Johnson, H. M. (1994). Processes of successful intentional forgetting. Psychological Bulletin 116 274-292. |
| [20] | Jöreskog, K. G. (1967). Some contributions to maximum likelihood factor analysis. Psychometrika 32 443-482. · Zbl 0183.24603 · doi:10.1007/BF02289658 |
| [21] | Lage-Castellanos, A., Martínez-Montes, E., Hernández-Cabrera, J. A. and Galán, L. (2010). False discovery rate and permutation test: An evaluation in ERP data analysis. Stat. Med. 29 63-74. |
| [22] | Lee, Y. S., Lee, H. M. and Fawcett, J. M. (2013). Intentional forgetting reduces color-naming interference: Evidence from item-method directed forgetting. Journal of Experimental Psychology. Learning , Memory and Cognition 39 220-236. |
| [23] | Leek, J. T. and Storey, J. D. (2008). A general framework for multiple testing dependence. Proc. Natl. Acad. Sci. USA 105 18718-18723. · Zbl 1359.62202 · doi:10.1073/pnas.0808709105 |
| [24] | Leek, J. T., Johnson, W. E., Parker, H. S., Jaffe, A. E. and Storey, J. D. (2014). SVA: Surrogate Variable Analysis. R package version 3.6.0. |
| [25] | Mardia, K. V., Kent, J. T. and Bibby, J. M. (1979). Multivariate Analysis . Academic Press, London. · Zbl 0432.62029 |
| [26] | Näätänen, R. (2003). Mismatch negativity: Clinical research and possible applications. Int. J. Psychophysiol. 48 179-188. |
| [27] | Paz-Caballero, M. D. and Menor, J. (1999). ERP correlates of directed forgetting effects in direct and indirect memory tests. European Journal of Cognitive Psychology 11 239-260. |
| [28] | Poldrack, R. A., Mumford, J. A. and Nichols, T. E. (2011). Handbook of Functional MRI Data Analysis . Cambridge Univ. Press, Cambridge. · Zbl 1321.92015 · doi:10.1017/CBO9780511895029 |
| [29] | Press, W. H., Teukolsky, S. A., Vetterling, W. T. and Flannery, B. P. (2007). Numerical Recipes : The Art of Scientific Computing , 3rd ed. Cambridge Univ. Press, Cambridge. · Zbl 1132.65001 |
| [30] | Rosberg, T., Butrous, N. N. and Ford, J. M. (2008). Reduced auditory evoked potential component N100 in schizophrenia-A critical review. Psychiatric Research 161 259-274. |
| [31] | Rubin, D. B. and Thayer, D. T. (1982). EM algorithms for ML factor analysis. Psychometrika 47 69-76. · Zbl 0483.62046 · doi:10.1007/BF02293851 |
| [32] | Rugg, M. D. and Curran, T. (2007). Event-related potentials and recognition memory. Trends Cogn. Sci. ( Regul. Ed. ) 11 251-257. |
| [33] | Sheu, C. F., Perthame, E., Lee, Y. S. and Causeur, D. (2016). Supplement to “Accounting for time dependence in large-scale multiple testing of event-related potential data.” . · Zbl 1454.62230 |
| [34] | Sun, W. and Cai, T. T. (2009). Large-scale multiple testing under dependence. J. R. Stat. Soc. Ser. B. Stat. Methodol. 71 393-424. · Zbl 1248.62005 · doi:10.1111/j.1467-9868.2008.00694.x |
| [35] | Sun, Y., Zhang, N. R. and Owen, A. B. (2012). Multiple hypothesis testing adjusted for latent variables, with an application to the AGEMAP gene expression data. Ann. Appl. Stat. 6 1664-1688. · Zbl 1257.62115 · doi:10.1214/12-AOAS561 |
| [36] | Sun, Y., Zhang, N. R. and Owen, A. B. (2014). LEAPP: Latent effect adjustment after primary projection. R package version 1.1. |
| [37] | Thomson, G. H. (1951). The Factorial Analysis of Human Ability . London Univ. Press, London. · Zbl 0031.36703 |
| [38] | van der Laan, M. J. and Dudoit, S. (2007). Multiple Testing Procedures with Applications to Genomics . Springer, New York. · Zbl 1261.62014 · doi:10.1007/978-0-387-49317-6 |
| [39] | Vul, E., Harris, C., Winkielman, P. and Pashler, H. (2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect. Psychol. Sci. 4 274-290. |
| [40] | Weiner, B. (1968). Motivated forgetting and the study of repression. J. Pers. 36 213-234. |
| [41] | Westfall, P. H. and Young, S. S. (1993). Resampling-Based Multiple Testing : Examples and Methods for P-Value Adjustment . Wiley, New York. · Zbl 0850.62368 |
| [42] | Williams, L. M., Simms, E., Clark, C. R., Paul, R. H., Rowe, D. and Gordon, E. (2005). The test-retest reliability of a standardized neurocognitive and neurophysiological test battery: ”neuromarker”. Int. J. Neurosci. 115 1605-1630. |
| [43] | Woolrich, M. W., Beckmann, C. F., Nichols, T. E. and Smith, S. M. (2009). Statistical Analysis of FMRI Data. In fMRI techniques and protocols (M. Filippi, ed.). Humana Press, New York. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
