False discovery rate and permutation test: An evaluation in ERP data analysis

Statistics in Medicine

Volumn 29, Issue 1, 2010, Pages 63-74

  Lage Castellanos, Agustín ^a   Martínez Montes, Eduardo ^a   Hernández Cabrera, Juan A ^b   Galán, Lídice ^a  

^a CUBAN NEUROSCIENCE CENTER   (Cuba)

^b UNIVERSIDAD DE LA LAGUNA   (Spain)

Author keywords

ERP; False discovery rate; Multiple comparisons; Permutation tests

Indexed keywords

ARTICLE; COMPARATIVE STUDY; DATA ANALYSIS; ELECTRIC POTENTIAL; EVENT RELATED POTENTIAL; FALSE DISCOVERY RATE; FALSE POSITIVE RESULT; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; NORMAL HUMAN; NULL HYPOTHESIS; SCALP; STATISTICAL ANALYSIS;

COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; EVOKED POTENTIALS; FALSE POSITIVE REACTIONS; HUMANS;

EID: 74849106603     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3784     Document Type: Article

References (48)

1. Fisher RA. The Design of Experiments (1st edn). Oliver and Boyd: Edinburgh, 1935.
2. Handy T. Event-Related Potentials. The MIT Press: Cambridge, 2004.
3. Goodman S. Toward evidence-based medical statistics. 1: the p value fallacy. Annals of Internal Medicine 1999; 130(12):995-1004.
4. Bobes MA, Lopera F, Díaz-Comas L, Galan L, Carbonell F, Bringas ML, Valdés-Sosa M. Brain potentials reflect residual face processing in a case of prosopagnosia. Cognitive Neurophysiology 2004; 21(7):691-718. DOI: 10.1080/0264329034200025.
5. Bobes MA, Quiñones I, Perez J, Leon I, Valdes-Sosa M. Brain potentials reflect access to visual and emotional memories for faces. Biological Psychology 2007; 75:146-153. DOI: 10.1016/j.biopsycho. 2007.01.006.
6. Jennings JR, Cohen MJ, Ruchkin DS, Fridlund AJ. Editorial policy on analysis of variance with repeated measures. Psychophysiology 1987; 24(4):474-478. DOI: 10.1111/j.1469-8986.1987.tb00320.x.
7. Kiebel SJ, Friston K. Statistical parametric mapping for event-related potentials: 1 generic considerations. Neuroimage 2004; 22:492-502. DOI: 10.1016/j.neuroimage.2004.02.012.
8. Carbonell F, Galan L, Valdes P, Worsley K, Biscay RJ, Diaz-Comas L, Bobes MA, Parra M. Random field-union intersection tests for EEG/MEG imaging. NeuroImage 2004; 22:268-276. DOI: 10.1016/j.neuroimage.2004.01. 020.
9. Picton T, Bentin S, Berg P, Donchin E, Hillyard S, Johnson R, Miller G, Ritter W, Ruchkin D, Rugg M, Taylor M. Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology 2000; 37(2):127-152. DOI: 10.1111/1469-8986. 3720127.
10. Goodman S. Multiple comparison, explained. American Journal of Epidemiology 1998; 147:807-812. DOI: 10.1080/02643290342000258.
11. Yandell BS. Practical Data Analysis for Designed Experiments (1st edn). Chapman & Hall: London, 1997.
12. Worsley KJ, Marett S, Neelin P, Vandal A, Friston K, Evans A. A unified statistical approach for determining significant signals in images of cerebral activation. Human Brain Mapping 1996; 4:58-73. DOI: 10.1002/(SICI)1097-0193(1996)4.
13. Bosch-Bayard JJ, Valdés-Sosa PA, Virues-Alba T, Aubert-Vázquez E, John E, Harmony T, Riera-Díaz J, Trujillo-Barreto N. 3D statistical parametric mapping of EEG source spectra by means of variable resolution electromagnetic tomography (VARETA). Clinical Electroencephalography 2001; 32:47-61.
14. Kilner JM, Kiebel SJ, Friston KJ. Applications of random field theory to electrophysiology. Neuroscience Letters 2005; 374:174-178. DOI: 10.1016/j.neulet.2004.10.052.
15. Edgington ES. Statistical Inference: The Distribution Free Approach. McGraw-Hill: New York, 1969.
16. Raz J. Analysis of repeated measurements using nonparametric smoothers and randomization tests. Biometrics 1989; 45:851-871.
17. Westfall PH, Young SS. Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment. Wiley: New York, 1993.
18. Blair RC, Karniski W. An alternative method for significance testing of waveform difference potential. Psychophysiology 1993; 30:518-524. DOI: 10.1111/j.1469-8986.1993.tb02075.x.
19. Holmes AP, Blair RC, Watson JDG, Ford I. Non-parametric analysis of statistic images from functional mapping experiments. Journal of Cerebral Blood Flow and Metabolism 1996; 16:7-22. DOI: 10.1097/00004647- 199601000-00002.
20. Galán L, Biscay R, Rodríguez JL, Ábalo C, Rodríguez R. Testing topographic differences between event related brain potentials by using non-parametric combinations of permutation tests. Electroencephalography and Clinical Neurophysiology 1997; 102:240-247. DOI: 10.1016/S0013-4694(96)95155-3.
21. Manly BFJ. Randomization, Bootstrap, and Monte-Carlo Methods in Biology. Chapman & Hall: London, 1997.
22. Pesarin F. Multivariate Permutation Tests. Wiley: New York, 2001.
23. Nichols T, Holmes A. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Human Brain Mapping 2001; 15(1):1-25. DOI: 10.1002/hbm.1058.
24. Bobes MA, Lopera F. Covert matching of unfamiliar faces in a case of prosopagnosia: an erp study. Cortex 2003; 39(1):41-56. DOI: 10.1080/02643290342000258.
25. Maris E, Oostenveld R. Nonparametric statistical testing of EEG- and MEG-data. Journal of Neuroscience Methods 2007; 164(1):177-190. DOI: 10.1016/j.jneumeth.2007.03.024.
26. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B 1995; 57(1):289-300.
27. Efron B. Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. Journal of American Statistical Association 2004; 99:96-104. DOI: 10.1198/016214504000000089.
28. Ge Y, Sealfon SC, Tseng CH, Speed TP. A Holm-type procedure controlling the false discovery rate. Statistics and Probability Letters 2007; 77(12):1756-1762. DOI: 10.1016/j.spl.2007.04.019.
29. Langers D, Jansen J, Backes W. Enhanced signal detection in neuroimaging by means of regional control of the global false discovery rate. NeuroImage 2007; 38(1):43-56. DOI: 10.1016/j.neuroimage.2007.07. 031.
30. Finos L, Salmaso L. FDR- and FWE-controlling methods using data-driven weights. Journal of Statistical Planning and Inference 2007; 137(12):3859-3870. DOI: 10.1016/j.jspi.2007.04.004.
31. Ploner A, Calza S, Gusnanto A, Pawitan Y. Multidimensional local false discovery rate for microarray studies. Bioinformatics 2006; 22(5):556-565. DOI: 10.1093/bioinformatics/btk013.
32. Schwartzman A. Empirical null and false discovery rate inference for exponential families. Annals of Applied Statistics 2008; 2(4):1332-1359. DOI: 10.1214/08-AOAS184.
33. Robin S, Avner BH, Daudin JJ, Pierre L. A semi-parametric approach for mixture models: application to local false discovery rate estimation. Computational Statistics and Data Analysis 2007; 51(12):5483-5493. DOI: 10.1016/j.csda.2007.02.028.
34. Xie Y, Pan W, Khodursky AB. A note on using permutation-based false discovery rate estimates to compare different analysis methods for microarray data. Bioinformatics 2005; 21(23):4280-4288. DOI: 10.1093/bioinformatics/bti685.
35. Genovese C, Lazar N, Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002; 15(N 1053-8119):870-878. DOI: 10.1006/nimg.2001.1037.
36. Sánchez-Bornot J, Martínez-Montes E, Lage-Castellanos A, Vega M, Valdés P. Uncovering sparse brain effective connectivity: a voxel-based approach using penalized regression. Statistica Sinica 2008; 18(4):1501-1518.
37. Marchini J, Presanis A. Comparing methods of analyzing fMRI statistical parametric maps. NeuroImage 2004; 22:1203-1213. DOI: 10.1016/j.neuroimage.2004.03.030.
38. Martínez-Montes E, Cuspineda E, El-Deredy W, Sánchez-Bornot J, Lage-Castellanos A, Valdés P. Exploring event-related brain dynamics with tests on complex valued time-frequency representations. Statistics in Medicine 2007; 27(15):2922-2947. DOI: 10.1002/sim.3132.
39. Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Annals of Statistics 2001; 29(4):1165-1188. DOI: 10.1214/aos/1013699998.
40. Storey JD. A direct approach to false discovery rates. Journal of the Royal Statistical Society Series B 2002; 64:479-498. DOI: 10.1111/1467-9868.00346.
41. Qian HR, Huang S. Comparison of false discovery rate methods in identifying genes with differential expression. Genomics 2005; 86(4):495-503. DOI: 10.1016/j.ygeno.2005.06.007.
42. Storey JD. The positive false discovery rate: a Bayesian interpretation and the q-value. Annals of Statistics 2003; 31(6):2013-2035. DOI: 10.1214/aos/1074290335.
43. Chumbley RJ, Friston KJ. False discovery rate revisited: FDR and topological inference using Gaussian random fields. NeuroImage 2009; 44(1):62-70. DOI: 10.1016/j.neuroimage.2008.05.021.
44. Yeung N, Bogacz R, Holroyd C, Cohen J. Detection of synchronized oscillations in the electroencephalogram: an evaluation of methods. Psychophysiology 2004; 41:822-832. DOI: 10.1111/j.1469-8986.2004. 00239.x.
45. Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd edn). Lawrence Erlbaum: NJ, 1988.
46. Delplanque S, Silvert L, Hot P, Rigoulot S, Sequeira H. Arousal and valence effects on event-related P3a and P3b during emotional categorization. International Journal of Psychophysiology 2006; 60(3):315-322. DOI: 10.1016/j.ijpsycho.2005.06.006.
47. Lewis PA, Critchley HD, Rotshtein P, Dolan RJ. Neural correlates of processing valence and arousal in affective words. Cerebral Cortex 2007; 17(3):742-748. DOI: 10.1093/cercor/bhk024.
48. Fernández A. Factores que modulan el componente positivo temprano frontal asociados a los estímulos de alto valor emocional. Master Thesis, Cuban Neuroscience Center, Havana, 2009.