Binary classification with pFDR-pFNR losses

Biometrical Journal

Volumn 55, Issue 3, 2013, Pages 463-477

  Dickhaus, Thorsten ^a   Blankertz, Benjamin ^b,c   Meinecke, Frank C ^b  

^a HUMBOLDT UNIVERSITY   (Germany)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

Author keywords

Autocorrelated data; Brain computer interfaces; Density ratio estimation; False discovery rate; Weak dependence

Indexed keywords

CLASSIFICATION (OF INFORMATION); ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; INTERFACES (COMPUTER); PROBABILITY DENSITY FUNCTION;

AUTO CORRELATION; AUTO-CORRELATED DATA; BINARY CLASSIFICATION; CLASSIFICATION APPROACH; DENSITY-RATIO ESTIMATIONS; FALSE DISCOVERY RATE; FEATURES VECTOR; MIXTURE MODELING; MULTIPLE TESTING; WEAK DEPENDENCES;

BRAIN COMPUTER INTERFACE;

EID: 84876955568     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.201200054     Document Type: Article

References (43)

1. Abramovich, F., Benjamini, Y., Donoho, D. L. and Johnstone, I. M. (2006). Adapting to unknown sparsity by controlling the false discovery rate. Annals of Statistics 34, 584-653, doi:10.1214/009053606000000074.
2. Benjamini, Y. (2010). Simultaneous and selective inference: current successes and future challenges. Biometrical Journal 52, 708-721.
3. Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B (Statistical Methodology) 57, 289-300.
4. Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis (2nd edn.). Springer Series in Statistics. Springer-Verlag, New York.
5. Blanchard, G., Lee, G. and Scott, C. (2010). Semi-supervised novelty detection. Journal of Machine Learning Research 11, 2973-3009.
6. Blanchard, G. and Roquain, E. (2008). Two simple sufficient conditions for FDR control. Electronic Journal of Statistics 2, 963-992.
7. Blanchard, G. and Roquain, E. (2009). Adaptive false discovery rate control under independence and dependence. Journal of Machine Learning Research 10, 2837-2871.
8. Blankertz, B., Lemm, S., Treder, M. S., Haufe, S. and Müller, K. R. (2011). Single-trial analysis and classification of ERP components-a tutorial. NeuroImage 56, 814-825, doi:10.1016/j.neuroimage.2010.06.048.
9. Blankertz, B., Sannelli, C., Halder, S., Hammer, E. M., Kübler, A., Müller, K. R., Curio, G. and Dickhaus, T. (2010a). Neurophysiological predictor of SMR-based BCI performance. NeuroImage 51, 1303-1309, doi:10.1016/j.neuroimage.2010.03.022.
10. Blankertz, B., Tangermann, M., Vidaurre, C., Fazli, S., Sannelli, C., Haufe, S., Maeder, C., Ramsey, L. E., Sturm, I., Curio, G. and Müller, K. R. (2010b). The Berlin Brain-Computer Interface: non-medical uses of BCI technology. Frontiers in Neuroscience 4, 198, doi:10.3389/fnins.2010.00198. Open Access.
11. Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M. and Müller, K. R. (2008). Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Processing Magazine 25, 41-56, doi:10.1109/MSP.2008.4408441.
12. Bogdan, M., Chakrabarti, A., Frommlet, F. and Ghosh, J. K. (2011). Asymptotic Bayes-optimality under sparsity of some multiple testing procedures. Annals of Statistics 39, 1551-1579, doi:10.1214/1010.1214/10-AOS869AOS869.
13. Brockwell, P. J. and Davis, R. A. (1991). Time Series: Theory and Methods (2nd edn.). Springer Series in Statistics. Springer10.1214/10-AOS869Verlag, Berlin
14. Clarke, S. and Hall, P. (2009). Robustness of multiple testing procedures against dependence. Annals of Statistics 37, 332-358, doi:10.1214/0710.1214/07-AOS557AOS557.
15. DasGupta, A. (2008). Asymptotic Theory of Statistics and Probability. Springer Texts in Statistics. Springer, New York, NY
16. Dickhaus, T., Sannelli, C., Müller, K. R., Curio, G. and Blankertz, B. (2009). Predicting BCI performance to study BCI illiteracy. BMC Neuroscience 10 (Suppl 1), P84, doi:10.1186/14712202-10-S1-P84.
17. Do, K. A., Müller, P. and Tang, F. (2005). A Bayesian mixture model for differential gene expression. Journal of the Royal Statistical Society, Series B, Applied Statistics 54, 627-644, doi:10.1111/j.1467-9876.2005.05593.x.
18. Donoho, D. and Jin, J. (2008). Higher criticism thresholding: optimal feature selection when useful features are rare and weak. Proceedings of the National Academy of Sciences USA 105, 14790-14795.
19. Dornhege, G., del R. Millán, J., Hinterberger, T., McFarland, D. and Müller, K. R. (Eds.) (2007). Toward Brain-Computer Interfacing, MIT Press, Cambridge, MA.
20. Efron, B. (2003). Robbins, empirical Bayes and microarrays. Annals of Statistics 31, 366-378, doi:10.1214/aos/1051027871.
21. Efron, B. (2008). Microarrays, empirical bayes and the two-groups model. Statistical Science 23, 1-22.
22. Farcomeni, A. (2007). Some results on the control of the false discovery rate under dependence. Scandinavian Journal of Statistics 34, 275-297, doi:10.1111/j.1467-9469.2006.00530.x.
23. Finner, H., Dickhaus, T. and Roters, M. (2009). On the false discovery rate and an asymptotically optimal rejection curve. Annals of Statistics 37, 596-618, doi:10.1214/07-AOS569.
24. Freidlin, B., Jiang, W. and Simon, R. (2010). The cross10.1214/07-AOS569validated adaptive signature design. Clinical Cancer Research 16, 691-698.
25. Genovese, C. and Wasserman, L. (2004). A stochastic process approach to false discovery control. Annals of Statistics 32, 1035-1061, doi:10.1214/009053604000000283.
26. Gontscharuk, V. (2010). Asymptotic and Exact Results on FWER and FDR in Multiple Hypotheses Testing. Ph.D. thesis, Heinrich10.1214/07-AOS569Heine Universität, Düsseldorf.
27. Härdle, W., Müller, M., Sperlich, S. and Werwatz, A. (2004). Nonparametric and Semiparametric Models. Springer Series in Statistics. Springer, Berlin.
28. Hastie, T., Tibshirani, R. and Friedman, J. (2009). The Elements of Statistical Learning. Data Mining, Inference, and Prediction (2nd ed.). Springer Series in Statistics. Springer, New York, NY. doi:10.1007.b94608.
29. Hwang, J. N., Lay, S. R. and Lippman, A. (1994). Nonparametric multivariate density estimation: a comparative study. IEEE Transactions on Signal Processing 42, 2795-2810.
30. Lipkovich, I., Dmitrienko, A., Denne, J. and Enas, G. (2011) Subgroup identification based on differential effect search-a recursive partitioning method for establishing response to treatment in patient subpopulations. Statistics in Medicine 30, 2601-2621.
31. Müller, P., Parmigiani, G. and Rice, K. (2007). FDR and Bayesian multiple comparisons rules. In: J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West (eds.): Bayesian Statistics 8. Proceedings of ISBA 8th World Meeting on Bayesian Statistics. Oxford University Press, Oxford, pp. 349-370.
32. Müller, P., Parmigiani, G., Robert, C. and Rousseau, J. (2004). Optimal sample size for multiple testing: the case of gene expression microarrays. Journal of the American Statistical Association 99, 990-1001, doi:10.1198/016214504000001646.
33. Schmidt, N. M., Blankertz, B. and Treder, M. S. (2012). Online detection of error10.1214/07-AOS569related potentials boosts the performance of mental typewriters. BMC Neuroscience 13, 19, doi:10.1186/1471-2202-13-19.
34. Scott, C., Bellala, G. and Willett, R. (2009). The false discovery rate for statistical pattern recognition. Electronic Journal of Statistics 3, 651-677.
35. Silverman, B. (1986). Density Estimation for Statistics and Data Analysis. Monographs on Statistics and Applied Probability. Chapman and Hall, London, New York.
36. Storey, J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. Annals of Statistics 31, 2013-2035, doi:10.1214/aos/1074290335.
37. Storey, J. D., Taylor, J. E. and Siegmund, D. (2004). Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach. Journal of The Royal Statistical Society Series B (Statistical Methodology) 66, 187-205, doi:10.1111/j.1467-9868.2004.00439.x.
38. Sugiyama, M., Kanamori, T., Suzuki, T., Hido, S., Sese, J., Takeuchi, I. and Wang, L. (2009). A density-ratio framework for statistical data processing. IPSJ Transactions on Computer Vision and Applications 1, 183-208.
39. Tsui, C. S., Gan, J. Q. and Hu, H. (2011). A self-paced motor imagery based brain-computer interface for robotic wheelchair control. Clinical EEG and Neuroscience 42, 225-229.
40. Vapnik, V. N. (1995). The Nature of Statistical Learning Theory. Springer-Verlag, Berlin.
41. Vapnik, V. N. (1998). Statistical Learning Theory, Adaptive and Learning Systems for Signal Processing, Communications, and Control. Wiley, Chichester.
42. Williamson, J., Murray-Smith, R., Blankertz, B., Krauledat, M. and Müller, K. R. (2009). Designing for uncertain, asymmetric control: interaction design for brain-computer interfaces. International Journal of Human-Computer Studies 67, 827-841, doi:10.1016/j.ijhcs.2009.05.009.
43. Wolpaw, J. R. and Wolpaw, E. W. (Eds) (2012). Brain-Computer Interfaces: Principles and Practice. Oxford University Press, New York. ISBN-13: 978-0195388855.