Adaptive classification on brain-computer interfaces using reinforcement signals

Neural Computation

Volumn 24, Issue 11, 2012, Pages 2900-2923

  Llera, A ^a,b   Gomez V ^a,b   Kappen, H J ^a,b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b RADBOUD UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BRAIN COMPUTER INTERFACE; HUMAN; REINFORCEMENT; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BRAIN-COMPUTER INTERFACES; HUMANS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REINFORCEMENT (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84874207140     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00348     Document Type: Article

References (40)

1. Bishop, C. M. (2007). Pattern recognition and machine learning. NewYork: Springer.
2. Blankertz, B., Dornhege, G., Schäfer, C., Krepki, R., Kohlmorgen, J., Müller, K. R., et al. (2004). Boosting bit rates and error detection for the classification of fastpaced motor commands based on single-trial EEG analysis. IEEE Transactions on Biomedical Engineering, 51, 993-1002.
3. Blankertz, B., Kawanabe, M., Tomioka, R., Hohlefeld, F., Nikulin, V., & Müller, K. R. (2008). Invariant common spatial patterns: Alleviating nonstationarities in brain-computer interfacing. In J. C. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in neural information processing systems, 20 (pp. 113-120). Cambridge, MA: MIT Press.
4. Blumberg, J., Rickert, J.,Waldert, S., Schulze-Bonhage,A., Aertsen, A.,&Mehring, C. (2007). Adaptive classification for brain computer interfaces. In Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 2536-2539). Piscataway, NJ: IEEE Press.
5. Chavarriaga, R., Ferrez, P. W., & Millán, J. del R. (2007). To err is human: Learning from error potentials in brain-computer interfaces. In Proceedings of the International Conference on Cognitive Neurodynamics (pp. 777-782). New York: Springer.
6. Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience: Computational and mathematical modeling of neural systems. Cambridge, MA: MIT Press.
7. Ferrez, P. W. (2007). Error-related EEG potentials in brain-computer interfaces. Unpublished doctoral dissertation, Ecole polytechnique fédérale de Lausanne EPFL.
8. Ferrez, P.W.,&Millán, J. del R. (2008). Error-related EEG potentials generated during simulated brain-computer interaction. IEEE Transactions on Biomedical Engineerings, 55, 923-929.
9. Fukunaga, K. (1990). Introduction to statistical pattern recognition. Orlando, Fl: Academic Press.
10. Gan, J. G. (2006). Self-adapting BCI based on unsupervised learning. In Proceedings of the 3rd International Workshop on Brain-Computer Interfaces (pp. 50-51). New York: Springer.
11. Hasan, B.A.S., & Gan, J. Q. (2009a). Unsupervised adaptive GMM for BCI. In Proceedings of the International IEEE EMBS Conf. on Neural Engineering (pp. 295-298). New York: Springer.
12. Hasan, B.A.S., & Gan, J. Q. (2009b). Sequential EM for unsupervised adaptive gaussian mixture model based classifier. NewYork: Springer.
13. Heskes, T., Gielen, S.,&Kappen, H. J. (1991).Neural networks learning in a changing environment. In T. Kohonen, K. Makisara, O. Simula, & J. Kangas (Eds.), Artificial neural networks (vol. 1, pp. 15-20). Amsterdam: North-Holland.
14. Heskes, T., & Kappen, H. J. (1991). Learning processes in neural networks. Physical Review A, 44, 2718-2726.
15. Heskes, T., & Kappen, H. J. (1992). Learning-parameter adjustment in neural networks. Physical Review A, 45, 8885-8893.
16. Kawanabe, M., Krauledat, M., & Blankertz, B. (2006). A Bayesian approach for adaptive BCI classification. In Proceedings of the 3rd International Brain-Computer Interface Workshop and Training Course 2006 (pp. 54-55). Graz: Verlag der Technischen Universität Graz.
17. Krauledat, M. (2008). Analysis of nonstationarities in EEG signals for improving braincomputer interfaces performance. Unpublished doctoral dissertations, Technische Universität Berlin.
18. Leeb, R., Sagha, H., & Chavarriaga, R. andMillan, J. del R. (2010).Multimodal fusion of muscle and brain signals for a hybrid-BCI. In Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 4343-4346). Piscataway, NJ: IEEE.
19. Lemm, S., Blankertz, B., Curio, G., & Müller, K. R. (2005). Spatio-spectral filters for improved classification of single trial EEG. IEEE Trans. Biomed. Eng, 52, 1541-1548.
20. Li, Y., & Guan, C. (2006). An extended EM algorithm for joint feature extraction and classification in brain-computer interfaces. Neural Computation, 18, 2730-2761.
21. Liu, G., Huang, G., Meng, J., Zhang, D., & Zhu, X. (2010). Improved GMM with parameter initialization for unsupervised adaptation of brain-computer interface. International Journal for Numerical Methods in Biomedical Engineering, 26, 681-691.
22. Llera, A., van Gerven, M.A.J., Gómez, V., Jensen, O., & Kappen, H. J. (2011). On the use of interaction error potentials for adaptive brain computer interfaces. Neural Networks, 24, 1120-1127.
23. Millán, J. del R. (2004).On the need for on-line learning in brain-computer interfaces. IEEE Proc. of the Int. Joint Conf. on Neural Networks, 4, 2877-2882.
24. Müller-Gerking, J., Pfurtscheller, G., & Flyvbjerg, H. (1998). Designing optimal spatial filters for single-trial EEG classification in a movement task. Clinical Neurophysiology, 110, 787-798.
25. Ramoser, H., Müller-Gerking, J., & Pfurtscheller, G. (1998). Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Transactions on Rehabilitation and Engineering, 8, 441-446.
26. Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71-80.
27. Reuderink, B., Farquhar, J., Poel, M., & Nijholt, A. (2011). A subject-independent brain-computer interface based on smoothed, second-order baselining. In Proceedings of the 33st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 4600-4604). Piscataway, NJ: IEEE.
28. Samek, W., Vidaurre, C., Müller, K. R., & Kawanabe, M. (2012). Stationary common spatial patterns for brain-computer interfacing. Journal of Neural Engineering, 9, 0260134.
29. Shenoy, P., Krauledat, M., Blankertz, B., Rao, R. P., & Müller, K. R. (2006). Towards adaptive classification for BCI. Journal of Neural Engineering, 3, R13-R23.
30. Sutton,R. S.,&Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
31. Sykacek, P., Roberts, S. J., & Stokes, M. (2004). Adaptive BCI based on variational Kalman filtering: An empirical evaluation. IEEE Transactions on Biomedical Engineering, 51, 719-727.
32. Tomioka, R., Hill, J. N., Blankertz, B., & Aihara, K. (2006). Adapting spatial filter methods for nonstationary BCIs. In Proceedings of 2006 Workshop on Information-Based Induction Sciences (pp. 65-70). Munich: Max Planck Society.
33. van Gerven, M., & Jensen, O. (2009). Attention modulations of posterior alpha as a control signal for two-dimensional brain-computer interfaces. Journal of Neuroscience Methods, 179, 78-84.
34. Vidaurre, C., & Blankertz, B. (2010). Towards a cure for BCI illiteracy. Brain Topogr., 23, 194-198.
35. Vidaurre, C., Kawanabe, M., von Bünau, P., Blankertz, B., & Müller, K. R. (2010). Toward an unsupervised adaptation of LDA for brain-computer interfaces. IEEE Trans. Biomed. Eng., 58, 587-597.
36. Vidaurre, C., Sannelli, C., Müller, K. R., & Blankertz, B. (2010). Machine-learning based co-adaptive calibration. Neural Computation, 23(3), 791-816.
37. Vidaurre, C., Schlöogl, A., Cabeza, R., Scherer, R., & Pfurtscheller, G. (2006). A fully on-line adaptive BCI. IEEE Transactions on Biomedical Engineering, 6, 1214-1219.
38. von Bünau, P., Meinecke, F. C., Scholler, S., &Müller, K. R. (2010). Finding stationary brain sources in EEG data. In Proceedings of the 32nd Annual Conference of the IEEE EMBS, 2010 (pp. 2810-2813). Piscataway, NJ: IEEE.
39. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M.(2002). Brain-computer interfaces for communication and control. Clinical Neurophysiology, 6, 767-791.
40. Zhou, Y., Mulekar, M. S., & Nerellapalli, P. (2005). Adaptive spam filtering using dynamic feature space. In Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence (pp. 302-309). Piscataway, NJ: IEEE.