Convolutional neural networks for P300 detection with application to brain-computer interfaces

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 3, 2011, Pages 433-445

  Cecotti, Hubert ^a   Gräser, Axel ^a  

^a UNIVERSITY OF BREMEN   (Germany)

Author keywords

brain computer interface (BCI); convolution; electroencephalogram (EEG); gradient based learning; Neural network; P300; spatial filters

Indexed keywords

COMPUTER INTERFACES; ELECTROENCEPHALOGRAM (EEG); GRADIENT-BASED LEARNING; P300; SPATIAL FILTERS;

BRAIN; BRAIN MODELS; CLASSIFIERS; COMPUTER NETWORKS; CONVOLUTION; ELECTROENCEPHALOGRAPHY; INTERFACES (COMPUTER); NEURAL NETWORKS; TIME DOMAIN ANALYSIS;

BRAIN COMPUTER INTERFACE;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BRAIN; COMPUTER INTERFACE; COMPUTER PROGRAM; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; EVOKED RESPONSE; HUMAN; INSTRUMENTATION; METHODOLOGY; PHYSIOLOGY; SIGNAL PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BRAIN; ELECTROENCEPHALOGRAPHY; EVENT-RELATED POTENTIALS, P300; EVOKED POTENTIALS; HUMANS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 79551544230     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2010.125     Document Type: Article

References (44)

1. B.Z. Allison, E.W. Wolpaw, and J.R. Wolpaw, "Brain-Computer Interface Systems: Progress and Prospects," Expert Rev. Medical Devices, vol. 4, no. 4, pp. 463-474, 2007.
2. N. Birbaumer and L.G. Cohen, "Brain-Computer Interfaces: Communication and Restoration of Movement in Paralysis," J. Physiology-London, vol. 579, no. 3, pp. 621-636, 2007.
3. A. Kostov and M. Polak, "Parallel Man-Machine Training in Development of EEG-Based Cursor Control," IEEE Trans. Rehabilitation Eng., vol. 8, no. 2, pp. 203-205, June 2000.
4. N. Birbaumer, N. Ghanayim, T. Hinterberger, I. Iversen, B. Kotchoubey, A. Kübler, J. Perelmouter, E. Taub, and H. Flor, "A Spelling Device for the Paralysed," Nature, vol. 398, pp. 297-298, 1999.
5. B. Blankertz, G. Dornhege, S. Lemm, M. Krauledat, G. Curio, and K.-R. Müller, "The Berlin Brain-Computer Interface: EEG-Based Communication without Subject Training," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 14, no. 2, pp. 147-152, June 2006.
6. F. Lotte, M. Congedo, A. Lecuyer, F. Lamarche, and B. Arnaldi, "A Review of Classification Algorithms for EEG-Based Brain-Computer Interfaces," J. Neural Eng., vol. 4, pp. R1-R13, 2007.
7. K.-R. Müller, M. Krauledat, G. Dornhege, G. Curio, and B. Blankertz, "Machine Learning Techniques for Brain-Computer Interfaces," Biomedical Technology, vol. 49, no. 1, pp. 11-22, 2004.
8. K.-R. Müller, M. Tangermann, G. Dornhege, M. Krauledat, G. Curio, and B. Blankertz, "Machine Learning for Real-Time Single-Trial EEG-Analysis: From Brain-Computer Interfacing to Mental State Monitoring," J. Neuroscience Methods, vol. 167, no. 1 pp. 82-90, 2008.
9. C.W. Anderson, S.V. Devulapalli, and E.A. Stolz, "Determining Mental State from EEG Signals Using Parallel Implementations of Neural Networks," Proc. IEEE Workshop Neural Networks for Signal in Processing, pp. 475-483, 1995.
10. H. Cecotti and A. Gräser, "Time Delay Neural Network with Fourier Transform for Multiple Channel Detection of Steady-State Visual Evoked Potential for Brain-Computer Interfaces," Proc. European Signal Processing Conf., 2008.
11. T. Felzer and B. Freisieben, "Analyzing EEG Signals Using the Probability Estimating Guarded Neural Classifier," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 11, no. 4, pp. 361-371, Dec. 2003.
12. E. Haselsteiner and G. Pfurtscheller, "Using Time Dependent Neural Networks for EEG Classification," IEEE Trans. Rehabilitation Eng., vol. 8, no. 4, pp. 457-463, Dec. 2000.
13. N. Masic and G. Pfurtscheller, "Neural Network Based Classification of Single-Trial EEG Data," Artificial Intelligence in Medicine, vol. 5, no. 6, pp. 503-513, 1993.
14. N. Masic, G. Pfurtscheller, and D. Flotzinger, "Neural Network-Based Predictions of Hand Movements Using Simulated and Real EEG Data," Neurocomputing, vol. 7, no. 3, pp. 259-274, 1995.
15. B. Blankertz, G. Curio, and K.-R. Müller, "Classifying Single Trial EEG: Towards Brain Computer Interfacing," Advances in Neural Information Processing Systems, T.G. Diettrich, S. Becker, and Z. Ghahramani, eds., vol. 14, pp. 157-164, MIT Press, 2002.
16. A. Rakotomamonjy and V. Guigue, "BCI Competition III: Data Set II-Ensemble of SVMs for BCI p300 Speller," IEEE Trans. Biomedical Eng., vol. 55, no. 3, pp. 1147-1154, Mar. 2008.
17. B. Obermaier, C. Guger, C. Neuper, and G. Pfurtscheller, "Hidden Markov Models for Online Classification of Single Trial EEG data," Pattern Recognition Letters, vol. 22, no. 12, pp. 1299-1309, 2001.
18. S. Zhong and J. Gosh, "HMMs and Coupled HMMs for MultiChannel EEG Classification," Proc. IEEE Int'l Joint Conf. Neural Networks, vol. 2, pp. 1154-1159, 2002.
19. A. Hiraiwa, K. Shimohara, and Y. Tokunaga, "EEG Topography Recognition by Neural Networks," IEEE Eng. in Medicine and Biology Magazine, vol. 9, no. 3, pp. 39-42, Sept. 1990.
20. Y. Bengio and Y. LeCun, "Scaling Learning Algorithms towards AI," Large-Scale Kernel Machines, L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, eds., MIT Press, 2007.
21. P.Y. Simard, D. Steinkraus, and J.C. Platt, "Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis," Proc. Seventh Int'l Conf. Document Analysis and Recognition, pp. 958-962, 2003.
22. S. Sukittanon, A.C. Surendran, J.C. Platt, and C.J.C. Burges, "Convolutional Networks for Speech Detection," Proc. Eighth Int'l Conf. Spoken Language Processing, pp. 1077-1080, 2004.
23. D.J. Krusienski, E.W. Sellers, D. McFarland, T.M. Vaughan, and J.R. Wolpaw, "Toward Enhanced P300 Speller Performance," J. Neuroscience Methods, vol. 167, pp. 15-21, 2008.
24. E. Donchin, K.M. Spencer, and R. Wijesinghe, "Assessing the Speed of a P300-Based Brain-Computer Interface," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 8, no. 2, pp. 174-179, June 2000.
25. L. Farwell and E. Donchin, "Talking Off the Top of Your Head: Toward a Mental Prosthesis Utilizing Event-Related Brain Potentials," Electroencephalography and Clinical Neurophysiology, vol. 70, pp. 510-523, 1988.
26. B. Blankertz, K.-R. Müller, D.J. Krusienski, G. Schalk, J.R. Wolpaw, A. Schlögl, G. Pfurtscheller, J.R. Millán, M. Schröder, and N. Birbaumer, "The BCI Competition. III: Validating Alternative Approaches to Actual BCI Problems," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 14, no. 2, pp. 153-159, June 2006.
27. G. Schalk, D.J. McFarland, T. Hinterberger, N. Birbaumer, and J. Wolpaw, "BCI2000: A General-Purpose Brain-Computer Interface (BCI) System," IEEE Trans. Biomedical Eng., vol. 51, no. 6, pp. 1034-1043, June 2004.
28. G.-E. Sharbrough, R.P. Chatrian, H. Lesser, M. Luders, T.W. Nuwer, and T.W. Picton, "American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature," J. Clinical Neurophysiology, vol. 8, pp. 200-202, 1991.
29. L. Breiman, "Bagging Predictors," Machine Learning, vol. 26, no. 2 pp. 123-140, 1996.
30. U. Hoffmann, G. Garcia, J.-M. Vesin, K. Diserens, and T. Ebrahimi, "Boosting Approach to p300 Detection with Application to Brain-Computer Interfaces," Proc. IEEE Conf. Neural Eng., pp. 97-100, 2005.
31. Y. LeCun, F.-J. Huang, and L. Bottou, "Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
32. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
33. Y. LeCun, L. Bottou, G. Orr, and K.-R. Müller, "Efficient Backprop," Neural Networks: Tricks of the Trade, G. Orr and K. Muller, eds., Springer, 1998.
34. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas, "On Combining Classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, Mar. 1998.
35. K. Chellapilla, S. Puri, and P.Y. Simard, "High Performance Convolutional Neural Networks for Document Processing," Proc. 10th Int'l Workshop Frontiers in Handwriting Recognition, 2006.
36. R.J. Meuth and D.C. Wunsch, "Approximate Dynamic Programming and Neural Networks on Game Hardware," Proc. Int'l Joint Conf. Neural Networks, 2007.
37. H. Serby, E. Yom-Toy, and G.F. Inbar, "An Improved P300-Based Brain-Computer Interface," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 13, no. 1, pp. 89-98, Mar. 2005.
38. J.R. Wolpaw, N. Birbaumer, D.J. McFarland, G. Pfurtscheller, and T.M. Vaughan, "Brain-Computer Interfaces for Communication and Control," Clinical Neurophysiology, vol. 113, pp. 767-791, 2002.
39. C.E. Shannon and W. Weaver, The Mathematical Theory of Communication. Univ. of Illinois Press, 1964.
40. B. Blankertz, "BCI Competition III-Final Results," http://ida.first.fraunhofer.de/projects/bci/competition-iii/results/, 2008.
41. U. Hoffmann, G. Garcia, J.M. Vesin, and T. Ebrahimi, "Application of the Evidence Framework to Brain-Computer Interfaces," Proc. Conf. IEEE Eng. Medicine and Biology Soc., vol. 1, pp. 446-449, 2004.
42. N. Liang and L. Bougrain, "Averaging Techniques for Single-Trial Analysis of Oddball Event-Related Potentials," Proc. Fourth Int'l BCI Workshop and Training Course, pp. 44-49, 2008.
43. B. Blankertz, "BCI Competition III Webpage," http://ida.first. fraunhofer.de/projects/bci/competition-iii, 2008.
44. B. Blankertz, K.-R. Müller, G. Curio, T.M. Vaughan, G. Schalk, J.R. Wolpaw, A. Schlögl, C. Neuper, G. Pfurtscheller, T. Hinterberger, M. Schröder, and N. Birbaumer, "The BCI Competition 2003: Progress and Perspectives in Detection and Discrimination of EEG Single Trials," IEEE Trans. Biomedical Eng., vol. 51, no. 6, pp. 1044-1051, June 2004.