Single-trial classification of event-related potentials in rapid serial visual presentation tasks using supervised spatial filtering

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 11, 2014, Pages 2030-2042

  Cecotti, Hubert ^a,b   Eckstein, Miguel P ^a   Giesbrecht, Barry ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Brain computer interface (BCI); common spatial patterns (CSP); convolution; electroencephalogram (EEG); neural networks; rapid serial visual presentation (RSVP); spatial filters.

Indexed keywords

CONVOLUTION; NEURAL NETWORKS;

COMMON SPATIAL PATTERNS; ELECTRO-ENCEPHALOGRAM (EEG); EVENT RELATED POTENTIALS; RAPID SERIAL VISUAL PRESENTATIONS; SINGLE-TRIAL CLASSIFICATIONS; SPATIAL FILTERINGS; SPATIAL FILTERS;

BRAIN COMPUTER INTERFACE;

ADOLESCENT; ADULT; ALGORITHM; AREA UNDER THE CURVE; ARTIFICIAL NEURAL NETWORK; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEMALE; FILTRATION; HUMAN; MALE; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; RECEIVER OPERATING CHARACTERISTIC; SIGNAL PROCESSING; SUPPORT VECTOR MACHINE; VISION; YOUNG ADULT;

ADOLESCENT; ADULT; ALGORITHMS; AREA UNDER CURVE; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; FILTRATION; HUMANS; MALE; NEURAL NETWORKS (COMPUTER); PHOTIC STIMULATION; REACTION TIME; ROC CURVE; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUPPORT VECTOR MACHINES; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84908087726     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2302898     Document Type: Article

References (61)

1. S. J. Luck, A Introduction to the Event-Related Potential Technique. Cambridge, MA, USA: MIT Press, 2005.
2. S. J. Luck, G. F. Woodman, and E. K. Vogel, "Event-related potential studies of attention," Trends Cognit. Sci., vol. 4, no. 11, pp. 432-440, 2000.
3. J. Polich, "Updating P300: An integrative theory of P3a and P3b," Clin. Neurophysiol., vol. 118, no. 10, pp. 2128-2148, 2007.
4. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, 2002.
5. K.-R. Müller, M. Tangermann, G. Dornhege, M. Krauledat, G. Curio, and B. Blankertz, "Machine learning for real-time single-trial EEGanalysis: From brain-computer interfacing to mental state monitoring," J. Neurosci. Methods, vol. 167, no. 1, pp. 82-90, 2008.
6. L. Farwell and E. Donchin, "Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials," Electroencephalograph. Clin. Neurophysiol., vol. 70, no. 6, pp. 510-523, 1988.
7. B. Hong, F. Guo, T. Liu, X. Gao, and S. Gao, "N200-speller using motion-onset visual response," Clin. Neurophysiol., vol. 120, no. 9, pp. 1658-1666, 2009.
8. A. Rakotomamonjy and V. Guigue, "BCI competition III : Dataset II-ensemble of SVMs for BCI P300 speller," IEEE Trans. Biomed. Eng., vol. 55, no. 3, pp. 1147-1154, Mar. 2008.
9. H. Cecotti, "Spelling with non-invasive brain-computer interfaces-Current and future trends," J. Physiol. Paris, vol. 105, nos. 1-3, pp. 106-114, 2011.
10. P. Sajda, A. Gerson, and L. Parra, "High-throughput image search via single-trial event detection in a rapid serial visual presentation task," in Proc. 1st Int. IEEE EMBS Conf. Neural Eng., Capri Island, Italy, Mar. 2003, pp. 7-10.
11. Y. Huang, D. Erdogmus, M. Pavel, S. Mathan, and K. E. Hild, "A framework for visual image search using single-trial brain responses," Neurocomputing, vol. 74, pp. 2041-2051, Jun. 2011.
12. M. C. Potter, "Short-term conceptual memory for pictures," J. Experim. Psychol., Human Learn. Memory, vol. 2, no. 5, pp. 509-522, 1976.
13. M. M. Chun and C. M. Potter, "A two-stage model for multiple target detection in rapid serial visual presentation," J. Exp. Phys. Human Perception Perform., vol. 21, no. 1, pp. 109-127, 1995.
14. N. Bigdely-Shamlo, A. Vankov, R. R. Ramirez, and S. Makeig, "Brain activity-based image classification from rapid serial visual presentation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 16, no. 5, pp. 432-441, Oct. 2008.
15. A. Gerson, L. Parra, and P. Sajda, "Cortically-coupled computer vision for rapid image search," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 14, no. 2, pp. 174-179, Jun. 2006.
16. L. C. Parra, C. Christoforou, A. D. Gerson, M. Dyrholm, A. Luo, M. Wagner, et al., "Spatio-temporal linear decoding of brain State: Application to performance augmentation in high-throughput tasks," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 95-115, Jan. 2008.
17. E. A. Pohlmeyer, D. C. Jangraw, J. Wang, S. F. Chang, and P. Sajda, "Combining computer and human vision into a BCI: Can the whole be greater than the sum of its parts?" in Proc. 32nd Int. IEEE EMBC Conf., Buenos Aires, Argentina, Sep. 2010, pp. 138-141.
18. E. A. Pohlmeyer, J. Wang, D. C. Jangraw, B. Lou, S. Chang, and P. Sajda, "Closing the loop in cortically-coupled computer vision: A brain-computer interface for searching image databases," J. Neural Eng., vol. 8, no. 3, p. 036025, 2011.
19. J. Touryan, L. Gibson, H. J. Horne, and P. Weber, "Real-time measurement of face recognition in rapid serial visual representation," Frontiers Psychol., vol. 2, no. 42, pp. 1-8, 2011.
20. K. E. Hild, M. Kurimo, and V. D. Calhoun, "The sixth annual MLSP competition, 2010," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process., Kittila, Finland, Sep. 2010, pp. 107-111.
21. B. Rivet, A. Souloumiac, V. Attina, and G. Gibert, "xDAWN algorithm to enhance evoked potentials: Application to brain-computer interface," IEEE Trans. Biomed. Eng., vol. 56, no. 8, pp. 2035-2043, Aug. 2009.
22. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K.-R. Müller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 41-56, Jan. 2008.
23. L. Parra, C. Alvino, A. Tang, B. Pearlmutter, N. Yeung, A. Osman, et al., "Single trial detection in EEG and MEG: Keeping it linear," Neurocomputing, vols. 52-54, pp. 177-183, Mar. 2003.
24. U. Hoffmann, J. Vesin, K. Diserens, and T. Ebrahimi, "An efficient P300-based brain-computer interface for disabled subjects," J. Neurosci. Methods, vol. 167, no. 1, pp. 115-125, 2008.
25. B. Labbé, X. Tian, and A. Rakotomamonjy, "MLSP competition, 2010: Description of the third place method," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process., Kittila, Finland, Sep. 2010, pp. 116-117.
26. H. Cecotti and A. Gräser, "Convolutional neural networks for P300 detection with application to brain-computer interfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 433-445, Mar. 2011.
27. R. J. Johnson, "A triarchic model of P300 amplitude," Psychophysiology, vol. 23, no. 4, pp. 367-384, 1986.
28. C. J. Gonsalvez and J. Polich, "P300 amplitude is determined by targetto-target interval," Psychophysiology, vol. 39, no. 3, pp. 388-396, 2002.
29. B. Blankertz, M. Kawanabe, R. Tomioka, F. Hohlefeld, V. Nikulin, and K.-R. Müller, "Invariant common spatial patterns: Alleviating nonstationarities in brain-computer interfacing," in Advances in Neural Information Processing Systems, vol. 20, Cambridge, MA, USA: MIT Press, 2008, pp. 1-8.
30. C. Brunner, M. Naeem, R. Leeb, B. Graimann, and G. Pfurtscheller, "Spatial filtering and selection of optimized components in four class motor imagery EEG data using independent components analysis," Pattern Recognit. Lett., vol. 28, no. 8, pp. 957-964, 2007.
31. G. Pfurtscheller, C. Guger, and H. Ramoser, "EEG-based brain-computer interface using subject-specific spatial filters," in Proc. Int. Work Conf. Artif. Natural Neural Netw., vol. 2. Alicante, Spain, 1999, pp. 248-254.
32. R. Tomioka, N. J. Hill, B. Blankertz, and K. Aihara, "Adapting spatial filter methods for nonstationary BCIs," in Proc. Workshop Inf. Based Induction Sci., Osaka, Japan, 2006, pp. 1-6.
33. H. Cecotti, B. Rivet, M. Congedo, C. Jutten, O. Bertrand, E. Maby, et al., "A robust sensor selection method for P300 brain-computer interfaces," J. Neural Eng., vol. 8, no. 1, p. 016001, 2011.
34. B. Rivet, H. Cecotti, E. Maby, and J. Mattout, "Impact of spatial filters during sensor selection in a visual P300 brain-computer interface," Brain Topograph., vol. 12, no. 1, pp. 55-63, 2012.
35. B. Rivet and A. Souloumiac, "Optimal linear spatial filters for eventrelated potentials based on a spatio-temporal model: Asymptotical performance analysis," Signal Process., vol. 93, no. 2, pp. 387-398, 2013.
36. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed. Baltimore, MD, USA: Johns Hopkins Univ., 1996.
37. M. Krauledat, M. Tangermann, B. Blankertz, and K.-R. Müller, "Towards zero training for brain-computer interfacing," PLoS ONE, vol. 3, no. 8, p. e2967, 2008.
38. Q. Zhao, L. Zhang, A. Cichocki, and J. Li, "Incremental common spatial pattern algorithm for BCI," in Proc. IEEE Int. Joint Conf. Neural Netw., Hong Kong, Jun. 2008, pp. 2656-2659.
39. M. Arvaneh, G. Cuntai, K. K. Ang, and C. Quek, "Optimizing spatial filters by minimizing within-class dissimilarities in electroencephalogrambased brain-computer interface," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 4, pp. 610-619, Apr. 2013.
40. H. Zhang, H. Yang, and C. Guan, "Bayesian learning for spatial filtering in an EEG-based brain-computer interface," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 7, pp. 1049-1060, Jul. 2013.
41. D. J. C. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, no. 3, pp. 415-447, 1992
42. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
43. C.-C. Chang and C.-J. Lin. (2001). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu. tw/∼cjlin/libsvm
44. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
45. P. Y. Simard, D. Steinkraus, and J. C. Platt, "Best practices for convolutional neural networks applied to visual document analysis," in Proc. 7th Int. Conf. Document Anal. Recognit., Edinburgh, Scotland, U.K., 2003, pp. 958-962.
46. R. Hadsell, P. Sermanet, M. Scoffier, A. Erkan, K. Kavackuoglu, U. Muller, et al., "Learning long-range vision for autonomous off-road driving," J. Field Robot., vol. 26, no. 2, pp. 120-144, 2009.
47. H. Cecotti, "A time-frequency convolutional neural network for the offline classification of steady-state visual evoked potential responses," Pattern Recognit. Lett., vol. 32, no. 8, pp. 1145-1153, 2011.
48. P. Mirowski, D. Madhavan, Y. LeCun, and R. Kuzniecky, "Classification of patterns of EEG synchronization for seizure prediction," Clin. Neurophysiol., vol. 120, no. 11, pp. 1927-1940, 2009.
49. Y. Bengio and Y. LeCun, "Scaling learning algorithms towards AI," in Large-Scale Kernel Machines, L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, Eds. Cambridge, MA, USA: MIT Press, 2007.
50. Y. LeCun, L. Bottou, G. Orr, and K. R. Müller, "Efficient backprop," in Neural Networks: Tricks of the Trade, G. Orr, Ed. New York, NY, USA: Springer-Verlag, 1998.
51. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, no. 6088, pp. 533-536, 1986.
52. T. Fawcett, "An introduction to ROC analysis," Pattern Recognit. Lett., vol. 27, no. 8, pp. 861-874, 2006.
53. N. Troje and H. H. Bülthoff, "Face recognition under varying poses: The role of texture and shape," Vis. Res., vol. 36, no. 12, pp. 1761-1771, 1996.
54. F. Sharbrough, G. Chatrian, and R. P. E. A. Lesser, Guidelines for Standard Electrode Position Nomenclature. Bloomfield, IL, USA: Amer. EEG Soc., 1990.
55. J. M. Leiva and S. M. M. Martens, "MLSP competition, 2010: Description of the first place method," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process., Kittila, Finland, Sep. 2010, pp. 112-113.
56. C. Cortes and M. Mohri, "AUC optimization vs. error rate minimization," in Advances in Neural Information Processing Systems. Vancouver, BC, Canada: MIT Press, 2003, pp. 1-8.
57. R. Tomioka and K. R. Müller, "A regularized discriminative framework for EEG analysis with application to brain-computer interface," Neuroimage, vol. 49, no. 1, pp. 415-432, 2010.
58. E. K. Vogel, S. J. Luck, and K. L. Shapiro, "Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink," J. Experim. Psychol., Human Perception Perform., vol. 24, no. 6, pp. 1656-1674, 1998.
59. M. Kutas, G. McCarthy, and E. Donchin, "Augmenting mental chronometry: The p300 as a measure of stimulus evaluation time," Science, vol. 197, no. 4305, pp. 792-795, 1977.
60. H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio, "An empirical evaluation of deep architectures on problems with many factors of variation," in Proc. 24th Int. Conf. Mach. Learn., Corvallis, OR, USA, 2007, pp. 473-480.
61. L. Acqualagna, M. S. Treder, M. Schreuder, and B. Blankertz, "A novel brain-computer interface based on the rapid serial visual presentation paradigm," in Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. , Buenos Aires, Argentina, Sep. 2010, pp. 2686-2689.