Spelling with non-invasive Brain-Computer Interfaces - Current and future trends

Journal of Physiology Paris

Volumn 105, Issue 1-3, 2011, Pages 106-114

  Cecotti, Hubert ^a  

^a CNRS   (France)

Author keywords

Brain Computer Interface (BCI); Electroencephalography (EEG); Human Computer Interaction; Motor imagery; P300; Speller; Steady State Visual Evoked Potentials (SSVEP); Virtual keyboard

Indexed keywords

BRAIN COMPUTER INTERFACE; EVENT RELATED POTENTIAL; EVOKED VISUAL RESPONSE; HUMAN; REVIEW; SENSORIMOTOR CORTEX; SIGNAL PROCESSING; SPELLING; STEADY STATE; STIMULUS RESPONSE; VISUAL INFORMATION; VISUAL MEMORY; VISUAL STIMULATION;

BRAIN; COMMUNICATION AIDS FOR DISABLED; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; HUMANS; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 82555165848     PISSN: 09284257     EISSN: 17697115     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2011.08.003     Document Type: Review

References (77)

1. Acqualagna, L., Treder, M.S., Schreuder, M., Blankertz, B., 2010. A novel brain-computer interface based on the rapid serial visual presentation paradigm. In: Annual International Conference of the IEEE. Engineering in Medicine and Biology Society (EMBC), pp. 2686-2689.
2. Allison, B.Z., 2009. The i of BCIs: Next Generation Interfaces for Brain-Computer Interface Systems that Adapt to Individual Users. LNCS - Human-Computer Interaction. Novel Interaction Methods and Techniques, pp. 558-568.
3. Allison B.Z., Wolpaw E.W., Wolpaw J.R. Brain-computer interface systems: progress and prospects. Expert Rev. Med. Dev. 2007, 4(4):463-474.
4. Allison B.Z., Lüth T., Valbuena D., Teymourian A., Volosyak I., Gräser A. BCI demographics: how many (and what kinds of) people can use an SSVEP BCI?. IEEE Trans. Neural Syst. Rehab. Eng. 2010.
5. Aricò, P., Aloise, F., Schettini, F., Riccio, A., Salinari, S., Babiloni, F., Mattia, D., Cincotti, F., 2010. GeoSpell: an alternative p300-based speller interface towards no eye gaze required. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 158-159.
6. Bin G., Gao X., Yan Z., Hong B., Gao S.K. An online multi-channel SSVEP-based braincomputer interface using a canonical correlation analysis method. J. Neural Eng. 2009, 6.
7. Birbaumer N., Cohen L.G. Brain-computer interfaces: communication and restoration of movement in paralysis. J. Physiol. - London 2007, 579(3):621-636.
8. Birbaumer N., Ghanayim N., Hinterberger T., Iversen I., Kotchoubey B., Kübler A., Perelmouter J., Taub E., Flor H. A spelling device for the paralysed. Nature 1999, 398:297-298.
9. Birbaumer N., Kübler A., Ghanayim N., Hinterberger T., Perelmouter J., Kaiser J., Iversen I., Kotchoubey B., Neumann N., Flor H. The thought translation device (TTD) for completely paralyzed patients. IEEE Trans. Rehab. Eng. 2000, 8(2):190-193.
10. Blankertz, B., Dornhege, G., Krauledat, M., Schröder, M., Williamson, J., Murray-Smith, R., Müller, K.-R., 2006. The berlin brain-computer interface presents the novel mental typewriter hex-o-spell. In: Proc. of the 3rd International Brain-Computer Interface Workshop and Training Course 2006, pp. 108-109.
11. Brouwer A.-M., van Erp J.B.F. A tactile p300 brain-computer interface. Front. Neurosci. 2010, 4(19).
12. Brunner P., Joshi S., Briskin S., Wolpaw J.R., Bischof H., Schalk G. Does the 'P300' speller depend on eye gaze?. J. Neural Eng. 2010, 7(5).
13. Brunner P., Bianchi L., Guger C., Cincotti F., Schalk G. Current trends in hardware and software for brain-computer interfaces (BCIs). J. Neural Eng. 2011, 8.
14. Cecotti H. A self-paced and calibration-less SSVEP based brain-computer interface speller. IEEE Trans. Neural Syst. Rehab. Eng. 2010, 18:127-133.
15. Cecotti, H., Gräser, A., 2008. Convolutional neural network with embedded Fourier transform for EEG classification. In: Proc. of the 19th International Conference on Pattern Recognition.
16. Cecotti H., Gräser A. Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 2010.
17. Cecotti, H., Rivet, B., 2010a. One step beyond rows and columns flashes in the P300 speller: a theoretical description. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 61-62.
18. Cecotti, H., Rivet, B., 2010b. A pilot study for improving the graphical user interface of P300 based BCIs. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 54-55.
19. Cecotti, H., Volosyak, I., Gräser, A., 2009. Evaluation of an SSVEP based brain-computer interface on the command and application levels. In: 4th IEEE EMBS International Conference on Neural Engineering.
20. Cecotti, H., Rivet, B., Congedo, M., Jutten, C., Bertrand, O., Maby, E., Mattout, J., 2010. Suboptimal sensor subset evaluation in a p300 brain-computer interface. In: Proc. of the 18th European Signal Processing Conference.
21. Cecotti H., Rivet B., Congedo M., Jutten C., Bertrand O., Maby E., Mattout J. A robust sensor selection method for P300 brain-computer interfaces. J. Neural Eng. 2011, 8.
22. Cincotti F., Mattia D., Aloise F., Bufalari S., Schalk G., Oriolo G., Cherubini A., Marciani M.G., Babiloni F. Non-invasive brain-computer interface system: towards its application as assistive technology. Brain Res. Bull. 2008, 75:796-803.
23. D'Albis, T., 2009. A Predictive Speller for a Brain-Computer Interface based on Motor-Imagery. Master Thesis.
24. Donchin E., Spencer K.M., Wijesinghe R. Assessing the speed of a P300-based brain-computer interface. IEEE Trans. Neural Syst. Rehab. Eng. 2000, 8(2):174-179.
25. Farwell L., Donchin E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 1988, 70:510-523.
26. Friman O., Volosyak I., Gräser A. Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces. IEEE Trans. Biomed. Eng. 2007, 54(4):742-750.
27. Gao X.R., Xu D.F., Cheng M., Gao S.K. A BCI based environmental controller for the motion-disabled. IEEE Trans. Rehab. Eng. 2003, 11(2):137-140.
28. Gargiulo G., Calvo R.A., Bifulco P., Cesarelli M., Jin C., Mohamed A., Schaik A.v. A new EEG recording system for passive dry electrodes. Clin. Neurophysiol. 2010, 121:686-693.
29. Gartner, 1995. http://www.gartner.com/technology/research/.
30. Gtec., 2010. Intendix. Guger Technologies. http://www.gtec.at/.
31. Guger C., Edlinger G., Harkam W., Niedermayer I., Pfurtscheller G. How many people are able to operate an EEG-based brain-computer interface (BCI)?. IEEE Trans. Neural Syst. Rehab. Eng. 2003, 11(2):145-147.
32. Guger C., Daban S., Sellers E., Holznera C., Krausza G., Carabalonac R., Gramaticac F., Edlinger G. How many people are able to control a P300-based brain-computer interface (BCI)?. Neurosci. Lett. 2009, 462:94-98.
33. Hoffmann U., Vesin J., Diserens K., Ebrahimi T. An efficient P300-based brain-computer interface for disabled subjects. J. Neurosci. Methods 2008, 167(1):115-125.
34. Jin J., Allison B.Z., Brunner C., Wang B., Wang X., Zhang J., Neuper C., Pfurtscheller G. P300 Chinese input system based on Bayesian LDA. Biomed. Eng. 2010, 55(1):5-18.
35. Kostov A., Polak M. Parallel man-machine training in development of EEG-based cursor control. IEEE Trans. Rehab. Eng. 2000, 8(2):203-205.
36. Krusienski D.J., Sellers E.W., Cabestaing F., Bayoudh S., McFarland D.J., Vaughan T.M., Wolpaw J.R. A comparison of classification techniques for the P300 speller. J. Neural Eng. 2006, 3:299-305.
37. Lalor E.C., Kelly S.P., Finucane C., Burke R., Smith R., Reilly R.B., McDarby G. Steady-state VEP-based brain-computer interface control in an immersive 3d gaming environment. EURASIP J. Appl. Signal Process. 2006, 19:3156-3164.
38. Liang, N., Bougrain, L., 2008. Averaging techniques for single-trial analysis of oddball event-related potentials. In: Proc. of the 4th International BCI Workshop and Training Course, pp. 44-49.
39. Li Y., Nam C.S., Shadden B.B., Johnson S.L. A P300-based brain-computer interface: effects of interface type and screen size. Int. J. Hum.-Comput. Interact. 2011, 27(1):52-68.
40. Lu S., Guan C., Zhang H. Unsupervised brain-computer interface based on inter-subject information and online adaptation. IEEE Trans. Neural Syst. Rehab. Eng. 2009, 17(2):1-11.
41. Lüth, T., Ojdanic, D., Friman, O., Prenzel, O., Gräser, A., 2007. Low level control in a semi-autonomous rehabilitation robotic system via a brain-computer interface. In: IEEE 10th International Conference on Rehabilitation Robotics, ICORR 2007, pp. 721-728.
42. Mak J.N., Arbel Y., Minett J.W., McCane L.M., Yuksel B., Ryan D., Thompson D., Bianchi L., Erdogmus D. Optimizing the P300-based brain-computer interface: current status, limitations and future directions. J. Neural Eng. 2011, 8.
43. Mason S.G., Birch G.E. A general framework for brain-computer interface design. IEEE Trans. Neural Syst. Rehab. Eng. 2003, 11(1):70-85.
44. Mason S.G., Moore Jackson M.M., Birch G.E. A general framework for characterizing studies of brain interface technology. Ann. Biomed. Eng. 2005, 33(11):1653-1670.
45. Millán J.d.R., Rupp R., Müller-Putz G.R., Murray-Smith R., Giugliemma C., Tangermann M., Vidaurre C., Cincotti F., Kübler A., Leeb R., Neuper C., Müller K.-R., Mattia D. Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges. Front. Neurosci. 2010, 4.
46. Müller K.-R., Tangermann M., Dornhege G., Krauledat M., Curio G., Blankertz B. Machine learning for real-time single-trial EEG-analysis: from brain-computer interfacing to mental state monitoring. J. Neurosci. Methods 2008, 167(1):82-90.
47. Müller-Putz G.R., Pfurtscheller G. Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Trans. Biomed. Eng. 2008, 55:361-362.
48. Müller-Putz G.R., Scherer R., Brauneis C., Pfurtscheller G. Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components. J. Neural Eng. 2005, 2(1):123-130.
49. Müller-Putz G., Scherer R., Neuper C., Pfurtscheller G. Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces. IEEE Trans. Neural Syst. Rehab. Eng. 2006, 14:30-37.
50. Pfurtscheller G., Brendan A., Bauernfeind G., Brunner C., Escalante T.S., Scherer R., Zander T.O., Mueller-Putz G., Neuper C., Birbaumer N. The hybrid BCI. Front. Neuroprosthet. 2010, 4(30).
51. Rakotomamonjy A., Guigue V. BCI competition III: Dataset II - ensemble of SVMs for BCI P300 speller. IEEE Trans. Biomed. Eng. 2008, 55(3):1147-1154.
52. Renard Y., Lotte F., Gibert G., Congedo M., Maby E., Delannoy V., Bertrand O., Lecuyer A. Openvibe: an open-source software platform to design, test, and use brain-computer interfaces in real and virtual environments. Presence: Teleoper. Virt. Environ. 2010, 19(1):35-53.
53. Rivet B., Cecotti H., Maby E., Mattout J. Impact of spatial filters during sensor selection in a visual P300 brain-computer interface. Brain Topogr. 2011, 1-9.
54. Ryan D.B., Frye G.E., Townsend G., Berry D.R., Mesa-G S., Gates N.A., Sellers E.W. Predictive spelling with a P300-based brain-computer interface: increasing the rate of communication. Int. J. Hum.-Comput. Interact. 2011, 27:69-84.
55. Schalk G., McFarland D.J., Hinterberger T., Birbaumer N., Wolpaw J. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 2004, 51(6):1034-1043.
56. Scherer R., Müller G.R., Neuper C., Graimann B., Pfurtscheller G. An asynchronously controlled EEG-based virtual keyboard: Improvement of the spelling rate. IEEE Trans. Biomed. Eng. 2004, 51(6):979-984.
57. Schreuder M., Blankertz B., Tangermann M. A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative cue. PLOS One 2010, 5(4).
58. Sellers E.W., Vaughan T.M., Wolpaw J.R. A brain-computer interface for long-term independent home use. Amyotr. Lateral Sclerosis 2010, 11(5):449-455.
59. Sullivan, T.J., Deiss, S.R., Jung, T.-P., Cauwenberghs, G., 2008. A brain-machine interface using dry-contact, low-noise EEG sensors. In: IEEE Int. Symp. Circuits and Systems (ISCAS), pp. 1986-1989.
60. Sutton S., Braren M., Zubin J., John E.R. Evoked potential correlates of stimulus uncertainty. Science 1965, 150:1187-1188.
61. Takano K., Komatsu T., Hata N., Nakajima Y., Kansaku K. Visual stimuli for the P300 brain-computer interface: a comparison of white/gray and green/blue flicker matrices. Clin. Neurophysiol. 2009, 120:1562-1566.
62. Tangermann, M., Schreuder, Martijn Dähne, S., Höhne, J., Regler, S., Ramsay, A., Quek, M., Williamson, J., Murray-Smith, R., 2010. Optimized stimulation events for a visual ERP BCI. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 14-15.
63. Thulasidas, M., Guan, C., 2005. Optimization of BCI speller based on p300 potential. In: Conf. Proc. IEEE Eng. Med. Biol. Soc., p. 5.
64. Townsend G., LaPallo B.K., Boulay C.B., Krusienski D.J., Frye G.E., Hauser C.K., Schwartz N.E., Vaughan T.M., Wolpaw J.R., Sellers E.W. A novel P300-based brain-computer interface stimulus presentation paradigm: moving beyond rows and columns. Clin. Neurophysiol. 2010.
65. Treder M., Blankertz B. (C)overt attention and visual speller design in an ERP-based brain-computer interface. Behav. Brain Funct. 2010, 6(28).
66. Treder, M.S., Schmidt, N., Blankertz, B., 2010. Gaze-independent visual brain-computer interfaces. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 33-34.
67. Valbuena, D., Sugiarto, I., Gräser, A., 2008. Spelling with the bremen brain-computer interface and the integrated SSVEP stimulator. In: Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course, pp. 291-296.
68. Van de Laar, B., Nijboer, F., Gürkök, H., Bos, D.P.-O., Nijholt, A., 2010. User experience evaluation in BCI: bridge the gap. In: Proc. of the TOBI (tools for brain-computer interaction) Workshop II, pp. 162-163.
69. Vaughan T.M., McFarland D.J., Schalk G., Sarnacki W.A., Krusienski D.J., Sellers E.W., Wolpaw J.R. The wadsworth BCI research and development program: at home with BCI. IEEE Trans. Neural Syst. Rehab. Eng. 2006, 14(2):229-233.
70. Vialatte F., Maurice M., Dauwels J., Cichocki A. Steady-state visually evoked potentials: focus on essential paradigms and future perspectives. Prog. Neurobiol. 2010, 90(4):418-438.
71. Vidaurre C., Blankertz B. Towards a cure for BCI illiteracy. Brain Topogr. 2009.
72. Volosyak, I., Cecotti, H., Valbuena, D., Gräser, A., 2009. Evaluation of the bremen SSVEP based BCI in real world conditions. In: 11th International IEEE Conference on Rehabilitation Robotics, pp. 322-331.
73. Williamson J., Murray-Smith R., Blankertz B., Krauledat M., Müller K.-R. Designing for uncertain, asymmetric control: interaction design for brain-computer interfaces. Int. J. Hum.-Comput. Stud. 2009, 67:827-841.
74. Wolpaw J.R. Brain-computer interface research comes of age: traditional assumptions meet emerging realities. J. Motor Behav. 2010, 42(6):351-353.
75. Wolpaw J.R., Birbaumer N., McFarland D.J., Pfurtscheller G., Vaughan T.M. Brain-computer interfaces for communication and control. Clin. Neurophysiol. 2002, 113:767-791.
76. Wu Z., Lai Y., Wu D., Yao D. Stimulator selection in SSVEP-based BCI. Int. J. Med. Eng. Phys. 2008, 30(8):1079-1088.
77. Zhu D., Bieger J., Garcia G., M.A.R. A survey of stimulation methods used in SSVEP-based BCIs. Comput. Intell. Neurosci. 2010, 2010:12.