Out of the frying pan into the fire-the P300-based BCI faces real-world challenges

Progress in Brain Research

Volumn 194, Issue , 2011, Pages 27-46

  Kleih, Sonja C ^a   Kaufmann, Tobias ^a   Zickler, Claudia ^b   Halder, Sebastian ^b   Leotta, Francesco ^c   Cincotti, Febo ^c   Aloise, Fabio ^c   Riccio, Angela ^c   Herbert, Cornelia ^a   Mattia, Donatella ^c   Kübler, Andrea ^a,b  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c Fondazione Santa Lucia IRCCS   (Italy)

Author keywords

ALS; BCI application; Brain computer interface; ERP; P300; Visual

Indexed keywords

BOOK; BRAIN COMPUTER INTERFACE; BRAIN DEPTH STIMULATION; EVENT RELATED POTENTIAL; HUMAN; INFORMATION PROCESSING; INTERNET; PRIORITY JOURNAL; PSYCHOLOGIC ASSESSMENT; SIGNAL TRANSDUCTION; SPELLING;

EID: 80051878443     PISSN: 00796123     EISSN: 18757855     Source Type: Book Series    
DOI: 10.1016/B978-0-444-53815-4.00019-4     Document Type: Chapter

References (96)

1. Aloise F., Babiloni F., Marciani M.G., Morelli D., Paolucci S., Oriolo G., et al. Brain-operated assistive devices: The ASPICE Project, Pisa, Italy 2006.
2. Aloise F., Ferriero D., Ruiu A., Santucci G., Catarci T., Mattia D., Babiloni F., Cincotti F., et al. Controlling domotic appliances via a dynamical P300-based Brain Computer interface 2009, AAATE'09, Florence 31 August - 2 September 2009.
3. Aloise F., Marchionni S., Romito G., Brouwer A.M., van Erp J., Mattia D., et al. P300-based brain computer interface: To operate domotic appliance 2008, 4th BCI Workshop, Graz.
4. Anderson C.W., Kirby M.J., Hundley D.R., Knight J.N. Classification of time-embedded EEG using short-time principal component analysis. Toward brain-computer interfacing 2007, 261-278. MIT Press, Cambridge, MA. G. Dornhege, J. del, R. Millán, T. Hinterberger, D.J. McFarland, K.R. Müller (Eds.).
5. Babiloni F., Cincotti F., Marciani M., Salinari S., Astolfi L., Aloise F., et al. On the use of brain-computer interfaces outside scientific laboratories toward an application in domotic environments. International Review of Neurobiology 2009, 86:133-146.
6. Baldoni R., Di Ciccio C., Mecella M., Patrizi F., Querzoni L., Santucci G., et al. An embedded middleware platform for pervasive and immersive environments for-all 2009, 1-3. SECON Workshops.
7. Bayliss J.D. Use of the evoked potential P3 component for control in a virtual apartment. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2003, 11:113-116.
8. Birbaumer N., Ghanayim N., Hinterberger T., Iversen I., Kotchoubey B., Kübler A., et al. A spelling device for the paralysed. Nature 1999, 398(6725):297-298.
9. Birbaumer N., Murguialday A.R., Cohen L. Brain-computer interface in paralysis. Current Opinion in Neurology 2008, 21(6):634-638.
10. Blankertz B., Krauledat M., Dornhege G., Williamson J., Murray-Smith R., Müller K.R. A note on brain actuated spelling with the berlin brain- computer interface. Universal access in HCI, part II, HCII 2007, volume 4555 of LNCS 2007, 759-768. Springer, Berlin, Heidelberg. C. Stephanidis (Ed.).
11. Blankertz B., Lemm S., Treder M., Haufe S., Müller K.-R. Single-trial analysis and classification of ERP components-A tutorial. Neuroimage 2011, 56(2):814-825. doi:10.1016/j.neuroimage.2010.06.048.
12. Blankertz B., Sannelli C., Halder S., Hammer E.M., Kübler A., Müller K.R., et al. Neurophysiological predictor of SMR-based BCI performance. Neuroimage 2010, 51(4):1303-1309.
13. Brouwer A.M., van Erp J.B.F. A tactile P300 brain-computer interface. Front Neuroprocessor 2010, 4:1-11.
14. Brunner P., Joshi S., Briskin S., Wolpaw J.R., Bischof H., Schalk G. Does the 'P300' speller depend on eye gaze?. Journal of Neural Engineering 2010, 7:1-9.
15. Cecotti H., Gräser A. Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 2011, 33(3):433-445. doi:10.1109/TPAMI.2010.125.
16. Cincotti F., Kauhanen L., Aloise F., Palomaki T., Caporusso N., Jylänki P., et al. Vibrotactile feedback for brain-computer interface operation. Computational Intelligence and Neuroscience 2007, 2007:48937. doi:10.1155/2007/48937.
17. Cincotti F., Mattia D., Aloise F., Bufalari S., Schalk G., Oriolo G., et al. Non-invasive brain-computer interface system: Towards its application as assistive technology. Brain Research Bulletin 2008, 75:796-803.
18. Demiralp T., Ademoglu A., Comerchero M., Polich J. Wavelet analysis of P3a and P3b. Brain Topography 2001, 13(4):251-267.
19. Donchin E., Spencer K.M., Wijesinghe R. The mental prosthesis: Assessing the speed of a P300-based brain-computer interface. IEEE Transactions on Rehabilitation Engineering 2000, 8(2):174-179.
20. Donoghue J.P. Bridging the gap to the world: A perspective on neural interface systems. Neuron 2008, 60:511-521.
21. Dornhege G., Krauledat M., Müller K.-R., Blankertz B. General signal processing and machine learning tools for BCI analysis. Toward brain-computer interfacing 2007, 207-234. MIT Press, Cambridge, MA. G. Dornhege, J.D.R. Millán, T. Hinterberger, D.J. McFarland, K.-R. Müller (Eds.).
22. Fabiani M., Gratton G., Karis D., Donchin E. Definition, identification and reliability of measurement of the P300 component of the event-related brain potential. Advances in psychophysiology 1987, 1-79. JAI Press, Greenwich, CT. P.K. Ackles, J.R. Jennings, M.G.H. Coles (Eds.).
23. Farwell L.A., Donchin E. Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology 1988, 70(6):510-523.
24. Furdea A., Halder S., Krusienski D.J., Bross D., Nijboer F., Birbaumer N., et al. An auditory oddball (P300) spelling system for brain-computer interfaces. Psychophysiology 2009, 46(3):617-625.
25. Giacino J.T., Ashwal S., Childs N., Cranford R., Jennett B., Katz D.I., et al. The minimally conscious state: Definition and diagnostic criteria. Neurology 2002, 58:349-353.
26. Gonsalvez C.L., Polich J. P300 amplitude is determined by target-to-target interval. Psychophysiology 2002, 39:388-396.
27. Guger C., Daban S., Sellers E., Holzner C., Krausz G., Carabalona R., et al. How many people are able to control a P300-based brain-computer interface (BCI)?. Neuroscience Letters 2009, 462(1):94-98.
28. Guger C., Holzner C., Grönegrass C., Edlinger G., Slater M. Brain-Computer Interface for Virtual Reality Control. Proceedings of ESANN 2009 2009, 443-448.
29. Halder S., Rea M., Andreoni R., Nijboer F., Hammer E.M., Kleih S.C., et al. An auditory oddball brain-computer interface for binary choices. Clinical Neurophysiology 2010, 121(4):516-523.
30. Hill N.J., Lal T.N., Bierig K., Birbaumer N., Schölkopf B. An auditory paradigm for brain-computer interfaces. Advances in Neural Information Processing Systems 2005, Vol. 17:569-576. MIT Press, Cambridge, MA, USA. L. Saul, Y. Weiss, L. Bottou (Eds.).
31. Hill N.J., Lal T.N., Tangermann M., Hinterberger T., Widman G., Elger C.E., et al. Classifying event-related desynchronization in EEG, ECoG, and MEG signals. Toward brain-computer interfacing 2007, 235-260. MIT Press, Cambridge, MA. G. Dornhege, J.D.R. Millán, T. Hinterberger, D.J. McFarland, K.-R. Müller (Eds.).
32. Hoffmann U. Bayesian machine learning applied in a Brain-Computer Interface for disabled users 2007, Dissertation. Ecole Polytechnique Federale de Lausanne.
33. Hoffmann U., Vesin J., Ebrahimi T., Diserens K. An efficient P300-based brain-computer interface for disabled subjects. Journal of Neuroscience Methods 2008, 167(1):115-125.
34. Höhne J., Schreuder M., Blankertz B., Tangermann M. Two-dimensional auditory P300 Speller with predictive text system. Conference Proceedings: IEEE Engineering in Medicine and Biology Society 2010, 1:4185-4188.
35. Iturrate I., Antelis J.M., Kübler A., Minguez J. A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation. IEEE Transactions on Robotics 2009, 25(3):614-627.
36. Kaper M., Meinicke P., Grossekathoefer U., Lingner T., Ritter H. Support vector machines for the P300 speller paradigm. IEEE Transactions on Biomedical Engineering 2004, 51(6):1073-1076.
37. Kaufmann, T., Vögele, C., Sütterlin, S., Lukito, S., & Kübler, A. (submitted for publication). Effects of cardiac autonomic balance on performance in a P300 Brain Computer Interface.
38. Kleih S.C., Nijboer F., Halder S., Kübler A. Motivation modulates the P300 amplitude during brain-computer interface use. Clinical Neurophysiology 2010, 121(7):1023-1031.
39. Klobassa D.S., Vaughan T.M., Brunner P., Schwartz N.E., Wolpaw J.R., Neuper C., et al. Toward a high-throughput auditory P300-based brain-computer interface. Clinical Neurophysiology 2009, 120(7):1252-1261.
40. Kotchoubey B., Kaiser J., Bostanov V., Lutzenberger W., Birbaumer N. Recognition of affective prosody in brain-damaged patients and healthy controls: A neurophysiological study using EEG and whole-head MEG. Cognitive, Affective, & Behavioral Neuroscience 2009, 9(2):153-167.
41. Krusienski D.J., Cox D., Shih J. Control of a robotic manipulator using EEG and ECoG signals 2010.
42. Krusienski D.J., Sellers E.W., Cabestaing F., Bayoudh S., McFarland D.J., Vaughan T.M., et al. A comparison of classification techniques for the P300 speller. Journal of Neural Engineering 2006, 3(4):299-305.
43. Krusienski D.J., Sellers E.W., McFarland D.J., Vaughan T.M., Wolpaw J.R. Toward enhanced P300 speller performance. Journal of Neuroscience Methods 2008, 167(1):15-21.
44. Kübler A., Furdea A., Halder S., Hammer E.M., Nijboer F., Kotchoubey B. A brain-computer interface controlled auditory event-related potential (p300) spelling system for locked-in patients. Annals of the New York Academy of Sciences 2009, 1157:90-100.
45. Kübler A., Halder S., Furdea A., Hösle A. Brain painting-BCI meets art. Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course 2008, 361-366.
46. Kübler A., Kotchoubey B. Brain-computer interfaces in the continuum of consciousness. Current Opinion in Neurology 2007, 20:643-649.
47. Kübler A., Kotchoubey B., Kaiser J., Wolpaw J.R., Birbaumer N. Brain-computer communication: Unlocking the locked in. Psychological Bulletin 2001, 127(3):358-375.
48. Kübler A., Müller K.-R. An introduction to brain-computer interfacing. Toward brain-computer interfacing 2007, 1-26. MIT Press, Cambridge, MA. G. Dornhege, J.D.R. Millán, T. Hinterberger, D.J. McFarland, K.-R. Müller (Eds.).
49. Kübler A., Neumann N., Wilhelm B., Hinterberger T., Birbaumer N. Brain-computer predictability of brain-computer communication. Journal of Psychophysiology 2004, 18(2-3):121-129.
50. Laureys S., Owen A., Schiff N.D. Brain function in coma, vegetative state, and related disorders. Lancet Neurology 2004, 9:537-546.
51. Laureys S., Pellas F., Van Eeckhout P., Ghorbel S., Schnakers C., Perrin F., et al. The locked-in syndrome: What is it like to be conscious but paralyzed and voiceless?. Progress in Brain Research 2005, 150:495-511.
52. Lin C.T., Ko L.W., Chang M.H., Duann J.R., Chen J.Y., Su T.P., et al. Review of wireless and wearable electroencephalogram systems and brain-computer interfaces-A mini-review. Gerontology 2010, 56(1):112-119.
53. Lotte F., Congedo M., Lecuyer A., Lamarche F., Arnaldi B. A review of classification algorithms for EEG-based brain-computer interfaces. Journal of Neural Engineering 2007, 4(2):R1-R13.
54. Lutzenberger W., Elbert T., Rockstroh B., Birbaumer N. The effects of self-regulation of slow cortical potentials on performance in a signal detection task. The International Journal of Neuroscience 1979, 9(3):175-183.
55. Lutzenberger W., Elbert T., Rockstroh B., Birbaumer N. Biofeedback produced slow brain potentials and task performance. Biological Psychology 1982, 14(1-2):99-111.
56. Mankoff J., Day A., Moore M., Batra U. Web accessability for low bandwidth input. Proceedings of ASSETS 2002, 89-96. ACM Press, Edinburgh.
57. McFarland D.J., McCane L.M., David S.V., Wolpaw J.R. Spatial filter selection for EEG-based communication. Electroencephalography and Clinical Neurophysiology 1997, 103(3):386-394.
58. McFarland D.J., Sarnacki W.A., Townsend G., Vaughan T., Wolpaw J.R. The P300-based brain-computer interface (BCI): Effects of stimulus rate. Clinical Neurophysiology 2011, 122(4):731-737. 10.1016/j.clinph.2010.10.029.
59. Millán J.del R., Rupp R., Müller-Putz G.-R., Murray-Smith R., Giugliemma C., Tangermann M., et al. Combining brain-computer interfaces and assistive technologies: State-of-the-art and challenges. Frontiers in Neuroscience 2010, 4(161):1-15.
60. Monti M., Laureys S., Owen A.M. The vegetative state. British Medical Journal 2010, 341:292-296.
61. Monti M.M., Vanhaudenhuyse A., Coleman M.R., Boly M., Pickard J.D., Tshibanda L., et al. Willful modulation of brain activity in disorders of consciousness. The New England Journal of Medicine 2010, 362:579-589.
62. Mugler E., Bensch M., Halder S., Rosenstiel W., Bogdan M., Birbaumer N., et al. Control of an internet browser using the P300 event-related potential. International Journal of Bioelectromagnetism 2008, 10(1):56-63.
63. Mugler E.M., Ruf C.A., Halder S., Bensch M., Kübler A. Design and implementation of a P300-based brain-computer interface for controlling an internet browser. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2010, 18(6):599-609.
64. Müller-Putz G.R., Scherer R., Neuper C., Pfurtscheller G. Steady-state somatosensory evoked potentials: Suitable brain signals for brain-computer interfaces?. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2006, 14(1):30-37.
65. Münßinger J.I., Halder S., Kleih S.C., Furdea A., Raco V., Hösle A., Kübler A. Brain Painting: first evaluation of a new brain-computer interface application with ALS-patients and healthy volunteers. Frontiers in Neuroprosthetics 2010, 4(182). 10.3389/fnins.2010.00182.
66. Neumann N., Birbaumer N. Predictors of successful self control during brain-computer communication. Journal of Neurology, Neurosurgey, and Psychiatry 2003, 74(8):1117-1121.
67. Nijboer F., Birbaumer N., Kübler A. The Influence of Psychological State and Motivation on Brain-Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis - a Longitudinal Study. Frontiers in Neuroscience 2010, 4. 10.3389/fnins.2010.00055.
68. Nijboer F., Furdea A., Gunst I., Mellinger J., McFarland D.J., Birbaumer N., et al. An auditory brain-computer interface (BCI). Journal of Neuroscience Methods 2008, 167(1):43-50.
69. Nijboer F., Sellers E.W., Mellinger J., Jordan M.A., Matuz T., Furdea A., et al. A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clinical Neurophysiology 2008, 119(8):1909-1916.
70. Nunan D., Donovan G., Jakovljevic D.G., Hodges L., Sandercock G.R.H., Brodie D.A. Validity and reliability of short-term heart-rate variability from the Polar S810. Medicine and Science in Sports and Exercise 2009, 41(1):243-250.
71. Pfurtscheller G. Event-related synchronization (ERS): An electrophysiological correlate of cortical areas at rest. Electroencephalography and Clinical Neurophysiology 1992, 83(1):62-69.
72. Pfurtscheller G., Neuper C. EEG-based brain-computer interfaces. Electroencephalography: Basic principles, clinical applications, and related fields 2005, Lippincott Williams & Wilkins, Philadelphia. 5th ed. E. Niedermeyer, F. da Silva (Eds.).
73. Piccione F., Giorgi F., Tonin P., Priftis K., Giove S., Silvoni S., et al. P300-based brain computer interface: Reliability and performance in healthy and paralysed participants. Clinical Neurophysiology 2006, 117(3):531-537.
74. Pineda J.A., Silverman D.S., Vankov A., Hestenes J. Learning to control brain rhythms: Making a brain-computer interface possible. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2003, 11(2):181-184.
75. Pires G., Nunes U. A wheelchair steered through voice commands and assisted by a reactive fuzzy-logic controller. Journal of Intelligent and Robotic Systems 2002, 34(3):301-314.
76. Pritchard W.S. Psychophysiology of P300. Psychological Bulletin 1981, 89(3):506-540.
77. Rastjoo A., Arabalibeik H. Evaluation of hidden Markov model for P300 detection in EEG signal. Studies in Health Technology and Informatics 2009, 142:265-267.
78. Riccio A., Leotta F., Aloise F., Bianchi L., Mattia D., Cincotti F. Evaluation of a P300 overlaid stimulation for controlling an assistive technology software 2010.
79. Rowland L.P., Shneider N.A. Medical progress: Amyotrophic lateral sclerosis. The New England Journal of Medicine 2001, 344(22):1688-1700.
80. Schalk G., McFarland D., Hinterberger T., Birbaumer N., Wolpaw J.R. BCI2000: A general-purpose brain-computer interface (BCI) system. IEEE Transactions on Biomedical Engineering 2004, 51(6):1034-1043.
81. Schnakers C., Vanhaudenhuyse A., Giacino J., Ventura M., Boly M., Majerus S., et al. Diagnostic accuracy of the vegetative and minimally conscious state: Clinical consensus versus standardized neurobehavioral assessment. BMC Neurology 2009, 9:35.
82. Schreuder M., Blankertz B., Tangermann M. A new auditory multi-class brain computer interface paradigm: Spatial hearing as an informative cue. PLoS One 2010, 5(4):e9813.
83. Sellers E.W., Donchin E. A P300-based brain-computer interface: Initial tests by ALS patients. Clinical Neurophysiology 2006, 117(3):538-548.
84. Sellers E.W., Krusienski D.J., McFarland D.J., Vaughan T.M., Wolpaw J.R. A P300 event-related potential brain-computer interface (BCI): The effects of matrix size and inter stimulus interval on performance. Biological Psychiatry 2006, 73:242-252.
85. Sellers E.W., Vaughan T.M., Wolpaw J.R. A brain-computer interface for long-term independent home use. Amyotrophic Lateral Sclerosis 2010, 11:449-455.
86. Sirvent J.L., Azorín J.M., Iáñez E., Úbeda A., Fernández E. P300-based brain-computer interface for internet browsing. Trends in practical applications of agents and multiagent systems 2010, 71:615-622. Springer Berlin Heidelberg, Berlin, Heidelberg. Y. Demazeau, F. Dignum, J.M. Corchado, J. Bajo, R. Corchuelo, E. Corchado, F. Fernández-Riverola, V.J. Julián, P. Pawlewski, C. Andrew (Eds.).
87. Sutton S., Braren M., Zubin J., John E.R. Evoked-potential correlates of stimulus uncertainty. Science 1965, 150(700):1187-1188.
88. Takano K., Komatsu T., Hata N., Nakajima Y. Visual stimuli for the P300 brain-computer interface: A comparison of white/gray and green/blue flicker matrices. Clinical Neurophysiology 2009, 120:1562-1566.
89. Task Force of the European Society of Cardiology and The North American Society of Pacing and Electrophysiology Heart rate variability-Standards of measurement, physiological interpretation, and clinical use. European Heart Journal 1996, 17:354-381.
90. Townsend G., LaPallo B.K., Boulay C.B., Krusienski D.J., Frye G.E., Hauser C.K., et al. A novel P300-based brain-computer interface stimulus presentation paradigm: Moving beyond rows and columns. Clinical Neurophysiology 2010, 121(7):1109-1120.
91. Treder M.S., Blankertz B. (C)overt attention and visual speller design in an ERP-based brain-computer interface. Behavioral and Brain Functions 2010, 6(1). 10.1186/1744-9081-6-28.
92. van Boxtel J.J.A., Tsuchiya N., Koch C. Consciousness and attention: On sufficiency and necessity. Frontiers in Psychology 2010, 1:217. 10.3389/fpsyg.2010.00217.
93. Volosyak I., Valbuena D., Malechka T., Peuscher J., Gräser A. Brain-computer interface using water-based electrodes. Journal of Neural Engineering 2010, 7:066007. 10.1088/1741-2560/7/6/066007.
94. Williamson J., Murray-Smith R., Blankertz B., Krauledat M., Müller K.R. Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces. International Journal of Human-Computer Studies 2009, 67(10):827-841.
95. Zickler C., Di Donna V., Kaiser V., Al-Khodairy A., Kleih S.C., Kübler A., et al. BCI applications for people with disabilities: Defining user needs and user requirements 2009.
96. Zickler, C., Riccio, A., Leotta, F., Hillian-Tress, S., Halder, S., Holz, E., et al. (submitted for publication). BCI and Assistive Technology: BCI as input channel in a standard assistive technology ICT-software. Clinical EEG.