Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users

Artificial Intelligence in Medicine

Volumn 59, Issue 2, 2013, Pages 121-132

  Leeb, Robert ^a   Perdikis, Serafeim ^a   Tonin, Luca ^a   Biasiucci, Andrea ^a   Tavella, Michele ^a   Creatura, Marco ^a   Molina, Alberto ^a   Al Khodairy, Abdul ^b   Carlson, Tom ^a   Millán, José d R ^a  

^a EPFL   (Switzerland)

^b SUVA   (Switzerland)

Author keywords

Application control; Brain computer interface (BCI); Electroencephalogram (EEG); End user; Motor imagery; Technology transfer

Indexed keywords

APPLICATION-CONTROL; ASSISTIVE MOBILITIES; BRAIN COMPUTER INTERFACES (BCIS); CONTROLLED CONDITIONS; ELECTRO-ENCEPHALOGRAM (EEG); END USERS; LABORATORY ENVIRONMENT; MOTOR IMAGERY;

ELECTROENCEPHALOGRAPHY; INTERFACES (COMPUTER); ROBOTS; TECHNOLOGY TRANSFER;

BRAIN COMPUTER INTERFACE;

ADULT; ARTICLE; BRAIN COMPUTER INTERFACE; CLINICAL ARTICLE; COMPUTER; ELECTROENCEPHALOGRAM; FEEDBACK SYSTEM; FEMALE; HUMAN; MALE; MOTOR DYSFUNCTION; OUTCOME ASSESSMENT; PRIORITY JOURNAL; ROBOTICS;

APPLICATION CONTROL; BRAIN-COMPUTER INTERFACE (BCI); ELECTROENCEPHALOGRAM (EEG); END-USER; MOTOR IMAGERY; TECHNOLOGY TRANSFER;

ADULT; BRAIN-COMPUTER INTERFACES; DISABLED PERSONS; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; MIDDLE AGED; PARALYSIS;

EID: 84886769378     PISSN: 09333657     EISSN: 18732860     Source Type: Journal    
DOI: 10.1016/j.artmed.2013.08.004     Document Type: Article

References (44)

1. Wolpaw J., Birbaumer N., McFarland D., Pfurtscheller G., Vaughan T. Brain-computer interfaces for communication and control. Clinical Neurophysiology 2002, 113(6):767-791.
2. Millán J.d.R., Rupp R., Müller-Putz G., Murray-Smith R., Giugliemma C., Tangermann M., et al. Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges. Frontiers in Neuroscience 2010, 4:161.
3. Birbaumer N., Ghanayim N., Hinterberger T., Iversen I., Kotchoubey B., Kübler A., et al. A spelling device for the paralysed. Nature 1999, 398(6725):297-298.
4. Williamson J., Murray-Smith R., Blankertz B., Krauledat M., Müller K.R. Designing for uncertain, asymmetric control: interaction design for brain-computer interfaces. International Journal of Human Computer Studies 2009, 67(10):827-841.
5. Bensch M., Karim A.A., Mellinger J., Hinterberger T., Tangermann M., Bogdan M., et al. Nessi: an EEG-controlled web browser for severely paralyzed patients. Computational Intelligence and Neuroscience 2007, 71863:1-5.
6. Riccio A., Leotta F., Bianchi L., Aloise F., Zickler C., Hoogerwerf E.J., et al. Workload measurement in a communication application operated through a P300-based brain-computer interface. Journal of Neural Engineering 2011, 8(2):025028.
7. Galán F., Nuttin M., Lew E., Ferrez P.W., Vanacker G., Philips J., et al. A brain-actuated wheelchair: asynchronous and non-invasive brain-computer interfaces for continuous control of robots. Clinical Neurophysiology 2008, 119(9):2159-2169.
8. Carlson T., Millán J.d.R. Brain-controlled wheelchairs: a robotic architecture. IEEE Robotics and Automation Magazine 2013, 20(1):65-73.
9. Millán J.d.R., Renkens F., Mouriño J., Gerstner W. Noninvasive brain-actuated control of a mobile robot by human EEG. IEEE Transactions on Biomedical Engineering 2004, 51(6):1026-1033.
10. Bell C.J., Shenoy P., Chalodhorn R., Rao R.P.N. Control of a humanoid robot by a noninvasive brain-computer interface in humans. Journal of Neural Engineering 2008, 5:214-220.
11. Lalor E., Kelly S., Finucane C., Burke R., Smith R., Reilly R.B., et al. Steady-state VEP-based brain computer interface control in an immersive 3-D gaming environment. EURASIP Journal on Applied Signal Processing 2005, 19:3156-3164.
12. Nijholt A., Tan D., Allison B., Millán J.d.R., Graimann B., Jackson M. Brain-computer interfaces for HCI and games. Proceedings ACM CHI 2008, ACM Publishing, New York. M. Burnett, M. Costabile, T. Catarci, B. de Ruyter, D. Tan, M. Czerwinski (Eds.).
13. Leeb R., Keinrath C., Friedman D., Guger C., Scherer R., Neuper C., et al. Walking by thinking: the brainwaves are crucial, not the muscles!. Presence: Teleoperators and Virtual Environments 2006, 15:500-514.
14. Lotte F., Langhenhove A.V., Lamarche F., Ernest T., Renard Y., Arnaldi B., et al. Exploring large virtual environments by thoughts using a brain-computer interface based on motor imagery and high-level commands. Presence: Teleoperators and Virtual Environments 2010, 19(1):54-70.
15. Tonin L., Carlson T., Leeb R., Millán J.d.R. Brain-controlled telepresence robot by motor-disabled people. Proc. annual international conference of the IEEE Engineering in Medicine and Biology Society EMBC 2011 2011, 4227-4230.
16. Kübler A., Birbaumer N. Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients?. Clinical Neurophysiology 2008, 119(11):2658-2666.
17. Müller G.R., Neuper C., Pfurtscheller G. Implementation of a telemonitoring system for the control of an EEG-based brain-computer interface. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2003, 11:54-59.
18. Decety J. The neurophysiological basis of motor imagery. Behavioural Brain Research 1996, 77(1-2):45-52.
19. Ehrsson H.H., Geyer S., Naito E. Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. Journal of Neurophysiology 2003, 90:3304-3316.
20. Jeannerod M., Frak V. Mental imaging of motor activity in humans. Current Opinion in Neurobiology 1999, 9(6):735-739.
21. Pfurtscheller G., Lopes da Silva F.H. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology 1999, 110:1842-1857.
22. Pfurtscheller G., Neuper C. Motor imagery and direct brain-computer communication. Proceedings of the IEEE 2001, 89:1123-1134.
23. Tonin L., Leeb R., Tavella M., Perdikis S., Millán J.d.R. The role of shared-control in BCI-based telepresence. Proc. of 2010 IEEE international conference on systems, man and cybernetics 2010, 1462-1466.
24. Schöner G., Dose M., Engels C. Dynamics of behavior: theory and applications for autonomous robot architectures. Robotics and Autonomous Systems 1995, 16:213-245.
25. Perdikis S., Ramsey A., Leeb R., Williamson J., Al-Khodairy A., Murray-Smith R., et al. Clinical evaluation of a hybrid-BCI text-entry system. Proceedings of TOBI workshop III: bringing BCIs to end-users: facing the challenge 2012, 75-76.
26. Hu T.C., Tucker A.C. Optimal computer search trees and variable-length alphabetical codes. SIAM Journal on Applied Mathematics 1971, 21(4):514-532.
27. Youden W.J. Index for rating diagnostic tests. Cancer 1950, 3(1):32-35.
28. Guger C., Daban S., Sellers E., Holzner C., Krausz G., Carabalona R., et al. How many people are able to control a P300-based brain-computer interface (BCI)?. Neuroscience Letters 2009, 462(1):94-98.
29. Sellers E.W., Krusienski D.J., McFarland D.J., Vaughan T.M., Wolpaw J.R. A P300 event-related potential brain-computer interface (BCI): the effects of matrix size and inter stimulus interval on performance. Biological Psychology 2006, 73(3):242-252.
30. Riener R., Nef T., Colombo G. Robot-aided neurorehabilitation of the upper extremities. Medical and Biological Engineering and Computing 2005, 43:2-10.
31. Rosati G., Gallina P., Masiero S. Design, implementation and clinical tests of a wire-based robot for neurorehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2007, 15(4):560-569.
32. Guger C., Edlinger G., Harkam W., Niedermayer I., Pfurtscheller G. How many people are able to operate an EEG-based brain-computer interface (BCI). IEEE Transactions on Neural Systems and Rehabilitation Engineering 2003, 11:145-147.
33. Sagha H., Perdikis S., Millàn J.d.R., Chavarriaga R. Toward online detection of BCI performance degradation. Proceedings of TOBI workshop III: bringing BCIs to end-users: facing the challenge 2012, 89-90.
34. Faller J., Vidaurre C., Solis-Escalante T., Neuper C., Scherer R. Autocalibration and recurrent adaptation: towards a plug and play online ERD-BCI. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2012, 20(3):313-319.
35. Vidaurre C., Kawanabe M., von Bünau P., Blankertz B., Müller K.R. Toward unsupervised adaptation of LDA for brain-computer interfaces. IEEE Transactions on Biomedical Engineering 2011, 58(3):587-597.
36. Perdikis S., Tavella M., Leeb R., Chavarriaga R., Millán J.d.R. A supervised recalibration protocol for unbiased BCI. 5th International brain-computer interface conference, 2011 2011, 8-11. Verlag der Technischen Universität Graz, Graz, Austria. G.R. Müller-Putz, R. Scherer, M. Billinger, A. Kreilinger, V. Kaiser, C. Neuper (Eds.).
37. Carlson T., Leeb R., Chavarriaga R., Millán J.d.R. Online modulation of the level of assistance in shared control systems. Proceedings of the IEEE international conference on systems man and cybernetics 2012, 3321-3326.
38. Zhang H., Guan C., Ang K.K., Chin Z.Y. Learning discriminative patterns for self-paced EEG-based motor imagery detection. Frontiers in Neuroscience 2012, 6(7).
39. Leeb R., Lancelle M., Kaiser V., Fellner D., Pfurtscheller G. Thinking Penguin: multi-modal brain-computer interface control of a VR game. IEEE Transactions on Computational Intelligence and AI in Games 2013, 5(2):117-128.
40. Leeb R., Sagha H., Chavarriaga R., Millán J.d.R. A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities. Journal of Neural Engineering 2011, 8(2):025011.
41. Müller-Putz G., Breitwieser C., Cincotti F., Leeb R., Schreuder M., Leotta F., et al. Tools for brain-computer interaction: a general concept for a hybrid BCI. Frontiers in Neuroinformatics 2011, 5:30.
42. Neuper C., Scherer R., Reiner M., Pfurtscheller G. Imagery of motor actions: differential effects of kinaesthetic versus visual-motor mode of imagery on single-trial EEG. Brain Research Cognitive Brain Research 2005, 25:668-677.
43. Kübler A., Neumann N. Brain-computer interfaces - the key for the conscious brain locked into a paralyzed body. Progress in Brain Research 2005, 150:513-525.
44. Galán F., Ferrez P.W., Oliva F., Guàrdia J., Millán J.d.R. Feature extraction for multi-class BCI using canonical variates analysis. IEEE international symposium on intelligent signal processing 2007.