An EEG/EOG-based hybrid brain-neural computer interaction (BNCI) system to control an exoskeleton for the paralyzed hand

Biomedizinische Technik

Volumn 60, Issue 3, 2015, Pages 199-205

  Soekadar, Surjo R ^a   Witkowski, Matthias ^a,b   Vitiello, Nicola ^c,d   Birbaumer, Niels ^b,e  

^a UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c SCUOLA SUPERIORE SANT ANNA   (Italy)

^d IRCCS FONDAZIONE DON CARLO GNOCCHI   (Italy)

^e Istituto di Ricovero e Cura a Carattere Scientifico   (Italy)

Author keywords

Assistive brain machine interface (BMI); Biosignal fusion; Brachial plexus injury (BPI); Electrooculography (EOG); Sensori motor rhythms (SMR)

Indexed keywords

BRAIN COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; ELECTROOCULOGRAPHY; ELECTROPHYSIOLOGY; EXOSKELETON (ROBOTICS);

ASSISTIVE DEVICES; ASSISTIVE ROBOTICS; BIOSIGNALS; BRACHIAL PLEXUS; BRAIN MACHINE INTERFACE; CONTROL PERFORMANCE; HEALTHY VOLUNTEERS; SENSORI-MOTOR RHYTHMS (SMR);

COMPUTER CONTROL SYSTEMS;

ADULT; ARTICLE; BRACHIAL PLEXUS INJURY; BRAIN COMPUTER INTERFACE; BRAIN NEURAL COMPUTER INTERACTION; CASE REPORT; CONTROLLED STUDY; DAILY LIFE ACTIVITY; ELECTROENCEPHALOGRAPHY; ELECTROOCULOGRAPHY; FINGER PARALYSIS; FLACCID PARALYSIS; GRIP STRENGTH; HAND EXOSKELETON; HAND FUNCTION; HUMAN; MALE; PARALYSIS; PRIORITY JOURNAL; ROBOTIC EXOSKELETON; BRAIN; COMPUTER SYSTEM; DEVICES; EXOSKELETON (REHABILITATION); HAND; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PROCEDURES; ROBOTICS; SIGNAL PROCESSING;

ADULT; BRAIN; BRAIN-COMPUTER INTERFACES; COMPUTER SYSTEMS; ELECTROENCEPHALOGRAPHY; ELECTROOCULOGRAPHY; EXOSKELETON DEVICE; HAND; HUMANS; MALE; MOVEMENT; PARALYSIS; ROBOTICS; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84931829638     PISSN: 00135585     EISSN: None     Source Type: Journal    
DOI: 10.1515/bmt-2014-0126     Document Type: Article

References (33)

1. Buch E, Weber C, Cohen LG, et al. Think to move: A neuromagnetic brain-computer interface (BCI) system for chronic stroke. Stroke 2008; 39: 910-917.
2. Cempini M, Cortese M, Vitiello N. A powered finger-thumb wearable hand exoskeleton with self-aligning joint axes. IEEE/ASME Trans Mechatron 2014; 99: 1-12.
3. Cempini M, De Rossi SMM, Lenzi T, et al. Kinematics and design of a portable and wearable exoskeleton for hand rehabilitation. Proc IEEE Int Conf Rehab Robot 2013;2013:6650414.
4. Collinger JL, Boninger ML, Bruns TM, Curley K, Wang W, Weber DJ. Functional priorities, assistive technology, and brain-computer interfaces after spinal cord injury. J Rehabil Res Dev 2013; 50: 145-160.
5. Collinger JL, Wodlinger B, Downey JE, et al. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 2013; 381: 557-564.
6. Del R Millan J, Galan F, Vanhooydonck D, Lew E, Philips J, Nuttin M. Asynchronous non-invasive brain-activated control of an intelligent wheelchair. Conf Proc IEEE Eng Med Biol Soc 2009; 2009: 3361-3364.
7. Millán JDR, Rupp R, Müller-Putz GR, et al. Combining braincomputer interfaces and assistive technologies: State-of-Theart and challenges. Front Neurosci 2010; 4: 161.
8. Future BNCI: A roadmap for future directions in brain/neuronal computer interaction research, Future BNCI Program under the European Union Seventh Framework Programme, FP7/2007- 2013, grant 248320; http://www.brainable.org/Documents/Future-BNCI-Roadmap.pdf.
9. Ganguly K, Secundo L, Ranade G, et al. Cortical representation of ipsilateral arm movements in monkey and man. J Neurosci. 2009; 29: 12948-12956.
10. Hargrove LJ, Simon AM, Young AJ, et al. Robotic leg control with EMG decoding in an amputee with nerve transfers. N Engl J Med 2013; 369: 1237-1242.
11. Kiguchi K, Hayashi Y. An EMG based control for an upper-limb power-assist exoskeleton robot. IEEE Trans Syst Man Cyber B 2012; 42: 1064-1071.
12. Leeb R, Sagha H, Chavarriaga R, Millán J del R. A hybrid braincomputer interface based on the fusion of electroencephalographic and electromyographic activities. J Neural Eng 2011; 8: 025011.
13. Liyanage SR, Guan C, Zhang H, Ang KK, Xu J, Lee TH. Dynamically weighted ensemble classification for non-stationary EEG processing. J Neural Eng 2013; 10: 036007.
14. Matsumoto Y, Seki M, Ando T, et al. Analysis of EMG signals of patients with essential tremor focusing on the change of tremor frequency. Conf Proc IEEE Eng Med Biol Soc 2012; 2012: 2244-2250.
15. Medical Research Council. Aids to the investigation of peripheral nerve injuries. 2nd ed. London: Her Majesty's Stationery Office, 1943.
16. Micera S, Carpaneto J, Raspopovic S. Control of hand prostheses using peripheral information. IEEE Rev Biomed Eng 2010; 3: 48-68.
17. Müller-Putz GR, Daly I, Kaiser V. Motor imagery-induced EEG patterns in individuals with spinal cord injury and their impact on brain-computer interface accuracy. J Neural Eng 2014; 11: 035011.
18. Müller-Putz GR, Scherer R, Pfurtscheller G, Rupp R. Braincomputer interfaces for control of neuroprostheses: From synchronous to asynchronous mode of operation/Braincomputer interfaces zur steuerung von neuroprothesen: Von der synchronen zur asynchronen funktionsweise. Biomed Tech 2006; 51: 57-63.
19. Müller-Putz GR, Scherer R, Pfurtscheller G, Rupp R. EEG-based neuroprosthesis control: A step towards clinical practice. Neurosci Lett 2005; 382: 169-174.
20. Müller-Putz GR, Schreuder M, Tangermann M, Leeb R, Millán Del RJ. The hybrid brain-computer interface: A bridge to assistive technology? Biomed Tech (Berl) 2013; 58. doi: 10.1515/bmt-2013-4435.
21. Oldfield C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971; 9: 97-113.
22. Pfurtscheller G, Aranibar A. Evaluation of event-related desynchronization (ERD) preceding and following self-paced movement. Electroencephalogr Clin Neurophysiol 1979; 46: 138-146.
23. Pfurtscheller G, Guger C, Müller G, Krausz G, Neuper C. Brain oscillations control hand orthosis in a tetraplegic. Neurosci Lett 2000; 292: 211-214.
24. Pfurtscheller G, Müller GR, Pfurtscheller J, Gerner HJ, Rüdiger R. 'Thought'-control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia. Neurosci Lett 2003; 351: 33-36.
25. Pons JL, Rocon E, Ceres R, et al. The MANUS-HAND dextrous robotics upper limb prosthesis: Mechanical and manipulation aspects. Auton Robot 2004; 16: 143-163.
26. Potvin JR. Effects of muscle kinematics on surface EMG amplitude and frequency during fatiguing dynamic contractions. J Appl Physiol 1997; 82: 144-151.
27. Ribeiro P, Brasil F, Witkowski M, et al. Controlling assistive machines in paralysis using brain waves and other biosignals. Adv Hum Comput Interact 2013;2013:369425.
28. Rohm M, Schneiders M, Müller C, et al. Hybrid brain-computer interfaces and hybrid neuroprostheses for restoration of upper limb functions in individuals with high-level spinal cord injury. Artif Intell Med 2013; 59: 133-142.
29. Rupp R, Rohm M, Schneiders M, et al. Think2grasp - BCI-controlled neuroprosthesis for the upper extremity. Biomed Tech (Berl). 2013 (in press). doi: 10.1515/bmt-2013-4440.
30. Soekadar SR, Birbaumer N, Slutzky M, Cohen LG. Brainmachine interfaces in neurorehabilitation of stroke. Neurobiol Dis 2015 (in press).
31. Soekadar SR, Cohen LG, Birbaumer N. Clinical brain-machine interfaces. In: Tracy J, Hampstead B, Sathian K, editors. Plasticity of cognition in neurologic disorders. New York: Oxford University Press 2015, Part 3, Chapter 15, pp. 347-361. ISBN: 978-0-19-996524-3.
32. Soekadar SR, Witkowski M, Mellinger J, Ramos A, Birbaumer N, Cohen LG. ERD-based online brain-machine interfaces (BMI) in the context of neurorehabilitation: Optimizing BMI learning and performance. IEEE TNSRE 2011;19: 542-549.
33. Vitiello N, Lenzi T, Roccella S, et al. NEUROExos: A powered elbow exoskeleton of physical rehabilitation. IEEE Trans Robot 2013; 29: 220-235.