Detection of motor execution using a hybrid fNIRS-biosignal BCI: A feasibility study

Journal of NeuroEngineering and Rehabilitation

Volumn 10, Issue 1, 2013, Pages

  Zimmermann, Raphael ^a,b   Marchal Crespo, Laura ^a,c   Edelmann, Janis ^a   Lambercy, Olivier ^a   Fluet, Marie Christine ^a   Riener, Robert ^a,c   Wolf, Martin ^b   Gassert, Roger ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY HOSPITAL ZURICH   (Switzerland)

^c BALGRIST UNIVERSITY HOSPITAL   (Switzerland)

Author keywords

Autonomic nervous system (ANS); BCI; Biosignals; Functional NIRS; Hidden Markov model (HMM); Isometric pinching; Single trial

Indexed keywords

HEMOGLOBIN;

ADULT; ALGORITHM; ARTICLE; ASSOCIATION; AUTONOMIC NERVOUS SYSTEM; BRAIN COMPUTER INTERFACE; BREATHING RATE; FEASIBILITY STUDY; FEMALE; FINGER; HEART RATE; HEMODYNAMICS; HUMAN; INNERVATION; MALE; METABOLISM; METHODOLOGY; MOTOR CORTEX; MOVEMENT (PHYSIOLOGY); MUSCLE ISOMETRIC CONTRACTION; NEAR INFRARED SPECTROSCOPY; PHYSIOLOGY; PROBABILITY; SIGNAL PROCESSING; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ADULT; ALGORITHMS; AUTONOMIC NERVOUS SYSTEM; BRAIN-COMPUTER INTERFACES; CUES; DATA INTERPRETATION, STATISTICAL; FEASIBILITY STUDIES; FEMALE; FINGERS; HEART RATE; HEMODYNAMICS; HEMOGLOBINS; HUMANS; ISOMETRIC CONTRACTION; MALE; MARKOV CHAINS; MODELS, STATISTICAL; MOTOR CORTEX; MOVEMENT; RESPIRATORY RATE; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPECTROSCOPY, NEAR-INFRARED;

MLCS; MLOWN;

EID: 84872416291     PISSN: None     EISSN: 17430003     Source Type: Journal    
DOI: 10.1186/1743-0003-10-4     Document Type: Article

References (64)

1. Think to move: A neuromagnetic Brain-Computer Interface (BCI) system for chronic stroke. Buch E, Weber C, Cohen LG, Braun C, Dimyan MA, Ard T, Mellinger J, Caria A, Soekadar S, Fourkas A, Birbaumer N, Stroke 2008 39 910 917 10.1161/STROKEAHA.107.505313 18258825
2. Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. Hogan N, Krebs HI, Rohrer B, Palazzolo JJ, Dipietro L, Fasoli SE, Stein J, Hughes R, Frontera WR, Lynch D, Volpe BT, J Rehabil Res Dev 2006 43 605 618 10.1682/JRRD.2005.06.0103 17123202
3. Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. Wang W, Collinger JL, Perez MA, Tyler-Kabara EC, Cohen LG, Birbaumer N, Brose SW, Schwartz AB, Boninger ML, Weber DJ, Phys Med Rehabil Clin North Am 2010 21 157 178 10.1016/j.pmr.2009.07.003
4. A concept for extending the applicability of constraint-induced movement therapy through motor cortex activity feedback using a neural prosthesis. Ward TE, Soraghan CJ, Matthews F, Markham C, Comput Intell Neurosci 2007 2007 51363
5. Cortical control of a prosthetic arm for self-feeding. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB, Nature 2008 453 1098 1101 10.1038/nature06996 18509337
6. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP, Nature 2006 442 164 171 10.1038/nature04970 16838014
7. A brain-computer interface using electrocorticographic signals in humans. Leuthardt EC, Schalk G, Wolpaw JR, Ojemann JG, Moran DW, J Neural Eng 2004 1 63 10.1088/1741-2560/1/2/001 15876624
8. Real-time control of a prosthetic hand using human electrocorticography signals. Yanagisawa T, Hirata M, Saitoh Y, Goto T, Kishima H, Fukuma R, Yokoi H, Kamitani Y, Yoshimine T, J Neurosurgery 2011 114 1715 1722 10.3171/2011.1. JNS101421
9. Hemodynamic brain-computer interfaces for communication and rehabilitation. Sitaram R, Caria A, Birbaumer N, Neural Netw 2009 22 1320 1328 10.1016/j.neunet.2009.05.009 19524399
10. Brain-computer interfaces for communication and control. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM, Clin Neurophysiol 2002 113 767 791 10.1016/S1388-2457(02)00057-3 12048038
11. On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. Coyle S, Ward T, Markham C, McDarby G, Physiol Meas 2004 25 815 822 10.1088/0967-3334/25/4/003 15382823
12. Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI). Weiskopf N, Mathiak K, Bock S, Scharnowski F, Veit R, Grodd W, Goebel R, Birbaumer N, Biomed Eng, IEEE Trans on 2004 51 966 970 10.1109/TBME.2004.827063
13. Neurovascular coupling. Pasley BN, Freeman RD, Scholarpedia 2008 3 5340 10.4249/scholarpedia.5340
14. Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. Wolf M, Ferrari M, Quaresima V, J Biomed Opt 2007 12 062104 10.1117/1.2804899 18163807
15. Wireless miniaturized in-vivo near infrared imaging. Muehlemann T, Haensse D, Wolf M, Opt Express 2008 16 10323 10330 10.1364/OE.16.010323 18607442
16. Near infrared spectroscopy based brain-computer interface. Sitaram R, Hoshi Y, Guan C, Proc. SPIE 5852, Third International Conference on Experimental Mechanics and Third Conference of the Asian Committee on Experimental Mechanics 434: June 03, 2005 Bellingham, WA, USA: SPIE, Quan C, Chau FS, Asundi A, Wong BS, Lim CT, 2005 434 442
17. Hemodynamics for brain-computer interfaces. Matthews F, Pearlmutter B, Ward T, Soraghan C, Markham C, Signal Process Mag, IEEE 2008 25 87 94
18. Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. Sitaram R, Zhang H, Guan C, Thulasidis M, Hoshi Y, Ishikawa A, Shimizu K, Birbaumer N, NeuroImage 2007 34 1416 1427 10.1016/j.neuroimage.2006.11.005 17196832
19. Brain-computer interface using a simplified functional near-infrared spectroscopy system. Coyle SM, Ward TE, Markham CM, J Neural Eng 2007 4 219 10.1088/1741-2560/4/3/007 17873424
20. Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy. Power SD, Falk TH, Chau T, J Neural Eng 2010 7 026002 10.1088/1741-2560/7/2/026002
21. Development, set-up and first results for a one-channel near-infrared spectroscopy system. Bauernfeind G, Leeb R, Wriessnegger SC, Pfurtscheller G, Biomed Eng 2008 53 36 43 10.1515/BMT.2008.005
22. Taking NIRS-BCIs outside the lab: towards achieving robustness against environment noise. Falk T, Guirgis M, Power S, Chau T, Neural Syst Rehabil Eng, IEEE Trans on 2011 19 136 146
23. Decoding subjective preference from single-trial near-infrared spectroscopy signals. Luu S, Chau T, J Neural Eng 2009 6 016003 10.1088/1741-2560/6/1/016003 19104138
24. Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface. Tai K, Chau T, J Neuroeng Rehabil 2009 6 39 10.1186/1743-0003-6-39 19900285
25. Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study. Holper L, Wolf M, J Neuroeng Rehabil 2011 8 34 10.1186/1743-0003-8-34 21682906
26. Recognition of brain hemodynamic mental response for brain computer interface. Abibullaev B, Kang WS, Lee SH, An J, International Conference on Control, Automation and Systems (ICCAS) Seoul, South Korea: Institute of Electrical and Electronics Engineers 2010 2238 2243
27. Multichannel temporal data classification of motor imagination using fNIRS. Takahashi S, Nakamura H, Tsunashima H, International Conference on Control, Automation and Systems (ICCAS) Seoul, South Korea: Institute of Electrical and Electronics Engineers 2010 2443 2447
28. Physiological noise in near-infrared spectroscopy: implications for optical brain computer interfacing. Coyle S, Ward T, Markham C, Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Francisco, CA, USA: Institute of Electrical and Electronics Engineers 2004 4540 4543
29. Estimating and validating the interbeat intervals of the heart using near-infrared spectroscopy on the human forehead. Trajkovic I, Scholkmann F, Wolf M, J Biomed Opt 2011 16 087002 10.1117/1.3606560 21895329
30. Measurement of changes in cerebral haemodynamics during inspiration and expiration using near infrared spectroscopy. Elwell CE, Owen-Reece H, Cope M, Edwards AD, Wyatt JS, Reynolds EOR, Delpy DT, Adv Exp Med Biol 1994 345 619 626 10.1007/978-1-4615-2468-7-82 8079766
31. The enigma of Mayer waves: Facts and models. Julien C, Cardiovasc Res 2006 70 12 21 10.1016/j.cardiores.2005.11.008 16360130
32. Oscillations in cerebral haemodynamics-implications for functional activation studies. Elwell CE, Springett R, Hillmann E, Delpy DT, Adv Exp Med Biol 1999 471 57 65 10.1007/978-1-4615-4717-4-8 10659132
33. Spontaneous low frequency oscillations of cerebral hemodynamics and metabolism in human adults. Obrig H, Neufang M, Wenzel R, Kohl M, Steinbrink J, Einhupl K, Villringer A, NeuroImage 2000 12 623 639 10.1006/nimg.2000.0657 11112395
34. Towards a BCI for sensorimotor training: Initial results from simultaneous fNIRS and biosignal recordings. Zimmermann R, Marchal-Crespo L, Lambercy O, Fluet MC, Riener R, Wolf M, Gassert R, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Boston, MA, USA: Institute of Electrical and Electronics Engineers 2011 6339 6343
35. The hybrid BCI. Pfurtscheller G, Allison BZ, Brunner C, Bauernfeind G, Solis-Escalante T, Scherer R, Zander TO, Mueller-Putz G, Neuper C, Birbaumer N, Front Neurosci 2010 4 30 20589236
36. Motor hand representation in cortical area 44. Uozumi T, Tamagawa A, Hashimoto T, Tsuji S, Neurology 2004 62 757 761 10.1212/01.WNL.0000113731.75479. 25 15007126
37. The primary motor and premotor areas of the human cerebral cortex. Chouinard PA, Paus T, Neuroscientist 2006 12 143 152 10.1177/1073858405284255 16514011
38. Cacioppo JT, Tassinary LG, Berntson G, Handbook of Psychophysiology New York: Cambridge University Press 2007
39. The electrodermal response. Malmivuo J, Plonsey R, Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields New York: Oxford University Press 1995 1995
40. Event-related functional magnetic resonance imaging: modelling, inference and optimization. Josephs O, Henson RNA, Philos Trans R Soc London, Ser B: Biol Sci 1999 354 1387 1215 1228 10.1098/rstb.1999.0475
41. How to detect and reduce movement artifacts in near-infrared imaging using standard deviation and spline interpolation. Scholkmann F, Spichtig S, Muehlemann T, Wolf M, Physiol Meas 2010 31 649 662 10.1088/0967-3334/31/5/004 20308772
42. Non-invasive optical spectroscopy and imaging of human brain function. Villringer A, Chance B, Trends in Neurosciences 1997 20 435 442 10.1016/S0166-2236(97)01132-6 9347608
43. Optical pathlength measurements on adult head, calf and forearm and the head of the newborn infant using phase resolved optical spectroscopy. Duncan A, Meek JH, Clemence M, Elwell CE, Tyszczuk L, Cope M, Delpy D, Phys Med Biol 1995 40 295 304 10.1088/0031-9155/40/2/007 7708855
44. Characterization of the near infrared absorption spectra of cytochrome aa3 and haemoglobin for the non-invasive monitoring of cerebral oxygenation. Wray S, Cope M, Delpy DT, Wyatt JS, Reynolds EO, Biochim Biophys Acta 1988 933 184 192 10.1016/0005-2728(88)90069-2 2831976
45. Measurement of frontal lobe functional activation and related systemic effects: A near-infrared spectroscopy investigation. Tachtsidis I, Leung TS, Devoto L, Delpy DT, Elwell CE, Adv Exp Med Biol 2008 614 397 403 10.1007/978-0-387-74911-2-44 18290351
46. Real time electrocardiogram QRS detection using combined adaptive threshold. Christov I, Biomed Eng OnLine 2004 3 28 10.1186/1475-925X-3-28 15333132
47. Heart rate variability: standards of measurement, physiological interpretation, and clinical Use. Task Force of the European Society of Cardiology the North American Society of Pacing Electrophysiology, Circulation 1996 93 1043 1065 10.1161/01.CIR.93.5.1043 8598068
48. A tutorial on hidden Markov models and selected applications in speech recognition. Rabiner L, Proc IEEE 1989 77 257 286 10.1109/5.18626
49. Development of an optical brain-machine interface. Utsugi K, Obata A, Sato H, Katsura T, Sagara K, Maki A, Koizumi H, Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society Lyon, France: Institute of Electrical and Electronics Engineers 2007 5338 5341
50. Single-trial reconstruction of finger-pinch forces from human motor-cortical activation measured by near-infrared spectroscopy (NIRS). Nambu I, Osu R, Sato Ma, Ando S, Kawato M, Naito E, NeuroImage 2009 47 628 637 10.1016/j.neuroimage.2009.04.050 19393320
51. Hidden Markov Model (HMM) Toolbox for Matlab, Version 3 (PMTK3). Murphy K, [ http://www.cs.ubc.ca/∼murphyk/Software/HMM/hmm.html ]
52. BCI meeting 2005-workshop on clinical issues and applications. Kübler A, Mushahwar V, Hochberg L, Donoghue J, Neural Syst Rehabil Eng, IEEE Trans 2006 14 131 134 10.1109/TNSRE.2006.875585
53. Brain-computer interface research at the university of south Florida cognitive psychophysiology laboratory: the P300 speller. Sellers E, Kübler A, Donchin E, Neural Syst Rehabil Eng, IEEE Trans 2006 14 221 224 10.1109/TNSRE.2006.875580
54. Motor imagery. A backdoor to the motor system after stroke? Sharma N, Pomeroy VM, Baron JC, Stroke 2006 37 1941 1952 10.1161/01.STR.0000226902.43357. fc 16741183
55. Motor imagery and stroke rehabilitation: a critical discussion. De Vries S, Mulder T, J Rehabil Med 2007 39 5 13 10.2340/16501977-0020 17225031
56. Efficacy of motor imagery in post-stroke rehabilitation: a systematic review. Zimmermann-Schlatter A, Schuster C, Puhan M, Siekierka E, Steurer J, J Neuroeng Rehabil 2008 5 8 10.1186/1743-0003-5-8 18341687
57. Motor execution detection based on autonomic nervous system responses. Marchal-Crespo L, Zimmermann R, Lambercy O, Edelmann J, Fluet MC, Wolf M, Gassert R, Riener R, Physiol Meas 2013 34 35 51 10.1088/0967-3334/34/1/35 23248174
58. A NIRS-based brain-computer interface system during motor imagery: System development and online feedback training. Kanoh S, Murayama Ym, Miyamoto Ki, Yoshinobu T, Kawashima R, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Minneapolis, MN, USA: Institute of Electrical and Electronics Engineers 2009 594 597
59. Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery. Gomez-Rodriguez M, Peters J, Hill J, Schoelkopf B, Gharabaghi A, Grosse-Wentrup M, J Neural Eng 2011 8 036005 10.1088/1741-2560/8/3/036005 21474878
60. Speeded near infrared spectroscopy (NIRS) response detection. Cui X, Bray S, Reiss A, PLoS One 2010 5 15474 10.1371/journal.pone.0015474 21085607
61. Near infrared spectroscopy to study the brain: an overview. Wolf M, Morren G, Haensse D, Karen T, Wolf U, Fauchère J, Bucher H, Opto-Electronics Rev 2008 16 413 419 10.2478/s11772-008-0042-z
62. Modeling the hemodynamic response to brain activation. Buxton RB, Uludag K, Dubowitz DJ, Liu TT, NeuroImage 2004 23 Suppl 1 220 233
63. Harnessing neuroplasticity for clinical applications. Cramer SC, Sur M, Dobkin BH, O'Brien C, Sanger TD, Trojanowski JQ, Rumsey JM, Hicks R, Cameron J, Chen D, Chen WG, Cohen LG, deCharms C, Duffy CJ, Eden GF, Fetz EE, Filart R, Freund M, Grant SJ, Haber S, Kalivas PW, Kolb B, Kramer AF, Lynch M, Mayberg HS, McQuillen PS, Nitkin R, Pascual-Leone A, Reuter-Lorenz P, Schiff N, Sharma A, Shekim L, Stryker M, Sullivan EV, Vinogradov S, Brain 2011 134 1591 1609 10.1093/brain/awr039 21482550
64. A combined robotic and cognitive training for locomotor rehabilitation: Evidences of cerebral functional reorganization in two chronic traumatic brain injured patients. Sacco K, Cauda F, D'Agata F, Duca S, Zettin M, Virgilio R, Nascimbeni A, Belforte G, Eula G, Gastaldi L, Appendino S, Geminiani GC, Front Human Neurosci 2011 5 146