Collaborative approach in the development of high-performance brain-computer interfaces for a neuroprosthetic arm: Translation from animal models to human control

Clinical and Translational Science

Volumn 7, Issue 1, 2014, Pages 52-59

  Collinger, Jennifer L ^a,b   Kryger, Michael A ^b   Barbara, Richard ^b   Betler, Timothy ^c   Bowsher, Kristen ^d   Brown, Elke H P ^b   Clanton, Samuel T ^b   Degenhart, Alan D ^b,c   Foldes, Stephen T ^a,b,c   Gaunt, Robert A ^b   Gyulai, Ferenc E ^e   Harchick, Elizabeth A ^b   Harrington, Deborah ^b   Helder, John B ^f   Hemmes, Timothy ^b   Johannes, Matthew S ^f   Katyal, Kapil D ^f   Ling, Geoffrey S F ^g   Mcmorland, Angus J C ^c,e   Palko, Karina ^b   Para, Matthew P ^f   Scheuermann, Janet ^b   Schwartz, Andrew B ^b,c,e   Skidmore, Elizabeth R ^b,c   Solzbacher, Florian ^h,i   Srikameswaran, Anita V ^c   Swanson, Dennis P ^c   Swetz, Scott ^f   Tyler Kabara, Elizabeth C ^b,c,e   Velliste, Meel ^c,e   Wang, Wei ^b,c,e   Weber, Douglas J ^a,b,c   Wodlinger, Brian ^b,c   Boninger, Michael L ^a,b,c   more..

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b Department of Physical Medicine and Rehabilitation ^*

^c UNIVERSITY OF PITTSBURGH   (United States)

^d CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^e UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^f JOHNS HOPKINS UNIVERSITY APPLIED PHYSICS LABORATORY   (United States)

^g DEFENSE ADVANCED RESEARCH PROJECTS AGENCY   (United States)

^h University of Utah   (United States)

ⁱ UNIVERSITY OF UTAH   (United States)

Author keywords

Brain; Clinical trials; Methodology; Translational research

Indexed keywords

BRAIN; CLINICAL TRIALS; METHODOLOGY; TRANSLATIONAL RESEARCH;

ADULT; ANIMALS; ARTIFICIAL LIMBS; BRAIN-COMPUTER INTERFACES; COOPERATIVE BEHAVIOR; ELECTROENCEPHALOGRAPHY; HUMANS; MALE; MODELS, ANIMAL; PRIMATES; PROSTHESIS DESIGN; QUADRIPLEGIA; ROBOTICS; SOFTWARE; SPINAL CORD INJURIES; TRANSLATIONAL MEDICAL RESEARCH; USER-COMPUTER INTERFACE;

EID: 84894071006     PISSN: 17528054     EISSN: 17528062     Source Type: Journal    
DOI: 10.1111/cts.12086     Document Type: Article

References (65)

1. Fetz EE. Operant conditioning of cortical unit activity. Science 1969; 163(3870): 955-958.
2. Georgopoulos AP, Kalaska JF, Caminiti R, Massey JT. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neuroscience: Official J Soc Neurosci. 1982; 2(11): 1527-1537.
3. Kalaska JF, Caminiti R, Georgopoulos AP. Cortical mechanisms related to the direction of two-dimensional arm movements: relations in parietal area 5 and comparison with motor cortex. Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale 1983; 51(2): 247-260.
4. Taylor DM, Tillery SI, Schwartz AB. Direct cortical control of 3D neuroprosthetic devices. Science 2002; 296(5574): 1829-1832.
5. Schwartz AB, Kettner RE, Georgopoulos AP. Primate motor cortex and free arm movements to visual targets in three-dimensional space. I. Relations between single cell discharge and direction of movement. J Neurosci: Offic J Soc Neurosci. 1988; 8(8): 2913-2927.
6. Lebedev MA, Carmena JM, O'Doherty JE, Zacksenhouse M, Henriquez CS, Principe JC, Nicolelis MA. Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J Neurosci: Offic J Soc Neurosci. 2005; 25(19): 4681-4693.
7. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP. Instant neural control of a movement signal. Nature 2002; 416(6877): 141-142.
8. Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, Dimitrov DF, Patil PG, Henriquez CS, Nicolelis MA. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 2003; 1(2): E42.
9. Georgopoulos AP, Schwartz AB, Kettner RE. Neuronal population coding of movement direction. Science 1986; 233(4771): 1416-1419.
10. Schwartz AB. Direct cortical representation of drawing. Science 1994; 265(5171): 540-542.
11. Ethier C, Oby ER, Bauman MJ, Miller LE. Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature 2012; 485(7398): 368-371.
12. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB. Cortical control of a prosthetic arm for self-feeding. Nature 2008; 453(7198): 1098-1101.
13. DeVivo MJ, Chen Y. Trends in new injuries, prevalent cases, and aging with spinal cord injury. Archiv Phys Med Rehabilitat. 2011; 92(3): 332-338.
14. Lee BB, Cripps RA, Fitzharris M, Wing PC. The global map for traumatic spinal cord injury epidemiology: update 2011, global incidence rate. Spinal Cord 2013. Feb 26 [Epub ahead of print].
15. Ziegler-Graham K, MacKenzie EJ, Ephraim PL, Travison TG, Brookmeyer R. Estimating the prevalence of limb loss in the United States: 2005 to 2050. Arch Phys Med and Rehabilitat. 2008; 89(3): 422-429.
16. Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Black MJ. Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J Neural Eng. 2008; 5(4): 455-476.
17. Hochberg LR, Bacher D, Jarosiewicz B, Masse NY, Simeral JD, Vogel J, Haddadin S, Liu J, Cash SS, van derSmagt P, et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 2012; 485(7398): 372-375.
18. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006; 442(7099): 164-171.
19. Collinger JL, Wodlinger B, Downey JE, Wang W, Tyler-Kabara EC, Weber DJ, McMorland AJ, Velliste M, Boninger ML, Schwartz AB. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 2012; 381(9866): 557-564.
20. Wang W, Collinger JL, Degenhart AD, Tyler-Kabara EC, Schwartz AB, Moran DW, Weber DJ, Wodlinger B, Vinjamuri RK, Ashmore RC, et al. An electrocorticographic brain interface in an individual with tetraplegia. PLoS One 2013; 8(2): e55344.
21. Hill NJ, Lal TN, Schroder M, Hinterberger T, Wilhelm B, Nijboer F, Mochty U, Widman G, Elger C, Scholkopf B, et al. Classifying EEG and ECoG signals without subject training for fast BCI implementation: comparison of nonparalyzed and completely paralyzed subjects. IEEE Transact Neural Syst Rehabilitat Eng: A Publicat IEEE Eng Med and Biol Soc. 2006; 14(2): 183-186.
22. Murguialday AR, Hill J, Bensch M, Martens S, Halder S, Nijboer F, Schoelkopf B, Birbaumer N, Gharabaghi A. Transition from the locked in to the completely locked-in state: a physiological analysis. Clinic Neurophysiol: Off J Int Federat Clinical Neurophysiol. 2011; 122(5): 925-933.
23. Wang W, Degenhart AD, Sudre GP, Pomerleau DA, Tyler-Kabara EC. Decoding semantic information from human electrocorticographic (ECoG) signals. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA 2011: 6294-6298.
24. Degenhart AD, Collinger JL, Vinjamuri R, Kelly JW, Tyler-Kabara EC, Wang W. Classification of hand posture from electrocorticographic signals recorded during varying force conditions. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA 2011: 5782-5785.
25. Wang W, Degenhart AD, Collinger JL, Vinjamuri R, Sudre GP, Adelson PD, Holder DL, Leuthardt EC, Moran DW, Boninger ML, et al. Human motor cortical activity recorded with Micro-ECoG electrodes, during individual finger movements. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN 2009: 586-589.
26. Wang W, Collinger JL, Perez MA, Tyler-Kabara EC, Cohen LG, Birbaumer N, Brose SW, Schwartz AB, Boninger ML, Weber DJ. Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. Phys Med Rehabilitat Clinics of North Am. 2010; 21(1): 157-178.
27. Crone NE, Miglioretti DL, Gordon B, Sieracki JM, Wilson MT, Uematsu S, Lesser RP. Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. Brain : A J Neurol. 1998; 121 (Pt 12): 2271-2299.
28. Crone NE, Miglioretti DL, Gordon B, Lesser RP. Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. Brain: A J Neurol. 1998; 121 (Pt 12): 2301-2315.
29. Leuthardt EC, Schalk G, Wolpaw JR, Ojemann JG, Moran DW. A brain-computer interface using electrocorticographic signals in humans. J Neural Eng. 2004; 1(2): 63-71.
30. Schalk G, Kubanek J, Miller KJ, Anderson NR, Leuthardt EC, Ojemann JG, Limbrick D, Moran D, Gerhardt LA, Wolpaw JR. Decoding two-dimensional movement trajectories using electrocorticographic signals in humans. J Neural Eng. 2007; 4(3): 264-275.
31. Miller KJ, Schalk G, Fetz EE, den Nijs M, Ojemann JG, Rao RP. Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc Natl Acad Sci U S A 2010; 107(9): 4430-4435.
32. Isaacs RE, Weber DJ, Schwartz AB. Work toward real-time control of a cortical neural prothesis. IEEE Trans Rehab Eng: Publ IEEE Eng Med Biol Soc. 2000; 8(2): 196-198.
33. Clanton ST. Brain-Computer Interface Control of an Anthropomorphic Robotic Arm. Pittsburgh, PA: Robotics Institute, Carnegie Mellon University; 2011.
34. Kelly JW, Degenhart AD, Siewiorek DP, Smailagic A, Wang W. Sparse linear regression with elastic net regularization for brain-computer interfaces. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA 2012: 4275-4278.
35. Vinjamuri R, Weber DJ, Degenhart AD, Collinger JL, Sudre GP, Adelson PD, Holder DL, Boninger ML, Schwartz AB, Crammond DJ, et al. A fuzzy logic model for hand posture control using human cortical activity recorded by micro-ECog electrodes. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN 2009: 4339-4342.
36. Crone NE, Sinai A, Korzeniewska A. High-frequency gamma oscillations and human brain mapping with electrocorticography. Progress Brain Res. 2006; 159: 275-295.
37. Mukamel R, Gelbard H, Arieli A, Hasson U, Fried I, Malach R. Coupling between neuronal firing, field potentials, and FMRI in human auditory cortex. Science 2005; 309(5736): 951-954.
38. Schalk G. BCIs that use electrocorticographic activity. In Wolpaw JR, Winter-Wolpaw E, eds. Brain-Computer Interfaces: Principles and Practice. New York: Location is New York, NY. Also, to clarify, this is a chapter from a textbook, In: Brain-Computer Interfaces: Principles and Practice. Eds: J.R. Wolpaw and E. Winter-Wolpaw. Oxford University Press; 2012: 251-264.
39. Schalk G, Leuthardt EC. Brain-computer interfaces using electrocorticographic signals. IEEE Rev Biomed Eng. 2011; 4: 140-154.
40. Degenhart AD, Kelly JW, Ashmore RC, Collinger JL, Tyler-Kabara EC, Weber DJ, Wang W. Craniux: a LabVIEW-based modular software framework for brain-machine interface research. Computat Intel Neurosci. 2011; 2011: 363565.
41. Vinjamuri R, Weber DJ, Mao ZH, Collinger JL, Degenhart AD, Kelly JW, Boninger ML, Tyler-Kabara EC, Wang W. Toward synergy-based brain-machine interfaces. IEEE Trans Inf Technol Biomed: Publ IEEE Eng MedBiol Soc. 2011; 15(5): 726-736.
42. Crone NE. Functional mapping with ECoG spectral analysis. Adv Neurol. 2000; 84: 343-351.
43. Hill NJ, Gupta D, Brunner P, Gunduz A, Adamo MA, Ritaccio A, Schalk G. Recording human electrocorticographic (ECoG) signals for neuroscientific research and real-time functional cortical mapping. J Vis Exp: JoVE. 2012; (64): e3993.
44. Yanagisawa T, Hirata M, Saitoh Y, Kishima H, Matsushita K, Goto T, Fukuma R, Yokoi H, Kamitani Y, Yoshimine T. Electrocorticographic control of a prosthetic arm in paralyzed patients. Ann Neurol. 2012; 71(3): 353-361.
45. Rouse AG, Williams JJ, Wheeler JJ, Moran DW. Cortical adaptation to a chronic micro-electrocorticographic brain computer interface. J Neurosci: Official J Soc Neurosci. 2013; 33(4): 1326-1330.
46. Chao ZC, Nagasaka Y, Fujii N. Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys. Frontiers in Neuroeng. 2010; 3: 3.
47. Revolutionizing Prosthetics. http://www.darpa.mil/our_work/dso/programs/revolutionizing_prosthetics.aspx. Accessed February 1, 2013.
48. Harris A, Katyal K, Para M, Thomas J. Revolutionizing prosthetics software technology. Paper Presented at: Systems, Man, and Cybernetics (SMC), 2011 IEEE International Conference, Anchorage, AK 9-12 October, 2011.
49. Johannes MS, Bigelow JD, Burck JM, Harshbarger SD, Kozlowski MV, Van Doren T. An overview of the developmental process for the Modular Prosthetic Limb. The Johns Hopkins University Applied Physics Laboratory Technical Digest. Vol 30. Laurel, MD: Johns Hopkins University; 2011.
50. Armiger RS, Tenore FV, Bishop WE, Beaty JD, Bridges MM, Burck JM, Vogelstein RJ, Harshbarger SD. A real-time virtual integration environment for neuroprosthetics and rehabilitation. In The Johns Hopkins University Applied Physics Laboratory Technical Digest. Vol 30. Laurel, MD: Johns Hopkins University; 2011.
51. Bishop W, Armiger R, Burck J, Bridges M, Hauschild M, Englehart K, Scheme E, Vogelstein RJ, Beaty J, Harshbarger S. A real-time virtual integration environment for the design and development of neural prosthetic systems. Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC 2008: 615-619.
52. Lyle RC. A performance test for assessment of upper limb function in physical rehabilitation treatment and research. International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue Internationale de Recherches de Readaptation 1981; 4(4): 483-492.
53. Investigational Device Exemption. Device Advice: Comprehensive Regulatory Assistance 2013; http://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/HowtoMarketYourDevice/InvestigationalDeviceExemptionIDE/default.htm. Accessed February 1, 2013.
54. Marquaridt DW. Generalized inverses, ridge regression, biased linear estimation, and nonlinear estimation. Technometrics 1970; 12(3): 591-612.
55. Kokotilo KJ, Eng JJ, Curt A. Reorganization and preservation of motor control of the brain in spinal cord injury: a systematic review. J Neurotrauma. 2009; 26(11): 2113-2126.
56. Wang W, Sudre GP, Xu Y, Kass RE, Collinger JL, Degenhart AD, Bagic AI, Weber DJ. Decoding and cortical source localization for intended movement direction with MEG. J Neurophysiol. 2010; 104(5): 2451-2461.
57. Martyn JA, White DA, Gronert GA, Jaffe RS, Ward JM. Up-and-down regulation of skeletal muscle acetylcholine receptors. Effects on neuromuscular blockers. Anesthesiol. 1992; 76(5): 822-843.
58. Rossman AC. The physiology of the nicotinic acetylcholine receptor and its importance in the administration of anesthesia. AANA J. 2011; 79(5): 433-440.
59. Eltorai IM, Wong DH, Lacerna M, Comarr AE, Montroy R. Surgical aspects of autonomic dysreflexia. J Spinal Cord Med. 1997; 20(3): 361-364.
60. Hambly PR, Martin B. Anaesthesia for chronic spinal cord lesions. Anaesthesia 1998; 53(3): 273-289.
61. Krassioukov A, Warburton DE, Teasell R, Eng JJ. A systematic review of the management of autonomic dysreflexia after spinal cord injury. Archiv Phys Med and Rehabilitat 2009; 90(4): 682-695.
62. Lambert DH, Deane RS, Mazuzan JE Jr. Anesthesia and the control of blood pressure in patients with spinal cord injury. Anesthesia Analgesia 1982; 61(4): 344-348.
63. Schonwald G, Fish KJ, Perkash I. Cardiovascular complications during anesthesia in chronic spinal cord injured patients. Anesthesiology 1981; 55(5): 550-558.
64. Yoo KY, Jeong CW, Kim SJ, Chung ST, Bae HB, Oh KJ, Lee J. Sevoflurane concentrations required to block autonomic hyperreflexia during transurethral litholapaxy in patients with complete spinal cord injury. Anesthesiology 2008; 108(5): 858-863.
65. Yoo KY, Jeong CW, Kim SJ, Jeong ST, Kim WM, Lee HK, Oh KJ, Lee JU, Shin MH, Chung SS. Remifentanil decreases sevoflurane requirements to block autonomic hyperreflexia during transurethral litholapaxy in patients with high complete spinal cord injury. Anesthesia Analgesia 2011; 112(1): 191-197.