Simultaneous neural control of simple reaching and grasping with the modular prosthetic limb using intracranial EEG

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 22, Issue 3, 2014, Pages 695-705

  Fifer, Matthew S ^a   Hotson, Guy ^b   Wester, Brock A ^c   McMullen, David P ^d   Wang, Yujing ^a   Johannes, Matthew S ^c   Katyal, Kapil D ^c   Helder, John B ^c   Para, Matthew P ^c   Vogelstein, R Jacob ^c   Anderson, William S ^d   Thakor, Nitish V ^a,e   Crone, Nathan E ^f  

^a Johns Hopkins University   (United States)

^b Johns Hopkins University   (United States)

^c JOHNS HOPKINS UNIVERSITY APPLIED PHYSICS LABORATORY   (United States)

^d JOHNS HOPKINS UNIVERSITY   (United States)

^e NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^f JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Brain machine interface (BMI); electrocorticography; functional mapping; high gamma; upper limb prosthesis

Indexed keywords

BRAIN MAPPING; ELECTRODES; ELECTROENCEPHALOGRAPHY; KNOWLEDGE MANAGEMENT; ROBOTICS;

BRAIN MACHINE INTERFACE; ELECTROCORTICOGRAPHY; FUNCTIONAL MAPPING; HIGH GAMMA; UPPER LIMB PROSTHESIS;

ARTIFICIAL LIMBS;

ADULT; ANTHROPOMETRY; ELECTRODE IMPLANT; ELECTROENCEPHALOGRAPHY; FEMALE; HAND STRENGTH; HUMAN; LIMB PROSTHESIS; MALE; MIDDLE AGED; ONLINE SYSTEM; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY;

ADULT; ANTHROPOMETRY; ARTIFICIAL LIMBS; ELECTRODES, IMPLANTED; ELECTROENCEPHALOGRAPHY; FEMALE; HAND STRENGTH; HUMANS; MALE; MIDDLE AGED; ONLINE SYSTEMS; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY OF RESULTS;

EID: 84900434632     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2013.2286955     Document Type: Article

References (45)

1. T. Pistohl, A. Schulze-Bonhage, A. Aertsen, C. Mehring, and T. Ball, "Decoding natural grasp types from human ECoG, " Neuroimage, vol.59, pp. 248-260, Jan. 2, 2012.
2. T. Pistohl, T. S. Schmidt, T. Ball, A. Schulze-Bonhage, A. Aertsen, and C. Mehring, "Grasp detection from human ECoG during naturalreach-to-grasp movements, " PLoS One, vol. 8, p. e54658, 2013.
3. C. A. Chestek, V. Gilja, C. H. Blabe, B. L. Foster, K. V. Shenoy, J.Parvizi, and J. M. Henderson, "Hand posture classification using electrocorticographysignals in the gamma band over human sensorimotorbrain areas, " J. Neural. Eng., vol. 10, p. 026002, Jan. 31, 2013.
4. N. R. Anderson, T. Blakely, G. Schalk, E. C. Leuthardt, and D. W.Moran, "Electrocorticographic (ECoG) correlates of human armmovements, "Exp. Brain. Res., vol. 223, pp. 1-10, Nov. 2012.
5. R. Vinjamuri, D. J. Weber, Z. H. Mao, J. L. Collinger, A. D. Degenhart, J. W. Kelly, M. L. Boninger, E. C. Tyler-Kabara, and W. Wang, "Toward synergy-based brain-machine interfaces, " IEEE Trans. Inf.Technol. Biomed., vol. 15, no. 5, pp. 726-736, Sep. 2011.
6. T. Yanagisawa, M. Hirata, Y. Saitoh, H. Kishima, K. Matsushita, T.Goto, R. Fukuma, H. Yokoi, Y. Kamitani, and T. Yoshimine, " Electrocorticographiccontrol of a prosthetic arm in paralyzed patients, " Ann.Neurol., vol. 71, pp. 353-361, Mar. 2012.
7. W. Wang, J. L. Collinger, A. D. Degenhart, E. C. Tyler-Kabara, A. B.Schwartz, D. W. Moran, D. J.Weber, B. Wodlinger, R. K. Vinjamuri, R. C. Ashmore, J. W. Kelly, and M. L. Boninger, "An electrocorticographicbrain interface in an individual with tetraplegia, " PLoS One, vol. 8, p. e55344, 2013.
8. E. C. Leuthardt, G. Schalk, D. Moran, and J. G. Ojemann, "Theemerging world of motor neuroprosthetics: A neurosurgical perspective, "Neurosurgery, vol. 59, pp. 1-14, Jul. 2006.
9. W. J. Freeman, M. D. Holmes, B. C. Burke, and S. Vanhatalo, "Spatialspectra of scalp EEG and EMG from awake humans, " Clin. Neurophysiol., vol. 114, pp. 1053-1068, Jun. 2003. (Pubitemid 36694762)
10. T. Ball, M. Kern, I. Mutschler, A. Aertsen, and A. Schulze-Bonhage, "Signal quality of simultaneously recorded invasive and non-invasiveEEG, " Neuroimage, vol. 46, pp. 708-716, Jul. 1, 2009.
11. J. R. Manning, J. Jacobs, I. Fried, and M. J. Kahana, "Broadband shiftsin local field potential power spectra are correlated with single-neuronspiking in humans, " J. Neurosci., vol. 29, pp. 13613-13620, Oct. 28, 2009.
12. S. Ray, N. E. Crone, E. Niebur, P. J. Franaszczuk, and S. S. Hsiao, "Neural correlates of high-gamma oscillations (60-200 Hz) inmacaquelocal field potentials and their potential implications in electrocorticography, "J. Neurosci., vol. 28, pp. 11526-11536, Nov. 5, 2008.
13. E. C. Leuthardt, G. Schalk, J. R. Wolpaw, J. G. Ojemann, and D. W.Moran, "A brain-computer interface using electrocorticographic signalsin humans, " J. Neural. Eng., vol. 1, pp. 63-71, Jun. 2004. (Pubitemid 41079659)
14. G. Schalk, K. J. Miller, N. R. Anderson, J. A. Wilson, M. D. Smyth, J.G. Ojemann, D. W. Moran, J. R. Wolpaw, and E. C. Leuthardt, " Twodimensionalmovement control using electrocorticographic signals inhumans, " J. Neural. Eng., vol. 5, pp. 75-84, Mar. 2008. (Pubitemid 351366605)
15. J. R. Wolpaw, D. J. McFarland, G. W. Neat, and C. A. Forneris, "AnEEG-based brain-computer interface for cursor control, " Electroencephalogr.Clin. Neurophysiol., vol. 78, pp. 252-259, Mar. 1991.
16. D. J. McFarland, W. A. Sarnacki, and J. R. Wolpaw, " Electroencephalographic(EEG) control of three-dimensional movement, " J.Neural. Eng., vol. 7, p. 036007, Jun. 2010.
17. A. G. Rouse, J. J.Williams, J. J.Wheeler, and D. W. Moran, "Corticaladaptation to a chronic micro-electrocorticographic brain computer interface, "J. Neurosci., vol. 33, pp. 1326-1330, Jan. 23, 2013.
18. J. S. Duncan, X. Papademetris, J. Yang, M. Jackowski, X. Zeng, and L.H. Staib, "Geometric strategies for neuroanatomic analysis fromMRI, "Neuroimage, vol. 23, pp. S34-S45, 2004. (Pubitemid 39421705)
19. Y. Klipper-Aurbach, M. Wasserman, N. Braunspiegel-Weintrob, D.Borstein, S. Peleg, S. Assa, M. Karp, Y. Benjamini, Y. Hochberg, andZ. Laron, "Mathematical formulae for the prediction of the residualbeta cell function during the first two years of disease in childrenand adolescents with insulin-dependent diabetes mellitus, " Med.Hypotheses, vol. 45, pp. 486-490, Nov. 1995.
20. D. J. McFarland, L. M. McCane, S. V. David, and J. R. Wolpaw, "Spatial filter selection for EEG-based communication, " Electroencephalogr.Clin. Neurophysiol., vol. 103, pp. 386-394, 1997. (Pubitemid 27382149)
21. M. S. Johannes, J. D. Bigelow, J. M. Burck, S. D. Harshbarger, M.V. Kozlowski, and T. Van Doren, "An overview of the developmentprocess for the modular prosthetic limb, " Johns Hopkins Univ. Appl.Phys. Lab. Tech. Dig., vol. 30, 2011.
22. A. Harris, K. Katyal, M. Para, and J. Thomas, "Revolutionizing prostheticssoftware technology, " in Proc. 2011 IEEE Int. Conf. Syst., Man, Cybern., 2011, pp. 2877-2884.
23. M. M. Bridges, M. P. Para, and M. J. Mashner, "Control system architecturefor the modular prosthetic limb, " Johns Hopkins Univ. Appl.Phys. Lab. Tech. Dig., vol. 30, 2011.
24. M. S. Fifer, S. Acharya, H. L. Benz, M. Mollazadeh, N. E. Crone, andN. V. Thakor, "Toward electrocorticographic control of a dexterousupper limb prosthesis: Building brain-machine interfaces, " IEEEPulse, vol. 3, pp. 38-42, Jan. 2012.
25. G. Rizzolatti, G. Luppino, and M. Matelli, "The organization of thecortical motor system: New concepts, " Electroencephalogr. Clin. Neurophysiol., vol. 106, pp. 283-296, Apr. 1998. (Pubitemid 28198084)
26. F. Filimon, "Human cortical control of handmovements: Parietofrontalnetworks for reaching, grasping, and pointing, " Neuroscientist, vol. 16, pp. 388-407, Aug. 2010.
27. N. E. Crone, D. L. Miglioretti, B.Gordon, and R. P. Lesser, "Functionalmapping of human sensorimotor cortex with electrocorticographicspectral analysis. II. Event-related synchronization in the gammaband, " in Brain, Dec. 1998, vol. 121, pp. 2301-2315, (pt 12). (Pubitemid 28552467)
28. N. E. Crone, L. Hao, J. Hart, Jr., D. Boatman, R. P. Lesser, R. Irizarry, and B. Gordon, "Electrocorticographic gamma activity during wordproduction in spoken and sign language, " Neurology, vol. 57, pp.2045-2053, Dec. 11, 2001. (Pubitemid 33126873)
29. K. J. Miller, E. C. Leuthardt, G. Schalk, R. P. Rao, N. R. Anderson, D. W. Moran, J. W. Miller, and J. G. Ojemann, "Spectral changes incortical surface potentials during motor movement, " J. Neurosci., vol.27, pp. 2424-2432, Feb. 28, 2007. (Pubitemid 46340971)
30. S. Ray, E. Niebur, S. S. Hsiao, A. Sinai, and N. E. Crone, "Highfrequencygamma activity (80-150 Hz) is increased in human cortexduring selective attention, " Clin. Neurophysiol., vol. 119, pp. 116-133, Jan. 2008.
31. J. Liu and W. T. Newsome, "Local field potential in cortical area MT:Stimulus tuning and behavioral correlations, " J. Neurosci., vol. 26, pp.7779-7790, July 26, 2006. (Pubitemid 44315148)
32. S. Ray, N. E. Crone, E. Niebur, P. J. Franaszczuk, and S. S. Hsiao, "Neural correlates of high-gamma oscillations (60-200 Hz) inmacaquelocal field potentials and their potential implications in electrocorticography, "J. Neurosci., vol. 28, pp. 11526-11536, 2008.
33. S. Ray and J. H. Maunsell, "Different origins of gamma rhythm andhigh-gamma activity in macaque visual cortex, " PLoS Biol., vol. 9, p.e1000610, Apr. 2011.
34. A. Flinker, E. F. Chang, N. M. Barbaro, M. S. Berger, and R. T. Knight, "Sub-centimeter language organization in the human temporal lobe, "Brain Lang., vol. 117, pp. 103-109, Jun. 2011.
35. J. P. Lachaux, N. Axmacher, F.Mormann, E. Halgren, and N. E. Crone, "High-frequency neural activity and human cognition: Past, presentand possible future of intracranial EEG research, " Prog. Neurobiol., vol. 98, pp. 279-301, Sept. 2012.
36. A.Flinker, E.F.Chang, H.E.Kirsch, N.M.Barbaro, N. E.Crone, andR.T. Knight, "Single-trial speech suppression of auditory cortex activity inhumans, " J. Neurosci., vol. 30, pp. 16643-16650, Dec. 8, 2010.
37. J. Kubanek, K. J. Miller, J. G. Ojemann, J. R. Wolpaw, and G. Schalk, "Decoding flexion of individual fingers using electrocorticographicsignals in humans, " J. Neural. Eng., vol. 6, p. 66001, Dec. 2009.
38. T. Yanagisawa, M. Hirata, Y. Saitoh, T. Goto, H. Kishima, R. Fukuma, H. Yokoi, Y. Kamitani, and T. Yoshimine, "Real-time control of a prosthetichand using human electrocorticography signals, " J. Neurosurg., vol. 114, pp. 1715-1722, June 2011.
39. Z. C. Chao, Y. Nagasaka, and N. Fujii, "Long-term asynchronous decodingof arm motion using electrocorticographic signals in monkeys, "Front Neuroeng., vol. 3, p. 3, 2010.
40. L. R. Hochberg, D. Bacher, B. Jarosiewicz, N. Y. Masse, J. D. Simeral, J. Vogel, S. Haddadin, J. Liu, S. S. Cash, P. van der Smagt, and J. P.Donoghue, "Reach and grasp by peoplewith tetraplegia using a neurallycontrolled robotic arm, " Nature, vol. 485, pp. 372-375, May 17, 2012.
41. J. L. Collinger, B. Wodlinger, J. E. Downey, W. Wang, E. C. Tyler-Kabara, D. J. Weber, A. J. McMorland, M. Velliste, M. L. Boninger, and A. B. Schwartz, "High-performance neuroprosthetic control by anindividual with tetraplegia, " Lancet, Dec. 13, 2012.
42. N. S. Narayanan, E. Y. Kimchi, and M. Laubach, "Redundancy andsynergy of neuronal ensembles in motor cortex, " J. Neurosci., vol. 25, pp. 4207-4216, Apr. 27, 2005. (Pubitemid 40628764)
43. M. W. Slutzky, L. R. Jordan, T. Krieg, M. Chen, D. J. Mogul, and L. E.Miller, "Optimal spacing of surface electrode arrays for brain-machineinterface applications, " J. Neural. Eng., vol. 7, p. 26004, Apr. 2010.
44. J. Viventi, D. H. Kim, L. Vigeland, E. S. Frechette, J. A. Blanco, Y. S.Kim, A. E. Avrin, V. R. Tiruvadi, S. W. Hwang, A. C. Vanleer, D. F.Wulsin, K. Davis, C. E. Gelber, L. Palmer, J. Van der Spiegel, J. Wu, J. Xiao, Y. Huang, D. Contreras, J. A. Rogers, and B. Litt, "Flexible, foldable, actively multiplexed, high-density electrode array for mappingbrain activity in vivo, " Nat. Neurosci., vol. 14, pp. 1599-1605, Dec. 2011.
45. S. Thongpang, T. J. Richner, S. K. Brodnick, A. Schendel, J. Kim, J.A.Wilson, J. Hippensteel, L. Krugner-Higby, D. Moran, A. S. Ahmed, D. Neimann, K. Sillay, and J. C. Williams, "A micro-electrocorticographyplatform and deployment strategies for chronic BCI applications, "Clin. EEG Neurosci., vol. 42, pp. 259-265, Oct. 2011.