What limits the performance of current invasive brain machine interfaces?

Frontiers in Systems Neuroscience

Volumn 8, Issue APR, 2014, Pages

  Baranauskas, Gytis ^a  

^a LITHUANIAN UNIVERSITY OF HEALTH SCIENCES   (Lithuania)

Author keywords

Brain computer interface; Brain machine interface; Extracellular recordings; Information; Multichannel recordings; Throughput

Indexed keywords

BRAIN COMPUTER INTERFACE; ELECTRODE; HUMAN; MICROPROCESSOR; MOTOR CORTEX; MUSCLE CONTRACTION; NERVE CELL; NONHUMAN; REVIEW; SPEECH;

EID: 84899732750     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2014.00068     Document Type: Review

References (76)

1. Aggarwal, V., Mollazadeh, M., Davidson, A. G., Schieber, M. H., and Thakor, N. V. (2013). State-based decoding of hand and finger kinematics using neuronal ensemble and LFP activity during dexterous reach-to-grasp movements.J. Neurophysiol. 109, 3067-3081. doi: 10.1152/jn.01038.2011
2. Allison, B. Z., Dunne, S., Leeb, R., Millan, J. D. R., and Nijholt, A. (2012). Towards Practical Brain-computer Interfaces. Heidelberg; New York, NY; Dordrecht, London: Springer.
3. Andersen, R. A., Musallam, S., and Pesaran, B. (2004). Selecting the signals for a brain-machine interface. Curr. Opin. Neurobiol. 14, 720-726. doi: 10.1016/j.conb.2004.10.005
4. Brown, P. F., Pietra, V. J. D., Mercer, R. L., Pietra, S. A. D., and Lai, J. C. (1992). An estimate of an upper bound for the entropy of english. Comput. Linguist. 18, 31-40.
5. Brunner, P., Joshi, S., Briskin, S., Wolpaw, J. R., Bischof, H., and Schalk, G. (2010). Does the "P300" speller depends on eye gaze? J. Neural. Eng. 7, 056013. doi: 10.1088/1741-2560/7/5/056013
6. Buracas, G. T., Zador, A. M., DeWeese, M. R., and Albright, T. D. (1998). Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron 20, 959-969. doi: 10.1016/S0896-6273(00)80477-8
7. Buzsáki, G., Anastassiou, C. A., and Koch, C. (2012). The origin of extracellular fields and currents-EEG, ECoG, LFP and spikes. Nat. Rev. Neurosci. 13, 407-420. doi: 10.1038/nrn3241
8. Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., et al. (2003). Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 1:E42. doi: 10.1371/journal.pbio.0000042
9. Chapin, J. K., Moxon, K. A., Markowitz, R. S., and Nicolelis, M. A. (1999). Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2, 664-670. doi: 10.1038/10223
10. Cramer, D. (2003). A cautionary tale of two statistics: partial correlation and standardized partial regression. J. Psychol. 137, 507-511. doi: 10.1080/00223980309600632
11. Dunn, C. C., Noble, W., Tyler, R. S., Kordus, M., Gantz, B. J., and Ji, H. (2010). Bilateral and unilateral cochlear implant users compared on speech perception in noise. Ear Hear. 31, 296-298. doi: 10.1097/AUD.0b013e3181c12383
12. Ecker, A. S., Berens, P., Keliris, G. A., Bethge, M., Logothetis, N. K., and Tolias, A. S. (2010). Decorrelated neuronal firing in cortical microcircuits. Science 327, 584-587. doi: 10.1126/science.1179867
13. Fatourechi, M., Bashashati, A., Ward, R. K., and Birch, G. E. (2007). EMG and EOG artifacts in brain computer interface systems: a survey. J. Clin. Neurophysiol. 118, 480-494. doi: 10.1016/j.clinph.2006.10.019
14. Fetz, E. E., and Baker, M. A. (1973). Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. J. Neurophysiol. 36, 179-204.
15. Fetz, E. E., and Finocchio, D. V. (1971). Operant conditioning of specific patterns of neural and muscular activity. Science 174, 431-435. doi: 10.1126/science.174.4007.431
16. Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement.J. Exp. Psychol. 47, 381-391. doi: 10.1037/h0055392
17. Fitzsimmons, N. A., Lebedev, M. A., Peikon, I. D., and Nicolelis, M. A. (2009). Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity (2009). Front. Integr. Neurosci. 3:3. doi: 10.3389/neuro.07.003.2009
18. Flint, R. D., Wright, Z. A., Scheid, M. R., and Slutzky, M. W. (2013). Long term, stable brain machine interface performance using local field potentials and multiunit spikes. J. Neural Eng. 10, 056005. doi: 10.1088/1741-2560/10/5/056005
19. Gilja, V., Nuyujukian, P., Chestek, C. A., Cunningham, J. P., Yu, B. M., Fan, J. M., et al. (2012). A high-performance neural prosthesis enabled by control algorithm design. Nat. Neurosci. 15, 1752-1757. doi: 10.1038/nn.3265
20. Grosse-Wentrup, M., Mattia, D., and Oweiss, K. (2011). Using brain-computer interfaces to induce neural plasticity and restore function. J. Neural Eng. 8:025004. doi: 10.1088/1741-2560/8/2/025004
21. Guilford, J. P., and Fruchter, B. (1973). Fundamental Statistics in Psychology and Education. 5th Edn. New York, NY: McGraw-Hill Book Co.
22. Harris, K. D., Henze, D. A., Csicsvari, J., Hirase, H., and Buzsáki, G. (2000). Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. J. Neurophysiol. 84, 401-414.
23. Haselager, P. (2013). Did I do that? Brain-computer interfacing and the sense of agency. Minds Mach. 23, 405-418. doi: 10.1007/s11023-012-9298-7
24. Henderson, J. M., Giljam V., Pandarinath, C., Blabe, C., Hochberg, L. R., and Shenoy, K. V. (2013). High performance computer cursor control using neuronal ensemble recordings from the motor cortex of a person with ALS. Neurosurgery 60, 184. doi: 10.1227/01.neu.0000432784.58847.74
25. Henze, D. A., Borhegyi, Z., Csicsvari, J., Mamiya, A., Harris, K. D., and Buzsáki, G. (2000). Intracellular features predicted by extracellular recordings in the hippocampus in vivo. J. Neurophysiol. 84, 390-400.
26. Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J., et al. (2012). Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372-375. doi: 10.1038/nature11076
27. Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., et al. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164-171. doi: 10.1038/nature04970
28. Hoshi, E., and Tanji, J. (2004). Functional specialization in dorsal and ventral premotor areas. Prog. Brain Res. 143, 507-511. doi: 10.1016/S0079-6123(03)43047-1
29. Humphrey, D. R., Schmidt, E. M., and Thompson, W. D. (1970). Predicting measures of motor performance from multiple cortical spike trains. Science 170, 758-762. doi: 10.1126/science.170.3959.758
30. Ifft, P. J., Shokur, S., Lebedev, M. A., and Nicolelis, M. A. (2013). A brain-machine interface enables bimanual arm movements in monkeys. Sci. Transl. Med. 5, 210ra154. doi: 10.1126/scitranslmed.3006159
31. Judy, J. W. (2012). Neural interfaces for upper-limb prosthesis control: opportunities to improve long-term reliability. IEEE Pulse 3, 57-60. doi: 10.1109/MPUL.2011.2181026
32. Kennedy, P. R., and Bakay, R. A. (1998). Restoration of neural output from a paralyzed patient by a direct brain connection. Neuroreport 9, 1707-1711. doi: 10.1097/00001756-199806010-00007
33. Kennedy, P. R., Bakay, R. A., Moore, M. M., and Adams, K. (2000). Direct control of a computer from the human central nervous system. IEEE Trans. Rehabil. Eng. 8, 198-202. doi: 10.1109/86.847815
34. Kennedy, P. R., Bakay, R. A., and Sharpe, S. M. (1992). Behavioral correlates of action potentials recorded chronically inside the Cone Electrode. Neuroreport 3, 605-608. doi: 10.1097/00001756-199207000-00015
35. Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P., and Black, M. J. (2008). Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J. Neural Eng. 5, 455-476. doi: 10.1088/1741-2560/5/4/010
36. Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P., Friehs, G. M., and Black, M. J. (2011). Point-and-click cursor control with an intracortical neural interface system by humans with tetraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 193-203. doi: 10.1109/TNSRE.2011.2107750
37. Klobassa, D. S., Vaughan, T. M., Brunner, P., Schwartz, N. E., Wolpaw, J. R., Neuper, C., et al. (2009). Toward a high-throughput auditory P300-based brain-computer interface. Clin. Neurophysiol. 120, 1252-1261. doi: 10.1016/j.clinph.2009.04.019
38. Krusienski, D. J., Sellers, E. W., McFarland, D. J., Vaughan, T. M., and Wolpaw, J. R. (2008). Toward enhanced P300 speller performance. J. Neurosci. Methods 167, 15-21. doi: 10.1016/j.jneumeth.2007.07.017
39. Lebedev, M. A., and Nicolelis, M. A. L. (2006). Brain-machine interfaces: past, present and future. Trends Neurosci. 29, 536-546. doi: 10.1016/j.tins.2006.07.004
40. Lebedev, M. A., and Nicolelis, M. A. L. (2011). Toward a whole-body neuroprosthetic. Prog. Brain Res. 194, 47-60. doi: 10.1016/B978-0-444-53815-4.00018-2
41. Lebedev, M. A., O'Doherty, J. E., and Nicolelis, M. A. (2008). Decoding of temporal intervals from cortical ensemble activity. J. Neurophysiol. 99, 166-186. doi: 10.1152/jn.00734.2007
42. Lewicki, M. S. (1998). A review of methods for spike sorting: the detection and classification of neural action potentials. Netw. Bristol Engl. 9, R53-R78. doi: 10.1088/0954-898X/9/4/001
43. Li, Z., O'Doherty, J. E., Hanson, T. L., Lebedev, M. A., Henriquez, C. S., and Nicolelis, M. A. L. (2009). Unscented Kalman filter for brain-machine interfaces. PLoS ONE 4:e6423. doi: 10.1371/journal.pone.0006243
44. MacKenzie, I. S., and Buxton, W. (1992). "Extending Fitts Law to two-dimensional tasks, " in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, series CHI '92, (New York, NY: ACM), 219-226. doi: 10.1145/142750.142794
45. MacKinnon, D. P., Fairchild, A. J., and Fritz, M. S. (2007). Mediation analysis. Annu. Rev. Psychol. 58, 593-614. doi: 10.1146/annurev.psych.58.110405.085542
46. Moller, A. R. (2006). "History of cochlear impalnts and auditory brainstem implants, " in Cohlear and Brainstem Implants. Adv. Otorhinolaryngology. (Basel: Karger), 1-10.
47. Moritz, C. T., and Fetz, E. E. (2011). Volitional control of single cortical neurons in a brain machine interface. J. Neural. Eng. 8, 025017. doi: 10.1088/1741-2560/8/2/025017
48. Moritz, C. T., Perlmutter, S. I., and Fetz, E. E. (2008). Direct control of paralyzed muscles by cortical neurons. Nature 456, 639-643. doi: 10.1038/nature07418
49. Mulliken, G. H., Musallam, S., and Andersen, R. A. (2008). Decoding trajectories from posterior parietal cortex ensembles. J. Neurosci. 28, 12913-12926. doi: 10.1523/JNEUROSCI.1463-08.2008
50. Mussa-Ivaldi, F. A., and Miller, L. E. (2003). Brain-machine interfaces: computational demands and clinical needs meet basic neuroscience. Trends Neurosci. 26, 329-334. doi: 10.1016/S0166-2236(03)00121-8
51. Navarro, X., Krueger, T. B., Lago, N., Micera, S., Stieglitz, T., and Dario, P. (2005). A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems. J. Peripher. Nerv. Syst. 10, 229-258. doi: 10.1111/j.1085-9489.2005.10303.x
52. Nelken, I., and Chechik, G. (2007). Information theory in auditory research. Hear. Res. 229, 94-105. doi: 10.1016/j.heares.2007.01.012
53. Nicolelis, M. A. L., and Lebedev, M. A. (2009). Principles of neural ensemble physiology underlying the operation of brain-machine interfaces. Nat. Rev. Neurosci. 10, 530-540. doi: 10.1038/nrn2653
54. O'Doherty, J. E., Lebedev, M. A., Ifft, P. J., Zhuang, K. Z., Shokur, S., Bleuler, H. et al. (2011). Active tactile exploration using a brain-machine-brain interface. Nature 479, 228-231. doi: 10.1038/nature10489
55. Oskoei, M. A., and Hu, H. (2007). Myoelectric control systems-a survey. Biomed. Signal Process. Control 2, 275-294. doi: 10.1016/j.bspc.2007.07.009
56. Rauschecker, J. P., and Shannon, R. V. (2002). Sending sound to the brain. Science 295, 1025-1029. doi: 10.1126/science.1067796
57. Santhanam, G., Ryu, S. I., Yu, B. M., Afshar, A., and Shenoy, K. V. (2006). A high-performance brain-computer interface. Nature 442, 195-198. doi: 10.1038/nature04968
58. Saunders, J. A., and Knill, D. C. (2003). Humans use continuous visual feedback from the hand to control fast reaching movements. Exp. Brain Res. 152, 341-352. doi: 10.1007/s00221-003-1525-2
59. Schmidt, E. M., McIntosh, J. S., Durelli, L., and Bak, M. J. (1978). Fine control of operantly conditioned firing patterns of cortical neurons. Exp. Neurol. 61, 349-369. doi: 10.1016/0014-4886(78)90252-2
60. Schwartz, A. B., Cui, X. T., Weber, D. J., and Moran, D. W. (2006). Brain-controlled interfaces: movement restoration with neural prosthetics. Neuron 52, 205-220. doi: 10.1016/j.neuron.2006.09.019
61. Schwartz, A. B., Taylor, D. M., and Tillery, S. I. (2001). Extraction algorithms for cortical control of arm prosthetics. Curr. Opin. Neurobiol. 11, 701-707. doi: 10.1016/S0959-4388(01)00272-0
62. Shannon, C. E. (1948). Mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423, 623-656. doi: 10.1002/j.1538-7305.1948.tb00917.x
63. Simeral, J. D., Kim, S.-P., Black, M. J., Donoghue, J. P., and Hochberg, L. R. (2011). Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array.J. Neural Eng. 8, 025027. doi: 10.1088/1741-2560/8/2/025027
64. Surakka, V., Illi, M., and Isokoski, P. (2004). Gazing and frowning as a new human-computer interaction technique. ACM Trans. Appl. Percept. 1, 40-56. doi: 10.1145/1008722.1008726
65. Taylor, D. M., Tillery, S. I. H., and Schwartz, A. B. (2002). Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829-1832. doi: 10.1126/science.1070291
66. Taylor, D. M., Tillery, S. I. H., and Schwartz, A. B. (2003). Information conveyed through brain-control: cursor versus robot. IEEE Trans. Neural. Syst. Rehab. Eng. 11, 195-199. doi: 10.1109/TNSRE.2003.814451
67. Tehovnik, E. J., Woods, L. C., and Slocum, W. M. (2013). Transfer of information by BMI. Neuroscience 255, 134-146. doi: 10.1016/j.neuroscience.2013.10.003
68. Tonet, O., Marinelli, M., Citi, L., Rossini, P. M., Rossini, L., Megali, G., et al. (2008). Defining brain-machine interface applications by matching interface performance with device requirements. J. Neurosci. Methods 167, 91-104. doi: 10.1016/j.jneumeth.2007.03.015
69. Townsend, G., LaPallo, B. K., Boulay, C. B., Krusienski, D. J., Frye, G. E., Hauser, C. K., et al. (2010). A novel P300-based brain-computer interface stimulus presentation paradigm: moving beyond rows and columns. Clin. Neurophysiol. 121, 1109-1120. doi: 10.1016/j.clinph.2010.01.030
70. Tuisku, O., Surakka, V., Vanhala, T., Rantanen, V., and Lekkala, J. (2012). Wireless Face Interface: using voluntary gaze direction and facial muscle activations for human-computer interaction. Interact. Comput. 24, 1-9. doi: 10.1016/j.intcom.2011.10.002
71. Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., and Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098-1101. doi: 10.1038/nature06996
72. Vialatte, F.-B., Maurice, M., Dauwels, J., and Cichocki, A. (2010). Steady state visually evoked potentials: focus on essential paradigms and future perspectives. Prog. Neurobiol. 90, 418-438. doi: 10.1016/j.neurobio.2009.11.005
73. Wessberg, J., Stambaugh, C. R., Kralik, J. D., Beck, P. D., Laubach, M., Chapin, J. K., et al. (2000). Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361-365. doi: 10.1038/35042582
74. Wolpaw, J. R., Birbaumer, N., Heetderks, W. J., McFarland, D. J., Peckham, P. H., Schalk, G., et al. (2000). Brain-computer interface technology: a review of the first international meeting. IEEE Trans. Rehabil. Eng. 8, 164-173.
75. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., and Vaughan, T. M. (2002). Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767-791. doi: 10.1016/S1388-2457(02)00057-3
76. Wolpaw, J. R., and McFarland, D. J. (2004). Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. U.S.A. 101, 17849-17854. doi: 10.1073/pnas.0403504101