Comparing temporal aspects of visual, tactile, and microstimulation feedback for motor control

Journal of Neural Engineering

Volumn 11, Issue 4, 2014, Pages

  Godlove, Jason M ^a,b   Whaite, Erin O ^b,c   Batista, Aaron P ^a,b  

^a University of Pittsburgh   (United States)

^b CENTER FOR THE NEURAL BASIS OF COGNITION   (United States)

^c UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

brain computer interface; feedback; reaching; somatosensory; stimulation

Indexed keywords

FEEDBACK; VISUAL COMMUNICATION;

BRAIN COMPUTER INTERFACES (BCIS); NON-VISUAL FEEDBACKS; REACHING; SOMATOSENSORY; SOMATOSENSORY CORTEX; STIMULATION; TEMPORAL ASPECTS; VISUAL ATTENTION;

BRAIN COMPUTER INTERFACE;

ADULT; ARTICLE; ASSOCIATION; BRAIN COMPUTER INTERFACE; FEMALE; HAPLORHINI; HUMAN; MALE; MICROSTIMULATION FEEDBACK; MOTOR CONTROL; NONHUMAN; PRIORITY JOURNAL; REACTION TIME; SENSORY FEEDBACK; SOMATOSENSORY CORTEX; TACTILE FEEDBACK; TACTILE STIMULATION; VISUAL FEEDBACK; VISUAL STIMULATION; ANIMAL; COMPARATIVE STUDY; ELECTROSTIMULATION; FEEDBACK SYSTEM; MOVEMENT (PHYSIOLOGY); PHYSICAL STIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; RHESUS MONKEY; TOUCH; YOUNG ADULT;

ADULT; ANIMALS; ELECTRIC STIMULATION; FEEDBACK, PHYSIOLOGICAL; FEEDBACK, SENSORY; FEMALE; HUMANS; MACACA MULATTA; MALE; MOVEMENT; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; TOUCH; YOUNG ADULT;

EID: 84904656159     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/11/4/046025     Document Type: Article

References (79)

1. Nicolelis M, Dimitrov D, Carmena J, Crist R, Lehew G, Kralik J and Wise S 2003 Chronic, multisite, multielectrode recordings in macaque monkeys Proc. Natl Acad. Sci. USA 100 11041-6 (Pubitemid 37140149)
2. Kennedy P, Andreasen D, Ehirim P, King B, Kirby T, Mao H and Moore M 2003 Using human extra-cortical local field potentials to control a switch J. Neural Eng. 1 72-7 (Pubitemid 41079660)
3. Taylor D, Tillery S and Schwartz A 2002 Direct cortical control of 3D neuroprosthetic devices Science 296 1829-32 (Pubitemid 34596262)
4. Taylor D, Tillery S and Schwartz A 2003 Information conveyed through brain-control: cursor versus robot IEEE Trans. Neural. Syst. Rehabil. Eng. 11 195-9 (Pubitemid 36935058)
5. Jarosiewicz B, Masse N, Bacher D, Cash S, Eskandar E, Friehs G, Donoghue J and Hochberg L 2013 Advantages of closed-loop calibration in intracortical brain-computer interfaces for people with tetraplegia J. Neural Eng. 10 046012
6. Musallam S, Corneil B, Greger B, Scherberger H and Andersen R 2004 Cognitive control signals for neural prosthetics Science 305 258-62 (Pubitemid 38886742)
7. Li Z, O'Doherty J, Lebedev M and Nicolelis M 2011 Adaptive decoding for brain-machine interfaces through bayesian parameter updates Neural Comput. 23 3162-204
8. Gilja V et al 2012 A high-performance neural prosthesis enabled by control algorithm design Nat. Neurosci. 15 1752-7
9. Kim S, Simeral J, Hochberg L, Donoghue J and Black M 2008 Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia J. Neural Eng. 5 455-76
10. Mulliken G, Musallam S and Andersen R 2008 Decoding trajectories from posterior parietal cortex ensembles J. Neurosci. 28 12913-26
11. Onose G et al 2012 On the feasibility of using motor imagery EEG-based brain-computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up Spinal Cord 50 599-608
12. Rouse A, Williams J, Wheeler J and Moran D 2013 Cortical adaptation to a chronic micro-electrocorticographic brain computer interface J. Neurosci. 33 1326-30
13. Ashmore R, Endler B, Smalianchuk I, Degenhart A, Hatsopoulos N, Tyler-Kabara E, Batista A and Wang W 2012 Stable online control of an electrocorticographic brain-computer interface using a static decoder Conf. Proc. IEEE Eng. Med. Biol. Soc. (San Diego) pp 1740-4
14. Hochberg L et al 2012 Reach and grasp by people with tetraplegia using a neurally controlled robotic arm Nature 485 372-5
15. Carmena J, Lebedev M, Crist R, O'Doherty J, Santucci D, Dimitrov D, Patil P, Henriquez C and Nicolelis M 2003 Learning to control a brain-machine interface for reaching and grasping by primates PLoS Biol. 1 E42
16. Hochberg L, Serruya M, Friehs G, Mukand J, Saleh M, Caplan A, Branner A, Chen D, Penn R and Donoghue J 2006 Neuronal ensemble control of prosthetic devices by a human with tetraplegia Nature 442 164-71 (Pubitemid 44086558)
17. Velliste M, Perel S, Spalding M, Whitford A and Schwartz A 2008 Cortical control of a prosthetic arm for self-feeding Nature 453 1098-101
18. Collinger J L, Wodlinger B, Downey J E, Wang W, Tyler-Kabara E C, Weber D J, McMorland A J, Velliste M, Boninger M L and Schwartz A B 2013 7 degree-of-freedom neuroprosthetic control by an individual with tetraplegia Lancet 381 557-64
19. Moritz C, Perlmutter S and Fetz E 2008 Direct control of paralysed muscles by cortical neurons Nature 456 639-42
20. Pohlmeyer E, Oby E, Perreault E, Solla S, Kilgore K, Kirsch R and Miller L 2009 Toward the restoration of hand use to a paralyzed monkey: brain-controlled functional electrical stimulation of forearm muscles PLoS One 4 e5924
21. Ethier C, Oby E, Bauman M and Miller L 2012 Restoration of grasp following paralysis through brain-controlled stimulation of muscles Nature 485 368-71
22. Shanechi M, Williams Z, Wornell G, Hu R, Powers M and Brown E 2013 A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design PLoS One 8 e59049
23. Rutkowski T and Mori H 2014 Tactile and bone-conduction auditory brain computer interface for vision and hearing impaired users J. Neurosci. Methods at press
24. Ghez C, Gordon J and Ghilardi M 1995 Impairments of reaching movements in patients without proprioception. II. effects of visual information on accuracy J. Neurophysiol. 73 361-72
25. Sainburg R, Ghilardi M, Poizner H and Ghez C 1995 Control of limb dynamics in normal subjects and patients without proprioception J. Neurophysiol. 73 820-35
26. Weber D, Friesen R and Miller L 2012 Interfacing the somatosensory system to restore touch and proprioception: essential considerations J. Mot. Behav. 44 403-18
27. Johansson R and Flanagan J 2009 Coding and use of tactile signals from the fingertips in object manipulation tasks Nat. Rev. Neurosci. 10 345-59
28. Bensmaia S J and Miller L E 2014 Restoring sensorimotor function through intracortical interfaces: progress and looming challenges Nature Rev. Neurosci. 15 313-25
29. Tabot G A, Dammann J F III, Berg J A, Tenore F V, Boback J L, Vogelstein R J and Bensmaia S J 2013 Restoring the sense of touch with a prosthetic hand through a brain interface Proc. Natl Acad. Sci. USA 110 18279-84
30. Prewett M S, Yang L, Stilson F R B, Gray A A, Coovert M D, Burke J, Redden E and Elliot L R 2006 The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback Proc. 8th Int. Conf. on Multimodel Interfaces (New York: ACM) pp 333-8
31. Prewett M S, Elliott L R, Walvoord A G and Coovert M D 2012 A meta-analysis of vibrotactile and visual information displays for improving task performance IEEE Trans. Syst. Man Cybern. 40 123-32
32. Scott J and Gray R 2008 A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving Hum. Factors 50 264-75 (Pubitemid 351744371)
33. Forster B, Cavina-Pratesi C, Aglioti S and Berlucchi G 2002 Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time Exp. Brain Res. 143 480-7 (Pubitemid 34253297)
34. Diederich A and Colonius H 2004 Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time Percept. Psychophys. 66 1388-404 (Pubitemid 40778227)
35. Chatterjee A, Aggarwal V, Ramos A, Acharya S and Thakor N 2007 A brain-computer interface with vibrotactile biofeedback for haptic information J. Neuroeng. Rehabil. 4 40
36. Romo A, Hernández A, Zainos and Salinas E 1998 Somatosensory discrimination based on cortical microstimulation Nature 392 387-90
37. Romo R, Hernández A, Zainos A, Brody C and Lemus L 2000 Sensing without touching: psychophysical performance based on cortical microstimulation Neuron 26 273-8
38. O'Doherty J, Lebedev M, Ifft P, Zhuang K, Shokur S, Bleuler H and Nicolelis M 2011 Active tactile exploration using a brain-machine-brain interface Nature 479 228-31
39. London B, Jordan L, Jackson C and Miller L 2008 Electrical stimulation of the proprioceptive cortex (area 3a) used to instruct a behaving monkey IEEE Trans. Neural. Syst. Rehabil. Eng. 16 32-6 (Pubitemid 351264077)
40. O'Doherty J, Lebedev M, Hanson T, Fitzsimmons N and Nicolelis M 2009 A brain-machine interface instructed by direct intracortical microstimulation Front Integr. Neurosci. 3 20
41. Fitzsimmons N, Drake W, Hanson T, Lebedev M and Nicolelis M 2007 Primate reaching cued by multichannel spatiotemporal cortical microstimulation J. Neurosci. 27 5593-602 (Pubitemid 350021077)
42. Salzman C D and Newsome W T 1994 Neural mechanisms for forming a perceptual decision Science 264 231-7 (Pubitemid 24189115)
43. Romo R, Hernández A, Salinas E, Brody C, Zainos A, Lemus L, de L and Luna R 2002 From sensation to action Behav. Brain Res. 135 105-18
44. Tehovnik E 1996 Electrical stimulation of neural tissue to evoke behavioral responses J. Neurosci. Methods 65 1-17 (Pubitemid 26106371)
45. Graziano M, Taylor C and Moore T 2002 Complex movements evoked by microstimulation of precentral cortex Neuron 34 841-51 (Pubitemid 34628745)
46. Cohen M and Newsome W 2004 What electrical microstimulation has revealed about the neural basis of cognition Curr. Opin. Neurobiol. 14 169-77 (Pubitemid 38479933)
47. DeAngelis G and Newsome W 2004 Perceptual 'read-out' of conjoined direction and disparity maps in extrastriate area MT PLoS Biol. 2 E77
48. Tehovnik E, Tolias A, Sultan F, Slocum W and Logothetis N 2006 Direct and indirect activation of cortical neurons by electrical microstimulation J. Neurophysiol. 96 512-21 (Pubitemid 44155190)
49. Liu J and Newsome W 2000 Somatosensation: touching the mind's fingers Curr. Biol. 10 R598-600
50. Brindley G S and Lewin W S 1968 The sensations produced by electrical stimulation of the visual cortex J. Physiol. 196 479-93
51. Dobelle W, Mladejovsky M, Evans J, Roberts T and Girvin J 1976 'Braille' reading by a blind volunteer by visual cortex stimulation Nature 259 111-2
52. Davis K, Kiss Z, Luo L, Tasker R, Lozano A and Dostrovsky J 1998 Phantom sensations generated by thalamic microstimulation Nature 391 385-7 (Pubitemid 28093511)
53. Kiss Z, Anderson T, Hansen T, Kirstein D, Suchowersky O and Hu B 2003 Neural substrates of microstimulation-evoked tingling: a chronaxie study in human somatosensory thalamus Eur. J. Neurosci. 18 728-32 (Pubitemid 37041122)
54. Ohara S, Weiss N and Lenz F 2004 Microstimulation in the region of the human thalamic principal somatic sensory nucleus evokes sensations like those of mechanical stimulation and movement J. Neurophysiol. 91 736-45 (Pubitemid 38168847)
55. Churchland M and Shenoy K 2007 Delay of movement caused by disruption of cortical preparatory activity J. Neurophysiol. 97 348-59 (Pubitemid 46143362)
56. Davis T, Torab K, House P and Greger B 2009 A minimally invasive approach to long-term head fixation in behaving nonhuman primates J. Neurosci. Methods 181 106-10
57. Adams D, Economides J, Jocson C, Parker J and Horton J 2011 A watertight acrylic-free titanium recording chamber for electrophysiology in behaving monkeys J. Neurophysiol. 106 1581-90
58. Koivuniemi A and Otto K 2011 Asymmetric versus symmetric pulses for cortical microstimulation IEEE Trans. Neural. Syst. Rehabil. Eng. 19 468-76
59. Koivuniemi A and Otto K 2012 The depth, waveform and pulse rate for electrical microstimulation of the auditory cortex Conf. Proc. IEEE Eng. Med. Biol. Soc. pp 2489-92
60. Katnani H and Gandhi N 2012 The relative impact of microstimulation parameters on movement generation J. Neurophysiol. 108 528-38
61. Morasso P 1981 Spatial control of arm movements Exp. Brain Res. 42 223-7 (Pubitemid 11147291)
62. Graziano M S, Alisharan S, Hu X and Gross C 2002 The clothing effect: tactile neurons in the precentral gyrus do not respond to the touch of the familiar primate chair Proc. Natl Acad. Sci. USA 99 11930-3 (Pubitemid 34994501)
63. Salzman C D, Britten K and Newsome W 1990 Cortical microstimulation influences perceptual judgements of motion direction Nature 346 174-7
64. Berg J et al 2013 Behavioral demonstration of a somatosensory neuroprosthesis IEEE Trans. Neural. Syst. Rehabil. Eng. 21 500-7
65. Fritsch G and Hitzig E 1870 Uber die elektrische Erregbarkeit des Grosshirns Arch. Anat. Physiol. Wissen 37 300-32
66. Schiller P H and Sandell J 1983 Interactions between visually and electrically elicited saccades before and after superior colliculus and frontal eye field ablations in the rhesus monkey Exp. Brain Res. 49 381-92 (Pubitemid 13160734)
67. Bruce C, Goldberg M E, Bushnell M and Stanton G 1985 Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements J. Neurophysiol. 54 714-34 (Pubitemid 16217258)
68. Robinson D and Fuchs A 1969 Eye movements evoked by stimulation of frontal eye fields J. Neurophysiol. 32 637-48
69. Robinson D 1972 Eye movements evoked by collicular stimulation in the alert monkey Vision Res. 12 1795-808
70. Griffin D, Hudson H, Belhaj-Saïf A and Cheney P 2011 Hijacking cortical motor output with repetitive microstimulation J. Neurosci. 31 13088-96
71. Nowak L and Bullier J 1998 Axons, but not cell bodies, are activated by electrical stimulation in cortical gray matter. I. Evidence from chronaxie measurements Exp. Brain Res. 118 477-88 (Pubitemid 28056848)
72. Ranck J B 1975 Which elements are excited in electrical stimulation of mammalian central nervous system: a review Brain Res. 98 417-40
73. Butovas S and Schwarz C 2003 Spatiotemporal effects of microstimulation in rat neocortex: a parametric study using multielectrode recordings J. Neurophysiol. 90 3024-39 (Pubitemid 37430003)
74. Jazayeri M, Lindbloom-Brown Z and Horwitz G D 2012 Saccadic eye movements evoked by optogenetic activation of primate V1 Nat. Neurosci. 15 1368-70
75. VanDerLubbe R, Jaśkowski P, Wauschkuhn B and Verleger R 2001 Influence of time pressure in a simple response task, a choice-by-location task, and the Simon task J. Psychophysiol. 241-55 (Pubitemid 34196262)
76. Daly J, Liu J, Aghagolzadeh M and Oweiss K 2012 Optimal space-time precoding of artificial sensory feedback through multichannel microstimulation in bi-directional brainmachine interfaces J. Neural Eng. 9 065004
77. Hokanson J, Ayers C, Gaunt R, Bruns T and Weber D 2011 Effects of spatial and temporal parameters of primary afferent microstimulation on neural responses evoked in primary somatosensory cortex of an anesthetized cat Conf. Proc. IEEE Eng. Med. Biol. Soc. pp 7533-6
78. Tehovnik E and Slocum W 2005 Microstimulation of V1 affects the detection of visual targets: manipulation of target contrast Exp. Brain Res. 165 305-14 (Pubitemid 41206954)
79. Wang W et al 2013 An electrocorticographic brain interface in an individual with tetraplegia PLoS One 8 e55344