Virtual active touch using randomly patterned intracortical microstimulation

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 20, Issue 1, 2012, Pages 85-93

  O'Doherty, Joseph E ^a   Lebedev, Mikhail A ^b   Li, Zheng ^b   Nicolelis, Miguel A L ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Bidirectional interface; brain machine interface; intracortical microstimulation; neural prosthesis

Indexed keywords

ACTIVE EXPLORATIONS; APERIODIC PULSE TRAIN; BRAIN MACHINE INTERFACE; COEFFICIENTS OF VARIATIONS; GAMMA DISTRIBUTION; MICROSTIMULATION; MOVEMENT KINEMATICS; NEURAL PROSTHESIS; NEURONAL POPULATIONS; PERIODIC PULSE TRAIN; PULSE RATE; PULSE TRAIN; RHESUS MONKEY; SENSORIMOTOR CORTEX; SOMATOSENSORY FEEDBACKS; SPATIOTEMPORAL PATTERNS; TACTILE SENSATION; TACTILE SENSE; TEMPORAL PATTERN;

HUMAN REHABILITATION ENGINEERING;

COMPUTER APPLICATIONS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFACT; BIOMECHANICS; BRAIN CORTEX; COMPUTER INTERFACE; COMPUTER SIMULATION; ELECTROSTIMULATION; EQUIPMENT DESIGN; EXPLORATORY BEHAVIOR; LEARNING; MACACA MULATTA; MICROELECTRODE; MOTOR CORTEX; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PSYCHOMETRY; PSYCHOMOTOR PERFORMANCE; SOMATOSENSORY CORTEX; TOUCH;

ALGORITHMS; ANIMALS; ARTIFACTS; BIOMECHANICS; CEREBRAL CORTEX; COMPUTER SIMULATION; ELECTRIC STIMULATION; EQUIPMENT DESIGN; EXPLORATORY BEHAVIOR; LEARNING; MACACA MULATTA; MICROELECTRODES; MOTOR CORTEX; MOVEMENT; PSYCHOMETRICS; PSYCHOMOTOR PERFORMANCE; SOMATOSENSORY CORTEX; TOUCH; USER-COMPUTER INTERFACE;

EID: 84856412509     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2011.2166807     Document Type: Article

References (55)

1. M. M. Merzenich, D. N. Schindler, and M. W. White, "Feasibility of multichannel scala tympani stimulation," Laryngoscope, vol. 84, pp. 1887-1893, Nov. 1974.
2. J. B. Fallon, D. R. F. Irvine, and R. K. Shepherd, "Cochlear implants and brain plasticity," Hear. Res., vol. 238, pp. 110-117, Apr. 2008. (Pubitemid 351381618)
3. P. Bach-y-Rita, C. C. Colins, F. A. Saunders, B. White, and L. Scadden, "Vision substitution by tactile image projection," Nature, vol. 221, pp. 963-964, Mar. 1969.
4. P. Bach-y-Rita, K. A. Kaczmarek, M. E. Tyler, and J. Garcia-Lara, "Form perception with a 49-point electrotactile stimulus array on the tongue: A technical note," J. Rehabil. Res. Dev., vol. 35, pp. 427-430, Oct. 1998. (Pubitemid 29180037)
5. P. Bach-y-Rita and S. W. Kercel, "Sensory substitution and the humanmachine interface," Trends Cogn. Sci., vol. 7, pp. 541-546, Dec. 2003.
6. W. H. Dobelle, M. G. Mladejovsky, and J. P. Girvin, "Artificial vision for the blind: Electrical stimulation of visual cortex offers hope for a functional prosthesis," Science, vol. 183, pp. 440-444, Feb. 1974.
7. G. Dagnelie, "Psychophysical evaluation for visual prosthesis," Annu. Rev. Biomed. Eng., vol. 10, pp. 339-368, 2008.
8. E. D. Cohen, "Prosthetic interfaces with the visual system: Biological issues," J. Neural Eng., vol. 4, pp. R14-R31, Jun. 2007. (Pubitemid 46603811)
9. J. E. O'Doherty, M. A. Lebedev, T. L. Hanson, N. A. Fitzsimmons, and M. A. L. Nicolelis, "A brain-machine interface instructed by direct intracortical microstimulation," Front. Integr. Neurosci., vol. 3, p. 20, 2009.
10. J. E. O'Doherty et al., "Active tactile exploration enabled by a brainmachinebrain interface," Nature, vol. 479, pp. 228-231, Nov. 2011.
11. F. A. Mussa-Ivaldi et al., "New perspectives on the dialogue between brains and machines," Front. Neurosci., vol. 4, p. 44, 2010.
12. S. Stanslaski et al., "An implantable bi-directional brain-machine interface system for chronic neuroprosthesis research," in Proc. IEEE Eng. Med. Biol. Soc. Conf., 2009, vol. 2009, pp. 5494-5497.
13. A. H. Fagg et al., "Toward a biomimetic, bidirectional, brain machine interface," in Proc. IEEE Eng. Med. Biol. Soc. Conf., 2009, vol. 2009, pp. 3376-3380.
14. T. C. Marzullo, M. J. Lehmkuhle, G. J. Gage, and D. R. Kipke, "Development of closed-loop neural interface technology in a rat model: Combining motor cortex operant conditioning with visual cortex microstimulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 4, pp. 117-126, Apr. 2010.
15. M. A. Lebedev and M. A. L. Nicolelis, "Brain-machine interfaces: Past, present and future," Trends Neurosci., vol. 29, pp. 536-546, Sep. 2006. (Pubitemid 44291817)
16. M. A. L. Nicolelis and M. A. Lebedev, "Principles of neural ensemble physiology underlying the operation of brain-machine interfaces," Nat. Rev. Neurosci., vol. 10, pp. 530-540, Jul. 2009.
17. N. A. Fitzsimmons, M. A. Lebedev, I. D. Peikon, and M. A. L. Nicolelis, "Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity," Front. Integr. Neurosci., vol. 3, p. 3, 2009.
18. J. S. Brumberg, A. Nieto-Castanon, P. R. Kennedy, and F. H. Guenther, "Brain-computer interfaces for speech communication," Speech Commun., vol. 52, pp. 367-379, Apr. 2010.
19. F. H. Guenther et al., "A wireless brain-machine interface for real-time speech synthesis," PLoS One, vol. 4, p. e8218, 2009.
20. N. R. Peterson, D. B. Pisoni, and R. T. Miyamoto, "Cochlear implants and spoken language processing abilities: Review and assessment of the literature," Restor. Neurol. Neurosci., vol. 28, pp. 237-250, 2010.
21. N. A. Fitzsimmons, W. Drake, T. L. Hanson, M. A. Lebedev, and M. A. L. Nicolelis, "Primate reaching cued by multichannel spatiotemporal cortical microstimulation," J. Neurosci., vol. 27, pp. 5593-5602, May 2007. (Pubitemid 350021077)
22. R. Romo, A. Hernández, A. Zainos, and E. Salinas, "Somatosensory discrimination based on cortical microstimulation," Nature, vol. 392, pp. 387-390, Mar. 1998. (Pubitemid 28168734)
23. R. Romo, A. Hernández, A. Zainos, C. D. Brody, and L. Lemus, "Sensing without touching: Psychophysical performance based on cortical microstimulation," Neuron, vol. 26, pp. 273-278, Apr. 2000.
24. V. de Lafuente and R. Romo, "Neuronal correlates of subjective sensory experience," Nat. Neurosci., vol. 8, pp. 1698-1703, Dec. 2005. (Pubitemid 41683197)
25. S. Butovas and C. Schwarz, "Detection psychophysics of intracortical microstimulation in rat primary somatosensory cortex," Eur. J. Neurosci., vol. 25, pp. 2161-2169, Apr. 2007. (Pubitemid 46581730)
26. A. R. Houweling and M. Brecht, "Behavioural report of single neuron stimulation in somatosensory cortex," Nature, vol. 451, pp. 65-68, Jan. 2008.
27. S. K. Talwar et al., "Rat navigation guided by remote control," Nature, vol. 417, pp. 37-38, May 2002. (Pubitemid 34498808)
28. S. Venkatraman and J. M. Carmena, "Active sensing of target location encoded by cortical microstimulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 3, pp. 317-324, Jun. 2011.
29. D. Katz and L. E. Krueger, The World of Touch. Hillsdale, N. J.: Erlbaum, 1989.
30. V. B. Mountcastle, M. A. Steinmetz, and R. Romo, "Frequency discrimination in the sense of flutter: Psychophysical measurements correlated with postcentral events in behaving monkeys," J. Neurosci., vol. 10, pp. 3032-3044, Sep. 1990.
31. E. Salinas, A. Hernández, A. Zainos, and R. Romo, "Periodicity and firing rate as candidate neural codes for the frequency of vibrotactile stimuli," J. Neurosci., vol. 20, pp. 5503-5515, Jul. 2000. (Pubitemid 30457747)
32. M. A. Lebedev, J. M. Denton, and R. J. Nelson, "Vibration-entrained and premovement activity in monkey primary somatosensory cortex," J. Neurophysiol., vol. 72, pp. 1654-1673, Oct. 1994. (Pubitemid 24325093)
33. R. J. Sinclair and H. Burton, "Tactile discrimination of gratings: Psychophysical and neural correlates in human and monkey," Somatosens. Mot. Res., vol. 8, pp. 241-248, 1991.
34. R. J. Sinclair, J. R. Pruett, and H. Burton, "Responses in primary somatosensory cortex of rhesus monkey to controlled application of embossed grating and bar patterns," Somatosens. Mot. Res., vol. 13, pp. 287-306, 1996. (Pubitemid 27075935)
35. E. Gamzu and E. Ahissar, "Importance of temporal cues for tactile spatialfrequency discrimination," J. Neurosci., vol. 21, pp. 7416-7427, Sept. 2001. (Pubitemid 32846989)
36. J. R. Phillips and K. O. Johnson, "Tactile spatial resolution. II. Neural representation of bars, edges, and gratings in monkey primary afferents," J. Neurophysiol., vol. 46, pp. 1192-1203, Dec. 1981. (Pubitemid 12196184)
37. J. M. Carmena et al., "Learning to control a brain-machine interface for reaching and grasping by primates," PLoS Biol., vol. 1, p. E42, Nov. 2003.
38. A. Koivuniemi and K. Otto, "Asymmetric vs. symmetric electric pulses for intracortical microstimulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 468-476, Oct. 2011.
39. A. D. Dorval, A. M. Kuncel, M. J. Birdno, D. A. Turner, and W. M. Grill, "Deep brain stimulation alleviates parkinsonian bradykinesia by regularizing pallidal activity," J. Neurophysiol., vol. 104, pp. 911-921, Aug. 2010.
40. Z. Li et al., "Unscented Kalman filter for brain-machine interfaces," PLoS One, vol. 4, p. e6243, 2009.
41. Y. Grandvalet, L. Niklasson, Ed. et al., "Perspectives in Neural Computing," in Least Absolute Shrinkage is Equivalent to Quadratic Penalization. New York: Springer Verlag, 1998, pp. 201-206.
42. A. Hernández, A. Zainos, and R. Romo, "Neuronal correlates of sensory discrimination in the somatosensory cortex," in Proc. Nat. Acad. Sci. USA, May 2000, vol. 97, pp. 6191-6196. (Pubitemid 30367545)
43. H. K. Kim et al., "Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces," IEEE Trans. Biomed. Eng., vol. 53, no. 6, pp. 1164-1173, Jun. 2006. (Pubitemid 43860739)
44. S. J. Lederman and R. L. Klatzky, "Hand movements: A window into haptic object recognition," Cogn. Psychol., vol. 19, pp. 342-368, Jul. 1987.
45. E. Heming, R. Choo, J. Davies, and Z. Kiss, "Designing a thalamic somatosensory neural prosthesis: Consistency and persistence of percepts evoked by electrical stimulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 477-482, Oct. 2011.
46. G. Y. Fridman, H. T. Blair, A. P. Blaisdell, and J. W. Judy, "Perceived intensity of somatosensory cortical electrical stimulation," Exp. Brain Res., vol. 203, pp. 499-515, June 2010.
47. R. Sinclair and H. Burton, "Responses from area 3b of somatosensory cortex to textured surfaces during active touch in primate," Somatosens. Res., vol. 5, pp. 283-310, 1988.
48. C. Simões-Franklin, T. A. Whitaker, and F. N. Newell, "Active and passive touch differentially activate somatosensory cortex in texture perception," Hum. Brain Mapp., vol. 32, pp. 1067-1080, 2011.
49. S. J. Bolanowski, R. T. Verrillo, and F. McGlone, "Passive, active and intra-active (self) touch," Behav. Brain. Res., vol. 148, pp. 41-45, Jan. 5, 2004. (Pubitemid 37543654)
50. T. B. Crapse and M. A. Sommer, "Corollary discharge across the animal kingdom," Nat. Rev. Neurosci., vol. 9, pp. 587-600, Aug. 2008. (Pubitemid 352032115)
51. J. D. Rolston, R. E. Gross, and S. M. Potter, "A low-cost multielectrode system for data acquisition enabling real-time closed-loop processing with rapid recovery from stimulation artifacts," Front. Neuroeng., vol. 2, p. 12, 2009.
52. M. H. Histed, V. Bonin, and R. C. Reid, "Direct activation of sparse, distributed populations of cortical neurons by electrical microstimulation," Neuron, vol. 63, pp. 508-522, Aug. 2009.
53. F. Zhang, A. M. Aravanis, A. Adamantidis, L. de Lecea, and K. Deisseroth, "Circuit-breakers: Optical technologies for probing neural signals and systems," Nat. Rev. Neurosci., vol. 8, pp. 577-581, Aug. 2007. (Pubitemid 47096597)
54. E. S. Boyden, F. Zhang, E. Bamberg, G. Nagel, and K. Deisseroth, "Millisecond-timescale, genetically targeted optical control of neural activity," Nat. Neurosci., vol. 8, pp. 1263-1268, Sep. 2005. (Pubitemid 43348147)
55. F. Zhang, L. P. Wang, E. S. Boyden, and K. Deisseroth, "Channelrhodopsin-2 and optical control of excitable cells," Nat. Methods, vol. 3, pp. 785-792, Oct. 2006. (Pubitemid 44445824)