Haptic interaction of touch and proprioception: Implications for neuroprosthetics

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 19, Issue 5, 2011, Pages 490-500

  Rincon Gonzalez, Liliana ^a   Warren, Jay P ^b   Meller, David M ^c   Helms Tillery, Stephen ^d  

^a ARIZONA STATE UNIVERSITY   (United States)

^b Carefusion Corporation   (United States)

^c EXPONENT INC   (United States)

^d Arizona State University   (United States)

Author keywords

Muscle sense; prosthetics; somatosensation; tactile

Indexed keywords

CORTICAL NEURONS; DYNAMIC MODIFICATIONS; HAPTIC INTERACTIONS; HAPTICS; IN-PROCESS; NEUROPROSTHETICS; PRIMARY SOMATOSENSORY CORTEX; RECEPTIVE FIELDS; SEAMLESS INTEGRATION; SELF MOTION; SELF-MOVEMENTS; SOMATOSENSATION; SOMATOSENSORY; SOMATOSENSORY SYSTEMS; SPATIAL ERRORS; SPATIAL LOCATION; TACTILE; TACTILE SENSATION;

VIRTUAL REALITY;

ANIMAL; ARTICLE; BODY POSTURE; FINGER; HUMAN; INNERVATION; METHODOLOGY; PHYSIOLOGY; PROPRIOCEPTION; PROSTHESES AND ORTHOSES; PROSTHESIS; ROBOTICS; SOMATOSENSORY CORTEX; TOUCH;

ANIMALS; FINGERS; HUMANS; POSTURE; PROPRIOCEPTION; PROSTHESES AND IMPLANTS; PROSTHESIS DESIGN; ROBOTICS; SOMATOSENSORY CORTEX; TOUCH;

EID: 80054086675     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2011.2166808     Document Type: Article

References (90)

1. F. A. Geldard and C. E. Sherrick, "The cutaneous "rabbit": A perceptual illusion," Science, vol. 178, no. 57, pp. 178-179, Oct. 13, 1972.
2. F. A. Geldard, "Cutaneous stimuli, vibratory and saltatory," J. Invest. Dermatol., vol. 69, no. 1, pp. 83-87, Jul. 1977. (Pubitemid 8130714)
3. F. A. Geldard, "Cutaneous saltatory areas and intensity," Bull. Psychonomic Soc., vol. 16, p. 178, 1980.
4. F. A. Geldard, "Saltatory areas of the skin-What determines their limits," Bull. Psychonomic Soc., vol. 18, no. 55, 1981.
5. F. A. Geldard, "Intersensory perception and sensory integration," Am. J. Psychol., vol. 95, pp. 529-530, 1982.
6. F. A. Geldard, "Saltation in somesthesis," Psychol. Bull., vol. 92, no. 1, pp. 136-175, Jul. 1982.
7. F. A. Geldard and C. E. Sherrick, "The cutaneous saltatory area and presumed neural basis," Percept. Psychophys., vol. 33, no. 4, pp. 299-304, Apr. 1983. (Pubitemid 13061864)
8. F. A. Geldard and C. E. Sherrick, "Space, time and touch," Sci. Am., vol. 255, no. 1, pp. 90-95, Jul. 1986.
9. M. Eimer, B. Forster, and J. Vibell, "Cutaneous saltation within and across arms: A new measure of the saltation illusion in somatosensation," Percept. Psychophys., vol. 67, no. 3, pp. 458-468, Apr. 2005. (Pubitemid 40979061)
10. F. Blankenburg, C. C. Ruff, and R. Deichmann et al., "The cutaneous rabbit illusion affects human primary sensory cortex somatotopically," PLoS Biol., vol. 4, no. 3, p. e69, Mar. 2006.
11. R. Flach and P. Haggard, "The cutaneous rabbit revisited," J. Exp. Psychol. Hum. Percept. Perform, vol. 32, no. 3, pp. 717-732, Jun. 2006. (Pubitemid 44195477)
12. J. P. Warren, M. Santello, and S. I. Helms Tillery, "Electrotactile stimuli delivered across fingertips inducing the cutaneous rabbit effect," Exp. Brain Res., vol. 206, no. 4, pp. 419-426, 2010.
13. J. P.Warren, "Effects of fusion between tactile and proprioceptive input on tactile perception," Public Library Sci. One, vol. 6, no. 3, 2011.
14. S. I. Tillery, J. F. Soechting, and T. J. Ebner, "Somatosensory cortical activity in relation to arm posture: Nonuniform spatial tuning," J. Neurophysiol., vol. 76, no. 4, pp. 2423-2438, 1996. (Pubitemid 26346417)
15. M. J. L. Prud'homme and J. F. Kalaska, "Proprioceptive activity in primate primary somatosensory cortex during active arm reaching movements," J. Neurophysiol., vol. 72, pp. 2280-2301, 1994. (Pubitemid 24362625)
16. D. A. D. Cohen, M. J. L. Prud'homme, and J. F. Kalaska, "Tactile activity in primate somatosensory cortex during active arm movements: Correlation with receptive field properties," J. Neurophysiol., vol. 71, pp. 161-172, 1994. (Pubitemid 24058849)
17. M. Hulliger, E. Nordh, and A.-E. Thelin et al., "The responses of afferent fibres from the glabrous skin of the hand during voluntary finger movements in man," J. Physiol. (London), vol. 291, pp. 233-249, 1979. (Pubitemid 9193954)
18. B. B. Edin and J. H. Abbs, "Finger movement responses of cutaneous mechanoreceptors in the dorsal skin of the human hand," J. Neurophysiol., vol. 65, pp. 657-670, 1991.
19. B. B. Edin and N. Johansson, "Skin strain patterns provide kinaesthetic information to the human central nervous system," J. Physiol. (London), vol. 487, pp. 243-251, 1995.
20. L. Rincon-GonzalezC. A. Buneo and S. I. Helms-Tillery, "The proprioceptive map of arm position is systematic and stable, but idiosyncractic," PLoS One, 2011.
21. A. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: Bradford Books, MIT Press, 1990.
22. M. P. Kilgard and M. M. Merzenich, "Anticipated stimuli across skin," Nature, vol. 373, no. 6516, p. 663, Feb. 23, 1995.
23. L. R. Bobich, J. P. Warren, and J. D. Sweeney et al., "Spatial localization of electrotactile stimuli on the fingertip in humans," Somatosens. Mot. Res., vol. 24, no. 4, pp. 179-188, Dec. 2007.
24. J. P. Warren, L. R. Bobich, and M. Santello et al., "Receptive field characteristics under electrotactile stimulation of the fingertip," IEEE Trans Neural Syst. Rehabil. Eng., vol. 16, no. 4, pp. 410-415, Aug. 2008.
25. M. Nawrot, A. Aertsen, and S. Rotter, "Single-trial estimation of neuronal firing rates: From single-neuron spike trains to population activity," J. Neurosci. Methods, vol. 94, no. 1, pp. 81-92, Dec. 15, 1999.
26. V. B. Mountcastle, M. A. Steinmetz, and R. Romo, "Frequency discrimination in the sense of flutter: Psychophysical measurements correlated with postcentral events in behaving monkeys," J. Neurosci., vol. 10, no. 9, pp. 3032-3044, Sep. 1990.
27. S. Miocinovic, A. M. Noecker, and C. B. Maks et al., "Cicerone: Stereotactic neurophysiological recording and deep brain stimulation electrode placement software system," Acta Neurochir. Suppl., vol. 97, pt. 2, pp. 561-567, 2007.
28. B. B. Edin, "Quantitative analysis of static strain sensitivity in human mechanoreceptors from hairy skin," J. Neurophysiol., vol. 67, pp. 1105-1113, 1992.
29. B. B. Edin, "Quantitative analyses of dynamic strain sensitivity in human skin mechanoreceptors," J. Neurophysiol., vol. 92, no. 6, pp. 3233-3243, Dec. 2004. (Pubitemid 39506302)
30. M. S. Christensen, J. Lundbye-Jensen, and S. S. Geertsen et al., "Premotor cortex modulates somatosensory cortex during voluntary movements without proprioceptive feedback," Nat. Neurosci., vol. 10, no. 4, pp. 417-419, Apr. 2007. (Pubitemid 46494593)
31. P. N. Steinmetz, A. Roy, and P. J. Fitzgerald et al., "Attention modulates synchronized neuronal firing in primate somatosensory cortex," Nature, vol. 404, no. 6774, pp. 187-190, Mar. 9, 2000. (Pubitemid 30154486)
32. D. Zipser and R. A. Andersen, "A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons," Nature, vol. 331, no. 6158, pp. 679-684, Feb. 25, 1988. (Pubitemid 18062235)
33. R. A. Andersen and D. Zipser, "The role of the posterior parietal cortex in coordinate transformations for visual-motor integration," Can. J. Physiol. Pharmacol., vol. 66, no. 4, pp. 488-501, Apr. 1988.
34. S. Adamovich, M. Berkinblit, and B. Smetanin et al., "Influence of movement speed on accuracy of pointing to memorized targets in 3D space," Neurosci. Lett., vol. 172, no. 1-2, pp. 171-174, May 19, 1994. (Pubitemid 24178770)
35. S. V. Adamovich, M. B. Berkinblit, and O. Fookson et al., "Pointing in 3D space to remembered targets. I. Kinesthetic versus visual target presentation," J. Neurophysiol., vol. 79, no. 6, pp. 2833-2846, Jun. 1998. (Pubitemid 28317016)
36. D. J. Goble and S. H. Brown, "Task-dependent asymmetries in the utilization of proprioceptive feedback for goal-directed movement," Exp. Brain Res., vol. 180, no. 4, pp. 693-704, Jul. 2007. (Pubitemid 46988113)
37. D. J. Goble and S. H. Brown, "Dynamic proprioceptive target matching behavior in the upper limb: Effects of speed, task difficulty and arm/ hemisphere asymmetries," Behav. Brain Res., pp. 7-14, Nov. 2008.
38. J. B. Smeets, J. J. van den Dobbelsteen, and D. D. de Grave et al., "Sensory integration does not lead to sensory calibration," Proc. Nat. Acad. Sci. USA, vol. 103, no. 49, pp. 18781-18786, Dec. 5, 2006. (Pubitemid 44913487)
39. J. E. Lateiner and R. L. Sainburg, "Differential contributions of vision and proprioception to movement accuracy," Exp. Brain Res., vol. 151, no. 4, pp. 446-454, Aug. 2003. (Pubitemid 36995144)
40. L. E. Brown, D. A. Rosenbaum, and R. L. Sainburg, "Limb position drift: Implications for control of posture and movement," J. Neurophysiol., vol. 90, no. 5, pp. 3105-3118, Nov. 2003. (Pubitemid 37430008)
41. L. E. Brown, D. A. Rosenbaum, and R. L. Sainburg, "Movement speed effects on limb position drift," Exp. Brain Res., vol. 153, no. 2, pp. 266-274, Nov. 2003. (Pubitemid 37445320)
42. L. B. Bagesteiro, F. R. Sarlegna, and R. L. Sainburg, "Differential influence of vision and proprioception on control of movement distance," Exp. Brain Res., vol. 171, no. 3, pp. 358-370, May 2006. (Pubitemid 43780109)
43. A. K. Rao and A. M. Gordon, "Contribution of tactile information to accuracy in pointing movements," Exp. Brain Res., vol. 138, no. 4, pp. 438-445, Jun. 2001. (Pubitemid 32467762)
44. J. R. Lackner, "Adaptation to displaced vision: Role of proprioception," Perceptual Motor Skills, vol. 38, pp. 1251-1256, 1974.
45. J. R. Lackner and P. DiZio, "Rapid adaptation to Coriolis force perturbations of arm trajectory," J. Neurophysiol., vol. 72, pp. 299-313, 1994.
46. P. Dizio and J. R. Lackner, "Motor adaptation to Coriolis force perturbations of reaching movements: Endpoint but not trajectory adaptation transfers to the nonexposed arm," J. Neurophysiol., vol. 74, no. 4, pp. 1787-1792, 1995.
47. J. R. Lackner and P. A. DiZio, "Aspects of body self-calibration, " Trends Cogn. Sci., vol. 4, no. 7, pp. 279-288, 2000. (Pubitemid 30392371)
48. M. Desmurget, H. Grea, and C. Prablanc, "Final posture of the upper limb depends on the initial position of the hand during prehension movements," Exp. Brain Res., vol. 119, no. 4, pp. 511-516, Apr. 1998. (Pubitemid 28159786)
49. P. Vindras, M. Desmurget, and C. Prablanc et al., "Pointing errors reflect biases in the perception of the initial hand position," J. Neurophysiol., vol. 79, no. 6, pp. 3290-3294, Jun. 1998. (Pubitemid 28317055)
50. R. J. van Beers, A. C. Sittig, and J. J. Denier van der Gon, "How humans combine simultaneous proprioceptive and visual position information," Exp. Brain Res., vol. 111, no. 2, pp. 253-261, Sep. 1996. (Pubitemid 26300827)
51. R. J. van Beers, A. C. Sittig, and J. J. Denier van der Gon, "The precision of proprioceptive position sense," Exp. Brain Res., vol. 122, no. 4, pp. 367-377, Oct. 1998. (Pubitemid 28457134)
52. S. I. Tillery,M. Flanders, and J. F. Soechting, "A coordinate system for the synthesis of visual and kinesthetic information," J. Neurosci., vol. 11, no. 3, pp. 770-778, Mar. 1991.
53. S. I. Tillery, M. Flanders, and J. F. Soechting, "Errors in kinesthetic transformations for hand apposition," Neuroreport, vol. 6, no. 1, pp. 177-181, Dec. 30, 1994.
54. W. G. Darling and G. F. Miller, "Perception of arm orientation in threedimensional space," Exp. Brain Res., vol. 102, no. 3, pp. 495-502, 1995.
55. J. P. Wann and S. F. Ibrahim, "Does limb proprioception drift?," Exp. Brain Res., vol. 91, no. 1, pp. 162-166, 1992.
56. M. Desmurget, P. Vindras, and H. Grea et al., "Proprioception does not quickly drift during visual occlusion," Exp. Brain Res., vol. 134, no. 3, pp. 363-377, Oct. 2000.
57. P. Vindras, M. Desmurget, and P.Viviani, "Error parsing in visuomotor pointing reveals independent processing of amplitude and direction," J. Neurophysiol., vol. 94, no. 2, pp. 1212-1224, Aug. 2005. (Pubitemid 41061360)
58. R. J. van Beers, D. M.Wolpert, and P. Haggard, "When feeling is more important than seeing in sensorimotor adaptation," Curr. Biol., vol. 12, no. 10, pp. 834-837, May 14, 2002. (Pubitemid 34514369)
59. E. T. Wilson, J. Wong, and P. L. Gribble, "Mapping proprioception across a 2D horizontal workspace," PLoS ONE, vol. 5, no. 7, p. e11851.
60. J. J. van den Dobbelsteen, E. Brenner, and J. B. Smeets, "Body-centered visuomotor adaptation," J. Neurophysiol., vol. 92, no. 1, pp. 416-423, Jul. 2004. (Pubitemid 38802264)
61. M. Kouzaki and K. Masani, "Reduced postural sway during quiet standing by light touch is due to finger tactile feedback but not mechanical support," Exp. Brain Res., vol. 188, no. 1, pp. 153-158, Jun. 2008.
62. J. R. Lackner, E. Rabin, and P. DiZio, "Fingertip contact suppresses the destabilizing influence of leg muscle vibration," J. Neurophysiol., vol. 84, no. 5, pp. 2217-2224, 2000.
63. E. Rabin and A. M. Gordon, "Influence of fingertip contact on illusory arm movements," J. Appl. Physiol., vol. 96, no. 4, pp. 1555-1560, Apr. 2004. (Pubitemid 38392696)
64. E. Rabin, P. DiZio, and J. Ventura et al., "Influences of arm proprioception and degrees of freedom on postural control with light touch feedback," J. Neurophysiol., vol. 99, no. 2, pp. 595-604, Feb. 2008. (Pubitemid 351253221)
65. J. R. Lackner, E. Rabin, and P. DiZio, "Stabilization of posture by precision touch of the index finger with rigid and flexible filaments," Exp. Brain Res., vol. 139, no. 4, pp. 454-464, 2001. (Pubitemid 32703953)
66. R. Dickstein, "Stance stability with unilateral and bilateral light touch of an external stationary object," Somatosens Mot. Res., vol. 22, no. 4, pp. 319-325, Dec. 2005.
67. J. J. Jeka and J. R. Lackner, "The role of haptic cues from rough and slippery surfaces in human postural control," Exp. Brain Res., vol. 103, no. 2, pp. 267-276, 1995.
68. J. J. Jeka, G. Schoner, and T. Dijkstra et al., "Coupling of fingertip somatosensory information to head and body sway," Exp. Brain Res., vol. 113, no. 3, pp. 475-483, Mar. 1997. (Pubitemid 27140271)
69. R. J. van Beers, A. C. Sittig, and J. J. Denier van der Gon, "Localization of a seen finger is based exclusively on proprioception and on vision of the finger," Exp. Brain Res., vol. 125, no. 1, pp. 43-49, Mar. 1999. (Pubitemid 29132403)
70. P. Haggard, C. Newman, and J. Blundell et al., "The perceived position of the hand in space," Percept. Psychophys., vol. 62, no. 2, pp. 363-377, Feb. 2000.
71. M. Flanders, S. I. Helms Tillery, and J. F. Soechting, "Early stages in a sensorimotor transformation," Behavioral Brain Sci., vol. 15, pp. 309-362, 1992.
72. M. Tagliabue and J. McIntyre, "Necessity is the mother of invention: Reconstructing missing sensory information in multiple, concurrent reference frames for eye-hand coordination," J. Neurosci., vol. 31, no. 4, pp. 1397-1409, Jan. 26, .
73. M. S. Graziano, X. T. Hu, and C. G. Gross, "Visuospatial properties of ventral premotor cortex," J. Neurophysiol., vol. 77, no. 5, pp. 2268-2292, May 1997. (Pubitemid 27209203)
74. M. S. Graziano and C. G. Gross, "Spatial maps for the control of movement," Curr. Opin. Neurobiol., vol. 8, no. 2, pp. 195-201, Apr. 1998. (Pubitemid 28247800)
75. M. S. Graziano and C. G. Gross, "Visual responses with and without fixation: Neurons in premotor cortex encode spatial locations independently of eye position," Exp. Brain Res., vol. 118, no. 3, pp. 373-380, Feb. 1998. (Pubitemid 28052343)
76. L. Fogassi, V. Gallese, and G. di Pellegrino et al., "Space coding by premotor cortex," Exp. Brain Res., vol. 89, no. 3, pp. 686-690, 1992.
77. M. Gentilucci, C. Scandolara, and I. N. Pigarev et al., "Visual responses in the postarcuate cortex (area 6) of the monkey that are independent of eye position," Exp. Brain Res., vol. 50, no. 2-3, pp. 464-468, 1983. (Pubitemid 14183370)
78. C. Spence, "Crossmodal spatial attention," Ann. NY Acad. Sci., vol. 1191, pp. 182-200, Mar. .
79. N. Bolognini and A. Maravita, "Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex," Curr. Biol., vol. 17, no. 21, pp. 1890-1895, Nov. 6, 2007. (Pubitemid 350016925)
80. A. Maravita, C. Spence, and S. Kennett et al., "Tool-use changes multimodal spatial interactions between vision and touch in normal humans," Cognition, vol. 83, no. 2, pp. B25-B34, Mar. 2002. (Pubitemid 34175123)
81. S. Kennett, C. Spence, and J. Driver, "Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture," Percept. Psychophys., vol. 64, no. 7, pp. 1083-1094, Oct. 2002.
82. D. M. Lloyd, D. I. Shore, and C. Spence et al., "Multisensory representation of limb position in human premotor cortex," Nature Neurosci., vol. 6, pp. 17-18, 2002.
83. C. Spence, "Multisenory integration-Solving the crossmodal binding problem. Comment on "Crossmodal influences on visual perception" by Shams & Kim," Phys. Life Rev., vol. 7, no. 3, pp. 285-286, Sep. 2010.
84. A. Maravita, C. Spence, and J. Driver, "Multisensory integration and the body schema: Close to hand and within reach," Curr. Biol., vol. 13, no. 13, pp. R531-R539, Jul. 2003. (Pubitemid 36815254)
85. J. E. O'Doherty, M. A. Lebedev, Z. Li, and M. A. L. Nicolelis, "Towards a brain-machine interface: Virtual active touch using randomly patterned intracortical microstimulation," IEEE Trans. Neural Syst. Rehabil. Eng., to be published.
86. D. J.Weber, B. M. London, J. A. Hokanson, C. A. Ayers, R. R. Torres, B. Zaaimi, and L. E. Miller, "Limb-state information encoded by peripheral and central somatosensory neurons: Implications for an afferent interface," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 501-513, Oct. 2011.
87. S. S. Kim, S. Mihalas, R. Alexander, Y. Dong, and S. Bensmaia, "Does afferent heterogeneity matter in conveying tactile feedback through peripheral nerve stimulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 514-520, Oct. 2011.
88. K. Horch, S. Meek, T. Taylor, and D. Hutchinson, "Object disrimination with an artificial hand using electrical stimulation of peripheral tactile and proprioceptive pathways with intrafascicular electrodes," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 483-489, Oct. 2011.
89. F. W. Mott and C. S. Sherrington, "Experiments upon the influence of sensory nerves upon movement and nutrition of the limbs. Preliminary communication," Proc. R. Soc. London, vol. 57, pp. 481-488, 1895.
90. T. E. Twitchell, "Sensory factors in purposive movement," J. Neurophysiol., vol. 17, pp. 239-252, 1954.