Visual-haptic cue integration with spatial and temporal disparity during pointing movements

Experimental Brain Research

Volumn 210, Issue 1, 2011, Pages 67-80

  Serwe, Sascha ^a,b   Körding, Konrad P ^c   Trommershäuser, Julia ^a,d  

^a JUSTUS LIEBIG UNIVERSITY   (Germany)

^b UNIVERSITY OF HAGEN   (Germany)

^c NORTHWESTERN UNIVERSITY   (United States)

^d NEW YORK UNIVERSITY   (United States)

Author keywords

Cue integration; Hand movement control; Haptics; Motor learning; Multisensory integration; Vision

Indexed keywords

ACCURACY; ADULT; ARM MOVEMENT; ARTICLE; ASSOCIATION; CONTROLLED STUDY; DEPTH PERCEPTION; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; TACTILE DISCRIMINATION; TASK PERFORMANCE; TEMPORAL SUMMATION; THEORETICAL MODEL; TRAINING;

ADULT; CUES; FEMALE; HUMANS; MALE; MOVEMENT; PHOTIC STIMULATION; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE; SPACE PERCEPTION; TIME PERCEPTION; VISION DISPARITY; YOUNG ADULT;

EID: 79953834474     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-011-2603-5     Document Type: Article

References (57)

1. Alais D, Burr D (2004) The ventriloquist effect results from nearoptimal bimodal integration. Curr Biol 14:257-262 (Pubitemid 38215356)
2. Baddeley RJ, Ingram HA, Miall RC (2003) System identification applied to a visuomotor task: near-optimal human performance in a noisy changing task. J Neurosci 23:3066-3075 (Pubitemid 36418642)
3. Beck JM, Pouget A (2007) Exact inferences in a neural implementation of a hidden Markov model. Neural Comput 19:1344-1361
4. Bertelson P, Aschersleben G (1998) Automatic visual bias of perceived auditory location. Psychon Bull Rev 5:482-489 (Pubitemid 128457707)
5. Bresciani J, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A (2005) Feeling what you hear: auditory signals can modulate tactile tap perception. Exp Brain Res 162:172-180 (Pubitemid 40543828)
6. Burge J, Ernst MO, Banks MS (2008) The statistical determinants of adaptation rate in human reaching. J Vis 8(4):1-19
7. Calvert GA (1998) Crossmodal identification. Trends Cogn Sci 2:247-253
8. Calvert GA, Thesen T (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. J Physiol Paris 98:191-205 (Pubitemid 39345371)
9. Deneve S (2008a) Bayesian spiking neurons I: inference. Neural Comput 20:91-117
10. Deneve S (2008b) Bayesian spiking neurons II: learning. Neural Comput 20:118-145
11. Deneve S, Latham PE, Pouget A (2001) Efficient computation and cue integration with noisy population codes. Nat Neurosci 4:826-831 (Pubitemid 32702515)
12. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433 (Pubitemid 34100953)
13. Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162-169 (Pubitemid 38429926)
14. Gepshtein S, Burge J, Ernst MO, Banks MS (2005) The combination of vision and touch depends on spatial proximity. J Vis 5(11):1013-1023 (Pubitemid 43078793)
15. Gold JI, Shadlen MN (2007) The neural basis of decision making. Annu Rev Neurosci 30:535-574 (Pubitemid 47218767)
16. Griffiths TL, Tenenbaum JB (2006) Optimal predictions in everyday cognition. Psychol Sci 17:767-773 (Pubitemid 44396822)
17. Helbig HB, Ernst MO (2007) Knowledge about a common source can promote visual-haptic integration. Perception 36:1523-1533
18. Hillis JM, Ernst MO, Banks MS, Landy MS (2002) Combining sensory information: mandatory fusion within, but not between, senses. Science 298:1627-1630 (Pubitemid 35387202)
19. Hillis JM, Watt SJ, Landy MS, Banks MS (2004) Slant from texture and disparity cues: optimal cue combination. J Vis 4(12):967-992 (Pubitemid 41522184)
20. Hospedales T, Cartwright J, Vijayakumar S. (2007) Structure inference for Bayesian multisensory perception and tracking. Proc Int Joint Conf Art Intell (IJCAI '07). 2122-2128
21. Knill DC (1998) Discrimination of planar surface slant from texture: human and ideal observers compared. Vis Res 38:1683-1711
22. Knill DC, Saunders JA (2003) Do humans optimally integrate stereo and texture information for judgments of surface slant? Vis Res 43:2539-2558
23. Körding KP, Wolpert DM (2004a) Advances in neural information processing systems 16. In: Thrun S, Saul L, Schölkopf B (eds) Advances in neural information processing systems 16. MIT Press, Cambridge, MA, pp 1327-1334
24. Körding KP, Wolpert DM (2004b) Bayesian integration in sensorimotor learning. Nature 427:244-247 (Pubitemid 38112039)
25. Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS ONE 2(9):e943. doi:10.1371/journal.pone.0000943
26. Landy MS, Maloney LT, Johnston EB, Young M (1995) Measurement and modeling of depth cue combination: in defense of weak fusion. Vis Res 35:389-412
27. Lewald J, Ehrenstein WH, Guski R (2001) Spatio-temporal constraints for auditory-visual integration. Behav Brain Res 121:69-79 (Pubitemid 32223463)
28. Liu D, Todorov E (2007) Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. J Neurosci 27:9354-9368 (Pubitemid 47358214)
29. Louw S, Smeets J, Brenner E (2007) Judging surface slant for placing objects: a role for motion parallax. Exp Brain Res 183:149-158 (Pubitemid 47497723)
30. Ma WJ, Pouget A (2008) Linking neurons to behavior in multisensory perception: a computational review. Brain Res 1242:4-12
31. Ma WJ, Beck JM, Latham PE, Pouget A (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9:1432-1438 (Pubitemid 44646216)
32. Ma WJ, Beck JM, Pouget A (2008) Spiking networks for Bayesian inference and choice. Curr Opin Neurobiol 18:217-222
33. Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389-391 (Pubitemid 13067842)
34. Meredith MA, Stein BE (1996) Spatial determinants of multisensory integration in cat superior colliculus neurons. J Neurophysiol 75:1843-1857 (Pubitemid 26159021)
35. Radeau M, Bertelson P (1987) Auditory-visual interaction and the timing of inputs. Psychol Res 49:17-22
36. Rao RPN (2004) Bayesian computation in recurrent neural circuits. Neural Comput 16:1-38
37. Saunders JA, Knill DC (2004) Visual feedback control of hand movements. J Neurosci 24:3223-3234
38. Schmidt T (2002) The finger in flight: Real-time motor control by visually masked color stimuli. Psychol Sci 13:112-117
39. Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6:461-464
40. Serwe S, Drewing K, Trommershauser J (2009) Combination of noisy directional visual and proprioceptive information. J Vis 9:1-14
41. Seydell A, McCann BC, Trommershäuser J, Knill DC (2008) Learning stochastic reward distributions in a speeded pointing task. J Neurosci 28:4356-4367
42. Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (Area LIP) of the Rhesus monkey. J Neurophysiol 86:1916-1936 (Pubitemid 32953239)
43. Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12:7-10 (Pubitemid 32099017)
44. Song J, Nakayama K (2007) Automatic adjustment of visuomotor readiness. J Vis 7(5):1-9
45. Song J, Nakayama K (2008) Target selection in visual search as revealed by movement trajectories. Vis Res 48:853-861
46. Sousa R, Brenner E, Smeets JB (2009) Slant cue are combined early in visual processing: Evidence from visual search. Vis Res 49:257-261
47. Spence C, Squire S (2003) Multisensory integration: maintaining the perception of synchrony. Curr Biol 13:R519-R521 (Pubitemid 36815250)
48. Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge, MA
49. Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266 (Pubitemid 351430829)
50. Takahashi C, Diedrichsen J, Watt SJ (2009) Integration of vision and haptics during tool use. J Vis 9(6):1-15
51. Tassinari H, Hudson T, Landy MS (2006) Combining priors and noisy visual cues in a rapid pointing task. J Neurosci 26:10154-10163 (Pubitemid 44527409)
52. van Beers RJ, Sittig A, Denier van der Gon J (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81:1355-1364 (Pubitemid 29272452)
53. van Beers RJ, Wolpert DM, Haggard P (2002) When feeling is more important than seeing in sensorimotor adaptation. Curr Biol 12:834-837 (Pubitemid 34514369)
54. Vogels IMLC (2004) Detection of temporal delays in visual-haptic interfaces. Hum Factors 46:118-134
55. Wallace MT, Meredith MA, Stein BE (1998) Multisensory integration in the superior colliculus of the alert cat. J Neurophysiol 80:1006-1010 (Pubitemid 28387680)
56. Wallace MW, Roberson G, Hairston W, Stein BE, Vaughan J, Schirillo J (2004) Unifying multisensory signals across time and space. Exp Brain Res 158:252-258 (Pubitemid 39281121)
57. Wolpert DM, Ghahramani Z, Jordan M (1995) An internal model for sensorimotor integration. Science 269:1880-1882