A neural network model of ventriloquism effect and aftereffect

PLoS ONE

Volumn 7, Issue 8, 2012, Pages

  Magosso, Elisa ^a   Cuppini, Cristiano ^a   Ursino, Mauro ^a  

^a UNIVERSITY OF BOLOGNA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NERVE FIBER; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; DEPRESSION; HEARING; HUMAN; IN VIVO STUDY; INTEGRATION; NERVE CELL NETWORK; POSITIVE FEEDBACK; RELIABILITY; VISION; VISUAL ORIENTATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; MODELS, NEUROLOGICAL; NERVE NET; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 84864568170     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0042503     Document Type: Article

References (58)

1. Stein BE, Meredith MA, (1993) The merging of the senses. Cambridge, MA: The MIT Press.
2. Bertelson P, Radeau M, (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept Psychophys 29: 578-584.
3. Radeau M, Bertelson P, (1987) Auditory-Visual Interaction and the Timing of Inputs- Thomas (1941) Revisited. Psychological Research-Psychologische Forschung 49: 17-22.
4. Radeau M, Bertelson P, (1977) Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations. Percept Psychophys 22: 137-146.
5. Welch RB, Warren DH, (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88: 638-667.
6. Hairston WD, Wallace MT, Vaughan JW, Stein BE, Norris JL, et al. (2003) Visual localization ability influences cross-modal bias. J Cogn Neurosci 15: 20-29.
7. Slutsky DA, Recanzone GH, (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12: 7-10.
8. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, et al. (2004) Unifying multisensory signals across time and space. Exp Brain Res 158: 252-258.
9. Burr D, Alais D, (2006) Combining visual and auditory information. Prog Brain Res 155: 243-258.
10. Alais D, Burr D, (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14: 257-262.
11. Bertelson P, Frissen I, Vroomen J, de Gelder B, (2006) The aftereffects of ventriloquism: patterns of spatial generalization. Percept Psychophys 68: 428-436.
12. Frissen I, Vroomen J, de Gelder B, Bertelson P, (2003) The aftereffects of ventriloquism: are they sound-frequency specific? Acta Psychol (Amst) 113: 315-327.
13. Frissen I, Vroomen J, de Gelder B, Bertelson P, (2005) The aftereffects of ventriloquism: generalization across sound-frequencies. Acta Psychol (Amst) 118: 93-100.
14. Lewald J, (2002) Rapid adaptation to auditory-visual spatial disparity. Learn Mem 9: 268-278.
15. Recanzone GH, (1998) Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proc Natl Acad Sci U S A 95: 869-875.
16. Woods TM, Recanzone GH, (2004) Visually induced plasticity of auditory spatial perception in macaques. Curr Biol 14: 1559-1564.
17. Battaglia PW, Jacobs RA, Aslin RN, (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am A Opt Image Sci Vis 20: 1391-1397.
18. Witten IB, Knudsen EI, (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48: 489-496.
19. Sato Y, Toyoizumi T, Aihara K, (2007) Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli. Neural Comput 19: 3335-3355.
20. Wozny DR, Shams L, (2011) Computational characterization of visually induced auditory spatial adaptation. Front Integr Neurosci 5: 75.
21. Cuppini C, Stein BE, Rowland BA, Magosso E, Ursino M, (2011) A computational study of multisensory maturation in the superior colliculus (SC). Exp Brain Res 213: 341-349.
22. Cuppini C, Ursino M, Magosso E, Rowland BA, Stein BE, (2010) An emergent model of multisensory integration in superior colliculus neurons. Front Integr Neurosci 4: 6.
23. Magosso E, Cuppini C, Serino A, Di Pellegrino G, Ursino M, (2008) A theoretical study of multisensory integration in the superior colliculus by a neural network model. Neural Netw 21: 817-829.
24. Ursino M, Cuppini C, Magosso E, Serino A, di Pellegrino G, (2009) Multisensory integration in the superior colliculus: a neural network model. J Comput Neurosci 26: 55-73.
25. Magosso E, (2010) Integrating information from vision and touch: a neural network modeling study. IEEE Trans Inf Technol Biomed 14: 598-612.
26. Magosso E, Ursino M, di Pellegrino G, Ladavas E, Serino A, (2010) Neural bases of peri-hand space plasticity through tool-use: insights from a combined computational-experimental approach. Neuropsychologia 48: 812-830.
27. Magosso E, Zavaglia M, Serino A, di Pellegrino G, Ursino M, (2010) Visuotactile representation of peripersonal space: a neural network study. Neural Comput 22: 190-243.
28. Georgopoulos AP, Kalaska JF, Caminiti R, Massey JT, (1982) On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neurosci 2: 1527-1537.
29. Vogels R, Orban GA, (1990) How well do response changes of striate neurons signal differences in orientation: a study in the discriminating monkey. J Neurosci 10: 3543-3558.
30. Bolognini N, Leo F, Passamonti C, Stein BE, Ladavas E, (2007) Multisensory-mediated auditory localization. Perception 36: 1477-1485.
31. Dayan P, Abbott LF, (2001) Plasticity and Learning. Theoretical Neuroscience. Cambridge, MA: The MIT Press. pp pp. 153-194.
32. Recanzone GH, (2009) Interactions of auditory and visual stimuli in space and time. Hear Res 258: 89-99.
33. Recanzone GH, Sutter ML, (2008) The biological basis of audition. Annu Rev Psychol 59: 119-142.
34. Rajan R, Aitkin LM, Irvine DR, (1990) Azimuthal sensitivity of neurons in primary auditory cortex of cats. II. Organization along frequency-band strips. J Neurophysiol 64: 888-902.
35. Recanzone GH, Guard DC, Phan ML, Su TK, (2000) Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. J Neurophysiol 83: 2723-2739.
36. Woods TM, Lopez SE, Long JH, Rahman JE, Recanzone GH, (2006) Effects of stimulus azimuth and intensity on the single-neuron activity in the auditory cortex of the alert macaque monkey. J Neurophysiol 96: 3323-3337.
37. Bonath B, Noesselt T, Martinez A, Mishra J, Schwiecker K, et al. (2007) Neural basis of the ventriloquist illusion. Curr Biol 17: 1697-1703.
38. Ghazanfar AA, Schroeder CE, (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10: 278-285.
39. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, et al. (2007) Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex 17: 1672-1679.
40. Bertini C, Leo F, Avenanti A, Ladavas E, (2010) Independent mechanisms for ventriloquism and multisensory integration as revealed by theta-burst stimulation. Eur J Neurosci 31: 1791-1799.
41. Passamonti C, Frissen I, Ladavas E, (2009) Visual recalibration of auditory spatial perception: two separate neural circuits for perceptual learning. Eur J Neurosci 30: 1141-1150.
42. Schroeder CE, Foxe J, (2005) Multisensory contributions to low-level, 'unisensory' processing. Curr Opin Neurobiol 15: 454-458.
43. Ben-Yishai R, Bar-Or RL, Sompolinsky H, (1995) Theory of orientation tuning in visual cortex. Proc Natl Acad Sci U S A 92: 3844-3848.
44. Georgopoulos AP, Taira M, Lukashin A, (1993) Cognitive neurophysiology of the motor cortex. Science 260: 47-52.
45. Rolls ET, Deco G, (2002) Computational neuroscience of vision. Oxford, NY: Oxford University Press.
46. Miller KD, Mackay DJC, (1994) The Role of Constraints in Hebbian Learning. Neural Comput 6: 100-126.
47. van Ooyen A, (2011) Using theoretical models to analyse neural development. Nat Rev Neurosci 12: 311-326.
48. Deneve S, Latham PE, Pouget A, (2001) Efficient computation and cue integration with noisy population codes. Nat Neurosci 4: 826-831.
49. Knill DC, Pouget A, (2004) The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci 27: 712-719.
50. Ma WJ, Beck JM, Latham PE, Pouget A, (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9: 1432-1438.
51. Weisswange TH, Rothkopf CA, Rodemann T, Triesch J, (2011) Bayesian cue integration as a developmental outcome of reward mediated learning. PLoS One 6: e21575.
52. Rolls ETT, (1998) A (1998) Neural Networks and Brain Functions. New York: Oxford University Press.
53. Crick F, (1989) The recent excitement about neural networks. Nature 337: 129-132.
54. Witten IB, Knudsen EI, Sompolinsky H, (2008) A Hebbian learning rule mediates asymmetric plasticity in aligning sensory representations. J Neurophysiol 100: 1067-1079.
55. Bruns P, Spence C, Roder B, (2011) Tactile recalibration of auditory spatial representations. Exp Brain Res 209: 333-344.
56. Recanzone GH, Guard DC, Phan ML, (2000) Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. J Neurophysiol 83: 2315-2331.
57. Shams L, Kamitani Y, Shimojo S, (2002) Visual illusion induced by sound. Brain Res Cogn Brain Res 14: 147-152.
58. Treves A, (1993) Mean-field analysis of neuronal spike dynamics. Network 4: 259-284.