A neural network model can explain ventriloquism aftereffect and its generalization across sound frequencies

BioMed Research International

Volumn 2013, Issue , 2013, Pages

  Magosso, Elisa ^a   Cona, Filippo ^a   Ursino, Mauro ^a  

^a UNIVERSITY OF BOLOGNA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NERVE FIBER; ADAPTATION; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUDITORY RESPONSE; AUDITORY STIMULATION; MATHEMATICAL MODEL; RECEPTIVE FIELD; SENSITIVITY ANALYSIS; SOUND; SOUND ANALYSIS; SOUND INTENSITY; STEADY STATE; STIMULUS RESPONSE; SYNAPSE; VENTRILOQUISM AFTEREFFECT; VISUAL STIMULATION; HUMAN; METHODOLOGY; NEUROPHYSIOLOGICAL MONITORING; PHOTOSTIMULATION;

ACOUSTIC STIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); NEUROPHYSIOLOGICAL MONITORING; PHOTIC STIMULATION; SOUND;

EID: 84887488079     PISSN: 23146133     EISSN: 23146141     Source Type: Journal    
DOI: 10.1155/2013/475427     Document Type: Article

References (45)

1. Alais D., Newell F. N., Mamassian P., Multisensory processing in review: from physiology to behaviour. Seeing and Perceiving 2010 23 1 3 38 2-s2.0-77952008842 10.1163/187847510X488603
2. Ernst M. O., Bülthoff H. H., Merging the senses into a robust percept. Trends in Cognitive Sciences 2004 8 4 162 169 2-s2.0-1842576869 10.1016/j.tics.2004.02.002
3. Stein B. E., Meredith M. A., The Merging of Senses 1993 The MIT Press
4. Welch R. B., Warren D. H., Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 1980 88 3 638 667 2-s2.0-0019085905 10.1037/0033-2909.88.3.638
5. Bertelson P., Radeau M., Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception and Psychophysics 1981 29 6 578 584 2-s2.0-0019573904
6. Recanzone G. H., Interactions of auditory and visual stimuli in space and time. Hearing Research 2009 258 1-2 89 99 2-s2.0-70449644799 10.1016/j.heares.2009.04.009
7. Bertelson P., Aschersleben G., Automatic visual bias of perceived auditory location. Psychonomic Bulletin and Review 1998 5 3 482 489 2-s2.0-0000284217
8. Slutsky D. A., Recanzone G. H., Temporal and spatial dependency, of the ventriloquism effect. NeuroReport 2001 12 1 7 10 2-s2.0-0035931546
9. Bonath B., Noesselt T., Martinez A., Mishra J., Schwiecker K., Heinze H.-J., Hillyard S. A., Neural basis of the ventriloquist illusion. Current Biology 2007 17 19 1697 1703 2-s2.0-34848885828 10.1016/j.cub.2007.08.050
10. Bertini C., Leo F., Avenanti A., Làdavas E., Independent mechanisms for ventriloquism and multisensory integration as revealed by theta-burst stimulation. European Journal of Neuroscience 2010 31 10 1791 1799 2-s2.0-77952665315 10.1111/j.1460-9568.2010.07200.x
11. Leo F., Bolognini N., Passamonti C., Stein B. E., Làdavas E., Cross-modal localization in hemianopia: new insights on multisensory integration. Brain 2008 131 3 855 865 2-s2.0-39749140351 10.1093/brain/awn003
12. Recanzone G. H., Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proceedings of the National Academy of Sciences of the United States of America 1998 95 3 869 875 2-s2.0-0032477719 10.1073/pnas.95.3.869
13. Wozny D. R., Shams L., Recalibration of auditory space following milliseconds of cross-modal discrepancy. Journal of Neuroscience 2011 31 12 4607 4612 2-s2.0-79953021530 10.1523/JNEUROSCI.6079-10.2011
14. Frissen I., Vroomen J., De Gelder B., The aftereffects of ventriloquism: the time course of the visual recalibration of auditory localization. Seeing and Perceiving 2012 25 1 1 14 2-s2.0-84858210560 10.1163/187847611X620883
15. Lewald J., Rapid adaptation to auditory-visual spatial disparity. Learning and Memory 2002 9 5 268 278 2-s2.0-0036743630 10.1101/lm.51402
16. Woods T. M., Recanzone G. H., Visually induced plasticity of auditory spatial perception in macaques. Current Biology 2004 14 17 1559 1564 2-s2.0-4644313738 10.1016/j.cub.2004.08.059
17. Frissen I., Vroomen J., de Gelder B., Bertelson P., The aftereffects of ventriloquism: are they sound-frequency specific? Acta Psychologica 2003 113 3 315 327 2-s2.0-0038712916 10.1016/S0001-6918(03)00043-X
18. Frissen I., Vroomen J., de Gelder B., Bertelson P., The aftereffects of ventriloquism: generalization across sound-frequencies. Acta Psychologica 2005 118 1-2 93 100 2-s2.0-14144255875 10.1016/j.actpsy.2004.10.004
19. Bertelson P., Frissen I., Vroomen J., De Gelder B., The aftereffects of ventriloquism: patterns of spatial generalization. Perception and Psychophysics 2006 68 3 428 436 2-s2.0-33748375543
20. Rajan R., Aitkin L. M., Irvine D. R. F., Azimuthal sensitivity of neurons in primary auditory cortex of cats-I. Types of sensitivity and the effects of variations in stimulus parameters. Journal of Neurophysiology 1990 64 3 872 887
21. Recanzone G. H., Guard D. C., Phan M. L., Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. Journal of Neurophysiology 2000 83 4 2315 2331 2-s2.0-0034128857
22. Recanzone G. H., Spatial processing in the auditory cortex of the macaque monkey. Proceedings of the National Academy of Sciences of the United States of America 2000 97 22 11829 11835 2-s2.0-0034710872 10.1073/pnas.97.22.11829
23. Recanzone G. H., Guard D. C., Phan M. L., Su T.-I. K., Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. Journal of Neurophysiology 2000 83 5 2723 2739 2-s2.0-0034078488
24. Kajikawa Y., De La Mothe L., Blumell S., Hackett T. A., A comparison of neuron response properties in areas A1 and CM of the marmoset monkey auditory cortex: tones and broadband noise. Journal of Neurophysiology 2005 93 1 22 34 2-s2.0-16644395905 10.1152/jn.00248.2004
25. Cuppini C., Magosso E., Rowland B., Stein B., Ursino M., Hebbian mechanisms help explain development of multisensory integration in the superior colliculus: a neural network model. Biological Cybernetics 2012 106 11-12 691 713
26. Cuppini C., Stein B. E., Rowland B. A., Magoss E., Ursino M., A computational study of multisensory maturation in the superior colliculus (SC). Experimental Brain Research 2011 213 2-3 341 349 2-s2.0-80053927074 10.1007/s00221-011-2714-z
27. Cuppini C., Ursino M., Magosso E., Rowland B. A., Stein B. E., An emergent model of multisensory integration in superior colliculus neurons. Frontiers in Integrative Neuroscience 2010 4 1 15 2-s2.0-80053929355 10.3389/fnint.2010.00006
28. Ursino M., Cuppini C., Magosso E., Serino A., Pellegrino G., Multisensory integration in the superior colliculus: a neural network model. Journal of Computational Neuroscience 2009 26 1 55 73 2-s2.0-60449102511 10.1007/s10827-008-0096-4
29. Magosso E., Cuppini C., Serino A., Di Pellegrino G., Ursino M., A theoretical study of multisensory integration in the superior colliculus by a neural network model. Neural Networks 2008 21 6 817 829 2-s2.0-50449109822 10.1016/j.neunet.2008.06.003
30. Magosso E., Zavaglia M., Serino A., di Pellegrino G., Ursino M., Visuotactile representation of peripersonal space: a neural network study. Neural Computation 2010 22 1 190 243 2-s2.0-77649257935 10.1162/neco.2009.01-08- 694
31. Magosso E., Ursino M., di Pellegrino G., Làdavas E., Serino A., Neural bases of peri-hand space plasticity through tool-use: insights from a combined computational-experimental approach. Neuropsychologia 2010 48 3 812 830 2-s2.0-74449089431 10.1016/j.neuropsychologia.2009.09.037
32. Magosso E., Integrating information from vision and touch: a neural network modeling study. IEEE Transactions on Information Technology in Biomedicine 2010 14 3 598 612 2-s2.0-77953141188 10.1109/TITB.2010.2040750
33. Magosso E., Cuppini C., Ursino M., A neural network model of ventriloquism effect and aftereffect. PLoS ONE 2012 7 8 e42503
34. Woods T. M., Lopez S. E., Long J. H., Rahman J. E., Recanzone G. H., Effects of stimulus azimuth and intensity on the single-neuron activity in the auditory cortex of the alert macaque monkey. Journal of Neurophysiology 2006 96 6 3323 3337 2-s2.0-33751529503 10.1152/jn.00392.2006
35. Hairston W. D., Wallace M. T., Vaughan J. W., Stein B. E., Norris J. L., Schirillo J. A., Visual localization ability influences cross-modal bias. Journal of Cognitive Neuroscience 2003 15 1 20 29 2-s2.0-0037244388 10.1162/089892903321107792
36. Wallace M. T., Roberson G. E., Hairston W. D., Stein B. E., Vaughan J. W., Schirillo J. A., Unifying multisensory signals across time and space. Experimental Brain Research 2004 158 2 252 258 2-s2.0-4644276897 10.1007/s00221-004-1899-9
37. Radeau M., Signal intensity, task context, and auditory-visual interactions. Perception 1985 14 5 571 577 2-s2.0-0022332642
38. Bolognini N., Leo F., Passamonti C., Stein B. E., Làdavas E., Multisensory-mediated auditory localization. Perception 2007 36 10 1477 1485 2-s2.0-38349054864 10.1068/p5846
39. Ghazanfar A. A., Schroeder C. E., Is neocortex essentially multisensory? Trends in Cognitive Sciences 2006 10 6 278 285 2-s2.0-33745044194 10.1016/j.tics.2006.04.008
40. Schroeder C. E., Smiley J., Fu K. G., McGinnis T., O'Connell M. N., Hackett T. A., Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. International Journal of Psychophysiology 2003 50 1-2 5 17 2-s2.0-0348077580 10.1016/S0167-8760(03)00120- X
41. Schroeder C. E., Foxe J., Multisensory contributions to low-level, "unisensory" processing. Current Opinion in Neurobiology 2005 15 4 454 458 2-s2.0-23044480166 10.1016/j.conb.2005.06.008
42. Kayser C., Petkov C. I., Logothetis N. K., Multisensory interactions in primate auditory cortex: fMRI and electrophysiology. Hearing Research 2009 258 1-2 80 88 2-s2.0-65449161883 10.1016/j.heares.2009.02.011
43. Dayan P., Abbott L. F., Philosophical Psycology 2001 The MIT Press
44. Miller K. D., MacKay D. J. C., The role of constraints in Hebbian learning. Neural Computation 1994 6 1 100 126
45. Passamonti C., Frissen I., Làdavas E., Visual recalibration of auditory spatial perception: two separate neural circuits for perceptual learning. European Journal of Neuroscience 2009 30 6 1141 1150 2-s2.0-70349206337 10.1111/j.1460-9568.2009.06910.x