A computational model of crossmodal processing for conflict resolution

7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017

Volumn 2018-January, Issue , 2017, Pages 33-38

  Parisi, German I ^a   Barros, Pablo ^a   Kerzel, Matthias ^a   Wu, Haiyan ^b,c   Yang, Guochun ^b,c   Li, Zhenghan ^b,c   Liu, Xun ^b,c   Wermter, Stefan ^a  

^a UNIVERSITY OF HAMBURG   (Germany)

^b INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^c UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC GENERATORS; COMPUTATION THEORY; COMPUTATIONAL METHODS; NETWORK ARCHITECTURE; NEURAL NETWORKS;

AUDIO-VISUAL STIMULUS; COMPLEX ENVIRONMENTS; COMPUTATIONAL MODELLING; CONFLICT RESOLUTION; CROSS-MODAL; DEVELOPMENTAL STAGE; MULTISENSORY; NEURAL MECHANISMS; PERCEPTUAL EXPERIENCE; SENSORY MODALITY;

BEHAVIORAL RESEARCH;

EID: 85050361219     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2017.8329784     Document Type: Conference Paper

References (21)

1. B. E. Stein and M. A. Meredith, The merging of the senses. Cambridge, MA, US: The MIT Press, 1993.
2. K. P. Körding, U. Beierholm, W. J. Ma, S. Quartz, J. B. Tenenbaum, and L. Shams, "Causal inference in multisensory perception," PLoS ONE, vol. 2, no. 9, 2007.
3. B. Odegaard, D. Wozny, and L. Shams, "Biases in visual, auditory, and audiovisual perception of space.," PLoS Computational Biology, vol. 11, no. 12, 2015.
4. C. E. Jack and W. R. Thurlow, "Effects of degree of visual association and angle of displacement on the "ventriloquism" effect," Perceptual & Motor Skills, vol. 37, pp. 967-979, 1973.
5. M. Radeau and P. Bertelson, "Adaptation to auditoryvisual discordance and ventriloquism in semirealistic situations," Perception & Psychophysics, vol. 22, no. 2, pp. 137-146, 1977.
6. I. B. Witten and E. I. Knudsen, "Why seeing is believing: Merging auditory and visual worlds," Neuron, vol. 48, no. 3, 2005.
7. W.-H. Zhang, H. Wang, K. Y. M. Wong, and S. Wu, "Congruent and opposite neurons: Sisters for multisensory integration and segregation," in NIPS 29, pp. 3180- 3188, 2016.
8. P. Zhou and X. Liu, "Attentional modulation of emotional conflict processing with flanker tasks," PLoS One, vol. 8, no. 3, 2013.
9. C. Kayser and L. Shams, "Multisensory causal inference in the brain," PLoS Biology, vol. 13, no. 2, 2015.
10. N. E. Barraclough, D. Xiao, C. I. Baker, M.W. Oram, and D. I. Perrett, "Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions.," Journal of Cognitive Neuroscience, vol. 17, no. 3, pp. 377-391, 2005.
11. T. K. Hensch, "Critical period plasticity in local cortical circuits.," Nature Reviews, vol. 6, pp. 877-888, 2005.
12. K. Noda, H. Arie, Y. Suga, and T. Ogata, "Multimodal integration learning of robot behavior using deep neural networks.," Robotics and Autonomous Systems, vol. 62, no. 6, pp. 721 - 736, 2014.
13. F. Cruz, G. Parisi, J. Twiefel, and S. Wermter, "Multimodal integration of dynamic audiovisual patterns for an interactive reinforcement learning scenario," in Proceedings of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), pp. 759-766, 2016.
14. M. Ursino, C. Cuppini, and E. Magosso, "Neurocomputational approaches to modelling multisensory integration in the brain: A review," Neural Networks, vol. 60, pp. 141 - 165, 2014.
15. E. Magosso, C. Cuppini, and M. Ursino, "A neural network model of ventriloquism effect and aftereffect," PLoS ONE, vol. 7, no. 8, 2012.
16. M. Ursino, C. Cuppini, and E. Magosso, "Multisensory bayesian inference depends on synapse maturation during training: Theoretical analysis and neural modeling implementation," Neural Computation, vol. 29, no. 3, pp. 735- 782, 2017.
17. Q. Li, W. Nan, K. Wang, and X. Liu, "Independent processing of stimulus-stimulus and stimulus-response conflicts," PLoS ONE, vol. 9, 02 2014.
18. X. Liu, Y. Park, X. Gu, and J. Fan, "Dimensional overlap accounts for independence and integration of stimulus- response compatibility effects," Attention, Perception, & Psychophysics, vol. 72, no. 6, pp. 1710-1720, 2010.
19. W. D. Hairston, M. T. Wallace, J. W. Vaughan, B. E. Stein, J. L. Norris, and J. A. Schirillo, "Visual localization ability influences cross-modal bias," Journal of Cognitive Neuroscience, vol. 15, no. 1, pp. 20-29, 2003.
20. P. Bertelson, I. Frissen, J. Vroomen, and B. de Gelder, "The aftereffects of ventriloquism: Patterns of spatial generalization.," Perception Psychology, vol. 68, pp. 428- 436, 2006.
21. C. Cuppini, E. Magosso, N. Bolognini, G. Vallar, and M. Ursino, "A neurocomputational analysis of the soundinduced flash illusion.," Neuroimage, vol. 15, no. 92, pp. 248-266, 2014.