It does belong together: Cross-modal correspondences influence cross-modal integration during perceptual learning

Frontiers in Psychology

Volumn 6, Issue MAR, 2015, Pages

  Brunel, Lionel ^a   Carvalho, Paulo F ^b   Goldstone, Robert L ^b  

^a UNIVERSITÉ PAUL VALÉRY   (France)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Brightness Lightness; Cross modal correspondence; Cross modal integration; Perceptual learning; Pitch

Indexed keywords

EID: 84926630315     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00358     Document Type: Article

References (38)

1. Brunel, L., Goldstone, R. L., Vallet, G., Riou, B.,&Versace, R. (2013). When seeing a dog activates the bark: multisensory generalization and distinctiveness effects. Experimental Psychology, 60, 100-112. doi:10.1027/1618-3169/a000176
2. Brunel, L., Labeye, E., Lesourd, M.,&Versace, R. (2009). The sensory nature of episodic memory: Sensory priming effects due to memory trace activation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1081-1088. doi:10.1037/a0015537
3. Brunel, L., Lesourd, M., Labeye, E.,&Versace, R. (2010). The sensory nature of knowledge: Sensory priming effects in semantic categorization. The Quarterly Journal of Experimental Psychology, 63, 955-964. doi:10.1080/17470210903134369
4. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
5. Chen, Y.-C.,&Spence, C. (2010). When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition, 114, 389-404. doi: 10.1016/j.cognition.2009.10.012
6. Cohen J.D., MacWhinney B., Flatt M.,&Provost J. (1993). PsyScope: A new graphic interactive environment for designing psychology experiments. Behavioral Research Methods, Instruments, and Computers, 25, 257-271.
7. Dehaene, S., Charles, L., King, J-M&Marti, S. (2014). Toward a computational theory of conscious processing. Current opinion in Neurobiology, 25, 76-84. doi:10.1016/j.conb.2013.12.005
8. Ernst M (2007) Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7, 1-14.
9. Evans, K. K.,&Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features. Journal of Vision, 10, 1-12. doi:10.1167/10.1.6
10. Fodor, J. A. (1983). Modularity of Mind: An Essay on Faculty Psychology. Cambridge, MA: MIT Press.
11. Gallace, A.,&Spence, C. (2006). Multisensory synesthetic interactions in the speeded classification of visual size. Perception&Psychophysics, 68, 1191-1203.
12. Giard, M. H., Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: a behaviour and electrophysiological study. Journal of Cognitive Neuroscience 11, 473-490.
13. Goldstone, R. L. (2000). Unitization during category learning. Journal of Experimental Psychology: Human Perception and Performance, 26, 86-112.
14. Goldstone, R. L., Landy D.&Brunel, L. C. (2013). Improving the perception to make distant connections closer. Frontiers in psychology, 2, 1-10. doi: 10.3389/fpsyg.2011.00385
15. Goldstone, R. L., Lippa, Y.,&Shiffrin, R. M. (2001). Altering object representations through category learning. Cognition, 78, 27-43.
16. Klapetek, A., Ngo, M. K.,&Spence, C. (2012). Does crossmodal correspondence modulate the facilitatory effect of auditory cue on visual search?. Attention, Perception,&Psychophysics, 74, 1154-1167. DOI 10.3758/s13414-012-0317-9
17. King A.,&Calvert, G. (2001). Multisensory integration: perceptual grouping by eye and ear. Current Biology, 11, 322-325.
18. Laurienti, P., Burdette, J., Maldjian, J.,&Wallace, M.T. (2006). Enhanced multisensory integration in older adults. Neurobiology of Aging, 27, 1155-1163.
19. MacLeod, A,&Summerfield, Q. (1990). A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use. Brain Journal of Audiology, 24, 29-43.
20. Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance, 13, 384-394.
21. Marks, L. E. (2004). Cross-modal interactions in speeded classification. In G. A. Calvert, C. Spence,&B. E. Stein (Eds.), Handbook of multisensory processes (pp. 85-105). Cambridge: MIT Press
22. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E.,&Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cognitive Brain Research, 14, 115-128.
23. Mroczko-Wqsowicz, A.,&Werning M. (2012). Synesthesia, sensory-motor contingency, and semantic emulation: how swimming style-color synesthesia challenges the traditional view of synesthesia. Frontiers in Psychology, 3, p. 1-12. doi: 10.3389/fpsyg.2012.00279
24. Parise, C. V.,&Spence, C. (2009). "When Birds of a Feather Flock Together": Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE, 4, e5664. doi:10.1371/journal.pone.0005664.g003
25. Ramachandran, V. S.,&Hubbard, E. M. (2001). Synaesthesia-A window into perception, thought and language. Journal of Consciousness Studies, 8, 3-34.
26. Riou, B., Rey, A., Vallet, G. T., Cuny, C.,&Versace, R. (2014). Perceptual processing affects the reactivation of a sensory dimension during a categorization task. The Quarterly Journal of Experimental Psychology, 1-8. doi: 10.1080/17470218.2014.978876
27. Schmidt, J. R.,&De Houwer, J. (2012). Contingency learning with evaluative stimuli. Experimental Psychology, 59, 175-182. doi: 10.1027/1618-3169/a000141
28. Schmidt, J. R., De Houwer, J.,&Besner, D. (2010). Contingency learning and unlearning in the blink of an eye: A resource dependent process. Consciousness&Cognition, 19, 235-250. doi: 10.1016/j.concog.2009.12.016
29. Smith, L. B.,&Sera, M. (1992) A developmental analysis of the polar structure of dimensions. Cognitive Psvchology, 24, 99-142.
30. Stein, B. E.&Meredith, M. A. (1993). The merging of senses. Cambridge, MA: MIT Press.
31. Spence, C. (2011). Crossmodal correspondences: A tutorial review. Attention, Perception,&Psychophysics, 73, 971-995. doi: 10.3758/s13414-010-0073-7
32. Teder-Salejarvi, W. A., Russo, F., McDonald, J. L.,&Hillyard, S. A. (2005). Effects of spatial congruity on audio-visual multimodal integration. Journal of Cognitive Neuroscience, 17, 1396-1409.
33. Teder-Salejarvi, W. A., McDonald, J. L., Di Russo, F.,&Hillyard, S. A. (2002). An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cognitive Brain Research, 14, 106-114.
34. Versace, R., Vallet, G. T., Riou, B., Lesourd, M., Labeye, E.,&Brunel, L. (2014). Journal of Cognitive Psychology. Journal of Cognitive Psychology, 1-27. doi:10.1080/20445911.2014.892113
35. Versace, R., Labeye, E., Badard, G.,&Rose, M. (2009). The contents of long-term memory and the emergence of knowledge. The European Journal of Cognitive Psychology, 21, 522-560.
36. Zmigrod, S.,&Hommel, B. (2010). Temporal dynamics of unimodal and multimodal feature binding. Attention, Perception,&Psychophysics, 72, 142-152. doi:10.3758/APP.72.1.142
37. Zmigrod, S.,&Hommel, B. (2011). The relationship between feature binding and consciousness: Evidence from asynchronous multi-modal stimuli. Consciousness and Cognition, 20, 586-593. doi:10.1016/j.concog.2011.01.011
38. Zmigrod, S.,&Hommel, B. (2013). Feature Integration across Multimodal Perception and Action: A Review. Multisensory Research, 26, 143-157. doi:10.1163/22134808-00002390