The Sensory-Dependent Nature of Audio-Visual Interactions for Semantic Knowledge

Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011

Volumn , Issue , 2011, Pages 2077-2082

  Vallet, Guillaume ^a,b   Riou, Benoit ^a   Versace, Rémy ^a   Simard, Martine ^b  

^a Lyon University   (France)

^b UNIVERSITÉ LAVAL   (Canada)

Author keywords

Audio visual; Grounded Cognition; Masking; Memory; Perception; Priming

Indexed keywords

AUDIO-VISUAL; AUDIO-VISUAL INTERACTIONS; CONDITION; CROSS-MODAL; GROUNDED COGNITION; MASKING; MULTISENSORY; PRIMING; SEMANTIC MEMORY; SEMANTICS KNOWLEDGE;

EID: 84877887387     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.
2. Brunel, L., Labeye, E., Lesourd, M., & Versace, R. (2009). The sensory nature of episodic memory: Sensory priming effects due to memory trace activation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1081–1088.
3. Calvert, G. A., & Thesen, T. (2004). Multisensory integration: Methodological approaches and emerging principles in the human brain. Journal of Physiology, 98, 191–205.
4. Chen, Y. C., & Spence, C. (2010). When hearing the bark helps to identify the dog: Semantically-congruent sounds modulate the identification of masked pictures. Cognition, 114, 389–404.
5. Coccia, M., Bartolini, M., Luzzi, S., Provinciali, L., & Lambon Ralph, M. (2004). Semantic memory is an amodal, dynamic system: Evidence from the interaction of naming and object use in semantic dementia. Cognitive Neuropsychology, 21, 513–527.
6. Cohen, J., MacWhinney, B., Flatt, M., & Provost, J. (1993). Psyscope: A new graphic interactive environment for designing psychology experiments. Behavior Research Methods, 25, 257–271.
7. Doehrmann, O., & Naumer, M. (2008). Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration. Brain Research, 1242, 136–150.
8. Driver, J., & Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on’sensory-specific’ brain regions, neural responses, and judgments. Neuron, 57, 11–23.
9. Easton, R., Srinivas, K., & Greene, A. (1997). Do vision and haptics share common representations? Implicit and explicit memory within and between modalities. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, 153–163.
10. Enns, J., & Di Lollo, V. (2000). What’s new in visual masking? Trends in Cognitive Sciences, 4, 345–352.
11. Ishai, A., & Sagi, D. (1995). Common mechanisms of visual imagery and perception. Science, 268, 1772–1774.
12. Koelewijn, T., Bronkhorst, A., & Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: A review of audiovisual studies. Acta Psychologica, 134, 372–384.
13. Labeye, E., Oker, A., Badard, G., & Versace, R. (2008). Activation and integration of motor components in a short-term priming paradigm. Acta psychologica, 129, 108–111.
14. Laurienti, P., Kraft, R., Maldjian, J., Burdette, J., & Wallace, M. (2004). Semantic congruence is a critical factor in multisensory behavioral performance. Experimental Brain Research, 158, 405–414.
15. Lehmann, S., & Murray, M. (2005). The role of multisensory memories in unisensory object discrimination. Cognitive Brain Research, 24, 326–334.
16. Mitterer, H., & Jesse, A. (2010). Correlation versus causation in multisensory perception. Psychonomic Bulletin & Review, 17, 329–334.
17. Molholm, S., Martinez, A., Shpaner, M., & Foxe, J. (2007). Object-based attention is multisensory: Co-activation of an object’s representations in ignored sensory modalities. European Journal of Neuroscience, 26, 499–509.
18. Mulligan, N. W. (2003). Effects of cross-modal and intramodal division of attention on perceptual implicit memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 262–276.
19. Petrini, K., Russell, M., & Pollick, F. (2009). When knowing can replace seeing in audiovisual integration of actions. Cognition, 110, 432–439.
20. Riou, B., Lesourd, M., Brunel, L., & Versace, R. (in press). Visual memory and visual perception: When memory improves visual search. Memory & Cognition, 1–9.
21. Schneider, T., Engel, A., & Debener, S. (2008). Multisensory identification of natural objects in a two-way crossmodal priming paradigm. Experimental Psychology, 55, 121–132.
22. Slotnick, S. D., & Schacter, D. L. (2006). The nature of memory related activity in early visual areas. Neuropsychologia, 44, 2874–2886.
23. Spence, C. (2007). Audiovisual multisensory integration. Acoustical Science and Technology, 28, 61–70.
24. Sperdin, H., Cappe, C., Foxe, J., & Murray, M. (2009). Early, low-level auditory-somatosensory multisensory interactions impact reaction time speed. Frontiers in Integrative Neuroscience, 3, 1–10.
25. Taylor, K., Moss, H., & Tyler, L. (2007). The conceptual structure account: A cognitive model of semantic memory and its neural instantiation. In J. Hart & M. Kraut (Eds.), The neural basis of semantic memory (pp. 265–301). Cambridge University Press.
26. Tulving, E. (1972). Episodic and semantic memory. In E. Tulving & W. Donaldson (Eds.), Organization of memory (pp. 381–403). New York: Academic Press.
27. Tulving, E. (1995). Organization of memory: Quo Vadis? In M. Gazzaniga (Ed.), The cognitive neurosciences (pp. 839–847). Cambridge, Mass: MIT Press.
28. Vallet, G., Brunel, L., & Versace, R. (2010). The perceptual nature of the cross-modal priming effect: Arguments in favor of a sensory-based conception of memory. Experimental Psychology, 57, 376-382.
29. Vallet, G., Simard, M., & Versace, R. (in press). Sensory-dependent knowledge in young and elderly adults: Arguments from the cross-modal priming effect. Current Aging Science.
30. van den Bussche, E., van den Noortgate, W., & Reynvoet, B. (2009). Mechanisms of masked priming: A meta-analysis. Psychological Bulletin, 135, 452–477.
31. Versace, R., Labeye, E., Badard, G., & Rose, M. (2009). The contents of long-term memory and the emergence of knowledge. European Journal of Cognitive Psychology, 21, 522–560.
32. Wallace, M., Roberson, G., Hairston, W., Stein, B., Vaughan, J., & Schirillo, J. (2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158, 252–258.