Semantic congruency and the Colavita visual dominance effect

Experimental Brain Research

Volumn 184, Issue 4, 2008, Pages 533-546

  Koppen, Camille ^a   Alsius, Agnès ^b   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF BARCELONA   (Spain)

Author keywords

Audiovisual; Colavita effect; Semantic congruence; Speech; Visual dominance

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CONTROLLED STUDY; EYE DOMINANCE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; PRIORITY JOURNAL; SPEECH; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MALE; PERCEPTUAL MASKING; PHOTIC STIMULATION; SEMANTICS; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 38349086468     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-007-1120-z     Document Type: Article

References (55)

1. Baylis GC, Simon SL, Baylis LL, Rorden C (2002) Visual extinction with double simultaneous stimulation: what is simultaneous? Neuropsychologia 40:1027-1034
2. Bertelson P, de Gelder B (2004) The psychology of multimodal perception. In: Spence C, Driver J (eds) Crossmodal space and crossmodal attention. Oxford University Press, Oxford, pp 141-177
3. Callan DE, Callan AM, Kroos C, Vatikiotis-Bateson E (2001) Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Cogn Brain Res 10:349-353
4. Callan DE, Jones JA, Munhall K, Callan AM, Kroos C, Vatikiotis-Bateson E (2003) Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport 14:2213-2218
5. Calvert GA, Spence C, Stein BE (eds) (2004) The handbook of multisensory processes. MIT, Cambridge, MA
6. Colavita FB (1974) Human sensory dominance. Percept Psychophys 16:409-412
7. Colavita FB, Tomko R, Weisberg D (1976) Visual prepotency and eye orientation. Bull Psychon Soc 8:25-26
8. Colavita FB, Weisberg D (1979) A further investigation of visual dominance. Percept Psychophys 25:345-347
9. Driver J, Spence C (2000) Multisensory perception: beyond modularity and convergence. Curr Biol 10:R731-R735
10. Egeth HE, Sager LC (1977) On the locus of visual dominance. Percept Psychophys 22:77-86
11. Frick RW (1995) Accepting the null hypothesis. Mem Cognit 23:132-138
12. Hay JC, Pick HLJ, Ikeda K (1965) Visual capture produced by prism spectacles. Psychon Sci 2:215-216
13. Heron J, Whitaker D, McGraw PV (2004) Sensory uncertainty governs the extent of audio-visual interaction. Vision Res 44:2875-2884
14. Howard IP, Templeton WB (1966) Human spatial orientation. Wiley, New York
15. Johnson TL, Shapiro KL (1989) Attention to auditory and peripheral visual stimuli: effects of arousal and predictability. Acta Psychol 72:233-245
16. Koppen C, Spence C (2006) Prior entry and the Colavita effect. Poster presented at the 7th meeting of the IMRF. Trinity College, Dublin, 18-21 June [Abstract no. 111]
17. Koppen C, Spence C (2007a) Seeing the light: exploring the Colavita visual dominance effect. Exp Brain Res 180:737-754
18. Koppen C, Spence C (2007b) Spatial coincidence modulates the Colavita visual dominance effect. Neurosci Lett 417:107-111
19. Koppen C, Spence C (2007c) Assessing the role of stimulus probability on the Colavita visual dominance effect. Neurosci Lett 418:266-271
20. Laurienti PJ, Kraft RA, Maldjian JA, Burdette JH, Wallace MT (2004) Semantic congruence is a critical factor in multisensory behavioral performance. Exp Brain Res 158:405-414
21. Lavie N (2005) Distracted and confused? Selective attention under load. Trends Cogn Sci 9:75-82
22. Marcell ME, Borella D, Greene M, Kerr E, Rogers S (2000) Confrontation naming of environmental sounds. J Clin Exp Neuropsychol 22:830-864
23. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748
24. McRae K, de Sa VR, Seidenberg MS (1997) On the nature and scope of featural representations of word meaning. J Exp Psychol Gen 126:99-130
25. Miller JO (1982) Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14:247-279
26. Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14:452-465
27. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:121-134
28. Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17:154-163
29. Partan S, Marler P (1999) Communication goes multimodal. Science 283:1272-1273
30. Quinlan P (2000) The 'late' locus of visual dominance. Abstr Psychon Soc 5:64
31. Radeau M, Bertelson P (1977) Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations. Percept Psychophys 22:137-146
32. Recanzone GH (2003) Auditory influences on visual temporal rate perception. J Neurophysiol 89:1078-1093
33. Rosenblum LD, Wuestefeld AP, Anderson KL (1996) Auditory reachability: an affordance approach to the perception of sound source distance. Ecol Psychol 8:1-24
34. Schneider W, Eschman A, Zuccolotto A (2002a) E-prime user's guide. Psychology Software Tools, Pittsburgh
35. Schneider W, Eschman A, Zuccolotto A (2002b) E-prime reference guide. Psychology Software Tools, Pittsburgh
36. Sekiyama K, Kanno I, Miura S, Sugita Y (2003) Auditory-visual speech perception examined by fMRI and PET. Neurosci Res 47:277-287
37. Shams L, Kamitani Y, Shimojo S (2000) What you see is what you hear: sound induced visual flashing. Nature 408:788
38. Shimojo S, Shams L (2001) Sensory modalities are not separate modalities: plasticity and interactions. Curr Opin Neurobiol 11:505-509
39. Sinnett S, Spence C, Soto-Faraco S (2007) Visual dominance and attention: the Colavita effect revisited. Percept Psychophys
40. Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12:7-10
41. Snodgrass JG, Vanderwart M (1980) A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. J Exp Psychol Hum Learn Mem 6:174-215
42. Spence C (2007) Audiovisual multisensory integration. Acoust Sci Technol 28:61-70
43. Stein BE, Meredith MA (1993) The merging of the senses. MIT, Cambridge, MA
44. Taylor KI, Moss HE, Stamatakis EA, Tyler LK (2006) Binding crossmodal object features in perirhinal cortex. Proc Natl Acad Sci USA 103:8239-8244
45. Tyler LK, Moss HE (2001) Towards a distributed account of conceptual knowledge. Trends Cogn Sci 5:244-252
46. Vatakis A, Spence C (2007a) Crossmodal binding: evaluating the 'unity assumption' using audiovisual speech. Percept Psychophys 69:744-756
47. Vatakis A, Spence C (2007b) Evaluating the influence of the 'unity assumption' for the temporal perception of realistic audiovisual stimuli. Acta Psychol doi: 10.1016/j.actpsy.2006.12.002
48. Vroomen J, Keetels M (2006) The spatial constraint in intersensory pairing: no role in temporal ventriloquism. J Exp Psychol Hum Percept Perform 32:1063-1071
49. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, Schirillo JA (2004) Unifying multisensory signals across time and space. Exp Brain Res 158:252-258
50. Watanabe K, Shimojo S (1998) Attentional modulation in perception of visual motion events. Perception 27:1041-1054
51. Welch RB (1999) Meaning, attention, and the "unity assumption" in the intersensory bias of spatial and temporal perceptions. In: Ashersleben G, Bachmann T, Müsseler J (eds) Cognitive contributions to the perception of spatial and temporal events. Elsevier Science, B.V., Amsterdam, pp 371-387
52. Welch RB, DuttonHurt LD, Warren DH (1986) Contributions of audition and vision to temporal rate perception. Percept Psychophys 39:294-300
53. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 3:638-667
54. Welch RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and performance, vol 1. Sensory processes and perception. Wiley, New York, pp 25-1-25-36
55. Zampini M, Guest S, Shore DI, Spence C (2005) Audio-visual simultaneity judgments. Percept Psychophys 67:531-544