Audio-visual speech cue combination

PLoS ONE

Volumn 5, Issue 4, 2010, Pages

  Arnold, Derek H ^a   Tear, Morgan ^a   Schindel, Ryan ^a   Roseboom, Warrick ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; BAYES THEOREM; CONTENT ANALYSIS; CONTROLLED STUDY; DECISION MAKING; HUMAN; HUMAN EXPERIMENT; MAXIMUM LIKELIHOOD METHOD; NORMAL HUMAN; PREDICTION; PROBABILITY; SENSORY EVALUATION; SPEECH ARTICULATION; VISUAL DISCRIMINATION; VISUAL STIMULATION; VOLUNTEER; HEARING; PHYSIOLOGY; SPEECH; STATISTICAL MODEL; VISION;

AUDITORY PERCEPTION; CUES; HUMANS; LIKELIHOOD FUNCTIONS; SPEECH; VISUAL PERCEPTION;

EID: 77956320682     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0010217     Document Type: Article

References (25)

1. Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, et al. (2005) Feeling what you hear: Auditory signals can modulate tactile tap perception. Experimental Brain Research 162: 172-180.
2. Lopez-Moliner J, Soto-Faraco S (2007) Vision affects how fast we hear sounds move. Journal of Vision 7: 1-7.
3. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264: 746-748.
4. Pavani F, Spence C, Driver J (2000) Visual capture of touch: out-of-the-body experiences with rubber gloves. Psychological Science 11: 353-359.
5. Sekuler R, Sekuler AB, Lau R (1997) Sound alters visual motion perception. Nature 385: 308.
6. Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408: 788.
7. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14: 257-262.
8. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429-433.
9. Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26: 212-215.
10. Graham N (1989) Visual pattern analyzers. Oxford: Oxford University Press.
11. Koene A, Arnold DH, Johnston A (2007) Bimodal sensory discrimination is finer than dual single modality discrimination. Journal of Vision 7: 1-11.
12. Macmillan NA, Creelman CD (2005) Detection theory: A user's guide (2nd ed.). London: Lawrence Erlbaum Associates.
13. Wuerger SM, Hofbauer M, Meyer GF (2003) The integration of auditory and visual motion signals at threshold. Perception & Psychophysics 65: 1188-1196.
14. Treisman M (1998) Combining information: Probability summation and probability averaging in detection and discrimination. Psychological Methods 2: 252-265.
15. Meyer GF, Wuerger SM, Rohrbein F, Zetzsche C (2005) Low-level integration of auditory and visual motion signals requires spatial co-localisation. Experimental Brain Research 166: 538-547.
16. Morrone MC, Burr DC, Vaina LM (1995) Two stages of visual processing for radial and circular motion. Nature 376: 507-509.
17. Meese TS, Harris MG (2001) Independent detectors for expansion and rotation, and for orthogonal components of deformation. Perception 30: 1189-1202.
18. Green DM, Swets JA (1966) Signal detection theory and psychophysics. New York: Wiley.
19. Yuille AL, Buelthoff HH (1996) Bayesian decision theory and psychophysics. In: Knill DC, Richards W, eds. Perception as Bayesian inference (pp. 123-161). Cambridge: Cambridge University Press.
20. Fujisaki W, Koene A, Arnold DH, Johnston A, Nishida S (2006) Visual search for a target changing in synchrony with an auditory signal. Proceedings of the Royal Society of London B 273: 865-874.
21. Soto-Faraco S, Navarra J, Alsius A (2004) Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task. Cognition 92: B13-23.
22. Hillis JM, Ernst MO, Banks MS, Landy MS (2002) Combining sensory information: Mandatory fusion within, but not between, senses. Science 298: 1627-1630.
23. Arrighi R, Marini F, Burr D (2009) Meaningful auditory information enhances perception of visual biological motion. Journal of Vision 9: 1-7.
24. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC (2009) Lip-reading aids word recognition most in moderate noise: A Bayesian explanation using highdimensional feature space. PLoS ONE 4(3): e4638.
25. Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ (2007) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisey environments. Cerebral Cortex 17: 1147-1153.