The integration of auditory and visual motion signals at threshold

Perception and Psychophysics

Volumn 65, Issue 8, 2003, Pages 1188-1196

  Wuerger, S M ^a,c   Hofbauer, M ^b   Meyer, G F ^a  

^a KEELE UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF MUNICH   (Germany)

^c UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 1642573395     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03194844     Document Type: Article

References (61)

1. ALAIS, D., & BURR, D. (2001). No low-level interaction between visual and auditory motion [Abstract]. Perception, 30(Suppl.), 5.
2. ASPELL, J. E., BRAMWELL, D. I., & HURLBERT, A. C. (2000). Interactions between visual and auditory movement perception in a direction discrimination task. Perception, 29(Suppl.), 74.
3. BARLOW, H., & TRIPATHY, S. P. (1997). Correspondence noise and signal pooling in the detection of coherent visual motion. Journal of Neuroscience, 17, 7954-7966.
4. BRADDICK, O. (1997). Local and global representations of velocity: Transparency, opponency, and global direction perception. Perception, 26, 995-1010.
5. BRECHT, M., GOEBEL, R., SINGER, W., & ENGEL, A. K. (2001). Synchronisation of visual responses in the superior colliculus of awake cats. NeuroReport, 12, 43-47.
6. BREMMER, F., SCHLACK, A., DUHAMEL, J. R., GRAF, W., & FINK, G. R. (2001). Space coding in primate posterior parietal cortex. Neuro-Image, 14.S46-S51.
7. BREMMER, F., SCHLACK, A., SHAH, N. J., ZAFIRIS, O., KUBISCHIK, M., HOFFMANN, K. P., ZILLES, K., & FINK, G. R. (2001). Polymodal motion processing in posterior parietal and promotor cortex.: A human fMRI study strongly implies equivalencies between humans and monkeys. Neuron, 29, 287-296.
8. BURR, D. C., & SANTORO, L. (2001). Temporal integration of optic flow, measured by contrast and coherence thresholds. Vision Research, 41, 1891-1899.
9. CALVERT, G. A., BRAMMER, M. J., BULLMORE, E. T., CAMPBELL, R., IVERSON, S. D., & DAVID, A. S. (1999). Response amplification in sensory-specific cortices during cross-modal binding. NeuroReport, 10, 2619-2623.
10. CALVERT, G. A., BULLMORE, E. T., BRAMMER, M. J., CAMPBELL, R., WILLIAMS, S. C., MCGUIRE, P. K., WOODRUFF, P. W., IVERSEN, S. D., & DAVID, A. S. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
11. DAFFNER, K. R., MESULAM, M. M., SCINTO, L. F. M., ACAR, D., CALVO, V., FAUST, R., CHABERIC, A., KENNEDY, B., & HOLCOMB, P. (2000). The central role of the prefrontal cortex in directing attention to novel events. Brain, 123, 927-939.
12. DRIVER, J., & SPENCE, C. (1998a). Attention and the crossmodal construction of space. Trends in Cognitive Sciences, 2, 254-263.
13. DRIVER, J., & SPENCE, C. (1998b). Cross-modal links in spatial attention. Philosophical Transactions of the Royal Society of London: Series B, 353, 1319-1331.
14. FOXE, J. J., MOROCZ, I. A., MURRAY, M. M., HIGGINS, B. A., JAVITT, D. C., & SCHROEDER, C. E. (2000). Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Cognitive Brain Research, 10, 77-83.
15. FOXE, J. J., & SIMPSON, G. V. (2002). Flow of activation from VI to frontal cortex in humans: A framework for defining "early" visual processing. Experimental Brain Research, 142, 139-150.
16. FU, K. M. G., FOXE, J. J., MURRAY, M. M., HIGGINS, B. A., JAVITT, D. C., & SCHROEDER, C. E. (2001). Attention-dependent suppression of distracter visual input can be cross-modally cued as indexed by anticipatory parieto-occipital alpha-band oscillations. Cognitive Brain Research, 12, 145-152.
17. FUSTER, J. M., BODNER, M., & KROGER, J. K. (2000). Cross-modal and cross-temporal association in neurons of frontal cortex. Nature, 405, 347-351.
18. GIBSON, J. J. (1957). Optical motions and transformation as stimuli for visual perception. Psychological Review, 64, 288-295.
19. GITELMAN, D. R., PARRISH, T. B., FRISTON, K. J., & MESULAM, M. M. (2002). Functional anatomy of visual search: Regional segregations within the frontal eye fields and effective connectivity of the superior colliculus. NeuroImage, 15, 970-982.
20. GRIFFITHS, T. D., REES, G., REES, A., GREEN, G. G. R., WITTON, C., ROWE, D., BUCHEL, C., TURNER, R., & FRACKOWIAK, R. S. (1998). Right parietal cortex is involved in the perception of sound movement in humans. Nature Neuroscience, 1, 74-79.
21. GROSSMAN, E. D., & BLAKE, R. (1999). Perception of coherent motion, biological motion and form-from-motion under dim-light conditions. Vision Research, 39, 3721-3727.
22. GURNEY, K. N., & WRIGHT, M. J. (1996). A model for the spatial integration and differentiation of velocity signals. Vision Research, 36, 2939-2955.
23. HARRIS, L. R., BLAKEMORE, C., & DONAGHY, M. (1980). Integration of visual and auditory space in the mammalian superior colliculus. Nature, 288, 56-59.
24. KING, A. J., & CALVERT, G. (2001). Multisensory integration: Perceptual grouping by eye and ear. Current Biology, 11, 322-325.
25. KING, A. J., SCHNUPP, J. W. H., & THOMPSON, I. D. (1998). Signals from the superficial layers of the superior colliculus enable the development of the auditory space map in the deeper layers. Journal of Neuroscience, 18, 9394-9408.
26. LEWALD, J., EHRENSTEIN, W. H., & GUSKI, R. (2001). Spatio-temporal constraints for auditory-visual integration. Behavioural Brain Research, 121, 69-79.
27. LEWIS, J. W., BEAUCHAMP, M. S., & DEYOE, E. A. (2000). A comparison of visual and auditory motion processing in human cerebral cortex. Cerebral Cortex, 10, 873-888.
28. LIENERT, G. A. (1962). Verteilungsfreie Verfahren in der Biostatistik. Meisenheim: A. Hain.
29. MCDONALD, J. J., TEDER-SÄLEJÄRVI, W. A., & HILLYARD, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature, 407, 906-908.
30. MEREDITH, M. A., NEMITZ, J. W., & STEIN, B. E. (1987). Determinants of multisensory integration in superior colliculus neurones: I. Temporal factors. Journal of Neuroscience, 10, 3215-3229.
31. MEREDITH, M. A., & STEIN, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-391.
32. MEREDITH, M. A., & STEIN, B. E. (1996). Spatial determinants of multisensory integration in cat superior colliculus. Journal of Neurophysiology, 75, 1843-1857.
33. MESULAM, M. M., NOBRE, A. C., KIM, Y. H., PARRISH, T. B., & GITELMAN, D. R. (2001). Heterogeneity of cingulate contributions to spatial attention. NeuroImage, 13, 1065-1072.
34. MEYER, G., & WUERGER, S. (2001). Cross-modal integration of auditory and visual motion signals. NeuroReport, 12, 2557-2600.
35. MULLIGAN, R. M., & SHAW, M. L. (1980). Multimodal signal detection: Independent decisions vs. integration. Perception & Psychophysics, 28, 471-478.
36. QUICK, R. F. (1974). A vector magnitude model of contrast detection. Kybernetik, 16, 65-67.
37. RAUSCHECKER, J. P. (1988). Visual function of the cat's LP/LS subsystem in global motion processing. Progress in Brain Research, 75, 95-108.
38. RAUSCHECKER, J. P., & HARRIS, L. R. (1989). Auditory and visual neurons in the cat's superior colliculus selective for the direction of apparent motion stimuli. Brain Research, 490, 56-63.
39. SCASE, M. O., BRADDICK, O. J., & RAYMOND, J. E. (1996). What is noise for the motion system? Vision Research, 36, 2579-2586.
40. SCHMITT, M., POSTMA, A., & DE HAAN, E. (2000). Interactions between exogenous auditory and visual spatial attention. Quarterly Journal of Experimental Psychology, 53, 105-130.
41. SEKULER, R., SEKULER, A. B., & LAU, R. (1997). Sound alters visual motion perception. Nature, 385, 308.
42. SHAMS, L., KAMITANI, Y., & SHIMOJO, S. (2000). What you see is what you hear. Nature, 408, 788.
43. SMALL, D. M., GITELMAN, D. R., GREGORY, M. D., NOBRE, A. C., PARRISH, T., & MESULAM, M. M. (2001). The posterior cingulate cortex and anticipatory shifts of spatial attention. NeuroImage, 13, S360-S360.
44. SMITH, A. T., SNOWDEN, R. J., & MILNE, A. B. (1994). Is global motion really based on spatial integration of local motion signals. Vision Research, 34, 2425-2430.
45. SNOWDEN, R. J., & BRADDICK, O. J. (1989). The combination of motion signals over time. Vision Research, 29, 1621-1630.
46. SPENCE, C., & DRIVER, J. (1994). Covert spatial orienting in audition. Journal of Experimental Psychology: Human Perception & Performance, 20, 555-574.
47. SPENCE, C., & DRIVER, J. (1996). Audiovisual links in endogenous covert spatial attention. Journal of Experimental Psychology: Human Perception & Performance, 22, 1000-1030.
48. SPENCE, C., & DRIVER, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59, 1-22.
49. STEIN, B. E., HUNEYCUTT, W. S., & MEREDITH, M. A. (1988). Neurons and behavior: The same rules of multisensory integration apply. Brain Research, 448, 355-358.
50. STEIN, B. E., & MEREDITH, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
51. VANDENBERGHE, R., GITELMAN, D. R., PARRISH, T. B., & MESULAM, M. M. (2001). Functional specificity of superior parietal mediation of spatial shifting. NeuroImage, 14, 661-673.
52. WALLACE, M. T., MCHAFFIE, J. G., & STEIN, B. E. (1997). Visual response properties and visuotopic representation in the newborn monkey superior colliculus. Journal of Neurophysiology, 78, 2732-2741.
53. WALLACE, M. T., MEREDITH, M. A., & STEIN, B. E. (1998). Multisensory integration in the superior colliculus of the alert cat. Journal of Neurophysiology, 80, 1006-1010.
54. WALLACE, M. T., & STEIN, B. E. (1994). Cross-modal synthesis in the mid-brain depends on input from association cortex. Journal of Neurophysiology, 71, 429-432.
55. WALLACE, M. T., & STEIN, B. E. (1997). Development of multisensory neurons and multisensory integration in cat superior colliculus. Journal of Neuroscience, 17, 2429-2444.
56. WALLACE, M. T., WILKINSON, L. K., & STEIN, B. E. (1996). Representation and integration of multiple sensory inputs in primate superior colliculus. Journal of Neurophysiology, 76, 1246-1266.
57. WARREN, J. D., ZIELINSKI, B. A., GREEN, G. G. R., RAUSCHECKER, J. P., & GRIFFITHS, T. D. (2002). Perception of sound-source motion by the human brain. Neuron, 34, 139-148.
58. WATANABE, K., & SHIMOJO, S. (1998). Attentional modulation in perception of visual motion events. Perception, 27, 1041-1054.
59. WATANABE, K., & SHIMOJO, S. (2001). When sound affects vision: Effects of auditory grouping on visual motion perception. Psychological Science, 12, 109-116.
60. WEIBULL, W. (1951). A statistical distribution function of wide applicability. Journal of Applied Mechanics, 18, 292-297.
61. WESTHEIMER, G. (1954). Eye movement responses to a horizontally moving stimulus. Archives of Ophthalmology, 52, 932-941.