Multisensory temporal order judgments: When two locations are better than one

Perception and Psychophysics

Volumn 65, Issue 2, 2003, Pages 318-328

  Spence, Charles ^a   Baddeley, Roland ^b   Zampini, Massimiliano ^a   James, Robert ^a   Shore, David I ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF SUSSEX   (United Kingdom)

^c MCMASTER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; DECISION MAKING; HEARING; HUMAN; TIME PERCEPTION; TOUCH; VISION;

ADULT; AUDITORY PERCEPTION; HUMANS; JUDGMENT; TIME PERCEPTION; TOUCH; VISUAL PERCEPTION;

EID: 0038526239     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03194803     Document Type: Article

References (88)

1. ALLEN, P. G., & KOLERS, P. A. (1981). Sensory specificity of apparent motion. Journal of Experimental Psychology: Human Perception & Performance, 7, 1318-1326.
2. ANLLO-VENTO, L., & HILLYARD, S. A. (1996). Selective attention to the color and direction of moving stimuli: Electrophysiological correlates of hierarchical feature selection. Perception & Psychophysics, 58, 191-206.
3. ANZOLA, G. P., BERTOLONI, G., BUCHTEL, H. A., & RIZZOLATTI, G. (1977). Spatial compatibility and anatomical factors in simple and choice reaction time. Neuropsychologia, 15, 295-302.
4. BALD, L., BERRIEN, F. K., PRICE, J. B., & SPRAGUE, R. O. (1942). Errors in perceiving the temporal order of auditory and visual stimuli. Journal of Applied Psychology, 26, 382-388.
5. BERTELSON, P. (1998). Starting from the ventriloquist: The perception of multimodal events. In M. Sabourin, F. I. M. Craik, & M. Robert (Eds.), Advances in psychological science, Vol. 2. Biological and cognitive aspects (pp. 419-439). Hove, U.K.: Psychological Press.
6. BERTELSON, P., & ASCHERSLEBEN, G. (2001, January). Crossmodal interaction on the time dimension: Evidence from auditory-visual time order judgment. Paper presented at the London meeting of the Experimental Psychology Society.
7. BISHOP, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press, Clarendon Press.
8. BLOCH, A. M. (1887). Exnerschen ähnliche Versuche mit analogen Ergebnissen [Replication of Exner's studies with analogous results]. Revue Scientifique, XXXIX, S.585.
9. BRADSHAW, J. L., HOWARD, M. J., PIERSON, J. M., PHILLIPS, J., & BRADSHAW, J. A. (1992). Effects of expectancy and attention in vibrotactile choice reaction time tasks. Quarterly Journal of Experimental Psychology, 44A, 509-528.
10. BURTT, H. E. (1917). Tactile illusions of movement. Journal of Experimental Psychology, 1, 371-385.
11. BUSHARA, K. O., GRAFMAN, J., & HALLETT, M. (2001). Neural correlates of auditory-visual stimulus onset asynchrony detection. Journal of Neuroscience, 21, 300-304.
12. CARMON, A., & NACHSHON, I. (1971). Effect of unilateral brain damage on perception of temporal order. Cortex, 7, 410-418.
13. COREN, S., WARD, L. M., & ENNS, J. T. (1999). Sensation and perception (5th Ed.). Fort Worth: Harcourt Brace.
14. DENNETT, D. C. (1992). Temporal anomalies of consciousness. In Y. Christen & P. S. Churchland (Eds.), Neurophilosophy and Alzheimer's disease. Berlin: Springer-Verlag.
15. DINNERSTEIN, A. J., & BLITZ, B. (1964). Perceptual delays and speed of reading and tapping. Perceptual & Motor Skills, 19, 867-873.
16. DINNERSTEIN, A. J., & ZLOTOGURA, P. (1968). Intermodal perception of temporal order and motor skills: Effects of age. Perceptual & Motor Skills, 26, 987-1000.
17. DRIVER, J., & SPENCE, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10, R731-R735.
18. DUNCAN, J. (1984). Selective attention and the organization of visual information. Journal of Experimental Psychology: General, 113, 501-517.
19. EFRON, R. (1963). The effect of handedness on the perception of simultaneity and temporal order. Brain, 86, 261-284.
20. EGLY, R., DRIVER, J., & RAFAL, R. D. (1994). Shifting visual attention between objects and locations: Evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General, 123, 161-177.
21. ESTES, W. K. (1956). The problem of interference from curves based on group data. Psychological Bulletin, 53, 134-140.
22. EXNER, S. (1875). Experimentelle Untersuchung der einfachsten psychischen Processe [Experimental study of the most simple psychological processes]. Archiv für die geschichte Physiologie (Pflüger's Archive), 11, 403-432.
23. FENDRICH, R., & CORBALLIS, P. M. (2001). The temporal cross-capture of audition and vision. Perception & Psychophysics, 63, 719-725.
24. FINNEY, D. J. (1964). Probit analysis: Statistical treatment of the sigmoid response curve (2nd ed.). Cambridge: Cambridge University Press.
25. FRAISSE, P. (1963). The psychology of time. Evanston, NY: Harper & Row.
26. GENGEL, R. W., & HIRSH, I. J. (1970). Temporal order: The effect of single versus repeated presentations, practice, and verbal feedback. Perception & Psychophysics, 1, 209-211.
27. GROSSBERG, S., & GRUNEWALD, A. (1997). Cortical synchronization and perceptual framing. Journal of Cognitive Neuroscience, 9, 117-132.
28. GUINZBERG, R. L. (1928). É possibile 1'apprendimento di sensazioni eterogenee come perfettamente simultanee? (Is it possible to learn that heterogenous sensations are perfectly simultaneous?) Archivi Italiani di Psicologia, 6, 103-114.
29. HAMLIN, A. J. (1895). On the least observable interval between stimuli addressed to disparate senses and to different organs of the same sense. American Journal of Psychology, 6, 564-575.
30. HIRSH, I. J. (1988). Auditory perception and speech. In R. C. Atkinson, R. J. Herrnstein, G. Lindsey, & R. D. Luce (Eds.), Stevens' Handbook of experimental psychology: Perception and motivation (2nd ed., pp. 377-408). New York: Wiley.
31. HIRSH, I. J., & FRAISSE, P. (1964). Simultanéité et succession de stimuli hétérogènes [Simultaneity and succession of heterogeneous stimuli]. L'Année Psychologique, 64, 1-19.
32. HIRSH, I. J., & SHERRICK, C. E, JR.. (1961). Perceived order in different sense modalities. Journal of Experimental Psychology, 62, 423-432.
33. JAŚKOWSKI, P., JAROSZYK, F., & HOJAN-JERIERSKA, D. (1990). Temporal-order judgments and reaction time for stimuli of different modalities. Psychological Research, 52, 35-38.
34. KENNETT, S., EIMER, M., SPENCE, C., & DRIVER, J. (2001). Tactile-visual links in exogenous spatial attention under different postures: Convergent evidence from psychophysics and ERPs. Journal of Cognitive Neuroscience, 13, 462-478.
35. KENNETT, S., SPENCE, C., & DRIVER, J. (2002). Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture. Perception & Psychophysics, 64, 1083-1094.
36. KING, A. J., & PALMER, A. R. (1985). Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Experimental Brain Research, 60, 492-500.
37. McFARLAND, D. J., CACACE, A. T., & SETZEN, G. (1998). Temporal-order discrimination for selected auditory and visual stimulus dimensions. Journal of Speech, Language, & Hearing Research, 41, 300-314.
38. MEREDITH, M. A., & STEIN, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-391.
39. MILLAR, S. (1994). Understanding and representing space: Theory and evidence from studies with blind and sighted children, Oxford: Oxford University Press.
40. MOREIN-ZAMIR, S., SOTO-FARACO, S., & KINGSTONE, A. F. (2001). Captured vision: Sounds influence the perception of visual temporal order. Abstracts of the Psychonomic Society, 6, 91.
41. MOUTOUSSIS, K., & ZEKI, S. (1997). A direct demonstration of perceptual asynchrony in vision. Proceedings of the Royal Society of London: Series B, 264, 393-399.
42. NEISSER, U. (1976). Cognition and reality. San Francisco: Freeman.
43. NELDER, J. A., & MEAD, R. (1965). A simplex method for function minimisation. Computer Journal. 7, 308-313.
44. NISHIDA, S., & JOHNSTON, A. (2002). Marker correspondence, not processing latency, determines temporal binding of visual attributes. Current Biology, 12, 359-368.
45. O'CONNOR, N., & HERMELIN, B. (1978). Seeing and hearing and space and time. New York: Academic Press.
46. O'CRAVEN, K. M., DOWNING, P. E., & KANWISHER, N. (1999). fMRI evidence for objects as the units of attentional selection. Nature, 401, 584-587.
47. PIÉRON, H. (1952). The sensations: Their functions, processes and mechanisms. New Haven: Yale University Press.
48. PÖPPEL, E. (1985). Grenzen des Bewußtseins. Stuttgart: Deutsche Verlags-Anstal. [Translated as Mindworks: Time and conscious experience (1988). New York: Harcourt Brace Jovanovich.]
49. PÖPPEL, E. (1985). Grenzen des Bewußtseins. Stuttgart: Deutsche Verlags-Anstal. [Translated as Mindworks: Time and conscious experience (1988). New York: Harcourt Brace Jovanovich.]
50. PÖPPEL, E., SCHILL, K., & STEINBÜCHEL, N. VON (1990). Sensory integration within temporally neutral system states: A hypothesis. Naturwissenschaften, 77, 89-91.
51. RAIZADA, R. D. S., & POLDRACK, R. A. (2001). Event-related fMRI of audio-visual simultaneity perception. Society for Neuroscience Abstracts. Poster No. 511.14.
52. RAO, S. M., MAYER, A. R., & HARRINGTON, D. L. (2001). The evolution of brain activation during temporal processing. Nature Neuroscience, 4, 317-323.
53. ROBERTSON, G. E., HAIRSTON, W. D., WALLACE, M. T., STEIN, B. E., LAURIENTI, P. J., & SCHIRILLO, J. A. (2001). Unifying multisensory signals across time and space. Society for Neuroscience Abstracts, Poster No. 511.19.
54. RÖDER, B., SPENCE, C., & RÖSLER, F. (2002). Assessing the effect of posture changes on tactile inhibition of return. Experimental Brain Research, 143, 453-462.
55. ROSE, S. A., FELDMAN, J. F., JANKOWSKI, J. J., & FUTTERWEIT, L. R. (1999). Visual and auditory temporal processing, cross-modal transfer, and reading. Journal of Learning Disabilities, 32, 256-266.
56. RUTSCHMANN, J., & LINK, R. (1964). Perception of temporal order of stimuli differing in sense mode and simple reaction time. Perceptual & Motor Skills, 18, 345-352.
57. SADE, A., & SPITZER, H. (1998). The effects of attentional spread and attentional effort on orientation discrimination. Spatial Vision, 11, 367-383.
58. SCHEIER, C. R., NIJHAWAN, R., & SHIMOJO, S. (1999). Sound alters visual temporal resolution [Abstract]. Investigative Ophthalmology & Visual Science, 40, S792.
59. SCHRÖDER, E., & WOLFF, C. (1997). Fast preattentive processing of location: A functional basis for selective listening in humans. Neuroscience Letters, 232, 5-8.
60. SHERRICK, C. E. (1976). The antagonisms of hearing and touch. In S. K. Hirsh, D. H. Eldredge, I. J. Hirsh, & S. R. Silverman (Eds.), Hearing and Davis: Essays honoring Hallowell Davis (pp. 149-158). St. Louis: Washington University Press.
61. SHORE, D. I., SPENCE, C., & KLEIN, R. M. (2001). Visual prior entry. Psychological Science, 12, 205-212.
62. SHORE, D. I., SPRY, E., & SPENCE, C. (2002a). Confusing the mind by crossing the hands. Cognitive Brain Research, 14, 153-163.
63. SHORE, D. I., SPRY, E., & SPENCE, C. (2002b). Spatial modulation of tactile temporal order judgments. Manuscript submitted for publication.
64. SIMON, J. R. (1990). The effects of an irrelevant directional cue on human information processing. In R. W. Proctor & T. G. Reeve (Eds.), Stimulus-response compatibility (pp. 31-86). Amsterdam: Elsevier.
65. SLUTSKY, D. A., & RECANZONE, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. NeuroReport, 12, 7-10.
66. SMITH, W. F. (1933). The relative quickness of visual and auditory perception. Journal of Experimental Psychology, 16, 239-257.
67. SPENCE, C., & DRIVER, J. (1997). On measuring selective attention to an expected sensory modality. Perception & Psychophysics, 59, 389-403.
68. SPENCE, C., NICHOLLS, M. E. R., & DRIVER, J. (2001). The cost of expecting events in the wrong sensory modality. Perception & Psychophysics, 63, 330-336.
69. SPENCE, C., NICHOLLS, M. E. R., GILLESPIE, N., & DRIVER, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Perception & Psychophysics, 60, 544-557.
70. SPENCE, C., PAVANI, F., & DRIVER, J. (2000). Crossmodal links between vision and touch in covert endogenous spatial attention. Journal of Experimental Psychology: Human Perception & Performance, 26, 1298-1319.
71. SPENCE, C., SHORE, D. I., & KLEIN, R. M. (2001). Multisensory prior entry. Journal of Experimental Psychology: General, 130, 799-832.
72. STEIN, B. E., & MEREDITH, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
73. STONE, J. V., HUNKIN, N. M., PORRILL, J., WOOD, R., KEELER, V., BEANLAND, M., PORT, M., & PORTER, N. R. (2001). When is now? Perception of simultaneity. Proceedings of the Royal Society of London: Series B, 268, 31-38.
74. STRYBEL, T. Z., MANLIGAS, C. L., CHAN, O., & PERROTT, D. R. (1990). A comparison of the effects of spatial separation on apparent motion in the auditory and visual modalities. Perception & Psychophysics, 47, 439-448.
75. SWANSON, W. H., & BIRCH, E. E. (1992). Extracting thresholds from noisy psychophysical data. Perception & Psychophysics, 51, 409-422.
76. TAYLOR, B. (1978). Dimensional redundancy in the processing of vibrotactile temporal order. Unpublished doctoral dissertation, Princeton University.
77. TEATINI, G., FARNÈ, M., VERZELLA, F., & BERRUECOS, P., JR. (1976). Perception of temporal order: Visual and auditory stimuli. Giornale Italiano di Psicologia, 3, 157-164.
78. URBACH, D., & SPITZER, H. (1995). Attentional effort modulated by task difficulty. Vision Research, 35, 2169-2177.
79. VAN DE PAR, S., KOHLRAUSCH, A., & JUOLA, J. F. (1999). Judged synchrony/asynchrony for light-tone pairs. Abstracts of the Psychonomic Society, 4, 60.
80. WATT, R. J. (1991). Understanding vision. London: Academic Press.
81. WEILAND, B. A. (1960). The interaction of space and time in cutaneous perception. American Journal of Psychology, 73, 248-255.
82. WELCH, R. B., DUTTONHURT, L. D., & WARREN, D. H. (1986). Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294-300.
83. WELCH, R. B., & WARREN, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 3, 638-667.
84. WHIPPLE, G. M., SANFORD, E. C., & COLGROVE, F. W. (1899). Minor studies from the psychological laboratory of Clark University: On nearly simultaneous clicks and flashes. The time required for recognition: Notes on mental standards of length. American Journal of Psychology, 10, 280-295.
85. WIDMANN, A., SCHARF, B., & SCHRÖDER, E. (2000). Frequency and location discrimination: Which is faster? In A. Schick, M. Meis, & C. Reckhardt (Eds.), Contributions to Psychological Acoustics: Results of the Eighth Oldenburg Symposium on Psychological Acoustics (pp. 373-380). Oldenburg: Bibliotheks- und Informationssystem der Universität Oldenburg.
86. YAMAMOTO, S., & KITAZAWA, S. (2001a). Reversal of subjective temporal order due to arm crossing. Nature Neuroscience, 4, 759-765.
87. YAMAMOTO, S., & KITAZAWA, S. (2001b). Sensation at the tips of invisible tools. Nature Neuroscience, 4, 979-980.
88. ZAMPINI, M., GUEST, S., SHORE, D. I., & SPENCE, C. (2003). Audiovisual synchrony judgments. Manuscript submitted for publication.