Preattentive binding of auditory and visual stimulus features

Journal of Cognitive Neuroscience

Volumn 17, Issue 2, 2005, Pages 320-339

  Winkler, István ^a,b,d   Czigler, István ^a   Sussman, Elyse ^c   Horváth, János ^a   Balázs, László ^a  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^b UNIVERSITY OF HELSINKI   (Finland)

^c ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^d INSTITUTE FOR PSYCHOLOGY   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDITORY DISCRIMINATION; AUDITORY MEMORY; AUDITORY STIMULATION; COGNITION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MISMATCH NEGATIVITY; PERCEPTION; PRIORITY JOURNAL; PSYCHOMOTOR PERFORMANCE; VISUAL DISCRIMINATION; VISUAL MEMORY; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ATTENTION; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MEMORY; PHOTIC STIMULATION; REACTION TIME; SPEECH PERCEPTION;

EID: 13244284750     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/0898929053124866     Document Type: Article

References (75)

1. Alho, K., Woods, D. L., Algazi, A., & Näätänen, R. (1992). Intermodal selective attention: II. Effects of attentional load on processing of auditory and visual stimuli in central space. Electroencephalography and Clinical Neurophysiology, 82, 356-368.
2. Awh, E., Dhaliwal, H., Christensen, S., & Matsukura, M. (2001). Evidence for two components of object-based selection. Psychological Science, 12, 329-334.
3. Berti, S., & Schröger, E. (2004). Distraction effects in vision: Behavioral and event-related potential indices. NeuroReport, 15, 665-669.
4. Berti, S., Schroger, E., Cowan, N., & Winkler, I. (2000). Attention and auditory sensory memory. In: C. Esceara, M. Tervaniemi, & E. Barcelona Yago (Eds.), Abstract book of the second international congress on mismatch negativity and its clinical applications (p. 67). Les Franqueses del Vallès: Grafiques Alle.
5. Bregman, A. S. (1978). Auditory streaming is cumulative. Journal of Experimental Psychology: Human Perception and Performance, 4, 380-387.
6. Chun, M. M., & Potter, M. C. (1995). A two-stage model for multiple target detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance, 21, 109-127.
7. Coltheart, M. (1980). Iconic memory and visible persistence. Perception and Psychophysics, 27, 183-228.
8. Coltheart, V. (1999). Introduction: Perceiving and remembering brief visual stimuli. In: V. Coltheart (Ed.), Fleeting memories (pp. 1-12). Cambridge: MIT Press.
9. Cutting, J. (1976). Auditory and linguistic processes in speech perception: Inferences from six fusions in dichotic listening. Psychological Review, 83, 114-140.
10. Czigler, I., Balázs, L., & Winkler, I. (2002). Memory-based detection of task-irrelevant visual changes. Psychophysiology, 39, 869-873.
11. Czigler, I., & Csibra, G. (1992). Event-related potentials and the identification of deviant stimuli. Psychophysiology, 33, 195-206.
12. DeSchepper, B., & Treisman, A. (1996). Visual memory for novel shapes: Implicit coding without attention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 27-42.
13. Deutsch, D. (1975). Two-channel listening to musical scales. Journal of the Acoustical Society of America, 57, 1156-1160.
14. Duncan, J. (1984). Selective attention and the organization of visual information. Journal of Experimental Psychology: General, 113, 501-517.
15. Duncan, J., & Humphreys, G. (1989). Visual search and stimulus similarity. Psychological Review, 96, 433-458.
16. Duncan, J., Martens, S., & Ward, R. (1997). Restricted attentional capacity within but not between sensory modalities. Nature, 387, 808-810.
17. Edgington, E. S. (1980). Randomization tests. New York: Dekker.
18. Effron, R., & Yund, E. W. (1974). Dichotic competition of simultaneous tone bursts of different frequency: I. Dissociation of pitch from lateralization and loudness. Neuropsychologia, 12, 149-156.
19. Engel, A. K., König, P., Kreiter, A. K., Schillen, T. B., & Singer, W. (1992). Temporal coding in the visual cortex: New vistas on integration in the nervous system. Trends in Neurosciences, 15, 218-226.
20. Giard, M. H., Lavikainen, J., Reinikainen, K., Bertrand, O., Pernier, J., & Näätänen, R. (1995). Separate representation of stimulus frequency, intensity, and duration in auditory sensory memory: An event-related potential and dipole-model study. Journal of Cognitive Neuroscience, 7, 133-143.
21. Gomes, H., Bernstein, R., Ritter, W., Vaughan, H. G., Jr., & Miller, J. (1997). Storage of feature conjunctions in transient auditory memory. Psychophysiology, 34, 712-716.
22. Hall, M. D., Pastore, R. E., Acker, B. E., & Huang, W. (2000). Evidence for auditory feature integration with spatially distributed items. Perception and Psychophysics, 62, 1243-1257.
23. Heslenfeld, D. J. (2003). Visual mismatch negativity. In: J. Polich (Ed.), Detection of change: Event-related potential and fMRI findings (pp. 41-60). Boston: Kluwer Academic Publishing.
24. Houck, M. R., & Hoffman, J. E. (1986). Conjunction of color and form without attention: Evidence from an orientation-contingent color aftereffect. Journal of Experimental Psychology: Human Perception and Performance, 12, 186-199.
25. Humphrey, G. K., James, T. W., Gati, J. S., Menon, R. S., & Goodale, A. (1999). Perception of the McCollough effect correlates with activity in extrastriate cortex: A functional magnetic resonance imaging study. Psychological Science, 10, 444-448.
26. Jeffreys, D. A., & Axford, J. G. (1972). Source location of pattern-specific components of human visual evoked potentials: II. Components of extrastriate cortical origin. Experimental Brain Research, 16, 22-40.
27. Kenemans, J. L., Jonh, T. G., & Verbaten, M. N. (2003). Detection of visual change: Mismatch ore rareness? NeuroReport, 14, 1239-1242.
28. Kenemans, J. L., Kok, A., & Smulders, F. T .Y. (1993). Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirement. Electroencephalography and Clinical Neurophysiology, 88, 51-63.
29. Mack, A., & Rock, I. (1998). Inattentional blindness. Cambridge: MIT Press.
30. Marr, D. (1982). Vision. New York: Freeman.
31. McCollough, C. (1965). Color adaptation of edge-detectors in the human visual system. Science, 149, 1115-1116.
32. Murch, G. M. (1972). Binocular relationships in a size and orientation specific aftereffect. Journal of Experimental Psychology, 93, 30-34.
33. Näätänen, R., Paavilainen, P., Tiitinen, H., Jiang, D., & Alho, K. (1993). Attention and mismatch negativity. Psychophysiology, 30, 436-450.
34. Näätänen, R., & Picton, T. W. (1987). The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology, 24, 375-425.
35. Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). "Primitive intelligence" in the auditory cortex. Trends in Neurosciences, 24, 283-288.
36. Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 125, 826-859.
37. Paavilainen, P., Simola, J., Jaramillo, M., Näätänen, R., & Winkler, I. (2001). Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). Psychophysiology, 38, 359-365.
38. Pantev, C., Hoke, M., Lehnertz, K., & Lütkenhöner, B. (1989). Neuromagnetic evidence of an ampliotopic organization of the human auditory cortex. Electroencephalography and Clinical Neurophysiology, 72, 225-231.
39. Pantev, C., Hoke, M., Lehnertz, K., Lütkenhöner, B., Anogianakis, G., & Wittkowski, W. (1988). Tonotopic organization of the human auditory cortex revealed by transient auditory evoked magnetic fields. Electroencephalography and Clinical Neurophysiology, 69, 160-170.
40. Pashler, H. E. (1998). The psychology of attention. Cambridge: MIT Press.
41. Pazo-Alvarez, A., Cadaveira, F., & Amenedo, E. (2003). MMN in the visual modality: A review. Biological Psychology, 63, 199-236.
42. Picton, D. W., Alain, C., Otten, L., & Ritter, W. (2000). Mismatch negativity: Different water in the same river. Audiology and Neuro-Otology, 5, 111-139.
43. Potter, M. C., Stiefbold, D., & Moryadas, A. (1998). Word selection in reading sentences: Preceding versus following contexts. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 68-100.
44. Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.
45. Rafal, R. (1996). Visual attention: Converging operations from neurology and psychology. In: A. F. Kramer, M. G. H. Coles, & G. D. Logan (Eds.), Converging operations in the study of visual selective attention (pp. 139-192). Washington, DC: American Psychological Association.
46. Rensink, R. A., O'Regan, J. K., & Clark, J. J. (1997). To see and not to see: The need for attention to perceive changes in scenes. Psychological Science, 8, 368-373.
47. Ritter, W., Deacon, D., Gomes, H., Javitt, D. C., & Vaughan, H. G., Jr. (1995). The mismatch negativity of event-related potentials as a probe of transient auditory memory: A review. Ear and Hearing, 16, 52-67.
48. Scholl, B. J. (2001). Objects and attention: The state of the art. Cognition, 80, 1-46.
49. Schröger, E., Rauh, R., & Schubö, W. (1993). Probability distribution of Minkowski distance between discrete random variables. Educational and Psychological Measurement, 53, 379-398.
50. Stagg, C., Hindley, P., Tales, A., & Butler, S. (2004). Visual mismatch negativity: The detection of stimulus change. NeuroReport, 15, 659-663.
51. Stromeyer, C. F. (1978). Form-color aftereffects in human vision. In R. Held, H. W. Leibowitz, & H.-L. Teuber (Eds.), Perception: Handbook of sensory physiology (vol. 8, pp. 97-142). New York: Springer-Verlag.
52. Sussman, E., Gomes, H., Nousak, J. M., Ritter, W., & Vaughan, H. G., Jr. (1998). Feature conjunctions and auditory sensory memory. Brain Research, 793, 95-102.
53. Sussman, E., Winkler, I., Huotilainen, M., Ritter, W., & Näätänen, R. (2002). Top-down effects on stimulus-driven auditory organization. Cognitive Brain Research, 13, 393-405.
54. Sussman, E., Winkler, I., Kreuzer, J., Saher, M., Näätä nen, R., & Ritter, W. (2002). Temporal integration: intentional sound discrimination does not modulate stimulus-driven processes in auditory event synthesis. Clinical Neurophysiology, 113, 1909-1920.
55. Sussman, E., Winkler, I., & Wang, W. J. (2003). MMN and attention: Competition for deviance detection. Psychophysiology, 40, 430-435.
56. Takegata, R., Huotilainen, M., Rinne, T., Winkler, I., & Näätänen, R. (2001). Changes in acoustic features and their conjunctions are processed by separate neuronal populations. NeuroReport, 12, 525-529.
57. Takegata, R., Paavilainen, P., Näätänen, R., & Winkler, I. (1999). Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity. Neuroscience Letters, 266, 109-112.
58. Takegata, R., Paavilainen, P., Näätänen, R., & Winkler, I. (2001). Preattentive processing of spectral, temporal, and structural characteristics of acoustic regularities: A mismatch negativity study. Psychophysiology, 38, 92-98.
59. Tales, A., Newton, P., Troscianko, T., & Butler, S. (1999). Mismatch negativity in the visual modality. NeuroReport, 10, 3363-3367.
60. Thompson, W. F., Hall, M. D., & Pressing, J. (2001). Illusory conjunctions of pitch and duration in unfamiliar tone sequences. Journal of Experimental Psychology: Human Perception and Performance, 27, 128-140.
61. Tiitinen, H., Sinkkonen, J., May, P., & Näätänen, R. (1994). The auditory transient 40-Hz response is insensitive to changes in stimulus features. NeuroReport, 6, 190-192.
62. Treisman, A. (1993). The perception of features and objects. In A. Baddeley & L. Weiskrantz (Eds.), Attention: Selection, awareness, and control. A tribute to Donald Broadbent (pp. 5-35). Oxford: Clarendon Press.
63. Treisman, A. (1998). Feature binding, attention and object perception. Philosophical Transactions of the Royal Society of London. Series B. Biological Sciences, 353, 1295-1306.
64. Treisman, A. M., & Gelade, G. A. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97-136.
65. Treisman, A. M., & Schmidt, H. (1992). Illusory conjunctions in the perception of objects. Cognitive Psychology, 14, 107-141.
66. Vogel, E. K., Luck, S. J., & Shapiro, K. L. (1998). Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink. Journal of Experimental Pyschology: Human Perception and Performance, 24, 1656-1674.
67. Widmann, A., & Schröger, E. (1999). Bootstrapping the distribution of the city-block distance between two repeated measures. Available at: http://www.uni-leipzig.de/~biopsych/widmann/minkowski.html.
68. Winkler, I., Sussman, E., Tervaniemi, M., Ritter, W., Horváth J., & Näätänen, R. (2003). Pre-attentive auditory context effects. Cognitive, Affective, and Behavioral Neuroscience, 3, 57-77.
69. Woldorff, M. G., Hackley, S. A., & Hillyard, S. A. (1991). The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones. Psychophysiology, 28, 30-42.
70. Wolfe, J. M. (1994). Guided search 2.0: A revised model of visual search. Psychonomic Bulletin and Review, 1, 202-238.
71. Wolfe, J. M. (1999). Inattentional amnesia. In: V. Coltheart (Ed.), Fleeting memories (pp. 71-94). Cambridge: MIT Press.
72. Wolfe, J. M., Cave, K. R., & Franzel, S. L. (1989). Guided search: An alternative to feature integration model for visual search. Journal of Experimental Psychology: Human Perception and Performance, 15, 419-433.
73. Woods, D. L., Alain, C., & Ogawa, K. H. (1998). Conjoining auditory and visual features during high-rate serial presentation: Processing and conjoining two features can be faster that processing one. Perception and Psychophysics, 60, 239-249.
74. Woods, D. L., Alho, K., & Algazi, A. (1992). Intermodal selective attention: I. Effects of event-related potentials to lateralized auditory and visual stimuli. Electroencephalography and Clinical Neurophysiology, 82, 341-355.
75. Wyers, A. A., Mulder, G., Okita, T., & Mulder, L. J. M. (1989). Event-related potentials during memory search and selective attention to letter size and conjunction of letter size and color. Psychophysiology, 26, 529-547.