Human visual system automatically encodes sequential regularities of discrete events

Journal of Cognitive Neuroscience

Volumn 22, Issue 6, 2010, Pages 1124-1139

  Kimura, Motohiro ^a,b,c   Schröger, Erich ^c   Czigler, István ^d   Ohira, Hideki ^a  

^a NAGOYA UNIVERSITY   (Japan)

^b JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

^c UNIVERSITY OF LEIPZIG   (Germany)

^d INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; CORRELATION ANALYSIS; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MEMORY; MISMATCH NEGATIVITY; PRIORITY JOURNAL; SEQUENCE ANALYSIS; STIMULUS RESPONSE; VISUAL SYSTEM;

ADULT; ANALYSIS OF VARIANCE; ATTENTION; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; MEMORY; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SERIAL LEARNING; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL CORTEX; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 77952053205     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2009.21299     Document Type: Article

References (101)

1. Alain, C., Woods, D. L., & Ogawa, K. H. (1994). Brain indices of automatic pattern processing. NeuroReport, 6, 140-144.
2. Alho, K., Woods, D. L., Algazi, A., & Näätänen, R. (1992). Intermodal selective attention: II. Effects of attentional load on processing of auditory and visual stimuli in central space. Electroencephalography and Clinical Neurophysiology, 82, 356-368.
3. Amenedo, E., Pazo-Alvarez, P., & Cadaveira, F. (2007). Vertical asymmetries in pre-attentive detection of changes in motion direction. International Journal of Psychophysiology, 64, 184-189. (Pubitemid 46654379)
4. Astikainen, P., Lillstrang, E., & Ruusuvirta, T. (2008). Visual mismatch negativity for changes in orientation - A sensory memory-dependent response. European Journal of Neuroscience, 28, 2319-2324.
5. Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control process. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory ( Vol. 2, pp. 89-195). New York: Academic Press.
6. Bar, M. (2007). The proactive brain: Using analogies and associations to generate predictions. Trends in Cognitive Neurosciences, 11, 280-289.
7. Bendixen, A., Prinz, W., Horváth, J., Trujillo-Barreto, N. J., & Schröger, E. (2008). Rapid extraction of auditory feature contingencies. Neuroimage, 41, 1111-1119.
8. Berti, S., & Schröger, E. (2001). A comparison of auditory and visual distraction effects: Behavioral and event-related indices. Cognitive Brain Research, 10, 265-273. (Pubitemid 32146583)
9. Berti, S., & Schröger, E. (2004). Distraction effects in vision: Behavioral and event-related potential indices. NeuroReport, 15, 665-669. (Pubitemid 38457157)
10. Berti, S., & Schröger, E. (2006). Visual distraction: A behavioral and event-related brain potential study in humans. NeuroReport, 17, 151-155. (Pubitemid 43100318)
11. Bubic, A., von Cramon, D. Y., Jacobsen, T., Schröger, E., & Schubotz, R. I. (2008). Violation of expectation: Neural correlates reflect bases of prediction. Journal of Cognitive Neuroscience, 21, 1-14.
12. Canfield, R. L., & Haith, M. M. (1991). Young infants' visual expectations for symmetric and asymmetric stimulus sequence. Developmental Psychology, 27, 198-208.
13. Cohen, A., Ivry, R. I., & Keele, S. W. (1990). Attention and structure in sequential learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 17-30.
14. Czigler, I. (2007). Visual mismatch negativity: Violation of nonattended environmental regularities. Journal of Psychophysiology, 21, 224-230.
15. Czigler, I., Balázs, L., & Pató, L. (2004). Visual change detection: Event-related brain potentials are dependent on stimulus location in humans. Neuroscience Letters, 364, 149-153. (Pubitemid 38757922)
16. Czigler, I., Balázs, L., & Winkler, I. (2002). Memory-based detection of task-irrelevant visual changes. Psychophysiology, 39, 869-873. (Pubitemid 36025329)
17. Czigler, I., Weisz, J., & Winkler, I. (2006). ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli. Neuroscience Letters, 401, 178-182. (Pubitemid 44269288)
18. Czigler, I., Weisz, J., & Winkler, I. (2007). Backward masking and visual mismatch negativity: Electrophysiological evidence for memory-based detection of deviant stimuli. Psychophysiology, 44, 610-619. (Pubitemid 46905327)
19. Czigler, I., Winkler, I., Pató, L., Várnagy, A., Weisz, J., & Balázs, L. (2006). Visual temporal window of integration as revealed by the visual mismatch negativity event-related potential to stimulus omissions. Brain Research, 1104, 129-140. (Pubitemid 44148517)
20. Denham, S. L., & Winkler, I. (2006). The role of predictive models in the formation of auditory streams. Journal of Physiology (Paris), 100, 154-170.
21. Deouell, L. Y. (2007). The frontal generator of the mismatch negativity revisited. Journal of Psychophysiology, 21, 188-203.
22. Duncan-Johnson, C. C., Roth, W. T., & Kopell, B. S. (1984). Effects of stimulus sequence on P300 and reaction time in schizophrenics: A preliminary report. Annals of the New York Academy of Sciences, 425, 570-577.
23. Eimer, M., Goschke, T., Schlaghecken, F., & Stürmer, B. (1996). Explicit and implicit learning of event sequences: Evidence from event-related brain potentials. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 970-987. (Pubitemid 126491341)
24. Ferdinand, N. K., Mecklinger, A., & Kray, J. (2008). Error and deviance processing in implicit and explicit sequence learning. Journal of Cognitive Neuroscience, 20, 629-642. (Pubitemid 351480955)
25. Fonteneau, E., & Davidoff, J. (2007). Neural correlates of colour categories. NeuroReport, 18, 1323-1327.
26. Ford, J. M., Duncan-Johnson, C. C., Pfefferbaum, A., & Kopell, B. S. (1982). Expectancy for events in old age: Stimulus sequence effects on P300 and reaction time. Journal of Gerontology, 37, 696-704. (Pubitemid 13250467)
27. Friston, K. (2005). A theory of cortical response. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 360, 815-836.
28. Fu, S., Fan, S., & Chen, L. (2003). Event-related potentials reveal involuntary processing of orientation changes in the visual modality. Psychophysiology, 40, 770-775. (Pubitemid 37128040)
29. Grill-Spector, K., Henson, R., & Martin, A. (2006). Repetition and the brain: Neural models of stimulus-specific effects. Trends in Neurosciences, 10, 14-23. (Pubitemid 43049768)
30. Haber, R. N. (1983). The impending demise of the icon: A critique of the concept of iconic storage in visual information processing. Behavioral and Brain Sciences, 6, 1-54.
31. Haith, M. M., & McCarty (1990). Stability of visual expectancy at 3.0 months of age. Developmental Psychology, 26, 68-74.
32. Heslenfeld, D. J. (2003). Visual mismatch negativity. In J. Polich (Ed.), Detection of change: Event-related potential and fMRI findings (pp. 41-60). Boston: Kluwer Academic Publishing.
33. Horváth, J., Czigler, I., Jacobsen, T., Maess, B., Schröger, E., & Winkler, I. (2008). MMN or no MMN: No magnitude of deviance effect on the MMN amplitude. Psychophysiology, 45, 60-69.
34. Horváth, J., & Winkler, I. (2004). How the human auditory system treats repetition amongst change. Neuroscience Letters, 368, 157-161. (Pubitemid 39194863)
35. Huettel, S. A., Mack, P. B., & McCarthy, G. (2002). Perceiving patterns in random series: Dynamic processing of sequence in prefrontal cortex. Nature Neuroscience, 5, 485-490.
36. Jääskeläinen, I. P., Ahveninen, J., Bonmassar, G., Dale, A. M., Ilmoniemi, R. J., Levänen, S., et al. (2004). Human posterior auditory cortex gates novel sounds to consciousness. Proceedings of the National Academy of Sciences, U.S.A., 101, 6809-6814.
37. Jacobsen, T., Horenkamp, T., & Schröger, E. (2003). Preattentive memory-based comparison of sound intensity. Audiology & Neuro-Otology, 8, 338-346. (Pubitemid 37323442)
38. Jacobsen, T., & Schröger, E. (2001). Is there pre-attentive memory-based comparison of pitch? Psychophysiology, 38, 723-727.
39. Jacobsen, T., & Schröger, E. (2003). Measuring duration mismatch negativity. Clinical Neurophysiology, 114, 1133-1143.
40. Jacobsen, T., Schröger, E., Horenkamp, T., & Winkler, I. (2003). Mismatch negativity to pitch change: Varied stimulus proportions in controlling effects of neural refractoriness on human auditory event-related brain potentials. Neuroscience Letters, 344, 79-82.
41. Jentzsch, I., & Sommer, W. (2001). Sequence-sensitive subcomponents of P300: Topographical analyses and dipole source localization. Psychophysiology, 38, 607-621.
42. Kaukoranta, E., Sams, M., Hari, R., Hämäläinen, M., & Näätänen, R. (1989). Reactions of human auditory cortex to a change in tone duration. Hearing Research, 41, 15-22.
43. Kenemans, J. L., Jong, T. G., & Verbaten, M. N. (2003). Detection of visual change: Mismatch or rareness? NeuroReport, 14, 1239-1242.
44. Kimura, M., Katayama, J., & Murohashi, H. (2005a). Neural correlates of preattentive and attentive processing of visual changes. NeuroReport, 16, 2061-2064.
45. Kimura, M., Katayama, J., & Murohashi, H. (2005b). Positive difference in ERPs reflects independent processing of visual changes. Psychophysiology, 42, 369-379.
46. Kimura, M., Katayama, J., & Murohashi, H. (2006a). An ERP study of visual change detection: Effects of magnitude of spatial frequency changes on the change-related posterior positivity. International Journal of Psychophysiology, 62, 14-23.
47. Kimura, M., Katayama, J., & Murohashi, H. (2006b). Independent processing of visual stimulus change in ventral and dorsal stream features indexed by an early positive difference in event-related brain potentials. International Journal of Psychophysiology, 59, 141-150.
48. Kimura, M., Katayama, J., & Murohashi, H. (2006c). Probability-independent and -dependent ERPs reflecting visual change detection. Psychophysiology, 43, 180-189.
49. Kimura, M., Katayama, J., & Murohashi, H. (2008a). Attention switching function of memory-comparison-based change detection system in the visual modality. International Journal of Psychophysiology, 67, 101-113.
50. Kimura, M., Katayama, J., & Murohashi, H. (2008b). Effects of feature and spatial attention on visual change detection. NeuroReport, 19, 389-392.
51. Kimura, M., Katayama, J., & Murohashi, H. (2008c). Involvement of memory-comparison-based change detection in visual distraction. Psychophysiology, 45, 445-457.
52. Kimura, M., Katayama, J., & Murohashi, H. (2008d). Underlying mechanisms of P3a-task-difficulty effect. Psychophysiology, 45, 731-741.
53. Kimura, M., Katayama, J., Ohira, H., & Schröger, E. (2009). Visual mismatch negativity: New evidence from the equiprobable paradigm. Psychophysiology, 46, 402-409.
54. Maess, B., Jacobsen, T., Schröger, E., & Friederici, A. D. (2007). Localizing pre-attentive auditory memory-based comparison: Magnetic mismatch negativity to pitch change. Neuroimage, 37, 561-571.
55. Mayr, U. (1996). Spatial attention and implicit sequence learning: Evidence for independent learning of spatial and nonspatial sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 350-364.
56. Mazza, V., Turatto, M., & Sarlo, M. (2005). Rare stimuli or rare changes: What really matters for the brain? NeuroReport, 16, 1061-1064.
57. McCarthy, G., & Wood, C. C. (1985). Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models. Electroencephalography and Clinical Neurophysiology, 62, 203-208.
58. Müller, D., Widmann, A., & Schröger, E. (2005). Deviance-repetition effects as a function of stimulus feature, feature value variation, and timing: A mismatch negativity study. Biological Psychology, 68, 1-14.
59. Näätänen, R. (1990). The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function. Behavioral and Brain Sciences, 13, 201-288.
60. Näätänen, R. (1992). Attention and brain function. Hillsdale, NJ: Erlbaum.
61. Näätänen, R., & Alho, K. (1997). Higher-order processes in auditory change detection. Trends in Cognitive Sciences, 2, 44-45.
62. Näätänen, R., Gaillard, A. W. K., & Mantysalo, S. (1978). Early selective-attention effect on evoked potential reinterpreted. Acta Psychologica, 42, 313-329.
63. Näätänen, R., Jacobsen, T., & Winkler, I. (2005). Memory-based or afferent processes in mismatch negativity (MMN): A review of the evidence. Psychophysiology, 42, 25-32.
64. Näätänen, R., Paavilainen, P., Alho, K., Reinikainen, K., & Sams, M. (1989). Do event-related potentials reveal the mechanism of the auditory sensory memory in the human brain? Neuroscience Letters, 98, 217-221.
65. Näätänen, R., Paavilainen, P., & Reinikainen, K. (1989). Do event-related potentials to infrequent decrements in duration of auditory stimuli demonstrate a memory trace in man? Neuroscience Letters, 107, 347-352.
66. Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007). The mismatch negativity (MMN) in basic research of central auditory processing: A review. Clinical Neurophysiology, 118, 2544-2590.
67. Näätänen, R., & Rinne, T. (2002). Electric brain response to sound repetition in humans: An index of long-term-memory-trace formation? Neuroscience Letters, 318, 49-51.
68. Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). "Primitive intelligence" in the auditory cortex. Trends in Neurosciences, 24, 283-288.
69. Nissen, M. J., & Bullemer, P. (1987). Attentional requirements of learning: Evidence from performance measures. Cognitive Psychology, 19, 1-32.
70. Nordby, H., Roth, W. T., & Pfefferbaum, A. (1988). Event-related potentials to breaks in sequences of alternating pitches or interstimulus intervals. Psychophysiology, 25, 262-268.
71. Nousak, J. M. K., Deacon, D., Ritter, W., & Vaughan, H. G. J. (1996). Storage of information in transient auditory memory. Cognitive Brain Research, 4, 305-317.
72. Opitz, B., Schröger, E., & von Cramon, Y. (2005). Sensory and cognitive mechanisms for preattentive change detection in auditory cortex. European Journal of Neuroscience, 21, 531-535.
73. O'Regan, J. K., & Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24, 939-1031.
74. Paavilainen, P., Karlsson, M. L., Reinikainen, K., & Näätänen, R. (1989). Mismatch negativity to change in spatial location of an auditory stimulus. Electroencephalography and Clinical Neurophysiology, 73, 129-141.
75. Paavilainen, P., Saarinen, J., Tervaniemi, M., & Näätä nen, R. (1995). Mismatch negativity to changes in abstract sound features during dichotic listening. Journal of Psychophysiology, 9, 243-249.
76. Pazo-Alvarez, P., Amenedo, E., & Cadaveira, F. (2004). Automatic detection of motion direction changes in the human brain. European Journal of Neuroscience, 19, 1978-1986. (Pubitemid 38482586)
77. Pazo-Alvarez, P., Amenedo, E., Lorenzo-López, P., & Cadaveira, F. (2004). Effects of stimulus location on automatic detection of changes in motion direction in human brain. Neuroscience Letters, 371, 111-116.
78. Pazo-Alvarez, P., Cadaveira, F., & Amenedo, E. (2003). MMN in the visual modality: A review. Biological Psychology, 63, 199-236.
79. Rüsseler, J., Hennighausen, E., Münte, T. F., & Rösler, F. (2003). Differences in incidental and intentional learning of sensorimotor sequences as revealed by event-related brain potentials. Cognitive Brain Research, 15, 116-126.
80. Saarinen, J., Paavilainen, P., Schröger, E., Tervaniemi, M., & Näätänen, R. (1992). Representation of abstract attributes of auditory stimuli in the human brain. NeuroReport, 3, 1149-1151.
81. Sams, M., Alho, K., & Näätänen, R. (1984). Short-term habituation and dishabituation of the mismatch negativity of the ERP. Psychophysiology, 21, 434-441.
82. Schröger, E. (1997). Higher-order processes in auditory change detection: Response from Schröger. Trends in Cognitive Sciences, 2, 45-46.
83. Schröger, E. (2007). Mismatch negativity: A microphone into auditory memory. Journal of Psychophysiology, 21, 138-146.
84. Schröger, E., & Wolff, C. (1996). Mismatch response of the human brain to changes in sound location. NeuroReport, 7, 3005-3008.
85. Schröger, E., & Wolff, C. (1998). Behavioral and electrophysiological effects of task-irrelevant sound change: A new distraction paradigm. Cognitive Brain Research, 7, 71-87.
86. Schubotz, R. I. (2007). Prediction of external events with our motor system: Towards a new framework. Trends in Cognitive Sciences, 11, 211-218.
87. Schubotz, R. I., & von Cramon, D. Y. (2002). Predicting perceptual events activates corresponding motor schemes in lateral premotor cortex: An fMRI study. Neuroimage, 15, 787-796.
88. Sokolov, E. N. (1963). Perception and the conditioned reflex. Oxford: Pergamon Press.
89. Squires, K. C., Wickens, C. D., Squires, N. K., & Donchin, E. (1976). The effect of stimulus sequence on the waveform of the cortical event-related potential. Science, 193, 1142-1146.
90. Stagg, C., Hindley, P., Tales, A., & Butler, S. (2004). Visual mismatch negativity: The detection of stimulus change. NeuroReport, 15, 659-663.
91. Sussman, E. (2007). A new view on the MMN and attention debate. Journal of Psychophysiology, 21, 164-175.
92. Tales, A., Newton, P., Troscianko, T., & Butler, S. (1999). Mismatch negativity in the visual modality. NeuroReport, 10, 3363-3367.
93. Turner, D. C., Aitken, M. R. F., Shanks, D. R., Sahakian, B. J., Robbins, T. W., Schwarzbauer, C., et al. (2004). The role of the lateral frontal cortex in causal associative learning: Exploring preventative and super-learning. Cerebral Cortex, 14, 872-880.
94. Wang, Y., Tian, S., Wang, H., Cui, L., Zhang, Y., & Zhang, X. (2003). Event-related potentials evoked by multi-feature conflict under different attentive conditions. Experimental Brain Research, 148, 451-457.
95. Winkler, I. (2007). Interpreting the mismatch negativity. Journal of Psychophysiology, 21, 147-163.
96. Winkler, I., Czigler, I., Sussman, E., Horváth, J., & Balázs, L. (2005). Preattentive binding of auditory and visual stimulus features. Journal of Cognitive Neuroscience, 17, 320-339.
97. Woldorff, M. G., Hackley, S. A., & Hillyard, S. A. (1991). The effects of channel-selective attention on the mismatch negativity wave elicited by deviant tones. Psychophysiology, 28, 30-42.
98. Wolff, C., & Schröger, E. (2001). Activation of the auditory pre-attentive change detection system by tone repetitions with fast stimulation rate. Cognitive Brain Research, 10, 323-327.
99. Yabe, H., Tervaniemi, M., Reinikainen, K., & Näätänen, R. (1997). Temporal window of integration revealed by MMN to sound omission. NeuroReport, 8, 1971-1974.
100. Yabe, H., Tervaniemi, M., Sinkkonen, J., Huotilainen, M., Ilmoniemi, R., & Näätänen, R. (1998). Temporal window of integration of auditory information in the human brain. Psychophysiology, 35, 615-619.
101. Yucel, G., McCarthy, G., & Belger, A. (2007). fMRI reveals that involuntary visual deviance processing is resource limited. Neuroimage, 34, 1245-1252. (Pubitemid 46394459)