Predictive regularity representations in violation detection and auditory stream segregation: From conceptual to computational models

Brain Topography

Volumn 27, Issue 4, 2014, Pages 565-577

  Schröger, Erich ^a   Bendixen, Alexandra ^a,b   Denham, Susan L ^c   Mill, Robert W ^d   Bőhm, Tamás M ^e   Winkler, István ^e,f  

^a UNIVERSITY OF LEIPZIG   (Germany)

^b UNIVERSITY OF OLDENBURG   (Germany)

^c UNIVERSITY OF PLYMOUTH   (United Kingdom)

^d MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

^e INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^f UNIVERSITY OF SZEGED   (Hungary)

Author keywords

Auditory object; Auditory scene analysis; Deviance detection; Mismatch negativity (MMN); Predictive modelling

Indexed keywords

AUDITORY EVENT REPRESENTATION SYSTEM; AUDITORY SYSTEM; CHAINS MODEL; COMPETITION; CONCEPTUAL FRAMEWORK; HUMAN; MATHEMATICAL MODEL; MISMATCH NEGATIVITY; PERCEPTION; PREDICTIVE VALUE; PRIORITY JOURNAL; PSYCHOLOGICAL ASPECT; REVIEW; SOUND; BIOLOGICAL MODEL; BRAIN; COMPUTER SIMULATION; EVOKED AUDITORY RESPONSE; HEARING; PHYSIOLOGY;

AUDITORY PERCEPTION; BRAIN; COMPUTER SIMULATION; EVOKED POTENTIALS, AUDITORY; HUMANS; MODELS, NEUROLOGICAL;

EID: 84904746454     PISSN: 08960267     EISSN: 15736792     Source Type: Journal    
DOI: 10.1007/s10548-013-0334-6     Document Type: Review

References (76)

1. Althen H, Grimm S, Escera C (2013) Simple and complex acoustic regularities are encoded at different levels of the auditory hierarchy. Eur J Neurosci 38(10):3448-3455
2. Baldeweg T (2007) ERP repetition effects and mismatch negativity generation - A predictive coding perspective. J Psychophysiol 21(3-4):204-213
3. Beauvois MW, Meddis R (1991) A computer-model of auditory stream segregation. Q J Exp Psychol Sect A 43(3):517-541
4. Bendixen A, Roeber U, Schröger E (2007) Regularity extraction and application in dynamic auditory stimulus sequences. J Cogn Neurosci 19(10):1664-1677 (Pubitemid 47547869)
5. Bendixen A, Prinz WG, Horváth J, Trujillo-Barreto NJ, Schröger E (2008) Rapid extraction of auditory feature contingencies. Neuroimage 41(3):1111-1119
6. Bendixen A, Schröger E, Winkler I (2009) I heard that coming: event-related potential evidence for stimulus-driven prediction in the auditory system. J Neurosci 29(26):8447-8451
7. Bendixen A, Denham SL, Gyimesi K, Winkler I (2010) Regular patterns stabilize auditory streams. J Acoust Soc Am 128(6):3658-3666
8. Bendixen A, SanMiguel I, Schröger E (2012a) Early electrophysiological indicators for predictive processing in audition: a review. Int J Psychophysiol 83(2):120-131
9. Bendixen A, Schröger E, Ritter W, Winkler I (2012b) Regularity extraction from non-adjacent sounds. Frontiers Psychol 3:143
10. Bendixen A, Bohm TM, Szalárdy O, Mill R, Denham SL, Winkler I (2013) Different roles of similarity and predictability in auditory stream segregation. Learn Percept 5:37-54
11. Boh B, Herholz SC, Lappe C, Pantev C (2011) Processing of complex auditory patterns in musicians and nonmusicians. PLoS One 6(7):e21458
12. Bregman AS (1990) Auditory scene analysis. The perceptual organization of sound. MIT PressMA, Cambridge
13. Costa-Faidella J, Grimm S, Slabu L, Diaz-Santaella F, Escera C (2011) Multiple time scales of adaptation in the auditory system as revealed by human evoked potentials. Psychophysiology 48(6):774-783
14. Cowan N (1984) On short and long auditory stores. Psychol Bull 96(2):341-370
15. Cowan N, Winkler I, Teder W, Näätänen R (1993) Memory prerequisites of mismatch negativity in the auditory eventrelated potential (ERP). J Exp Psychol-Learn Mem Cogn 19(4):909-921
16. Deike S, Heil P, Böckmann-Barthel M, Brechmann A (2012) The build-up of auditory stream segregation: a different perspective. Frontiers Psychol 3:461
17. Denham SL, Gyimesi K, Stefanics G, Winkler I (2013) Perceptual bistability in auditory streaming: how much do stimulus features matter? Learn Percept 5(2):73-100
18. Elhilali M, Shamma SA (2008) A cocktail party with a cortical twist: how cortical mechanisms contribute to sound segregation. J Acoust Soc Am 124(6):3751-3771
19. Escera C, Leung S, Grimm S (2013) Deviance detection based on regularity encoding along the auditory hierarchy: electrophysiological evidence in humans. Brain Topogr. doi:10.1007/s10548-013-0328-4
20. Fowler CA, Rosenblum LD (1990) Duplex perception - a comparison of monosyllables and slamming doors. J Exp Psychol-Hum Percep Perform 16(4):742-754
21. Friston K, Kiebel S (2009a) Cortical circuits for perceptual inference. Neural Netw 22(8):1093-1104
22. Friston K, Kiebel S (2009b) Predictive coding under the free-energy principle. Philos Trans R Soc Lond B 364(1521):1211-1221
23. Garrido MI, Kilner JM, Stephan KE, Friston KJ (2009) The mismatch negativity: a review of underlying mechanisms. Clin Neurophysiol 120(3):453-463
24. Griffiths TD, Warren JD (2004) Opinion: what is an auditory object? Nat Review Neurosci 5:887-892
25. Grimm S, Escera C (2012) Auditory deviance detection revisited: evidence for a hierarchical novelty system. Int J Psychophysiol 85(1):88-92
26. Grossberg S, Govindarajan KK, Wyse LL, Cohen MA (2004) ARTSTREAM: a neural network model of auditory scene analysis and source segregation. Neural Netw 17(4):511-536 (Pubitemid 38510336)
27. Haenschel C, Vernon DJ, Dwivedi P, Gruzelier JH, Baldeweg T (2005) Event-related brain potential correlates of human auditory sensory memory-trace formation. J Neurosci 25(45):10494-10501 (Pubitemid 41628451)
28. Helmholtz Hv (1867) Handbuch der physiologischen Optik. Allgemeine Encyklopädie der Physik, vol Bd 9. Voss, Leipzig
29. Herrmann CS, Munk MHJ, Engel AK (2004) Cognitive functions of gamma-band activity: memory match and utilization. Trends Cogn Sci 8(8):347-355 (Pubitemid 39099460)
30. Horváth J, Czigler I, Sussman E, Winkler I (2001) Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain. Cogn Brain Res 12(1):131-144 (Pubitemid 32728288)
31. Horváth J, Winkler I, Bendixen A (2008) Do N1/MMN, P3a, and RON form a strongly coupled chain reflecting the three stages of auditory distraction? Biol Psychol 79(2):139-147
32. Jacobs AM, Grainger J (1994) Models of visual word recognition - sampling the state-of-the-art. J Exp Psychol-Hum Percep Perform 20(6):1311-1334
33. Jones MR (1976) Time, our lost dimension: toward a new theory of perception, attention, and memory. Psychol Rev 83(5):323-355
34. Kiebel SJ, von Kriegstein K, Daunizeau J, Friston KJ (2009) Recognizing sequences of sequences. PLoS Comput Biol 5(8):e1000464
35. Köhler W (1947) Gestalt psychology: an introduction to new concepts in modern psychology. Liveright Publishing, New York
36. Kubovy M, Van Valkenburg D (2001) Auditory and visual objects. Cognition 80:97-126 (Pubitemid 32178141)
37. Lieder F, Daunizeau J, Garrido MI, Friston KJ, Stephan KE (2013) Modelling trial-by-trial changes in the mismatch negativity. PLoS Comput Biol 9(2):e1002911
38. Massaro DW (1972) Preperceptual images, processing time, and perceptual units in auditory perception. Psychol Rev 79:124-145
39. McCabe SL, Denham MJ (1997) A model of auditory streaming. J Acoust Soc Am 101(3):1611-1621 (Pubitemid 27114265)
40. Mill R, Bohm T, Bendixen A, Winkler I, Denham SL CHAINS - Competition and cooperation between fragmentary event predictors in a model of auditory scene analysis. In: Information Sciences and Systems (CISS), 2011, IEEE 45th Annual Conference on, Baltimore, pp 1-6, 2011
41. Mill RW, Bohm TM, Bendixen A, Winkler I, Denham SL (2013) Modelling the emergence and dynamics of perceptual organisation in auditory streaming. PLoS Comput Biol 9(3):e1002925
42. Moore BCJ, Gockel H (2002) Factors influencing sequential stream segregation. Acta Acust United Acust 88(3):320-333 (Pubitemid 34732115)
43. Moore BCJ, Gockel HE (2012) Properties of auditory stream formation. Philos Trans Royal Soc B 367(1591):919-931
44. Müller D, Widmann A, Schröger E (2005) Deviance-repetition effects as a function of stimulus feature, feature value variation, and timing: a mismatch negativity study. Biol Psychol 68(1):1-14
45. Mumford D (1992) On the computational architecture of the neocortex II. The role of cortico-cortical loops. Biol Cybern 66(3):241-251
46. Näätänen R (1990) The Role of attention in auditory information-processing as revealed by event-related potentials and other brain measures of cognitive function. Behav Brain Sci 13(2):201-232
47. Näätänen R, Winkler I (1999) The concept of auditory stimulus representation in cognitive neuroscience. Psychol Bull 125(6):826-859
48. Näätänen R, Gaillard A, Mäntysalo S (1978) Early selective-attention effect on evoked potential reinterpreted. Acta Psychol 42:313-329
49. Näätänen R, Kujala T, Winkler I (2011) Auditory processing that leads to conscious perception: a unique window to central auditory processing opened by the mismatch negativity and related responses. Psychophysiology 48(1):4-22
50. Neisser U (1967) Cognitive psychology. Appleton-Century-Crofts, New York
51. Paavilainen P, Arajärvi P, Takegata R (2007) Preattentive detection of nonsalient contingencies between auditory features. NeuroReport 18(2):159-163
52. Rao RPN, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2(1):79-87 (Pubitemid 30488944)
53. Rensink RA (2000) Seeing, sensing, and scrutinizing. Vision Res 40(10-12):1469-1487
54. Rinne T, Särkkä A, Degerman A, Schröger E, Alho K (2006) Two separate mechanisms underlie auditory change detection and involuntary control of attention. Brain Res 1077:135-143
55. Ritter W, Sussman E, Molholm S (2000) Evidence that the mismatch negativity system works on the basis of objects. NeuroReport 11(1):61-63 (Pubitemid 30053390)
56. Ritter W, De Sanctis P, Molholm S, Javitt DC, Foxe JJ (2006) Preattentively grouped tones do not elicit MMN with respect to each other. Psychophysiology 43(5):423-430 (Pubitemid 44370044)
57. Schröger E (2007) Mismatch negativity - A microphone into auditory memory. J Psychophysiol 21(3-4):138-146
58. Schwartz JL, Grimault N, Hupé J-M, Moore BC, Pressnitzer D (2012) Multistability in perception: binding sensory modalities, an overview. Philos Trans R Soc Lond B 367(1591):896-905
59. Sokolov EN (1963) Higher nervous functions: the orienting reflex. Annu Rev Physiol 25:545-580
60. Sussman ES (2005) Integration and segregation in auditory scene analysis. J Acoust Soc Am 117(3 Pt 1):1285-1298
61. Sussman ES, Gumenyuk V (2005) Organization of sequential sounds in auditory memory. NeuroReport 16(13):1519-1523 (Pubitemid 41805674)
62. Sussman ES, Horváth J, Winkler I, Orr M (2007) The role of attention in the formation of auditory streams. Perc Psychophys 69(1):136-152
63. Szalárdy O, Winkler I, Schröger E, Widmann A, Bendixen A (2013) Foreground-background discrimination indicated by eventrelated brain potentials in a new auditory multistability paradigm. Psychophysiology 12:1239-1250
64. van Noorden LPAS (1975) Temporal coherence in the perception of tone sequences. Technical University, Eindhoven
65. Wacongne C, Labyt E, van Wassenhove V, Bekinschtein T, Naccache L, Dehaene S (2011) Evidence for a hierarchy of predictions and prediction errors in human cortex. Proc Natl Acad Sci USA 108(51):20754-20759
66. Wacongne C, Changeux JP, Dehaene S (2012) A neuronal model of predictive coding accounting for the mismatch negativity. J Neurosci 32(11):3665-3678
67. Wang DL, Chang P (2008) An oscillatory correlation model of auditory streaming. Cogn Neurodyn 2(1):7-19
68. Winkler I (2007) Interpreting the mismatch negativity. J Psychophysiol 21(3-4):147-163
69. Winkler I, Czigler I (1998) Mismatch negativity: deviance detection or the maintenance of the 'standard'. NeuroReport 9(17):3809-3813 (Pubitemid 29189307)
70. Winkler I, Czigler I (2012) Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. Int J Psychophysiol 83(2):132-143
71. Winkler I, Karmos G, Näätänen R (1996) Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Res 742(1-2):239-252 (Pubitemid 27016028)
72. Winkler I, Korzyukov O, Gumenyuk V, Cowan N, Linkenkaer-Hansen K, Ilmoniemi RJ, Alho K, Näätänen R (2002) Temporary and longer term retention of acoustic information. Psychophysiology 39(4):530-534 (Pubitemid 34765084)
73. Winkler I, Takegata R, Sussman E (2005) Event-related brain potentials reveal multiple stages in the perceptual organization of sound. Cogn Brain Res 25(1):291-299 (Pubitemid 41278506)
74. Winkler I, van Zuijen TL, Sussman E, Horváth J, Näätänen R (2006) Object representation in the human auditory system. Eur J Neurosci 24(2):625-634 (Pubitemid 44100354)
75. Winkler I, Denham SL, Nelken I (2009) Modeling the auditory scene: predictive regularity representations and perceptual objects. Trends Cogn Sci 13(12):532-540
76. Winkler I, Denham S, Mill R, Bohm TM, Bendixen A (2012) Multistability in auditory stream segregation: a predictive coding view. Philos Trans Royal Soc B 367(1591):1001-1012