Modelling the Emergence and Dynamics of Perceptual Organisation in Auditory Streaming

PLoS Computational Biology

Volumn 9, Issue 3, 2013, Pages

  Mill, Robert W ^a   Bohm, Tamás M ^b,c   Bendixen, Alexandra ^d   Winkler, István ^b,e   Denham, Susan L ^f  

^a MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

^b INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^c BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^d UNIVERSITY OF LEIPZIG   (Germany)

^e UNIVERSITY OF SZEGED   (Hungary)

^f UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITION; PATIENT REHABILITATION; TIME SWITCHES;

AUDITORY PERCEPTION; AUDITORY SCENE ANALYSIS; AUDITORY STREAMING; AUDITORY SYSTEMS; BI-STABILITY; MULTISTABILITY; ON-THE-FLY; PERCEPTUAL ORGANIZATION; SOUND EVENTS; SOUND SOURCE;

ACOUSTIC GENERATORS;

ADULT; ARTICLE; AUDITORY LATERALIZATION; AUDITORY SCENE ANALYSIS; AUDITORY STIMULATION; AUDITORY STREAMING; CONTROLLED STUDY; DYNAMICS; EVOKED AUDITORY RESPONSE; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PERCEPTIVE DISCRIMINATION; PERCEPTUAL MULTI STABILITY; PREDICTION; PROBABILITY; SIMULATION; SOUND ANALYSIS; STIMULUS RESPONSE;

EID: 84875983850     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002925     Document Type: Article

References (108)

1. Winkler I, Denham SL, Nelken I, (2009) Modeling the auditory scene: predictive regularity representations and perceptual objects. Trends in Cognitive Sciences 13: 532-540.
2. Griffiths TD, Warren JD, (2004) What is an auditory object? Nature Reviews Neuroscience 5: 887-892.
3. Bregman AS (1990) Auditory Scene Analysis. Cambridge, Massachusetts: MIT Press.
4. Cowan N, (1984) On short and long auditory stores. Psychological Bulletin 96: 341-370.
5. Demany L, Semal C (2007) The role of memory in auditory perception. In: Yost WA, Popper AN, Fay RR, editors. Auditory Perception of Sound Sources. Springer US. pp. 77-113.
6. Baddeley Alan (2007) Working memory, thought, and action. New York, NY: Oxford University Press.
7. Cowan N. (1995) Attention and memory. An integrated framework. Oxford: Oxford University Press.
8. Schwartz JL, Grimault N, Hupé JM, Moore BCJ, Pressnitzer D, (2012) Multistability in perception: binding sensory modalities, an overview. Philosophical Transactions of the Royal Society B-Biological Sciences 367: 896-905.
9. Winkler I, Teder-Salejärvi WA, Horváth J, Näätänen R, Sussman E, (2003) Human auditory cortex tracks task-irrelevant sound sources. NeuroReport 14: 2053-2056.
10. Carlyon RP, (2004) How the brain separates sounds. Trends in Cognitive Sciences 8: 465-471.
11. Moore BCJ, Gockel H, (2002) Factors influencing sequential stream segregation. Acta Acustica United with Acustica 88: 320-333.
12. Bendixen A, Bo{double acute}hm TM, Szalárdy O, Mill R, Denham SL, et al. (2012) Different roles of similarity and predictability in auditory stream segregation. Learning and Perception In press.
13. Garrido MI, Kilner JM, Stephan KE, Friston KJ, (2009) The mismatch negativity: A review of underlying mechanisms. Clin Neurophysiol 120: 453-463.
14. Bendixen A, Denham SL, Gyimesi K, Winkler I, (2010) Regular patterns stabilize auditory streams. J Acoust Soc Am 128: 3658-3666.
15. Köhler W (1947) Gestalt Psychology. New York: Liveright.
16. Sterzer P, Kleinschmidt A, Rees G, (2009) The neural bases of multistable perception. Trends in Cognitive Sciences 13: 310-318.
17. Leopold DA, Logothetis NK, (1999) Multistable phenomena: Changing views in perception. Trends in Cognitive Sciences 3: 254-264.
18. Blake R, Logothetis NK, (2002) Visual competition. Nat Rev Neurosci 3: 13-21.
19. Shpiro A, Moreno-Bote R, Rubin N, Rinzel J, (2009) Balance between noise and adaptation in competition models of perceptual bistability. J Comput Neurosci 27: 37-54.
20. Moreno-Bote R, Rinzel J, Rubin N, (2007) Noise-induced alternations in an attractor network model of perceptual bistability. J Neurophysiol 98: 1125-1139.
21. Noest AJ, van Ee R, Nijs MM, van Wezel RJA, (2007) Percept-choice sequences driven by interrupted ambiguous stimuli: A low-level neural model. Journal of Vision 7: 10 10.1167/7.8.10.
22. van Ee R, (2009) Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability. Journal of the Optical Society of America A-Optics Image Science and Vision 26: 2612-2622.
23. Lehky SR, (1988) An astable-multivibrator model of binocular-rivalry. Perception 17: 215-228.
24. Hohwy J, Roepstorff A, Friston K, (2008) Predictive coding explains binocular rivalry: an epistemological review. Cognition 108: 687-701.
25. Tong F, Meng M, Blake R, (2006) Neural bases of binocular rivalry. Trends Cogn Sci 10: 502-511.
26. Pressnitzer D, Hupé JM, (2006) Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Current Biology 16: 1351-1357.
27. Kondo HM, Kitagawa N, Kitamura MS, Koizumi A, Nomura M, Kashino M, (2011) Separability and commonality of auditory and visual bistable perception. Cereb Cortex 2011 Sep 30 [Epub ahead of print].
28. Rubin N, Hupé JM (2004) Dynamics of perceptual bistability: plaids and binocular rivalry. In: Alais D, Blake R, editors. Binocular Rivalry. Cambridge, Massachusetts: MIT Press. pp. 137-154.
29. Levelt WJM (1968) On Binocular Rivalry. Paris: Mouton.
30. van Noorden LPAS (1975) Temporal coherence in the perception of tone sequences [dissertation]. Eindhoven University of Technology, Leiden, The Netherlands.
31. Pastukhov A, Braun J, (2008) A short-term memory of multi-stable perception. J Vis 8: 7-14.
32. Denham SL, Winkler I, (2006) The role of predictive models in the formation of auditory streams. Journal of Physiology-Paris 100: 154-170.
33. Cusack R, (2012) Differentiating the roles of parietal cortex, auditory cortex and the thalamus in auditory stream segregation. The Journal Of The Acoustical Society Of America 131: 3229.
34. Kashino M, Kondo HM, (2012) Functional brain networks underlying perceptual switching: auditory streaming and verbal transformations. Philosophical Transactions of the Royal Society B: Biological Sciences 367: 977-987.
35. Kondo HM, Kashino M, (2009) Involvement of the thalamocortical loop in the spontaneous switching of percepts in auditory streaming. J Neurosci 29: 12695-12701.
36. Fishman YI, Reser DH, Arezzo JC, Steinschneider M, (2001) Neural correlates of auditory stream segregation in primary auditory cortex of the awake monkey. Hear Res 151: 167-187.
37. Micheyl C, Tian B, Carlyon RP, Rauschecker JP, (2005) Perceptual organization of tone sequences in the auditory cortex of awake Macaques. Neuron 48: 139-148.
38. Pressnitzer D, Sayles M, Micheyl C, Winter IM, (2008) Perceptual organization of sound begins in the auditory periphery. Current Biology 18: 1124-1128.
39. Bee MA, Klump GM, (2005) Auditory stream segregation in the songbird forebrain: Effects of time intervals on responses to interleaved tone sequences. Brain Behavior and Evolution 66: 197-214.
40. Itatani N, Klump GM, (2009) Auditory streaming of amplitude-modulated sounds in the songbird forebrain. J Neurophysiol 101: 3212-3225.
41. Denham SL, Gyimesi K, Stefanics G, Winkler I, (2012) Multistability in auditory stream segregation: the role of stimulus features in perceptual organisation. Learning and Perception In press.
42. Winkler I, Denham S, Mill R, Bo{double acute}hm TM, Bendixen A, (2012) Multistability in auditory stream segregation: a predictive coding view. Philosophical Transactions of the Royal Society B-Biological Sciences 367: 1001-1012.
43. Winkler I, (2007) Interpreting the mismatch negativity. Journal of Psychophysiology 21: 147-163.
44. Winkler I, Czigler I, (2012) Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. Int J Psychophysiol 83: 132-143.
45. Wacongne C, Changeux JP, Dehaene S, (2012) A neuronal model of predictive coding accounting for the mismatch negativity. J Neurosci 32: 3665-3678.
46. Näätänen R, Kujala T, Winkler I, (2011) Auditory processing that leads to conscious perception: A unique window to central auditory processing opened by the mismatch negativity and related responses. Psychophysiology 48: 4-22.
47. Bendixen A, SanMiguel I, Schröger E, (2012) Early electrophysiological indicators for predictive processing in audition: A review. Int J Psychophysiol 83: 120-131 doi:10.1016/j.ijpsycho.2011.08.003.
48. Jaramillo S, Zador AM, (2011) The auditory cortex mediates the perceptual effects of acoustic temporal expectation. Nat Neurosci 14: 246-251.
49. Rensink RA, (2000) Seeing, sensing, and scrutinizing. Vision Research 40: 1469-1487.
50. Mill R, Bo{double acute}hm TM, Bendixen A, Winkler I, Denham SL, (2011) CHAINS: Competition and cooperation between fragmentary event predictors in a model of Auditory Scene Analysis. 45th Annual Conference on Information Sciences and Systems. CISS 2011 pp. 1-6.
51. Picton TW (2010) Human Auditory Evoked Potentials. San Diego, CA: Plural Publishing.
52. Sams M, Alho K, Näätänen R, (1984) Short-term habituation and dishabituation of the mismatch negativity of the ERP. Psychophysiology 21: 434-441.
53. Winkler I, Karmos G, Näätänen R, (1996) Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Res 742: 239-252.
54. Winkler I, Cowan N, (2005) From sensory to long-term memory: evidence from auditory memory reactivation studies. Exp Psychol 52: 3-20.
55. Rao RPN, Ballard DH, (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2: 79-87.
56. Wiegand K, Gutschalk A, (2012) Correlates of perceptual awareness in human primary auditory cortex revealed by an informational masking experiment. Neuroimage 61: 62-69.
57. Helson H. (1964) Adaptation-Level Theory. Oxford: Harper & Row.
58. Cowan N, Winkler I, Teder W, Näätänen R, (1993) Memory prerequisites of mismatch negativity in the auditory event-related potential (ERP). J Exp Psychol Learn Mem Cogn 19: 909-921.
59. Schröger E, (1997) On the detection of auditory deviations: a pre-attentive activation model. Psychophysiology 34: 245-257.
60. Bendixen A, Roeber U, Schröger E, (2007) Regularity extraction and application in dynamic auditory stimulus sequences. J Cogn Neurosci 19: 1664-1677.
61. Grossberg S, (1968) Some physiological and biochemical consequences of psychological postulates. Proc Natl Acad Sci U S A 60: 758-765.
62. Wilson HR, Cowan JD, (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J 12: 1-24.
63. Cohen MA, Grossberg S, (1987) Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. Appl Opt 26: 1866-1891.
64. Risken H (1989) The Fokker-Planck Equation. Berlin: Springer-Verlag.
65. Netser S, Zahar Y, Gutfreund Y, (2011) Stimulus-specific adaptation: can it be a neural correlate of behavioral habituation? J Neurosci 31: 17811-17820.
66. Ulanovsky N, Las L, Nelken I, (2003) Processing of low-probability sounds by cortical neurons. Nat Neurosci 6: 391-398.
67. Shpiro A, Curtu R, Rinzel J, Rubin N, (2007) Dynamical Characteristics Common to Neuronal Competition Models. J Neurophysiol 97: 462-473.
68. Laing CR, Chow CC, (2002) A spiking neuron model for binocular rivalry. J Comput Neurosci 12: 39-53.
69. Seely J, Chow CC, (2011) Role of mutual inhibition in binocular rivalry. J Neurophysiol 106: 2136-2150.
70. Winkler I, Takegata R, Sussman E, (2005) Event-related brain potentials reveal multiple stages in the perceptual organization of sound. Brain Res Cogn Brain Res 25: 291-299.
71. Denham SL, Gyimesi K, Stefanics G, Winkler I (2009) Stability of perceptual organisation in auditory streaming. In: Lopez-Poveda EA, Palmer AR, Meddis R, editors. The Neurophysiological Bases of Auditory Perception. Springer. pp. 477-488.
72. Szalárdy O, Bendixen A, Tóth D, Denham SL, Winkler I, (2012) Modulation frequency acts as a primary cue for auditory stream segregation. Learning and Perception In press.
73. Moreno-Bote R, Shpiro A, Rinzel J, Rubin N, (2010) Alternation rate in perceptual bistability is maximal at and symmetric around equi-dominance. Journal of Vision 10: 1.
74. Denham S, Bendixen A, Mill R, Tóth D, Wennekers T, et al. (2012) Characterising switching behaviour in perceptual multi-stability. J Neurosci Methods 2012 Apr 21 [Epub ahead of print].
75. Jones MR, (1976) Time, Our Lost Dimension- Toward A New Theory of Perception, Attention, and Memory. Psychological Review 83: 323-355.
76. Brascamp JW, van Ee R, Noest AJ, Jacobs RHAH, van den Berg AV, (2006) The time course of binocular rivalry reveals a fundamental role of noise. Journal of Vision 6: 1244-1256.
77. Anstis S, Saida S, (1985) Adaptation to auditory streaming of frequency-modulated tones. Journal of Experimental Psychology-Human Perception and Performance 11: 257-271.
78. McCabe SL, Denham MJ, (1997) A model of auditory streaming. J Acoust Soc Am 101: 1611-1621.
79. Elhilali M, Shamma SA, (2008) A cocktail party with a cortical twist: how cortical mechanisms contribute to sound segregation. J Acoust Soc Am 124: 3751-3771.
80. Wang D, Chang P, (2008) An oscillatory correlation model of auditory streaming. Cogn Neurodyn 2: 7-19.
81. Beauvois MW, Meddis R, (1991) A computer model of auditory stream segregation. Q J Exp Psychol A 43: 517-541.
82. Grossberg S, Govindarajan KK, Wyse LL, Cohen MA, (2004) ARTSTREAM: a neural network model of auditory scene analysis and source segregation. Neural Netw 17: 511-536.
83. Alain C, Winkler I (2012) Recording Event-Related Brain Potentials: Application to Study Auditory Perception. In: Poeppel D, Overath T, Popper AN, Fay RR, editors. The Human Auditory Cortex. New York: Springer. pp. 69-96.
84. Näätänen R, Winkler I, (1999) The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin 125: 826-859.
85. Alain C, Arnott SR, Picton TW, (2001) Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials. J Exp Psychol Hum Percept Perform 27: 1072-1089.
86. Grimm S, Roeber U, Trujillo-Barreto NJ, Schröger E, (2006) Mechanisms for detecting auditory temporal and spectral deviations operate over similar time windows but are divided differently between the two hemispheres. Neuroimage 32: 275-282.
87. Weise A, Grimm S, Müller D, Schröger E, (2010) A temporal constraint for automatic deviance detection and object formation: A mismatch negativity study. Brain Res 1331: 88-95.
88. Weise A, Bendixen A, Müller D, Schröger E, (2012) Which kind of transition is important for sound representation? An event-related potential study. Brain Res 1464: 30-42.
89. Takegata R, Brattico E, Tervaniemi M, Varyagina O, Näätänen R, Winkler I, (2005) Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects. Brain Res Cogn Brain Res 25: 169-179.
90. Winkler I, Czigler I, Sussman E, Horváth J, Balázs L, (2005) Preattentive binding of auditory and visual stimulus features. J Cogn Neurosci 17: 320-339.
91. Ritter W, Sussman E, Molholm S, (2000) Evidence that the mismatch negativity system works on the basis of objects. NeuroReport 11: 61-63.
92. Sussman E, Gomes H, Nousak JMK, Ritter W, Vaughan HG, (1998) Feature conjunctions and auditory sensory memory. Brain Res 793: 95-102.
93. Näätänen R, Tervaniemi M, Sussman E, Paavilainen P, Winkler I, (2001) 'Primitive intelligence' in the auditory cortex. Trends in Neurosciences 24: 283-288.
94. Horváth J, Czigler I, Sussman E, Winkler I, (2001) Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain. Brain Res Cogn Brain Res 12: 131-144.
95. Sussman E, Sheridan K, Kreuzer J, Winkler I, (2003) Representation of the standard: stimulus context effects on the process generating the mismatch negativity component of event-related brain potentials. Psychophysiology 40: 465-471.
96. Boh B, Herholz SC, Lappe C, Pantev C, (2011) Processing of complex auditory patterns in musicians and nonmusicians. Plos One 6: e21458.
97. Kaernbach C, (2004) The memory of noise. Exp Psychol 51: 240-248.
98. Warren RM, Bashford JA, Cooley JM, Brubaker BS, (2001) Detection of acoustic repetition for very long stochastic patterns. Perception & Psychophysics 63: 175-182.
99. Sussman E, Winkler I, Huotilainen M, Ritter W, Näätänen R, (2002) Top-down effects can modify the initially stimulus-driven auditory organization. Brain Res Cogn Brain Res 13: 393-405.
100. Paavilainen P, Simola J, Jaramillo M, Näätänen R, Winkler I, (2001) Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). Psychophysiology 38: 359-365.
101. Bendixen A, Schröger E, Ritter W, Winkler I, (2012) Regularity extraction from non-adjacent sounds. Front Psychol 3: 143.
102. Bee MA, Klump GM, (2004) Primitive auditory stream segregation: a neurophysiological study in the songbird forebrain. J Neurophysiol 92: 1088-1104.
103. Fishman YI, Arezzo JC, Steinschneider M, (2004) Auditory stream segregation in monkey auditory cortex: effects of frequency separation, presentation rate, and tone duration. J Acoust Soc Am 116: 1656-1670.
104. Snyder JS, Carter OL, Hannon EE, Alain C, (2009) Adaptation reveals multiple levels of representation in auditory stream segregation. J Exp Psychol Hum Percept Perform 35: 1232-1244.
105. Ikegaya Y, Aaron G, Cossart R, Aronov D, Lampl I, et al. (2004) Synfire chains and cortical songs: Temporal modules of cortical activity. Science 304: 559-564.
106. Kang MS, Blake R, (2010) What causes alternations in dominance during binocular rivalry? Attention Perception & Psychophysics 72: 179-186.
107. Cusack R, Deeks J, Aikman G, Carlyon RP, (2004) Effects of location, frequency region, and time course of selective attention on auditory scene analysis. Journal of Experimental Psychology-Human Perception and Performance 30: 643-656.
108. Hupé JM, Pressnitzer D, (2012) The initial phase of auditory and visual scene analysis. Philos Trans R Soc Lond B Biol Sci 367: 942-953.