Multistability in auditory stream segregation: A predictive coding view

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 367, Issue 1591, 2012, Pages 1001-1012

  Winkler, István ^a,b   Denham, Susan ^c   Mill, Robert ^c   Bohm, Tamás M ^a,d   Bendixen, Alexandra ^e  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^b UNIVERSITY OF SZEGED   (Hungary)

^c UNIVERSITY OF PLYMOUTH   (United Kingdom)

^d BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^e UNIVERSITY OF LEIPZIG   (Germany)

Author keywords

Auditory grouping; Auditory object representation; Auditory scene analysis; Computational models; Perceptual bistability; Predictive processing

Indexed keywords

AUDITORY CUE; BRAIN; PARADIGM SHIFT; PERCEPTION;

EID: 84857516393     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2011.0359     Document Type: Article

References (71)

1. Winkler, I., Denham, S. L. & Nelken, I. 2009 Modeling the auditory scene: predictive regularity representations and perceptual objects. Trends Cogn. Sci. 13, 532-540. (doi:10.1016/j.tics.2009.09.003)
2. Friston, K. & Kiebel, S. 2009 Cortical circuits for perceptual inference. Neural Netw. 22, 1093-1104. (doi:10.1016/j.neunet.2009.07.023)
3. Winkler, I. 2007 Interpreting the mismatch negativity. J. Psychophysiol. 21, 147-163. (doi:10.1027/0269-8803.21.34.147)
4. Cowan, N. 1984 On short and long auditory stores. Psychol. Bull. 96, 341-370. (doi:10.1037/0033-2909.96.2.341)
5. Demany, L. & Semal, C. 2007 The role of memory in auditory perception. In Auditory perception of sound sources. Springer handbook of auditory research (eds W. A. Yost, A. N. Popper & R. A. Fay), pp. 77-113. New York, NY: Springer.
6. Cowan, N. 1988 Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information processing system. Psychol. Bull. 104, 163-191. (doi:10.1037/0033-2909.104.2.163)
7. Agus, T. R., Thorpe, S. J. & Pressnitzer, D. 2010 Rapid formation of robust auditory memories: insights from noise. Neuron 66, 610-618. (doi:10.1016/j.neuron.2010.04.014)
8. Kaernbach, C. 2004 The memory of noise. Exp. Psychol. 51, 240-248. (doi:10.1027/1618-3169.51.4.240)
9. Warren, R. M., Bashford, J. A., Cooley, J. M. & Brubaker, B. S. 2001 Detection of acoustic repetition for very long stochastic patterns. Percept. Psychophys. 63, 175-182. (doi:10.3758/BF03200511)
10. Duke, R. A. 1989 Musicians' perception of beat in monotonic stimuli. J. Res. Music. Educ. 37, 61-71. (doi:10.2307/3344953)
11. van Noorden, L. & Moelants, D. 1999 Resonance in the perception of musical pulse. J. New Music Res. 28, 43-66. (doi:10.1076/jnmr.28.1.43.3122)
12. Ulanovsky, N., Las, L. & Nelken, I. 2003 Processing of low-probability sounds by cortical neurons. Nat. Neurosci. 6, 391-398. (doi:10.1038/Nn1032)
13. Ulanovsky, N., Las, L., Farkas, D. & Nelken, I. 2004 Multiple time scales of adaptation in auditory cortex neurons. J. Neurosci. 24, 10440-10453. (doi:10.1523/Jneurosci.1905-04.2004)
14. Mill, R., Coath, M., Wennekers, T. & Denham, S. L. 2011 Abstract stimulus-specific adaptation models. Neural Comput. 23, 435-476. (doi:10.1162/NECO_a_00077)
15. Bregman, A. S. 1990 Auditory scene analysis. The perceptual organization of sound. Cambridge, MA: MIT Press.
16. Darwin, C. J. 1995 Perceiving vowels in the presence of another sound: a quantitative test of the 'old-plus-new' heuristic. In Levels in speech communication: relations and interactions: a tribute to Max Wajskop (eds C. Sorin, J. Mariani, H. Méloni & J. Schoentgen), pp. 1-12. Amsterdam, The Netherlands: Elsevier.
17. Glenberg, A. M. 1984 A retrieval account of the longterm modality effect. J. Exp. Psychol. Learn. Mem. Cogn. 10, 16-31. (doi:10.1037/0278-7393.10.1.16)
18. Winkler, I. & Cowan, N. 2005 From sensory to long-term memory: evidence from auditory memory reactivation studies. Exp. Psychol. 52, 3-20. (doi:10.1027/1618-3169.52.1.3)
19. Korzyukov, O. A., Winkler, I., Gumenyuk, V. I. & Alho, K. 2003 Processing abstract auditory features in the human auditory cortex. Neuroimage 20, 2245-2258. (doi:10.1016/j.neuroimage.2003.08.014)
20. Cowan, N., Saults, S. & Nugent, L. 2001 The ravages of absolute and relative amounts of time on memory. In The nature of remembering: essays in honor of Robert G. Crowder (eds H. L. Roediger III, J. S. Nairne III, I. Neath & A. Surprenant), pp. 315-330. Washington, DC: American Psychological Association.
21. Griffiths, T. D. & Warren, J. D. 2004 What is an auditory object? Nat. Rev. Neurosci. 5, 887-892. (doi:10.1038/nrn1538)
22. Kubovy, M. & Van Valkenburg, D. 2001 Auditory and visual objects. Cognition 80, 97-126. (doi:10.1016/S0010-0277(00)00155-4)
23. Bar, M. 2007 The proactive brain: using analogies and associations to generate predictions. Trends Cogn. Sci. 11, 280-289. (doi:10.1016/j.tics.2007.05.005)
24. Summerfield, C. & Egner, T. 2009 Expectation (and attention) in visual cognition. Trends Cogn. Sci. 13, 403-409. (doi:10.1016/j.tics.2009.06.003)
25. Creutzig, F., Globerson, A. & Tishby, N. 2009 Past- future information bottleneck in dynamical systems. Phys. Rev. E 79, 041925. (doi:10.1103/PhysRevE.79.041925)
26. van Noorden, L. P. A. S. 1975 Temporal coherence in the perception of tone sequences. Doctoral dissertation, Technical University Eindhoven, Eindhoven, The Netherlands.
27. Bendixen, A., SanMiguel, I. & Schröger, E. In press. Early electrophysiological indicators for predictive processing in audition: a review. Int. J. Psychophysiol. (doi:10.1016/j.ijpsycho.2011.08.003)
28. Bendixen, A., Schröger, E. & Winkler, I. 2009 I heard that coming: event-related potential evidence for stimulus- driven prediction in the auditory system. J. Neurosci. 29, 8447-8451. (doi:10.1523/jneurosci.1493-09.2009)
29. Kraemer, D. J. M., Macrae, C. N., Green, A. E. & Kelley, W. M. 2005 Musical imagery: sound of silence activates auditory cortex. Nature 434, 158. (doi:10.1038/434158a)
30. Petkov, C. I., O'Connor, K. N. & Sutter, M. L. 2007 Encoding of illusory continuity in primary auditory cortex. Neuron 54, 153-165. (doi:10.1016/j.neuron.2007.02.031)
31. Mumford, D. 1992 On the computational architecture of the neocortex. II. The role of corticocortical loops. Biol. Cybern. 66, 241-251. (doi:10.1007/BF00202389)
32. Horváth, J., Czigler, I., Sussman, E. & Winkler, I. 2001 Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain. Cogn. Brain Res. 12, 131-144. (doi:10.1016/S0926-6410(01)00038-6)
33. Denham, S. L. & Winkler, I. 2006 The role of predictive models in the formation of auditory streams. J. Physiol. Paris 100, 154-170. (doi:10.1016/j.jphysparis.2006.09.012)
34. Cowan, N. 2001 The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav. Brain Sci. 24, 87-114. (doi:10.1017/S0140525X01003922)
35. Brochard, R., Drake, C., Botte, M.-C. & McAdams, S. 1999 Perceptual organization of complex auditory sequences: effect of number of simultaneous subsequences and frequency separation. J. Exp. Psychol. Hum. Percept. Perform. 25, 1742-1759. (doi:10.1037/0096-1523.25.6.1742)
36. Cusack, R., Deeks, J., Aikman, G. & Carlyon, R. P. 2004 Effects of location, frequency region, and time course of selective attention on auditory scene analysis. J. Exp. Psychol. Hum. Percept. Perform. 30, 643-656. (doi:10.1037/0096-1523.30.4.643)
37. Winkler, I., Teder-Sälejärvi, W. A., Horváth, J., Näätänen, R. & Sussman, E. 2003 Human auditory cortex tracks task-irrelevant sound sources. Neuroreport 14, 2053-2056. (doi:10.1097/01.wnr.0000095496.09138.6d)
38. Köhler, W. 1947 Gestalt psychology: an introduction to new concepts in modern psychology. New York, NY: Liveright Publishing Corporation.
39. Moore, B. C. J. & Gockel, H. E. 2012 Properties of perceptual stream formation. Phil. Trans. R. Soc. B 367 919-931. (doi:10.1098/rstb.2011.0355)
40. Moore, B. C. J. & Gockel, H. 2002 Factors influencing sequential stream segregation. Acta Acust. United Acust. 88, 320-333.
41. Jones, M. R. 1976 Time, our lost dimension: toward a new theory of perception, attention, and memory. Psychol. Rev. 83, 323-355. (doi:10.1037/0033-295X.83.5.323)
42. Shinozaki, N., Yabe, H., Sato, Y., Hiruma, T., Sutoh, T., Matsuoka, T. & Kaneko, S. 2003 Spectrotemporal window of integration of auditory information in the human brain. Cogn. Brain Res. 17, 563-571. (doi:10.1016/S0926-6410(03)00170-8)
43. Sussman, E. S. 2007 A new view on the MMN and attention debate: the role of context in processing auditory events. J. Psychophysiol. 21, 164-175. (doi:10.1027/0269-8803.21.34.164)
44. May, P. J. C. & Tiitinen, H. 2010 Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. Psychophysiology 47, 66-122. (doi:10.1111/j.1469-8986.2009.00856.x)
45. Broadbent, D. E. 1958 Perception and communication. Oxford, UK: Pergamon.
46. Cromwell, H. C., Mears, R. P., Wan, L. & Boutros, N. N. 2008 Sensory gating: a translational effort from basic to clinical science. Clin. EEG Neurosci. 39, 69-72.
47. French-St.George, M. & Bregman, A. S. 1989 Role of predictability of sequence in auditory stream segregation. Percept. Psychophys. 46, 384-386. (doi:10.3758/BF03204992)
48. Bendixen, A., Denham, S. L., Gyimesi, K. & Winkler, I. 2010 Regular patterns stabilize auditory streams. J. Acoust. Soc. Am. 128, 3658-3666. (doi:10.1121/1.3500695)
49. Andreou, L.-V., Kashino, M. & Chait, M. 2011 The role of temporal regularity in auditory segregation. Hearing Res. 280, 228-235. (doi:10.1016/j.heares.2011.06.001)
50. Helson, H. 1964 Adaptation-level theory: an experimental and systematic approach to behavior. Oxford, UK: Harper & Row.
51. Denham, S. L., Gyimesi, K., Stefanics, G. & Winkler, I. 2010 Stability of perceptual organisation in auditory streaming. In The neurophysiological bases of auditory perception (eds E. A. Lopez-Poveda, A. R. Palmer & R. Meddis), pp. 477-488. New York, NY: Springer.
52. Sperduti, M., Tallon-Baudry, C., Hugueville, L. & Pouthas, V. 2011 Time is more than a sensory feature: attending to duration triggers specific anticipatory activity. Cogn. Neurosci. 2, 11-18. (doi:10.1080/17588928.2010.513433)
53. Glenberg, A. M. & Swanson, N. G. 1986 A temporal distinctiveness theory of recency and modality effects. J. Exp. Psychol. Learn. Mem. Cogn. 12, 3-15. (doi:10.1037/0278-7393.12.1.3)
54. Stefanics, G., Hangya, B., Hernádi, I., Winkler, I., Lakatos, P. &Ulbert, I. 2010 Phase entrainment of human delta oscillations can mediate the effects of expectation on reaction speed. J. Neurosci. 30, 13578-13585. (doi:10.1523/Jneurosci.0703-10.2010)
55. Anstis, S. & Saida, S. 1985 Adaptation to auditory streaming of frequency-modulated tones. J. Exp. Psychol. Hum. Percept. Perform. 11, 257-271. (doi:10.1037/0096-1523.11.3.257)
56. Pressnitzer, D. & Hupé, J. M. 2006 Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Curr. Biol. 16, 1351-1357. (doi:10.1016/j.cub.2006.05.054)
57. Roberts, B., Glasberg, B. R. & Moore, B. C. J. 2002 Primitive streamsegregation of tone sequences without differences in fundamental frequency or passband. J. Acoust. Soc. Am. 112, 2074-2085. (doi:10.1121/1.1508784)
58. Mamassian, P. & Goutcher, R. 2005 Temporal dynamics in bistable perception. J. Vis. 5, 361-375. (doi:10.1167/ 5.4.7)
59. Bourjaily, M. A. & Miller, P. 2011 Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons. PLoS Comput. Biol. 7, e1001091. (doi:10.1371/journal.pcbi.1001091)
60. Bee, M. A. & Klump, G. M. 2004 Primitive auditory stream segregation: a neurophysiological study in the songbird forebrain. J. Neurophysiol. 92, 1088-1104. (doi:10.1152/jn.00884.2003)
61. Fishman, Y. I., Arezzo, J. C. & Steinschneider, M. 2004 Auditory stream segregation in monkey auditory cortex: effects of frequency separation, presentation rate, and tone duration. J. Acoust. Soc. Am. 116, 1656-1670. (doi:10.1121/1.1778903)
62. Hupé, J.-M. & Pressnitzer, D. 2012 The initial phase of auditory and visual scene analysis. Phil. Trans. R. Soc. B 367, 942-953. (doi:10.1098/rstb.2011.0368)
63. Pastukhov, A. & Braun, J. 2008 A short-term memory of multi-stable perception. J. Vis. 8, 7-14. (doi:10.1167/8.13.7)
64. Haywood, N. R. & Roberts, B. 2010 Build-up of the tendency to segregate auditory streams: resetting effects evoked by a single deviant tone. J. Acoust. Soc. Am. 128, 3019-3031. (doi:10.1121/1.3488675)
65. Roberts, B., Glasberg, B. R. & Moore, B. C. J. 2008 Effects of the build-up and resetting of auditory stream segregation on temporal discrimination. J. Exp. Psychol. Hum. Percept. Perform. 34, 992-1006. (doi:10.1037/0096-1523.34.4.992)
66. Rogers, W. L. & Bregman, A. S. 1998 Cumulation of the tendency to segregate auditory streams: resetting by changes in location and loudness. Percept. Psychophys. 60, 1216-1227. (doi:10.3758/BF03206171)
67. Rand, T. C. 1974 Dichotic release from masking for speech. J. Acoust. Soc. Am. 55, 678-680. (doi:10.1121/1.1914584)
68. Kovács, I., Papathomas, T. V., Yang, M. & Fehér, A. 1996 When the brain changes its mind: interocular grouping during binocular rivalry. Proc. Natl Acad. Sci. USA 93, 15508-15511. (doi:10.1073/pnas.93.26.15508)
69. Kang, M. S. & Blake, R. 2010 What causes alternations in dominance during binocular rivalry? Atten. Percept.Psychophys. 72, 179-186. (doi:10.3758/App.72.1.179)
70. van Ee, R. 2009 Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability. J. Opt.Soc. Am. A Opt. Image Sci. Vis. 26, 2612-2622. (doi:10.1364/JOSAA.26.002612)
71. Mill, R., Böhm, T., Bendixen, A., Winkler, I. & Denham, S. L. 2011 CHAINS: competition and cooperation between fragmentary event predictors in a model of auditory scene analysis. In 45th Annual Conference on Information Sciences and Systems (CISS). Baltimore, MD. (eds M. Elhilali & H. Weinert), Institute of Electrical and Electronics Engineers. (doi:10.1109/CISS.2011.5766095)