Laminar cortical dynamics of conscious speech perception: Neural model of phonemic restoration using subsequent context in noise

Journal of the Acoustical Society of America

Volumn 130, Issue 1, 2011, Pages 440-460

  Grossberg, Stephen ^a   Kazerounian, Sohrob ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC FEATURES; ACOUSTIC SIGNALS; ACOUSTICAL SIGNALS; BROADBAND NOISE; CONTEXTUAL INFORMATION; CORTICAL PROCESSING; NEURAL MODELS; PHONEMIC RESTORATION; RESONANT WAVES; SPEECH PERCEPTION; TEMPORAL ORDER;

RESTORATION;

ACOUSTIC NOISE;

ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BIOLOGICAL MODEL; COMPUTER SIMULATION; CONSCIOUSNESS; HUMAN; LANGUAGE; MEMORY; NEOCORTEX; NOISE; PERCEPTION; PHYSIOLOGY; SPEECH PERCEPTION; TIME;

ACOUSTIC STIMULATION; AUDITORY CORTEX; COMPUTER SIMULATION; CONSCIOUSNESS; HUMANS; LANGUAGE; MEMORY; MODELS, NEUROLOGICAL; NEOCORTEX; NOISE; PERCEPTUAL MASKING; SPEECH PERCEPTION; TIME FACTORS;

EID: 79960692411     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3589258     Document Type: Article

References (81)

1. Ames, H., and Grossberg, S. (2009). Speaker normalization using cortical strip maps: A neural model for steady state vowel categorization., J. Acoust. Soc. Am. 124, 3918-3936. 10.1121/1.2997478
2. Anderson, J., and Bower, G. (1974). A prepositional theory of recognition memory., Mem. Cognit. 2, 406-412. 10.3758/BF03196896
3. Aslin, R., Woodward, J., LaMendola, P., and Bever, T. (1996). Models of word segmentation in fluent maternal speech to infants., in Signal to Syntax: Bootstrapping From Speech to Grammar in Early Acquisition, edited by, J. Morgan, and, K. Demuth, (Lawrence Erlbaum Associates, Mahwah), pp. 117-134.
4. Atkinson, R., and Shiffrin, R. (1968). Human memory: A proposed system and its control processes., in The psychology of learning and motivation, edited by, K. Spence, and, J. Spence, (Academic Press, New York), pp. 89-195.
5. Averbeck, B., Chafee, M., Crowe, D., and Georgopoulos, A. (2003a). Neural activity in prefrontal cortex during copying geometrical shapes. i. Single cells encode shape, sequence and metric parameters., Exp. Brain Res. 150, 127-141. (Pubitemid 36606378)
6. Averbeck, B., Chafee, M., Crowe, D, and Georgopoulos, A. (2003b). Neural activity in prefrontal cortex during copying geometrical shapes. ii. Decoding shape segments from neural ensembles., Exp. Brain Res. 150, 142-153. (Pubitemid 36606379)
7. Bellmann, A., Meuli, R., and Clarke, S. (2001). Two types of auditory neglect., Brain 124 (4), 676-687. 10.1093/brain/124.4.676 (Pubitemid 32303827)
8. Bhatt, R., Carpenter, G., and Grossberg, S. (2007). Texture segregation by visual cortex: Perceptual grouping, attention, and learning., Vis. Res. 47, 3173-3211. 10.1016/j.visres.2007.07.013 (Pubitemid 350081045)
9. Boardman, I., Grossberg, S., Myers, C., and Cohen, M. (1999). Neural dynamics of perceptual order and context effects for variable-rate speech syllables., Percep. Psychophys. 6, 1477-1500. 10.3758/BF03213112
10. Bohland, J. W., Bullock, D., and Guenther, F. H. (2010). Neural representations and mechanisms for the performance of simple speech sequences., J. Cog. Neurosci. 22 (7), 1504-1529. 10.1162/jocn.2009.21306
11. Borg-Graham, L. J., Monier, C., and Fregnac, Y. (1998). Visual input evokes transient and strong shunting inhibition in visual cortical neurons., Nature 393 (6683), 369-373. 10.1038/30735 (Pubitemid 28269710)
12. Bradski, G., Carpenter, G., and Grossberg, S. (1994). Store working memory networks for storage and recall of arbitrary temporal sequences., Bio. Cybern. 71, 469-480. 10.1007/BF00198465
13. Brown, J., Bullock, D., and Grossberg, S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues., J. Neurosci. 19, 10,502-10,511.
14. Brown, J. W., Bullock, D., and Grossberg, S. (2004). How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades., Neural Networks 17, 471-510. 10.1016/j.neunet.2003.08.006 (Pubitemid 38510335)
15. Brown, L., Schneider, S., and Lidsky, T. (1997). Sensory and cognitive functions of the basal ganglia., Curr. Op. Neurobio. 7 (2), 157-163. 10.1016/S0959-4388(97)80003-7 (Pubitemid 27219851)
16. Bullock, D., and Rhodes, B. J. (2003). Competitive queuing for planning and serial performance., in The Handbook of Brain Theory and Neural Networks, edited by, M. A. Arbib, (MIT Press, Cambridge, MA), pp. 241-244.
17. Cao, Y., and Grossberg, S. (2005). A laminar cortical model of stereopsis and 3D surface perception: Closure and da Vinci stereopsis., Spat. Vis. 18, 515-578. 10.1163/156856805774406756 (Pubitemid 41633664)
18. Carpenter, G. A., and Grossberg, S. (1987). A massively parallel architecture for a self-organizing neural pattern recognition machine., Comp. Vis., Graph., Image Proc. 37, 54-115. 10.1016/S0734-189X(87)80014-2
19. Cohen, M., and Grossberg, S. (1986). Neural dynamics of speech and language coding: Developmental programs, perceptual grouping, and competition for short-term memory., Hum. Neurobio. 5, 1-22.
20. Cohen, M., and Grossberg, S. (1987). Masking fields: A massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data., App. Opt. 26, 1866-1891. 10.1364/AO.26.001866
21. Cohen, M. A., and Grossberg, S. (1997). Parallel auditory filtering by sustained and transient channels separates coarticulated vowels and consonants., IEEE Trans. Speech Aud. Proc. 5, 301-318. 10.1109/89.593304 (Pubitemid 127746003)
22. Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity., Behav. Brain Sci. 24, 87-185. 10.1017/S0140525X01003922 (Pubitemid 32725664)
23. Damasio, A. R., Damasio, H., and Chui, H. C. (1980). Neglect following damage to frontal lobe or basal ganglia., Neuropsychologia 18 (2), 123-132. 10.1016/0028-3932(80)90058-5 (Pubitemid 10112634)
24. Fang, L., and Grossberg, S. (2009). From stereogram to surface: How the brain sees the world in depth., Spat. Vis. 22, 45-82. 10.1163/156856809786618484
25. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in primate cerebral cortex., Cereb. Cortex 1, 1-47. 10.1093/cercor/1.1.1-a
26. Farrell, S., and Lewandowsky, S. (2004). Modeling transposition latencies: Constraints for theories of serial order memory., J. Mem. Lang. 51, 115-135. 10.1016/j.jml.2004.03.007 (Pubitemid 38939400)
27. Francis, G., Grossberg, S., and Mingolla, E. (1994). Cortical dynamics of feature binding and reset: Control of visual persistence., Vis. Resear. 34, 1089-1104. 10.1016/0042-6989(94)90012-4 (Pubitemid 24092162)
28. Gaudiano, P., and Grossberg, S. (1991). Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories., Neural Networks 4, 493-504. 10.1016/0893-6080(91)90002-M
29. Goldman-Rakic, P. S. (1987). Circuitry of primate prefrontal cortex and regulation of behavior by representational memory., in Handbook of Physiology, edited by, F. Plum, and, V. Mountcastle, (American Physiological Society, Bethesda), Vol. 5 pp. 373-417.
30. Grossberg, S. (1968). Some physiological and biochemical consequences of psychological postulates., Proc. Nat. Acad. Sci. 60, 758-765. 10.1073/pnas.60.3.758
31. Grossberg, S. (1969). On the production and release of chemical transmitters and related topics in cellular control., J. Theor. Bio. 22, 325-364. 10.1016/0022-5193(69)90009-5
32. Grossberg, S. (1973). Contour enhancement, short-term memory, and constancies in reverberating neural networks., Stud. App. Math. 52, 213-257.
33. Grossberg, S. (1978a). Behavioral contrast in short-term memory: Serial binary memory models or parallel continuous memory models?, J. Math. Psych. 3, 199-219. 10.1016/0022-2496(78)90016-0
34. Grossberg, S. (1978b). A theory of human memory: Self-organization and performance of sensory-motor codes, maps, and plans.., in Progress in Theoretical Biology, edited by, R. Rosen, and, F. Snell, (Academic Press, NY), Vol. 5, pp. 233-374.
35. Grossberg, S. (1980). How does a brain build a cognitive code?, Pysch. Rev. 87, 1-51. 10.1037/0033-295X.87.1.1
36. Grossberg, S. (1984). Unitization, automaticity, temporal order, and word recognition., Cogn. Brain Theory 7, 263-283.
37. Grossberg, S. (1986). The adaptive self-organization of serial order in behavior: Speech, language, and motor control., in Pattern Recognition by Humans and Machines, Vol. 1: Speech Perception, edited by, E. C. Schwab, and, H. C. Nusbaum, (Academic Press, New York), pp. 187-294.
38. Grossberg, S. (1987). Competitive learning: From interactive activation to adaptive resonance., Cogn. Sci. 11, 23-63. 10.1111/j.1551-6708.1987.tb00862.x
39. Grossberg, S. (1988). Nonlinear neural networks: Principles, mechanisms, and architectures., Neural Networks 1, 17-61. 10.1016/0893-6080(88)90021-4
40. Grossberg, S. (2000). How hallucinations may arise from brain mechanisms of learning, attention, and volition., J. Intl. Neuropsych. Soc. 6, 579-588.
41. Grossberg, S. (2003). Resonant neural dynamics of speech perception., J. Phonetics 31, 423-445. 10.1016/S0095-4470(03)00051-2 (Pubitemid 37495918)
42. Grossberg, S., Boardman, I., and Cohen, M. (1997). Neural dynamics of variable-rate speech categorization., J. Exp. Psych: Hum. Percept. Perf. 23, 418-503.
43. Grossberg, S., Govindarajan, K., Wyse, L., and Cohen, M. (2004). ARTSTREAM: A neural network model of auditory scene analysis and source segregation., Neural Networks 17, 511-536. 10.1016/j.neunet.2003.10.002 (Pubitemid 38510336)
44. Grossberg, S., and Myers, C. (2000). The resonant dynamics of speech perception: Interword integration and duration-dependent backward effects., Psych. Rev. 107, 735-767. 10.1037/0033-295X.107.4.735
45. Grossberg, S., and Pearson, L. (2008). Laminar cortical dynamics of cognitive and motor working memory, sequence learning and performance: Toward a unified theory of how the cerebral cortex works., Psych. Rev. 115, 677-732. 10.1037/a0012618
46. Grossberg, S., and Seitz, A. (2003). Laminar development of receptive fields, maps, and columns in visual cortex: The coordinating role of the subplate., Cerebral Cortex 13, 852-863. 10.1093/cercor/13.8.852 (Pubitemid 36917965)
47. Grossberg, S., and Stone, G. O. (1986). Neural dynamics of word recognition and recall: Attentional priming, learning, and resonance., Psych. Rev. 93, 46-74. 10.1037/0033-295X.93.1.46
48. Grossberg, S., and Versace, M. (2008). Spikes, synchrony, and attentive learning by laminar thalamocortical circuits., Brain Res. 1218, 278-312. 10.1016/j.brainres.2008.04.024
49. Grossberg, G., and Williamson, J. R. (2001). A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual groupings and learning., Cerebral Cortex 11, 37-58. 10.1093/cercor/11.1.37 (Pubitemid 32064175)
50. Grossberg, S., and Yazdanbakhsh, A. (2005). Laminar cortical dynamics of 3D surface perception: Stratification, transparency, and neon color spreading., Vis. Res. 45, 1725-1743. 10.1016/j.visres.2005.01.006 (Pubitemid 40403831)
51. He, J., Hashikawa, T., Ojima, H., and Kinouchi, Y. (1997). Temporal integration and duration tuning in the dorsal zone of cat auditory cortex., J. Neurosci. 17, 2615-2625. (Pubitemid 27137427)
52. Hikosaka, O., and Wurtz R. H. (1989). The basal ganglia., in The Neurobiology of Saccadic Eye Movements, edited by, R. H. Wurtz, M. E. Goldberg, (Elsevier, Amsterdam), pp. 257-281.
53. Houghton, G. (1990). The problem of serial order: A neural network model of sequence learning and recall., in Current Research in Natural Language Generation, edited by, R. Dale, C. Mellish, and, M. Zock., (Academic Press, London), pp. 287-319.
54. Lashley, K. S. (1951). The problem of serial order in behavior., in Cerebral Mechanisms in Behavior, edited by, L. A. Jeffries, (Wiley, New York), pp. 506-528.
55. Kashino, M. (2006). Phonemic restoration: The brain creates missing speech sounds., Acoust. Sci. Techn. 27, 318-321. 10.1250/ast.27.318 (Pubitemid 44728680)
56. Kazerounian, S., and Grossberg, S. (2009a). Neural dynamics of speech perception: Phonemic restoration in noise using subsequent context., J. Acoust. Soc. Am. 125, 2658(A).
57. Kazerounian, S., and Grossberg, S. (2009b). Neural dynamics of phonemic restoration: How the brain uses context backwards in time., in Proceedings of 13th International Conference on Cognitive and Neural Systems (ICCNS), Boston MA, May, p. 114.
58. Kazerounian, S., and Grossberg, S. (2009c). Laminar cortical dynamics of conscious speech perception: Phonemic restoration in noise using subsequent context., Soc. Neurosci. Abstracts, Chicago, IL, pp. 1678-1679.
59. Masuda-Katsuse, I., and Kawahara, H. (1999). Dynamic sound stream formation based on continuity of spectral change., Speech Comm. 27, 235-259. 10.1016/S0167-6393(98)00084-3
60. McClelland, J., and Elman, J. (1986). The trace model of speech perception., Cog. Psych. 18, 1-86. 10.1016/0010-0285(86)90015-0
61. Miller, G. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information., Psych. Rev. 63, 81-97. 10.1037/h0043158
62. Miller, J. L., and Liberman, A. M. (1979). Some effect of later-occuring information on the perception of stop consonant and semivowel., Percept. Psychophys. 25, 457-465. 10.3758/BF03213823 (Pubitemid 10166069)
63. Norris, D. (1994). Shortlist: A connectionist model of continuous speech recognition., Cognition 52, 189-234. 10.1016/0010-0277(94)90043-4
64. Norris, D., McQueen, J., and Cutler, A. (2000). Merging information in speech recognition: Feedback is never necessary., Behav. Brain Sci. 23, 299-370. 10.1017/S0140525X00003241
65. Page, M. P., and Norris, D. (1998a). The primacy model: A new model of immediate serial recall., Psychol. Rev. 105 (5): 761-781. 10.1037/0033-295X.105. 4.761-781 (Pubitemid 128456530)
66. Page, M. P., and Norris, D. (1998b). Modeling immediate serial recall with a localist implementation of the primacy model., in Localist Connectionist Approaches to Human Cognition, edited by, J. Grainger, and, A. M. Jacobs, (Erlbaum, Mahwah, NJ), pp. 227-255.
67. Pasupathy, A., Miller, E. K. (2005). Different timecourses of learning-related activity in the prefrontal cortex and striatum., Nature. 433, 873-876. 10.1038/nature03287 (Pubitemid 40314896)
68. Raizada, R., and Grossberg, S. (2003). Towards a theory of the laminar architecture of cerebral cortex: Computational clues from the visual system., Cereb. Cort. 13, 100-113. 10.1093/cercor/13.1.100 (Pubitemid 35462898)
69. Repp, B., Liberman, A., Eccardt, T., and Pesetsky, D. (1978). Perceptual integration of acoustic cues for stop, fricative, and affricate manner., J. Exp. Psychol.: Human Percept. Perf. 4, 621-637. 10.1037/0096-1523.4.4.621
70. Rempel-Clower, N. L., and Barbas, H. (2000). The laminar pattern of connections between prefrontal and anterior temporal cortices in the rhesus monkey is related to cortical structure and function., Cerebral Cortex, 10, 851-865. 10.1093/cercor/10.9.851
71. Rumelhart, D., Hinton, G., and McClelland, J. (1986). A general framework for parallel distributed processing., in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, (MIT Press, Cambridge), Vol. 1: Foundations, pp. 45-76.
72. Samuel, A. (1981a). Phonemic restoration: Insights from a new methodoloty., J. Exp. Psychol.: Human Percept. Perf. 4, 474-494.
73. Samuel, A. (1981b). The role of bottom-up confirmation in the phonemic restoration illusion., J. Exp. Psychol.: Human Percept. Perf. 7, 1124-1131. 10.1037/0096-1523.7.5.1124
74. Samuel, A. (1997). Lexical activation produces potent phonemic percepts., Cog. Psych. 32, 97-127. 10.1006/cogp.1997.0646 (Pubitemid 127433713)
75. Shinn-Cunningham, B., and Wang, D. (2008). Influences of auditory object formation on phonemic restoration., J. Acoust. Soc. Am. 121, 295-301. 10.1121/1.2804701
76. Srinivasan, S., and Wang, D. (2005). A schema-based model for phonemic restoration., Speech Comm. 45, 63-87. 10.1016/j.specom.2004.09.002 (Pubitemid 40034710)
77. Warren, R. (1970). Perceptual restoration of missing speech sounds., Science 167, 392-393. 10.1126/science.167.3917.392
78. Warren, R., and Obusek, C. (1971). Speech perception and phonenemic restorations., Percept. Psychophy. 9, 358-362. 10.3758/BF03212667
79. Warren, R., and Sherman, A. (1974). Phonemic restorations based on subsequent context., Percept. Psychophys. 16, 150-156. 10.3758/BF03203268
80. Warren, R., and Warren, R. (1970). Auditory illusions and confusions., Sci. Am. 223, 30-36. 10.1038/scientificamerican1270-30
81. Werbos, P. (1974). Beyond regression: New tools for prediction and analysis in the behavioral sciences., Ph.D thesis, Harvard University, Cambridge, MA.