Speech perception under adverse conditions: Insights from behavioral, computational, and neuroscience research

Frontiers in Systems Neuroscience

Volumn 7, Issue JAN, 2014, Pages

  Guediche, Sara ^a   Blumstein, Sheila E ^a   Fiez, Julie A ^b,c   Holt, Lori L ^b,c  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Cerebellum; Language; Perceptual learning; Plasticity; Prediction error signals; Speech perception; Supervised learning

Indexed keywords

EID: 84892597061     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2013.00126     Document Type: Article

References (181)

1. Ackermann, H., Graber, S., Hertrich, I., and Daum, I. (1997). Categorical speech perception in cerebellar disorders. Brain Lang. 60, 323-331. doi: 10.1006/brln.1997.1826
2. Adank, P., and Devlin, J. (2010). On-line plasticity in spoken sentence comprehension: adapting to time-compressed speech. Neuroimage 49, 1124-1132. doi: 10.1016/j.neuroimage.2009.07.032
3. Adank, P., and Janse, E. (2009). Perceptual learning of time-compressed and natural fast speech. J. Acoust. Soc. Am. 126, 2649-2659. doi: 10.1121/1.3216914
4. Altmann, G. T. M., and Young, D. (1993). "Factors affecting adaptation to time-compressed speech," in Third European Conference on Speech Comunication, (Berlin).
5. Anderson, S., and Kraus, N. (2010). Sensory-cognitive interaction in the neural encoding of speech in noise. J. Am. Acad. Audiol. 21, 575-585. doi: 10.3766/jaaa.21.9.3
6. Baizer, J. S., Kralj-Hans, I., and Glickstein, M. (1999). Cerebellar lesions and prism adaptation in macaque monkeys. J. Neurophysiol. 81, 1960-1965.
7. Banai, K., and Lavner, Y. (2012). Perceptual learning of time-compressed speech: more than rapid adaptation. PLoS ONE 7:e47099. doi: 10.1371/jour-nal.pone.0047099
8. Bastos, A., Usrey, W., Adams, R., Mangun, G., Fries, P., and Friston, K. (2012). Canonical microcircuits for predictive coding. Neuron 76, 695-711. doi: 10.1016/j.neuron.2012.10.038
9. Bedford, F. L. (1999). Keeping perception accurate. Trends Cogn. Sci. (Regul. Ed). 3, 4-11. doi: 10.1016/S1364-6613(98)01266-2
10. Bertelson, P., Vroomen, J., and Gelder, B. D. (2003). Visual recalibration of auditory speech identification: a McGurk aftereffect. Psychol. Sci. 14, 592-597. doi:10.1046/j.0956-7976.2003.psci_1470.x
11. Bertelson, P., Vroomenti, J., and Gelderti, B. (1997). "Auditory-visual interaction in voice localization and in bimodal speech recognition: the effects of desynchronization," in AVSP-1997 (Rhodes), 97-100
12. Binder, J. R., Desai, R. H., Graves, W. W., and Conant, L. L. (2009). Where is the semantic system? a critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767-2796. doi: 10.1093/cercor/bhp055
13. Binder, J. R., Liebenthal, E., Possing, E. T., Medler, D. A., and Ward, B. D. (2004). Neural correlates of sensory and decision processes in auditory object identification. Nat. Neurosci. 7, 295-301. doi: 10.1038/nn1198
14. Blumstein, S., Myers, E., and Rissman, J. (2005). The perception of voice onset time: an fMRI investigation of phonetic category structure. J. Cogn. Neurosci. 17, 1353-1366. doi: 10.1162/0898929054985473
15. Borsky, S., Tuller, B., and Shapiro, L. (1998). "How to milk a coat:" the effets of semantic and acoustic information on phoneme categorization. J. Acoust. Soc. Am. 103, 2670-2676. doi: 10.1121/1.422787
16. Bostan, A. C., Dum, R. P., and Strick, P. L. (2010). The basal ganglia communicate with the cerebellum. Proc. Natl. Acad. Sci. U.S.A. 107, 8452-8456. doi: 10.1073/pnas.1000496107
17. Bradlow, A., and Bent, T. (2008). Perceptual adaptation to non-native speech. Cognition 106, 707-729. doi: 10.1016/j.cognition.2007.04.005
18. Cainer, K., James, C., and Rajan, R. (2008). Learning speech-in-noise discrimination in adult humans. Hear. Res. 238, 155-164. doi: 10.1016/j.heares.2007.
19. Caplan, D. (1999). Activating brain systems for syntax and semantics. Neuron 24, 292-293. doi: 10.1016/S0896-6273(00)80843-0
20. Caplan, D. (2006). Why is Broca's area involved in syntax? Cortex 24, 42, 469-471. doi: 10.1016/S0010-9452(08)70379-4
21. Chang, E., Niziolek, C., Knight, R., Nagarajan, S., and Houde, J. (2013). Human cortical sensorimotor network underlying feedback control of vocal pitch. Proc. Natl. Acad. Sci. U.S.A. 110, 2653-2658. doi: 10.1073/pnas.1216827110
22. Chinta, L. V., and Tweed, D. B. (2012). Adaptive optimal control without weight transport. Neural Comput. 24, 1487-1518. doi: 10.1162/NECO_a_00277
23. Clark, A. (2013). Whatever next? Predictive brains, situated agents and the future of cognitive science. Behav. Brain Sci. 36, 131-204. doi: 10.1017/S0140525X1 2000477
24. Clarke, C., and Garrett, M. (2004). Rapid adaptation to foreign-accented English. J. Acoust. Soc. Am. 116, 3647-3658. doi: 10.1121/1.1815131
25. Clarke-Davidson, C., Luce, P., and Sawusch, J. (2008). Does perceptual learning in speech reflect changes in phonetic category representation or decision bias. Percept. Psychophys. 70, 604-618. doi: 10.3758/PP.70.4.604
26. Clayards, M., Tanenhaus, M. K., Aslin, R. N., and Jacobs, R. A. (2008). Perception of speech reflects optimal use of probabilistic speech cues. Cognition 108, 804-809. doi: 10.1016/j.cognition.2008.04.004
27. Clos, M., Langner, R., Meyer, M., Oechslin, M. S., Zilles, K., and Eickhoff, S. B. (2012). Effects of prior information decoding degraded speech: an fMRI study. Hum. Brain Mapp. 35, 61-74. doi: 10.1002/hbm.22151
28. Clower, D. M., Hoffman, J. M., Votaw, J. R., Faber, T. L., Woods, R. P., and Alexander, G. E. (1996). Role of posterior parietal cortex in the recalibration of visually guided reaching. Nature 383, 618-621. doi: 10.1038/383618a0
29. Crick, F. (1989). The recent excitement about neural networks. Nature 337, 129-132. doi: 10.1038/337129a0
30. Cunningham, H. A., and Welch, R. B. (1994). Multiple concurrent visual-motor mappings:implications for models of adaptation. J. Exp. Psychol. Hum. Percept. Perform. 20, 987-999. doi: 10.1037/0096-1523.20.5.987
31. Cutler, A. (2008). The abstract representations in speech processing. Q. J. Exp. Psychol. 61, 1601-1619. doi: 10.1080/13803390802218542
32. Davis, M., Johnsrude, I., Hervais-Aldelman, A., Taylor, K., and McGettigan, C. (2005). Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. J. Exp. Psychol. Gen. 134, 222-241. doi: 10.1037/0096-3445.134.2.222
33. Davis, M. H., Ford, M. A., Kherif, F., and Johnsrude, I. S. (2011). Does semantic context benefit speech understanding through "top-down" processes? Evidence from time-resolved sparse fMRI. J. Cogn. Neurosci. 23, 3914-3932. doi: 10.1162/jocn_a_00084
34. Davis, M. H., and Johnsrude, I. S. (2003). Hierarchical processing in spoken language comprehension. J. Neurosci. 23, 3423. doi: 10.1093/cercor/bhi009
35. Davis, M. H., and Johnsrude, I. S. (2007). Hearing speech sounds: top-down influences on the interface between audition and speech perception. Hear. Res. 229, 132-147. doi: 10.1016/j.heares.2007.01.014
36. Delgado, M., Nystrom, L., Fissell, C., Noll, D., and Fiez, J. (2000). Tracking the hemodynamic responses to reward and punishment. J. Neurophysiol. 84, 3072-3077. doi: 10.1196/annals.1390.002
37. Desmond, J. E., and Fiez, J. A. (1998). Neuroimaging studies of the cerebellum: language, learning and memory. Trends Cogn. Sci. (Regul. Ed). 2, 355-358. doi: 10.1016/S1364-6613(98)01211-X
38. Desmurget, M., and Grafton, S. (2000). Forward modeling allows feedback control for fast reaching movements. Trends Cogn. Sci. 4, 423-431. doi: 10.1016/S1364-6613(00)01537-0
39. DeWitt, I., and Rauschecker, J. P. (2012). Phoneme and word recognition in the auditory ventral stream. Proc. Natl. Acad. Sci. U.S.A. 109, E505-E514. doi: 10.1073/pnas.1113427109
40. Doya, K. (2000). Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr. Opin. Neurobiol. 10, 732-739. doi: 10.1016/S0959-4388(00)00153-7
41. Eisner, F., McGettigan, C., Faulkner, A., Rosen, S., and Scott, S. (2010). Inferior frontal gyrus activation predicts individual differences in perceptual learning of cochlear-implant simulations. J. Neurosci. 30, 7179-7186. doi: 10.1523/JNEUROSCI.4040-09.2010
42. Erb, J., Henry, M., Eisner, F., and Obleser, J. (2013). The brain dynamics of rapid perceptual adaptation to adverse listening conditions. J. Neurosci. 33, 10688-10697. doi: 10.1523/JNEUROSCI.4596-12.2013
43. Fedorenko, E., Duncan, J., and Kanwisher, N. (2012). Lexical and syntactic representations in the brain: an fMRI investigation with multi-voxel pattern analyses. Neuropsychologia 50, 499-513. doi: 10.1016/j.neuropsychologia.2011.09.014
44. Fenn, K., Nusbaum, H., and Margoliash, D. (2003). Consolidation during sleep of perceptual learning of spoken language. Nature 425, 614-616. doi: 10.1038/nature01951
45. Fiez, J. A., Petersen, S. E., Cheney, M. K., and Raichle, M. E. (1992). Impaired non-motor learning and error detection associated with cerebellar damage. Brain 115(Pt.1), 155-178. doi: 10.1093/brain/115.1.155
46. Flanagan, J., Vetter, P., Johansson, R., and Wolpert, D. (2003). Prediction precedes control in motor learning. Curr. Biol. 13, 146-150. doi: 10.1016/S0960-9822(03)00007-1
47. Francis, A., Baldwin, K., and Nusbaum, H. (2000). Effects of training on attention to acoustic cues. Percept. Psychophys. 62, 1668-1680. doi: 10.3758/BF03212164
48. Francis, A., Nusbaum, H., and Fenn, K. (2007). Effects of training on the acoustic phonetic representation of synthetic speech. J. Speech Lang. Hear. Res. 50, 1445-1465. doi: 10.1044/1092-4388(2007/100)
49. Friederici, A. D. (2009). Pathways to language: fiber tracts in the human brain. Trends Cogn. Sci. (Regul. Ed). 13, 175-181. doi: 10.1016/j.tics.2009.01.001
50. Friston, K., and Kiebel, S. (2009). Predictive coding under the free-energy principle. Philos. Trans. R. Soc. B Biol. Sci. 364, 1211-1221. doi: 10.1098/rstb.2008.0300
51. Fu, Q., and Galvin, J. R. (2003). The effects of short-term training for spectrally mismatched noise-band speech. J. Acoust. Soc. Am. 113, 1065-1072. doi: 10.1121/1.1537708
52. Gagnepain, P., Henson, R. N., and Davis, M. H. (2012). Temporal predictive codes for spoken words in auditory cortex. Curr. Biol. 22, 615-621. doi: 10.1016/j.cub.2012.02.015
53. Ganong, W. R. (1980). Phonetic categorization in auditory word perception. J. Exp. Psychol. Hum. Percept. Perform. 6, 110-125. doi: 10.1037//0096-1523.6.1.110
54. Gaskell, M. G., and Marslen-Wilson, W. D. (1997). Integrating form and meaning: a distributed model of speech perception. Lang. Cogn. Process. 12, 613-656. doi: 10.1080/016909697386646
55. Glickstein, M. (2006). Thinking about the cerebellum. Brain 129, 288-290. doi: 10.1093/brain/awh728
56. Golfinopoulos, E., Tourville, J., Bohland, J., Ghosh, S., Nieto-Castanon, A., and Guenther, F. (2011). fMRI investigation of unexpected somatosen-sory feedback perturbation during speech. Neuroimage 55, 1324-1338. doi: 10.1016/j.neuroimage.2010.12.065
57. Gow, J. D., Segawa, J., Ahlfors, S., and Lin, F. (2008). Lexical influences on speech perception: a Granger causality analysis of MEG and EEG source estimates. Neuroimage 43, 614-623. doi: 10.1016/j.neuroimage.2008.07.027
58. Greenspan, S., Nusbaum, H., and Pisoni, D. (1988). Perceptual learning of synthetic speech produced by rule. J. Exp. Psychol. Learn. Mem. Cogn. 14, 421-433. doi: 10.1037//0278-7393.14.3.421
59. Grossberg, S. (2013). Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world. Neural Netw. 37, 1-47. doi: 10.1016/j.neunet.2012.09.017
60. st Annual Conference of the Cognitive Science Society. (Amsterdam).
61. Guediche, S., Holt, L. L., Laurent, P., Lim, S., and Fiez, J. A. (accepted). Evidence for cerebellar contributions to adaptive plasticity in speech perception. Cereb. Cortex.
62. Guediche, S., Salvata, C., and Blumstein, S. E. (2013). Temporal cortex reflects effects of sentence context on phonetic processing. J. Cogn. Neurosci. 25, 706-718. doi: 10.1162/jocn_a_00351
63. Guenther, F. (1995). Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production. Psychol. Rev. 102, 594-621. doi: 10.1037/0033-295X.102.3.594
64. Guenther, F. H., and Ghosh, S. S. (2003). "A model of cortical and cerebellar function in speech," in Proceedings of the XVth International Congress of Phonetic Sciences (Barcelona).
65. Hervais-Adelman, A., Davis, M. H., Johnsrude, I. S., and Carlyon, R. P. (2008). Perceptual learning of noise vocoded words: effects of feedback and lexical-ity. J. Exp. Psychol. Hum. Percept. Perform. 34, 460-474. doi: 10.1037/0096-1523.34.2.460
66. Hervais-Adelman, A. G., Davis, M. H., Johnsrude, I. S., Taylor, K. J., and Carlyon, R. P. (2011). Generalization of perceptual learning of vocoded speech. J. Exp. Psychol. Hum. Percept. Perform. 37, 283-295. doi: 10.1037/a0020772
67. Hesselmann, G., Sadaghiani, S., Friston, K. J., and Kleinschmidt, A. (2010). Predictive coding or evidence accumulation? False inference and neuronal fluctuations. PLoS ONE 5:e9926. doi: 10.1371/journal.pone.0009926
68. Hickok, G., and Poeppel, D. (2004). Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92, 67-99. doi: 10.1016/j.cognition.2003.10.011
69. Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402. doi: 10.1038/nrn2113
70. Hinton, G., and Plaut, D. (1987). "Using fast weights to deblur old memories," in Proceedings of the Ninth Annual Conference of the Cognitive Science Society, (Hillsdale, NJ: Earlbaum).
71. Holt, L. (2005). Temporally nonadjacent nonlinguistic sounds affect speech categorization. Psychol. Sci. 16, 305-312. doi: 10.1111/j.0956-7976.2005.01532.x
72. Hoshi, E., Tremblay, L., Feger, J., Carras, P., and Strick, P. (2005). The cerebellum communicates with the basal ganglia. Nat. Neurosci. 8, 1491-1493. doi: 10.1038/nn1544
73. Houde, J. F., and Jordan, M. I. (1998). Sensorimotor adaptation in speech production. Science 279, 1213-1216. doi: 10.1126/science.279.5354.1213
74. Houde, J. F., and Jordan, M. I. (2002). Sensorimotor adaptation of speech: compensation and adaptation. J. Speech Lang. Hear. Res. 45, 295-310. doi: 10.1044/1092-4388(2002/023)
75. Idemaru, K., and Holt, L. L. (2011). Word recognition reflects dimension-based statistical learning. J. Exp. Psychol. Hum. Percept. Perform. 37, 1939-1956. doi: 10.1037/a0025641
76. Imamizu, H., Kuroda, T., Miyauchi, S., Yoshioka, T., and Kawato, M. (2003). Modular organization of internal models of tools in the human cerebellum. Proc. Natl. Acad. Sci. U.S.A. 100, 5461-6566. doi: 10.1073/pnas.0835746100
77. Ito, M. (2008). Control of mental activities by internal models in the cerebellum. Nat. Rev. Neurosci. 9, 304-313. doi: 10.1038/nrn2332
78. Ivry, R. B. (1996). The representation of temporal information in perception and motor control. Curr. Opin. Neurobiol. 6, 851-857. doi: 10.1016/S0959-4388(96)80037-7
79. Jones, J. A. (2003). Learning to produce speech with an altered vocal tract: the role of auditory feedback. J. Acoust. Soc. Am. 113, 532-543. doi: 10.1121/1.1529670
80. Jones, J. A., and Munhall, K. G. (2000). Perceptual calibration of F0 production: evidence from feedback perturbation. J. Acoust. Soc. Am. 108, 1246-1251. doi: 10.1121/1.1288414
81. Kagerer, F., Contreras-Vidal, J., and Stelmach, G. (1997). Adaptation to gradual as compared with sudden visuo-motor distortions. Exp. Brain Res. 115, 557-561. doi: 10.1007/PL00005727
82. Kawato, M., and Wolpert, D. (1998). Internal models for motor control. Novartis Found. Symp. 218, 291-304.
83. Keren-Happuch, E., Chen, S. H., and Desmond, J. E. (2012). A meta-analysis of cerebellar contributions to higher cognition from PET and fMRI studies. Hum. Brain Mapp. doi: 10.1002/hbm.22194. [Epub ahead of print].
84. Kilian-Hutten, N., Valente, G., Vroomen, J., and Formisano, E. (2011a). Auditory cortex encodes the perceptual interpretation of ambiguous sound. J. Neurosci. 31, 1715-1720. doi: 10.1523/JNEUROSCI.4572-10.2011
85. Kilian-Hutten, N., Vroomen, J., and Formisano, E. (2011b). Brain activation during audiovisual exposure anticipates future perception of ambiguous speech. Neuroimage 57, 1601-1607. doi: 10.1016/j.neuroimage.2011.05.043
86. Kleinschmidt, D., and Jaeger, T. F. (2011). "A Bayesian belief updating model of phonetic recalibration and selective adaptation," in Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics, (Portland, OR: Association for Computational Linguistics), 10-19.
87. Kotz, S. A., and Schwartze, M. (2010). Cortical speech processing unplugged: a timely subcortico-cortical framework. Trends Cogn. Sci. 14, 392-399. doi: 10.1016/j.tics.2010.06.005
88. Kraljic, T., Samuel, A., and Brennan, S. (2008). First impressions and last resorts: how listeners adjust to speaker variability. Psychol. Sci. 19, 332-338. doi: 10.1111/j.1467-9280.2008.02090.x
89. Kraljic, T., and Samuel, A. G. (2005). Perceptual learning for speech: is there a return to normal? Cognit. Psychol. 51, 141-178. doi: 10.1016/j.cogpsych.2005. 05.001
90. Kraljic, T., and Samuel, A. G. (2011). Perceptual learning evidence for contextually-specific representations. Cognition 121, 459-465. doi: 10.1016/j.cognition.2011. 08.015
91. Ladefoged, P., and Broadbent, D. E. (1957). Information conveyed by vowels. J. Acoust. Soc. Am. 29, 113-127. doi: 10.1121/1.1908694
92. Leff, A., Schofield, T., Stephan, K., Crinion, J., Friston, K., and Price, C. (2008). The cortical dynamics of intelligible speech. J. Neurosci. 28, 13209-13215. doi: 10.1523/JNEUROSCI.2903-08.2008
93. Li, T., and Fu, Q. (2006). Perceptual adaptation to spectrally shifted vowels: training with nonlexical labels. J. Assoc. Res. Otolaryngol. 8, 32-41. doi: 10.1007/s10162-006-0059-2
94. Li, T., and Fu, Q. (2010). Effects of spectral shifting on speech perception in noise. Hear. Res. 270, 81-88. doi: 10.1016/j.heares.2010.09.005
95. Li, T., Galvin, J. R., and Fu, Q. (2009). Interactions between unsuper-vised learning and the degree of spectral mismatch on short-term perceptual adaptation to spectrally shifted speech. Ear Hear. 30, 238-249. doi: 10.1097/AUD.0b013e31819769ac
96. Liss, J., Spitzer, S., Caviness, J., and Adler, C. (2002). The effects of familiarization on intelligibility and lexical segmentation in hypokinetic and ataxic dysarthria. J. Acoust. Soc. Am. 112, 3022-3030. doi: 10.1121/1.1515793
97. Lotto, A., and Kluender, K. (1998). General contrast effects in speech perception: effect of preceding liquid on stop consonant identification. Percept. Psychophys. 60, 602-619. doi: 10.3758/BF03206049
98. MacDonald, J., and McGurk, H. (1978). Visual influences on speech perception processes. Percept. Psychohys. 24, 253-257. doi: 10.3758/BF03206096
99. Martin, T. A., Keating, J. G., Goodkin, H. P., Bastian, A. J., and Thach, W. T. (1996a). Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. Brain 119, 1183-1198. doi: 10.1093/brain/119.4.1183
100. Martin, T. A., Keating, J. G., Goodkin, H. P., Bastian, A. J., and Thach, W. T. (1996b). Throwing while looking through prisms. II. Specificity and storage of multiple gaze-throw calibrations. Brain 119, 1199-1211. doi: 10.1093/brain/119. 4.1199
101. Mattys, S. L., Davis, M. H., Bradlow, A. R., and Scott, S. K. (2012). Speech recognition in adverse conditions: a review. Lang. Cogn. Process. 277, 953-978. doi: 10.1080/01690965.2012.705006
102. Mattar, A., Nasir, S., Darainy, M., and Ostry, D. (2011). Sensory change following motor learning. Prog. Brain Res. 191, 31-44. doi: 10.1016/B978-0-444-53752-2.00015-1
103. Maye, J., Aslin, R., and Tanenhaus, M. (2008). The weckud wetch of the wast: lexical adaptation to a novel accent. Cogn. Sci. 5, 543-562. doi: 10.1080/03640210802035357
104. Mumford, D. (1992). On the computational architecture of the neocortex. Biol. Cybern. 66, 241-251. doi: 10.1007/BF00198477
105. McClelland, J., and Elman, J. (1986). The TRACE model of speech perception. Cogn. Psychol. 18, 1-86. doi: 10.1016/0010-0285(86)90015-0
106. McClelland, J., McNaughton, B., and O'Reilly, R. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419-457. doi: 10.1037//0033-295X.102.3.419
107. McClelland, J. L., Mirman, D., and Holt, L. L. (2006). Are there interactive processes in speech perception? Trends Cogn. Sci. (Regul. Ed) 10, 363-369. doi: 10.1016/j.tics.2006.06.007
108. McGettigan, C., Faulkner, A., Altarelli, I., Obleser, J., Baverstock, H., and Scott, S. (2012). Speech comprehension aided by multiple modalities: behavioural and neural interactions. Neuropsychologia 50, 762-776. doi: 10.1016/j.neuropsychologia.2012.01.010
109. McGurk, H., and Macdonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748.
110. McQueen, J. M., Tyler, M., and Cutler, A. (2012). Lexical retuning of children's speech perception: evidence for knowledge about words' component sounds. Learn. Dev. 8, 317-339. doi: 10.1080/15475441.2011.641887
111. Mehler, J., Sebastian, N., Altmann, G., Dupoux, E., Christophe, A., and Pallier, C. (1993). Understanding compressed sentences: the role of rhythm and meaning. Ann. N.Y. Acad. Sci. 682, 272-282. doi: 10.1111/j.1749-6632.1993.tb22975.x
112. Mesite, L. and Myers, E. (2012). "An fMRI study of lexically-induced perceptual learning inspeech," in Poster Presented at the 3rd Annual University of Connecticut Language Fest (Storrs, CT).
113. Mirman, D., McClelland, J., and Holt, L. (2006). An interactive Hebbian account of lexically guided tuning of speech perception. Psychon. Bull. Rev. 13, 958-965. doi: 10.3758/BF03213909
114. Myers, E., and Blumstein, S. (2008). The neural bases of the lexical effect: an fMRI investigation. Cereb. Cortex 18, 278-288. doi: 10.1093/cercor/bhm053
115. Nasir, S. M., and Ostry, D. J. (2009). Auditory plasticity and speech motor learning. PNAS 106, 20470-20475.
116. Norris, D. (1994). Shortlist: a connectionist model of continuous speech recognition. Cognition 52, 189-234. doi: 10.1016/0010-0277(94)90043-4
117. Norris, D., McQueen, J., and Cutler, A. (2000). Merging information in speech recognition: feedback is never necessary. Behav. Brain Sci. 23, 299-325. doi: 10.1017/S0140525X00003241
118. Norris, D., McQueen, J. M., and Cutler, A. (2003). Perceptual learning in speech. Cogn. Psychol. 47, 204-238. doi: 10.1016/S0010-0285(03)00006-9
119. Obleser, J., and Kotz, S. A. (2010). Expectancy constraints in degraded speech modulate the language comprehension network. Cereb. Cortex 20, 633-640. doi: 10.1093/cercor/bhp128
120. Obleser, J., and Kotz, S. A. (2011). Multiple brain signatures of integration in the comprehension of degraded speech. Neuroimage 55, 713-723. doi: 10.1016/j.neuroimage.2010.12.020
121. Obleser, J., Wise, R., Dresner, M., and Scott, S. (2007). Functional integration across brain regions improves speech perception under adverse listening conditions. J. Neurosci. 27, 2283-2289. doi: 10.1523/JNEUROSCI.4663-06.2007
122. O'Reilly, R. (2001). Generalization in interactive networks: the benefits of inhibitory competition and Hebbian learning. Neural Comput. 13, 1199-1241. doi: 10.1162/08997660152002834
123. Pallier, C., Sebastian-Galles, N., Dupoux, E., Christophe, A., and Mehler, J. (1998). Perceptual adjustment to time-compressed speech: a cross-linguistic study. Mem. Cogn. 26, 844-851. doi: 10.3758/BF03211403
124. Panichello, M. F., Cheung, O. S., and Bar, M. (2012). Predictive feedback and conscious visual experience. Front. Psychol. 3:620. doi: 10.3389/fpsyg.2012. 00620
125. Peelle, J., and Wingfield, A. (2005). Dissociations in perceptual learning revealed by adult age differences in adaptation to time-compressed speech. J. Exp. Psychol. Hum. Percept. Perform. 31, 1315-1330. doi: 10.1037/0096-1523.31. 6.1315
126. Peelle, J. E., Johnsrude, I. S., and Davis, M. H. (2010). Hierarchical processing for speech in human auditory cortex and beyond. Front. Hum. Neurosci. 4:51. doi: 10.3389/fnhum.2010.00051
127. Perkell, J., Lane, H., Denny, M., Matthies, M., Tiede, M., Zandipour, M., et al. (2007). Time course of speech changes in response to unanticipated short-term changes in hearing state. J. Acoust. Soc. Am. 121, 2296-2311. doi: 10.1121/1.2642349
128. Petacchi, A., Laird, A., Fox, P., and Bower, J. (2005). Cerebellum and auditory function: an ALE meta-analysis of functional neuroimaging studies. Hum. Brain Mapp. 25, 118-128. doi: 10.1002/hbm.20137
129. Peterson, G. E., and Barney, H. L. (1952). Control methods used in a study of the vowels. J. Acoust. Soc. Am. 24, 175-184. doi: 10.1121/1.1906875
130. Pickering, M., and Garrod, S. (2007). Do people use language production to make predictions during comprehension? Tr e n d s C o g n. S c i. 11, 105-110. doi: 10.1016/j.tics.2006.12.002
131. Poldrack, R., Temple, E., Protopapas, A., Nagarajan, S., Tallal, P., Merzenich, M., et al. (2001). Relations between the neural bases of dynamic auditory processing and phonological processing: evidence from fMRI. J. Cogn. Neurosci. 13, 687-698. doi: 10.1162/089892901750363235
132. Price, C., Crinion, J., and MacSweeney, M. (2011). A generative model of speech production in Broca's and Wernicke's areas. Front. Psychol. 2:237. doi: 10.3389/fpsyg.2011.00237
133. Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816-847. doi: 10.1016/j.neuroimage.2012.04.062
134. Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87.
135. Rauschecker, J. (2011). An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hear. Res. 271, 16-25. doi: 10.1016/j.heares.2010.09.001
136. Rauschecker, J. (2012). Ventral and dorsal streams in the evolution of speech and language. Front. Evol. Neurosci. 4:7. doi: 10.3389/fnevo.2012.00007
137. Rauschecker, J., and Scott, S. (2009). Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718-724. doi: 10.1038/nn.2331
138. Rauschecker, J., and Tian, B. (2000). Mechanisms and streams for processing of what and where in auditory cortex. Proc. Natl. Acad. Sci. 97, 11800-11806. doi: 10.1073/pnas.97.22.11800
139. Ravizza, S. (2003). Dissociating the performance of cortical and subcortical patients on phonemic tasks. Brain Cogn. 53, 301-310. doi: 10.1016/S0278-2626(03)00131-3
140. Redding, G. M., and Wallace, B. (1996). Adaptive spatial alignment and strategic perceptual-motor control. J. Exp. Psychol. Hum. Percept. Perform. 22, 379-394. doi: 10.1037//0096-1523.22.2.379
141. Roth, M. J., Synofzik, M., and Lindner, A. (2013). The cerebellum optimizes perceptual predictions about external sensory events. Curr. Biol. 23, 930-935. doi: 10.1016/j.cub.2013.04.027
142. Rothermich, K., and Kotz, S. (2013). Predictions in speech comprehension: fMRI evidence on the meter-semantic interace. Neuroimage 70, 89-100. doi: 10.1016/j.neuroimage.2012.12.013
143. Rumelhart, D., Hinton, G., and William, R. (1986). Learning representations by back-propagating errors. Nature 23, 533-536. doi: 10.1038/323533a0
144. Samuel, A., and Kraljic, T. (2009). Perceptual learning for speech. Atten. Percept. Psychophys. 71, 1207-1218. doi: 10.3758/APP.71.6.1207
145. Samuel, A. G. (2011). Speech perception. Annu. Rev. Psychol. 62, 49-72. doi: 10.1146/annurev.psych.121208.131643
146. Schlerf, J., Ivry, R., and Diedrichsen, J. (2012). Encoding of sensory prediction errors in the human cerebellum. J. Neurosci. 32, 5913-5922. doi: 10.1523/JNEUROSCI.4504-11.2012
147. Schwab, E., Nusbaum, H., and Pisoni, D. (1985). Some effects of training on the perception of synthetic speech. Hum. Factors. 27, 395-408.
148. Scott, S. (2012). The neurobiology of speech perception and production-Can functional imaging tell us anything we did not already know? J. Commun. Sci. Disord. 45, 419-425. doi: 10.1016/j.jcomdis.2012.06.007
149. Scott, S. K., and Wise, R. J. S. (2004). The functional neuroanatomy of prelexical processing in speech perception. Cognition 92, 13-45. doi: 10.1016/j.cognition.2002.12.002
150. Sebastian-Galles, N., Dupoux, E., Costa, A., and Mehler, J. (2000). Adaptation to time-compressed speech: phonological determinants. Percept. Psychophys. 62, 834-842. doi: 10.3758/BF03206926
151. Seghier, M., Fagan, E., and Price, C. (2010). Functional subdivisions in the left angular gyrus where the semnatic system meets and diverges from the default network. J. Neurosci. 30, 16809-16817. doi: 10.1523/JNEUROSCI.3377-10.2010
152. Shadmehr, R., Smith, M., and Krakauer, J. (2010). Error correction, sensory prediction, and adaptation in motor control. Ann. Rev. Neurosci. 33, 89-108. doi: 10.1146/annurev-neuro-060909-153135
153. Shiller, D. M., Sato, M., Gracco, V. L., and Baum, S. R. (2009). Perceptual recalibra-tion of speech sounds following speech motor learning. J. Acoust. Soc. Am. 125, 1103-1113. doi: 10.1121/1.3058638
154. Skipper, J., Goldin-Meadown, S., Nusbaum, H., and Small, S. (2009). Gestures orchestrate brain networks for language understanding. Curr. Biol. 19, 661-667. doi: 10.1016/j.cub.2009.02.051
155. Sohoglu, E., Peelle, J., Carlyon, R., and Davis, M. H. (2012). Predictive top-down integration of prior knowledge during speech perception. J. Neurosci. 32, 8443-8453. doi: 10.1523/JNEUROSCI.5069-11.2012
156. Song, J., Skoe, E., Banai, K., and Kraus, N. (2011). Perception of speech in noise: neural correlates. J. Cogn. Neurosci. 23, 2268-2279. doi: 10.1162/jocn.2010.21556
157. Song, J. H., Banai, K., and Kraus, N. (2008). Brainstem timing deficits in children with learning impairment may result from corticofugal origins. Audiol. Neurotol. 13, 335-344. doi: 10.1159/000132689
158. Song, J. H., Skoe, E., Banai, K., and Kraus, N. (2012). Training to improve hearing speech in noise: biological mechanisms. Cereb. Cortex 22, 1180-1190. doi: 10.1093/cercor/bhr196
159. Spratling, M. W. (2008). Reconciling predictive coding and biased competition models of cortical function. Front. Comput. Neurosci. 2:4. doi: 10.3389/neuro.10.004.2008
160. Stoodley, C., and Schmahmann, J. (2009). Functional topogaphy in the human cerebellum: a meta-analysis of neuroimaging studies. Neuroimage 44, 489-501. doi: 10.1016/j.neuroimage.2008.08.039
161. Stoodley, C. J., Valera, E. M., and Schmahmann, J. D. (2012). Functional topography of the cerebellum for motor and cognitive tasks: an fMRI study. Neuroimage 59, 1560-1570. doi: 10.1016/j.neuroimage.2011.08.065
162. Strick, P., Dum, R., and Fiez, J. (2009). Cerebellum and nonmotor function. Annu. Rev. Neurosci. 32, 413-434. doi: 10.1146/annurev.neuro.31.060407. 125606
163. Szenkovitz, G., Peelle, J., Norris, D., and Davis, M. (2012). Individual differences in premotor and motor recruitment during speech perception. Neuropsychologia 50, 1380-1392. doi: 10.1016/j.neuropsychologia.2012.02.023
164. Thach, W. T. (1998). What is the role of the cerebellum in motor learning and cognition. Trends Cogn. Sci. (Regul. Ed) 2, 331-337. doi: 10.1016/S1364-6613(98)01223-6
165. Tian, X., and Poeppel, D. (2010). Mental imagery of speech and movement implicates the dynamics of internal forward models. Front. Psychol. 1:166. doi: 10.3389/fpsyg.2010.00166
166. Tian, X., and Poeppel, D. (2013). The effect of imagination on stimulation: the functional specificity of efference copies in speech processing. J. Cogn. Neurosci. 25, 1020-1036. doi: 10.1162/jocn_a_00381
167. Tricomi, E., Delgado, M., McCandliss, B., McClelland, J., and Fiez, J. (2006). Performance feedback drives caudate activation in a phonological learning task. J. Cogn. Neurosci. 18, 1029-1043. doi: 10.1162/jocn.2006.18.6.1029
168. Turken, A. U., and Dronkers, N. F. (2011). The neural architecture of the language comprehension network: converging evidence from lesion and connectivity analyses. Front. Syst. Neurosci. 5:1. doi: 10.3389/fnsys.2011.00001
169. Ungerleider, L., and Haxby, J. (1994). What and where in the human brain. Curr. Opin. Neurobiol. 4, 157-165. doi: 10.1016/0959-4388(94)90066-3
170. Villacorta, V., Perkell, J., and Guenther, F. (2007). Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. J. Acoust. Soc. Am. 22, 2306-2319. 10.1121/1.2773966
171. von Kriegstein, K., Dogan, O., Gruterm, M., Giraud, A., Kell, C., Gruter, T., et al. (2008). Simulation of talking faces in the human brain improves auditory speech recognition. Proc. Natl. Acad. Sci. U.S.A. 105, 6747-6752. 10.1073/pnas.0710826105
172. Vroomen, J., and Baart, M. (2012). "Phonetic recalibration in audiovisual speech," in The Neural Bases of Multisensory Processes, eds M. Murray and M. Wallace (Boca Raton, FL: CRC Press), 254-259.
173. Vroomen, J., van Linden, S., Degelder, B., and Bertelson, P. (2007). Visual recalibration and selective adaptation in auditory-visual speech perception: contrasting build-up courses. Neuropsychologia 45, 572-577. 10.1016/j.neuropsychologia.2006.01.031
174. Wild, C. J., Davis, M. H., and Johnsrude, I. S. (2012). Human auditory cortex is sensitive to the perceived clarity of speech. Neuroimage 60, 1490-1502. 10.1016/j.neuroimage.2012.01.035
175. Wild, C. J., Yusuf, A., Wilson, D. E., Peelle, J. E., Davis, M. H., and Johnsrude, I. S. (2012b). Effortful listening: the processing of degraded speech depends critically on attention. J. Neurosci. 32, 14010-14021. 10.1523/JNEUROSCI.1528-12.2012
176. Wolpert, D., Diedrichsen, J., and Flanagan, J. (2011). Principles of sensorimotor learning. Nat. Rev. Neurosci. 12, 739-751. 10.1038/nrn3112
177. Wolpert, D. M., Miall, R. C., and Kawato, M. (1998). Internal models in the cerebellum. Trends Cogn. Sci. 2, 338-346. 10.1016/S1364-6613(98) 01221-2
178. Yamamoto, K., Hoffman, D. S., and Strick, P. L. (2006). Rapid and long-lasting plasticity of input-output mapping. J. Neurophysiol. 96, 2797-2801. 10.1152/jn.00209.2006
179. Yu, K., Xu, W., and Gong, Y. (2008). "Deep learning with kernel regularization for visual recognition," in Advances in Neural Information Processing Systems, (Cupertino, CA), 1889-1896.
180. Zekveld, A., Rudner, M., Johnsrude, I., Eslenfeld, D., and Ronnberg, J. (2012). Behavioral and fMRI evidence that cognitive ability modulates the effect of semantic context on speech intelligibility. Brain Lang. (Baltim) 122, 103-113. doi: 10.1016/j.bandl.2012.05.006
181. Zheng, Z. Z., Vicente-Grabovetsky, A., MacDonald, E. N., Munhall, K. G., Cusack, R., and Johnsrude, I. S. (2013). Multivoxel patterns reveal functionally differentiated networks underlying auditory feedback processing of speech. J. Neurosci. 33, 4339-4348. doi: 10.1523/JNEUROSCI. 6319-11.2013