Multisensory training can promote or impede visual perceptual learning of speech stimuli: Visual-tactile vs. visual-auditory training

Frontiers in Human Neuroscience

Volumn 8, Issue October, 2014, Pages 1-23

  Eberhardt, Silvio P ^a   Auer, Edward T ^a   Bernstein, Lynne E ^a  

^a GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

Lipreading; Multisensory perception; Perceptual learning; Reverse hierarchy theory; Speech perception; Vibrotactile perception; Vocoded speech

Indexed keywords

ACOUSTICS; ADULT; ARTICLE; AUDIOVISUAL TRAINING; AUDITORY STIMULATION; COCHLEA PROSTHESIS; CONGENITAL DEAFNESS; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; LIP READING; MALE; MULTISENSORY REVERSE HIERARCHY THEORY; MULTISENSORY TRAINING; SENSORY SYSTEM; SPEECH; TACTILE STIMULATION; THEORY; VIDEORECORDING; VISUAL AUDITORY TRAINING; VISUAL PERCEPTUAL LEARNING; VISUAL STIMULATION;

EID: 84933674287     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00829     Document Type: Article

References (106)

1. Abla, D., and Okanoya, K. (2009). Visual statistical learning of shape sequences: an ERP study. Neurosci. Res. 64, 185-190. doi: 10.1016/j.neures.2009.02.013
2. Ahissar, M., and Hochstein, S. (1997). Task difficulty and the specificity of perceptual learning. Nature 387, 401-406. doi: 10.1038/387401a0
3. Ahissar, M., and Hochstein, S. (2004). The reverse hierarchy theory of visual perceptual learning. Trends Cogn. Sci. 8, 457-464. doi: 10.1016/j.tics.2004.08.011
4. Ahissar, M., Nahum, M., Nelken, I., and Hochstein, S. (2009). Reverse hierarchies and sensory learning. Philos. Trans. R. Soc. B Biol. Sci. 364, 285-299. doi: 10.1098/rstb.2008.0253
5. Alais, D., and Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257-262. doi: 10.1016/s0960-9822(04)00043-0
6. Aldenderfer, M. S., and Blashfield, R. K. (1984). Cluster Analysis. Beverly Hills, CA: Sage.
7. Auer, E. T. Jr., and Bernstein, L. E. (1997). Speechreading and the structure of the lexicon: computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness. J. Acoust. Soc. Am. 102, 3704-3710. doi: 10.1121/1.420402
8. Auer, E. T. Jr., and Bernstein, L. E. (2007). Enhanced visual speech perception in individuals with early-onset hearing impairment. J. Speech Lang. Hear. Res. 50, 1157-1165. doi: 10.1044/1092-4388(2007/080)
9. Bernstein, L. E. (2012). "Visual speech perception," in AudioVisual Speech Processing, eds E. Vatikiotis-Bateson, G. Bailly and P. Perrier (Cambridge: Cambridge University), 21-39.
10. Bernstein, L. E., Auer, E. T. Jr., Eberhardt, S. P., and Jiang, J. (2013). Auditory perceptual learning for speech perception can be enhanced by audiovisual training. Front. Neurosci. 7:34. doi: 10.3389/fnins.2013.00034
11. Bernstein, L. E., Auer, E. T. Jr., and Tucker, P. E. (2001). Enhanced speechreading in deaf adults: can short-term training/practice close the gap for hearing adults? J. Speech Lang. Hear. Res. 44, 5-18. doi: 10.1044/1092-4388(2001/001)
12. Bernstein, L. E., Demorest, M. E., Coulter, D. C., and O'Connell, M. P. (1991). Lipreading sentences with vibrotactile vocoders: performance of normal-hearing and hearing-impaired subjects. J. Acoust. Soc. Am. 90, 2971-2984. doi: 10.1121/1.401771
13. Bernstein, L. E., Demorest, M. E., and Tucker, P. E. (2000). Speech perception without hearing. Percept. Psychophys. 62, 233-252. doi: 10.3758/bf03205546
14. Bernstein, L. E., Eberhardt, S. P., and Auer, E. T. Jr. (2014). Audiovisual spoken word training can promote or impede auditory-only perceptual learning: results from prelingually deafened adults with late-acquired cochlear implants versus normal-hearing adults. Front. Psychol. 5:934. doi: 10.3389/fpsyg.2014.00934
15. Bernstein, L. E., Eberhardt, S. P., and Demorest, M. E. (1989). Single-channel vibrotactile supplements to visual perception of intonation and stress. J. Acoust. Soc. Am. 85, 397-405. doi: 10.1121/1.397690
16. Binder, J. R., Frost, J. A., Hammeke, T. A., Bellgowan, P. S., Springer, J. A., Kaufman, J. N., et al. (2000). Human temporal lobe activation by speech and nonspeech sounds. Cereb. Cortex 10, 512-528. doi: 10.1093/cercor/10.5.512
17. Binnie, C. A., Jackson, P. L., and Montgomery, A. A. (1976). Visual intelligibility of consonants: a lipreading screening test with implications for aural rehabilitation. J. Speech Hear. Disord. 41, 530-539. doi: 10.1044/jshd.4104.530
18. Bradlow, A. R., Akahane-Yamada, R., Pisoni, D. B., and Tohkura, Y. (1999). Training Japanese listeners to identify English /r/ and /l/: long-term retention of learning in perception and production. Percept. Psychophys. 61, 977-985. doi: 10.3758/bf03206911
19. Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., and David, A. S. (1999). Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10, 2619-2623. doi: 10.1097/00001756-199908200-00033
20. Conrad, R. (1977). Lip-reading by deaf and hearing children. Br. J. Educ. Psychol. 47, 60-65. doi: 10.1111/j.2044-8279.1977.tb03001.x
21. Davis, M. H., Johnsrude, I. S., Hervais-Adelman, A., Taylor, K., and McGettigan, C. (2005). Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. J. Exp. Psychol. Gen. 134, 222-241. doi: 10.1037/0096-3445.134.2.222
22. DeFilippo, C. L. (1984). Laboratory projects in tactile aids to lipreading. Ear Hear. 5, 211-227. doi: 10.1097/00003446-198407000-00006
23. DeFilippo, C. L., and Scott, B. L. (1978). A method for training and evaluating the reception of ongoing speech. J. Acoust. Soc. Am. 63, 1186-1192. doi: 10.1121/1.381827
24. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses and judgments. Neuron 57, 11-23. doi: 10.1016/j.neuron.2007.12.013
25. Eberhardt, S. P., Bernstein, L. E., Demorest, M. E., and Goldstein, M. H. Jr. (1990). Speechreading sentences with single-channel vibrotactile presentation of voice fundamental frequency. J. Acoust. Soc. Am. 88, 1274-1285. doi: 10.1121/1.399704
26. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433. doi: 10.1038/415429a
27. Falchier, A., Cappe, C., Barone, P., and Schroeder, C. E. (2012). "Sensory convergence in low-level cortices," in The New Handbook of Multisensory Processing, ed B. E. Stein (Cambridge, MA: MIT), 67-79.
28. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex.Cereb. Cortex 1, 1-47. doi: 10.1093/cercor/1.1.1
29. Foxe, J. J., and Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16, 419-423. doi: 10.1097/00001756-200504040-00001
30. Gault, R. H. (1924). Progress in experiments in tactile interpretation of oral speech. J. Abnorm. Soc. Psychol. 19, 155-159. doi: 10.1037/h0065752
31. Gesi, A. T., Massaro, D. W., and Cohen, M. M. (1992). Discovery and expository methods in teaching visual consonant and word identification. J. Speech Hear. Res. 35, 1180-1188. doi: 10.1044/jshr.3505.1180
32. Ghazanfar, A. A., Chandrasekaran, C., and Logothetis, N. K. (2008). Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integratn in Rhesus mondeys. J. Neurosci. 28, 4457-4469. doi: 10.1523/JNEUROSCI.0541-08.2008
33. Ghazanfar, A. A., and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Cogn. Sci. 10, 278-285. doi: 10.1016/j.tics.2006.04.008
34. Giraud, A.-L., Price, C. J., Graham, J. M., Truy, E., and Frackowiak, S. J. (2001). Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron 30, 657-663. doi: 10.1016/S0896-6273(01)00318-X
35. Goldstone, R. L. (1998). Perceptual learning. Annu. Rev. Psychol. 49, 585-612. doi: 10.1146/annurev.psych.49.1.585
36. Hardison, D. M. (2003). Acquisition of second-language speech: effects of visual cues, context and talker variability. Appl. Psycholinguist. 24, 495-522. doi: 10.1017/s0142716403000250
37. Hazan, V., Sennema, A., Faulkner, A., Ortega-Llebaria, M., Iba, M., and Chunge, H. (2006). The use of visual cues in the perception of non-native consonant contrasts. J. Acoust. Soc. Am. 119, 1740-1751. doi: 10.1121/1.2166611
38. Heider, F., and Heider, G. M. (1940). An experimental investigation of lipreading. Psychol. Monogr. 52, 124-153. doi: 10.1037/h0093465
39. Hervais-Adelman, A., Davis, M. H., Johnsrude, I. S., Taylor, K. J., and Carlyon, R. P. (2011). Generalization of perceptual learning of vocoded speech. J. Exp. Psychol. Hum. Percept. Perform. 37, 293-295. doi: 10.1037/a0020772
40. Hochstein, S., and Ahissar, M. (2002). View from the top: hierarchies and reverse hierarchies in the visual system.Neuron 36, 791-804. doi: 10.1016/S0896-6273(02)01091-7
41. Hubel, D. H., and Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160, 106-154.
42. Huyse, A., Berthommier, F., and Leybaert, J. (2013). Degradation of labial information modifies audiovisual speech perception in cochlear-implanted children. Ear Hear. 34, 110-121. doi: 10.1097/AUD.0b013e3182670993
43. IEEE. (1969). Recommended practice for speech quality measurements. IEEE Trans. Audio. Electroacoustics 17, 225-246. doi: 10.1109/TAU.1969.1162058
44. Iverson, P., Bernstein, L. E., and Auer, E. T. Jr. (1998). Modeling the interaction of phonemic intelligibility and lexical structure in audiovisual word recognition. Speech Commun. 26, 45-63. doi: 10.1016/s0167-6393(98)00049-1
45. Jeffers, J., and Barley, M. (1971). Speechreading (Lipreading). Springfield, IL: Charles C. Thomas.
46. Jiang, J., Alwan, A., Keating, P., Auer, E. T. Jr., and Bernstein, L. E. (2002). On the relationship between face movements, tongue movements and speech acoustics. EURASIP J. Appl. Signal Process. Spec. Issue Jt. Audio Vis. Speech Process. 2002, 1174-1188. doi: 10.1155/s1110865702206046
47. Jiang, J., and Bernstein, L. E. (2011). Psychophysics of the McGurk and other audiovisual speech integration effects. J. Exp. Psychol. Hum. Percept. Perform. 37, 1193-1209. doi: 10.1037/a0023100
48. Jiang, X., Bradley, E. D., Rini, R. A., Zeffiro, T., VanMeter, J., and Riesenhuber, M. (2007). Categorization training results in shape- and category-selective human neural plasticity. Neuron 53, 891-903. doi: 10.1016/j.neuron.2007.02.015
49. Kaas, J. H., and Hackett, T. A. (2000). Subdivisions of auditory cortex and processing streams in primates. Proc. Natl. Acad. Sci. U S A 97, 11793-11799. doi: 10.1073/pnas.97.22.11793
50. Kayser, C., Petkov, C. I., Remedios, R., and Logothetis, N. K. (2012). "Multisensory influences on auditory processing: perspectives from fMRI and electrophysiology," in The Neural Bases of Multisensory Processes, eds M. M. Murray and M. T. Wallace (Boca Raton, FL: CRC Press), Chapter 6.
51. Kello, C. T., and Bernstein, L. E. (2000). Phonetic structure is similar across auditory and vibrotactile speech perception. J. Acoust. Soc. Am. 107, 2888. doi: 10.1121/1.428735
52. Kirman, J. H. (1973). Tactile communication of speech: a review and an analysis. Psychol. Bull. 80, 54-74. doi: 10.1037/h0034630
53. Kishon-Rabin, L., Boothroyd, A., and Hanin, L. (1996). Speechreading enhancement: a comparison of spatial-tactile display of voice fundamental frequency (F0) with auditory F0. J. Acoust. Soc. Am. 100, 593-602. doi: 10.1121/1.415885
54. Kral, A., and Eggermont, J. J. (2007). What's to lose and what's to learn: development under auditory deprivation, cochlear implants and limits of cortical plasticity. Brain Res. Rev. 56, 259-269. doi: 10.1016/j.brainresrev.2007.07.021
55. Kral, A., and Sharma, A. (2012). Developmental neuroplasticity after cochlear implantation. Trends Neurosci. 35, 111-122. doi: 10.1016/j.tins.2011.09.004
56. Logothetis, N. K., and Sheinberg, D. L. (1996). Visual object recognition. Annu. Rev. Neurosci. 19, 577-621. doi: 10.1146/annurev.neuro.19.1.577
57. Massaro, D. W. (1987). Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
58. Massaro, D. W., Cohen, M. M., and Gesi, A. T. (1993). Long-term training, transfer and retention in learning to lipread. Percept. Psychophys. 53, 549-562. doi: 10.3758/bf03205203
59. Massaro, D. W., Cohen, M. M., Tabain, M., Beskow, J., and Clark, R. (2012). "Animated speech: research progress and applications," in Audiovisual Speech Processing, eds G. Bailly, P. Perrier and E. Vatikiotis-Bateson (Cambridge: Cambridge University Press), 309-345.
60. Merabet, L. B., Rizzo, J. R., Amedi, A., Somers, D. C., and Pascual-Leone, A. (2005). What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses. Nat. Rev. Neurosci. 6, 71-77. doi: 10.1038/nrn1586
61. Miyamoto, R. T., Robbins, A. M., Osberger, M. J., Todd, S. L., Riley, A. I., and Kirk, K. I. (1995). Comparison of multichannel tactile aids and multichannel cochlear implants in children with profound hearing impairments. Am. J. Otol. 16, 8-13.
62. Mogford, K. (1987). "Lip-reading in the prelingually deaf," in Hearing by Eye: The Psychology of Lip-Reading, eds B. Dodd and R. Campbell (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc), 191-211.
63. Mohammed, T., Campbell, R., MacSweeney, M., Milne, E., Hansen, P., and Coleman, M. (2005). Speechreading skill and visual movement sensitivity are related in deaf speechreaders. Perception 34, 205-216. doi: 10.1068/p5211
64. Moody-Antonio, S., Takayanagi, S., Masuda, A., Auer, J. E. T., Fisher, L., and Bernstein, L. E. (2005). Improved speech perception in adult prelingually deafened cochlear implant recipients. Otol. Neurotol. 26, 649-654. doi: 10.1097/01.mao.0000178124.13118.76
65. Nahum, M., Nelken, I., and Ahissar, M. (2008). Low-level information and high-level perception: the case of speech in noise. PLoS Biol. 6, 978-991. doi: 10.1371/journal.pbio.0060126
66. Nahum, M., Nelken, I., and Ahissar, M. (2010). Stimulus uncertainty and perceptual learning: similar principles govern auditory and visual learning. Vision Res. 50, 391-401. doi: 10.1016/j.visres.2009.09.004
67. Nath, A. R., and Beauchamp, M. S. (2011). Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J. Neurosci. 31, 1704-1714. doi: 10.1523/JNEUROSCI.4853-10.2011
68. Navarra, J., Soto-Faraco, S., and Spence, C. (2014). Discriminating speech rhythms in audition, vision and touch.Acta Psychol. (Amst) 151C, 197-205. doi: 10.1016/j.actpsy.2014.05.021
69. Nitchie, E. B. (1912). Lipreading Principles and Practice. New York: Frederick A. Stokes Co.
70. Nygaard, L. C., and Pisoni, D. B. (1998). Talker-specific learning in speech perception. Percept. Psychophys. 60, 355-376. doi: 10.3758/bf03206860
71. Obleser, J., Zimmermann, J., Van Meter, J., and Rauschecker, J. P. (2007). Multiple stages of auditory speech perception reflected in event-related FMRI. Cereb. Cortex 17, 2251-2257. doi: 10.1093/cercor/bhl133
72. Pilling, M., and Thomas, S. (2011). Audiovisual cues and perceptual learning of spectrally distorted speech. Lang. Speech 54(Pt. 4), 487-497. doi: 10.1177/0023830911404958
73. Proulx, M. J., Brown, D. J., Pasqualotto, A., and Meijer, P. (2014). Multisensory perceptual learning and sensory substitution. Neurosci. Biobehav. Rev. 41, 16-25. doi: 10.1016/j.neubiorev.2012.11.017
74. Reed, C. M., Durlach, N. I., and Braida, L. D. (1982). Research on tactile communication of speech: a review. ASHA Monogr. 20, 1-23.
75. Rönnberg, J., Samuelsson, S., and Lyxell, B. (1998). "Contextual constraints in sentence-based lipreading in the hearing-impaired," in Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech, eds R. Campbell, B. Dodd and D. Burnham (Hove: Psychology Press), 143-154.
76. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., and Foxe, J. J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17, 1147-1153. doi: 10.1093/cercor/bhl024
77. Rouger, J., Fraysse, B., Deguine, O., and Barone, P. (2008). McGurk effects in cochlear-implanted deaf subjects.Brain Res. 1188, 87-99. doi: 10.1016/j.brainres.2007.10.049
78. Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O., and Barone, P. (2007). Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc. Natl. Acad. Sci. U S A 104, 7295-7300. doi: 10.1073/pnas.0609419104
79. Saffran, J. R., Aslin, R. N., and Newport, E. L. (1996). Statistical learning by 8-month-old infants. Science 274, 1926-1928. doi: 10.1126/science.274.5294.1926
80. Samuel, A. G., and Kraljic, T. (2009). Perceptual learning for speech. Atten. Percept. Psychophys. 71, 1207-1218. doi: 10.3758/APP.71.6.1207
81. Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., and Puce, A. (2008). Neuronal oscillations and visual amplification of speech. Trends Cogn. Sci. 12, 106-113. doi: 10.1016/j.tics.2008.01.002
82. Schwartz, J. L., and Savariaux, C. (2014). No, there is no 150 ms lead of visual speech on auditory speech, but a range of audiovisual asynchronies varying from small audio lead to large audio lag. PLoS Comput. Biol.10:e1003743. doi: 10.1371/journal.pcbi.1003743
83. Shams, L., and Kim, R. (2010). Crossmodal influences on visual perception. Phys. Life Rev. 7, 269-284. doi: 10.1016/j.plrev.2010.04.006
84. Shams, L., and Seitz, A. R. (2008). Benefits of multisensory learning. Trends Cogn. Sci. 12, 411-417. doi: 10.1016/j.tics.2008.07.006
85. Shams, L., Wozny, D. R., Kim, R., and Seitz, A. (2011). Influences of multisensory experience on subsequent unisensory processing. Front. Psychol. 18:264. doi: 10.3389/fpsyg.2011.00264
86. Stevens, K. N. (1998). Acoustic Phonetics. Cambridge, MA: MIT Press.
87. Summerfield, Q. (1991). "Visual perception of phonetic gestures," in Modularity and the Motor Theory of Speech Perception, eds I. G. Mattingly and M. Studdert-Kennedy (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc), 117-137.
88. Summers, I. R. (1992). Tactile Aids for the Hearing Impaired. London: Whurr.
89. Tye-Murray, N., Hale, S., Spehar, B., Myerson, J., and Sommers, M. S. (2014). Lipreading in school-age children: the roles of age, hearing status and cognitive ability. J. Speech Lang. Hear. Res. 57, 556-565. doi: 10.1044/2013_JSLHR-H-12-0273
90. Ungerleider, L. G., and Haxby, J. V. (1994). 'What' and 'where' in the human brain. Curr. Opin. Neurobiol. 4, 157-165. doi: 10.1016/0959-4388(94)90066-3
91. Utley, J. (1946). Factors involved in the teaching and testing of lipreading ability through the use of motion pictures. Volta Rev. 48, 657-659.
92. van Wassenhove, V. (2013). Speech through ears and eyes: interfacing the senses with the supramodal brain. Front. Psychol. 4:388. doi: 10.3389/fpsyg.2013.00388
93. Vroomen, J., and Baart, M. (2012). "Phonetic recalibration in audiovisual speech," in The Neural Bases of Multisensory Processes, eds M. M. Murray and M. T. Wallace (Boca Raton, FL: CRC Press), Chapter 19.
94. Vroomen, J., van Linden, S., de Gelder, B., and Bertelson, P. (2007). Visual recalibration and selective adaptation in auditory-visual speech perception: contrasting build-up courses. Neuropsychologia 45, 572-577. doi: 10.1016/j.neuropsychologia.2006.01.031
95. Walden, B. E., Erdman, S. A., Montgomery, A. A., Schwartz, D. M., and Prosek, R. A. (1981). Some effects of training on speech recognition by hearing-impaired adults. J. Speech Hear. Res. 24, 207-216. doi: 10.1044/jshr.2402.207
96. Walden, B. E., Prosek, R. A., Montgomery, A. A., Scherr, C. K., and Jones, C. J. (1977). Effects of training on the visual recognition of consonants. J. Speech Hear. Res. 20, 130-145. doi: 10.1044/jshr.2001.130
97. Waldstein, R. S., and Boothroyd, A. (1995). Speechreading supplemented by single-channel and multi-channel displays of voice fundamental frequency. J. Speech Hear. Res. 38, 690-705. doi: 10.1044/jshr.3803.690
98. Wayne, R. V., and Johnsrude, I. S. (2012). The role of visual speech information in supporting perceptual learning of degraded speech. J. Exp. Psychol. Appl. 18, 419-435. doi: 10.1037/a0031042
99. Weisenberger, J. M., Broadstone, S. M., and Kozma-Spytek, L. (1991). Relative performance of single-channel and multichannel tactile aids for speech perception. J. Rehabil. Res. Dev. 28, 45-56. doi: 10.1682/jrrd.1991.04.0045
100. Weisenberger, J. M., Broadstone, S. M., and Saunders, F. A. (1989). Evaluation of two multichannel tactile aids for the hearing impaired. J. Acoust. Soc. Am. 86, 1764-1775. doi: 10.1121/1.398608
101. Williams, P., and Simons, D. (2000). Detecting changes in novel, complex three-dimensional objects. Vis. Cogn. 7, 297-322. doi: 10.1080/135062800394829
102. Wilson, B. S., Dorman, M. F., Woldorff, M. G., and Tucci, D. L. (2011). Cochlear implants matching the prosthesis to the brain and facilitating desired plastic changes in brain function. Prog. Brain Res. 194, 117-129. doi: 10.1016/B978-0-444-53815-4.00012-1
103. Yehia, H., Rubin, P., and Vatikiotis-Bateson, E. (1998). Quantitative association of vocal-tract and facial behavior.Speech Commun. 26, 23-43. doi: 10.1016/s0167-6393(98)00048-x
104. Zeki, S. (2005). The ferrier lecture 1995: behind the seen: the functional specialization of the brain in space and time. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 1145-1183. doi: 10.1098/rstb.2005.1666
105. Zeng, F.-G., Popper, A. N., and Fay, R. R. (2004). Cochlear Implants: Auditory Prostheses and Electrical Hearing.NY: Springer.
106. Zilber, N., Ciuciu, P., Gramfort, A., Azizi, L., and van Wassenhove, V. (2014). Supramodal processing optimizes visual perceptual learning and plasticity. Neuroimage 93(Pt. 1), 32-46. doi: 10.1016/j.neuroimage.2014.02.017