Exploring the Roles of Spectral Detail and Intonation Contour in Speech Intelligibility: An fMRI Study

Journal of Cognitive Neuroscience

Volumn 26, Issue 8, 2014, Pages 1748-1763

  Kyong, Jeong S ^a   Scott, Sophie K ^a   Rosen, Stuart ^a   Howe, Timothy B ^a   Agnew, Zarinah K ^a   McGettigan, Carolyn ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMISPHERIC DOMINANCE; HUMAN; PITCH; PRIORITY JOURNAL; SIGNAL PROCESSING; SOUND; SPEECH; SPEECH INTELLIGIBILITY; SUPERIOR TEMPORAL GYRUS; TEMPORAL LOBE; ADOLESCENT; BRAIN MAPPING; HEARING; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; SPEECH PERCEPTION; YOUNG ADULT;

ADOLESCENT; ADULT; BRAIN MAPPING; HUMANS; MAGNETIC RESONANCE IMAGING; MIDDLE AGED; PITCH PERCEPTION; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TEMPORAL LOBE; YOUNG ADULT;

EID: 84903375668     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00583     Document Type: Article

References (63)

1. Baum, S. R., & Pell, M. D. (1999). The neural bases of prosody: Insights from lesion studies and neuroimaging. Aphasiology, 13, 581-608.
2. Belin, P., & Zatorre, R. J. (2000). "What, " "where" and "how" in auditory cortex. Nature Neuroscience, 3, 965-966.
3. Belin, P., & Zatorre, R. J. (2003). Adaptation to speaker's voice in right anterior temporal lobe. NeuroReport, 14, 2105-2109.
4. Belin, P., Zatorre, R. J., & Ahad, P. (2002). Human temporal-lobe response to vocal sounds. Cognitive Brain Research, 13, 17-26.
5. Bench, J., Kowal, A., & Bamford, J. (1979). The BKB (Bamford-Kowal-Bench) sentence lists for partially-hearing children. British Journal of Audiology, 13, 108-112.
6. Bestelmeyer, P. E. G., Belin, P., & Grosbras, M.-H. (2011). Right temporal TMS impairs voice detection. Current Biology, 21, R838-R839.
7. Binns, C., & Culling, J. F. (2007). The role of fundamental frequency contours in the perception of speech against interfering speech. Journal of the Acoustical Society of America, 122, 1765-1776.
8. Bozic, M., Tyler, L. K., Ives, D. T., Randall, B., & Marslen-Wilson, W. D. (2010). Bihemispheric foundations for human speech comprehension. Proceedings of the National Academy of Sciences, U.S.A., 107, 17439-17444.
9. Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10, 433-436.
10. Braun, B., Dainora, A., & Ernestus, M. (2011). An unfamiliar intonation contour slows down on-line speech comprehension. Language and Cognitive Processes, 26, 350-375.
11. Brett, M., Anton, J., Valabregue, R., & Poline, J. (2002). Region of interest analysis using an SPM toolbox. 8th International Conference on Functional Mapping of the Human Brain, June 2-6, 2002; Sendai, Japan. Available in CD-ROM in Neuroimage (Vol 16, No. 2). Abstract 497.
12. Carroll, J., Tiaden, S., & Zeng, F. G. (2011). Fundamental frequency is critical to speech perception in noise in combined acoustic and electric hearing. Journal of the Acoustical Society of America, 130, 2054-2062.
13. Cruttenden, A. (1986). Intonation. Cambridge, UK: Cambridge University Press.
14. Cutler, A., Dahan, D., & van Donselaar, W. (1997). Prosody in the comprehension of spoken language: A literature review. Language and Speech, 40, 141-201.
15. Davis, M. H., & Johnsrude, I. S. (2003). Hierarchical processing in spoken language comprehension. Journal of Neuroscience, 23, 3423-3431.
16. Dudley, H. (1939). Remaking speech. Journal of the Acoustical Society of America, 11, 169-177.
17. Edmister, W. B., Talavage, T. M., Ledden, P. J., & Weisskoff, R. M. (1999). Improved auditory cortex imaging using clustered volume acquisitions. Human Brain Mapping, 7, 89-97.
18. Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., et al. (2005). A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage, 25, 1325-1335.
19. Eisner, F., McGettigan, C., Faulkner, A., Rosen, S., & Scott, S. K. (2010). Inferior frontal gyrus activation predicts individual differences in perceptual learning of cochlear-implant simulations. Journal of Neuroscience, 30, 7179-7186.
20. Evans, S., Kyong, J., Rosen, S., Golestani, N., Warren, J. E., McGettigan, C., et al. (2013). The pathways for intelligible speech: Multivariate and univariate perspectives. Cerebral Cortex. doi: dx.doi.org/doi:10.1093/cercor/bht083
21. Gandour, J., Tong, Y., Wong, D., Talavage, T., Dzemidzic, M., Xu, Y., et al. (2004). Hemispheric roles in the perception of speech prosody. Neuroimage, 23, 344-357.
22. Gfeller, K., Turner, C., Oleson, J., Zhang, X., Gantz, B., Froman, R., et al. (2007). Accuracy of cochlear implant recipients on pitch perception, melody recognition, and speech reception in noise. Ear and Hearing, 28, 412-423.
23. Green, T., Faulkner, A., & Rosen, S. (2004). Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. Journal of the Acoustical Society of America, 116, 2298-2310.
24. Greenwood, D. D. (1990). A cochlear frequency-position function for several species-29 years later. Journal of the Acoustical Society of America, 87, 2592-2605.
25. Hall, D. A., Haggard, M. P., Akeroyd, M. A., Palmer, A. R., Summerfield, A. Q., Elliott, M. R., et al. (1999). "Sparse" temporal sampling in auditory fMRI. Human Brain Mapping, 7, 213-223.
26. Hart, J. T., Collier, R., & Cohen, A. (1990). A perceptual study of intonation. An experimental-phonetic approach to intonation. Cambridge, UK: Cambridge University Press.
27. Hickok, G., & Poeppel, D. (2007). Opinion-The cortical organization of speech processing. Nature Reviews Neuroscience, 8, 393-402.
28. Johnsrude, I. S., Penhune, V. B., & Zatorre, R. J. (2000). Functional specificity in the right human auditory cortex for perceiving pitch direction. Brain, 123, 155-163.
29. Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999). Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds. Speech Communication, 27, 187-207.
30. Kriegstein, K. V., & Giraud, A. L. (2004). Distinct functional substrates along the right superior temporal sulcus for the processing of voices. Neuroimage, 22, 948-955.
31. Ladd, R. D. (1996). Intonational phonology (Vol. 79). Cambridge, UK: Cambridge University Press.
32. McGettigan, C., Eisner, F., Agnew, Z. K., Manly, T., Wisbey, D., & Scott, S. K. (2013). T'ain't what you say, it's the way that you say it-Left insula and inferior frontal cortex work in interaction with superior temporal regions to control the performance of vocal impersonations. Journal of Cognitive Neuroscience, 25, 1875-1886.
33. McGettigan, C., Evans, S., Rosen, S., Agnew, Z. K., Shah, P., & Scott, S. K. (2012). An application of univariate and multivariate approaches in fMRI to quantifying the hemispheric lateralization of acoustic and linguistic processes. Journal of Cognitive Neuroscience, 24, 636-652.
34. McGettigan, C., Faulkner, A., Altarelli, I., Obleser, J., Baverstock, H., & Scott, S. K. (2012). Speech comprehension aided by multiple modalities: Behavioural and neural interactions. Neuropsychologia, 50, 762-776.
35. McGettigan, C., & Scott, S. K. (2012). Cortical asymmetries in speech perception: What's wrong, what's right and what's left? Trends in Cognitive Sciences, 16, 269-276.
36. Meister, H., Landwehr, M., Pyschny, V., Grugel, L., & Walger, M. (2011). Use of intonation contours for speech recognition in noise by cochlear implant recipients. Journal of the Acoustical Society of America, 129, E204-E209.
37. Meister, H., Landwehr, M., Pyschny, V., Wagner, P., & Walger, M. (2011). The perception of sentence stress in cochlear implant recipients. Ear and Hearing, 32, 459-467.
38. Meister, H., Landwehr, M., Pyschny, V., Walger, M., & Wedel, H. V. (2009). The perception of prosody and speaker gender in normal-hearing listeners and cochlear implant recipients. International Journal of Audiology, 48, 38-48.
39. Meyer, M., Alter, K., Friederici, A. D., Lohmann, G., & von Cramon, D. Y. (2002). fMRI reveals brain regions mediating slow prosodic modulations in spoken sentences. Human Brain Mapping, 17, 73-88.
40. Miller, S. E., Schlauch, R. S., & Watson, P. J. (2010). The effects of fundamental frequency contour manipulations on speech intelligibility in background noise. Journal of the Acoustical Society of America, 128, 435-443.
41. Nakata, T., Trehub, S. E., & Kanda, Y. (2012). Effect of cochlear implants on children's perception and production of speech prosody. Journal of the Acoustical Society of America, 131, 1307-1314.
42. Narain, C., Scott, S. K., Wise, R. J., Rosen, S., Leff, A., Iversen, S. D., et al. (2003). Defining a left-lateralized response specific to intelligible speech using fMRI. Cerebral Cortex, 13, 1362-1368.
43. Nooteboom, S. (1997). The prosody of speech: Melody and rhythm. The Handbook of Phonetic Sciences, 5, 640-673.
44. Okada, K., Rong, F., Venezia, J., Matchin, W., Hsieh, I. H., Saberi, K., et al. (2010). Hierarchical organization of human auditory cortex: Evidence from acoustic invariance in the response to intelligible speech. Cerebral Cortex, 20, 2486-2495.
45. Peelle, J. E., Gross, J., & Davis, M. H. (2013). Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cerebral Cortex, 23, 1378-1387.
46. Poeppel, D. (2003). The analysis of speech in different temporal integration windows: Cerebral lateralization as "asymmetric sampling in time. " Speech Communication, 41, 245-255.
47. Rosen, S., Wise, R. J. S., Chadha, S., Conway, E.-J., & Scott, S. K. (2011). Hemispheric asymmetries in speech perception: Sense, nonsense and modulations. PloS One, 6, e24672.
48. Rubinstein, J. T. (2004). How cochlear implants encode speech. Current Opinion in Otolaryngology & Head and Neck Surgery, 12, 444-448.
49. Sammler, D., Kotz, S. A., Eckstein, K., Ott, D. V. M., & Friederici, A. D. (2010). Prosody meets syntax: The role of the corpus callosum. Brain, 133, 2643-2655.
50. Scott, S. K., Blank, C. C., Rosen, S., & Wise, R. J. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain, 123, 2400-2406.
51. Scott, S. K., & Johnsrude, I. S. (2003). The neuroanatomical and functional organization of speech perception. Trends in Neurosciences, 26, 100-107.
52. Scott, S. K., Rosen, S., Lang, H., & Wise, R. J. S. (2006). Neural correlates of intelligibility in speech investigated with noise vocoded speech-A positron emission tomography study. Journal of the Acoustical Society of America, 120, 1075-1083.
53. Seghier, M. L. (2008). Laterality index in functional MRI: Methodological issues [Review]. Magnetic Resonance Imaging, 26, 594-601.
54. Slotnick, S. D., Moo, L. R., Segal, J. B., & Hart, J. (2003). Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Cognitive Brain Research, 17, 75-82.
55. Sohoglu, E., Peelle, J. E., Carlyon, R. P., & Davis, M. H. (2012). Predictive top-down integration of prior knowledge during speech perception. Journal of Neuroscience, 32, 8443-8453.
56. Tong, Y., Gandour, J., Talavage, T., Wong, D., Dzemidzic, M., Xu, Y., et al. (2005). Neural circuitry underlying sentence-level linguistic prosody. Neuroimage, 28, 417-428.
57. von Kriegstein, K., Eger, E., Kleinschmidt, A., & Giraud, A. L. (2003). Modulation of neural responses to speech by directing attention to voices or verbal content. Cognitive Brain Research, 17, 48-55.
58. von Kriegstein, K., Kleinschmidt, A., Sterzer, P., & Giraud, A. L. (2005). Interaction of face and voice areas during speaker recognition. Journal of Cognitive Neuroscience, 17, 367-376.
59. Warren, J. E., Wise, R. J., & Warren, J. D. (2005). Sounds do-able: Auditory-motor transformations and the posterior temporal plane. Trends in Neurosciences, 28, 636-643.
60. Watson, P. J., & Schlauch, R. S. (2009). Fundamental frequency variation with an electrolarynx improves speech understanding: A case study. American Journal of Speech-Language Pathology, 18, 162-167.
61. Wilke, M., & Schmithorst, V. J. (2006). A combined bootstrap/ histogram analysis approach for computing a lateralization index from neuroimaging data. Neuroimage, 33, 522-530.
62. Zatorre, R. J., & Baum, S. R. (2012). Musical melody and speech intonation: Singing a different tune? Plos Biology, 10, e1001372.
63. Zatorre, R. J., & Belin, P. (2001). Spectral and temporal processing in human auditory cortex. Cerebral Cortex, 11, 946-953.