Recognizing speech under a processing load: Dissociating energetic from informational factors

Cognitive Psychology

Volumn 59, Issue 3, 2009, Pages 203-243

  Mattys, Sven L ^a   Brooks, Joanna ^b   Cooke, Martin ^c,d  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c BASQUE FOUNDATION FOR SCIENCE   (Spain)

^d UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Energetic masking; Informational masking; Processing load; Psycholinguistics; Speech segmentation; Spoken word recognition

Indexed keywords

ARTICLE; ASSOCIATION; ATTENTION; AUDITORY STIMULATION; HUMAN; LINGUISTICS; NOISE; PERCEPTION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; RECOGNITION; SPEECH; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

ACOUSTIC STIMULATION; ATTENTION; CUES; HUMANS; NOISE; PERCEPTUAL MASKING; PSYCHOLINGUISTICS; PSYCHOMOTOR PERFORMANCE; RECOGNITION (PSYCHOLOGY); SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

EID: 69549107660     PISSN: 00100285     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cogpsych.2009.04.001     Document Type: Article

References (91)

1. ANSI (1997). American national standard methods for calculation of the speech intelligibility index. ANSI/ASA S3.5-1997.
2. Aydelott J., and Bates E. Effects of acoustic distortion and semantic context on lexical access. Language and Cognitive Processes 19 (2004) 29-56
3. Baayen R.H., Davidson D.J., and Bates D.M. Mixed-effects modelling with crossed random effects for subject and items. Journal of Memory and Language 59 (2008) 390-412
4. Baayen R.H., Piepenbrock R., and Gulikers L. The CELEX Lexical Database (Release 2) [CD-ROM] (1995), Linguistic Data Consortium, University of Pennsylvania, Philadelphia, PA [Distributor]
5. Baddeley A.D., and Hitch G.J. Working memory. In: Bower G.A. (Ed). The psychology of learning and motivation: Advances in research and theory Vol. 8 (1974), Academic Press, New York 47-89
6. Barker J., and Cooke M.P. Modelling speaker intelligibility in noise. Speech Communication 49 (2007) 402-417
7. Binns C., and Culling J.F. The role of fundamental frequency contours in the perception of speech against interfering speech. Journal of the Acoustical Society of America 122 (2007) 1765-1776
8. Bortfeld H., Morgan J., Golinkoff R.M., and Rathburn K. Mommy and me: Familiar names help launch babies into speech-stream segmentation. Psychological Science 16 (2005) 298-304
9. Bradlow A.R., and Alexander J.A. Semantic-contextual and acoustic-phonetic enhancements for English sentence-in-noise recognition by native and non-native listeners. Journal of the Acoustical Society of America 121 (2007) 2339-2349
10. Bregman A.S. Auditory scene analysis: The perceptual organization of sound (1990), MIT Press, Cambridge, MA
11. Brent M.R. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning 34 (1999) 71-106
12. Bronkhorst A.W., and Plomp R. Effect of multiple speech-like maskers on binaural speech recognition in normal and impaired hearing. Journal of the Acoustical Society of America 92 (1992) 3132-3139
13. Brungart D.S. Informational and energetic masking effects in the perception of two simultaneous talkers. Journal of the Acoustical Society of America 109 (2001) 1101-1109
14. Brungart D.S., and Simpson B.D. Within-ear and across-ear interference in a cocktail-party listening task. Journal of the Acoustical Society of America 112 (2002) 2985-2995
15. Carhart R., Johnson C., and Goodman J. Perceptual masking of spondees by combinations of talkers. Journal of the Acoustical Society of America 58 (1975) 535
16. Carhart R., Tillman T.W., and Johnson K.R. Effect of interaural time delays on masking by two competing signals. Journal of the Acoustical Society of America 43 (1968) 1223-1230
17. Cherry E.C. Some experiments on the recognition of speech, with one and with two ears. Journal of the Acoustical Society of America 25 (1953) 975-979
18. Coleman J.S. Discovering the acoustic correlates of phonological contrasts. Journal of Phonetic 31 (2003) 351-372
19. Cooke M. A glimpsing model of speech perception in noise. Journal of the Acoustical Society of America 119 (2006) 1562-1573
20. Cooke M.P., Garcia Lecumberri M.L., and Barker J. The foreign language cocktail effect party problem: Energetic and informational masking effects in non-native speech perception. Journal of the Acoustical Society of America 123 (2008) 414-427
21. Cooke M.P., Green P.D., Josifovski L.B., and Vizinho A. Robust automatic speech recognition with missing and uncertain acoustic data. Speech Communication 34 (2001) 267-285
22. Cutler A., and Butterfield S. Rhythmic cues to speech segmentation: Evidence from juncture misperception. Journal of Memory and Language 31 (1992) 218-236
23. Cutler A., Mehler J., Norris D., and Segui J. Phoneme identification and the lexicon. Cognitive Psychology 19 (1987) 141-177
24. Dahan D., and Brent M.R. On the discovery of novel word-like units from utterances: An artificial-language study with implications for native-language acquisition. Journal of Experimental Psychology: General 128 (1999) 165-185
25. Davis M.H. Connectionist modelling of lexical segmentation and vocabulary acquisition. In: Quinlan P.T. (Ed). Connectionist models of development: Developmental processes in real and artificial neural networks (2003), Psychology Press, Hove, UK 151-187
26. Davis M.H., and Johnsrude I.S. Hearing speech sounds: Top-down influences on the interface between audition and speech perception. Hearing Research 229 (2007) 132-147
27. Dilley L., Shattuck-Hufnagel S., and Ostendorf M. Glottalization of word-initial vowels as a function of prosodic structure. Journal of Phonetics 24 (1996) 423-444
28. Durlach N. Auditory masking: Need for improved conceptual structure. Journal of the Acoustical Society of America 120 (2006) 1787-1790
29. Eimas P.D., Marcovitz Hornstein S.B., and Payton P. Attention and the role of dual codes ion phoneme monitoring. Journal of Memory and Language 29 (1990) 160-180
30. Fernandes, T., Kolinsky, R., & Ventura, P. (submitted for publication).
31. Fernandes T., Ventura P., and Kolinsky R. Statistical information and coarticulation as cues to word boundaries: A matter of signal quality. Perception & Psychophysics 69 (2007) 856-864
32. Festen J.M., and Plomp R. Effects of fluctuating noise and interfering speech on the speech reception threshold for impaired and normal hearing. Journal of the Acoustical Society of America 88 (1990) 1725-1736
33. Freyman R.L., Balakrishan U., and Helfer K. Effect of number of masking talkers and auditory priming on informational masking in speech recognition. Journal of the Acoustical Society of America 115 (2004) 2246-2256
34. GarciaLecumberri M.L., and Cooke M.P. Effect of masker type on native and non-native consonant perception in noise. Journal of the Acoustical Society of America 119 (2006) 2445-2454
35. Gow D.W., and Gordon P.C. Lexical and prelexical influences on word segmentation: Evidence from priming. Journal of Experimental Psychology: Human Perception and Performance 21 (1995) 344-359
36. Haarmann H.J., and Usher M. Maintenance of semantic information in capacity-limited item short-term memory. Psychonomic Bulletin & Review 8 (2001) 568-578
37. Hawkins, S., & Slater, A. (1994). Spread of CV and V-to-V coarticulation in British English: Implications for the intelligibility of synthetic speech. In Proceedings of the international conference on spoken language processing (ICSLP 94) (Vol. 1, pp. 57-60).
38. Heid, S., & Hawkins, S. (2000). An acoustic study of long domain /r/ and /l/ coarticulation. Speech production: Models and data (pp. 77-80). Munich.
39. Hoen M., Meunier F., Grataloup C., Pellegrino F., Grimault N., Perrin F., et al. Phonetic and lexical interferences in informational masking during speech-in-speech comprehension. Speech Communication 49 (2007) 905-916
40. Ihlefeld A., and Shinn-Cunningham B. Spatial release from energetic and informational masking in a selective speech identification task. Journal of the Acoustical Society of America 123 (2008) 4369-4379
41. Jacquemot C., Dupoux E., Decouche O., and Bachoud-Lévi A.-C. Misperception in sentences but not in words: Speech perception and the phonological buffer. Cognitive Neuropsychology 23 (2006) 949-971
42. Kahneman D. Attention and effort (1973), Prentice-Hall, Englewood Cliffs, NJ
43. Kidd Jr. G., Mason C.R., Richards V.M., Gallun F.J., and Durlach N.I. Informational masking. In: Yost W.A., Popper A.N., and Fay R.R. (Eds). Handbook of auditory research Vol. 29 (2008), Springer, New York, NY 143-189
44. Klatt D.H. Linguistic uses of segmental duration in English: Acoustic and perceptual evidence. Journal of the Acoustical Society of America 59 (1976) 1208-1220
45. Lavie N. Distracted and confused?: Selective attention under load. Trends in Cognitive Sciences 9 (2005) 75-82
46. Liss J.M., Spitzer S., Caviness J.N., Adler C., and Edwards B. Syllabic strength and lexical boundary decisions in the perception of hypokinetic dysarthric speech. Journal of the Acoustical Society of America 104 (1998) 2457-2466
47. Lu Y., and Cooke M.P. Speech production modifications produced by competing talkers, babble and stationary noise. Journal of the Acoustical Society of America 124 (2008) 3261-3275
48. Luce P.A., and Pisoni D.B. Recognizing spoken words: The neighborhood activation model. Ear and Hearing 19 (1998) 1-36
49. Martin R.C., Shelton J.R., and Yaffee L. Language processing and working memory: Neuropsychological evidence for separate phonological and semantic capacities. Journal of Memory and Language 33 (1994) 83-111
50. Mattys S.L. The use of time during lexical processing and segmentation: A review. Psychonomic Bulletin & Review 4 (1997) 310-329
51. Mattys S.L. Stress versus coarticulation: Towards an integrated approach to explicit speech segmentation. Journal of Experimental Psychology: Human Perception and Performance 30 (2004) 397-408
52. Mattys S.L., and Melhorn J.F. Sentential, lexical, and acoustic effects on the perception of word boundaries. Journal of the Acoustical Society of America 122 (2007) 554-567
53. Mattys S.L., Melhorn J.F., and White L. Effects of syntactic expectations on speech segmentation. Journal of Experimental Psychology: Human Perception and Performance 33 (2007) 960-977
54. Mattys S.L., White L., and Melhorn J.F. Integration of multiple speech segmentation cues: A hierarchical framework. Journal of Experimental Psychology: General 134 (2005) 477-500
55. Mayo L.H., Florentine M., and Buss S. Age of second-language acquisition and perception of speech in noise. Journal of Speech, Language, and Hearing Research 40 (1997) 686-693
56. McQueen J.M. Segmentation of continuous speech using phonotactics. Journal of Memory and Language 39 (1998) 21-46
57. Miller G.A., and Licklider J.C.R. The intelligibility of interrupted speech. Journal of the Acoustical Society of America 22 (1950) 167-173
58. Mirman D., McClelland J.L., Holt L.L., and Magnuson J.S. Effects of attention on the strength of lexical influences on speech perception: Behavioral experiments and computational mechanisms. Cognitive Science 32 (2008) 398-417
59. Norman D.A., and Bobrow D.G. On data-limited and resource-limited processes. Cognitive Psychology 7 (1975) 44-64
60. Norris D., and McQueen J.M. Shortlist B: A Bayesian model of continuous speech recognition. Psychological Review 115 (2008) 357-395
61. Norris D., McQueen J.M., and Cutler A. Competition and segmentation in spoken-word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 21 (1995) 1209-1228
62. Norris D., McQueen J.M., Cutler A., and Butterfield S. The possible-word constraint in the segmentation of continuous speech. Cognitive Psychology 34 (1997) 191-243
63. Ogden R., Hawkins S., House J., Huckvale M., Local J., Carter P., et al. ProSynth: An integrated prosodic approach to device-independent, natural-sounding speech synthesis. Computer Speech and Language 14 (2000) 177-210
64. Oller D.K. The effect of position in utterance on speech segment duration in English. Journal of the Acoustical Society of America 54 (1973) 1235-1247
65. Onifer W., and Swinney D. Accessing lexical ambiguities during sentence comprehension: Effects of frequency-of-meaning and contextual bias. Memory & Cognition 9 (1981) 225-236
66. Pitt M.A., and Samuel A.G. Attentional allocation during speech perception: How fine is the focus?. Journal of Memory and Language 29 (1990) 611-632
67. Potter M.C. Very short-term conceptual memory. Memory & Cognition 21 (1993) 156-161
68. Pratt R.L. On the intelligibility of synthetic speech. Proceedings of the Institute of Acoustics 8 (1986) 183-192
69. Rabbitt P.M.A. Channel-capacity, intelligibility and immediate recall. Quarterly Journal of Experimental Psychology 20 (1968) 241-248
70. Rhebergen K.S., Versfeld N.J., and Dreschler W.A. Release from informational masking by time reversal of native and non-native interfering speech. Journal of the Acoustical Society of America 118 (2005) 1274-1277
71. Saffran J.R., Newport E.L., and Aslin R.N. Word segmentation: The role of distributional cues. Journal of Memory and Language 35 (1996) 606-621
72. Sanders L.D., and Neville H.J. An ERP study of continuous speech processing. I. Segmentation, semantics, and syntax in native speakers. Cognitive Brain Research 15 (2003) 228-240
73. Schwab S., Miller J.L., Grosjean F., and Mondini M. Effect of speaking rate on the identification of word boundaries. Phonetica 65 (2008) 173-186
74. Scott S.K., Rosen S., Wickham L., and Wise R.J.S. A positron emission tomography study of the neural basis of informational and energetic masking effects in speech perception. Journal of the Acoustical Society of America 115 (2004) 813-821
75. Seidenberg M.S., Tanenhaus M.J., Leiman J.M., and Bienkowski M. Automatic access of the meanings of ambiguous words in context: Some limitations of knowledge-based processing. Cognitive Psychology 14 (1982) 538-559
76. Shub D.E., Durlach N.I., and Colburn H.S. Monaural level discrimination under dichotic conditions. Journal of the Acoustical Society of America 123 (2008) 4421-4433
77. Simpson S., and Cooke M.P. Consonant identification in N-talker babble is a nonmonotonic function of N. Journal of the Acoustical Society of America 118 (2005) 2775-2778
78. Smith M.R., Cutler A., Butterfield S., and Nimmo-Smith I. The perception of rhythm and word boundaries in noise-masked speech. Journal of Speech and Hearing Research 32 (1989) 912-920
79. Spitzer, S. M., Liss, J. M., Spahr, T., Dorman, M., & Landford, K. (2009). The use of fundamental frequency for lexical segmentation in listeners with cochlear implants. Journal of the Acoustical Society of America - Express Letters.
80. Spitzer S.M., Liss J.M., and Mattys S.L. Acoustic cues to lexical segmentation: A study of resynthesized speech. Journal of the Acoustical Society of America 122 (2007) 3678-3687
81. Tabossi P., Burani C., and Scott D.R. Word recognition in connected speech in Italian. Journal of Memory and Language 34 (1995) 440-467
82. Toro J.M., Sinnett S., and Soto-Faraco S. The consequences of diverting attention within and across sensory modalities on statistical learning. Cognition 97 (2005) B25-B34
83. Van Dyke J.A., and McElree B. Retrieval interference in sentence processing. Journal of Memory and Language 55 (2006) 157-166
84. Van Engen K.J., and Bradlow A.R. Sentence recognition in native- and foreign-language multi-talker background noise. Journal of the Acoustical Society of America 121 (2007) 519-526
85. Venkataraman A. A statistical model for word discovery in transcribed speech. Computational Linguistics 27 (2001) 352-372
86. Vitevitch M.S. Change deafness: The inability to detect changes between two voices. Journal of Experimental Psychology: Human Perception and Performance 29 (2003) 333-342
87. Warren R.M., Riener K.R., Bashford J.A., and Brubaker B.S. Spectral redundancy: Intelligibility of sentences heard through narrow spectral slits. Perception & Psychophysics 57 (1995) 175-182
88. Watson C.S. Some comments on informational masking. Acta Acustica 91 (2005) 502-512
89. Welby P. The role of early fundamental frequency rises and elbows in French word segmentation. Speech Communication 49 (2007) 28-48
90. West, P. (1999). The extent of coarticulation of English liquids: An acoustic and articulatory study. In Proceedings of the 14th meeting of the international congress of phonetic sciences, Berkeley (Vol. 3, pp. 1901-1904.
91. White, L., Melhorn, J. F., & Mattys, S. L. (in press). Segmentation by lexical subtraction: Hungarian bilinguals listening to English speech. Quarterly Journal of Experimental Psychology.