Listening to speech in the presence of other sounds

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 363, Issue 1493, 2008, Pages 1011-1021

  Darwin, C J ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Auditory grouping; Auditory localization; Auditory perception; Auditory scene analysis; Cocktail party problem; Speech perception

Indexed keywords

ALGORITHM; AUDITORY CUE; BACKGROUND LEVEL; BIOACOUSTICS; HEARING; PERCEPTION; PSYCHOLOGY;

EID: 38549171780     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2007.2156     Document Type: Review

References (115)

1. Ainsworth, W. A. & Miller, J. B. 1972 The effect of relative formant amplitude on the identity of synthetic vowels. Lang. Speech 15, 328-341.
2. ANSI 1997 ANSI S3.5-1997: methods for calculation of the speech intelligibility index. New York, NY: American National Standards Institute.
3. Assmann, P. F. & Summerfield, Q. 1989 Modelling the perception of concurrent vowels: vowels with the same fundamental frequency. J. Acoust. Soc. Am. 85, 327-338. (doi:10.1121/1.397684)
4. Assmann, P. F. & Summerfield, Q. 1990 Modelling the perception of concurrent vowels: vowels with different fundamental frequencies. J. Acoust. Soc. Am. 88, 680-697. (doi:10.1121/1.399772)
5. Assmann, P. F. & Summerfield, Q. 1994 The contribution of waveform interactions to the perception of concurrent vowels. J. Acoust. Soc. Am. 95, 471-484. (doi:10.1121/1.408342)
6. Assmann, P. F. & Summerfield, Q. 2004 The perception of speech under adverse conditions. In Speech processing in the auditory system (eds S. Greenberg, W. A. Ainsworth, A. N. Popper & R. R. Fay), pp. 231-308. New York, NY: Springer.
7. Atal, B. S. & Hanauer, S. L. 1971 Speech analysis and synthesis by linear prediction of the acoustic wave. J. Acoust. Soc. Am. 50, 637-655. (doi:10.1121/1.1912679)
8. Barker, J. & Cooke, M. 1999 Is the sine-wave speech cocktail party worth attending? Speech Commun. 27, 159-174. (doi:10.1016/S0167- 6393(98)00081-8)
9. Bird, J. & Darwin, C. J. 1998 Effects of a difference in fundamental frequency in separating two sentences. In Psychophysical and physiological advances in hearing (eds A. R. Palmer, A. Rees, Q. Summerfield & R. Meddis), pp. 263-269. London, UK: Whurr Publishers.
10. Bodden, M. 1996 Auditory demonstrations of a cocktailparty processor. Acustica 82, 356-357.
11. Bregman, A. S. 1978 Auditory streaming is cumulative. J. Exp. Psychol. Hum. Percept. Perform. 4, 380-387. (doi:10.1037/0096-1523.4.3.380)
12. Bregman, A. S. 1990 Auditory scene analysis: the perceptual organisation of sound. Cambridge, MA: Bradford Books/ MIT Press.
13. Bregman, A. S. & Ahad, P. A. 1995 Compact disc: demonstrations of auditory scene analysis. Montreal, Canada: Department of Psychology, McGill University.
14. Bregman, A. S. & Pinker, S. 1978 Auditory streaming and the building of timbre. Can. J. Psychol. 32, 19-31.
15. Broadbent, D. E. & Ladefoged, P. 1957 On the fusion of sounds reaching different sense organs. J. Acoust. Soc. Am. 29, 708-710. (doi:10.1121/1.1909019)
16. Brokx, J. P. L. & Nooteboom, S. G. 1982 Intonation and the perceptual separation of simultaneous voices. J. Phonet. 10, 23-36.
17. Bronkhorst, A. W. 2000 The cocktail party phenomenon: a review of speech intelligibility in multiple-talker conditions. Acustica 86, 117-128.
18. Brungart, D. S. 2001 Informational and energetic masking effects in the perception of two simultaneous talkers. J. Acoust. Soc. Am. 109, 1101-1109. (doi:10.1121/1.1345696)
19. Brungart, D. S. 2005 A binary masking technique for isolating energetic masking in speech perception. J. Acoust. Soc. Am. 117, 2484. (doi:10.1121/1.1835509)
20. Brungart, D. S. & Simpson, B. D. 2002 Within-ear and across-ear interference in a cocktail-party listening task. J. Acoust. Soc. Am. 112, 2985-2995. (doi:10.1121/1.1512703)
21. Brungart, D. S., Simpson, B. D., Darwin, C. J., Arbogast, T. L. & Kidd Jr, G. 2005 Across-ear interference from parametrically-degraded synthetic speech signals in a dichotic cocktail-party listening task. J. Acoust. Soc. Am. 117, 292-304. (doi:10.1121/1.1835509)
22. Buss, E., Hall III, J. W. & Grose, J. H. 2004 Spectral integration of synchronous and asynchronous cues to consonant identification. J. Acoust. Soc. Am. 115, 2278-2285. (doi:10.1121/1.1691035)
23. Carlyon, R. P., Deeks, J., Norris, D. & Butterfield, S. 2002 The continuity illusion and vowel identification. Acta Acustica-Acustica 88, 408-415.
24. Cherry, E. C. 1953 Some experiments on the recognition of speech, with one and with two ears. J. Acoust. Soc. Am. 25, 975-979. (doi:10.1121/1.1907229)
25. Cherry, E. C. & Taylor, W. K. 1954 Some further experiments upon the recognition of speech, with one and with two ears. J. Acoust. Soc. Am. 26, 554-559. (doi:10.1121/1.1907373)
26. Cherry, C. & Wiley, R. H. 1967 Speech communication in very noisy environments. Nature 214, 1164. (doi:10.1038/2141164a0)
27. Chimento, T. C. & Schreiner, C. E. 1991 Adaptation and recovery from adaptation in single fiber responses of the cat auditory-nerve. J. Acoust. Soc. Am. 90, 263-273. (doi:10.1121/1.401296)
28. Clark, G. 2003 Cochlear implants: fundamentals and applications. Berlin, Germany; London, UK: Springer.
29. Cooke, M. 2003 Glimpsing speech. J. Phonet. 31, 579-584. (doi:10.1016/S0095-4470(03)00013-5)
30. Cooke, M. P. 1993 Modelling auditory processing and organisation. Cambridge, UK: Cambridge University Press.
31. Cooke, M. P., Green, P. D., Josifovski, L. & Vizinho, A. 2001 Robust automatic speech recognition with missing and unreliable acoustic data. Speech Commun. 34, 267-285. (doi:10.1016/S0167-6393(00)00034-0)
32. Culling, J. F. & Darwin, C. J. 1993 Perceptual separation of simultaneous vowels: within and across-formant grouping by F0. J. Acoust. Soc. Am. 93, 3454-3467. (doi:10.1121/1.405675)
33. Culling, J. F. & Darwin, C. J. 1994 Perceptual and computational separation of simultaneous vowels: cues arising from low-frequency beating. J. Acoust. Soc. Am. 95, 1559-1569. (doi:10.1121/1.408543)
34. Culling, J. F. & Summerfield, Q. 1995 Perceptual separation of concurrent speech sounds: absence of across-frequency grouping by common interaural delay. J. Acoust. Soc. Am. 98, 785-797. (doi:10.1121/1.413571)
35. Darwin, C. J. 1981 Perceptual grouping of speech components differing in fundamental frequency and onset-time. Q. J. Exp. Psychol. A 33, 185-208.
36. Darwin, C. J. 1984 Perceiving vowels in the presence of another sound: constraints on formant perception. J. Acoust. Soc. Am. 76, 1636-1647. (doi:10.1121/1.391610)
37. Darwin, C. J. 1990 Environmental influences on speech perception. In Advances in speech and language processing (ed. W. A. Ainsworth), pp. 219-241. London, UK: JAI Press.
38. Darwin, C. J. 1991 The relationship between speech perceptionandthe perceptionof other sounds. In Modularity and the motor theory of speech perception (eds I. G. Mattingly & M. G. Studdert-Kennedy), pp. 239-259. Hillsdale, NJ: Erlbaum.
39. Darwin, C. J. 1995 Perceiving vowels in the presence of another sound: a quantitative test of the "Old-plus-New" heuristic. In Levels in speech communication: relations and interactions: a tribute to Max Wajskop (eds C. Sorin, J. Mariani, H. Méloni & J. Schoentgen), pp. 1-12. Amsterdam, The Netherlands: Elsevier.
40. Darwin, C. J. 2002 Auditory streaming in language processing. In Genetics and the function of the auditory system: 19th Danavox symposium (eds L. Tranebjaerg, T. Andersen, J. Christensen-Dalsgaard & T. Poulsen), pp. 375-392. Brøndby, Denmark: Holmens Trykkeri.
41. Darwin, C. J., Carlyon, R. P. 1995 Auditory grouping In The handbook of perception and cognition. Vol. 6 Hearing (ed. B. C. J. Moore), pp. 387-424. 2nd edn. London, UK: Academic Press.
42. Darwin, C. J. & Gardner, R. B. 1986 Mistuning a harmonic of a vowel: grouping and phase effects on vowel quality. J. Acoust. Soc. Am. 79, 838-845. (doi:10.1121/1.393474)
43. Darwin, C. J. & Hukin, R. W. 1999 Auditory objects of attention: the role of interaural time-differences. J. Exp. Psychol. Hum. Percept. Perform. 25, 617-629. (doi:10.1037/0096-1523.25.3.617)
44. Darwin, C. J. & Hukin, R. W. 2000 Effectiveness of spatial cues, prosody and talker characteristics in selective attention. J. Acoust. Soc. Am. 107, 970-977. (doi:10.1121/1.428278)
45. Darwin, C. J. & Sutherland, N. S. 1984 Grouping frequency components of vowels: when is a harmonic not a harmonic? Q. J. Exp. Psychol. A 36, 193-208.
46. Darwin, C. J., Brungart, D. S. & Simpson, B. D. 2003 Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers. J. Acoust. Soc. Am. 114, 2913-2922. (doi:10.1121/1.1616924)
47. Diehl, R. L. 2008 Acoustic and auditory phonetics: the adaptive design of speech sound systems. Phil. Trans. R. Soc. B 363, 965-978. (doi:10.1098/rstb.2007.2153)
48. Dirks, D. D. & Wilson, R. H. 1969 The effects of spatially separated sound sources on speech intelligibility. J. Speech Hear. Res. 12, 5-38.
49. Dissard, P. & Darwin, C. J. 2000 Extracting spectral envelopes: formant frequency matching between sounds on different and modulated fundamental frequencies. J. Acoust. Soc. Am. 107, 960-969. (doi:10.1121/1.428277)
50. Dissard, P. & Darwin, C. J. 2001 Formant frequency matching between sounds with different bandwidths and on different fundamental frequencies. J. Acoust. Soc. Am. 110, 409-415. (doi:10.1121/1.1379085)
51. Drennan, W. R., Gatehouse, S. & Lever, C. 2003 Perceptual segregation of competing speech sounds: the role of spatial location. J. Acoust. Soc. Am. 114, 2178-2189. (doi:10.1121/1.1609994)
52. Drullman, R. & Bronkhorst, A. W. 2000 Multichannel speech intelligibility and talker recognition using monaural, binaural, and three-dimensional auditory presentation. J. Acoust. Soc. Am. 107, 2224-2235. (doi:10.1121/1.428503)
53. Duquesnoy, A. J. 1983 Perceptual segregation of competing speech sounds: the role of spatial location. J. Acoust. Soc. Am. 74, 739-743. (doi:10.1121/1.389859)
54. Durlach, N. I., Mason, C. R., Kidd Jr, G., Arbogast, T. L., Colburn, H. S. & Shinn-Cunningham, B. G. 2003 Note on informational masking. J. Acoust. Soc. Am. 113, 2984-2987. (doi:10.1121/1.1570435)
55. Egan, J. P., Carterette, E. C. & Thwing, E. J. 1954 Some factors affecting multi-channel listening. J. Acoust. Soc. Am. 26, 774-782. (doi:10.1121/1.1907416)
56. Festen, J. M. & Plomp, R. 1990 Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing. J. Acoust. Soc. Am. 88, 1725-1736. (doi:10.1121/1.400247)
57. Freyman, R. L., Helfer, K. S., McCall, D. D. & Clifton, R. K. 1999 The role of perceived spatial separation in the unmasking of speech. J. Acoust. Soc. Am. 106, 3578-3588. (doi:10.1121/1.428211)
58. Gutschalk, A., Micheyl, C., Melcher, J. R., Rupp, A., Scherg, M. & Oxenham, A. J. 2005 Neuromagnetic correlates of streaming in human auditory cortex. J. Neurosci. 25, 5382-5388. (doi:10.1523/JNEUROSCI.0347- 05.2005)
59. Haas, H. 1972 The influence of a single echo on the audibility of speech. J. Audio Eng. Soc. 20, 145-149.
60. Hill, N. I. & Darwin, C. J. 1996 Lateralisation of a perturbed harmonic: effects of onset asynchrony and mistuning. J. Acoust. Soc. Am. 100, 2352-2364. (doi:10.1121/1.417945)
61. Houtgast, T. & Steeneken, H. J. M. 1973 The modulation transfer function in room acoustics as a predictor of speech intelligibility. Acustica 28, 66-73.
62. Howard-Jones, P. A. & Rosen, S. 1993 Uncomodulated glimpsing in "checkerboard" noise. J. Acoust. Soc. Am. 93, 2915-2922. (doi:10.1121/1.405811)
63. Hu, G. & Wang, D. L. 2004 Monaural speech segregation based on pitch tracking and amplitude modulation. In Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPA), pp. 79-82.
64. Hunt, M. J. 1987 Delayed decisions in speech recognition - the case of formants. Pattern Recognit. Lett. 6, 121-137. (doi:10.1016/0167- 8655(87)90093-6)
65. Hunt, M. J., Zwierzynski, D. A. & Carr, R. C. 1989 Issues in high-quality LPC analysis and synthesis. In Proc. Eur. Conf. on Speech Communication and Technology (Euro-Speech-89).
66. Killion, M. C. 1997 Hearing aids: past, present, future: moving toward normal conversations in noise. Br. J. Audiol. 31, 141-148.
67. Klatt, D. H. 1985 The perceptual reality of a formant frequency. J. Acoust. Soc. Am. 78, S81-S82. (doi:10.1121/1.2023019)
68. Kubovy, M. 1981 Concurrent pitch segregation and the theory of indispensible attributes. In Perceptual organization (eds M. Kubovy & J. R. Pomerantz), pp. 55-98. Hillsdale, NJ: Erlbaum.
69. Liberman, A. M. 1982 On the finding that speech is special. Am. Psychol. 37, 148-167. (doi:10.1037/0003-066X.37.2.148)
70. Liberman, A. M., Cooper, F. S., Shankweiler, D. S. & Studdert-Kennedy, M. 1967 Perception of the speech code. Psychol. Rev. 74, 431-461. (doi:10.1037/h0020279)
71. Licklider, J. C. R. 1948 The influence of interaural phase relations upon the masking of speech by white noise. J. Acoust. Soc. Am. 20, 150-159. (doi:10.1121/1.1906358)
72. Lippmann, R. P. 1997 Speech recognition by machines and humans. Speech Commun. 22, 1-15. (doi:10.1016/S0167-6393(97)00021-6)
73. McAdams, S., Botte, M. C. & Drake, C. 1998 Auditory continuity and loudness computation. J. Acoust. Soc. Am. 103, 1580-1591. (doi:10.1121/1.421293)
74. Miller, G. A. 1947 The masking of speech. Psychol. Bull. 44, 105-129. (doi:10.1037/h0055960)
75. Miller, G. A. & Licklider, J. C. R. 1950 The intelligibility of interrupted speech. J. Acoust. Soc. Am. 22, 167-173. (doi:10.1121/1.1906584)
76. Moore, B. C. J. 1998 Cochlear hearing loss. London, UK: Whurr Publishers.
77. Moore, B. C. J. 2008 Basic auditory processes involved in the analysis of speech sounds. Phil. Trans. R. Soc. B 363, 947-963. (doi:10.1098/rstb.2007.2152)
78. Moore, R. K. 1986 Signal decomposition using Markov modelling techniques. Royal Signals Research Establishment (UK) Memorandum no. 3931.
79. Munte, T. F., Kohlmetz, C., Nager, W. & Altenmuller, E. 2001 Superior auditory spatial tuning in conductors. Nature 409, 580. (doi:10.1038/35054668)
80. Palmer, A. R. 1988 The representation of concurrent vowels in the temporal discharge patterns of auditory nerve fibers. In Basic issues in hearing (eds H. Duifhuis, J. W. Jorst & H. P. Wit), pp. 244-251. London, UK: Academic Press.
81. Patterson, R. D. & Johnsrude, I. S. 2008 Functional imaging of the auditory processing applied to speech sounds. Phil. Trans. R. Soc. B 363, 1023-1035. (doi:10.1098/rstb.2007.2157)
82. Peters, R. W., Moore, B. C. J. & Baer, T. 1998 Speech reception thresholds in noise with and without spectral and temporal dips for hearing-impaired and normally hearing people. J. Acoust. Soc. Am. 103, 577-587. (doi:10.1121/1.421128)
83. Plomp, R. 1976 Binaural and monaural speech intelligibility of connected discourse in reverberation as a function of a single competing sound source (speech or noise). Acustica 34, 200-211.
84. Plomp, R. 1977 Acoustical aspects of cocktail parties. Acustica 38, 186-191.
85. Powers, G. L. & Wilcox, J. C. 1977 Intelligibility of temporally-interrupted speech with and without intervening noise. J. Acoust. Soc. Am. 61, 195-199. (doi:10.1121/1.381255)
86. Price, C., Thierry, G. & Griffiths, T. D. 2005 Speech-specific auditory processing: where is it? Trends Cogn. Sci. 9, 271-276. (doi:10.1016/j.tics.2005.03.009)
87. Remez, R. E., Rubin, P. E., Pisoni, D. B. & Carrell, T. D. 1981 Speech perception without traditional speech cues. Science 212, 947-950. (doi:10.1126/science.7233191)
88. Rhebergen, K. S., Versfeld, N. J. & Dreschler, W. A. 2005 Release from informational masking by time reversal of native and non-native interfering speech. J. Acoust. Soc. Am. 118, 1274-1277. (doi:10.1121/1. 2000751)
89. Roberts, B. & Holmes, S. B. 2006 Asynchrony and the grouping of vowel components: captor tones revisited. J. Acoust. Soc. Am 119, 2905-2918. (doi:10.1121/1.2190164)
90. Roberts, B. & Moore, B. C. J. 1991 The influence of extraneous sounds on the perceptual estimation of first-formant frequency in vowels under conditions of asynchrony. J. Acoust. Soc. Am. 89, 2922-2932. (doi:10.1121/1.400731)
91. Roweis, S. 2004 Automatic speech processing by inference in generative models. In Speech separation by humans and machines (ed. P. L. Divenyi), pp. 97-134. New York, NY: Kluwer Academic Publishers.
92. Sach, A. J. & Bailey, P. J. 2004 Some characteristics of auditory spatial attention revealed using rhythmic masking release. Percept. Psychophys. 66, 1379-1387.
93. Samuel, A. G. 1981 The role of bottom-up confirmation in the phonemic restoration illusion. J. Exp. Psychol. Hum. Percept. Perform. 7, 1124-1131. (doi:10.1037/0096-1523.7.5.1124)
94. Scheffers, M. T. 1979 The role of pitch in perceptual separation of simultaneous vowels. Institute for Perception Research, Annual progress report 14, pp. 51-54.
95. Scheffers, M. T. 1983 Sifting vowels: auditory pitch analysis and sound segregation. PhD thesis, University of Groningen, The Netherlands.
96. Schouten, J. F. 1940 The residue and the mechanism of hearing. Proc. Kon. Akad. Wetenschap 43, 991-999.
97. Shackleton, T. M., Meddis, R. & Hewitt, M. J. 1994 The role of binaural and fundamental frequency difference cues in the identification of concurrently presented vowels. Q. J. Exp. Psychol. A 47, 545-563.
98. Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J. & Ekelid, M. 1995 Speech recognition with primarily temporal cues. Science 270, 303-304. (doi:10.1126/science.270.5234.303)
99. Smith, R. L. 1979 Adaptation, saturation, and physiological masking in single auditory nerve fibers. J. Acoust. Soc. Am. 65, 166-178. (doi:10.1121/1.382260)
100. Spence, C. J. & Driver, J. 1994 Covert spatial orienting in audition: exogenous and endogenous mechanisms. J. Exp. Psychol. Hum. Percept. Perform. 20, 555-574. (doi:10.1037/0096-1523.20.3.555)
101. Sroka, J. J. & Braida, L. D. 2005 Human and machine consonant recognition. Speech Commun. 45, 401-423. (doi:10.1016/j.specom. 2004.11.009)
102. Stubbs, R. J. & Summerfield, A. Q. 1990 Algorithms for separating the speech of interfering talkers: evaluations with voiced sentences and normal-hearing and hearing-impaired listeners. J. Acoust. Soc. Am. 89, 1383-1393. (doi:10.1121/1.400539)
103. Treisman, A. 1960 Contextual cues in selective listening. Q. J. Exp. Psychol. 12, 242-248.
104. Varga, A. P. & Moore, R. K. 1990 Hidden Markov model decomposition of speech and noise. In IEEE Int. Conf. on Acoustics, Speech and Signal Processing, pp. 845-848.
105. Verschuure, J. & Brocaar, M. P. 1983 Intelligibility of interrupted meaningful and nonsense speech with and without intervening noise. Percept. Psychophys. 33, 232-240.
106. Wang, D. L. 2004 An ideal binary mask as the computational goal of auditory scene analysis. In Speech separation by humans and machines (ed. P. L. Divenyi), pp. 181-197. New York, NY: Kluwer Academic Publishers.
107. Warren, R. M. 1970 Perceptual restoration of missing phonemes. Science 167, 392-393. (doi:10.1126/science.167.3917.392)
108. Warren, R. M. 1984 Perceptual restoration of obliterated sounds. Psychol. Bull. 96, 371-383. (doi:10.1037/0033-2909.96.2.371)
109. Warren, R. M., Obusek, C. J. & Ackroff, J. M. 1972 Auditory induction: perceptual synthesis of absent sounds. Science 176, 1149-1151. (doi:10.1126/science.176.4039.1149)
110. Watkins, A. J. & Makin, S. J. 1994 Perceptual compensation for speaker differences and for spectral-envelope distortion. J. Acoust. Soc. Am. 96, 1263-1282. (doi:10.1121/1.410275)
111. Watson, C. S. 1987 Uncertainty, informational masking and the capacity of immediate auditory memory. In Auditory processing of complex sounds (eds W. A. Yost & C. S. Watson), pp. 267-277. Hillsdale, NJ: Erlbaum.
112. Whalen, D. M. & Liberman, A. M. 1987 Speech perception takes precedence over nonspeech perception. Science 237, 169-171. (doi:10.1126/science.3603014)
113. Wightman, F. L. & Kistler, D. J. 1992 The dominant role of low-frequency interaural time differences in sound localization. J. Acoust. Soc. Am. 91, 1648-1661. (doi:10.1121/1.402445)
114. Woods, W. A. & Colburn, S. 1992 Test of a model of auditory object formation using intensity and interaural time difference discriminations. J. Acoust. Soc. Am. 91, 2894-2902. (doi:10.1121/1.402926)
115. Yates, G. K., Robertson, D. & Johnstone, B. M. 1985 Very rapid adaptation in the guinea-pig auditory nerve. Hear. Res. 17, 1-12. (doi:10.1016/0378-5955(85)90124-8)