Pitch Perception and Auditory Stream Segregation: Implications for Hearing Loss and Cochlear Implants

Trends in Amplification

Volumn 12, Issue 4, 2008, Pages 316-331

  Oxenham, Andrew J ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Auditory Streaming; Cochlear Implants; Hearing Loss; Pitch

Indexed keywords

AUDITORY THRESHOLD; COCHLEA PROSTHESIS; HEARING; HEARING ACUITY; HEARING IMPAIRMENT; HEARING LOSS; HUMAN; PITCH; REVIEW;

AUDITORY THRESHOLD; COCHLEAR IMPLANTS; HEARING IMPAIRED PERSONS; HEARING LOSS; HUMANS; PERCEPTUAL MASKING; PITCH PERCEPTION; PROSTHESIS DESIGN; REHABILITATION OF HEARING IMPAIRED; SOUND SPECTROGRAPHY; SPEECH PERCEPTION; TIME PERCEPTION;

EID: 56249135631     PISSN: 10847138     EISSN: 19405588     Source Type: Journal    
DOI: 10.1177/1084713808325881     Document Type: Article

References (118)

1. Anstis S. Saida S. (1985). Adaptation to auditory streaming of frequency-modulated tones. Journal of Experimental Psychology: Human Perception and Performance, 11, 257–271.
2. Arehart K. H. Rossi-Katz J. Swensson-Prutsman J. (2005). Double-vowel perception in listeners with cochlear hearing loss: Differences in fundamental frequency, ear of presentation, and relative amplitude. Journal of Speech, Language, and Heading Research, 48, 236–252.
3. Assmann P. F. Summerfield Q. (1987). Perceptual segregation of concurrent vowels. Journal of the Acoustical Society of America, 82, S120.
4. Beerends J. G. Houtsma A. J. M. (1989). Pitch identification of simultaneous diotic and dichotic two-tone complexes. Journal of the Acoustical Society of America, 85, 813–819.
5. Bendor D. Wang X. (2005). The neuronal representation of pitch in primate auditory cortex. Nature, 436, 1161–1165.
6. Bendor D. Wang X. (2006). Cortical representations of pitch in monkeys and humans. Current Opinion in Neurobiology, 16, 391–399.
7. Bernstein J. G. Oxenham A. J. (2003). Pitch discrimination of diotic and dichotic tone complexes: Harmonic resolvability or harmonic number? Journal of the Acoustical Society of America, 113, 3323–3334.
8. Bernstein J. G. Oxenham A. J. (2006a). The relationship between frequency selectivity and pitch discrimination: Effects of stimulus level. Journal of the Acoustical Society of America, 120, 3916–3928.
9. Bernstein J. G. Oxenham A. J. (2006b). The relationship between frequency selectivity and pitch discrimination: Sensorineural hearing loss. Journal of the Acoustical Society of America, 120, 3929–3945.
10. Bird J. Darwin C. J. (1998). Effects of a difference in fundamental frequency in separating two sentences. In Palmer A. R. Rees A. Summerfield A. Q. Meddis R. (Eds.), Psychophysical and physiological advances in hearing (pp. 263–269). London: Whurr.
11. Boex C. Baud L. Cosendai G. Sigrist A. Kos M. I. Pelizzone M. (2006). Acoustic to electric pitch comparisons in cochlear implant subjects with residual hearing. Journal of the Association for Research in Otolaryngology, 7, 110–124.
12. Bregman A. S. (1990). Auditory scene analysis: The perceptual organization of sound. Cambridge, MA: MIT Press.
13. Bregman A. S. Ahad P. Crum P. A. O'Reilly J. (2000). Effects of time intervals and tone durations on auditory stream segregation. Perception and Psychophysics, 62, 626–636.
14. Brokx J. P. Nooteboom S. G. (1982). Intonation and the perceptual separation of simultaneous voices. Journal of Phonetics, 10, 23–36.
15. Burns E. M. Viemeister N. F. (1981). Played again SAM: Further observations on the pitch of amplitude-modulated noise. Journal of the Acoustical Society of America, 70, 1655–1660.
16. Buss E. Hall J. W. Grose J. H. (2004). Temporal fine-structure cues to speech and pure tone modulation in observers with sensorineural hearing loss. Ear and Hearing, 25, 242–250.
17. Cariani P. A. Delgutte B. (1996). Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. Journal of Neurophysiology, 76, 1698–1716.
18. Carlyon R. P. (1996). Encoding the fundamental frequency of a complex tone in the presence of a spectrally overlapping masker. Journal of the Acoustical Society of America, 99, 517–524.
19. Carlyon R. P. Cusack R. Foxton J. M. Robertson I. H. (2001). Effects of attention and unilateral neglect on auditory stream segregation. Journal of Experimental Psychology: Human Perception and Performance, 27, 115–127.
20. Cedolin L. Delgutte B. (2007). Spatio-temporal representation of the pitch of complex tones in the auditory nerve. In Kollmeier B. Klump G. Hohmann V. Langemann U. Mauermann M. Uppenkamp S. et al., (Eds.), Hearing: From basic research to applications (pp. 61–70). New York/Berlin: Springer-Verlag.
21. Chatterjee M. Sarampalis A. Oba S. I. (2006). Auditory stream segregation with cochlear implants: A preliminary report. Hearing Research, 222, 100–107.
22. Cohen M. A. Grossberg S. Wyse L. L. (1995). A spectral network model of pitch perception. Journal of the Acoustical Society of America, 98, 862–879.
23. Cooper H. R. Roberts B. (2007). Auditory stream segregation of tone sequences in cochlear implant listeners. Hearing Research, 225, 11–24.
24. Dai H. (2000). On the relative influence of individual harmonics on pitch judgment. Journal of the Acoustical Society of America, 107, 953–959.
25. Darwin C. J. Carlyon R. P. (1995). Auditory organization and the formation of perceptual streams. In Moore B. C. J. (Ed.), Handbook of perception and cognition: Vol. 6. Hearing. San Diego: Academic.
26. de Boer E. (1956). On the “residue” in hearing. Unpublished doctoral dissertation submitted to University of Amsterdam, Netherlands.
27. de Cheveigné A. (1997). Concurrent vowel identification. III. A neural model of harmonic interference cancellation. Journal of the Acoustical Society of America, 101, 2857–2865.
28. de Cheveigné A. (1999). Waveform interactions and the segregation of concurrent vowels. Journal of the Acoustical Society of America, 106, 2959–2972.
29. Deeks J. M. Carlyon R. P. (2004). Simulations of cochlear implant hearing using filtered harmonic complexes: Implications for concurrent sound segregation. Journal of the Acoustical Society of America, 115, 1736–1746.
30. Dorman M. F. Spahr T. Gifford R. Loiselle L. McKarns S. Holden T. et al., (2007). An electric frequency-to-place map for a cochlear implant patient with hearing in the nonimplanted ear. Journal of the Association for Research in Otolaryngology, 8, 234–240.
31. Evans E. F. (2001). Latest comparisons between physiological and behavioural frequency selectivity. In Breebaart J. Houtsma A. J. M. Kohlrausch A. Prijs V. F. Schoonhoven R. (Eds.), Physiological and psychophysical bases of auditory function (pp. 382–387). Maastricht: Shaker.
32. Festen J. M. Plomp R. (1990). Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing. Journal of the Acoustical Society of America, 88, 1725–1736.
33. Fletcher H. (1940). Auditory patterns. Reviews of Modern Physics, 12, 47–65.
34. Glasberg B. R. Moore B. C. J. (1990). Derivation of auditory filter shapes from notched-noise data. Hearing Research, 47, 103–138.
35. Goldstein J. L. (1973). An optimum processor theory for the central formation of the pitch of complex tones. Journal of the Acoustical Society of America, 54, 1496–1516.
36. Gutschalk A. Oxenham A. J. Micheyl C. Wilson E. C. Melcher J. R. (2007). Human cortical activity during streaming without spectral cues suggests a general neural substrate for auditory stream segregation. Journal of Neuroscience, 27, 13074–13081.
37. Heinz M. G. Colburn H. S. Carney L. H. (2001). Evaluating auditory performance limits: I. One-parameter discrimination using a computational model for the auditory nerve. Neural Computation, 13, 2273–2316.
38. Hong R. S. Turner C. W. (2006). Pure-tone auditory stream segregation and speech perception in noise in cochlear implant recipients. Journal of the Acoustical Society of America, 120, 360–374.
39. Houtgast T. Steeneken H. J. M. Plomp R. (1980). Predicting speech intelligibility in rooms from the modulation transfer function. I. General room acoustics. Acustica, 46, 60–72.
40. Houtsma A. J. M. Smurzynski J. (1990). Pitch identification and discrimination for complex tones with many harmonics. Journal of the Acoustical Society of America, 87, 304–310.
41. Kaernbach C. Bering C. (2001). Exploring the temporal mechanism involved in the pitch of unresolved harmonics. Journal of the Acoustical Society of America, 110, 1039–1048.
42. Kim D. O. Molnar C. E. (1979). A population study of cochlear nerve fibres: Comparison of spatial distributions of average-rate and phase-locking measures of responses to single tones. Journal of Neurophysiology, 42, 16–30.
43. Kwon B. J. Turner C. W. (2001). Consonant identification under maskers with sinusoidal modulation: Masking release or modulation interference? Journal of the Acoustical Society of America, 110, 1130–1140.
44. Larsen E. Cedolin L. Delgutte B. (2008). Pitch representations in the auditory nerve: Two concurrent complex tones. Journal of Neurophysiology, 100, 1301–1319.
45. Liberman M. C. (1978). Auditory-nerve response from cats raised in a low-noise chamber. Journal of the Acoustical Society of America, 63, 442–455.
46. Licklider J. C. R. (1951). A duplex theory of pitch perception. Experientia, 7, 128–133.
47. Licklider J. C. R. (1954). “Periodicity” pitch and “place” pitch. Journal of the Acoustical Society of America, 26, 945.
48. Loeb G. E. White M. W. Merzenich M. M. (1983). Spatial cross correlation: A proposed mechanism for acoustic pitch perception. Biological Cybernetics, 47, 149–163.
49. Lorenzi C. Gilbert G. Carn H. Garnier S. Moore B. C. (2006). Speech perception problems of the hearing impaired reflect inability to use temporal fine structure. Proceedings of the National Academy of Sciences (USA), 103, 18866–18869.
50. Mackersie C. L. (2003). Talker separation and sequential stream segregation in listeners with hearing loss: Patterns associated with talker gender. Journal of Speech, Language, and Hearing Research, 46, 912–918.
51. Mackersie C. L. Prida T. L. Stiles D. (2001). The role of sequential stream segregation and frequency selectivity in the perception of simultaneous sentences by listeners with sensorineural hearing loss. Journal of Speech, Language, and Hearing Research, 44, 19–28.
52. Marrone N. Mason C. R. Kidd G. D. Jr. (2008). Evaluating the benefit of hearing aids in solving the cocktail party problem. Trends in Amplification, 12, 300–315.
53. McDermott J. H. Oxenham A. J. (2008). Spectral completion of partially masked sounds. Proceedings of the National Academy of Sciences (USA), 105, 5939–5944.
54. McKay C. M. McDermott H. J. Carlyon R. P. (2000). Place and temporal cues in pitch perception: Are they truly independent? Acoustics Research Letters Online, 1, 25–30.
55. Meddis R. Hewitt M. (1991a). Virtual pitch and phase sensitivity studied of a computer model of the auditory periphery. I: Pitch identification. Journal of the Acoustical Society of America, 89, 2866–2882.
56. Meddis R. Hewitt M. (1991b). Virtual pitch and phase sensitivity studied of a computer model of the auditory periphery. II: Phase sensitivity. Journal of the Acoustical Society of America, 89, 2882–2894.
57. Meddis R. O'Mard L. (1997). A unitary model of pitch perception. Journal of the Acoustical Society of America, 102, 1811–1820.
58. Micheyl C. Bernstein J. G. Oxenham A. J. (2006). Detection and F0 discrimination of harmonic complex tones in the presence of competing tones or noise. Journal of the Acoustical Society of America, 120, 1493–1505.
59. Miller G. A. Heise G. A. (1950). The trill threshold. Journal of the Acoustical Society of America, 22, 637–638.
60. Moore B. C. J. (1973). Frequency difference limens for short-duration tones. Journal of the Acoustical Society of America, 54, 610–619.
61. Moore B. C. J. Carlyon R. P. (2005). Perception of pitch by people with cochlear hearing loss and by cochlear implant users. In Plack C. J. Oxenham A. J. Fay R. Popper A. N. (Eds.), Pitch: Neural coding and perception. New York: Springer.
62. Moore B. C. J. Glasberg B. R. Peters R. W. (1985). Relative dominance of individual partials in determining the pitch of complex tones. Journal of the Acoustical Society of America, 77, 1853–1860.
63. Moore B. C. J. Peters R. W. (1992). Pitch discrimination and phase sensitivity in young and elderly subjects and its relationship to frequency selectivity. Journal of the Acoustical Society of America, 91, 2881–2893.
64. Moore B. C. J. Rosen S. M. (1979). Tune recognition with reduced pitch and interval information. Quarterly Journal of Experimental Psychology, 31, 229–240.
65. Narayan S. S. Temchin A. N. Recio A. Ruggero M. A. (1998). Frequency tuning of basilar membrane and auditory nerve fibers in the same cochleae. Science, 282, 1882–1884.
66. Nelson P. B. Jin S. H. (2004). Factors affecting speech understanding in gated interference: Cochlear implant users and normal-hearing listeners. Journal of the Acoustical Society of America, 115, 2286–2294.
67. Nelson P. B. Jin S. H. Carney A. E. Nelson D. A. (2003). Understanding speech in modulated interference: Cochlear implant users and normal-hearing listeners. Journal of the Acoustical Society of America, 113, 961–968.
68. Nelson D. A. van Tasell D. J. Schroder A. C. Soli S. Levine S. (1995). Electrode ranking of “place pitch” and speech recognition in electrical hearing. Journal of the Acoustical Society of America, 98, 1987–1999.
69. Oxenham A. J. Bernstein J. G. W. Penagos H. (2004). Correct tonotopic representation is necessary for complex pitch perception. Proceedings of the National Academy of Sciences (USA), 101, 1421–1425.
70. Oxenham A. J. Simonson A. M. (2009). Masking release for low- and high-pass filtered speech in the presence of noise and single-talker interference. Journal of the Acoustical Society of America.
71. Parsons T. W. (1976). Separation of speech from interfering speech by means of harmonic selection. Journal of the Acoustical Society of America, 60, 911–918.
72. Patterson R. D. (1976). Auditory filter shapes derived with noise stimuli. Journal of the Acoustical Society of America, 59, 640–654.
73. Penagos H. Melcher J. R. Oxenham A. J. (2004). A neural representation of pitch salience in non-primary human auditory cortex revealed with fMRI. Journal of Neuroscience, 24, 6810–6815.
74. Peters R. W. Moore B. C. J. Baer T. (1998). Speech reception thresholds in noise with and without spectral and temporal dips for hearing-impaired and normally hearing people. Journal of the Acoustical Society of America, 103, 577–587.
75. Pfingst B. E. Holloway L. A. Poopat N. Subramanya A. R. Warren M. F. Zwolan T. A. (1994). Effects of stimulus level on nonspectral frequency discrimination by human subjects. Hearing Research, 78, 197–209.
76. Pijl S. Schwarz D. W. (1995). Melody recognition and musical interval perception by deaf subjects stimulated with electrical pulse trains through single cochlear implant electrodes. Journal of the Acoustical Society of America, 98, 886–895.
77. Plack C. J. Oxenham A. J. (2005). Psychophysics of pitch. In Plack C. J. Oxenham A. J. Popper A. N. Fay R. (Eds.), Pitch: Neural coding and perception. New York: Springer.
78. Plomp R. (1967). Pitch of complex tones. Journal of the Acoustical Society of America, 41, 1526–1533.
79. Qin M. K. Oxenham A. J. (2003). Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. Journal of the Acoustical Society of America, 114, 446–454.
80. Qin M. K. Oxenham A. J. (2005). Effects of envelope-vocoder processing on F0 discrimination and concurrent-vowel identification. Ear and Hearing, 26, 451–460.
81. Rhode W. S. (1971). Observations of the vibration of the basilar membrane in squirrel monkeys using the Mössbauer technique. Journal of the Acoustical Society of America, 49, 1218–1231.
82. Ritsma R. J. (1967). Frequencies dominant in the perception of the pitch of complex sounds. Journal of the Acoustical Society of America, 42, 191–198.
83. Roberts B. Glasberg B. R. Moore B. C. (2002). Primitive stream segregation of tone sequences without differences in fundamental frequency or passband. Journal of the Acoustical Society of America, 112, 2074–2085.
84. Rose J. E. Brugge J. F. Anderson D. J. Hind J. E. (1967). Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey. Journal of Neurophysiology, 30, 769–793.
85. Rose M. M. Moore B. C. J. (1997). Perceptual grouping of tone sequences by normally hearing and hearing-impaired listeners. Journal of the Acoustical Society of America, 102, 1768–1778.
86. Ruggero M. A. Rich N. C. Recio A. Narayan S. S. Robles L. (1997). Basilar-membrane responses to tones at the base of the chinchilla cochlea. Journal of the Acoustical Society of America, 101, 2151–2163.
87. Scheffers M. T. M. (1983). Simulation of auditory analysis of pitch: An elaboration on the DWS pitch meter. Journal of the Acoustical Society of America, 74, 1716–1725.
88. Schouten J. F. (1940). The residue and the mechanism of hearing. Proc. Kon. Akad. Wetenschap, 43, 991–999.
89. Schouten J. F. Ritsma R. J. Cardozo B. L. (1962). Pitch of the residue. Journal of the Acoustical Society of America, 34, 1418–1424.
90. Shackleton T. M. Carlyon R. P. (1994). The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. Journal of the Acoustical Society of America, 95, 3529–3540.
91. Shamma S. A. (1985). Speech processing in the auditory system. I: The representation of speech sounds in the responses in the auditory nerve. Journal of the Acoustical Society of America, 78, 1612–1621.
92. Shamma S. A. Klein D. (2000). The case of the missing pitch templates: How harmonic templates emerge in the early auditory system. Journal of the Acoustical Society of America, 107, 2631–2644.
93. Shannon R. V. Zeng F. G. Kamath V. Wygonski J. Ekelid M. (1995). Speech recognition with primarily temporal cues. Science, 270, 303–304.
94. Shera C. A. Guinan J. J. Oxenham A. J. (2002). Revised estimates of human cochlear tuning from otoacoustic and behavioral measurements. Proceedings of the National Academy of Sciences Online (USA), 99, 3318–3323.
95. Shinn-Cunningham B. Best V. (2008). Selective attention in normal and impaired hearing. Trends in Amplification, 12, 283–299.
96. Singh P. G. (1987). Perceptual organization of complex-tone sequences: A trade-off between pitch and timbre? Proceedings of the National Academy of Sciences Online (USA), 82, 886–895.
97. Sininger Y. Starr A. (Eds.). (2001). Auditory neuropathy. San Diego, CA: Singular.
98. Sit J.-J. Simonson A. M. Oxenham A. J. Faltys M. A. Sarpeshkar R. (2007). A low-power asynchronous interleaved sampling algorithm for cochlear implants that encodes envelope and phase information. IEEE Transactions on Biomedical Engineering, 54, 138–149.
99. Snyder J. S. Alain C. Picton T. W. (2006). Effects of attention on neuroelectric correlates of auditory stream segregation. Journal of Cognitive Neuroscience, 18, 1–13.
100. Snyder J. S. Carter O. L. Lee S. K. Hannon E. E. Alain C. (2008). Effects of context on auditory stream segregation. Journal of Experimental Psychology: Human Perception and Performance, 34, 1007–1016.
101. Srulovicz P. Goldstein J. L. (1983). A central spectrum model: A synthesis of auditory-nerve timing and place cues in monaural communication of frequency spectrum. Journal of the Acoustical Society of America, 73, 1266–1276.
102. Stainsby T. H. Moore B. C. Glasberg B. R. (2004). Auditory streaming based on temporal structure in hearing-impaired listeners. Hearing Research, 192, 119–130.
103. Stickney G. S. Assmann P. F. Chang J. Zeng F. G. (2007). Effects of cochlear implant processing and fundamental frequency on the intelligibility of competing sentences. Journal of the Acoustical Society of America, 122, 1069–1078.
104. Stickney G. S. Zeng F. G. Litovsky R. Assmann P. (2004). Cochlear implant speech recognition with speech maskers. Journal of the Acoustical Society of America, 116, 1081–1091.
105. Summerfield A. Q. Assmann P. F. (1991). Perception of concurrent vowels: Effects of pitch-pulse asynchrony and harmonic misalignment. Journal of the Acoustical Society of America, 89, 1364–1377.
106. Summers V. Leek M. R. (1998). F0 processing and the separation of competing speech signals by listeners with normal hearing and with hearing loss. Journal of Speech, Language, and Hearing Research, 41, 1294–1306.
107. Terhardt E. Stoll G. Seewann M. (1982). Algorithm for extraction of pitch and pitch salience from complex tonal signals. Journal of the Acoustical Society of America, 71, 679–688.
108. Tong Y. C. Blamey P. J. Dowell R. C. Clark G. M. (1983). Psychophysical studies evaluating the feasibility of a speech processing strategy for a multiple-channel cochlear implant. Journal of the Acoustical Society of America, 74, 73–80.
109. Townsend B. Cotter N. van Compernolle D. White R. L. (1987). Pitch perception by cochlear implant subjects. Journal of the Acoustical Society of America, 82, 106–115.
110. Tsuji J. Liberman M. C. (1997). Intracelluar labeling of auditory nerve fibers in guinea pig: Central and peripheral projections. Journal of Comparative Neurology, 381, 188–202.
111. van Noorden L. P. A. S. (1975). Temporal coherence in the perception of tone sequences. Unpublished doctoral dissertation submitted to Eindhoven University of Technology, Netherlands.
112. Vliegen J. Moore B. C. J. Oxenham A. J. (1999). The role of spectral and periodicity cues in auditory stream segregation, measured using a temporal discrimination task. Journal of the Acoustical Society of America, 106, 938–945.
113. Vliegen J. Oxenham A. J. (1999). Sequential stream segregation in the absence of spectral cues. Journal of the Acoustical Society of America, 105, 339–346.
114. von Bismark G. (1974). Sharpness as an attribute of the timbre of steady sounds. Acustica, 30, 159–172.
115. Wightman F. L. (1973). The pattern-transformation model of pitch. Journal of the Acoustical Society of America, 54, 407–416.
116. Zeng F. G. (2002). Temporal pitch in electric hearing. Hearing Research, 174, 101–106.
117. Zeng F. G. Kong Y. Y. Michalewski H. J. Starr A. (2005). Perceptual consequences of disrupted auditory nerve activity. Journal of Neurophysiology, 93, 3050–3063.
118. Zwicker E. Flottorp G. Stevens S. S. (1957). Critical bandwidth in loudness summation. Journal of the Acoustical Society of America, 29, 548–557.