Pitch, harmonicity and concurrent sound segregation: Psychoacoustical and neurophysiological findings

Hearing Research

Volumn 266, Issue 1-2, 2010, Pages 36-51

  Micheyl, Christophe ^a   Oxenham, Andrew J ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Auditory scene analysis; Complex tones; Double vowels; Fundamental frequency; Harmonicity; Mistuned harmonic; Pitch

Indexed keywords

AUDITORY DISCRIMINATION; AUDITORY MASKING; AUDITORY STIMULATION; AUDITORY SYSTEM PARAMETERS; COCHLEAR NUCLEUS; EVOKED AUDITORY RESPONSE; FREQUENCY MODULATION; FUNDAMENTAL FREQUENCY; HEARING ACUITY; HUMAN; INFERIOR COLLICULUS; MATHEMATICAL MODEL; MECHANOTRANSDUCTION; MUSIC; NERVE POTENTIAL; NEUROPHYSIOLOGY; NONHUMAN; PITCH; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; REVIEW; SOUND DETECTION; SOUND LEVEL MEASUREMENT; SOUND TRANSMISSION; AUDITORY NERVOUS SYSTEM; BIOLOGICAL MODEL; COMPUTER SIMULATION; HEARING; PERCEPTION; PHYSIOLOGY; PSYCHOPHYSICS; SOUND; SPEECH PERCEPTION; TIME;

AUDITORY PATHWAYS; AUDITORY PERCEPTION; COMPUTER SIMULATION; EVOKED POTENTIALS, AUDITORY; HUMANS; MODELS, NEUROLOGICAL; MUSIC; PERCEPTUAL MASKING; PITCH DISCRIMINATION; PITCH PERCEPTION; PSYCHOACOUSTICS; SOUND; SOUND SPECTROGRAPHY; SPEECH PERCEPTION; TIME FACTORS;

EID: 77953685503     PISSN: 03785955     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.heares.2009.09.012     Document Type: Review

References (117)

1. Alain C. Breaking the wave: effects of attention and learning on concurrent sound perception. Hear. Res. 2007, 229:225-236.
2. Alain C., Izenberg A. Effects of attentional load on auditory scene analysis. J. Cogn. Neurosci. 2003, 15:1063-1073.
3. Alain C., Bernstein L.J. From sounds to meaning: the role of attention during auditory scene analysis. Curr. Opin. Otolaryngol. Head Neck Surg. 2008, 485:489.
4. Alain C., Arnott S.R., Picton T.W. Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials. J. Exp. Psychol. Hum. Percept. Perform. 2001, 27:1072-1089.
5. Alain C., Schuler B.M., McDonald K.L. Neural activity associated with distinguishing concurrent auditory objects. J. Acoust. Soc. Am. 2002, 111:990-995.
6. Alain C., Reinke K., He Y., Wang C., Lobaugh N. Hearing two things at once. neurophysiological indices of speech segregation and identification. J. Cogn. Neurosci. 2005, 17:811-818.
7. Alain C., Reinke K., McDonald K.L., Chau W., Tam F., Pacurar A., Graham S. Left thalamo-cortical network implicated in successful speech separation and identification. Neuroimage 2005, 26:592-599.
8. Arehart K.H. Effects of high-frequency amplification on double-vowel identification in listeners with hearing loss. J. Acoust. Soc. Am. 1998, 104:1733-1736.
9. Arehart K.H., King C.A., McLean-Mudgett K.S. Role of fundamental frequency differences in the perceptual separation of competing vowel sounds by listeners with normal hearing and listeners with hearing loss. J. Speech Lang. Hear. Res. 1997, 40:1434-1444.
10. Arehart K.H., Rossi-Katz J., Swensson-Prutsman J. Double-vowel perception in listeners with cochlear hearing loss: differences in fundamental frequency, ear of presentation, and relative amplitude. J. Speech Lang. Hear. Res. 2005, 48:236-252.
11. Assmann P.F., Summerfield Q. Modeling the perception of concurrent vowels: vowels with the same fundamental frequency. J. Acoust. Soc. Am. 1989, 85:327-338.
12. Assmann P.F., Summerfield Q. Modeling the perception of concurrent vowels: vowels with different fundamental frequencies. J. Acoust. Soc. Am. 1990, 88:680-697.
13. Assmann P.F., Paschall D.D. Pitches of concurrent vowels. J. Acoust. Soc. Am. 1998, 103:1150-1160.
14. Beerends J.G., Houtsma A.J. Pitch identification of simultaneous dichotic two-tone complexes. J. Acoust. Soc. Am. 1986, 80:1048-1056.
15. Beerends J.G., Houtsma A.J. Pitch identification of simultaneous diotic and dichotic two-tone complexes. J. Acoust. Soc. Am. 1989, 85:813-819.
16. Bernstein J.G., Oxenham A.J. Harmonic segregation through mistuning can improve fundamental frequency discrimination. J. Acoust. Soc. Am. 2008, 124:1653-1667.
17. Borchert, E.M.O., Micheyl, C., Oxenham, A.J., submitted for publication. Perceptual grouping affects pitch judgments across time and frequency. J. Exp. Psychol. Hum. Percept. Perform.
18. Bregman A.S. Auditory Scene Analysis 1990, MIT Press, Cambridge, MA.
19. Brunstrom J.M., Roberts B. Effects of asynchrony and ear of presentation on the pitch of mistuned partials in harmonic and frequency-shifted complex tones. J. Acoust. Soc. Am. 2001, 110:391-401.
20. Cariani P.A. Neural timing nets. Neural Netw. 2001, 14:737-753.
21. Cariani P.A. Temporal codes and computations for sensory representation and scene analysis. IEEE Trans. Neural Netw. 2004, 15:1100-1111.
22. Cariani P.A., Delgutte B. Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. J. Neurophysiol. 1996, 76:1698-1716.
23. Carlyon R.P. Masker asynchrony impairs the fundamental-frequency discrimination of unresolved harmonics. J. Acoust. Soc. Am. 1996, 99:525-533.
24. Carlyon R.P. Encoding the fundamental frequency of a complex tone in the presence of a spectrally overlapping masker. J. Acoust. Soc. Am. 1996, 99:517-524.
25. Carlyon R.P. The effect of two temporal cues on pitch judgments. J. Acoust. Soc. Am. 1997, 102:1097-1105.
26. Carlyon R.P., Shackleton T.M. Comparing the fundamental frequencies of resolved and unresolved harmonics: evidence for two pitch mechanisms?. J. Acoust. Soc. Am. 1994, 95:3541-3554.
27. Carlyon R.P., Gockel H. Effects of harmonicity and regularity on the perception of sound sources. Auditory Perception of Sound Sources 2008, Springer, New York. W.A. Yost, A.N. Popper, R. Fay (Eds.).
28. Cohen M.A., Grossberg S., Wyse L.L. A spectral network model of pitch perception. J. Acoust. Soc. Am. 1995, 98:862-879.
29. Culling J.F., Darwin C.J. Perceptual separation of simultaneous vowels: within and across-formant grouping by F0. J. Acoust. Soc. Am. 1993, 93:3454-3467.
30. Culling J.F., Darwin C.J. Perceptual and computational separation of simultaneous vowels: cues arising from low-frequency beating. J. Acoust. Soc. Am. 1994, 95:1559-1569.
31. Darwin C.J., Carlyon R.P. Auditory grouping. Hearing 1995, 387-424. Academic Press, London. second ed. B.C.J. Moore (Ed.).
32. Darwin C.J., Ciocca V., Sandell G.J. Effects of frequency and amplitude modulation on the pitch of a complex tone with a mistuned harmonic. J. Acoust. Soc. Am. 1994, 95:2631-2636.
33. de Cheveigné A. Separation of concurrent harmonic sounds: fundamental frequency estimation and a time-domain cancellation model of auditory processing. J. Acoust. Soc. Am. 1993, 93:3271-3290.
34. de Cheveigné A. Harmonic fusion and pitch shifts of mistuned partials. J. Acoust. Soc. Am. 1997, 102:1083-1087.
35. de Cheveigné A. Concurrent vowel identification. III. A neural model of harmonic interference cancellation. J. Acoust. Soc. Am. 1997, 101:2857-2865.
36. de Cheveigné A. Waveform interactions and the segregation of concurrent vowels. J. Acoust. Soc. Am. 1999, 106:2959-2972.
37. de Cheveigné A. Pitch perception models. Pitch. Neural Coding and Perception 2005, vol. 24:169-233. Springer, New York.
38. de Cheveigné A. Multiple F0 estimation. Computational Auditory Scene Analysis. Principles, Algorithms, and Applications 2006, 45-80. Wiley, Hoboken, NJ. D. Wang, G.J. Brown (Eds.).
39. de Cheveigné A., McAdams S., Laroche J., Rosenberg M. Identification of concurrent harmonic and inharmonic vowels: a test of the theory of harmonic cancellation and enhancement. J. Acoust. Soc. Am. 1995, 97:3736-3748.
40. de Cheveigné A., Kawahara H., Tsuzaki M., Aikawa K. Concurrent vowel identification. I. Effects of relative amplitude and F0 difference. J. Acoust. Soc. Am. 1997, 101:2839-2847.
41. Delgutte B. Representation of speech-like sounds in the discharge patterns of auditory-nerve fibers. J. Acoust. Soc. Am. 1980, 68:843-857.
42. Delgutte B., Kiang N.Y. Speech coding in the auditory nerve: I. Vowel-like sounds. J. Acoust. Soc. Am. 1984, 75:866-878.
43. Demany L., Semal C. Harmonic and melodic octave templates. J. Acoust. Soc. Am. 1990, 88:2126-2135.
44. Duifhuis H., Willems L.F., Sluyter R.J. Measurement of pitch in speech: an implementation of Goldstein's theory of pitch perception. J. Acoust. Soc. Am. 1982, 71:1568-1580.
45. Dyson B.J., Alain C. Representation of concurrent acoustic objects in primary auditory cortex. J. Acoust. Soc. Am. 2004, 115:280-288.
46. Feeney M.P. Dichotic beats of mistuned consonances. J. Acoust. Soc. Am. 1997, 102:2333-2342.
47. Fishman Y.I., Volkov I.O., Noh M.D., Garell P.C., Bakken H., Arezzo J.C., Howard M.A., Steinschneider M. Consonance and dissonance of musical chords: neural correlates in auditory cortex of monkeys and humans. J. Neurophysiol. 2001, 86:2761-2788.
48. Gilbert G., Micheyl C. Influence of competing multi-talker babble on frequency importance functions for speech measured using a correlational approach. Acta Acust. United Acust. 2005, 145:154.
49. Glasberg B.R., Moore B.C.J. Derivation of auditory filter shapes from notched-noise data. Hear. Res. 1990, 47:103-138.
50. Gockel H., Carlyon R.P., Plack C.J. Across-frequency interference effects in fundamental frequency discrimination: questioning evidence for two pitch mechanisms. J. Acoust. Soc. Am. 2004, 116:1092-1104.
51. Gockel H., Carlyon R.P., Moore B.C.J. Pitch discrimination interference: the role of pitch pulse asynchrony. J. Acoust. Soc. Am. 2005, 117:3860-3866.
52. Gockel H.E., Hafter E.R., Moore B.C.J., Carlyon R.P., Plack C.J., Gockel H., Patterson R.D., Meddis R. Pitch discrimination interference: the role of ear of entry and of octave similarity. J. Acoust. Soc. Am. 2009, 125:324-327.
53. Goldstein J.L. An optimum processor theory for the central formation of the pitch of complex tones. J. Acoust. Soc. Am. 1973, 54:1496-1516.
54. Hartmann W.M., McAdams S., Smith B.K. Matching the pitch of a mistuned harmonic in a complex sound. IRCAM Annu. Rep. 1986, 1986:54-63.
55. Hartmann W.M., McAdams S., Smith B.K. Hearing a mistuned harmonic in an otherwise periodic complex tone. J. Acoust. Soc. Am. 1990, 88:1712-1724.
56. Houtsma A.J.M., Goldstein J.L. The central origin of the pitch of complex tones: evidence from musical interval recognition. J. Acoust. Soc. Am. 1972, 51:520-529.
57. Keilson S.E., Richards V.M., Wyman B.T., Young E.D. The representation of concurrent vowels in the cat anesthetized ventral cochlear nucleus: evidence for a periodicity-tagged spectral representation. J. Acoust. Soc. Am. 1997, 102:1056-1071.
58. Kiang N.Y.-S., Watanabe T., Thomas E.C., Clark L.F. Discharge Patterns of Single Fibres in the Cat's Auditory Nerve 1965, MIT Press, Cambridge, MA.
59. Krumbholz K., Bleeck S., Patterson R.D., Senokozlieva M., Seither-Preisler A., Lutkenhoner B. The effect of cross-channel synchrony on the perception of temporal regularity. J. Acoust. Soc. Am. 2005, 118:946-954.
60. Laguitton V., Demany L., Semal C., Liegeois-Chauvel C. Pitch perception: a difference between right- and left-handed listeners. Neuropsychologia 1998, 36:201-207.
61. Larsen E., Cedolin L., Delgutte B. Pitch representations in the auditory nerve: two concurrent complex tones. J. Neurophysiol. 2008, 100:1301-1319.
62. Liberman M.C. Auditory-nerve response from cats raised in a low-noise chamber. J. Acoust. Soc. Am. 1978, 63:442-455.
63. Lin J.Y., Hartmann W.M. The pitch of a mistuned harmonic: evidence for a template model. J. Acoust. Soc. Am. 1998, 103:2608-2617.
64. McKinney M.F., Tramo M.J., Delgutte B. Neural correlates of musical dissonance in the inferior colliculus. Physiological and Psychophysical Bases of Auditory Function 2001, 71-77. Shaker, Masstricht, Netherlands. A.J.M. Houstma (Ed.).
65. Meddis R., Hewitt M. Virtual pitch and phase sensitivity studied of a computer model of the auditory periphery. II: phase sensitivity. J. Acoust. Soc. Am. 1991, 89:2882-2894.
66. Meddis R., Hewitt M. Virtual pitch and phase sensitivity studied of a computer model of the auditory periphery. I: pitch identification. J. Acoust. Soc. Am. 1991, 89:2866-2882.
67. Meddis R., Hewitt M.J. Modeling the identification of concurrent vowels with different fundamental frequencies. J. Acoust. Soc. Am. 1992, 91:233-245.
68. Meddis R., O'Mard L. A unitary model of pitch perception. J. Acoust. Soc. Am. 1997, 102:1811-1820.
69. Micheyl C., Oxenham A.J. Sequential F0 comparisons between resolved and unresolved harmonics: no evidence for translation noise between two pitch mechanisms. J. Acoust. Soc. Am. 2004, 116:3038-3050.
70. Micheyl C., Oxenham A.J. Comparing F0 discrimination in sequential and simultaneous conditions. J. Acoust. Soc. Am. 2005, 118:41-44.
71. Micheyl C., Oxenham A.J. Across-frequency pitch discrimination interference between complex tones containing resolved harmonics. J. Acoust. Soc. Am. 2007, 121:1621-1631.
72. Micheyl C., Bernstein J.G., Oxenham A.J. Detection and F0 discrimination of harmonic complex tones in the presence of competing tones or noise. J. Acoust. Soc. Am. 2006, 120:1493-1505.
73. Micheyl, C., Keebler, M.V., Oxenham, A.J., submitted for publication. Pitch perception in mixtures of harmonic complex tones. J. Acoust. Soc. Am.
74. Miller R.L., Schilling J.R., Franck K.R., Young E.D. Effects of acoustic trauma on the representation of the vowel /e/ in cat auditory nerve fibers. J. Acoust. Soc. Am. 1997, 101:3602.
75. Moore B.C.J., Glasberg B.R. Frequency discrimination of complex tones with overlapping and non-overlapping harmonics. J. Acoust. Soc. Am. 1990, 87:2163-2177.
76. Moore B.C.J., Glasberg B.R., Peters R.W. Thresholds for hearing mistuned partials as separate tones in harmonic complexes. J. Acoust. Soc. Am. 1986, 80:479-483.
77. Moore B.C.J. Perceptual Consequences of Cochlear Damage 1995, Oxford University Press, Oxford.
78. Moore B.C.J., Glasberg B.R., Peters R.W. Relative dominance of individual partials in determining the pitch of complex tones. J. Acoust. Soc. Am. 1985, 77:1853-1860.
79. Palmer A.R. The representation of concurrent vowels in the temporal discharge patterns of auditory nerve fibers. Basic Issue in Hearing 1988, 244-251. Academic, London. H. Duifhuis, J.W. Jorst, H.P. Wit (Eds.).
80. Palmer A.R. Segregation of the responses to paired vowels in the auditory nerve using autocorrelation. The Auditory Processing of Speech: From Sounds to Words 1992, 115-124. Mouton de Gruyter, Berlin. M.E.H. Schouten (Ed.).
81. Palmer A.R., Winter I.M., Darwin C.J. The representation of steady-state vowel sounds in the temporal discharge patterns of the guinea pig cochlear nerve and primarylike cochlear nucleus neurons. J. Acoust. Soc. Am. 1986, 79:100-113.
82. Parsons T. Separation of speech from interfering speech by means of harmonic selection. J. Acoust. Soc. Am. 1976, 60:911-918.
83. Patterson R.D., Allerhand M.H., Giguere C. Time-domain modeling of peripheral auditory processing: a modular architecture and a software platform. J. Acoust. Soc. Am. 1995, 98:1890-1894.
84. Qin M.K., Oxenham A.J. Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. J. Acoust. Soc. Am. 2003, 114:446-454.
85. Qin M.K., Oxenham A.J. Effects of introducing unprocessed low-frequency information on the reception of envelope-vocoder processed speech. J. Acoust. Soc. Am. 2006, 119:2417-2426.
86. Ritter W., Simson R., Vaughan H.G., Friedman D. A brain event related to the making of a sensory discrimination. Science 1979, 203:1358-1361.
87. Roberts B., Bregman A.S. Effects of the pattern of spectral spacing on the perceptual fusion of harmonics. J. Acoust. Soc. Am. 1991, 90:3050-3060.
88. Roberts B., Bailey P.J. Spectral pattern and the perceptual fusion of harmonics. I. The role of temporal factors. J. Acoust. Soc. Am. 1993, 94:3153-3164.
89. Roberts B., Bailey P.J. Spectral pattern and the perceptual fusion of harmonics. II. A special status for added components?. J. Acoust. Soc. Am. 1993, 94:3165-3177.
90. Roberts B., Bailey P.J. Spectral regularity as a factor distinct from harmonic relations in auditory grouping. J. Exp. Psychol. Hum. Percept. Perform. 1996, 22:604-614.
91. Roberts B., Bailey P.J. Regularity of spectral pattern and its effects on the perceptual fusion of harmonics. Percept. Psychophys. 1996, 58:289-299.
92. Roberts B., Brunstrom J.M. Perceptual segregation and pitch shifts of mistuned components in harmonic complexes and in regular inharmonic complexes. J. Acoust. Soc. Am. 1998, 104:2326-2338.
93. Roberts B., Brunstrom J.M. Perceptual fusion and fragmentation of complex tones made inharmonic by applying different degrees of frequency shift and spectral stretch. J. Acoust. Soc. Am. 2001, 110:2479-2490.
94. Roberts B., Holmes S.D. Grouping and the pitch of a mistuned fundamental component: effects of applying simultaneous multiple mistunings to the other harmonics. Hear. Res. 2006, 222:79-88.
95. Rossi-Katz J.A., Arehart K.H. Effects of cochlear hearing loss on perceptual grouping cues in competing-vowel perception. J. Acoust. Soc. Am. 2005, 118:2588-2598.
96. Sachs M.B., Abbas P.J. Rate versus level functions for auditory-nerve fibers in cats: tone-burst stimuli. J. Acoust. Soc. Am. 1974, 56:1835-1847.
97. Sachs M.B., Young E.D. Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. J. Acoust. Soc. Am. 1979, 66:470-479.
98. Sachs M.B., Voigt H.F., Young E.D. Auditory nerve representation of vowels in background noise. J. Neurophysiol. 1983, 50:27-45.
99. Scheffers M. Sifting Vowels: Auditory Pitch Analysis and Sound Segregation 1983, Groningen University, Groningen.
100. Scheffers M.T. Simulation of auditory analysis of pitch: an elaboration on the DWS pitch meter. J. Acoust. Soc. Am. 1983, 74:1716-1725.
101. Schroeder M.R. Period histogram and product spectrum: new methods for fundamental-frequency measurement. J. Acoust. Soc. Am. 1968, 43:829-834.
102. Shackleton T.M., Carlyon R.P. The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. J. Acoust. Soc. Am. 1994, 95:3529-3540.
103. Shamma S., Klein D. The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. J. Acoust. Soc. Am. 2000, 107.
104. Sinex D.G. Spectral processing and sound source determination. Int. Rev. Neurobiol. 2005, 70:371-398.
105. Sinex D.G. Responses of cochlear nucleus neurons to harmonic and mistuned complex tones. Hear. Res. 2008, 238:39-48.
106. Sinex D.G., Li H. Responses of inferior colliculus neurons to double harmonic tones. J. Neurophysiol. 2007, 98:3171-3184.
107. Sinex D.G., Sabes J.H., Li H. Responses of inferior colliculus neurons to harmonic and mistuned complex tones. Hear. Res. 2002, 168:150-162.
108. Sinex D.G., Li H., Velenovsky D.S. Prevalence of stereotypical responses to mistuned complex tones in the inferior colliculus. J. Neurophysiol. 2005, 94:3523-3537.
109. Sinex D.G., Guzik H., Li H., Henderson Sabes J. Responses of auditory nerve fibers to harmonic and mistuned complex tones. Hear. Res. 2003, 182:130-139.
110. Srulovicz P., Goldstein J.L. A central spectrum model: a synthesis of auditory-nerve timing and place cues in monaural communication of frequency spectrum. J. Acoust. Soc. Am. 1983, 73:1266-1276.
111. Terhardt E. Calculating virtual pitch. Hear. Res. 1979, 1:155-182.
112. Tramo M.J., Cariani P.A., Delgutte B., Braida L.D. Neurobiological foundations for the theory of harmony in western tonal music. Ann. NY Acad. Sci. 2001, 930:92-116.
113. Weintraub M. A Theory and Computational Model of Auditory Monaural Sound Separation 1985, Stanford.
114. Wightman F.L. The pattern-transformation model of pitch. J. Acoust. Soc. Am. 1973, 54:407-416.
115. Young E.D., Sachs M.B. Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. J. Acoust. Soc. Am. 1979, 66:1381-1403.
116. Zweig G. Basilar membrane motion. Cold Spring Harb. Symp. Quant. Biol. 1976, 40:619-633.
117. Zwicker U. Auditory recognition of diotic and dichotic vowel pairs. Speech Commun. 1984, 3:265-277.