Neural correlates of the pitch of complex tones. I. Pitch and pitch salience

Journal of Neurophysiology

Volumn 76, Issue 3, 1996, Pages 1698-1716

  Cariani, Peter A ^a   Delgutte, Bertrand ^a  

^a MASSACHUSETTS EYE AND EAR INFIRMARY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NERVE FIBER; ALGORITHM; AMPLITUDE MODULATION; ANESTHESIA; ANIMAL EXPERIMENT; ARTICLE; AUDITORY STIMULATION; CAT; CLICK; FREQUENCY MODULATION; HEARING; HISTOGRAM; NOISE; NONHUMAN; PITCH; PRIORITY JOURNAL; PSYCHOPHYSICS; SPIKE; WAVEFORM;

EID: 0029745579     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.1996.76.3.1698     Document Type: Article

References (117)

1. VON BEKESY, G. Hearing theories and complex sounds. J. Acoust. Soc. Am. 35: 588-601, 1963.
2. BHARUCHA, J. J. Pitch, harmony and neural nets: a psychological perspective. In: Connectionism and Music, edited by P. Todd and G. Loy. Cambridge, MA: MIT Press, 1991, p. 84-99.
3. BILSEN, R. A. AND RITSMA, R. J. Some parameters influencing the perceptibility of pitch. J. Acoust. Soc. Am. 47: 469-475, 1970.
4. DE BOER, E. On the "residue" and auditory pitch perception. In: Handbook of Sensory Physiology, edited by W. D. Keidel and W. D. Neff. Berlin: Springer-Verlag, 1976, p. 479-583.
5. BORING, E. G. Sensation and Perception in the History of Experimental Psychology. New York: Appleton-Century-Crofts, 1942.
6. BOURK, T. R. Electrical Responses of Neural Units in the Anteroventral Cochlear Nucleus of the Cat (PhD thesis). Cambridge, MA: MIT, 1976.
7. BURNS, E. M. AND FETH, L. L. Pitch of sinusoids and complex tones above 10 kHz. In: Hearing - Physiological Bases and Psychophysics, edited by R. Klinke and R. Hartmann. Berlin: Springer-Verlag, 1983, p. 327-333.
8. BURNS, E. M. AND VIEMEISTER, N. F. Nonspectral pitch. J. Acoust. Soc. Am. 60: 863-869, 1976.
9. BURNS, E. M. AND VIEMEISTER, N. F. Played-again SAM: further observations on the pitch of amplitude-modulated noise. J. Acoust. Soc. Am. 70: 1655-1660, 1981.
10. CARIANI, P. As if time really mattered: temporal strategies for neural coding of sensory information. Commun. Cognit. Artif. Intell. 12: 161-229, 1995.
11. CARIANI, P. AND DELGUTTE, B. Interspike interval distributions of auditory nerve fibers in response to variable-pitch complex stimuli. Assoc. Res. Otolaryngol. Abstr. 1992, p. 36.
12. CARIANI, P. AND DELGUTTE, B. Interspike interval distributions of auditory nerve fibers in response to concurrent vowels with same and different fundamental frequencies. Assoc. Res. Otolaryngol. Abstr. 1993, p. 94.
13. CARIANI, P. AND DELGUTTE, B. Transient changes in neural discharge patterns may enhance separation of concurrent vowels with different fundamental frequencies (Abstract). J. Acoust. Soc. Am. 95: 2842, 1994.
14. DE CHEVEIGNÉ. A. A pitch perception model. ICASSP Tokyo 86: 897-900, 1986.
15. CHUNG, S. H., RAYMOND, S. A., AND LETTVIN, J. Y. Multiple meaning in single visual units. Brain Behav. Evol. 3: 72-101, 1970.
16. COHEN, M. A., GROSSBERG, S., AND WYSE, L. L. A spectral network model of pitch perception. J. Acoust. Soc. Am. 98: 862-879, 1994.
17. CYNX, J. Periodicity pitch in a species of songbird, the European starling (Sturnus vulgaris). Assoc. Res. Otolaryngol. Abstr. 138, 1986.
18. DELGUTTE, B. Representation of speech-like sounds in the discharge patterns of auditory-nerve fibers. J. Acoust. Soc. Am. 68: 843-857, 1980.
19. DELGUTTE, B. Physiological models for basic auditory percepts. In: Auditory Computation, edited by H. Hawkins, T. McMullin, A. N. Popper, and R. R. Fay. New York: Springer-Verlag, 1995, p. 157-220.
20. DELGUTTE, B. Auditory neural processing of speech. In: The Handbook of the Phonetic Sciences, edited by W. J. Hardcastle and J. Laver. Oxford, UK: Blackwell. In press.
21. DELGUTTE, B. AND CARIANI, P. Coding of the pitch of harmonic and inharmonic complex tones in the interspike intervals of auditory nerve fibers. In: The Processing of Speech, edited by M. E. H. Schouten. Berlin: Mouton-DeGruyer, 1992, p. 37-45.
22. DELGUTTE, B. AND KIANG, N. Y. S. Speech coding in the auditory nerve. I. Vowel-like sounds. J. Acoust. Soc. Am. 75: 866-878, 1984.
23. DENG, L. AND GEISLER, S. Responses of auditory nerve fibers to multiple tone complexes. J. Acoust. Soc. Am. 82: 1989-2000, 1987.
24. DUIFHUIS, H., WILLEMS, L. F., AND SLUYTER, R. J. Measurement of pitch in speech: an implementation of Goldstein's theory of pitch perception. J. Acoust. Soc. Am. 71: 1568-1580, 1982.
25. EVANS, E. F. Place and time coding of frequency in the peripheral auditory system: some physiological pros and cons. Audiology 17: 369-420, 1978.
26. EVANS, E. F. Pitch and cochlear nerve fibre temporal discharge patterns. In: Hearing: Physiological Bases and Psychophysics, edited by R. Klinke and R. Hartmann. Berlin: Springer-Verlag, 1983, p. 140-146.
27. EVANS, E. F. Cochlear nerve fibre temporal discharge patterns, cochlear frequency selectivity and the dominant region for pitch. In: Auditory Frequency Selectivity, edited by B. C. J. Moore and R. D. Patterson. New York: Plenum, 1986, p. 253-264.
28. FASTL, H. AND STOLL, G. Scaling of pitch strength. Hear. Res. 1: 293-301, 1979.
29. FAY, R. R. Perception of amplitude-modulated auditory signals by the goldfish. J. Acoust. Soc. Am. 53: 660-666, 1972.
30. FAY, R. R., YOST, W. A., AND COOMBS, S. Psychophysics and neurophysiology of repetition noise processing in a vertebrate auditory system. Hear. Res. 12: 31-55, 1983.
31. FENG, A. S., HALL, J. C., AND SIDDIQUE, S. Coding of temporal parameters of complex sounds by frog auditory nerve fibers. J. Neurophysiol. 65: 424-445, 1991.
32. GERSON, A. AND GOLDSTEIN, J. L. Evidence for a general template in central optimal processing for pitch of complex tones. J. Acoust. Soc. Am. 63: 498-510, 1978.
33. GHITZA, O. Auditory nerve representation as a basis for speech processing. In: Advances in Speech Signal Processing, edited by S. Furui and M. M. Sondhi. New York: Dekker, 1992, p. 453-485.
34. GOLDSTEIN, J. L. An optimum processor theory for the central formation of the pitch of complex tones. J. Acoust. Soc. Am. 54: 1496-1516, 1973.
35. GOLDSTEIN, J. L. AND SRULOVICZ, P. Auditory-nerve spike intervals as an adequate basis for aural frequency measurement. In: Psychophysics and Physiology of Hearing, edited by E. F. Evans and J. P. Wilson. London: Academic, 1977.
36. GREENBERG, S. Possible role of low and medium spontaneous rate cochlear nerve fibers in the encoding of waveform periodicity. In: Auditory Frequency Selectivity, edited by B. C. J. Moore and R. D. Patterson. New York: Plenum, 1986, p. 241-251.
37. GREENBERG, S. AND RHODE, W. S. Periodicity coding in cochlear nerve and ventral cochlear nucleus. In: Auditory Processing of Complex Sounds, edited by W. A. Yost and C. S. Watson. Hillsdale, NJ: Erlbaum. 1987, p. 225-236.
38. GREENWOOD, D. D. A cochlear frequency-position function for several species - 29 years later. J. Acoust. Soc. Am. 87: 2592-2604, 1990.
39. HEFNER, H. AND WHITFIELD, I. C. Perception of the missing fundamental in cats. J. Acoust. Soc. Am. 59: 915-919, 1976.
40. HERMES, D. J. Pitch analysis. In: Visual Representations of Speech Signals, edited by S. Beet and M. Crawford. Chichester, UK: Wiley, 1993, p. 3-25.
41. HIRAHARA, T., CARIANI, P., AND DELGUTTE, B. Representation of low-frequency vowel formants in the auditory nerve. Assoc. Res. Otolaryngol. Abstr. 80, 1996.
42. HORST, J. W., JAVEL, E., AND FARLEY, G. R. Coding of spectral fine structure in the auditory nerve. I. Fourier analysis of period and interspike interval histograms. J. Acoust. Soc. Am. 79: 398-416, 1986.
43. HORST, J. W., JAVEL, E., AND FARLEY, G. R. Coding of fundamental frequency in auditory nerve fibers: effects of signal level and phase spectrum. In: The Processing of Speech, edited by M. E. H. Schouten. Berlin: Mouton-DeGruyer, 1992, p. 29-36.
44. HOUTSMA, A. J. M. AND SMURZYNSKI, J. Pitch identification and discrimination for complex tones with many harmonics. J. Acoust. Soc. Am. 87: 304-310, 1990.
45. HOUTSMA, A. J. M., WICKE, R. W., AND ORDUBADI, A. Pitch of amplitude modulated low-pass noise and predictions by temporal and spectral theories. J. Acoust. Soc. Am. 67: 1312-1322, 1980.
46. JAVEL, E. Coding of AM tones in the chinchilla auditory nerve: implications for the pitch of complex tones. J. Acoust. Soc. Am. 68: 133-146, 1980.
47. JAVEL, E., MCGEE, J. A., HORST, W., AND FARLEY, G. R. Temporal mechanisms in auditory stimulus coding. In: Auditory Function: Neurobiological Bases of Hearing, edited by G. M. Edelman, W. E. Gall, and W. M. Cowan. New York: Wiley, 1988, p. 515-558.
48. TEN KATE, J. AND VAN BEKKUM, M. F. Synchrony-dependent autocorrelation in eight-nerve-fiber response to rippled noise. J. Acoust. Soc. Am. 84: 2092-2102, 1988.
49. KIANG, N. Y. S., EDDINGTON, D. K., AND DELGUTTE, B. Fundamental considerations in designing auditory implants. Acta Otolaryngol. 87: 294-218, 1979.
50. KIANG, N. Y. S. AND MOXON, E. C. Physiological considerations in artificial stimulation of the inner ear. Ann. Otol. Rhinol. Laryngol. 81: 714-731, 1972.
51. KIANG, N. Y. S., MOXON, E. C., AND LEVINE, R. A. Auditory-nerve activity in cats with normal and abnormal cochleas. In: Sensorineural Hearing Loss, edited by G. E. W. Wolstenholme and J. Knight. London: Churchill, 1970, p. 241-273.
52. KIANG, N. Y. S., WATANABE, T., THOMAS, E. C., AND CLARK, L. F. Discharge Patterns of Single Fibers in the Cat's Auditory Nerve. Cambridge, MA: MIT Press, 1965.
53. KIM, D. O., SIRIANNI, J. G., AND CHANG, S. O. Responses of DCN-PVCN neurons and auditory nerve fibers in unanesthetized decerebrate cats to AM and pure tones: analysis with autocorrelation/power-spectrum. Hear. Res. 45: 95-113, 1990.
54. LANGE, F. H. Correlation Techniques. Princeton, NJ: Van Nostrand, 1967.
55. LAZZARO, J. AND MEAD, C. Silicon modeling of pitch perception. Proc. Natl. Acad. Sci. USA 86: 9597-9601, 1989.
56. LIBERMAN, C. E. AND KIANG, N. Y. S. Acoustic trauma in cats. Acta Otolaryngol. Suppl. 358: 1-63, 1978.
57. LIBERMAN, M. C. The cochlear frequency map for the cat: labeling auditory-nerve fibers of known characteristic frequency. J. Acoust. Soc. Am. 72: 1441-1449, 1982.
58. LICKLIDER, J. C. R. A duplex theory of pitch perception. Experientia VII: 128-134, 1951.
59. LICKLIDER, J. C. R. "Periodicity" pitch and "place" pitch (Abstract). J. Acoust. Soc. Am. 26: 945, 1954.
60. LICKLIDER, J. C. R. Auditory frequency analysis. In: Information Theory, edited by C. Cherry. London: Butterworths, 1956, p. 253-268.
61. LICKLIDER, J. C. R. Three auditory theories. In: Psychology: A Study of a Science. Study I. Conceptual and Systematic, edited by S. Koch. New York: McGraw-Hill, 1959, p. 41-144.
62. LYON, R. AND SHAMMA, S. Auditory representations of timbre and pitch. In: Auditory Computation, edited by H. Hawkins, T. McMullin, A. N. Popper, and R. R. Fay. New York: Springer-Verlag, 1995, p. 517.
63. MEDDIS, R. AND HEWITT, M. J. Virtual pitch and phase sensitivity of a computer model of the auditory periphery. I. Pitch identification. J. Acoust. Soc. Am. 89: 2866-2882, 1991a.
64. MEDDIS, R. AND HEWITT, M. J. Virtual pitch and phase sensitivity of a computer model of the auditory periphery. II. Phase sensitivity. J. Acoust. Soc. Am. 89: 2883-2894, 1991b.
65. MELCHER, J. R. The Cellular Generators of the Brainstem Auditory Evoked Potential (PhD thesis). Cambridge, MA: MIT, 1993.
66. MILLER, G. A. AND TAYLOR, W. G. The perception of repeated bursts of noise. J. Acoust. Soc. Am. 20: 171-182, 1948.
67. MILLER, M. I. AND SACHS, M. B. Representation of voice pitch in discharge patterns of auditory-nerve fibers. Hear. Res. 14: 257-279, 1984.
68. MØLLER, A. R. The use of correlation analysis in processing neuroelectric data. In: Progress in Brain Research, Computers and Brains, edited by J. P. Schade and J. Smith. Amsterdam: Elsevier, 1970, vol. 33, p. 87-99.
69. MOORE, B. C. J. Introduction to the Psychology of Hearing (3rd ed.). London: Academic, 1989.
70. MOORE, B. C. J. Pitch perception in silicon. Nature Land. 343: 114-115, 1990.
71. MOORE, B. C. J. AND GLASBERG, B. R. The role of frequency selectivity in the perception of loudness, pitch and time. In: Frequency Selectivity in Hearing, edited by B. C. J. Moore. London: Academic, 1986, p. 251-308.
72. VAN NOORDEN, L. Two channel pitch perception. In: Music, Mind and Brain, edited by M. Clynes. New York: Plenum, 1982, p. 251-269.
73. NORDMARK, J. O. Time and frequency analysis. In: Foundations of Modern Auditory Theory, edited by J. V. Tobias. New York: Academic, 1970, p. 57-83.
74. NORDMARK, J. O. Frequency and periodicity analysis. In: Handbook of Perception, edited by E. C. Carterette and M. P. Friedman. New York: Academic, 1978, p. 243-282.
75. PALMER, A. R. Segregation of the responses to paired vowels in the auditory nerve of the guinea pig using autocorrelation. In: The Auditory Processing of Speech, edited by M. E. H. Schouten. Berlin: Mouton de Gruyter, 1992, p. 115-124.
76. PALMER, A. R., WINTER, I. M., AND DARWIN, C. J. The representation of steady-state vowel sounds in the temporal discharge patterns of the guinea pig cochlear nerve and primarylike cochlear nucleus neurons. J. Acoust. Soc. Am. 79: 100-113, 1986.
77. PATTERSON, R. D. A pulse-ribbon model of peripheral auditory processing. In: Auditory Processing of Complex Sounds, edited by W. A. Yost and C. S. Watson. New Jersey: Erlbaum, 1987, p. 167-179.
78. PATTERSON, R. D. AND AKEROYD, M. A. Time-interval patterns and sound quality. In: Advances in Hearing Research, edited by G. A. Manley, G. M. Klump, C. Köppel, H. Fastl, and H. Oeckinghaus. Singapore: World Scientific, 1995, p. 545-556.
79. PATTERSON, R. D., ALLERHAND, M. H., AND GIGUERE, C. Time-domain modeling of peripheral auditory processing: a modular architecture and a software platform. J. Acoust. Soc. Am. 98: 1890-1894, 1995.
80. PATTERSON, R. D., JOHNSON-DAVIES, D., AND MILROY, R. Amplitude-modulated noise: the detection of modulation versus the detection of modulation rate. J. Acoust. Soc. Am. 63: 1904-1911, 1978.
81. PERKELL, D. H. AND BULLOCK, T. H. Neural Coding. Neurosciences Research Program Bulletin, Vol. 6, No. 3. Neurosciences Research Program, 1968.
82. PIERCE, J. R., LIPES, R., AND CHEETHAM, C. Uncertainty concerning the direct use of time information in hearing: place clues in white-spectra stimuli. J. Acoust. Soc. Am. 61: 1609-1621, 1977.
83. PLOMP, R. The ear as a frequency analyzer. J. Acoust. Soc. Am. 36: 1628-1636, 1964.
84. PLOMP, R. Pitch of complex tones. J. Acoust. Soc. Am. 41: 1526-1533, 1967.
85. PLOMP, R. Aspects of Tone Sensation. London: Academic, 1976.
86. PLOMP, R. AND MIMPEN, A. M. The ear as a frequency analyzer. II. J. Acoust. Soc. Am. 43: 764-767, 1968.
87. RITSMA, R. J. Existence region of the tonal residue. I. J. Acoust. Soc. Am. 34: 1224-1229, 1962a.
88. RITSMA, R. J. Existence region of the tonal residue. II. J. Acoust. Soc. Am. 35: 1241-1245, 1962b.
89. RODIECK, R., KIANG, N. Y. S., AND GERSTEIN, G. L. Some quantitative methods for the study of spontaneous activity of single neurons. Biophys. J. 2: 351-368, 1962.
90. RODIECK, R. W. Maintained activity of cat retinal ganglion cells. J. Neurophysiol. 30: 1043-1071, 1967.
91. ROSE, J. E. Neural correlates of some psychoacoustical experiences. In: Neural Mechanisms of Behavior, edited by D. McFadden. New York: Springer-Verlag, 1980, p. 1-33.
92. ROSE, J. E., BRUGGE, J. R., ANDERSON, D. J., AND HIND, J. E. Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey. J. Neurophysiol. 30: 769-793, 1967.
93. ROSE, J. E., BRUGGE, J. F., ANDERSON, D. J., AND HIND, J. E. Some possible neural correlates of combination tones. J. Neurophysiol. 32: 769-793, 1969.
94. SECKER-WALKER, H. E. AND SEARLE, C. L. Time-domain analysis of auditory-nerve-fiber firing rates. J. Acoust. Soc. Am. 88: 1427-1436, 1990.
95. SENEFF, S. Pitch and Spectral Analysis of Speech Based on an Auditory Synchrony Model (PhD thesis). Cambridge, MA: MIT, 1985.
96. SHOFNER, W. P. AND YOST, W. A. Repetition pitch: auditory processing of rippled noise in the chinchilla. In: Advances in Hearing Research, edited by G. A. Manley, G. M. Klump, C. Köppel, H. Fasti, and H. Oeckinghaus. Singapore: World Scientific, 1995, p. 477-487.
97. SIEBERT, W. M. Frequency discrimination in the auditory system: place or periodicity mechanisms? Proc. IEEE 58: 723-730, 1970.
98. SINEX, D. G. AND GEISLER, D. Auditory nerve fiber responses to frequency-modulated tones. Hear. Res. 4: 127-148, 1981.
99. SLANEY, M. AND LYON, R. F. Apple Hearing Demo Reel. Videotape and report. Cupertino, CA: Apple Computer, 1991.
100. SLANEY, M. AND LYON, R. F. On the importance of time - a temporal representation of sound. In: Visual Representations of Speech Signals, edited by M. Cooke, S. Beet, and M. Crawford. New York: Wiley, 1993, p. 95-118.
101. SMALL, A. M. Periodicity pitch. In: Foundations of Modern Auditory Theory, edited by J. V. Tobias. New York: Academic, 1970, p. 3-54.
102. SRULOVICZ, P. AND GOLDSTEIN, J. L. A central spectrum model: a synthesis of auditory-nerve timing and place cues in monaural communication of frequency spectrum. J. Acoust. Soc. Am. 73: 1266-1276, 1983.
103. TERHARDT, E. Pitch, consonance, and harmony. J. Acoust. Soc. Am. 55: 1061-1069, 1973.
104. TERHARDT, E. Calculating virtual pitch. Hear. Res. 1: 155-182, 1979.
105. TERHARDT, E., STOLL, G., AND SEEWANN, M. Pitch of complex signals according to virtual-pitch theory: test, examples, and predictions. J. Acoust. Soc. Am. 71: 671-678, 1982a.
106. TERHARDT, E., STOLL, G., AND SEEWANN, M. Algorithm for extraction of pitch and pitch salience from complex tonal signals. J. Acoust. Soc. Am. 71: 679-688, 1982b.
107. TOMLINSON, R. W. W. AND SCHWARTZ, D. W. F. Perception of the missing fundamental in nonhuman primates. J. Acoust. Soc. Am. 84: 560-565, 1988.
108. VOIGT, H. F., SACHS, M. B., AND YOUNG, E. D. Representation of whispered vowels in discharge patterns of auditory-nerve fibers. Hear. Res. 8: 49-58, 1982.
109. WARREN, R. M. Auditory Perception: A New Synthesis. New York: Pergamon, 1982.
110. WEVER, E. G. Theory of Hearing. New York: Wiley, 1949.
111. WIGHTMAN, F. L. Pitch and stimulus fine structure. J. Acoust. Soc. Am. 54: 397-406, 1973a.
112. WIGHTMAN, F. L. The pattern-transformation model of pitch. J. Acoust. Soc. Am. 54: 407-416, 1973b.
113. YOST, W. A. AND HILL, R. Strength of the pitches associated with ripple noise. J. Acoust. Soc. Am. 64: 485-492, 1978.
114. YOST, W. A. AND HILL, R. Models of the pitch and pitch strength of rippled noise. J. Acoust. Soc. Am. 66: 400-410, 1979.
115. YOST, W. A., PATTERSON, R., AND SHEFT, S. A time domain description for the pitch strength of rippled noise. J. Acoust. Soc. Am. 99: 1066-1078, 1996.
116. YOUNG, E. D. AND SACHS, M. B. Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory nerve fibers. J. Acoust. Soc. Am. 66: 1381-1403, 1979.
117. ZWICKER, E. AND FASTL, H. Psychoacoustics: Facts and Models. Berlin: Springer-Verlag, 1990.