Temporal coding of periodicity pitch in the auditory system: An overview

Neural Plasticity

Volumn 6, Issue 4, 1999, Pages 147-172

  Cariani, Peter ^a,b  

^a HARVARD MEDICAL SCHOOL   (United States)

^b NONE   (United States)

Author keywords

Autocorrelation; Interspike intervals; Neural codes; Phase locking; Sensory coding; Speech perception; Temporal correlation; Voice pitch; Vowels

Indexed keywords

ACOUSTIC NERVE FIBER; ARTICLE; COCHLEAR NUCLEUS; HEARING; HUMAN; INFORMATION PROCESSING; NERVE CONDUCTION; NORMAL HUMAN; PERIODICITY; WAVEFORM;

EID: 0032702589     PISSN: 20905904     EISSN: None     Source Type: Journal    
DOI: 10.1155/NP.1999.147     Document Type: Article

References (106)

1. Abeles M, Bergman H, Margalit E, Vaadia E. Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. J. Neurophysiol. 1993; 70: 1629-1638.
2. Barlow HB. The neuron doctrine in perception. In: Gazzaniga, MS, ed, The Cognitive Neurosciences. Cambridge: MIT Press 1995; 415-435.
3. Bialek W, Rieke F, van Stevenink RR, de Ruyter WD. Reading a neural code. Science 1991; 252: 1854-1856.
4. Boring EG. Sensation and Perception in the History of Experimental Psychology. New York: Appleton-Century-Crofts, 1942.
5. Bower TGR. The evolution of sensory systems. In: MacLeod RB, Pick Jr. H, eds, Perception: Essays in Honor of James J. Gibson. Ithaca, NY: Cornell University Press 1974; 141-152.
6. Brugge JF, Reale RA, Hind JE. The structure of spatial receptive fields of neurons in primary auditory cortex of the cat. J Neurosci 1996; 16: 4420-4437.
7. Cariani P. As if time really mattered: temporal strategies for neural coding of sensory information. Communication and Cognition - Artificial Intelligence (CC-AI) 1995; 12: 161-229. Reprinted in: Pribram K, ed, Origins: Brain and Self-Organization. Hillsdale, NJ: Lawrence Erlbaum 1994; 208-252.
8. Cariani P. As if time really mattered: temporal strategies for neural coding of sensory information. Communication and Cognition - Artificial Intelligence (CC-AI) 1995; 12: 161-229. Reprinted in: Pribram K, ed, Origins: Brain and Self-Organization. Hillsdale, NJ: Lawrence Erlbaum 1994; 208-252.
9. Cariani P. Emergence of new signal-primitives in neural networks. Intellectica 1997; 1997: 95-143.
10. Cariani P. Temporal coding of sensory information. In: Bower, JM, ed, Computational Neuroscience: Trends in Research. 1997. New York: Plenum 1997; 591-598.
11. Cariani P. Neural timing nets for auditory computation. In: Greenberg S, Slaney M, eds, Computational Models of Auditory Function. Amsterdam: IOS Press in press; 16 pp.
12. Cariani P. Delgutte B. Tramo M. Neural representation of pitch through autocorrelation. Proceedings. Audio Engineering Society Meeting (AES). New York. September. 1997. Preprint #4583 (L-3); 1997.
13. Cariani PA, Delgutte B. Neural correlates of the pitch of complex tones. I. Pitch and pitch salience. J Neurophysiol. 1996a; 76: 1698-1716.
14. Cariani PA, Delgutte B. Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase-invariance, pitch circularity, and the dominance region for pitch. J Neurophysiol. 1996b; 76: 1717-1734.
15. Carlyon RP. Shackleton TM. Comparing the fundamental frequencies of resolved and unresolved harmonics: evidence for two pitch mechanisms?. J Acoust. Soc. Am. 1994; 95: 3541-3554.
16. Carr CE. Processing of temporal information in the brain. Ann Rev Neurosci 1993; 16: 223-243.
17. Cherry C. Two ears - but one world. In: Rosenblith WA, ed, Sensory Communication. New York: MIT Press/ John Wiley 1961; 99-117.
18. Chung SH. Raymond SA. Lettvin JY. Multiple meaning in single visual units. Brain Behav Evol 1970; 3: 72-101.
19. Covey E. Temporal Neural Coding in Gustation. Duke University. 1980.
20. de Boer E. On the "residue" and auditory pitch perception. In: Keidel WD, Neff WD, eds, Hand-book of Sensory Physiology. Berlin: Springer Verlag 1976; 479-583.
21. de Cheveigné A. A pitch perception model. ICASSP 86 (Tokyo) 1986; 897-900.
22. de Ribaupierre F. Acoustical information processing in the auditory thalamus and cerebral cortex. In: Ehret G, Romand R, eds, The Central Auditory System. New York: Oxford University Press 1997; 317-397.
23. Deadyler SA, Hampson RE. Ensemble activity and behavior what's the code?. Science 1995; 270: 1316-1318.
24. Delgutte B. Physiological models for basic auditory percepts. In: Hawkins H, McMullin T, Popper AN, Fay RR, eds, Auditory Computation. New York: Springer Verlag, 1995, 157-220.
25. Di Lorenzo PM, Hecht GS. Perceptual consequences of electrical stimulation in the gustatory system. Behavioral Neuroscience 1993; 107: 130-138.
26. Emmers R. Pain: A Spike-Interval Coded Message in the Brain. New York: Raven Press 1981.
27. Evans EF. Place and time coding of frequency in the peripheral auditory system: some physiological pros and cons. Audiology 1978; 17: 369-420.
28. Gerstner W. Spiking neurons. In: Maass W, Bishop CM, eds, Pulsed Neural Networks. Cambridge, Massachusetts, USA: MIT Press 1999; xiii-xxvi.
29. Gesteland RC, Lettvin JY, Pitts WH. Chemical transmission in the nose of the frog. J Physiol. 1965; 181: 525-559.
30. Goldstein MH Jr, Kiang NYS, Brown RM. Responses of the auditory cortex to repetitive acoustic stimuli. J Acoust Soc Am 1959; 31: 356-364.
31. Greenberg S, Rhode WS. Periodicity coding in cochlear nerve and ventral cochlear nucleus. In: Yost WA, Watson CS, eds, Auditory Processing of Complex Sounds. Hillsdale, NJ: Lawrence Erlbaum Associates 1987; 225-236.
32. Hatsopoulos NG, Ojakangas CL, Donohue JP, Maynard EM. Detection and identification of ensemble codes in motor cortex. In: Eichenbaum HB, Davis JL, eds, Neuronal Ensembles: Strategies for Recording and Decoding. New York: Wiley-Liss 1998; 161-176.
33. Heil P. First-spike timing of auditory-nerve fibers and comparison with auditory cortex. J Neurophysiol. 1997; 78: 2438-2454.
34. Hirahara T, Cariani P, Delgutte B. Representation of low-frequency vowel formants in the auditory nerve. Proceedings. European Speech Communication Association (ESCA) Research Workshop on The Auditory Basis of Speech Perception. Keele University, UK, July 15-19, 1996; 1-4.
35. Jeffress LA. A place theory of sound localization. J Comp Physiol Psychol 1948; 41: 35-39.
36. John ER. Switchboard vs. statistical theories of learning and memory. Science 1972; 177: 850-864.
37. John ER. Representation of information in the brain. In: John ER, ed, Machinery of the Mind. Boston, MA: Birkhauser 1990; 27-56.
38. John ER, Schwartz EL. The neurophysiology of information processing and cognition. Ann Rev Psychol 1978; 29: 1-29.
39. Kauer JS. Response patterns of amphibian olfactory bulb neurones to odour stimulation. J Physiol 1974; 243: 695-715.
40. Kiang NYS. Stimulus representation in the discharge patterns of auditory neurons. In: Tower DB, ed, The Nervous System. New York: Raven Press 1975; 81-96.
41. Kiang NYS. Moxon EC. Tails of tuning curves of auditory-nerve fibers. J Acoust Soc Am 1974; 55: 620-630.
42. Kiang NYS, Watanabe T, Thomas EC. Clark LF. Discharge Patterns of Single Fibers in the Cat's Auditory Nerve. Cambridge, Massachusetts, USA: MIT Press 1965.
43. Kim DO, Leonard G. Pitch-period following response of cat cochlear nucleus neurons to speech sounds. In: Duifhuis H, Horst JW, Wit HP, eds, Basic Issues in Hearing. London: Academic Press 1988; 252-260.
44. Kim DO, Molnar CE. A population study of cochlear nerve fibers: comparison of spatial distributions of average-rate and phase-locking measures of responses to single tones. J Neurophysiol. 1979; 42: 16-30.
45. Kim DO, Sirianni JG, Chang SO. Responses of DCN-PVCN neurons and auditory nerve fibers in unanesthetized decerebrate cats to AM and pure tones: Analysis with autocorrelation/power-spectrum. Hearing Res 1990; 45: 95-113.
46. Kozak WM, Reitboeck HJ. Color-dependent distribution of spikes in single optic tract fibers of the cat. Vision Res 1974; 14: 405-419.
47. Langner G. Periodicity coding in the auditory system. Hearing Res 1992; 60: 115-142.
48. Laurent G, Naraghi M. Odorant-induced oscillations in mushroom bodies of the locust J Neurosci. 1994; 14: 2993-3004.
49. Lee D, Port NL, Kruse W, Georgoupoulos AP. Neuronal population coding: multi-electrode recordings in primate cerebral cortex. In: Eichenbaum HB, Davis JL, eds, Neuronal Ensembles: Strategies for Re-cording and Decoding. New York: Wiley-Liss 1998; 117-138.
50. Lee S-H, Blake R. Visual form created solely from temporal structure. Science 1999; 284: 1165-1168.
51. Lestienne R, Strehler BL. Time structure and stimulus dependence of precise replicating patterns present in monkey cortical neuronal spike trains. Brain Res 1987; 43: 214-238.
52. Lestienne R, Tuckwell HC. The significance of precisely replicating patterns in mammalian CNS spike trains. Neuroscience 1998; 82: 315-336.
53. Licklider JCR. A duplex theory of pitch perception. Experientia 1951; VII: 128-134.
54. Licklider JCR. Three auditory theories. In: Koch S, ed, Psychology: A Study of a Science. Study I. Conceptual and Systematic. New York: McGraw-Hill 1959; 41-144.
55. Lyon R, Shamma S. Auditory representations of timbre and pitch. In: Hawkins H, McMullin T, Popper AN, Fay RR, eds, Auditory Computation. New York: Springer Verlag 1995; 221-270.
56. MacKay DM. Self-organization in the time domain. In: Yovitts, MC, Jacobi GT, Goldstein GD., eds, Self-Organizing Systems 1962. Washington. DC: Spartan Books 1962; 37-48.
57. Macrides F. Dynamic aspects of central olfactory processing. In: Schwartze DM, Mozell MM, eds, Chemical Signals in Vertebrates. New York: Plenum 1977; 207-229.
58. Macrides F, Chorover SL. Olfactory bulb units: activity correlated with inhalation cycles and odor quality. Science 1972; 175: 84-86.
59. Marion-Poll F, Tobin TR. Temporal coding of pheromone pulses and trains in Manduca sexta. J Comp Physiol A 1992; 171: 505-512.
60. Meddis R. Hewitt MJ Virtual pitch and phase sensitivity of a computer model of the auditory periphery. I. Pitch identification. J Acoust Soc Am 1991; 89: 2866-2882.
61. Meddis R, O'Mard L. A unitary model of pitch perception. J Acoust. Soc. Am. 1997; 102: 1811-1820.
62. Moore BCJ. Introduction to the Psychology of Hearing, 4th Ed. London: Academic Press 1997; 118-121.
63. Morley JW, Archer JS, Ferrington DG, Rowe MJ, Turman AB. Neural coding of complex tactile vibration. Information Processing in Mammalian Auditory and Tactile Systems. New York: Alan R. Liss 1990; 127-140.
64. Morrell F. Electrical signs of sensory coding. In: Quarton GC, Melnechuck T, Schmitt FO, eds, The Neurosciences: A Study Program. New York: Rockefeller University Press 1967; 452-469.
65. Mountcastle V. The problem of sensing and the neural coding of sensory events. In: Quarton GC, Melnechuk T, Schmitt FO, eds, The Neurosciences: A Study Program. New York: Rockefeller University Press 1967; 393-497.
66. Mountcastle V. Temporal order determinants in a somatosthetic frequency discrimination: sequential order coding. Annals New York Acad Sci 1993; 682: 151-170.
67. Onoda N, Mori K. Depth distribution of temporal firing patterns in olfactory bulb related to air intake cycles. J Neurophysiol 1980; 44: 29-39.
68. Palmer AR. Segregation of the responses to paired vowels in the auditory nerve of the guinea pig using autocorrelation. In: Scheuten MEH, ed, The Auditory Processing of Speech. Berlin: Mouton de Gruyter 1992; 115-124.
69. Perkell DH, Bullock TH. Neural Coding. Neurosciences Research Program Bulletin 1968; 6: 221-348.
70. Pfeiffer RR. Classification of response patterns of spike discharges from units in the cochlear nucleus: tone-burst stimulation. Exp Brain Res 1966; 1: 220-235.
71. Phillips DP. Timing of spike discharges in cat auditory cortex neurons: implications for encoding of stimulus periodicity. Hearing Res 1989; 40: 137-146.
72. Pollen DA, Gaska JP, Jacobson LD. Physiological constraints on models of visual cortical function. In: Cotterill RMJ, ed, Models of Brain Function. Cambridge, UK: Cambridge University Press 1989; 115-136.
73. Raymond SA. Effects of nerve impulses on threshold of frog sciatic nerve fibres. J Physiol (Lond) 1979; 290: 273-303.
74. Reichardt W. Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. In: Rosenblith WA, ed, Sensory Communication. New York: MIT Press/John Wiley 1961; 303-317.
75. Reitboeck HJ Pabst M. Eckhorn R. Texture description in the time domain. In: Cotterill RMJ, ed, Computer Simulation in Brain Science. Cambridge, UK, Cambridge University Press 1988.
76. Rhode WS. Interspike intervals as correlates of periodicity pitch in cat cochlear nucleus. J Acoust Soc Am 1995; 97: 2414-2429.
77. Rhode WS. Neural encoding of single-formant stimuli in ventral cochlear nucleus of the chinchilla. Hearing Res 1998; 117: 39-56.
78. Rhode WS, Smith PH, Oertel D. Physiological response properties of cells labeled intracellularly with horseradish peroxidase in cat ventral cochlear nucleus. J Comp Neurol 1983; 213: 448-463.
79. Richmond BJ, Gawne TJ. The relationship between neuronal codes and cortical organization. In: Eichenbaum HB, Davis JL, eds, Neuronal Ensembles: Strategies for Recording and Decoding. New York: Wiley-Liss 1998; 57-80.
80. Richmond BJ, Optican LM, Podell M, Spitzer H. Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics.. J Neurophysiol 1987; 57: 132-146.
81. Rieke F, Warland D, de Ruyter van Steveninck R, Bialek W. Spikes: Exploring the Neural Code. Cambridge. MA, USA: MIT Press 1997; 395.
82. Rose JE. Neural correlates of some psychoacoustical experiences. In: McFadden D, ed, Neural Mechanisms of Behavior. New York: Springer Verlag 1980; 1-33.
83. Rose JE, Brugge JR, Anderson DJ, Hind JE. Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey. J Neurophysiol 1967; 30: 769-793.
84. Ryugo DK. The auditory nerve: peripheral innervation. cell body morphology, and central projections. In: Webster DB, Popper AN, Fay RR, eds, The Mammalian Auditory Pathway: Neuroanatomy. New York: Springer-Verlag 1992; 23-65.
85. Shackleton TM, Carlyon RP. The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. J Acoust Soc Am 1994; 95: 3529-3540.
86. Shadlen MN, Newsome WT. Noise, neural codes and cortical organization. Curr Op Neurobiol 1994; 4: 569-579.
87. Shadlen MN, Newsome WT. The variable discharge of cortical neurons: implications for connectivity. Computation, and information coding. J Neurosci 1998; 18: 3870-3896.
88. Siebert WM. Stimulus transformations in the peripheral auditory system. In: Kollers PA, Eden M, eds, Recognizing Patterns. Cambridge, Massachusetts, USA: MIT Press 1968; 104-133.
89. Siebert WM. Frequency discrimination in the auditory system: place or periodicity mechanisms? Proc IEEE 1970; 58: 723-730.
90. Singer W. Search for coherence: a basic principle of cortical self-organization. Concepts Neurosci 1990; 1: 1-26.
91. Singer W. Development and plasticity of cortical processing architectures. Science 1995; 270: 758-764.
92. Singer W. Putative functions of temporal correlations in neocortical processing. In: Koch C, Davis CL, eds, Large-Scale Neuronal Theories of the Brain. Cambridge, MA, USA: MIT Press 1995; 201-237.
93. Slaney M, Lyon RF. On the importance of time - a temporal representation of sound. In: Cooke M, Beet S, Crawford M, eds, Visual Representations of Speech Signals. New York: Wiley 1993; 95-118.
94. Srulovicz P, Goldstein JL. Central spectral patterns in aural signal analysis based on cochlear neural timing and frequency filtering. IEEE, Tel Aviv. Israel, 1977.
95. Steinschneider M. Reser DH. Fishman YI. Arezzo J. Click train encoding in primary auditory cortex of the awake monkey: Evidence for two mechanisms subserving pitch perception. J Acoust Soc Am 1998; 104: 2395-2955.
96. Stevens SS. Sensory power functions and neural events. In: Loewenstein WR, ed, Principles of Receptor Physiology. Berlin: Springer-Verlag 1971; 226-242.
97. Tank DW, Hopfield JJ Neural computation by concentrating information in time. Proc Natl Acad Sci USA 1987; 84: 1896-1900.
98. Thatcher RW. John ER. Functional Neuroscience. Vol. I. Foundations of Cognitive Processes. Hillsdale, New Jersey, USA: Lawrence Erlbaum 1977; 382.
99. Troland LT. The psychophysiology of auditory qualities and attributes. 1929; 2: 28-58.
100. Uttal WR. The Psychobiology of Sensory Coding. New York: Harper Row 1973.
101. Uttal WR. An Autocorrelation Theory of Form Detection. New York: Wiley 1975.
102. van Noorden L. Two channel pitch perception. In: Clynes M, ed, Music. Mind and Brain. New York: Plenum 1982; 251-269.
103. Wasserman GS. Isomorphism. task dependence. and the multiple meaning theory of neural coding. Biol Signals 1992; 1: 117-142.
104. Wever EG. Theory of Hearing. New York: Wiley 1949.
105. Young ED. Response characteristics of neurons in the cochlear nuclei. In: Berlin C, ed, Hearing Science. San Diego, CA, USA: College Hill 1984; 423-460.
106. Young RA. Some observations on temporal coding of color vision: psychophysical results. Vision Res 1977; 17: 957.