Music in Our Ears: The Biological Bases of Musical Timbre Perception

PLoS Computational Biology

Volumn 8, Issue 11, 2012, Pages

  Patil, Kailash ^a   Pressnitzer, Daniel ^b   Shamma, Shihab ^c   Elhilali, Mounya ^a  

^a Johns Hopkins University   (United States)

^b UNIVERSITÉ PARIS DESCARTES   (France)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; MAMMALS; MUSICAL INSTRUMENTS;

AUDITORY CORTEX; BIOLOGICAL BASIS; COMPUTATIONAL FRAMEWORK; ECOLOGICAL ANALYSIS; HUMAN LISTENERS; MACHINE LEARNING APPROACHES; MUSICAL TIMBRES; PHYSICAL CHARACTERISTICS; PSYCHOPHYSICAL; SOUND SOURCE;

MUSIC;

ACCURACY; ANIMAL EXPERIMENT; ARTICLE; AUDITORY CORTEX; AUDITORY DISCRIMINATION; BRAIN FUNCTION; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; DECISION MAKING; DISTANCE PERCEPTION; EVOKED AUDITORY RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MATHEMATICAL MODEL; MUSIC; NONHUMAN; RECEPTIVE FIELD; SOUND ANALYSIS; SOUND DETECTION; SOUND RELATED PHENOMENA; SPATIAL DISCRIMINATION; TIMBRE;

EID: 84870717065     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002759     Document Type: Article

References (64)

1. Handel S (1993) Listening: An introduction to the perception of auditory events. Cambridge, MA: MIT Press.
2. Ansi PT (1973) Psychoacoustical Terminology. New York: American National Standards Institute.
3. Helmholtz H (1877) On the Sensations of Tone. New York: Dover Publications.
4. Grey JM, Gordon JW, (1978) Perceptual effects of spectral modifications on musical timbres. J Acoust Soc Am 63: 1493-1500.
5. McAdams S, Beauchamp JW, Meneguzzi S, (1999) Discrimination of musical instrument sounds resynthesized with simplified spectrotemporal parameters. J Acoust Soc Am 105: 882-897.
6. Patterson RD, (1994) The sound of a sinusoid: Time-interval models. J Acoust Soc Am 96: 1419-1428.
7. krumhansl C (1989) Why is musical timbre so hard to understand? In: Olsson SNaO, editor. structure and perception of electroacoustic sound and music. Amsterdam: Excerpta medica. pp. 43-53.
8. McAdams S, Winsberg S, Donnadieu S, De Soete G, Krimphoff J, (1995) Perceptual scaling of synthesized musical timbres: common dimensions, specificities, and latent subject classes. Psychol Res 58: 177-192.
9. Grey JM, (1977) Multidimensional perceptual scaling of musical timbres. J Acoust Soc Am 61: 1270-1277.
10. J A Burgoyne SM (2007) A Meta-analysis of Timbre Perception Using Nonlinear Extensions to CLASCAL. In: Proceedings of the Computer Music Modeling and Retrieval. Copenhagen, Denmark. pp. 181-202.
11. Donnadieu S (2007) Mental Representation of the Timbre of Complex Sounds. In: Beauchamp J, editor. Analysis, Synthesis, and Perception of Musical Sounds. New York: Springer. pp. 272-319.
12. Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S, (2011) The Timbre Toolbox: extracting audio descriptors from musical signals. J Acoust Soc Am 130: 2902-2916.
13. Caclin A, McAdams S, Smith BK, Winsberg S, (2005) Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones. J Acoust Soc Am 118: 471-482.
14. Waibel A, Lee K (1990) Readings in speech recognition: Morgan Kaufmann Pub. Inc. 680 p.
15. Eidenberger H (2011) Fundamental Media Understanding. Norderstedt, Germany: atpress.
16. Rabiner L, Juang B (1993) Fundamentals of Speech Recognition. New Jersey, USA: PTR Prentice Hall.
17. McKinney M, Breebaart J (2003) Features for Audio and Music Classification. In: Proceedings of International Symposium on Music Information Retrieval. Washington D.C, USA. pp. 151-158.
18. Lerch A (2012) An Introduction to Audio Content Analysis: Applications in Signal Processing and Music Informatics. New Jersey, USA: Wiley-IEEE Press.
19. Herrera-Boyer P, Peeters G, Dubnov S, (2003) Automatic classification of musical instrument sounds. Journal of New Music Research 32: 3-21.
20. Burred JJ, Haller M, Jin S, Samour A, Sikora T (2008) Audio Content Analysis. In: Kompatsiaris Y, Hobson P, editors. Semantic Multimedia and Ontologies: Theory and Applications. London, UK: Springer. pp. 123-162.
21. Caclin A, Brattico E, Tervaniemi M, Naatanen R, Morlet D, et al. (2006) Separate neural processing of timbre dimensions in auditory sensory memory. J Cogn Neurosci 18: 1959-1972.
22. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B, (2000) Voice-selective areas in human auditory cortex. Nature 403: 309-312.
23. Uppenkamp S, Johnsrude IS, Norris D, Marslen-Wilson W, Patterson RD, (2006) Locating the initial stages of speech-sound processing in human temporal cortex. NeuroImage 31: 1284-1296.
24. Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA, (2005) Distinct cortical pathways for processing tool versus animal sounds. J Neurosci 25: 5148-5158.
25. Leaver AM, Rauschecker JP, (2010) Cortical representation of natural complex sounds: effects of acoustic features and auditory object category. J Neurosci 30: 7604-7612.
26. De Lucia M, Clarke S, Murray MM, (2010) A temporal hierarchy for conspecific vocalization discrimination in humans. J Neurosci 30: 11210-11221.
27. Staeren N, Renvall H, De Martino F, Goebel R, Formisano E, (2009) Sound categories are represented as distributed patterns in the human auditory cortex. Curr Biol 19: 498-502.
28. Formisano E, De Martino F, Bonte M, Goebel R, (2008) "Who" is saying "what"? Brain-based decoding of human voice and speech. Science 322: 970-973.
29. Miller LM, Escabi MA, Read HL, Schreiner CE, (2002) Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. J Neurophysiol 87: 516-527.
30. Atencio CA, Schreiner CE, (2010) Laminar diversity of dynamic sound processing in cat primary auditory cortex. J Neurophysiol 103: 192-205.
31. Schreiner CE, Sutter ML, (1992) Topography of excitatory bandwidth in cat primary auditory cortex: single-neuron versus multiple-neuron recordings. J Neurophysiol 68: 1487-1502.
32. Versnel H, Shamma S, Kowalski N (1995) Ripple Analysis in the Ferret Primary Auditory Cortex. III. Topographic and Columnar Distribution of Ripple Response. Auditory Neuroscience: 271-285.
33. Schreiner CE, Mendelson J, Raggio MW, Brosch M, Krueger K, (1997) Temporal processing in cat primary auditory cortex. Acta Otolaryngol Suppl 532: 54-60.
34. Theunissen FE, Sen K, Doupe AJ, (2000) Spectral-temporal receptive fields of nonlinear auditory neurons obtained using natural sounds. J Neurosci 20: 2315-2331.
35. Elhilali M, Fritz JB, Klein DJ, Simon JZ, Shamma SA, (2004) Dynamics of precise spike timing in primary auditory cortex. J Neurosci 24: 1159-1172.
36. Christianson GB, Sahani M, Linden JF, (2008) The consequences of response nonlinearities for interpretation of spectrotemporal receptive fields. J Neurosci 28: 446-455.
37. David SV, Mesgarani N, Fritz JB, Shamma SA, (2009) Rapid synaptic depression explains nonlinear modulation of spectro-temporal tuning in primary auditory cortex by natural stimuli. J Neurosci 29: 3374-3386.
38. Sadagopan S, Wang X, (2009) Nonlinear spectrotemporal interactions underlying selectivity for complex sounds in auditory cortex. J Neurosci 29: 11192-11202.
39. Cristianini N, Shawe-Taylor J (2000) Introduction to support vector machines and other kernel-based learning methods. Cambridge, UK: Cambridge University Press.
40. Elhilali M, Fritz JB, Chi TS, Shamma SA, (2007) Auditory cortical receptive fields: stable entities with plastic abilities. Journal of Neuroscience 27: 10372-10382.
41. Livshin A, X.Rodet (2004) Musical instrument identification in continuous recordings. In: Proceedings of 7th International Conference on Digital Audio Effects. Naples, Italy. pp. 222-227.
42. Burred JJ, Robel A, Sikora T, (2010) Dynamic Spectral Envelope Modeling for Timbre Analysis of Musical Instrument Sounds. Ieee Transactions on Audio Speech and Language Processing 18: 663-674.
43. Cover T, Thomas J (2006) Elements of information theory. New York: Wiley-Interscience.
44. Krishna AG, Sreenivas TV (2004) Music instrument recognition: from isolated notes to solo phrases. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing. Montreal,Quebec,Canada. pp. iv265-iv268.
45. Marques J, Moreno PJ (1999) A study of musical instrument classification using Gaussian Mixture Models and Support Vector Machines. Compaq Corporation, Cambridge Research laboratory.
46. Brown JC, Houix O, McAdams S, (2001) Feature dependence in the automatic identification of musical woodwind instruments. J Acoust Soc Am 109: 1064-1072.
47. Kitahara T, Goto M, Okuno HG (2003) Musical instrument identification based on f0-dependent multivariate normal distribution. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. Hong Kong. pp. 409-412.
48. Eronen A, Klapuri A (2000) Musical instrument recognition using cepstral coefficients and temporal features. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing. Istanbul, Turkey. pp. II753-II756.
49. Agostini G, Longari M, Pollastri E (2001) Musical instrument timbres classification with spectral features. In: Proceedings of IEEE Fourth Workshop on Multimedia Signal Processing. Cannes, France. pp. 97-102.
50. Livshin A, Rodet X (2006) The Significance of the Non-Harmonic "Noise" Versus the Harmonic Series for Musical Instrument Recognition. In: Proceedings of the 7th International Conference on Music Information Retrieval. Victoria, Canada pp. 95-100.
51. Kostek B, (2004) Musical instrument classification and duet analysis employing music information retrieval techniques. Proceedings of the IEEE 92: 712-729.
52. Marozeau J, de Cheveigne A, McAdams S, Winsberg S, (2003) The dependency of timbre on fundamental frequency. J Acoust Soc Am 114: 2946-2957.
53. Cox TF, Cox MAA (2001) Multidimensional Scaling. London, UK: Chapman and Hall.
54. Yang X, Wang K, Shamma SA, (1992) Auditory representations of acoustic signals. IEEE Trans Inf Theory 38: 824-839.
55. Joly O, Ramus F, Pressnitzer D, Vanduffel W, Orban GA, (2012) Interhemispheric Differences in Auditory Processing Revealed by fMRI in Awake Rhesus Monkeys. Cereb Cortex 22: 838-853.
56. Agus TR, Suied C, Thorpe SJ, Pressnitzer D, (2012) Fast recognition of musical sounds based on timbre. J Acoust Soc Am 131: 4124-4133.
57. Goto M, Hashiguchi H, Nishimura T, Oka R (2003) RWC music database: Music genre database and musical instrument sound database. In: Proceedings of International Symposium on Music Information Retrieval. Washington D.C, USA. pp. 229-230.
58. Chi T, Ru P, Shamma SA, (2005) Multiresolution spectrotemporal analysis of complex sounds. J Acoust Soc Am 118: 887-906.
59. De Lathauwer L, De Moor B, Vandewalle J, (2000) A multilinear singular value decomposition. SIAM Journal on Matrix Analysis and Applications 21: 1253-1278.
60. Fritz J, Shamma S, Elhilali M, Klein D, (2003) Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat Neurosci 6: 1216-1223.
61. Fritz JB, Elhilali M, Shamma SA, (2005) Differential dynamic plasticity of A1 receptive fields during multiple spectral tasks. J Neurosci 25: 7623-7635.
62. Fritz JB, Elhilali M, Shamma SA, (2007) Adaptive changes in cortical receptive fields induced by attention to complex sounds. Journal of Neurophysiology 98: 2337-2346.
63. Klein DJ, Depireux DA, Simon JZ, Shamma SA, (2000) Robust spectrotemporal reverse correlation for the auditory system: optimizing stimulus design. J Comput Neurosci 9: 85-111.
64. Donoho D (2000) High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality. Aide-Memoire of a Lecture at AMS Conference on Math Challenges of the 21st Century. Los Angeles, California, USA.