The Timbre Toolbox: Extracting audio descriptors from musical signals

Journal of the Acoustical Society of America

Volumn 130, Issue 5, 2011, Pages 2902-2916

  Peeters, Geoffroy ^a   Giordano, Bruno L ^b   Susini, Patrick ^a   Misdariis, Nicolas ^a   McAdams, Stephen ^b  

^a CNRS   (France)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY MODELS; COMPLEX SOUNDS; CORRELATIONAL ANALYSIS; DESCRIPTIVE STATISTICS; DESCRIPTORS; ENERGETIC PROPERTIES; ENERGY ENVELOPE; HIER-ARCHICAL CLUSTERING; INFORMATION REDUNDANCIES; MACHINE-LEARNING; MUSIC INFORMATION RETRIEVAL; MUSICAL SIGNALS; SHORT-TERM FOURIER TRANSFORM; SINGLE-VALUE; SINUSOIDAL COMPONENTS; TIME VARYING;

AUDIO ACOUSTICS; INFORMATION RETRIEVAL; SIGNAL PROCESSING; TIME VARYING SYSTEMS;

ACOUSTIC MEASURING INSTRUMENTS;

ACOUSTICS; ARTICLE; CLUSTER ANALYSIS; COMPUTER LANGUAGE; COMPUTER PROGRAM; FOURIER ANALYSIS; MUSIC; SIGNAL PROCESSING; SOUND DETECTION; THEORETICAL MODEL; TIME;

ACOUSTICS; CLUSTER ANALYSIS; FOURIER ANALYSIS; MODELS, THEORETICAL; MUSIC; PROGRAMMING LANGUAGES; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOFTWARE; SOUND SPECTROGRAPHY; TIME FACTORS;

EID: 81355164049     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3642604     Document Type: Article

References (50)

1. Brown, J. (1998). Musical instrument identification using autocorrelation coefficients, in Proc. Intern. Symposium on Musical Acoustics (Leavenworth, Washington), pp. 291-295.
2. Brown, J., Houix, O., and McAdams, S. (2001). Feature dependence in the automatic identification of musical woodwind instruments, J. Acoust. Soc. Am. 109, 1064-1072. (Pubitemid 32215912)
3. Caclin, A., McAdams, S., Smith, B., and Winsberg, S. (2005). Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones, J. Acoust. Soc. Am. 118, 471-482. 10.1121/1.1929229 (Pubitemid 40981501)
4. Camacho, A., and Harris, J. (2008). A sawtooth waveform inspired pitch estimator for speech and music, J. Acoust. Soc. Am. 124, 1638-1652. 10.1121/1.2951592
5. de Cheveigné, A., and Kawahara, H. (2002). YIN, a fundamental frequency estimator for speech and music, J. Acoust. Soc. Am. 111, 1917-1930. 10.1121/1.1458024 (Pubitemid 34297247)
6. Fujinaga, I. (1998). Machine recognition of timbre using steady-state tone of acoustical musical instruments, in Proc. of Int. Computer Music Conference (University of Michigan, Ann Arbor, MI), pp. 207-210.
7. Fujinaga, I., and MacMillan, K. (2000). Realtime recognition of orchestral instruments, in Proc. of Int. Computer Music Conference (Berlin, Germany), pp. 241-243.
8. Giordano, B. L., Rocchesso, D., and McAdams, S. (2010). Integration of acoustical information in the perception of impacted sound sources: The role of information accuracy and exploitability, J. Exp. Psychol. 36, 462-479.
9. Gordon, J. (1987). The perceptual attack time of musical tones, J. Acoust. Soc. Am. 82, 88-105. 10.1121/1.395441
10. Gordon, A. D. (1999). Classification, 2nd ed. (Chapman Hall/CRC, Boca Raton, FL), pp. 1-256.
11. Grey, J. (1977). Multidimensional perceptual scaling of musical timbres, J. Acoust. Soc. Am. 61, 1270-1277. 10.1121/1.381428 (Pubitemid 8086808)
12. Grey, J., and Gordon, J. (1978). Perceptual effects of spectral modifications on musical timbres, J. Acoust. Soc. Am. 63, 1493-1500. 10.1121/1.381843 (Pubitemid 8346203)
13. Herrera, P., Amatriain, X., Batlle, E., and Serra, X. (2000). Towards instrument segmentation for music content description: A critical review of instrument classification techniques, in International Symposium on Music Information Retrieval (ISMIR 2000), Plymouth, MA (University of Massachusetts, Amherst, MA), pp. 23-25.
14. Hubert, L. J., and Arabie, P. (1985). Comparing partitions, J. Classif. 2, 193-218.
15. ISO/IEC (2002). MPEG-7: Information Technology - Multimedia Content Description Interface-Part 4: Audio (ISO/IEC FDIS 15938-4:2002).
16. Iverson, P., and Krumhansl, C. (1993). Isolating the dynamic attributes of musical timbre, J. Acoust. Soc. Am. 94, 2595-2603. (Pubitemid 23331178)
17. Johnston, J. (1988) Transform coding of audio signals using perceptual noise criteria, IEEE J. Sel. Areas Commun. 6 (2), 314-323. 10.1109/49.608 (Pubitemid 18596873)
18. Kendall, R., Carterette, E., and Hajda, J. (1999). Perceptual and acoustical features of natural and synthetic orchestral instrument tones, Music Percept. 16 (3), 327-364.
19. Krimphoff, J. (1993). Analyse acoustique et perception du timbre [Acoustic analysis and perception of timbre], Master's thesis (Université du Maine, Lemans, France).
20. Krimphoff, J., McAdams, S., and Winsberg, S. (1994). Caracté risation du timbre des sons complexes. II. Analyses acoustiques et quantification psychophysique (Characterization of the timbre of complex sounds. II Acoustical analysis and psychophysical quantification), J. Phys. 4, 625-628.
21. Krumhansl, C. L. (1989). Why is musical timbre so hard to understand?, in Structure and Perception of Electroacoustic Sound and Music, edited by, S. Nielzén Olsson, (Excerpta Medica, Amsterdam, Netherlands), pp. 43-51.
22. Lakatos, S. (2000). A common perceptual space for harmonic and percussive timbres, Percept. Psychophys. 62 (7), 1426-1439. 10.3758/BF03212144
23. Maher, R., and Beauchamp, J. (1994). Fundamental frequency estimation of musical signals using a two-way mismatch procedure, J. Acoust. Soc. Am. 95 (4), 2254-2263. 10.1121/1.408685 (Pubitemid 24113060)
24. Marozeau, J., and de Cheveigné, A. (2007). The effect of fundamental frequency on the brightness dimension of timbre, J. Acoust. Soc. Am. 121 (1), 383-387. 10.1121/1.2384910 (Pubitemid 46102785)
25. Marozeau, J., de Cheveigné, A., McAdams, S., and Winsberg, S. (2003). The dependency of timbre on fundamental frequency, J. Acoust. Soc. Am. 114 (5), 2946-2957. (Pubitemid 37371650)
26. Martin, K., Scheirer, E., and Vercoe, B. (1998). Music content analysis through models of audition, in Proc. ACM Multimedia Workshop on Content Processing of Music for Multimedia Applications, Bristol, UK (ACM, New York).
27. McAdams, S. (1993). Recognition of sound sources and events, in Thinking in Sound: The Cognitive Psychology of Human Audition, edited by, S. McAdams, and, E. Bigand, (Oxford University Press, Oxford, UK), pp. 146-198.
28. McAdams, S., Windsberg, S., Donnadieu, S., DeSoete, G., and Krimphoff, J. (1995). Perceptual scaling of synthesized musical timbres: Common dimensions specificities and latent subject classes, Psychol. Res. 58, 177-192. 10.1007/BF00419633
29. McAulay, R., and Quatieri, T. (1986). Speech analysis/synthesis based on a sinusoidal representation, IEEE Trans. Acoust. Speech Signal Process. 34 (4), 744-754. 10.1109/TASSP.1986.1164910
30. Miller, J., and Carterette, E. (1975). Perceptual space for musical structures, J. Acoust. Soc. Am. 58, 711-720. 10.1121/1.380719
31. Milligan, G. W. (1981). A Monte Carlo study in thirty internal criterion measures for cluster analysis, Psychometrika 46, 187-199. 10.1007/BF02293899
32. Misdariis, N., Smith, B., Presssnitzer, D., Susini, P., and McAdams, S. (1998). Validation of a multidimensional distance model for perceptual dissimilarities among musical timbres, J. Acoust. Soc. Am. 103, 3005-3006. 10.1121/1.421751
33. Moore, B. C. J., and Glasberg, B. R. (1983). Suggested formulae for calculating auditory-filter bandwidths and excitation patterns, J. Acoust. Soc. Am. 74, 750-753. 10.1121/1.389861 (Pubitemid 13019047)
34. Opolko, F., and Wapnick, J. (2006). McGill University Master Samples [DVD set] (McGill University, Montréal, Québec, Canada).
35. Patterson, R., Robinson, K., Holdsworth, J., McKeown, D., Zhang, C., and Allerhand, M. (1992). Complex sounds and auditory images, Aud. Physiol. Percept. 83, 429-446.
36. Peeters, G. (2004). A large set of audio features for sound description (similarity and classification) in the CUIDADO project, CUIDADO IST Project Report (IRCAM, Paris), pp. 1-25.
37. Peeters, G., McAdams, S., and Herrera, P. (2000). Instrument sound description in the context of MPEG-7, in Proc. of Int. Computer Music Conference, Berlin, Germany (ICMA, San Francisco).
38. Plomp, R. (1970). Timbre as a multidimensional attribute of complex tones, in Frequency Analysis and Periodicity Detection in Hearing, edited by, R. Plomp, and, G. F. Smoorenburg, (Sijthoff, Leiden), pp. 397-414.
39. Pollard, H., and Jansson, E. (1982). A tristumulus method for the specification of musical timbre, Acustica 51, 162-171.
40. Rioux, V., McAdams, S., Susini, P., and Peeters, G. (2002). Wp2.1.5. psycho-acoustic timbre descriptors, Cuidado Report (IRCAM, Paris).
41. SAS Institute Inc. (2010). SAS/Stat 9.22 User's Guide (SAS Institute Inc., Cary, NC).
42. Scheirer, E., and Slaney, M. (1997). Construction and evaluation of a robust multifeature speech/music discriminator, in Proc. of IEEE Int. Conference on Acoustic Speech and Signal Processing, Munich, Germany (IEEE Computer Society Press, Los Alamitos, CA), Vol. 2, pp. 1331-1334.
43. Serra, X., and Smith III, J. (1990). Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition, Comput. Music J. 14, 12-24. (Pubitemid 21695923)
44. Slaney, M. (1998). Auditory Toolbox, Version 2, Technical Report No: 1998-010 (Interval Research Corporation).
45. Tindale, A., Kapur, A., Tzanetakis, G., and Fujinaga, I. (2004). Retrieval of percussion gestures using timbre classification techniques, in Proceedings of the International Symposium on Music Information Retrieval (ISMIR 2004), Barcelona, Spain (Audiovisual Institute Pompeu Fabra University), pp. 541-544.
46. Wedin, L., and Goude, G. (1972). Dimension analysis of the perception of instrumental timbre, Scand. J. Psychol. 13, 228-240. 10.1111/j.1467-9450.1972. tb00071.x
47. Wessel, D. (1979). Timbre space as a musical control structure, Comput. Music J. 3, 45-52. 10.2307/3680283
48. Wessel, D. L. (1973). Psychoacoustics and music: A report from Michigan State University, PACE: Bull. Comput. Arts Soc. 30, 1-2.
49. Wright, M. (2008). The shape of an instant: Measuring and modeling perceptual attack time with probability density functions, Ph.d. thesis, Stanford University, Palo Alto, CA.
50. Zwicker, E. (1961). Subdivision of the audible frequency range into critical bands (Frequenzgruppen), J. Acoust. Soc. Am. 33, 248. 10.1121/1.1908630