Musical instrument recognition by pairwise classification strategies

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1401-1412

  Essid, Slim ^b   Richard, Gaël ^a,b   David, Bertrand ^b  

^a IEEE   (France)

^b INSTITUT TELECOM   (France)

Author keywords

Feature selection; Gaussian mixture model (GMM); Genetic algorithms; Inertia ratio maximization with feature space projection (IRMFSP); Musical instrument recognition; Pairwise classification; Support vector machine (SVM)

Indexed keywords

INERTIA RATIO MAXIMIZATION WITH FEATURE SPACE PROJECTION (IRMFSP); MUSIC INFORMATION RETRIEVAL; MUSICAL INSTRUMENT RECOGNITION; PAIRWISE CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; GAUSSIAN DISTRIBUTION; GENETIC ALGORITHMS; MUSICAL INSTRUMENTS; SOUND RECORDING; SUPPORT VECTOR MACHINES;

SPEECH RECOGNITION;

EID: 33744983081     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.860842     Document Type: Article

References (74)

1. Information Technology - Multimedia Content Description Interface - Part 4: Audio, Int. Standard, 1SO/IEC FDIS 15938-4:2001(E), Jun. 2001.
2. D. Godsmark and G. J. Brown, "A blackboard architecture for computational auditory scene analysis," Speech Commun., vol. 27, pp. 351-366, Oct. 1998.
3. K. Kashino and H. Mursae, "A sound source identification system for ensemble music based on template adaptation and music stream exrtaction," Speech Commun., vol. 27, pp. 337-349, Sep. 1998.
4. T. Kinoshita, S. Sakai, and H. Tanaka, "Musical sound source identification based on frequency component adaptation," in Proc. IJCAI Workshop on Computational Auditory Scene Analysis (IJCAI-CASA), Stockholm, Sweden, Aug. 1999, pp. 18-24.
5. J. Eggink and G. J. Brown, "A missing feature approach to instrument identification in polyphonic music," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Hong Kong, China, Apr. 2003, pp. 553-556.
6. _, "Instrument recognition in accompanied sonatas and concertos," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Montréal, QC, Canada, May 2004, pp. 217-220.
7. E. Vincent and X. Rodet, "Instrument identification in solo and ensemble music using independent subspace analysis," in Proc. Int. Conf. Music Information Retrieval (ISMIR), Barcelona, Spain, Oct. 2004.
8. S. Essid, G. Richard, and B. David, "Instrument Recognition in Polyphonic Music Based on Automatic Taxonomies," Trans. Audio, Speech, and Lang. Process., vol. 14, no. 1, pp. 68-80, Jan. 2006, to be published.
9. M. Clark, P. Robertson, and D. A. Luce, "A preliminary experiment on the perceptual basis for musical instrument families," J. Audio Eng. Soc., vol. 12, pp. 199-203, 1964.
10. R. Plomp, "Timbre as a multidimensional attribute of complex tones," in Frequency Analysis and Periodicity, Detection in Hearing, R. Plomp and G. Smoorenburg, Eds. Leiden, Germany: Sijthoff, 1970, pp. 197-414.
11. K. M. Grey, "Multidimensional perceptual scaling of musical timbres," J. Acoust. Soc. Amer., vol. 61, pp. 1270-1277, 1977.
12. R. A. Kendall, "The role of acoustic signal partitions in listener categorization of musical phrases," Music Perception, vol. 4, pp. 185-214, 1986.
13. S. McAdams, S. Winsberg, S. Donnadieu, G. De Soete, and J. Krimphoff, "Perceptual scaling of synthesized musical timbres : Common dimensions, specificities and latent subject classes," Psychol. Res., vol. 58, pp. 177-192, 1995.
14. K. D. Martin, "Sound-source recognition: A theory and computational model," Ph.D dissertation, Media Lab., Dept. Elect. Eng. Comput. Sci., Mass. Inst. Technol., Cambridge, 1999.
15. I. Kaminskyj, "Multi-feature musical instrument sound classifier," in Proc. Australasian Computer Music Conf., Jul. 2000, pp. 53-62.
16. I. Fujinaga and K. MacMillan, "Realtime recognition of orchestral instruments," in Proc. Int. Computer Music Conf., 2000, pp. 141-143.
17. B. Kostek and A. Czyzewski, "Automatic recognition of musical instrument sounds - Further developments," in Proc. 110th AES Convention, Amsterdam, The Netherlands, May 2001.
18. G. Agostini, M. Longari, and E. Pollastri, "Musical instrument timbres classification with spectral features," Proc. EURASIP J. Appl. Signal Process., vol. 1, no. 11, pp. 5-14, 2003.
19. A. Eronen, "Automatic musical instrument recognition," Master's thesis, Dept. Inf. Tech., Tampere Univ. Technol., Tampere, Finland, 2001.
20. _, "Musical instrument recognition using ICA-based transform of features and discriminatively trained HMMs," in Proc. 7th Int. Symp. Signal Processing and its Applications, Paris, France, Jul. 2003, pp. 133-136.
21. G. Peeters, "Automatic classification of large musical instrument databases using hierarchical classifiers with inertia ratio maximization," in Proc. 115th AES Convention, New York, Oct. 2003.
22. A. G. Krishna and T. V. Sreenivas, "Music instrument recognition : From isolated notes to solo phrases," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Montréal, QC, Canada, May 2004, pp. 265-268.
23. F. Opolko and J. Wapnick, McGill University Master Samples. Montréal, QC, Canada: McGill Univ., 1987.
24. [Online]. Available: http://theremin.music.uiowa.edu
25. [Online]. Available: http://www.ircam.fr
26. M. Goto, H. Hashigushi, T. Nishimura, and R. Oka, "RWC music data-base: Popular, classical, and jazz music databases," in Proc. Int. Conf. Music Information Retrieval (ISMIR), Paris, France, Oct. 2002.
27. O. Gillet and G. Richard, "Automatic transcription of drum loops," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Montréal, QC, Canada, May 2004, pp. iv 263-iv 272.
28. S. Dubnov and X. Rodet, "Timbre recognition with combined stationary and temporal features," in Proc. Int. Computer Music Conf., 1998.
29. J. C. Brown, "Computer identification of musical instruments using pattern recognition with cepstral coefficients as features," J. Acoust. Soc. Amer., vol. 105, pp. 1933-1941, Mar. 1999.
30. J. C. Brown, O. Houix, and S. McAdams, "Feature dependence in the automatic identification of musical woodwind instruments," J. Acoust. Soc. Amer., vol. 109, pp. 1064-1072, Mar. 2000.
31. R. Ventura-Miravet, F. Murtagh, and J. Ming, "Pattern recognition of musical instruments using hidden Markov models," in Proc. Stockholm Music Acoustics Conf., Stockholm, Sweden, Aug. 2003, pp. 667-670.
32. S. Essid, G. Richard, and B. David, "Musical instrument recognition on solo performance," in Proc. Eur. Signal Processing Conf. (EUSIPCO), Vienna, Austria, Sep. 2004, pp. 1288-1292.
33. _, "Efficient musical instrument recognition on solo performance music using basic features," in Proc. AES 25th Int. Conf., London, U.K., Jun. 2004.
34. _, "Musical instrument recognition based on class pairwise feature selection," in Proc. 5th Int. Conf. Music Information Retrieval (ISMIR), Barcelona, Spain, Oct. 2004.
35. A. Livshin and X. Rodet, "Musical instrument identification in continuous recordings," in Proc. 7th Int. Conf. Digital Audio Effects (DAFX-4), Naples, Italy, Oct. 2004, pp. 222-227.
36. _, "Instrument recognition beyond separate notes - Indexing continuous recordings," in Proc. Int. Computer Music Conf., Miami, FL, Nov. 2004.
37. A. Kronen, "Comparison of features for musical instrument recognition," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, Oct. 2001, pp. 19-22.
38. G. Peeters and X. Rodet, "Automatically selecting signal descriptors for sound classification," in Proc. Int. Computer Music Conf., Goteborg, Sweden, Sep. 2002.
39. P. Herrera, G. Peeters, and S. Dubnov, "Automatic classificalion of musical sounds," J. New Music Res., vol. 32, no. 1, pp. 3-21, 2003.
40. I. Kaminskyj and A. Materka, "Automatic source identificalion of monophonic musical instrument sounds," in Proc. IEEE Int. Conf. Neural Netw., 1995, pp. 189-194.
41. I. Fujinaga, "Machine recognition of timbre using steady-state tone of acoustic musical instruments," in Proc. Int. Computer Music Conf., 1998.
42. G. Agoslini, M. Longari, and E. Pollastri, "Musical instrument timbres classification with spectral features," in Proc. Int. Workshop Multimedia Signal Processing, Cannes, France, Oct. 2001, pp. 97-102.
43. B. Kostek, Soft Computing in Acoustics, Applications of Neural Networks, Fuzty Logic, and Rough Sets to Musical Acoustics, Studies in Fuzziness and Soft Computing. New York: Physica-Verlag, 1999.
44. T. Kitahara, M. Goto, and H. G. Okuno, "Musical instrument identification based on f0-dependent multivariate normal distribution," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Hong Kong, China, Apr. 2003, pp. 409-412.
45. J. Lee and J. Chun, "Musical instrument recognition using hidden Markov model," in Conf. Rec. 36th Asilomar Conf. Signals, Systems, and Computers, Nov. 2002, pp. 196-199.
46. J. Marques and P. J. Moreno, "A Study of Musical Instrument Classification Using Gaussian Mixture Models and Support Vector Machines," Compaq Computer Corp., Cambridge, MA, Tech. Rep. CRL 99-4, 1999.
47. C. L. Krumhansl, "Why is musical timbre so hard to understand? in structure and perception of electroacoustic sound and music," Excerpta Medica, no. 846, pp. 43-53, 1989.
48. G. Peeters, "A Large Set of Audio Features for Sound Description (Similarity and Classification) in the CUIDADO Project," IRCAM, Paris, France, Tech. Rep., 2004.
49. F. Pachet and A. Zils, "Evolving automatically high-level music descriptors from acoustic signals," in Proc. 1st Int. Symp. Computer Music Modeling and Retrieval (CMMR), Montpellier, France, May 2003.
50. S. Essid, P. Leveau, G. Richard, L. Daudet, and B. David, "On the usefulness of differentiated transient/steady-state processing in machine recognition of musical instruments," in Proc. AES 118th Convention, Barcelona, Spain, May 2005.
51. J. Brown, "Musical instrument identification using autocorrelation co-efficients," in Proc. Int. Symp. Musical Acoustics, 1998, pp. 291-295.
52. L. R. Rabiner, Fundamentals of Speech Processing. Englewood Cliffs, NJ: Prentice-Hall, 1993, Prentice-Hall Signal Processing Series.
53. M. Partridge and M. Jabri, "Robust principal component analysis," in Proc. IEEE Signal Processing Society Workshop, Dec. 2000, pp. 289-298.
54. R. Kohavi and G. John, "Wrappers for featue subset selection," Artif. Intell. J., vol. 97, no. 1-2, pp. 273-324, 1997.
55. A. L. Blum and P. Langley, "Selection of relevant features and examples in machine learning," Artif. Intell. J., vol. 97, no. 1-2, pp. 245-271, Dec. 1997.
56. I. Guyon and A. Elisseeff, "An introduction to feature and variable selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2003.
57. W. Sidelcki and J. Sklansky, "A note on genetic algorithms for large-scale feature selection," Pattern Recognit. Lett., vol. 10, pp. 335-347, 1989.
58. F. J. Fern, V. Kadirakamanathan, and J. Kittler, "Feature subset search using genetic algorithms," in Proc. IEE/IEEE Workshop on Natural Algorithms in Signal Processing, 1993.
59. F. J. Ferri, P. Pudil, M. Hatef, and J. Kittler, "Comparative study of techniques for large-scale feature selection," Pattern Recognit. Practice IV, pp. 403-113, 1994.
60. L. Y. Tseng and S. B. Yang, "Genetic algorithms for clustering, feature selection and classification," in Proc. IEEE Int. Conf. Neural Networks, Jun. 1997, pp. 1612-1616.
61. Z. Sun, X. Yuan, and S. J. Louis, "Genetic feature subset selection for gender classification," in Proc. 6th IEEE Workshop on Applications of Computer Vision, 2002, pp. 165-170.
62. I.-S. Oh, J.-S. Lee, and B.-R. Moon, "Local search-embedded genetic algorithms for feature selection," in Proc. 16th IEEE Int. Conf. Pattern Recognition, 2002, pp. 148-151.
63. R. Duda and P. E. Hart, Pattern Classification and Scence Analysis. New York: Wiley, 1973.
64. M. Berthold and D. J. Hand, Intelligent Data Analysis: An Introduction. New York: Springer-Verlag, 1999.
65. M. Srinivas and M. Patnaik, "Genetic algorithms : A survey," in IEEE Computer Society Press Washington, DC, Jun. 1999, vol. 27, pp. 17-26.
66. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
67. T. K. Moon, "The expectation-maximization algorithm," IEEE Signal Process. Mag., no. 11, pp. 47-60, Nov. 1996.
68. T. Hastie and R. Tibshirani, ""Classification by Pairwise Coupling," Tech. Rep." Stanford Univ./Univ. Toronto, 1996.
69. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
70. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," J. Data Mining Knowledge Discovery, vol. 2, no. 2, pp. 1-43, 1998.
71. G. Schwartz, "Estimating the dimension of a model," Ann. Statist., vol. 6, pp. 461-464, 1978.
72. [Online]. Available: http://www.tsi.enst.fr/essid/pub/pubIeee1/pubIeee1. htm
73. T. Joachims, "Estimating the generalization performance of a SVM efficiently," in Proc. Int. Conf. Machine Learn., 2000, pp. 431-438.
74. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.