Monaural musical sound separation based on pitch and common amplitude modulation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 7, 2009, Pages 1361-1371

  Li, Yipeng ^a   Woodruff, John ^a   Wang, Deliang ^a  

^a Ohio State University   (United States)

Author keywords

Common amplitude modulation (CAM); Musical sound separation; Sinusoidal modeling; Time frequency masking; Underdetermined sound separation

Indexed keywords

COMMON AMPLITUDE MODULATION (CAM); MUSICAL SOUND SEPARATION; SINUSOIDAL MODELING; TIME-FREQUENCY MASKING; UNDERDETERMINED SOUND SEPARATION;

AMPLITUDE MODULATION; ASSOCIATIVE STORAGE; CAMS; HARMONIC ANALYSIS;

SEPARATION;

EID: 68549090694     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2020886     Document Type: Article

References (39)

1. The University of IOWA Musical Instrument Sample Database. [Online]. Available: http//:theremin.music.uiowa.edu/
2. S. A. Abdallah, "Towards Music Perception by Redundancy Reduction and Unsupervised Learning In Probablistic Models," Ph.D. dissertation, Dept. of Electron. Eng., King's College London, , London, u.k., 2002.
3. M. Bay and J. W. Beauchamp, "Harmonic source separation using prestored spectra," Indep. Compon. Anal. Blind Signal Separ., pp. 561-568, 2006.
4. P. Boersma and D. Weenink, "Praat: Doing Phonetics by Comput., Ver. 4.0.26," 2002. [Online]. Available: http://www.fon.hum.uva.nl/praat
5. a. s. Bregman, Auditory Scene Analysis. Cambridge, ma: mit Press, 1990.
6. G. J. Brown and M. P. Cooke, "Perceptual grouping of musical sounds: A computational model," J. New Music Res., vol. 23, pp. 107-132, 1994.
7. E. M. Burns, "Intervals, scales, and tuning," in The Psychology of Music, D. Deutsch, Ed. San Diego, CA: Academic, 1999.
8. D. R. Campbell, "The ROOMSIM User Guide (v3.3)," 2004. [Online]. Available: http://media.paisley.ac.uk/ campbell/Roomsim/
9. M. A. Casey and W. Westner, "Separation of mixed audio sources by independent subspace analysis," in Proc. Int. Comput. Music Conf., 2000.
10. E. Chew and X. Wu, "Separating voices in polyphonic music: a contig mapping approach," in Computer Music Modeling and Retrieval, ser. Lecture Notes in Computer Science. Berlin/Heideberg, Germany: Springer, 2005.
11. M. R. Every and J. E. Szymanski, "Separation of synchronous pitched notes by spectral filtering of harmonics," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1845-1856, Sep. 2006.
12. B. Fox, A. Sabin, B. Pardo, and A. Zopf, "Modeling perceptual similarity of audio signals for blind source separation evaluation," in Proc. Int. Conf. Ind. Compon, Anal. Signal Separ., 2007.
13. D. Godsmark and g. j. Brown, "a blackboard architecture for computational auditory scene analysis," Speech Commun., vol. 27, no. 4, pp. 351-366, 1999.
14. M. Goto, "Analysis of musical audio signals," in Computational Auditory Scene Analysis, D. L. Wang and G. J. Brown, Eds. New York: Wiley, 2006.
15. F. J. Harris, "On the use of windows for harmonic analysis with the discrete Fourier transform,"Proc. IEEE, vol. 66, no.1, pp. 51-83, 1978.
16. D. Huron, "Tone and voice: A derivation of the rules of voice-leading from perceptual principles," Music Perception, vol. 19, no. 1, pp. 1-64, 2001.
17. D. Huron, "The avoidance of part-crossing in polyphonic music: Perceptual evidence and musical practice," Music Perception, vol. 9, no. 1, pp. 93-104, 1991.
18. K. Itoyama, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "Instrument equalizer for query-by-example retrieval: improving sound source separation based on integrated harmonic and inharmonic models," in Proc. Int. Conf. Music Inf. Retrieval, 2008.
19. A. Klapuri, "Multiple fundamental frequency estimation based on harmonicity and spectral smoothness," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 804-816, Nov. 2003.
20. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, pp. 788-791, 1999.
21. Y. Li and D. L. Wang, "Pitch detection in polyphonic music using instrument tone models," inProc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2007, pp. II-481-II-484.
22. Y. Li and D. L. Wang, "Musical sound separation using pitch-based labeling and binary time-frequency masking," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2008, pp. 173-176.
23. R. McAulay and T. Quatieri, "Speech analysis/synthesis based on a sinusoidal representation," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, no. 4, pp. 744-754, Aug. 1986.
24. D. K. Mellinger, "Event Formation and Separation in Musical Sound," Ph.D. dissertation, Dept. of Comput. Sci., Stanford Univ., Stanford, CA, 1991.
25. N. Ono, K. Miyamoto, H. Kameoka, and S. Sagayama, "A real-time equalizer of harmonic and percussive components in music signals," in Proc. Int. Conf. Music Inf. Retrieval, 2008.
26. T. W. Parsons, "Separation of speech from interfering speech by means of harmonic selection," J. Acoust. Soc. Amer., vol. 60, no. 4, pp. 911-918, 1976.
27. J. Risset and D. Wessel, "Exploration of Timbre by Analysis and Synthesis," in The Psychology of Music, D. Deutsch, Ed. New York: Academic, 1982, pp. 26-58.
28. X. Serra, "Musical sound modeling with sinusoids plus noise," in Musical Signal Processing, C. Roads, S. Pope, A. Picialli, and G. Poli, Eds. Lisse, The Netherlands: Swets & Zeitlinger, 1997.
29. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2003, pp. 177-180.
30. E. Vincent, R. Gribonval, and C. Fevotte, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2006.
31. T. Virtanen, "Sound source separation in monaural music signals," Ph.D. dissertation, Tampere Univ. of Technol., Tampere, Finland, 2006.
32. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
33. T. Virtanen and A. Klapuri, "Separation of harmonic sounds using multipitch analysis and iterative parameter estimation," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2001, pp. 83-86.
34. H. Viste and G. Evangelista, "Separation of harmonic instruments with overlapping partials in multi-channel mixtures," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2003, pp. 25-28.
35. D.L. Wang, "Feature-based speech segregation," inComputational Auditory Scene Analysis, D. L. Wang and G. J. Brown, Eds. New York: Wiley, 2006.
36. D. L. Wang and G. J. Brown, Computational Auditory Scene Analysis: Principles, Algorithms, and Applications. Hoboken, NJ: Wiley/IEEE Press, 2006.
37. J. Woodruff, Y. Li, and D. L. Wang, "Resolving overlapping harmonics for monaural musical sound separation using pitch and common amplitude modulation," in Proc. Int. Conf. Music Inf. Retrieval, 2008.
38. J. Woodruff and B. Pardo, "Using pitch, amplitude modulation and spatial cues for separation of harmonic instruments from stereo music recordings," EURASIP J. Adv. Signal Process., vol. 2007, 2007.
39. J. Woodruff, B. Pardo, and R. Dannenberg, "Remixing stereo music with score-informed source separation," in Proc. Int. Conf. Music Inf. Retrieval, 2006.