A real-time music-scene-description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals

Speech Communication

Volumn 43, Issue 4 SPEC. ISS., 2004, Pages 311-329

  Goto, Masataka ^a  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Computational auditory scene analysis; EM algorithm; F0 estimation; MAP estimation; Music information retrieval; Music understanding

Indexed keywords

AUDIO ACOUSTICS; COMPUTATIONAL METHODS; HARMONIC ANALYSIS; INFORMATION RETRIEVAL; SIGNAL PROCESSING;

AUDIO SIGNALS; MUSIC INFORMATION RETRIEVAL; MUSIC UNDERSTANDING;

SPEECH COMMUNICATION;

EID: 4644242508     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.07.001     Document Type: Article

References (43)

1. Abe, T., Kobayashi, T., Imai, S., 1996. Robust pitch estimation with harmonics enhancement in noisy environments based on instantaneous frequency. In: Proc. Internat. Conf. on Spoken Language Processing (ICSLP 96), pp. 1277-1280.
2. Abe, T., Kobayashi, T., Imai, S., 1997. The IF spectrogram: a new spectral representation. In: Proc. Internat. Sympos. on Simulation, Visualization and Auralization for Acoustic Research and Education (ASVA 97), pp. 423-430.
3. Boashash, B., 1992. Estimating and interpreting the instantaneous frequency of a signal. Proc. IEEE 80 (4), 520-568.
4. Bregman, A.S., 1990. Auditory Scene Analysis: The Perceptual Organization of Sound. The MIT Press.
5. Brown, G.J., 1992. Computational auditory scene analysis: a representational approach. Ph.D. thesis, University of Sheffield.
6. Brown, G.J., Cooke, M., 1994. Perceptual grouping of musical sounds: a computational model. J. New Music Res. 23, 107-132.
7. Chafe, C., Jaffe, D., 1986. Source separation and note identification in polyphonic music. In: Proc. IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP 86), pp. 1289-1292.
8. Charpentier, F.J., 1986. Pitch detection using the short-term phase spectrum. In: Proc. IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP 86), pp. 113-116.
9. Cooke, M., Brown, G., 1993. Computational auditory scene analysis: exploiting principles of perceived continuity. Speech Comm. 13, 391-399.
10. dè Cheveigné, A., 1993. Separation of concurrent harmonic sounds: fundamental frequency estimation and a time-domain cancellation model of auditory processing. J. Acoust. Soc. Amer. 93 (6), 3271-3290.
11. de Cheveigné, A., Kawahara, H., 1999. Multiple period estimation and pitch perception model. Speech Comm. 27 (3-4), 175-185.
12. Dempster, A.P., Laird, N.M., Rubin, D.B., 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. B 39 (1), 1-38.
13. Flanagan, J.L., Golden, R.M., 1966. Phase vocoder. Bell System Tech. J. 45, 1493-1509.
14. Goto, M., 1998. A study of real-time beat tracking for musical audio signals. Ph.D. thesis, Waseda University (in Japanese).
15. Goto, M., 2001. An audio-based real-time beat tracking system for music with or without drum-sounds. J. New Music Res. 30(2), 159-171.
16. Goto, M., Muraoka, Y., 1994. A beat tracking system for acoustic signals of music. In: Proc. 2nd ACM Internat Conf. on Multimedia (ACM Multimedia 94), pp. 365-372.
17. Goto, M., Muraoka, Y., 1996. Beat tracking based on multiple-agent architecture - a real-time beat tracking system for audio signals. In: Proc. 2nd Internat. Conf. on Multiagent Systems (ICMAS-96), pp. 103-110.
18. Goto, M., Muraoka, Y., 1998. Music understanding at the beat level - real-time beat tracking for audio signals. In: Computational Auditory Scene Analysis. Lawrence Erlbaum Associates, pp. 157-176.
19. Goto, M., Muraoka, Y., 1999. Real-time beat tracking for drumless audio signals: chord change detection for musical decisions. Speech Comm. 27 (3-4), 311-335.
20. Goto, M., Neyama, R., Muraoka, Y., 1997. RMCP: remote music control protocol - design and applications. In: Proc. 1997 Internat. Computer Music Conference (ICMC 97), pp. 446-449.
21. Kashino, K., 1994. Computational auditory scene analysis for music signals. Ph.D. thesis, University of Tokyo (in Japanese).
22. Kashino, K., Murase, H., 1997. A music stream segregation system based on adaptive multi-agents. In: Proc. Internat. Joint Conf. on Artificial Intelligence (IJCAI-97), pp. 1126-1131.
23. Kashino, K., Tanaka, H., 1994. A computational model of segregation of two frequency components - evaluation and integration of multiple cues. Electron. Comm. Jpn. (Part III) 77 (7), 35-47.
24. Kashino, K., Nakadai, K., Kinoshita, T., Tanaka, H., 1998. Application of the Bayesian probability network to music scene analysis. In: Computational Auditory Scene Analysis. Lawrence Erlbaum Associates, pp. 115-137.
25. Katayose, H., Inokuchi, S., 1989. The kansei music system. Comput. Music J. 13 (4), 72-77.
26. Kawahara, H., Katayose, H., de Cheveigné, A., Patterson, R.D., 1999. Fixed point analysis of frequency to instantaneous frequency mapping for accurate estimation of F0 and periodicity. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech 99), pp. 2781-2784.
27. Kitano, H., 1993. Challenges of massive parallelism. In: Proc. Internat. Joint Conf. on Artificial Intelligence (IJCAI-93), pp. 813-834.
28. Klapuri, A.P., 2001. Multipitch estimation and sound separation by the spectral smoothness principle. In: Proc. IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP 2001).
29. Masuda-Katsuse, I., 2001. A new method for speech recognition in the presence of non-stationary, unpredictable and high-level noise. In: Proc. European Conf. on Speech Communication and Technology (Eurospeech 2001), pp. 1119-1122.
30. Masuda-Katsuse, I., Sugano, Y., 2001. Speech estimation biased by phonemic expectation in the presence of non-stationary and unpredictable noise. In: Proc. Workshop on Consistent & Reliable Acoustic Cues for Sound Analysis (CRAC workshop).
31. Nakatani, T., Okuno, H.G., Kawabata, T., 1995. Residue-driven architecture for computational auditory scene analysis. In: Proc. Internat. Joint Conf. on Artificial Intelligence (IJCAI-95), pp. 165-172.
32. Nehorai, A., Porat, B., 1986. Adaptive comb filtering for harmonic signal enhancement. IEEE Trans. ASSP ASSP-34 (5), 1124-1138.
33. Noll, A.M., 1967. Cepstrum pitch determination. J. Acoust. Soc. Amer. 41 (2), 293-309.
34. Ohmura, H., 1994. Fine pitch contour extraction by voice fundamental wave filtering method. In: Proc. IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP 94), pp. II-189-192.
35. Okuno, H.G., Cooke, M.P. (Eds.), 1997. Working Notes of the IJCAI-97 Workshop on Computational Auditory Scene Analysis.
36. Parsons, T.W., 1976. Separation of speech from interfering speech by means of harmonic selection. J. Acoust. Soc. Amer. 60(4), 911-918.
37. Plomp, R., 1967. Pitch of complex tones. J. Acoust. Soc. Amer. 41 (6), 1526-1533.
38. Rabiner, L.R., Cheng, M.J., Rosenberg, A.E., McGonegal, C.A., 1976. A comparative performance study of several pitch detection algorithms. IEEE Trans. ASSP ASSP-24 (5), 399-418.
39. Ritsma, R.J., 1967. Frequencies dominant in the perception of the pitch of complex sounds. J. Acoust. Soc. Amer. 42 (1), 191-198.
40. Rosenthal, D., Okuno, H.G. (Eds.), 1995. Working Notes of the IJCAI-95 Workshop on Computational Auditory Scene Analysis.
41. Rosenthal, D.F., Okuno, H.G. (Eds.), 1998. Computational Auditory Scene Analysis. Lawrence Erlbaum Associates.
42. Schroeder, M.R., 1968. Period histogram and product spectrum: new methods for fundamental-frequency measurement. J. Acoust. Soc. Amer. 43 (4), 829-834.
43. Tolonen, T., Karjalainen, M., 2000. A computationally efficient multipitch analysis model. IEEE Trans. Speech Audio Process. 8 (6), 708-716.