A tutorial on onset detection in music signals

IEEE Transactions on Speech and Audio Processing

Volumn 13, Issue 5, 2005, Pages 1035-1046

  Bello, Juan Pablo ^b   Daudet, Laurent ^c,e   Abdallah, Samer ^b   Duxbury, Chris ^b,d   Davies, Mike ^b   Sandler, Mark B ^a,b,f,g  

^a IEEE   (United Kingdom)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^c SORBONNE UNIVERSITÉ   (France)

^d WaveCrest Communications Ltd   (United Kingdom)

^e Laboratoire D'Acoustique Musicale   (France)

^f University of London ^*  (United Kingdom)

^g Audio Engineering   (United Kingdom)

Author keywords

Attack transcients; Audio; Note segmentation; Novelty detection

Indexed keywords

ATTACK TRANSCIENTS; AUDIO; NOTE SEGMENTATION; NOVELTY DETECTION;

MATHEMATICAL MODELS; NATURAL FREQUENCIES; PROBABILITY; SIGNAL PROCESSING; SPECTRUM ANALYSIS; STATISTICAL METHODS;

COMPUTER MUSIC;

EID: 27644583688     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.851998     Document Type: Article

References (41)

1. B. C. J. Moore, An Introduction to the Psychology of Hearing, 5th ed. New York: Academic, 1997.
2. J. Foote, "Automatic audio segmentation using a measure of audio novelty," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME2000), vol. I, New York, Jul. 2000, pp. 452-455.
3. M. Goto and Y. Muraoka, "Beat tracking based on multiple-agent architecture - a real-time beat tracking system for audio signals," in Proc. 2nd Int. Conf. Multiagent Systems, Dec. 1996, pp. 103-110.
4. E. D. Scheirer, "Tempo and beat analysis of acoustic musical signals," J. Acoust. Soc. Amer., vol. 103, no. 1, pp. 588-601, Jan. 1998.
5. A. Klapuri, "Sound onset detection by applying psychoacoustic knowledge," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP-99), Phoenix, AZ, 1999, pp. 115-118.
6. C. Duxbury, M. Sandler, and M. Davies, "A hybrid approach to musical note onset detection," in Proc. Digital Audio Effects Conf. (DAFX,'02), Hamburg, Germany, 2002, pp. 33-38.
7. R. J. McAulay and T. F. Quatieri, "Speech analysis/synthesis based on a sinusoidal representation," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, pp. 744-754, 1986.
8. X. Serra and J. O. Smith, "Spectral modeling synthesis: a sound analysis/synthesis system based on a deterministic plus stochastic decomposition," Comput. Music J., vol. 14, no. 4, pp. 12-24, winter 1990.
9. S. Levine, "Audio Representations for Data Compression and Compressed Domain Processing," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1998.
10. T. Verma, S. Levine, and T. Meng, "Transient modeling synthesis: A flexible analysis/synthesis tool for transient signals," in Proc. Int. Computer Music Conf., Thessaloniki, Greece, 1997, pp. 164-167.
11. T. Verma and T. Meng, "Sinusoidal modeling using frame-based perceptually weighted matching pursuits," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, Phoenix, AZ, 1999, pp. 981-998.
12. Z. Settel and C. Lippe, "Real-time musical applications using the FFT-based resynthesis," in Proc. Int. Computer Music Conf. (ICMC94), Aarhus, Denmark, 1994, pp. 338-343.
13. C. Duxbury, M. Davies, and M. Sandler, "Extraction of transient content in musical audio using multiresolution analysis techniques," in Proc. Digital Audio Effects Conf. (DAFX '01), Limerick, Ireland, 2001, pp. 1-4.
14. J. Princen and A. Bradley, "Analysis/synthesis filter bank design based on time domain aliasing cancellation," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, no. 5, pp. 1153-1161, Oct. 1986.
15. S. Shlien, "The modulated lapped transform, its time-varying forms, and its applications to audio coding standards," IEEE Trans. Speech Audio Process., vol. 5, no. 4, pp. 359-366, 1997.
16. M. Purat and P. Noll, "Audio coding with a dynamic wavelet packet decomposition based on frequency-varying modulated lapped transforms," in Proc. ICASSP, Atlanta, GA, 1996, pp. 1021-1024.
17. L. Daudet and B. Torrésani, "Hybrid representations for audiophonic signal encoding," Signal Process., vol. 82, no. 11, pp. 1595-1617, 2002.
18. A. W. Schloss, "On the Automatic Transcription of Percussive Music-From Acoustic Signal to High-Level Analysis," Ph.D. dissertation, Tech. Rep. STAN-M-27, Dept. Hearing and Speech, Stanford Univ., Stanford, CA, 1985.
19. C. Duxbury, M. Davies, and M. Sandler, "Improved time-scaling of musical audio using phase locking at transients," in Proc. AES 112th Conv., Munich, Germany, 2002, p. 5530.
20. B. Moore, B. Glasberg, and T. Bear, "A model for the prediction of thresholds, loudness and partial loudness," J. Audio Eng. Soc., vol. 45, no. 4, pp. 224-239, 1997.
21. X. Rodet and F. Jaillet, "Detection and modeling of fast attack transients," in Proc. Int. Computer Music Conf., Havana, Cuba, 2001, pp. 30-33.
22. P. Masri, "Computer Modeling of Sound for Transformation and Synthesis of Musical Signal," Ph.D. dissertation, Univ. of Bristol, Bristol, U.K., 1996.
23. M. Dolson, "The phase vocoder: a tutorial," Comput. Music J., vol. 10, no. 4, 1986.
24. J. P. Bello and M. Sandler, "Phase-based note onset detection for music signals," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-03), Hong Kong, 2003, pp. 49-52.
25. C. Duxbury, J. P. Bello, M. Davies, and M. Sandler, "A combined phase and amplitude based approach to onset detection for audio segmentation," in Proc. 4th European Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS-03), London, U.K., Apr. 2003, pp. 275-280.
26. J. P. Bello, C. Duxbury, M. Davies, and M. Sandler, "On the use of phase and energy for musical onset detection in the complex domain," IEEE Signal Proces. Lett., vol. 11, no. 6, pp. 553-556, Jun. 2004.
27. C. Duxbury, "Signal Models for Polyphonic Music," Ph.D. dissertation, Dept. Electron. Eng., Queen Mary, Univ. of London, London, U.K., 2004.
28. M. Davy and S. Godsill, "Detection of abrupt spectral changes using support vector machines. An application to audio signal segmentation," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP-02), Orlando, FL, 2002, pp. 1313-1316.
29. L. Daudet, "Transients modeling by pruned wavelet trees," in Proc. Int. Computer Music Conf. (ICMC'01), Havana, Cuba, 2001, pp. 18-21.
30. M. Basseville and I. V. Nikiforov, Detection of Abrupt Changes - Theory and Application. Englewood Cliffs, NJ: Prentice-Hall, 1993.
31. M. Basseville and A. Benveniste, "Sequential detection of abrupt changes in spectral changes of digital signals," IEEE Trans. Inform. Theory, vol. 29, pp. 709-724, 1983.
32. T. Jehan, "Musical Signal Parameter Estimation," M.S. thesis, Univ. of California, Berkeley, CA, 1997.
33. H. Thornburg and F. Gouyon, "A flexible analysis-synthesis method for transients," in Proc. Int. Computer Music Conf. (ICMC-2000), Berlin, 2000, pp. 400-403.
34. A. von Brandt, "Detecting and estimating parameter jumps using ladder algorithms and likelihood ratio test," in Proc. ICASSP, Boston, MA, 1983, pp. 1017-1020.
35. S. A. Abdallah and M. D. Plumbley, "Probability as metadata: event detection in music using ICA as a conditional density model," in Proc. 4th Int. Symp. Independent Component Analysis and Signal Separation (ICA2003), Nara, Japan, 2003, pp. 233-238.
36. J.-F. Cardoso, "Infomax and maximum likelihood for blind source separation," IEEE Signal Process. Lett., vol. 4, no. 4, pp. 112-114, Apr. 1997.
37. S. A. Abdallah and M. D. Plumbley, "If edges are the independent components of natural scenes, what are the independent components of natural sounds?," in Proc. 3rd Int. Conf. Independent Component Analysis and Signal Separation (ICA2001), San Diego, CA, 2001, pp. 534-539.
38. _, "Unsupervised onset detection: a probabilistic approach using ICA and a hidden Markov classifier," in Cambridge Music Processing Colloq., Cambridge, U.K., 2003, [Online] Available: http://www-sigproc.eng.cam.ac.uk/ music_proc/2003/contributors.html.
39. I. Kauppinen, "Methods for detecting impulsive noise in speech and audio signals," in Proc. 14th Int. Conf. Digit. Signal Process. (DSP2002), vol. 2, Santorini, Greece, Jul. 2002, pp. 967-970.
40. A. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press, 1990.
41. M. Castellengo, "Acoustical analysis of initial transients in flute-like instruments," Actu Acustica, vol. 85, no. 3, pp. 387-400, 1999.