A conditional random field framework for robust and scalable audio-to-score matching

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 8, 2011, Pages 2385-2397

  Joder, Cyril ^a   Essid, Slim ^a   Richard, Gaël ^a  

^a INSTITUT TELECOM   (France)

Author keywords

Audio signal processing; conditional random fields (CRFs); machine learning; music; music to score alignment; Viterbi algorithm

Indexed keywords

CONDITIONAL RANDOM FIELD; MACHINE-LEARNING; MUSIC; MUSIC-TO-SCORE ALIGNMENT; VITERBI;

ALIGNMENT; CONTENT BASED RETRIEVAL; IMAGE SEGMENTATION; VITERBI ALGORITHM;

AUDIO SIGNAL PROCESSING;

EID: 80052630625     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2134092     Document Type: Article

References (43)

1. R. B. Dannenberg, "An on-line algorithm for real-time accompaniment," in Proc. ICMC, 1984, pp. 193-198.
2. J. D. Vantomme, "Score following by temporal pattern," Comput. Music. J., vol. 19, no. 3, pp. 50-59, 1995.
3. N. Orio, S. Lemouton, and D. Schwarz, "Score following: State of the art and new developments," in Proc. NIME, 2003, pp. 36-41.
4. D. Damm, C. Fremerey, F. Kurth, M. Müller, and M. Clausen, "Multimodal presentation and browsing of music," in Proc. ICMI, 2008, pp. 205-208.
5. C. Raphael, "A classifier-based approach to score-guided source separation of musical audio," Comput. Music. J., vol. 32, no. 1, pp. 51-59, 2008. (Pubitemid 351479759)
6. P. Cano, A. Loscos, and J. Bonada, "Score-performance matching using HMMs," in Proc. ICMC, 1999, pp. 441-444.
7. C. Raphael, "Automatic segmentation of acoustic musical signals using hidden Markov models," IEEE Trans. Pattern Anal. Machine Intell., vol. 21, no. 4, pp. 360-370, Apr. 1999.
8. L. Grubb and R. B. Dannenberg, "Enhanced vocal performance tracking using multiple information sources," in Proc. ICMC, 1998, pp. 37-44.
9. A. Cont, "Realtime audio to score alignment for polyphonic music instruments using sparse non-negative constraints and hierarchical HMMs," in Proc. IEEE ICASSP, 2006, pp. 245-248.
10. M. Puckette, "Score following using the sung voice," in Proc. ICMC, 1995, pp. 175-178.
11. A. Cont, "A coupled duration-focused architecture for real-time music-to-score alignment," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 974-987, Jun. 2010.
12. N. Montecchio and N. Orio, "A discrete filterbank approach to audio to score matching for score following," in Proc. ISMIR, 2009, pp. 495-500.
13. N. Hu, R. B. Dannenberg, and G. Tzanetakis, "Polyphonic audio matching and alignment for music retrieval," in Proc. IEEE WASPAA, 2003, pp. 185-188.
14. M. Müller and D. Appelt, "Path-constrained partial music synchronization," in Proc. IEEE ICASSP, 2008, pp. 65-68.
15. S. Ewert, M. Müller, and P. Grosche, "High resolution audio synchronization using chroma onset features," in Proc. IEEE ICASSP, 2009, pp. 1869-1872.
16. S. Dixon and G. Widmer, "Match: A music alignment tool chest," in Proc. ISMIR, 2005, pp. 192-197.
17. F. Soulez, X. Rodet, and D. Schwarz, "Improving polyphonic and poly-instrumental music to score alignment," in Proc. ISMIR, 2003, pp. 143-148.
18. S. Salvador and P. Chan, "Fastdtw: Toward accurate dynamic time warping in linear time and space," in KDDWorkshop Mining Temporal and Sequential Data, 2004, pp. 70-80.
19. M. Müller, H. Mattes, and F. Kurth, "An efficient multiscale approach to audio synchronization," in Proc. ISMIR, 2006.
20. B. Niedermayer and G. Widmer, "A multi-pass algorithm for accurate audio-to-score alignment," in Proc. ISMIR, 2010, pp. 417-422.
21. C. Fremerey, M. Müller, and M. Clausen, "Handling repeats and jumps in score-performance synchronization," in Proc. ISMIR, 2010, pp. 243-248.
22. A. Arzt and G.Widmer, "Towards effective 'any-time' music tracking," in Proc. Starting AI Researchers' Symp. (STAIRS), Lisbon, Portugal, 2010, pp. 24-36.
23. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
24. B. Pardo and W. Birmingham, "Modeling form for on-line following of musical performances," in Proc. Nat. Conf. Artif. Intell., 2005, pp. 1018-1023. (Pubitemid 43006740)
25. L. Grubb and R. Dannenberg, "A stochastic method of tracking a vocal performer," in Proc. ICMC, 1997, pp. 301-308.
26. P. Peeling, A. T. Cemgil, and S. Godsill, "A probabilistic framework for matching music representations," in Proc. ISMIR, Vienna, Austria, 2007, pp. 267-272.
27. C. Raphael, "Aligning music audio with symbolic scores using a hybrid graphical model," Mach. Learn. J., vol. 65, pp. 389-409, 2006. (Pubitemid 44836050)
28. K. P. Murphy, Dynamic Bayesian Networks: Representation, Inference and Learning. Berkeley, CA: Computer Science Division, UC, 2002.
29. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001.
30. P. Grosche, M. Müller, and F.Kurth, "Cyclic tempogram-A mid-level tempo representation for music signals," in Proc. IEEE ICASSP, Mar. 2010, pp. 5522-5525.
31. W. P. Birmingham, R. B. Dannenberg, G. H.Wakefield, M. A. Bartsch, D. Mazzoni, C. Meek, M. Mellody, and W. Rand, "Musart: Music retrieval via aural queries," in Proc. ISMIR, 2001, pp. 73-81.
32. P. Smyth, "Belief networks, hidden Markov models, and Markov random fields: A unifying view," in Pattern Recogn. Lett., 1998, vol. 18, pp. 1261-1268.
33. H. M. Wallach, Conditional random fields: An introduction, department of computer and information science Univ. of Pennsylvania, Philadelphia, 2004, Tech. Rep. MS-CIS-04-21.
34. S. Fine and Y. Singer, "The hierarchical hidden Markov model: Analysis and applications," in Mach. Learn. Conf., 1998, pp. 41-62.
35. M. T. Johnson, "Capacity and complexity of HMM duration modeling techniques," IEEE Signal Process. Lett., vol. 12, no. 5, pp. 407-410, May 2005. (Pubitemid 40679646)
36. A. Friberg and J. Sundberg, "Time discrimination in a monotonic, isochronous sequence," J. Acoust. Soc. Amer., vol. 98, pp. 2525-2531, 1995.
37. A. T. Cemgil, H. J. Kappen, P. Desain, and H. Honing, "On tempo tracking: Tempogram representation and Kalman filtering," J. New Music Res., vol. 28, no. 4, pp. 259-273, 2001.
38. Y. Zhu and M. Kankanhalli, "Precise pitch profile feature extraction from musical audio for key detection," IEEE Trans. Multimedia, vol. 8, no. 3, pp. 575-584, Jun. 2006.
39. C. Joder, S. Essid, and G. Richard, "A comparative study of tonal acoustic features for a symbolic level music-to-score alignment," in Proc. IEEE ICASSP, 2010, pp. 409-412.
40. M. Alonso, G. Richard, and B. David, "Extracting note onsets from musical recordings," in Proc. IEEE ICME, 2005, pp. 896-899. (Pubitemid 44669012)
41. C. Joder, S. Essid, and G. Richard, "An improved hierarchical approach for music-to-symbolic score alignment," in Proc. ISMIR, Utrecht, Holland, Aug. 2010, pp. 39-44.
42. V. Emiya, R. Badeau, and B. David, "Multipitch estimation of piano sounds using a new probabilistic spectral smoothness principle," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1643-1654, Aug. 2010.
43. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWCmusic database: Popular, classical, and jazz music databases," in Proc. ISMIR, 2002, pp. 287-288.