Integrating additional chord information into HMM-based lyrics-to-audio alignment

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 1, 2012, Pages 200-210

  Mauch, Matthias ^a   Fujihara, Hiromasa ^a   Goto, Masataka ^a  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Audio user interfaces; hidden Markov models (HMMs); music; music information retrieval; speech processing

Indexed keywords

AUDIO ACOUSTICS; SPEECH PROCESSING; TRELLIS CODES; USER INTERFACES;

AUTOMATIC ALIGNMENT; AUTOMATIC GENERATION; HIDDEN MARKOV MODELS (HMMS); MEL FREQUENCY CEPSTRAL CO-EFFICIENT; MUSIC; MUSIC INFORMATION RETRIEVAL; MUSICAL PERFORMANCE; STATISTICAL SIGNIFICANCE;

HIDDEN MARKOV MODELS;

EID: 81155126217     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2159595     Document Type: Article

References (28)

1. M. A. Bartsch and G. H. Wakefield, "Audio thumbnailing of popular music using chroma-based representations," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 96-104, Feb. 2005. (Pubitemid 40178373)
2. K. Chen, S. Gao, Y. Zhu, and Q. Sun, "Popular song and lyrics synchronization and its application to music information retrieval," in Proc. SPIE, 2006.
3. R. Dannenberg and N. Hu, "Polyphonic audio matching for score following and intelligent audio editors," in Proc. Int. Comput. Music Conf. (ICMC 2003), 2003, pp. 27-34.
4. R. B. Dannenberg and C. Raphael, "Music score alignment and computer accompaniment," Commun. ACM, vol. 49, no. 8, pp. 38-43, 2006.
5. M. E. P. Davies, M. D. Plumbley, and D. Eck, "Towards a musical beat emphasis function," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'09), 2009, pp. 61-64.
6. H. Fujihara and M. Goto, "Three techniques for improving automatic synchronization between music and lyrics: Fricative detection, filler model, and novel feature vectors for vocal activity detection," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'08), 2008, pp. 69-72.
7. H. Fujihara, M. Goto, J. Ogata, K. Komatani, T. Ogata, and H. G. Okuno, "Automatic synchronization between lyrics and music CD recordings based on viterbi alignment of segregated vocal signals," in Proc. 8th IEEE Int. Symp. Multimedia (ISM'06), 2006, pp. 257-264.
8. T. Fujishima, "Real time chord recognition of musical sound: A system using common lisp music," in Proc. Int. Comput. Music Conf. (ICMC 1999), 1999, pp. 464-467.
9. M. Goto, "A real-time music scene description system: Predominant-F0estimation for detecting melody and bass lines in real-world audio signals," Speech Commun. (ISCA J.), vol. 43, no. 4, pp. 311-329, 2004.
10. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWCMusic Database: Popular, classical, and jazz music databases," in Proc. 3rd Int. Conf. Music Inf. Retrieval (ISMIR 2002), 2002, pp. 287-288.
11. D. Iskandar, Y.Wang, M. Y. Kan, and H. Li, "Syllabic level automatic synchronization of music signals and text lyrics," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 659-662, ACM. (Pubitemid 47113601)
12. M.-Y. Kan, Y. Wang, D. Iskandar, T. L. Nwe, and A. Shenoy, "Lyric Ally: Automatic synchronization of textual lyrics to acoustic music signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 338-349, Feb. 2008.
13. C. L. Lawson and R. J. Hanson, Solving Least Squares Problems. Englewood Cliffs: Prentice-Hall, 1974, ch. 23.
14. K. Lee and M. Cremer, "Segmentation-based lyrics-audio alignment using dynamic programming," in Proc. 9th Int. Conf. of Music Inf. Retrieval (ISMIR 2008), 2008, pp. 395-400.
15. N. C. Maddage, K. C. Sim, and H. Li, "Word level automatic alignment of music and lyrics using vocal synthesis," ACM Trans. Multimedia Comput., Commun., Applicat. (TOMCCAP), vol. 6, no. 3, 2010 [Online]. Available: http://doi.acm.org/10.1145/1823746.1823753, Article 19.
16. M. Mauch, "Automatic chord transcription from audio using computational models of musical context," Ph.D. dissertation, Queen Mary Univ. of London, London, U.K., 2010.
17. M. Mauch and S. Dixon, "A discrete mixture model for chord labelling," in Proc. 9th Int. Conf. Music Inf. Retrieval (ISMIR 2008), 2008, pp. 45-50.
18. M. Mauch and S. Dixon, "Approximate note transcription for the improved identification of difficult chords," in Proc. 11th Int. Soc. Music Inf. Retrieval Conf. (ISMIR 2010), 2010, pp. 135-140.
19. M. Mauch and S. Dixon, "Simultaneous estimation of chords and musical context from audio," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1280-1289, Aug. 2010.
20. M. Mauch, H. Fujihara, and M. Goto, "Song Prompter: An accompaniment system based on the automatic alignment of lyrics and chords to audio," in Proc. Late-Breaking Session 10th Int. Conf. Music Inf. Retrieval (ISMIR 2010), 2010, pp. 9-16.
21. M. McVicar and T. De Bie, "Enhancing chord recognition accuracy using web resources," in Proc. 3rd Int. Workshop Mach. Learn. Music (MML10), 2010.
22. A. Mesaros and T. Virtanen, "Automatic recognition of lyrics in singing," EURASIP J. Audio, Speech, Music Process., vol. 2010, 2010.[Online]. Available: , Article ID 546047.
23. L. Oudre, Y. Grenier, and C. Févotte, "Template-based chord recognition: Influence of the chord types," in Proc. 10th Int. Soc. for Music Inf. Retrieval Conf. (ISMIR 2009), 2009, pp. 153-158.
24. G. Poliner, D. Ellis, A. F. Ehmann, E. Gómez, S. Streich, and B. Ong, "Melody transcription from music audio: Approaches and evaluation," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1247-1256, May 2007.
25. A. Sheh and D. Ellis, "Chord segmentation and recognition using EM-trained hidden Markov models," in Proc. 4th Int. Conf. Music Inf. Retrieval (ISMIR 2003), 2003.
26. Y. Wang, M.-Y. Kan, T. L. Nwe, A. Shenoy, and J. Yin, "Lyric Ally: Automatic synchronization of acoustic musical signals and textual lyrics," in Proc. 12th Annu. ACM Int. Conf. Multimedia, 2004, pp. 212-219. (Pubitemid 40211749)
27. C. W. Wightman and D. T. Talkin, "The aligner: Text-to-speech alignment using Markov models," in Progress in Speech Synthesis, J. P. H. Van Santen, Ed. New York: Springer, ch. 25, pp. 313-323, Progress in speech synthesis.
28. A. Zolnay, R. Schlüter, and H. Ney, "Acoustic feature combination for robust speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2005, pp. 457-460.