LyricAlly: Automatic synchronization of textual lyrics to acoustic music signals

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 2, 2008, Pages 338-349

  Kan, Min Yen ^a   Wang, Ye ^a   Iskandar, Denny ^b   Nwe, Tin Lay ^b   Shenoy, Arun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Acoustic signal detection; Acoustic signal processing; Music; Text processing

Indexed keywords

ACOUSTIC MUSICAL SIGNALS; ACOUSTIC SIGNAL DETECTION; AUDIO FEATURES; AUTOMATIC SYNCHRONIZATIONS; AVERAGE ERRORS; CHORUS DETECTIONS; COMPUTATIONAL COSTS; KARAOKE; MULTI-MODAL APPROACHES; MUSIC; MUSIC SIGNALS; PROBLEM-BASED; SINGING VOICE DETECTIONS; TEST BEDS;

ACOUSTIC SIGNAL PROCESSING; ACOUSTIC WAVES; AUDIO SYSTEMS; EQUIPMENT TESTING; SIGNAL DETECTION; SIGNAL PROCESSING; TEXT PROCESSING; WORD PROCESSING;

AUDIO ACOUSTICS;

EID: 64849083397     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.911559     Document Type: Article

References (32)

1. V ArifT, M Clausen, F. Kurth, and M Muller, "Automatic synchronization of music data in score-, MIDI- and PCM-format," in Pwc. Int. Conf. Music Inf. Retrieval (ISMIR), 2003, pp. 219-220.
2. A. Berenzweig and D. P. W. Ellis, "Locating singing voice segments within music signals," in Proc. Workshop Appl. Signal Process. Audio Acoust. (WASPAA), 2001, pp. 119-122.
3. A. Berenzweig, D. P. W. Ellis, and S. Lawrence, "Using voice segments to improve artist classification of music," in Proc. AES-22 Int. Conf. Virt., Synth., Ent. Audio., Espoo, Finland, 2002, pp. 79-86.
4. B. Chen, H.-M. Wang, and L.-S. Lee, "Improved spoken document retrieval by exploring acoustic and linguistic cues," in Proc. Eurospeech,
5. 2001, pp. 1-4, CD-ROM.
6. R. Dannenberg and N. Hu, "Polyphonic audio matching for score following and intelligent audio editors," in Proc. Int. Comput. Music Conf. (ICMC), Singapore, 2003, pp. 27-33. [6] "EU Project Semantic HIF1." [Online]. Available: http://shf.ircam.fr/ [7] M. Furini and L. Alboresi, "Audio-text synchronization inside MP3 files: A new approach and its implementation," in Proc. IEEE Consumer Commun. Netw. Conf, Las Vegas, NV, 2004, pp. 522-526. [8] M. Goto, "An audio-based real-time beat tracking system for music with or without drum-sound," J. New Music Res., vol. 30, no. 2, pp. 159-171, Jun. 2001. [9] M. A. Goto, "Chorus-section detection method for musical audio signals," in Pwc. IEEE Int. Conf. Acoust, Speech, Signal Process. (ICASSP), 2003, pp. 1783-1794.
7. D. Iskandar, W. Wang, M. -Y. Kan, and H. Li, "Syllabic level automatic synchronization of music signals and text lyrics," in Proc. ACM Multimedia (MM), Santa Barbara, CA, Oct. 2006, pp. 659-662.
8. P. Knees, M. Schedl, and G. Widmer, "Multiple lyrics alignment: Automatic retrieval of song lyrics," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2005, pp. 564-569.
9. F. Kurth, M. Mueller, A. Ribbrock. T. Roeder, D. Damm, and C. Fremerey, "A prototypical service for real-time access to local context-based music information," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2004, pp. 34-37.
10. C. H. Lee, F. K. Soong. and B. H. Juang, "A segment model based approach to speech recognition," in IEEE Int. Conf. Acoust., Speech, Signal Pwcess., 1988, vol. 1, pp. 501-541.
11. B. Logan, A. Kositsky, and P. Moreno, "Semantic analysis of song lyrics," in Pwc. IEEE Int. Conf. Mutimedia Expo (ICME), 2004, pp. 8'27-830.
12. A. Loscos, P. Cano, and J. Bonada, "Low-delay singing voice alignment to text," in Proc. Int. Comput. Music Conf, Beijing, China, 1999, pp. 437-140.
13. J. P. G. Mahedero, A. Martinez, and P. Cano. "Natural language processing of lyrics," in Pwc. ACM Multimedia, 2005, pp. 475-478.
14. N. Minibayeva and J.-W. Dunn, "A digital library data model for music," in Proc. ACM/IEEE-CS Joint Conf. Digital Libraries (JCDL),
15. 2002, pp. 154-155.
16. P. J. Moreno, C. Joerg, J.-M. Van Thong, and O. Glickman, "A recursive algorithm for the forced alignment of very long audio segments," in Proc. Int. Conf. Spoken Lang. Process., 1998.
17. T. L. Nwe, F. S. Wei, and L. C. De Silva, "Stress classification using subband based features," IEICE Trans. Inf. Syst., vol. E86-D, no. 3, pp. 565-573, 2003.
18. N. Orio and D. Scwarz, "Alignment of monophonic and polyphonic music to a score," in Pwc. Int. Comput. Music Conf, San Francisco, CA, 2001, pp. 155-158.
19. A. Shenoy, R. Mohapatra, and Y. Wang, "Key determination of acoustic musical signals," in Proc. Int. Conf. Multimedia Expo (ICME), Taipei, Taiwan, 2004, CD-ROM.
20. R. J. Turetsky and D. P. W. Ellis, "Ground truth transcriptions of real music from force-aligned MIDI syntheses," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2003, pp. 135-141.
21. G. Tzanetakis, "Song-specific bootstrapping of singing voice structure," in Proc. Int. Conf. Multimedia Expo (ICME), Taipei, Taiwan, 2004, CD-ROM.
22. J.-M. Van Thong, P. J. Moreno, B. Logan, B. Fidler, K. Maffey, and M. Moores, "Speechbot: An experimental speech-based search engine for multimedia content on the Web," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 88-96, Mar. 2002.
23. H. D. Wactlar, A. G. Hauptmann, and M. J. Witbrock, "Informedia: News-on-demand experiments in speech recognition," in Proc. DARPA Speech Recognition Workshop, 1996.
24. C. K. Wang, R. Y. Lyu, and Y. C. Chiang, "An automatic singing transcription system with multilingual singing lyric recognizer and robust melody tracker," in Proc. Eurospeech, Geneva, Switzerland, 2003, pp. 1197-1200.
25. Y. Wang, M.-Y. Kan, T. L. Nwe, A. Shenoy, and J. Yin, "LyricAlly: Automatic synchronization of acoustic musical signals and textual lyrics," in Pwc. ACM Conf. Multimedia, 2004, pp. 212-219.
26. Y. Wang, J. Tang, A. Ahmaniemi, and M. Vaalgamaa, "Parametric vector quantization for coding percussive sounds in music," in Pwc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2003, pp. 652-655.
27. I. Waugh, "Song structure," Music Tech Mag., vol. 7, pp. 62-63,
28. Oct. 2003 [Online], Available: http://www.musictechmag.co.uk, Ten
29. Minute Master No. 18: Song Stucture. [30] R. Weide, "CMU Pronouncing Dictionary (Rel. 0.6, 1995)." [Online].
30. Available: http://www.speech.cs.cmu.edu/cgi-bin/cmudict) [31] H. Yang, L. Chaisorn, Y. Zhao, S.-Y. Neo, and T.-S. Chua, "VideoQA:
31. Question answering on news video," in Proc. ACM Multimedia, 2003, pp. 632-641.
32. Y. Zhu, K. Chen, and Q. Sun, "Multimodal content-based structure analysis of karaoke music," in Pwc. ACM Multimedia, 2005, pp. 638-647.