Lyric synchronizer: Automatic synchronization system between musical audio signals and lyrics

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 6, 2011, Pages 1252-1261

  Fujihara, Hiromasa ^a   Goto, Masataka ^a   Ogata, Jun ^a   Okuno, Hiroshi G ^b  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^b KYOTO UNIVERSITY   (Japan)

Author keywords

Alignment; Lyrics; Singing voice; Viterbi algorithm; Vocal

Indexed keywords

ALIGNMENT TECHNIQUE; AUTOMATIC SYNCHRONIZATION; CONVENTIONAL METHODS; LYRICS; MUSIC-PLAYBACK INTERFACES; MUSICAL AUDIO SIGNAL; SPEECH SIGNALS; VITERBI; VOCAL; VOCAL SIGNALS;

ALIGNMENT; SIGNAL DETECTION; SPEECH; SYNCHRONIZATION; VITERBI ALGORITHM;

AUDIO ACOUSTICS;

EID: 80052978670     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2159577     Document Type: Article

References (27)

1. Y.Wang, M.-Y. Kan, T. L. Nwe, A. Shenoy, and J. Yin, "Lyrically: Automatic synchronization of acoustic musical signals and textual lyrics," in Proc. 12th ACM Int. Conf. Multimedia, 2004, pp. 212-219. (Pubitemid 40211749)
2. C. H. Wong, W. M. Szeto, and K. H. Wong, "Automatic lyrics alignment for Cantonese popular music," Multimedia Syst., vol. 4-5, no. 12, pp. 307-323, 2007.
3. A. Loscos, P. Cano, and J. Bonada, "Low-delay singing voice alignment to text," in Proc. Int. Comput. Music Conf. (ICMC99), 1999.
4. C.-K.Wang, R.-Y. Lyu, and Y.-C. Chiang, "An automatic singing transcription system with multilingual singing lyric recognizer and robust melody tracker," in Proc. 8th Euro. Conf. Speech Commun. Technol. (Eurospeech'03), 2003, pp. 1197-1200.
5. M. Gruhne, K. Schmidt, and C. Dittmar, "Phoneme recognition in popular music," in Proc. 8th Int. Conf. Music Inf. Retrieval (ISMIR'07), 2007, pp. 369-370.
6. H. Fujihara, M. Goto, T. Kitahara, and H. G. Okuno, "A modeling of singing voice robust to accompaniment sounds and its application to singer identification and vocal-timbre-similarity based music information retrieval," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 638-648, Mar. 2010.
7. M. Goto, "A real-time music-scene-description system: Predominant- F0 estimation for detecting melody and bass lines in real-world audio signals," Speech Commun., vol. 43, no. 4, pp. 311-329, 2004.
8. M. Bay, A. F. Ehmann, and J. S. Downie, "Evaluation of multiple-F0 estimation and tracking systems," in Proc. 10th Int. Soc. Music Inf. Retrieval Conf. (ISMIR'09), 2009, pp. 315-320.
9. G. E. Poliner, D. P. Ellis, A. F. Ehmann, E. Gómez, S. Streich, and B. Ong, "Melody transcription from music audio: Approaches and evaluation," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1247-1256, May 2007.
10. A. L. Berenzweig and D. P. W. Ellis, "Locating singing voice segments within music signals," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), 2001, pp. 119-122. (Pubitemid 34080608)
11. W.-H. Tsai and H.-M. Wang, "Automatic detection and tracking of target singer in multi-singer music recordings," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'04), 2004, pp. 221-224.
12. T. L. Nwe and Y. Wang, "Automatic detection of vocal segments in popular songs," in Proc. 5th Int. Conf. Music Inf. Retrieval (ISMIR'04), 2004, pp. 138-145.
13. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. System, Man, Cybern., vol. SMC-9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
14. X. R. T. Galas, "Generalized functional approximation for source filter system modeling," in Proc. 2nd Eur. Conf. Speech Commun. Technol. (Eurospeech'91), 1991, pp. 1085-1088.
15. K. Tokuda, T. Kobayashi, and S. Imai, "Adaptive cepstral analysis of speech," IEEE Trans. Speech Audio Process., vol. 3, no. 6, pp. 481-489, Nov. 1995.
16. T. Kitahara, M. Goto, and H. G. Okuno, "Pitch-dependent identification of musical instrument sounds," Appl. Intell., vol. 23, no. 3, pp. 267-275, 2005. (Pubitemid 41801688)
17. H. Kameoka, M. Goto, and S. Sagayama, "Selective amplifier of periodic and non-periodic components in concurrent audio signals with spectral control envelopes," 2006, vol. 2006, pp. 77-84, IPSJ SIG Tech. Rep., no. 90.
18. R. E. Méliani, "Accurate keyword spotting using strictly lexical fillers," in Proc. 1997 IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'97), 1997, pp. 907-910.
19. A. S. Manos and V. W. Zue, "A segment-based wordspotter using phonetic filler models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'97), 1997, pp. 899-902.
20. J. L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291-298, Apr. 1994.
21. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
22. S. B. Davis and P. Mermelstein, "Comparison of parametric representation for monosyllabic word recognition," IEEE Trans. Acoustic, Speech, Signal Process., vol. ASSP-28, no. 4, pp. 357-366, Aug. 1980. (Pubitemid 11464930)
23. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWCmusic database: Popular, classical, and jazz music databases," in Proc. 3rd Int. Conf. Music Inf. Retrieval (ISMIR'02), Oct. 2002, pp. 287-288.
24. T. Kawahara, A. Lee, K. Takeda, and K. Shikano, "Recent progress of open-source LVCSR engine Julius and Japanese model repository- Software of continuous speech recognition consortium-," in Proc. 6th Int. Conf. Spoken Lang. Process. (Interspeech'04 ICSLP), 2004.
25. T. Kudo, K. Yamamoto, and Y. Matsumoto, "Applying conditional random fields to Japanese morphological analysis," in Proc. Conf. Empirical Methods in Natural Lang. Process., 2004, pp. 230-237.
26. A. Sasou, M. Goto, S. Hayamizu, and K. Tanaka, "An auto-regressive, non-stationary excited signal parameter estimation method and an evaluation of a singing-voice recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'05), 2005, pp. I-237-I-240. (Pubitemid 43761134)
27. M. Goto, "Active music listening interfaces based on signal processing," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'07), 2007, pp. IV-1441-IV-1444. (Pubitemid 47178651)