A query-by-singing system for retrieving Karaoke music

IEEE Transactions on Multimedia

Volumn 10, Issue 8, 2008, Pages 1626-1637

  Yu, Hung Ming ^a   Tsai, Wei Ho ^b   Wang, Hsin Min ^a  

^a INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^b NATIONAL TAIPEI UNIVERSITY OF TECHNOLOGY   (Taiwan)

Author keywords

Bayesian information criterion; Dynamic time warping; Karaoke; Music information retrieval; Query by singing

Indexed keywords

BAYESIAN NETWORKS; DATABASE SYSTEMS; ELECTRONIC MUSICAL INSTRUMENTS; INFORMATION RETRIEVAL; INFORMATION SERVICES; METAL RECOVERY; MILITARY OPERATIONS; NATURAL LANGUAGE PROCESSING SYSTEMS; WEAVING;

BAYESIAN INFORMATION CRITERION; DYNAMIC TIME WARPING; KARAOKE; MUSIC INFORMATION RETRIEVAL; QUERY-BY-SINGING;

AUDIO ACOUSTICS;

EID: 57849122659     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2007345     Document Type: Article

References (38)

1. A. Ghias, J. Logan, D. Chamberlin, and B. C. Smith, "Query by humming: Musical information retrieval in an audio database", in Proc. ACM Int. Conf. Multimedia, 1995.
2. C. C. Liu, J. L. Hsu, and A. L. P. Chen, "An approximate string matching algorithm for content-based music data retrieval", in Proc. IEEE Int. Conf. Multimedia Computing and Systems, 1999.
3. J. S. Mo, C. H. Han, and Y. S. Kim, "A melody-based similarity computation algorithm for musical information", in Proc. Workshop on Knowledge and Data Engineering Exchange, 1999.
4. N. Kosugi, Y. Nishihara, T. Sakata, M. Yamamuro, and K. Kushima, "A practical query-by-humming system for a large music database", in Proc. ACM Int. Conf. Multimedia, 2000.
5. J. S. R. Jang and H. R. Lee, "Hierarchical filtering method for content-based music retrieval via acoustic input", in Proc. ACM Int. Conf. Multimedia, 2001.
6. N. Hu and R. B. Dannenberg, "A comparison of melodic database retrieval techniques using sung queries", in Proc. ACM/IEEE Joint Conference on Digital Libraries, 2002.
7. S. Pauws, "Cuby Hum: A fully operational query by humming system", in Proc. Int. Conf. Music Information Retrieval, 2002.
8. T. Nishimura, H. Hashiguchi, J. Takita, J. X. Zhang, M. Goto, and R. Oka, "Music signal spotting retrieval by a humming query using start frame feature dependent continuous dynamic programming", in Proc. Int. Symp. Music Information Retrieval, 2001.
9. J. Song, S. Y. Bae, and K. Yoon, "Mid-level music melody representation of polyphonic audio for query-by-humming system", in Proc. Int. Conf. Music Information Retrieval, 2002.
10. J. Foote, "ARTHUR: Retrieving orchestral music by long-term structure", in Proc. Int. Symp. Music Information Retrieval, 2000.
11. S. Doraisamy and S. M. Riiger, "An approach towards a polyphonic music retrieval system", in Proc. Int. Symp. Music Information Retrieval, 2001.
12. J. Pickens, J. P. Bello, G. Monti, M. Sandler, T. Crawford, M. Dovey, and D. Byrd, "Polyphonic score retrieval using polyphonic audio queries: A harmonic modeling approach", J. New Music Res., vol. 32, no. 2, pp. 223-236, 2003.
13. H. M. Yu, W. H. Tsai, and H. M. Wang, "A query-by-singing technique for retrieving polyphonic objects of popular music", in Proc. Asian Information Retrieval Symp., 2005.
14. S. Doraisamy and S. Rüger, "Robust polyphonic music retrieval with n-grams", J. Intell. Inform. Syst., vol. 21, no. 1, pp. 53-70, Jul. 2003.
15. J. Shifrin and W. Birmingham, "Effectiveness of HMM-based retrieval on large databases", in Proc. Int. Conf. Music Information Retrieval, 2003.
16. C. Meek and W. P. Birmingham, "Automatic thematic extractor", J. Intell. Inform. Syst., vol. 21, no. 1, pp. 9-33, Jul. 2003.
17. R. Typke, R. C. Veltkamp, and F. Wiering, "Searching notated polyphonic music using transportation distances", in Proc. ACM Conf. Multimedia, 2004.
18. W. H. Tsai and H. M. Wang, "A query-by-example framework to retrieve music documents by singer", in Proc. IEEE Int. Conf. Multimedia and Expo, 2004.
19. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals", IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
20. Y. Feng, Y. Zhuang, and Y. Pan, "Popular music retrieval by detecting mood", in Proc. ACM Conf. Research and Development in Information Retrieval, 2003.
21. M. Goto, "A predominant-FO estimation method for CD recordings: MAP estimation using EM algorithm for adaptive tone models", in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2001.
22. J. Eggink and G. J. Brown, "Extracting melody lines from complex audio", in Proc. Int. Conf. Music Information Retrieval, 2004.
23. E. Keogh and M. Pazzani, "Scaling up dynamic time warping for datamining applications", in Proc. ACM SIGKDD, 2000.
24. S. Salvador and P. Chan, "Fast DTW: Toward accurate dynamic time warping in linear time and space", in Proc. KDD Workshop on Mining Temporal and Sequential Data, 2004.
25. G. Schwarz, "Estimation the dimension of a model", Ann. Statist., vol. 6, no. 2, pp. 461-464, 1978.
26. Cakewalk, Inc. [Online], Available: http://www.cakewalk.com/
27. M. Piszczalski and B. A. Galler, "Predicting musical pitch from component frequency ratios",. J. Acoust. Soc. Amer., vol. 66, no. 3, pp. 710-720, Sep. 1979.
28. B. Widrow, J. R. Glover, J. M. McCool, J. Kaunitz, C. S. Williams, R. H. Hearn, J. R. Zeidler, E. Dong, and R. C. Goodlin, "Adaptive noise cancelling: Principles and applications", Proc. IEEE, vol. 63, no. 12. pp. 1692-1716, Dec. 1975.
29. S. Haykin, Adaptive Filter Theory, 4th ed. New York: Prentice-Hall, 2002.
30. Y. Zhu and S. Gao, "Extracting vocal melody from karaoke music audio", in Proc. IEEE Int. Conf. Multimedia & Expo, 2005.
31. B. Pardo, W. Birmingham, and J. Shifrin, "Name that tune: A pilot study in finding a melody from a sung query", J. Amer. Soc. Inform. Sci. and Technol., vol. 55, no. 4, pp. 283-300, 2004.
32. B. Pardo, "Finding structure in audio for music information retrieval", IEEE Signal Process. Mag., vol. 23, no. 3, pp. 126-132, 2006.
33. T. D. Mulder, J. P. Martens, S. Pauws, F. Vignoli, M. Lesaffre, M. Leman, B. D. Baets, and H. D. Meyer, "Factors affecting music retrieval in query-by-melody", IEEE Trans. Multimedia, vol. 8, no. 4, pp. 728-739, Aug. 2006.
34. R. B. Dannenberg, W. P. Birmingham, G. Tzanetakis, C. Meek, N. Hu, and B. Pardo, "The MUSART testbed for query-by-humming evaluation", in Proc. Int. Conf. Music Information Retrieval, 2003, pp. 41-50.
35. R. B. Dannenberg, W. P. Birmingham, B. Pardo, N. Hu, C. Meek, and G. Tzanetakis, "A comparative evaluation of search techniques for query-by-humming using the MUSART testbed", J. Amer. Soc. Inform. Sci. and Technol., vol. 58, no. 2, pp. 687-701, 2007.
36. A. Duda, A. Nürnberger, and S. Stober, "Towards query by singing/humming on audio databases", in Proc. Int. Conf. Music Information Retrieval, 2007.
37. S. Pauws, "Effects of song familiarity, singing training and recent song exposure on the singing of melodies", in Proc. Int. Conf. Music Information Retrieval, 2003.
38. J. Foote, "Visualizing music and audio using self-similarity", in Proc. ACM Multimedia, 1999.