Automatic music video summarization based on audio-visual-text analysis and alignment

SIGIR 2005 - Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2005, Pages 361-368

  Xu, Changsheng ^a   Shao, Xi ^a,b   Maddage, Namunu C ^a,b   Kankanhalli, Mohan S ^b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

alignment; chorus; lyrics; music video; shot; summarization

Indexed keywords

CHORUS; LYRICS; MUSIC VIDEO; SHOT; SUMMARIZATION;

INFORMATION RETRIEVAL; VIDEO RECORDING;

ALIGNMENT;

EID: 38349119292     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1076034.1076097     Document Type: Conference Paper

References (28)

1. Logan B and Chu S, Music Summarization Using Key Phrases, In Proc. IEEE International Conference on Audio, Speech and Signal Processing, Istanbul,Turkey, 2000, vol.2, II749-II752.
2. Xu C, Zhu Y and Tian Q, Automatic music summarization based on temporal, spectral and cepstral features, In Proc. IEEE International Conference on Multimedia and Explore, Lausanne, Switzerland, 2002, 117-120.
3. Lu L, and Zhang H, Automated Extraction of Music Snippets, In Proc. ACM International Conference on Multimedia, Berkeley, CA, 2003, 140-147.
4. Bartsch M A and Wakefield G H, To Catch a Chorus: Using Chroma-based Representations for Audio Thumbnailing, In Proc. Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, New York, 2001, 15-18.
5. Cooper M and Foote J, Automatic Music Summarization via Similarity Analysis, In Proc. International Conference on Music Information Retrieval, Paris, France, 2002, 81-85.
6. Chai W and Vercoe B, Music Thumbnailing via Structural Analysis, In Proc. ACM international conference on Multimedia, Berkeley, CA, 2003, 223-226.
7. Yow, D., Yeo, B.L., Yeung, M., and Liu, G., Analysis and presentation of soccer highlights from digital video, In Proc. of Asian Conference on Computer Vision, Singapore, 1995, vol. II, 499-503.
8. Gong, Y., Liu, X., and Hua, W., Creating motion video summaries with partial audio-visual alignment, In Proc. of IEEE International Conference on Multimedia and Expo, Lausanne, Switzerland, 2002, vol.1, 285-288.
9. Foote, J., Cooper, M., and Girgensohn, A., Creating Music videos using automatic media analysis. In Proc. ACM International Conference on Multimedia, Juan-les-Pins, France, 2002, 553-560.
10. Pfeiffer, S., Lienhart, R., Fischer, S., and Effelsberg, W., Abstracting digital movies automatically, Journal of Visual Communication and Image Representation, 7, 4, (1996), 345-353.
11. Shao, X., Xu, C., and Kankanhalli, M.S., Automatically generating summaries for musical video, In Proceedings of IEEE International Conference on Image Processing, Barcelona, Spain, 2003, Vol.2, 547-550.
12. Agnihotri, L., Dimitrova, N., Kender, J., and Zimmerman, J., Music videos miner, In Proc. of the ACM International Conference on Multimedia, Berkeley, CA, 2003, 442-443.
13. Agnihotri, L., Dimitrova, N., and Kender, J., Design and evaluation of a music video summarization system, In Proc. of IEEE International Conference on Multimedia and Expo, 2004, Taibei, Taiwan.
14. Ten Minute Master No 18: Song Structure. MUSIC TECH magazine. www.musictechmag.co.uk (Oct. 2003), 62-63.
15. Goto M A, Chorus-section detecting method for musical audio signals, In Proc. IEEE International Conference on Acoustics Speech and Signal Processing, Hong Kong, 6-10 April, 2003.
16. nd International Conference on Music and Artificial Intelligence, Scotland, UK, 2002, 43-57.
17. Maddage C. N, Xu.C, Kankanhalli M.S, Shao X, Content-based music structure analysis with the applications to music semantic understanding, In Proc. ACM International Conference on Multimedia, New York, NY, 2004, 112-119.
18. rd Edition 2001.
19. Navarro, G. A guided tour to approximate string matching, ACM Computing Surveys, Vol.33, No.1, March 2001, 31-88. (Pubitemid 33768480)
20. Sheh, A., and Ellis, D.P.W., Chord Segmentation and Recognition using EM-Trained Hidden Markov Models. In Proc. ISMIR 2003.
21. Young S et al., The HTK Book, Dept. of Engineering, University of Cambridge, Version 3.2, 2002.
22. Deller, J. R., Hansen, J.H.L., and Proakis, H. J. G. Discrete-Time Processing of Speech Signals, IEEE Press (1999).
23. Collobert, R., and Bengio, S. SVMTorch: Support Vector Machines for Large-Scale Regression Problems. Journal of Machine Learning Research . Vol 1, 2001, 143-160. (Pubitemid 33738779)
24. Smoliar, S., and Zhang, H., Content-based video indexing and retrieval, IEEE Multimedia, vol. 1, pp. 62-72, 1994.
25. Li S. Z., Zhu L., Zhang Z. Q., Blake A., Zhang H. J. and Shum H., "Statistical learning of multi-view face detection", European Conference on Computer Vision, Denmark, May 2002.
26. Hua X. S.,, Chen X. R., Liu W., Zhang H. J., Automatic location of text in video frames. 3rd International Workshop on Multimedia Information Retrieval, Ottawa, Canada, 2001.
27. Rudiments and Theory of Music. The Associated Board of the Royal Schools of Music, 14 Bedford Square, London, WC1B 3JG, 1949.
28. John .P.C., Virginia A. Diehl and Kent L.N, Development of an instrument measuring user satisfaction of the human-computer interface,Proceedings of SIGCHI'88, pp.213-218, New York,1988