Towards scalable summarization of consumer videos via sparse dictionary selection

IEEE Transactions on Multimedia

Volumn 14, Issue 1, 2012, Pages 66-75

  Cong, Yang ^a,b   Yuan, Junsong ^a   Luo, Jiebo ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b SHENYANG INSTITUTE OF AUTOMATION   (China)

^c University of Rochester   (United States)

Author keywords

Group sparse; key frame; Lasso; scene analysis; video analysis; video skim; video summarization

Indexed keywords

GROUP SPARSE; KEY FRAMES; LASSO; SCENE ANALYSIS; VIDEO ANALYSIS; VIDEO SKIM; VIDEO SUMMARIZATION;

GLOBAL OPTIMIZATION; VIDEO RECORDING;

ALGORITHMS;

EID: 84856194404     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2166951     Document Type: Article

References (36)

1. R. Junee, "Zoinks! 20 hours of video uploaded every minute!," YouTube Blog, vol. 20, 2009.
2. J. Luo, C. Papin, and K. Costello, "Towards extracting semantically meaningful key frames from personal video clips: From humans to computers," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 2, pp. 289-301, Feb. 2009.
3. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
4. J. Wu, H. Christensen, and J. Rehg, "Visual place categorization: Problem, dataset, and algorithm," in Proc. IROS, 2009.
5. J. Wu and J. Rehg, "Centrist: A visual descriptor for scene categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1489-1501, Aug. 2010.
6. B. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput., Commun., Appl. (TOMCCAP), vol. 3, no. 1, p. 3, 2007.
7. A. Money and H. Agius, "Video summarisation: A conceptual framework and survey of the state of the art," J. Vis. Commun. Image Represent., vol. 19, no. 2, pp. 121-143, 2008.
8. Guidelines for the TRECVID 2007 Evaluation (2008). [Online]. Available: http://www-nlpir.nist.gov/projects/tv2007/tv2007.html, 2008
9. B. Li and I. Sezan, "Semantic sports video analysis: Approaches and new applications," in Proc. ICIP, 2003, vol. 1.
10. Z. Xiong, R. Radhakrishnan, A. Divakaran, and T. Huang, "Effective and efficient sports highlights extraction using the minimum description length criterion in selecting GMM structures (audio classification)," in Proc. ICME, 2004, vol. 3, pp. 1947-1950. (Pubitemid 40063440)
11. Y. Rui, A. Gupta, and A. Acero, "Automatically extracting highlights for TV baseball programs," in Proc. 8th ACM Int. Conf. Multimedia, 2000, p. 115.
12. C. Cheng and C. Hsu, "Fusion of audio and motion information on HMM-based highlight extraction for baseball games," IEEE Trans. Multimedia, vol. 8, no. 3, pp. 585-599, Jun. 2006.
13. J. Kender and B. Yeo, "On the structure and analysis of home videos," in Proc. ACCV, 2000.
14. T. Zhang, "Intelligent keyframe extraction for video printing," Proc. SPIE, vol. 5601, p. 25, 2004.
15. Y. Ma, L. Lu, H. Zhang, and M. Li, "A user attention model for video summarization," in Proc. 10th ACM Int. Conf. Multimedia, 2002, p. 542.
16. A. Aner-Wolf and J. Kender, "Video summaries and cross-referencing through mosaic-based representation," Comput. Vis. Image Understand., vol. 95, no. 2, pp. 201-237, 2004.
17. Y. Zhuang, Y. Rui, T. Huang, and S. Mehrotra, "Adaptive key frame extraction using unsupervised clustering," in Proc. ICIP, 1998, pp. 866-870.
18. P. Gresle and T. Huang, "Gisting of video documents: A key frames selection algorithm using relative activity measure," in Proc. 2nd Int. Conf. Visual Information Systems, 1997, pp. 279-286.
19. Z. Rasheed and M. Shah, "Detection and representation of scenes in videos," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1097-1105, Dec. 2005. (Pubitemid 41789121)
20. T. Liu, H. Zhang, and F. Qi, "A novel video key-frame-extraction algorithm based on perceived motion energy model," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, pp. 1006-1013, Oct. 2003.
21. C. Xu, N. Maddage, and X. Shao, "Automatic music classification and summarization," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 441-450, May 2005. (Pubitemid 40666178)
22. J. You, G. Liu, L. Sun, and H. Li, "A multiple visual models based perceptive analysis framework for multilevel video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 273-285, Mar. 2007. (Pubitemid 46394438)
23. B. Yu, W. Ma, K. Nahrstedt, and H. Zhang, "Video summarization based on user log enhanced link analysis," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 382-391.
24. Y. Peng and C. Ngo, "Clip-based similarity measure for query-dependent clip retrieval and video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 5, pp. 612-627, May 2006.
25. Z. Li, G. Schuster, and A. Katsaggelos, "Minmax optimal video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, p. 1245, Oct. 2005.
26. Z. Li, G. Schuster, A. Katsaggelos, and B. Gandhi, "Rate-distortion optimal video summary generation," IEEE Trans. Image Process., vol. 14, no. 10, pp. 1550-1560, Oct. 2005. (Pubitemid 41623085)
27. Z. Li, P. Ishwar, and J. Konrad, "Video condensation by ribbon carving," IEEE Trans. Image Process., vol. 18, no. 11, pp. 2572-2583, Nov. 2009.
28. Y. Fu,Y.Guo,Y. Zhu, F. Liu, C. Song, and Z. Zhou, "Multi-view video summarization," IEEE Trans. Multimedia, vol. 12, no. 7, pp. 717-729, Nov. 2010.
29. M.Yuan andY. Lin, "Model selection and estimation in regression with grouped variables," J. Roy. Statist. Soc.: Series B (Statist. Methodol.), vol. 68, no. 1, pp. 49-67, 2006. (Pubitemid 43415335)
30. K. Huang and S. Aviyente, "Sparse representation for signal classification," Adv. Neural Inf. Process. Syst., vol. 19, p. 609, 2007.
31. J. Liu, P. Musialski, P. Wonka, and J. Ye, "Tensor completion for estimating missing values in visual data," in Proc. 2009 IEEE 12th Int. Conf. Computer Vision, 2009, pp. 2114-2121.
32. Y. Cong, J. Yuan, and J. Liu, "Sparse reconstruction cost for abnormal event detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 3449-3456.
33. Y. Nesterov, Gradient Methods for Minimizing Composite Objective Function. Louvain-la-Neuve, Belgium: CORE, 2007.
34. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization," in Proc. ICML, 2009, pp. 457-464.
35. M. Stricker and M. Orengo, "Similarity of color images," Proc. SPIE Storage and Retrieval for Image and Video Databases, vol. 2420, pp. 381-392, 1995.
36. A. Loui, J. Luo, S. Chang, D. Ellis, W. Jiang, L. Kennedy, K. Lee, and A. Yanagawa, "Kodak's consumer video benchmark data set: Concept definition and annotation," in Proc. Int. Workshop Multimedia Information Retrieval, 2007, pp. 245-254.