Event driven web video summarization by tag localization and key-shot identification

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART1, 2012, Pages 975-985

  Wang, Meng ^a   Hong, Richang ^a   Li, Guangda ^b   Zha, Zheng Jun ^b   Yan, Shuicheng ^b   Chua, Tat Seng ^b  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Event driven summarization; key shot identification; tag localization; web videos

Indexed keywords

EVENT-DRIVEN SUMMARIZATION; EXPLOSIVE GROWTH; RELEVANCE SCORE; SUB-EVENTS; TAG LOCALIZATION; USER EXPERIENCE; VIDEO SKIMMING; WEB VIDEO; WEB VIDEO SUMMARIZATIONS;

SEARCH ENGINES; VIDEO RECORDING;

MULTIMEDIA SYSTEMS;

EID: 84864124214     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2185041     Document Type: Article

References (47)

1. X. Cheng, C. Dale, and J. Liu, "Understanding the characteristics of internet short video sharing: Youtube as a case study," presented at the 7th ACM SIGCOMM Conf. Internet Meas., San Diego, CA, 2007.
2. P.Duygulu, J.-Y. Pan, and D. A. Forsyth, "Towards auto-documentary: Tracking the evolution of news stories," presented at the 11th ACM Int. Conf. Multimedia, Berkeley, CA, 2003.
3. X. Wu, C.W. Ngo, and Q. Li, "Threading and autodocumenting news videos," IEEE Signal Process. Mag., vol. 23, pp. 59-68, 2006.
4. X. Wu, A. G. Hauptmann, and C. W. Ngo, "Practical elimination of near-duplicates from web video search," presented at the 15th Int. ACM Conf. Multimedia, Augsburg, Germany, 2007.
5. B. W. Chen, J. C. Wang, and J. F. Wang, "A novel video summarization based on mining the story-structure and semantic relations among concept entities," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 295-312, Feb. 2003.
6. R.Hong, J. Tang,H.K. Tan, S.Yan, C.-W. Ngo, and T.-S. Chua, "Event driven summarization for web videos," presented at the ACM Multimedia 1stWorkshop SocialMedia (ACM-MM-WSM), Beijing, China, 2009.
7. NIST, "TREC: The text retrieval conference," [Online]. Available: Http://trec.nist.gov/
8. T.-S. Chua, R.Hong, G. Li, and J. Tang, "From text question-Answering to multimedia QA," in ACM Multimedia Workshop Large-Scale Multimedia Retrieval Mining (LS-MMRM), 2009.
9. H. Yang, T.-S. Chua, S. Wang, and C.-K. Koh, "Structured use of external knowledge for event-based open-domain question-Answering," in Proc. 26th Int. ACM SIGIR Conf., 2003, pp. 33-40.
10. J. Cao and J. F. Nunamaker, "Question answering on lecture videos: A multifaceted approach," in Proc. ACM/IEEE Joint Conf. Digital Libraries, 2004, pp. 214-215.
11. Y. C.Wu, Y. S. Lee, and C. H. Chang, "CLVQ: Crosslanguage video question/answering system," in Proc. 6th IEEE Int. Symp. Multimedia Softw. Eng., 2004, pp. 294-301.
12. R. Hong, J. Tang, Z.-J. Zha, Z. Luo, and T.-S. Chua, "Mediapedia: Mining web knowledge to construct multimedia encyclopedia," in Proc. Multimedia Model., 2010, pp. 556-566.
13. G. Li, Z. Ming, H. Li, and T.-S. Chua, "Video reference: Question answering on YouTube," in Proc. 17th ACM Multimedia, Beijing, China, Oct. 2009.
14. B. Huet and B. Merialdo, "Automatic video summarization," in Interactive Video, Algorithms and Technologies. NewYork:Springer, 2006, pp. 27-41.
15. M. Cha, H. Kwak, P. Rodriguez, Y. Y. Ahn, and S. Moon, "I tube, you tube, everybody tubes: Analyzing the world's largest user generated content video system," presented at the SIGCOMM IMC., San Diego, CA, Sep. 2007.
16. S. Y. Neo, Y. Ran, H. K. Goh, Y. Zheng, and T. S. Chua, "The use of topic evolution to help users browse and find answers in news video corpus," presented at the ACM 14th Int. Conf. Multimedia, Augsburg, Germany, 2007.
17. X. Zhu, J. Fan, A. K. Elmagarmid, andX.Wu, "Hierarchical video content description and summarization using unified semantic and visual similarity," Multimedia Syst., vol. 9, pp. 31-53, 2003.
18. S. Tan, H. K. Tan, and C. W. Ngo, "Topical summarization of web videos by visual-Text time-dependent alignment," presented at the ACM 17th Int. Conf. Multimedia, Florence, Italy, 2010.
19. NIST, "TRECVID: A video evaluation forum organized in conjunction with TREC," [Online]. Available: Http://trecvid.nist.org/
20. A. P. Natsev, A. Haubold, J. Tesic, L. Xie, and R. Yan, "Semantic concept-based query expansion and re-ranking for multimedia retrieval," in MULTIMEDIA'07: Proc. 15th Int. Conf. Multimedia, 2007, pp. 991-1000.
21. S. Tang, J. Li, M. Li, X. Cheng, and L. Yizhi, "Trecvid 2008 highlevel feature extraction by mcg-ict-cas," presented at the TRECVID Workshop, 2008.
22. R. Hong, J. Tang, H.-K. Tan, C.-W. Ngo, S. Yan, and T.-S. Chua, "Beyond search: Event driven summarization forweb videos,"ACM Trans. Multimedia Comput., Commun., Appl., vol. 7S, no. 1, pp. 24-43, Oct. 2011.
23. S. Siersdorfer, J. S. Pedro, and M. Sanderson, "Automatic video tagging using content redundancy," presented at the 32nd Int. ACMSIGIR Conf. Res. Develop. Inf. Retrieval, New York, NY, 2009.
24. A. Ulges, C. Schulze, D. Keysers, and T. Breuel, "Identifying relevant frames in weakly labeled videos for training concept detectors," presented at the Int. Conf. Content-Based Image Video Retrieval (CIVR), Niagara Falls, Canada, 2008.
25. A. Ulges, C. Schulze, M. Koch, and T. M. Breuel, "Learning automatic concept detectors from online video," Comput. Vis. Image Understanding, vol. 114, no. 4, pp. 429-438, Apr. 2010.
26. W. Zhao, C. W. Ngo,H.K. Tan, and X. Wu, "Near-duplicate keyframe identification with interest point matching and pattern learning," IEEE Trans. Multimedia, vol. 9, pp. 1037-1048, 2007.
27. B. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, no. 5814, p. 972, 2007.
28. Y. Jia, J. Wang, C. Zhang, and X.-S. Hua, "Finding image exemplars using fast sparse affinity propagation," in Proc. ACMSIGMMInt. Conf. Multimedia, Vancouver, Canada, 2008, p. 639C642.
29. D. Heesch and S. Rlzger, "Nnk networks for content-based image retrieval," in Proc. Eur. Conf. Inf. Retrieval, Sunderland, U.K., 2004, p. 253C266.
30. B. Settles, M. Craven, and S. Ray, "Multiple-instance active learning," in Adv. Neural Inf. Process. Syst. (NIPS). Cambridge, MA: MIT Press, 2008, pp. 1289-1296.
31. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "NUSWIDE: A real-world web image database from national university of Singapore," in Proc. CIVR, Jul. 8-10, 2009.
32. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-111, Nov. 2004.
33. R. Hong, G. Li, L. Nie, J. Tang, and T.-S. Chua, "Exploring large scale data for multimedia QA: An initial study," presented at the ACM Int. Conf. Image Video Retrieval, Xi'an, China, 2010.
34. R. A. Fisher, Statistical Methods for Research Workers. NewYork: Macmillan., 1970.
35. G. Li, M. Wang, Y.-T. Zheng, H. Li, Z. Zha, and T.-S. Chua, "Shot-Tagger: Tag location for internet videos," presented at the Int. Conf. Multimedia Retrieval, Trento, Italy, 2011.
36. L. Duan, D. Xu, I. Tsang, and J. Luo, "Visual event recognition in videos by learning from web data," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1959-1966.
37. G. G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia, "EvenEvent detection and analysis from video stream detection and analysis from video stream," IEEE Trans. Pattern Recognit. Machine Intell., vol. 23, no. 8, pp. 873-889, Aug. 2001.
38. J. Shen, D. Tao, and X. Li, "Modality mixture projections for semantic video event detection," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1587-1596, Nov. 2008.
39. M. Shyu, Z.Xie,M. Chen, and S. Chen, "Video semantic event/concept detection using a subspace-based multimedia data mining framework," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 252-259, Feb. 2008.
40. J. Shen and Z. Cheng, "Personalized video similarity measure," Multimedia Syst., vol. 17, no. 5, pp. 421-433, 2011.
41. I. Yahiaoui, B. Merialdo, and B. Huet, "Comparison of multi-episode video summarization algorithms," EURASIP J. Appl. Signal Process., vol. 2003, no. 1, pp. 48-55, 2003.
42. Y. Li and B. Merialdo, "Multi-video summarization based on AV-MMR," presented at the Int. Workshop Content-Based Multimedia Indexing, Grenoble, France, 2010.
43. A. G. Money and H. Agius, "Video summarisation: A conceptual framework and survey of the state of the art," J. Vis. Commun. Image Represent., vol. 12, no. 2, pp. 121-143, 2008.
44. F. Wang and B. Merialdo, "Multi-doment video summarization," presented at the Int. Conf. Multimedia Expo., New York, NY, 2009.
45. M. Wang, X.-S. Hua, R. Hong, J. Tang, G. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., pp. 733-746, May 2009.
46. M. Wang, X.-S. Hua, J. Tang, and R. Hong, "Beyond distance measurement: Constructing neighborhood similarity for video annotation," IEEE Trans. Multimedia, vol. 11, no. 3, pp. 465-476, Mar. 2009.
47. M. Wang, X.-S. Hua, T. Mei, R. Hong, G.-J. Qi, Y. Song, and L. Dai, "Semi-supervised kernel denstity estimation for video annotation," Comput. Vis. Image Understanding, vol. 113, no. 3, pp. 384-396, 2009.