Resource allocation for personalized video summarization

IEEE Transactions on Multimedia

Volumn 16, Issue 2, 2014, Pages 455-469

  Chen, Fan ^a   De Vleeschouwer, Christophe ^b   Cavallaro, Andrea ^c  

^a JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Adaptive fast forwarding; personalized video summarization; resource allocation

Indexed keywords

ADAPTIVE FAST-FORWARDING; DISCRETE OPTIMIZATION PROBLEMS; LAGRANGIAN RELAXATION; PERSONALIZED SUMMARIZATION; PERSONALIZED VIDEO; RESOURCE ALLOCATION PROBLEM; SUBJECTIVE EXPERIMENTS; VIDEO SUMMARIZATION;

OPTIMIZATION; RESOURCE ALLOCATION; SECURITY SYSTEMS; VIDEO STREAMING;

VIDEO RECORDING;

EID: 84893372960     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2291967     Document Type: Article

References (57)

1. B. T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput. Commun. Appl., vol. 3, no. 1, 2007.
2. A. Ferman and A. Tekalp, "Two-stage hierarchical video summary extraction to match low-level user browsing preferences," IEEE Trans. Multimedia, vol. 5, no. 2, pp. 244-256, 2003.
3. G. C. de Silva, T. Yamasaki, and K. Aizawa, "Evaluation of video summarization for a large number of cameras in ubiquitous home," in Proc. ACM MM'05, 2005, pp. 820-828.
4. Y. Takahashi, N. Nitta, and N. Babaguchi, "Video summarization for large sports video archives," in Proc. ICME'05, 2005, pp. 1170-1173. (Pubitemid 44669079)
5. G. Zhu, Q. Huang, C. Xu, Y. Rui, S. Jiang,W. Gao, and H. Yao, "Trajectory based event tactics analysis in broadcast sports video," in Proc. ACM MM'07, 2007, pp. 58-67.
6. J. Wang, C. Xu, E. Chng, L. Duan, K.Wan, and Q. Tian, "Automatic generation of personalized music sports video," in Proc. ACM MM'05, 2005, pp. 735-744.
7. Y. Zhuang, Y. Rui, T. Huang, and S. Mehrotra, "Adaptive key frame extraction using unsupervised clustering," in Proc. ICIP'98, 1998, vol. 1, pp. 866-870.
8. M. Cooper and J. Foote, "Discriminative techniques for keyframe selection," in Proc. ICME'05, 2005, p. 4.
9. J. Lai and Y. Yi, "Key frame extraction based on visual attention model," J. Visual Commun. Image Represent., vol. 23, no. 1, pp. 114-125, 2012.
10. Z. Li, G. M. Schuster, and A. K. Katsaggelos, "Minmax optimal video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 15, pp. 1245-1256, 2005. (Pubitemid 41640562)
11. P. Pahalawatta, Z. Li, F. Zhai, and A. Katsaggelos, "Rate-distortion optimization for internet video summarization and transmission," in Proc. MMSP'05, 2005, pp. 1-4.
12. E. K. Kang, S. J. Kim, and J. S. Choi, "Video retrieval based on key frame extraction in compressed domain," in Proc. ICIP'99, 1999, vol. 3, pp. 260-264.
13. S. Baysal,M.Kurt, and P.Duygulu, "Recognizing human actions using key poses," in Proc. ICPR'10, 2010, pp. 1727-1730.
14. Y. Ma and H. Zhang, "A model of motion attention for video skimming," in Proc. ICIP'02, 2002, vol. 1, pp. 129-132.
15. M. Smith and T. Kanade, "Video skimming and characterization through the combination of image and language understanding," in Proc. CAIVD'98, 1998, pp. 61-70.
16. M. Albanese, M. Fayzullin, A. Picariello, and V. Subrahmanian, "The priority curve algorithm for video summarization," Inf. Syst., vol. 31, no. 7, pp. 679-695, 2006. (Pubitemid 44233991)
17. B. Chen, J. Wang, and J. Wang, "A novel video summarization based on mining the story-structure and semantic relations among concept entities," IEEE Trans. Multimedia, vol. 11, no. 2, pp. 295-312, 2009.
18. J. Fan, A. Elmagarmid, X. Zhu, W. Aref, and L. Wu, "Classview: Hierarchical video shot classification, indexing, and accessing," IEEE Trans. Multimedia, vol. 6, no. 1, pp. 70-86, Feb. 2004.
19. J. Sivic, F. Schaffalitzky, and A. Zisserman, "Object level grouping for video shots," Int. J. Comput. Vision, vol. 67, no. 2, pp. 189-210, 2006.
20. C. Snoek, M. Worring, D. Koelma, and A. Smeulders, "A learned lexicon-driven paradigmfor interactive video retrieval," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 280-292, 2007. (Pubitemid 46183099)
21. A. Ekin, A. Tekalp, and R.Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Process., vol. 12, no. 7, pp. 796-807, 2003.
22. K. A. Peker, A. Divakaran, and H. Sun, "Constant pace skimming and temporal sub-sampling of video using motion activity," in Proc. ICIP'01, 2001, vol. 3, pp. 414-417. (Pubitemid 33058007)
23. B. Höferlin, M. Höferlin, D. Weiskopf, and G. Heidemann, "Information-based adaptive fast-forward for visual surveillance," Multimedia Tools Appl., vol. 55, pp. 127-150, 2011.
24. K.-Y. Cheng, S.-J. Luo, B.-Y. Chen, and H.-H. Chu, "Smartplayer: User-centric video fast-forwarding," in Proc. CHI'09, 2009, pp. 789-798.
25. J. Jiang, X.-P. Zhang, and A. C. Loui, "A content-based video fastforward playback method using video time density function and rate distortion theory," in Proc. ICME'11, 2011, pp. 1-6.
26. N. Petrovic, N. Jojic, and T. S. Huang, "Adaptive video fast forward," Multimedia Tools Appl., vol. 26, no. 3, pp. 327-344, 2005. (Pubitemid 40983105)
27. Z. Li, P. Ishwar, and J. Konrad, "Video condensation by ribbon carving," IEEE Trans. Image Process., vol. 18, no. 11, pp. 2572-2583, 2009.
28. Y. Pritch, A. Rav-Acha, and S. Peleg, "Nonchronological video synopsis and indexing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1971-1984, 2008.
29. S. Feng, S. Z. Li, D. Yi, and Z. Lei, "Online content-aware video condensation," in Proc. CVPR'12, 2012, vol. 1, pp. 2082-2087.
30. B. Tseng and J. Smith, "Hierarchical video summarization based on context clustering," in Internet Multimedia Management Systems IV. (Edited by J.R. Smith, S, Panchanathan, and T. Zhang), Proc. SPIE, 2003, vol. 5242, pp. 14-25.
31. A. O. Holcombe, "Seeing slow and seeing fast: Two limits on perception," Trends Cognit. Sci., vol. 13, no. 5, pp. 216-221, 2009.
32. J. Palmer, "Attentional limits on the perception and memory of visual information," J. Experiment. Psychol.: Human Percept. Perform., vol. 16, pp. 332-350, 1990.
33. R. Cai, L. Lu, H.-J. Zhang, and L.-H. Cai, "Highlight sound effects detection in audio stream," in Proc. ICME'03, 2003, vol. 3, pp. 37-40.
34. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted American football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575-586, 2004.
35. B. Li, H. Pan, and I. Sezan, "A general framework for sports video summarization with its application to soccer," in Proc. ICASSP'03, 2003, vol. 3, pp. 169-172.
36. F. Chen, C. De Vleeschouwer, H. Barrobes, J. Escalada, and D. Conejero, "Automatic summarization of audio-visual soccer feeds," in Proc. ICME'10, 2010, pp. 837-842.
37. F. Chen and C. De Vleeschouwer, "Formulating team-sport video summarization as a resource allocation problem," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 2, pp. 193-205, 2011.
38. M. Höferlin, K. Kurzhals, B. Höferlin, G. Heidemann, and D. Weiskopf, "Evaluation of fast-forward video visualization," IEEE Trans. Visualiz. Comput. Graph., vol. 18, no. 12, pp. 2095-2103, 2012.
39. Y. Shoham and A. Gersho, "Efficient bit allocation for an arbitrary set of quantizers," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 9, pp. 1445-1453, 1988.
40. A. Ortega, "Optimal bit allocation under multiple rate constraints," in Proc. DCC'96, 1996, pp. 349-358.
41. H. Everett, "Generalized lagrange multiplier method for solving problems of optimum allocation of resources," Oper. Res., vol. 11, no. 3, pp. 399-417, 1963.
42. D. Helbing, P. Molnár, I. J. Farkas, and K. Bolay, "Self-organizing pedestrian movement," Environment and Planning B-Planning and Design, vol. 28, pp. 361-383, 2001. (Pubitemid 32477489)
43. F. Chen and A. Cavallaro, "Detection of group interactions by online association of trajectory data," in Proc. ICASSP'13, 2013, pp. 1754-1758.
44. H. Pan, P. van Beek, and M. I. Sezan, "Detection of slow-motion replay segments in sports video for highlights generation," in Proc. ICASSP'01, 2001, vol. 3, pp. 1649-1652. (Pubitemid 32838917)
45. I. Fernandez, F. Chen, F. Lavigne, X. Desurmont, and C. De Vleeschouwer, "Browsing sport content through an interactive H.264 streaming session," in Proc. MMEDIA'10, 2010, vol. 1, pp. 155-161.
46. H. Duxans, X. Anguera, and D. Conejero, "Audio based soccer game summarization," in Proc. BMSB'09, 2009, pp. 1-6.
47. J. Owens, Tv Sports Production. London, U.K.: Focal Press, 2007.
48. A. G. Money and H. W. Agius, "Feasibility of personalized affective video summaries," in Affect and Emotion in Human-Computer Interaction, 2008, pp. 194-208.
49. S. Zhao, H. Yao, X. Sun, X. Jiang, and P. Xu, "Flexible presentation of videos based on affective content analysis," in Proc. MMM'13, 2013, pp. 368-379.
50. JaistMultiview Surveillance Video Dataset, 2012. [Online]. Available: http://www.jaist.ac.jp/~chen-fan/multivision/jaistmvsdb.html.
51. Behave: Computer-Assisted Prescreening of Video Streams for Unusual Activities, 2007. [Online]. Available: http://groups.inf.ed.ac.uk/vision/ BEHAVEDATA/INTERACTIONS/.
52. D. Delannay, N. Danhier, and C. De Vleeschouwer, "Detection and recognition of sports(wo)men from multiple views," in Proc. ICDSC'09, 2009, pp. 1-7.
53. F. Chen and C. De Vleeschouwer, "Partial motion trajectory grouping through rooted arborescence," in Proc. ICIP'12, 2012, pp. 1337-1340.
54. Tracking Results of the Surveillance Dataset, 2012. [Online]. Available: http://www.jaist.ac.jp/project/prime-proj/results-tracking-tad. htm.
55. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: A survey," ACM Comput. Surv., vol. 38, 2006.
56. Supplemental Materials, 2012. [Online]. Available: http://www. jaist.ac.jp/project/prime-proj/tmm-supplementals.htm.
57. J. Nielsen, Usability Engineering. San Francisco, CA, USA:Morgan Kaufmann, 1993.