A Unified Framework for Video Summarization, Browsing & Retrieval

A Unified Framework for Video Summarization, Browsing & Retrieval

Volumn , Issue , 2006, Pages

  Xiong, Ziyou ^a   Radhakrishnan, Regunathan ^b   Divakaran, Ajay ^b   Rui, Yong ^c   Huang, Thomas S ^d  

^a UNITED TECHNOLOGIES RESEARCH CENTER   (United States)

^b MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

^c MICROSOFT RESEARCH   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882218729     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Book

References (112)

1. Zhang H., Kankanhalli A., Smoliar S.W. Automatic partitioning of full-motion video. ACM Multimedia System Journal 1993, vol. 1(no. 1):1-12.
2. Bolle R.M., Yeo B.-L., Yeung M.M. Video query: Beyond the keywords. Technical report Oct. 1996, IBM Research.
3. Zhong D., Zhang H., Chang S.-F. Clustering methods for video browsing and annotation. Technical report 1997, Columbia University.
4. Rui Y., Huang T.S., Mehrotra S. Exploring video structures beyond the shots. Proc. of IEEE Conf. Multimedia Computing and Systems 1998.
5. Zhang H., Smoliar S.W., Wu J.J. Content-based video browsing tools. Proc. IS & T/SPIE Conf. on Multimedia Computing and Networking 1995.
6. Xie L., Xu P., Chang S.F., Divakaran A., Sun H. Structure analysis of soccer video with domain knowledge and hidden Markov models. Pattern Recognition Letters May 2004, vol. 25(no. 7):767-775.
7. Hampapur A., Jain R., Weymouth T. Digital video segmentation. Proc. ACM Conf. on Multimedia 1994.
8. Kasturi R., Jain R. Dynamic vision. Proc. of Computer Vision: Principles 1991, IEEE Computer Society Press. R. Kasturi, R. Jain (Eds.).
9. Arman F., Hsu A., Chiu M.-Y. Feature management for large video databases. Proc. SPIE Storage and Retrieval for Image and Video Databases 1993.
10. Meng J., Juan Y., Chang S.-F. Scene change detection in an MPEG compressed video sequence. Proc. SPIE Symposium on Electronic Imaging: Science & Technology-Digital Video Compression: Algorithms and Technologies 1995, vol. 241:14-25.
11. Yeo B.-L. Efficient processing of compressed images and video. Ph.D. dissertation 1996, Princeton University.
12. Zabih R., Miller J., Mai K. A feature-based algorithm for detecting and classifying scene breaks. Proc. ACM Conf. on Multimedia 1995.
13. Nagasaka A., Tanaka Y. Automatic video indexing and full-video search for object appearances. Proc. Visual Database Systems II 1992, 113-127. Elsevier Science Publishers, Budapest, Hungary.
14. Swanberg D., Shu C.-F., Jain R. Knowledge guided parsing in video databases. Proc. SPIE Storage and Retrieval for Image and Video Databases 1993.
15. Zhang H., Smoliar S.W. Developing power tools for video indexing and retrieval. Proc. SPIE Storage and Retrieval for Image and Video Databases 1994.
16. Zhang H., Low C.Y., Smoliar S.W., Zhong D. Video parsing, retrieval and browsing: An integrated and content-based solution. Proc. ACM Conf. on Multimedia 1995.
17. Naphade M.R., Mehrotra R., Ferman A.M., Huang T.S., Tekalp A.M. A high performance algorithm for shot boundary detection using multiple cues. Proc. IEEE Int. Conf. on Image Proc. Oct., 1998.
18. Boreczky J.S., Rowe L.A. Comparison of video shot boundary detection techniques. Proc. SPIE Storage and Retrieval for Image and Video Databases 1996.
19. Ford R.M., Robson C., Temple D., Gerlach M. Metrics for scene change detection in digital video sequences. Proc. IEEE Conf. on Multimedia Comput. and Syst. 1997.
20. Zhuang Y., Rui Y., Huang T.S., Mehrotra S. Adaptive key frame extraction using unsupervised clustering. proc. IEE Int. Conf. on Image Proc. 1998.
21. Gresle P.O., Huang T.S. Gisting of video documents: A key frames selection algorithm using relative activity measure. Proc. the 2nd Int. Conf. on Visual Information System 1996.
22. Divakaran A., Peker K.A., Radhakrishnan R., Xiong Z., Cabasson R. Video summarization using MPEG-7 motion activity and audio descriptors. Video Mining January 2003, Kluwer Academic Publishers, Boston, MA. A. Rosenfeld, D. Doermann, D. DeMenthon (Eds.).
23. Xie L., Chang S.F., Divakaran A., Sun H. Structure analysis of soccer video with hidden Markov models. Proc. Int'l Conf. on Acoustic, Speech, and Signal Processing May 2002, vol. 4:4096-4099.
24. Wren C., Azarbayejani A., Darrell T., Pentland A. Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence July 1997, vol. 19(no. 7):780-785.
25. Xiong Z., Radhakrishnan R., Divakaran A. Effective and efficient sports high-lights extraction using the minimum description length criterion in selecting GMM structures. Proc. Int'l Conf. on Multimedia and Expo June 2004.
26. Rui Y., Gupta A., Acero A. Automatically extracting highlights for TV baseball programs. Proc. Eighth ACM Int'l Conf. on Multimedia 2000, 105-115.
27. Nepal S., Srinivasan U., Reynolds G. Automatic detection of 'goal' segments in basketball videos. Proc. ACM Conf. on Multimedia 2001, 261-269.
28. Chang Y.-L., Zeng W., Kamel I., Alonso R. Integrated image and speech analysis for content-based video indexing. Proc. IEEE Int'l Conf. on Multimedia Computing and Systems June 1996, 306-313.
29. Kawashima T.I.T., Tateyama K., Aoki Y. Indexing of baseball telecast for content-based video retrieval. Proc. IEEE Int'l Conf. on Imag. Proc. 1998.
30. Gong Y., Sin L.T., Chuan C.H., Zhang H., Sakauchi M. Automatic parsing of TV soccer programs. IEEE Int'l Conf. on Multimedia Computing and Systems 1995, 167-174.
31. Yeung M., Yeo B.-L., Wolf W., Liu B. Video browsing using clustering and scene transitions on compressed sequences. Proc. of Multimedia Computing and Networking, SPIE 1995, vol. 2417.
32. Irani M., Anandan P. Video indexing based on mosaic representations. Proceedings of IEEE May 1998, vol. 86:905-921.
33. Li Y., Kuo C.-C.J. A robust video scene extraction approach to movie content abstraction. International Journal of Imaging Systems and Technology 2004, vol. 13(no. 5):236-244.
34. Yeung M., Yeo B.L., Liu B. Extracting story units from long programs for video browsing and navigation. Proc. IEEE Conf. on Multimedia Computing and Systems 1996.
35. Zhang H.J., Gong Y., Smoliar S.W., Tan S.Y. Automatic parsing of news video. Proc. IEEE Conf. on Multimedia Computing and Systems 1994, 45-54.
36. Aigrain P., Joly P., Longueville V. Medium knowledge based macro segmentation of video into sequences. IJCAI Workshop on Intelligent Multimedia Information Retreival 1995, 5-14.
37. Aoki H., Shimotsuji S., Hori O. A shot classification method of selecting effective key frames for video browsing. Proc. ACM Conf. on Multimedia 1995.
38. Zhang H.J., Wang Y.A., Altunbasak Y. Content based video retrieval and compression: A unified solution. Proc. IEEE Int'l Conf. on Image Processing 1997.
39. Swain M.J., Ballard D.H. Color indexing. International Journal of Computer Vision 1991, vol. 7:11-32.
40. Bouman C.A. Cluster: An unsupervised algorithm for modeling Gaussian mixtures. Technical report Oct. 2001, Retrieved fro http, School of Electrical Engineering, Purdue University. http://dynamo.ecn.purdue.edu/~bouman/software/cluster.
41. Rissanen J. A universal prior for integers and estimation by minimum description length. Annals of Statistics 1983, vol. 11(no. 2):417-431.
42. Xiong Z., Radhakrishnan R., Divakaran A., Huang T.S. Audio-based high-lights extraction from baseball, golf and soccer games in a unified framework. Proc. Int'l Conf. on Acoustic, Speech, and Signal Processing 2003, vol. 5:628-631.
43. Young S., Evermann G., Kershaw D., Moore G., Odell J., et al. The HTK BOOK VERSION 3.2 2003, Cambridge University Press, Cambridge.
44. Xiong Z., Radhakrishnan R., Divakaran A., Huang T.S. Audio-visual sports highlights extraction using coupled hidden Markov models. Pattern Analysis and Application Journal 2005, vol. 8.
45. Viola P., Jones M. Robust real-time object detection. International Journal of Computer Vision May 2004, vol. 57(no. 2):137-154.
46. Nefian A.V., et al. A coupled HMM for audio-visual speech recognition. Proc. Int'l Conf. on Acoustics, Speech, and Signal Processing 2002, vol. 2:2013-2016.
47. Brand M., Oliver N., Pentland A. Coupled hidden Markov models for complex action recognition. Proc. Conf. on Computer Vision and Pattern Recognition June 1997, 994-999.
48. Peker K.A., Cabasson R., Divakaran A. Rapid generation of sports highlights using the mpeg-7 motion activity descriptor. Proc. SPIE Conf. on Storage and Retrieval from Media Databases 2002, vol. 4676:318-323.
49. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE Feb. 1989, vol. 77(no. 2):257-286.
50. Xiong Z., Rui Y., Radhakrishnan R., Divakaran A., Huang T.S. Handbook of Image & Video Processing, A Unified Framework for Video Summarization, Browsing, and Retrieval 2005, Academic Press. 2nd ed.
51. Jagadish H.V., Koudas N., Muthukrishnan S. Mining deviants in time series database. Proc. 25th Int'l Conf. on Very Large Databases 1999, 102-113.
52. Muthukrishnan S., Shan R., Vitter J.S. Mining deviants in time series data streams. Proc. 16th Int'l Conf. on Scientific and Statistical Database Management June 2004.
53. Dasgupta D., Forrest S. Novelty detection in time series using ideas from immunology. Proc. Int'l Conf. on Intelligent Systems 1999.
54. Ma J., Perkins S. Online novelty detection on temporal sequences. Proc. Int'l Conf. on Data Mining 2003.
55. Shahabi C., Tian X., Zhao W. Tsa-tree: A wavelet based approach to improve efficiency of multi-level surprise and trend queries. Proc. Int'l Conf. on Scientific and Statistical Database Management 2000.
56. Chakrabarti S., Sarawagi S., Dom B. Mining surprising patterns using temporal description length. Proc. 24th Int'l Conf. on Very Large Databases 1998, 606-618.
57. Brutlag J.D. Aberrant behavior detection in time series for network service monitoring. Proc. 14th System Administration Conf. 2000, 139-146.
58. Keogh E., Lonardi S., Chiu W. Finding surprising patterns in time service monitoring. Proc. 14th System Administration Conf. 2000, 139-146.
59. Keogh E., Lonardi S., Chiu W. Finding surprising patterns in time series database in linear time space. Proc. 8th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining 2002, 550-556.
60. Shi J., Malik J. Normalized cuts and image segmentation. Proc. of IEEE Conf. on Computer Vision and Pattern Recognition 1997.
61. Perona R., Freeman W. A factorization approach to grouping. Proc. of the 5th European Conf. on Computer Vision 1998, vol. 1:655-670.
62. Wand M.P., Jones M.C. Kernel Smoothing 1985, Chapman & Hall, London.
63. Sheather S.J., Jones M.C. Kernel Smoothing 1995, Chapman & Hall, London.
64. Sheather S.J., Jones M.C. A reliable data-based bandwidth selection method for kernel density estimation. J. R. Statist. Society 1991.
65. Rabiner L., Juang B.-H. Fundamentals of Speech Recognition 1993, Prentice Hall, Upper Saddle River, NJ. 1st ed.
66. Aner A., Kender J.R. Video summaries through mosaic-based shot and scene clustering. Proc. European Conference on Computer Vision 2002.
67. Radhakrishnan R., Otsuka I., Xiong Z., Divakaran A. Modelling sports high-lights using a time series clustering frameworkd & model interpretation. Proc. of SPIE 2005.
68. Poritz A. Linear predictive hidden Markov models and the speech signal. Proc. of ICASSP 1982.
69. Porikli F.M., Haga T. Event detection by eigenvector decomposition using object and frame features. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition June 2004.
70. Introduction to MPEG-7 2003, Wiley, Hoboken, NJ. T. Sikora, B.S. Manjunath, P. Salembier (Eds.).
71. Akutsu, et al. Video indexing using motion vectors. Proc. Visual Communications and Image Processing, SPIE 1992, vol. 1818:1522-1530.
72. Ardizzone E., et al. Video indexing using mpeg motion compensation vectors. Proc. IEEE Int'l Conf. on Multimedia Computing and Systems 1999.
73. Davis J.W. Recognizing movement using motion histograms. Tech. Rep. 487 April 1998, MIT Media Laboratory Preceptual Computing Section.
74. Dimitrova N., Golshani F. Motion recovery for video content analysis. ACM Trans. Information Systems Oct. 1995, vol. 13(No. 4):408-439.
75. Lin K.-I., Kobla V., Doermann D., Faloutsous C. Compressed domain video indexing techniques using dct and motion vector information in mpeg video. Proc. SPIE Conf. on Storage and Retrieval for Image and Video Databases V 1997, vol. 3022:200-211.
76. Sahouria E. Video indexing based on object motion. M.S. thesis 1999, UC Berkeley, Dept. of EECS.
77. Kulkarni S.R., Tan Y.P., Ramadge P.J. Rapid estimation of camera motion from compressed video with application to video annotation. IEEE Trans. on Circuits and Systems for Video Technology Feb. 2000, vol. 10(no. 1):133-146.
78. Tse Y.T., Baker R.L. Camera zoom/pan estimation and compensation for video compression. Proc. SPIE Conf. on Image Processing Algorithms and Techniques II 1991, 479-489.
79. Wolf W. Key frame selection by motion analysis. Proc. ICASSP 1996, 1228-1231.
80. Meng H.J., Sundaram H., Zhong D., Chang S.F., Chen W. A fully automated content-based video search engine supporting multi-objects spatio-temporal queries. IEEE Transactions on Circuit and Systems for Video Technology Sep. 1998, vol. 8(no. 5):602-615.
81. Petkovic D., Niblack W., Ponceleon D.B. Updates to the qbic system. Proc. IS & T SPIE, Storage and Retrieval for Image and Video Databases VI 1996, vol. 3312:150-161.
82. http://www.virage.com.Viragesystem.
83. http://www.qbic.almaden.ibm.com.QBIC.system.
84. http://www.ctr.columbia.edu/viedoq.VideoQ.system.
85. Kaneko T., Hori O. Results of spatio-temporal region ds core/validation experiment. ISO/IEC JTC1/SC29/WG11/MPEG99/M5414 Dec. 1999.
86. Mory B., Jeannin S. Video motion representation for improved content access. IEEE Transactions on Consumers Electronics Aug. 2000.
87. Asai K., Divakaran A., Vetro A., Nishikawa H. Video browsing system based on compressed domain feature extraction. IEEE Trans. Consumer Electronics Aug. 2000.
88. Salembier P., Llach J. Analysis of video sequences: Table of contents and index creation. Proc. Int'l Workshop on very low bit-rate video coding (VLBV'99) Oct. 1999, 52-56.
89. Mpeg-7 visual part of the xm 4.0. ISO/IEC MPEG99/W3068 Dec. 1999.
90. Jeannin S., Divakaran A. Mpeg-7 visual motion descriptors. IEEE Trans. on Circuits and Systems for Video Technology, special issue on MPEG-7 June 2001, vol. 11(no. 6).
91. Divakaran A., Peker K. Video summarization using motion descriptors. Proc. SPIE Conf. on Storage and Retrieval from Multimedia Databases Jan. 2001.
92. Divakaran A., Peker K., Sun H. Constant pace skimming and temporal subsampling of video using motion activity. Proc. ICIP 2001.
93. Rui Y., Huang T.S., Ortega M., Mehrotra S. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. on Circuits and Systems for Video Technology, special issue on segmentation, description, and retrieval of video content Sep. 1998, vol. 8:644-655.
94. Tong S., Chang E.Y. Support vector machine active learning for image retrieval. ACM Int'l Conf. on Multimedia Oct. 2001, 107-118.
95. Naphade M., Huang T.S. A probabilitic framework for semantic video indexing, filtering and retrieval. IEEE Transactions on Multimedia March 2001, vol. 3(no. 1):141-151.
96. Casey M. Mpeg-7 sound-recognition tools. IEEE Transactions on Circuits and Systems for Video Technology June 2001, vol. 11(no. 6):737-747.
97. Smith J.R., Naphade M.R., Natsev A. Multimedia semantic indexing using model vectors. Proc. IEEE Int'l Conf. on Multimedia & Expo (ICME) July 2003.
98. Chaisorn L., Chua T.-S., Lee C.-H., Tian Q. Hierarchical approch to story segmentation of large brodcast news video corpus. Proc. IEEE Int'l Conf. on Multimedia & Expo (ICME) June 2004.
99. Rui Y., Huang T.S., Mehrotra S. Consturcting table-of-content for videos. Journal of Multimedia Sys. Sep. 1999, vol. 7:359-368.
100. Ngo C.-W., Velivelli A., Huang T.S. Detection of documentary scene changes using audio-visual fusion. Int'l Conf. on Image and Video Retrival July 2003.
101. Sundaram H., Chang S. Audio scene segmentation using multiple models, features and time scales. IEEE Int'l Conf. on Acoustics, Speech, and Signal Precessing June 2000.
102. Ngo C.-W. Analysis of spatio-temporal slices for video content representation. Ph.D. Dissertation 2000, Hong Kong University of Science and Technology.
103. Rui Y., Huang T.S., Mehrotra S. Content-based image retrieval with relevance feedback in MARS. Proc. IEEE Int'l Conf. on Image Proc. 1997.
104. Schmidt J.A. Object and camera parameter estimation using mpeg motion vectors. M.S. Thesis 1998, University of Illinois at Urbana-champaign.
105. Rui Y., Huang T.S., Chang S.-F. Image retrieval: Current techniques, promising directions and open issues. Journal of Visual Communication and Image Representation 1999, vol. 10-4:39-62.
106. Kudhinsky A., Pering C., Creech M.L., Freeze D., Serra B., Gyvizdka J. FotoFile: A consumer multimedia organization and retrieval system. Proceedings of CHI'99 1999, 496-503.
107. Wactlar H.D., Kanadeand T., Smith M.A., Stenvens S.M. Intelligence access to digital video: Informedia project. IEEE Computer 1996, vol. 29-5:46-52.
108. Rowley H., Baluja S., Kanade T. Neural network-based face detection. IEEE Patt. Anal. Mach. Intell. 1998, vol. 20:22-38.
109. ACLU http://archive.aclu.org/features/f110101a.html.
110. Russell S., Norvig P. Artificial Interlligence: A Modern Approach 1995, Prentice Hall, Upper Saddle River, NJ. 2nd ed.
111. * tree-search algorithm: A best-first proof procedure. Artificial Intelligence 1979, vol. 12(no. 1):23-40.
112. Frey B. Graphical Models for Machine Learning and Digital Communication 1998, MIT Press, Cambridge.