InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval

IEEE Transactions on Multimedia

Volumn 7, Issue 4, 2005, Pages 648-666

  Zhu, Xingquan ^a   Elmagarmid, Ahmed K ^b   Xue, Xiangyang ^c   Wu, Lide ^c   Catlin, Ann Christine ^b  

^a University of Vermont   (United States)

^b Purdue University   (United States)

^c FUDAN UNIVERSITY   (China)

Author keywords

Video browsing; Video content organization; Video retrieval; Video similarity assessment

Indexed keywords

ALGORITHMS; HIERARCHICAL SYSTEMS; VIDEO SIGNAL PROCESSING;

VIDEO BROWSING; VIDEO CONTENT ORGANIZATION; VIDEO RETRIEVAL; VIDEO SIMILARITY ASSESSMENT;

IMAGE RETRIEVAL;

EID: 24944491051     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2005.850977     Document Type: Article

References (59)

1. H. J. Zhang, A. Kantankanhalli, and S. W. Smoliar, "Automatic partitioning of full-motion video," ACM Multimedia Syst., vol. 1, no. 1, 1993.
2. H. J. Zhang, C. Y. Low, S. W. Smoliar, and D. Zhong, "Video parsing, retrieval and browsing: an integrated and content-based solution," in Proc. ACM Multimedia Conf., San Francisco, CA, 1995.
3. M. M. Yeung and B.-L. Yeo, "Video visualization for compact presentation and fast browsing of pictorial content," IEEE Trans. Circuits Syst. Video Technol., vol. 7, pp. 771-785, 1997.
4. J. R. Smith, "VideoZoom spatio-temporal video browser," IEEE Trans. Multimedia, vol. 1, no. Jun., pp. 157-171, 1999.
5. Y. A. Aslandogan and C. T. Yu, "Techniques and systems for image and video retrieval," IEEE Trans. Knowl. Data Eng., vol. 11, no. 1, pp. 56-63, Jan. 1999.
6. H. Wactlar, "Informedia - Search and summarization in the video medium," in Proc. Imagina Conf., Monaco, 2000.
7. S. F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "VideoQ: an automated content based video search system using visual cues," in Proc. ACM Multimedia Conf., Seattle, WA, 1997, pp. 313-324.
8. A. Hampapur, A. Gupta, B. Horowitz, C.-F. Shu, C. Fuller, J. Bach, M. Gorkani, and R. Jain, "Virage video engine," in Proc. SPIE, vol. 3022, San Jose, CA, 1997.
9. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: content-based manipulation of image database," Int. J. Comput. Vis., vol. 18, pp. 233-254, 1996.
10. J. R. Smith and S. F. Chang, "VisualSEEk: a fully automated content-based image query system," in Proc. ACM Multimedia Conf., Boston, MA, 1996, pp. 87-98.
11. V. E. Ogle and M. Stonebraker, "Chabot: Retrieval from a relational database of image," Computer, vol. 28, no. 9, pp. 40-48, Sep. 1995.
12. C. Faloutsos, W. Equitz, M. Flickner, W. Niblack, S. Petkovic, and R. Barber, "Efficient and effective querying by image content," J. Intell. Inf. Syst., vol. 3, pp. 231-262, 1994.
13. H. Jiang and A. Elmagarmid, "WVTDB-A semantic content-based video database system on the world wide web," IEEE Trans. Knowl. Data Eng., vol. 10, no. 6, pp. 947-966, Nov. 1998.
14. A. Elmagarmid et al., Video Data Bases: Issues, Products and Applications. Norwell, MA: Kluwer, Mar. 1997.
15. S. F. Chang, J. Smith, and J. Meng, "Efficient techniques for feature based image/video access and manipulation," in Proc. 33rd Ann. Clinic on Library Application of Data Processing Image Access and Retrieval, Urbana-Champaign, IL, Mar. 1996.
16. M. La Cascia and E. Ardizzone, "JACOB: Just a content-based query system for video database," in Proc. ICASSP, Atlanta, GA, 1996.
17. J. R. Smith and S. F. Chang, "Searching for Images and Video on the World-Wide Web," Columbia Univ., New York, CTR Tech. Rep. 459-96-25, Aut. 1996.
18. D. W. Howard, K. Takeo, A. S. Michael, and M. S. Scott, "Intelligent access to digital video: informedia project," IEEE Computer, vol. 29, no. 5, pp. 46-52, May 1996.
19. B. L. Yeo and B. D. Liu, "Rapid scene analysis on compressed video," IEEE Trans. Circuits Syst. Video Technol., vol. 5, no. 6, pp. 533-544, Dec. 1995.
20. J. Fan, W. Aref, A. Elmagarmid, M. Hacid, M. Marzouk, and X. Zhu, "MultiView: multilevel video content representation and retrieval," J. Elect. Imaging, vol. 10, no. 4, pp. 895-908, Oct. 2001.
21. R. Szeliski, "Video mosaics for virtual environments," IEEE Comput. Graph. Appl., vol. 16, no. 2, pp. 22-30, Mar. 1996.
22. C. W. Ngo, T. C. Pong, H. J. Zhang, and R. T. Chin, "Motion characterization by temporal slice analysis," in Proc. Computer Vision and Pattern Recognition, vol. 2, Hilton Head, SC, 2000, pp. 768-773.
23. W. Xiong and J. C.-M. Lee, "Efficient scene change detection and camera motion annotation for video classification," Comput. Vis. Image Understanding, vol. 71, pp. 166-181, 1998.
24. M. V. Srinivasan, S. Venkatesh, and R. Hosie, "Qualitative estimation of camera motion parameters from video sequences," Pattern Recognit., vol. 30, no. 4, pp. 593-606, Apr. 1997.
25. R. C. Jain, "Direct computation of the focus of expansion," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, no. 1, pp. 58-64, Jan. 1983.
26. Y. P. Tan, D. D. Saur, S. R. Kulkami, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, Feb. 2000.
27. V. Kobla, D. S. Doermann, and A. Rosenfeld, "Compressed Domain Video Segmentation", CfAR Tech. Rep. CAR-TR-839 (CS-TR-3688), 1996.
28. C. Dorai and V. Kobla, "Perceived visual motion descriptors from MPEG-2 for content-based HDTV annotation and retrieval," in Proc. IEEE 3rd Workshop on Multimedia Signal Processing, Copenhagen, Denmark, 1999, pp. 147-152.
29. A. Hanjalic and H. J. Zhang, "An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 8, pp. 1280-1289, Dec. 1999.
30. H. J. Zhang, J. Wu, D. Zhong, and S. W. Smoliar, "An integrated system for content-based video retrieval and browsing," Pattern Recognit., vol. 30, no. 4, pp. 643-658, Apr. 1997.
31. Y. Zhang, Y. Rui, T. S. Huang, and S. Mehrotra, "Adaptive key frame extraction using unsupervised clustering," in Proc. ICIP, vol. 1, Chicago, IL, 1998, pp. 866-870.
32. W. Wolf, "Key frame selection by motion analysis," in Proc. IEEE ICASSP, Atlanta, GA, 1996, pp. 1228-1231.
33. A. Pentland, R. Picard, G. Davenport, and K. Haase, "Video and image semantics: advanced tools for telecommunications," IEEE Multimedia Mag., vol. 1, no. 2, pp. 73-75, Jun. 1994.
34. Y. Avrithis, N. Doulamis, A. Doulamis, and S. Kollias, "Efficient content representation in MPEG video database," in Proc. IEEE Workshop on Content Based Access of Image and Video Database, Santa Barbara, CA, 1998, pp. 91-95.
35. B. Shahraray and D. C. Gibbon, "Automatic generation of pictoral transcripts of video programs," in Proc. IS&T/SPIE Digital Video Compression: Algorithms and Technologies, San Jose, CA, 1995, pp. 512-519.
36. T. Lin and H. J. Zhang, "Automatic video scene extraction by shot grouping," in Proc. ICPR, Barcelona, Spain, 2000.
37. Y. Rui, T. Huang, and S. Mehrotra, "Constructing table-of-content for video," ACM Multimedia Syst. J., Special Issue Multimedia Systems on Video Libraries, vol. 7, no. 5, pp. 359-368, Sep. 1999.
38. M. M. Yeung and B. L. Yeo, "Time-constrained clustering for segmentation of video into story units," in Proc. ICPR'96, Vienna, Austria, 1996.
39. W. Zhou, A. Vellaikal, and C. J. Kuo, "Rule-based video classification system for basketball video indexing," in Proc. ACM Multimedia Conference Workshop, Los Angeles, CA, 2001.
40. D. Swanberg, C. F. Shu, and R. Jain, "Knowledge-guided parsing in video database," in Proc. IS&T/SPIE Storage and Retrieval for Image and Video Databases II, San Jose, CA, 1993, pp. 13-24.
41. X. Zhu, L. Wu, X. Xue, X. Lu, and J. Fan, "Automatic scene detection in news program by integrating visual feature and rules," in Proc. 2nd IEEE PCM Conf., LNCS2195, Beijing, China, 2001, pp. 837-842.
42. D. Zhong, H. J. Zhang, and S. F. Chang, "Clustering Methods for Video Browsing and Annotation," Columbia Univ., New York, Tech. Rep., 1997.
43. D. A. Adjeroh, M. C. Lee, and I. King, "A distance measure for video sequence similarity matching," in Proc. Int. Workshop on Multimedia Database Management Systems, Dayton, OH, 1998.
44. N. Dimitrova and M. Abdel-Mottaled, "Content based video retrieval by example video clip," in Proc. SPIE, vol. 3022, San Jose, CA, 1998.
45. R. Lienhart, W. Effelsberg, and R. Jain, "VisualGREP: a systematic method to compare and retrieval video sequences," in Proc. SPIE, vol. 3312, San Jose, CA, 1997, pp. 271-282.
46. L. Zhao, W. Qi, S. Z. Li, S. Yang, and H. Zhang, "Key-frame extraction and shot retrieval using Nearest Feature Line (NFL)," in Proc. ACM Multimedia Conference Workshops, Los Angeles, CA, 2000, pp. 217-220.
47. S. Li and J. Liu, "Face recognition based on nearest linear combinations," IEEE Trans. Neural Netw., vol. 10, no. 2, pp. 439-443, Mar. 1999.
48. X. Liu, Y. Zhuang, and Y. Pan, "A new approach to retrieve video by example video clip," in Proc. ACM Multimedia Conf, Orlando, FL, 1999, pp. 41-44.
49. A. K. Jain, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1998.
50. A. Hauptmann and M. Witbrock, "Story segmentation and detection of commercials in broadcast news video," in ADL-98 Advances in Digital Libraries Conf, Santa Barbara, CA, Apr. 22-24, 1998.
51. C. Ngo, T. Pong, and H. Zhang, "On clustering and retrieval of video shots," in Proc. 9th ACM Multimedia Conf., Ottawa, ON, Canada, 2001, pp. 51-60.
52. J. Fan, J. Yu, G. Fujita, T. Onoye, L. Wu, and I. Shirakawa, "Spatiotemporal segmentation for compact video representation," Signal Processing: Image Commun., vol. 16, pp. 553-566, 2001.
53. E. Ardizzone, M. Cascia, A. Avanzato, and A. Bruna, "Video indexing using MPEG motion compensation vectors," in Proc. IEEE Conf. on Multimedia Computing and Systems, Florence, Italy, 1999.
54. A. Divakaran, R. Radhakrishnan, and K. Peker, "Motion activity-based extraction of key-frame from video shots," in Proc. IEEE ICIP Conf., Rochester, NY, 2002.
55. _, "Video summarization using descriptors of motion activity: a motion activity based approach to key-frame extraction from video shots," J. Electron. Imag., vol. 10, no. 4, pp. 909-916, 2001.
56. M. Lazarescu, S. Venkatesh, and G. West, "On the automatic indexing for cricket using camera motion parameters," in Proc. IEEE ICME Conf., Laussane, Switzerland, 2002.
57. S. Jeannin and A. Divakaran, "MPEG-7 visual motion descriptor," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 720-724, Jun. 2001.
58. B. S. Manjunath, P. Salembier, and T. Sikora, Introduction to MPEG-7: Multimedia Content Description Interface. New York: Wiley, Jun. 2002.
59. "The MPEG-7 visual part of the XM 4.0, ISO/IEC MPEG99/W3068", HI, Dec. 1999.