Hierarchical video content description and summarization using unified semantic and visual similarity

Multimedia Systems

Volumn 9, Issue 1, 2003, Pages 31-53

  Zhu, Xingquan ^a   Fan, Jianping ^b   Elmagarmid, Ahmed K ^c   Wu, Xindong ^a  

^a University of Vermont   (United States)

^b University of North Carolina at Charlotte   (United States)

^c Purdue University   (United States)

Author keywords

Content description; Hierarchical video summarization; Semi automatic video annotation; Video grouping

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); DATA ACQUISITION; DATABASE SYSTEMS; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL; MULTIMEDIA SYSTEMS; SEMANTICS;

AUDIO SIGNAL PROCESSING; CONTENT DESCRIPTION; HIERARCHICAL VIDEO SUMMARIZATION; SEMI-AUTOMATIC VIDEO ANNOTATION; VIDEO GROUPING;

VIDEO SIGNAL PROCESSING;

EID: 1442333048     PISSN: 09424962     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00530-003-0076-5     Document Type: Article

References (58)

1. Zhang H, Kantankanhalli A, Smoliar S (1993) Automatic partitioning of full-motion video. ACM Multimedia Syst 1(1): 10-28
2. Zhang H, Low CY, Smoliar SW, Wu J (1995) Video parsing, retrieval and browsing: an integrated and content-based solution. Proceedings ACM Conference on Multimedia, San Francisco, CA
3. Yeung M, Yeo B (197) Video visualization for compact presentation and fast browsing of pictorial content. IEEE Trans CSVT 7:771-785
4. Pfeiffer S, Lienhart R, Fischer S, Effelsberg W (1996) Abstracting digital movies automatically. VCIP 7(4):345-353
5. Doulamis N, Doulamis A, Avrithis Y, Ntalianis K, Kollias S (2000) Efficient summarization of stereoscopic video sequences. IEEE Trans CSVT 10(4): 501-517
6. DeMenthon D, Kobla V, Doermann D (1998) Video summarization by curve simplification. Proceedings ACM Conference on Multimedia. Bristol, UK, pp 13-16
7. Uchihashi S, Foote J, Girgensohn A, Boreczky J (1999) Video Managa: generating semantically meaningful video summaries. Proceedings ACM Conference on Multimedia, Orlando, FL pp 383-392
8. He L, Sanocki W, Gupta A, Grudin J (1999) Auto-summarization of audio-video presentations. Proceedings of ACM Conference on Multimedia. Orlando, FL pp 489-498
9. Ratakonda K, Sezan M, Crinon R (1999) Hierarchical video summarization. IS&T/SPIE Conference on Visual Communications and Image Processing'99, San Jose, CA 3653:1531-1541
10. Kim C, Hwang J (2000) An integrated scheme for object-based video abstraction. Proceedings of ACM Conference on Multimedia Los Angeles, CA pp 303-311
11. Nam J, Tewfik A (1999) Dynamic video summarization and visualization. Proceedings of ACM International Conference on Multimedia, Orlando, FL
12. Lienhart R (1999) Abstracting home video automatically. Proceedings ACM Multimedia Conference, Orlando, FL, pp 37-40
13. Christel M, Hauptmann A, Warmack A, Crosby S (1999) Adjustable filmstrips and skims as abstractions for a digital video library. IEEE Advances in Digital Libraries Conference, MD, USA
14. Lienhart R, Pfeiffer S, Wffelsberg W (1997) Video abstracting. Commun ACM 40(12)
15. Christel M (1999) Visual digest for news video libraries. Proceedings ACM Multimedia Conference, Orlando, FL
16. Nack F, Windhouwer M, Hardman L, Pauwels E, Huijberts M (2001) The role of highlevel and lowlevel features in style-based retrieval and generation of multimedia presentation. New Review of Mypermedia and Multimedia (NRHM) 2001
17. Venkatesh S, Dorai C (2001) Bridging the semantic gap in content management systems: Computational medial aestetics. Proceedings of COSIGN, Amsterdam, pp 94-99
18. Windhouwer M, Schmidt R, Kersten M (1999) Acoi: A system for indexing multimedia objects. International Workshop on Information Integration and Web-based Applications & Services, Indonesia
19. Smoliar S, Zhang H (1994) Content based video indexing and retrieval. IEEE Multimedia 1(2):62-72
20. Brunelli R, Mich O, Modena C (1996) A survey on video indexing. IRST-technical report
21. Zhong D, Zhang H, Chang S (1997) Clustering methods for video browsing and annotation. Technical report, Columbia University, NJ
22. Satoh S, Nakamura Y, Kanade T (1999) Name-it: Naming and detecting faces in News video. IEEE Multimedia 6(1): 22-35
23. Girgensohn A, Foote J (1999) Video classification using transform coefficients. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Phoenix, AZ 6:3045-3048
24. Dimitrova N, Elenbaas H, McGee T, Leyvi E, Agnihotri L (2000) An architecture for video content filtering in consumer domain. International Conference on Information Technololgy: Coding and computing (ITCC'00), Las Vegas, NV
25. Zhou W, Vellaikal A, Kuo CCJ (2001) Rule-based video classification system for basketball video indexing. Proceedings of ACM International Conference on Multimedia, Los Angeles, CA
26. Haering N, Qian R, Sezan M (1999) Detecting hunts in wildlife videos. Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume I, Florence, Italy
27. Aguierre Smith T, Davenport G (1992) The Stratification System: A design environment for random access video. Third International Workshop on Network and Operating System Support for Digital Audio and Video, La Jolla, CA, pp 250-261
28. Weiss R, Duda A, Gifford D (1994) Content-based access to algebraic video. IEEE International Conference on Multimedia Computing and Systems, Boston, MA, pp 140-151
29. Davenport G, Murtaugh M (1995) Context: towards the evolving documentary. Proceedings of ACM Multimedia Conference, San Francisco, CA
30. Davis M (1993) Media streams: An iconic visual language for video annotation. IEEE Symposium on Visual Language, pp 196-202
31. Petkovic M, Jonker W (2000) An overview of data models and query languages for content-based video retrieval. International Conference on Advances in Infrastructure for Electronic Business, Science, and Education on the Internet, Italy
32. Kender J, Yeo B (1998) Video scene segmentation via continuous video coherence. Proceedings of CVPR, Santa Barbara, CA
33. Jiang H, Montesi D, Elmagarmid AK (1997) Video text database systems. Proceedings of IEEE Multimedia Systems, Ottawa, Canada
34. Ponceleon D, Dieberger A (2001) Hierarchical brushing in a collection of video data. Proceedings of the 34th Hawaii International Conference on System Sciences, Maui, HI
35. Luke S, Spector L, Rager D (1996) Ontology-based knowledge discovery on the world-wide web. Proceedings of the Workshop on Internet-based Information Systems, AAAI-96, Portland, OR
36. Miller G (1995) Wordnet: A lexical database for English. Commun ACM 38(11)
37. Mena E, Keshyap V, Illarramendi A, Sheth A (1998) Domain specific ontologies for semantic information brokering on the global information infrastructure. Proceedings of FOIS'98, Trento, Italy
38. Bloch G (1988) From concepts to film sequences. Proceedings of RIAO, Cambridge, MA, pp 760-767
39. Parkes A (1992) Computer-controlled video for intelligent interactive use: a description methodology. In: ADN Edwards, S Holland (eds) Multimedia Interface Design in Education. New York
40. Rui Y, Huang T, Mehrotra S (1999) Constructing table-of-content for video. ACM Multimedia Syst J 7(5) 359-368
41. Aref W, Elmagarmid A, Fan J, Guo J, Hammad M, Ilyas I, Marzouk M, Prabhakar S, Rezgui A, Teoh A, Terzi E, Tu Y, Vakali A, Zhu X (2002) A distributed database server for continuous media. Proceedings of IEEE 18th ICDE demonstration, San Jose, CA
42. Yeo B, Liu B (1995) Rapid scene analysis on compressed video. IEEE Trans CSVT 5(6)
43. Fan J, Aref W, Elmagarmid A, Hacid M, Marzouk M, Zhu X (2001) MultiView: Multilevel video content representation and retrieval. J Electr Imag 10(4):895-908
44. Yeung M, Yeo B (1996)Time-constrained clustering for segmentation of video into story units. Proceedings of ICPR'96, Vienna, Austria
45. Lin T, Zhang H (2000) Automatic video scene extraction by shot grouping. Proceedings of ICPR 2000, Barcelona, Spain
46. Fan J, Yu J, Fujita G, Onoye T, Wu L, Shirakawa I (2001) Spatiotemporal segmentation for compact video representation. Signal Process: Image Commun 16:553-566
47. Zhu X, Liu W, Zhang H, Wu L (2001) An image retrieval and semi-automatic annotation scheme for large image databases on the Web. IS&T/ 4311:168-177
48. Lu Y, Hu C, Zhu X, Zhang H, Yang Q (2000) A unified semantics and feature based image retrieval technique using relevance feedback. Proceedings of ACM Multimedia Conference, Los Angeles, CA, pp 31-37
49. Zhu X, Zhang H, Liu W, Hu C, Wu L (2001) A new query refinement and semantics integrated image retrieval system with semi-automatic annotation scheme. J Electr Imag - Special Issue on Storage, Processing and Retrieval of Digital Media 10 (4):850-860
50. Vasconcelos N, Lippman A (1998) A Bayesian framework for content-based indexing and retrieval. Proceedings of DCC'98, Snowbird, UT
51. Fan J, Zhu X, Wu L (2001) Automatic model-based semantic object extraction algorithm. IEEE Trans Circuits and Systems for Video Technology 11(10)10: 1073-1084
52. Zhu X, Fan J, Elmagarmid A, Aref W (2002) Hierarchical video summarization for medical data. SPIE: Storage and Retrieval for Media Databases 4676:395-406
53. Hjelsvold R, Midtstraum R (1994) Modelling and querying video data. Proceedings of VLDB Conference, Santiago de Chile, Chile
54. Schreiber ATh, Dubbeldam B, Wielemaker J, Wielinga B (2001) Ontology-based photo annotation. IEEE Intell Syst 16(3):66-74
55. Gruber T (1992) Ontolingua: A mechanism to support portable ontologies. Technical Report KSL-91-66, Knowledge Systems Laboratory, Stanford University, Palo Alto, CA
56. Voorhees E (1994) Query expansion using lexical-semantic relations. Proceedings 17th International Conference on Research and Development in Information Retrieval (ACM SIGIR), Dublin, Ireland, pp 61-69
57. Zhu X, Wu X (2003) Mining video associations for efficient database management. Proceedings of 18th IJCAI, Acapulco, Mexico
58. Zhu X, Wu X (2003) Sequential association mining for video summarization. Proceedings of ICME, Baltimore, MD