Survey on the automatic indexing of video data

Journal of Visual Communication and Image Representation

Volumn 10, Issue 2, 1999, Pages 78-112

  Brunelli, R ^a   Mich, O ^a   Modena, C M ^a  

^a ITC IRST   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; IMAGE PROCESSING; IMAGE SEGMENTATION; MULTIMEDIA SYSTEMS; VIDEO SIGNAL PROCESSING; VIDEODISKS;

IMAGE DATABASES; IMAGE INDEXING; IMAGE RETRIEVAL BY PICTORIAL CONTENT; VIDEO ANNOTATION; VIDEO DATA; VIDEO DATABASES; VIDEO INDEXING;

AUTOMATIC INDEXING;

EID: 0032657349     PISSN: 10473203     EISSN: None     Source Type: Journal    
DOI: 10.1006/jvci.1997.0404     Document Type: Article

References (111)

1. Adam N. R., Bhargava B. K. Digital Libraries. 1995.
2. Banfi F. Image Databases: State of the Art and Future Directions. September 1996.
3. Brink A., Marcus S., Subrahmanian V. S. Heterogeneous multimedia reasoning. Computer. September 1995;33-39.
4. G. Davenport, M. Murtaugh, ConText: Toward the evolving documentary, ACM Multimedia 95, San Francisco, CA, November 1995, 5, 8.
5. Fox E. A. Advances in interactive digital multimedia systems. Computer. October 1991;9-21.
6. Gemmell D. J., Vin H. M., Kandlur D. D., Rangan P. V., Rowe L. A. Multimedia storage servers: A tutorial. Computer. May 1995;40-49.
7. Jain R. InfoScopes: Multimedia Information Systems. 1995.
8. R. Jain, A. Pentland, D. Petkovic, Workshop Report: NFS-ARPA workshop on visual information management systems, Proceedings of the 5th ICCV, Cambridge, MA, 1995.
9. Moni S., Kashyap R. L. A multiresolution representation scheme for multimedia databases. Multimedia Systems. 3:1995;228-237.
10. Narasimhalu A. D. Multimedia databases. Multimedia Systems. 4:1996;226-249.
11. H. Nishiyama, S. Kin, T. Yokoyama, Y. Matsushita, An image retrieval system considering subjective perception, Proceedings of CHI '94, Boston, 1994, 4, 30, 36.
12. Rodriguez A. A., Rowe L. A. Multimedia systems and applications. Computer. May 1995;20-23.
13. Subrahmanian V. S., Jajodia S. Multimedia Database Systems. 1996.
14. Zhang H. J., Smoliar S. W., Wu J. H., Low C. Y., Kankanhalli A. A video database system for digital libraries. Advances in Digital Libraries, Lecture Notes in Computer Science. 1995.
15. Hampapur A., Jain R., Weymouth T. Digital video indexing in multimedia systems. Proceedings of the Workshop on Indexing and Reuse in Multimedia Systems, August 1994. 1994.
16. A. Hampapur, R. Jain, T. Weymouth, Feature based digital video indexing, Proceedings of IFIP 2.6 Third Working Conference on Visual Database Systems VDB.3, Lausanne, Switzerland, March 29-31, 1995.
17. Ahanger G., Benson D., Little T. D. C. Video Query Formulation. 1995.
18. Ahanger G., Little T. D. C. A survey of technologies for parsing and indexing digital video. J. Visual Commun. Image Rep. 7:1996;28-43.
19. C. Faloutsos, K. I. Lin, FastMap: A fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets, Proceedings of SIGMOD '95, 1995, 163, 174.
20. A. S. Gordon, E. A. Domeshek, Conceptual indexing for video retrieval, Proceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, August 1995.
21. T. Sikora, The MPEG-4 video standard and its potential for future multimedia applications, Proc. IEEE ISCAS Conference, Hong Kong, June 1997.
22. Flickner M., Sawhney H., Niblack W., Ashley J., Huang Q., Dom B., Gorkani M., Hafner J., Lee D., Petkovic D., Steele D., Yanker P. Query by image and video content: The QBIC systems. Computer. September 1995;23-32.
23. P. Kelly, M. Cannon, CANDID: Comparison algorithm for navigating digital image databases, Proceedings of the Seventh International Working Conference on Scientific and Statistical Database Management, Charlottesville, VA, September 1994, 252, 258.
24. P. Kelly, M. Cannon, Experience with CANDID: Comparison algorithm for navigating digital image databases, Proceedings SPIE of the 23rd AIPR Workshop On Image and Information Systems: Applications and Opportunities, Washington DC, October 12-14, 1994, 64, 75.
25. P. Kelly, M. Cannon, Query by image example: The CANDID approach, Proceedings of SPIE Storage and Retrieval for Image and Video Databases III, 1995, 2420, 238, 248.
26. I. K. Sethi, N. Patel, A statistical approach to scene change detection, Proceedings of SPIE Storage and Retrieval for Image and Video Databases III, San Josè, CA, 1995, 2420.
27. Zhang H. J., Kankanhalli A., Smoliar S. W. Automatic partitioning of full-motion video. Multimedia Systems. 1:1993;10-28.
28. Aigrain P., Joly O. The automatic real-time analysis of film editing and transition effects and its applications. Comput. & Graphics. 18:1994;93-103.
29. U. Gargi, S. Oswald, D. A. Kosiba, S. Devadiga, R. Kasturi, Evaluation of video sequence indexing and hierarchical video indexing, Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases III, 1995, 2420.
30. Gargi U., Kasturi R., Strayer S., Antani S. An Evaluation of Color Histogram Based Methods in Video Indexing. 1996.
31. J. M. Corridoni, A. Del Bimbo, Film semantic analysis, Proceedings of the International Conference on Analysis of Image Patterns, Prague, Czech Republic, September 1995.
32. Xiong W., Chung-Mong J., Ma R. H. Automatic video data structuring through shot partitioning and key-frame computing. Mach. Vision Appl. 10:1997;51-65.
33. Le Gall D. MPEG: A video compression standard for multimedia applications. Commun. ACM. 34:1991;46-58.
34. Zhang H. J., Low C. Y., Smoliar S. W. Video parsing and browsing using compressed data. Multimedia Tools Appl. 1:1995;91-113.
35. H.263: Video coding for low bit rate communication. March 1996.
36. J. Meng, Y. Juan, S.-F. Chang, Scene change detection in a MPEG compressed video sequence, Proceedings of the IS&T/SPIE Symposium on Electronic Imaging: Science & Technology, San Josè, CA, February 1995.
37. H. C. Liu, G. L. Zick, Automatic determination of scene changes in MPEG compressed video, Proc. of ISCAS-IEEE International Symposium on Circuits and Systems, 1995.
38. F. Arman, A. Hsu, M. Y. Chiu, Feature management for large video databases, Proceedings of SPIE Storage and Retrieval for Image and Video Databases, 1993, 2, 12.
39. E. Deardorff, T. D. C. Little, J. D. Marshall, D. Venkatesh, R. Walzer, Video scene decomposition with the motion picture parser, Proceedings of the IS&T/SPIE Symposium on Electronic Imaging Science and Technology (Digital Video Compression and Processing on Personal Computers: Algorithms and Technologies), San Josè, CA, February 1994, 2187, 44, 55.
40. Patel N. V., Sethi I. K. Video shot detection and characterization for video databases. Pattern Recognition - Special Issue on Multimedia. 30:1997;583-592.
41. E. Ardizzone, G. A. M. Gioiello, M. La Cascia, D. Molinelli, A real-time neural approach to scene cut detection, IS&T/SPIE - Storage & Retrieval for Image and Video Databases IV, San Josè, CA, January 28-February 2, 1996.
42. Yeo B.-L. Efficient Processing of Compressed Images and Video. January 1996.
43. K. Shen, E. J. Delp, A fast algorithm for video parsing using MPEG compressed sequences, Proc. of IEEE International Conference on Image Processing, October 1995, 252, 255.
44. Hampapur A., Jain R., Weymouth T. Production model based digital video segmentation. J. Multimedia Tools Appl. 1:1995;9-46.
45. A. Hampapur, R. Jain, T. Weymouth, Digital video segmentation, Proceedings Second Annual ACM MultiMedia Conference and Exposition, October 1994.
46. R. Zabih, J. Miller, K. Mai, A feature-based algorithm for detecting and classifying scene breaks, Proceedings of the Fourth ACM Conference on Multimedia, San Francisco, CA, November 1995.
47. Xiong W., Lee J. C.-M. Efficient scene change detection and camera motion annotation for video classification. Comput. Vision Image Understanding. 71:1998;166-181.
48. A. Dailianas, R. B. Allen, P. England, Comparisons of automatic video segmentation algorithms, Proceedings SPIE Photonics East'95: Integration Issues in Large Commercial Media Delivery System, Philadelphia, October 1995.
49. J. S. Boreczky, L. A. Rowe, A comparison of video shot boundary detection techniques, Storage & Retrieval for Image and Video Databases IV, I. K. SethiR. C. Jain, SPIE Proceedings Series, 2670, 170, 179.
50. Brunelli R., Poggio T. Template matching: Matched spatial filters and beyond. Pattern Recognition. 30:1997;751-768.
51. K. K. Sung, T. Poggio, Example-based learning for view-based human face detection, Proceedings Image Understanding Workshop, 1994.
52. M. S. Lew, N. Huijsmans, Information theory and face detection, Proceedings of ICPR, 1996, 601, 605.
53. Moghaddam B., Pentland A. Probabilistic visual learning for object representation. IEEE Trans. Pattern Anal. Mach. Intell. 19:1997;696-710.
54. E. Osuna, R. Freund, F. Girosi, Training support vector machines: An application to face detection, Proc. of CVPR'97, Puerto Rico, June 1997.
55. Wang H., Fu Chang S. A highly efficient system for automatic face region detection in MPEG video. IEEE Trans. Circuits Systems Video Technol. 7:1997;615-628.
56. Burel G., Carel D. Detection and localization of faces on digital images. Pattern Recognit. Lett. 15:1994;963-967.
57. H. A. Rowley, S. Baluja, T. Kanade, Neural network-based face detection, Image Understanding Workshop, February 1996, 725, 735.
58. T. Sato, T. Kanade, E. K. Hughes, M. A. Smith, S. Satoh, Video OCR: Indexing digital news libraries by recognition of superimposed caption, ACM Multimedia Systems, Special Issue on Video Libraries.
59. Y. Ariki, T. Teranishi, Indexing and classification of TV-news articles based on telop recognition, Fourth Int. Conf. on Document Analysis and Recognition, Ulm, Germany, August 1997, 422, 427.
60. A. K. Jain, B. Yu, Automatic text location in images and video frames, 14th Int. Conf. on Pattern Recognition, Brisbane, Australia, August 16-20, 1998.
61. Kim H.-K. Efficient automatic text location method and content-based indexing and structuring of video database. J. Visual Commun. Image Representation. 7:1996;336-344.
62. Lienhart R., Effelsberg W. Automatic Text Segmentation and Text Recognition for Video Indexing. 1998.
63. A. Takeshita, T. Inoue, K. Tanaka, Extracting text skim structures for multimedia browsing, Proceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, August 1995, M. Maybury.
64. V. Wu, R. Manmatha, E. M. Riseman, Finding text in images, 2nd ACM Int. Conf. on Digital Libraries, Philadelphia, PA, July 1997, 23, 26.
65. Messelodi S., Modena C. M. Automatic identification and skew estimation of text lines in real scene images. Pattern Recognit. 32:1999;789-808.
66. U. Gargi, R. Kasturi, S. Antani, Performance characterization and comparison of video indexing algorithms, Proc. of Computer Society Conference on Computer Vision and Pattern Recognition, 1998.
67. S. Sato, Y. Nakamura, T. Kanade, Name-it: Naming and detecting faces in video by the integration of image and natural language processing, Proc. of IJCAI-97, 1997.
68. Cedras C., Shah M. Motion-based recognition: A survey. Image Vision Comput. 13:1995;129-155.
69. J. Y. A. Wang, E. H. Adelson, Spatio-temporal segmentation of video data, Image and Video Processing II, Proceedings of the SPIE, San Josè, CA, February 1994, 2182.
70. J. Y. A. Wang, E. H. Adelson, U. Desai, Applying mid-level vision techniques for video data compression and manipulation, Digital Video Compression on Personal Computers: Algorithms and Technologies, Proceedings of the SPIE, San Josè, CA, February 1994, 2187.
71. Ayer S., Sawhney H. S. Layered Representation of Motion Video using Robust Maximum-Likelihood Estimation of Mixture Models and MDL Encoding. December 1994.
72. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, D. Zhong, VideoQ: An automated content based video search system using visual cues, Proceedings of the Fifth ACM Multimedia Conference, Seattle, November 1997.
73. H. S. Sawhney, S. Ayer, M. Gorkani, Model-based 2D & 3D dominant motion estimation for mosaicking and video representation, Proceedings of ICCV 95, Cambridge, MA, June 1995.
74. M. Bierling, Displacement estimation by hierarchical blockmatching, Proc. SPIE, Visual Communications and Image Processing '88, January 1988, 1001, 942, 951.
75. E. Sahouria, Video indexing based on object motion, Dept. of Electrical Engineering and Computer Science, University of California at Berkeley, 1998.
76. Hirzalla N., Karmouch A. Detecting cuts by understanding camera operation for video indexing. J. Visual Lang. Comput. 6:1995;385-404.
77. Smith M. A., Kanade T. Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques. February 1997;15213.
78. Joly P., Kim H.-K. Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images. Signal Process. Image Commun. 8:1996;295-307.
79. Park J., Lee C. W. Robust estimation of camera parameters from image sequence for video composition. Signal Process. Image Commun. 9:1996;43-53.
80. Dimitrova N., Golshani F. Motion recovery for video content classification. ACM Trans. Inform. Systems. 13:1995;408-439.
81. Ioka M., Kurokawa M. Estimation of motion vectors and their application to scene retrieval. Mach. Vision Appl. 7:1994;199-208.
82. S.-Y. Lee, H.-M. Kao, Video indexing - An approach based on moving object and track, Proceedings SPIE Storage and Retrieval for Image and Video Databases, 1993, 25, 36.
83. D. Zhong, S.-F. Chang, Video object model and segmentation for content-based video indexing, IEEE Intern. Conf. on Circuits and Systems, Hong Kong, June 1997.
84. E. Ardizzone, M. La Cascia, Video indexing using optical flow field, Int. Conf. on Image Processing, ICIP-96, Lausanne, Switzerland, September 16-19, 1996.
85. Y. Tonomura, A. Akutsu, K. Otsuji, T. Sadakata, VideoMAP and video spaceIcon: Tools for anatomizing video content, Proceedings of INTERCHI '93, ACM, April 24-29, 1993, 131, 136.
86. L. Teodosio, W. Bender, Salient stills from video, Proceedings of the ACM Multimedia '93 Conference, Anheim, CA, August 1993.
87. Sawhney H. S., Ayer S. Compact representations of video through dominant and multiple motion estimation. IEEE Trans. Pattern Anal. Mach. Intell. 18:1996.
88. D. Yow, B.-L. Yeo, M. Yeung, B. Liu, Analysis and presentation of soccer highlights from digital video, Proceedings of the Second Asian Conference on Computer Vision, December 1995.
89. Barron J. L., Fleet D. J., Beauchemin S. S. Performance of optical flow techniques. Int. J. Comput. Vision. 12:1994;43-77.
90. Yeung M. M., Liu B. Efficient Matching and Clustering of Video Shots. 1995.
91. H. J. Zhang, S. W. Smoliar, J. H. Wu, Content-based video browsing tools, Proceedings SPIE Conference on Multimedia Computing and Networking, San Josè, CA, February 1995.
92. W. Wolf, Key frame selection by motion analysis, Proceedings of ICASSP '96.
93. Liu X., Owen C. B., Makedon F. Automatic Video Pause Detection Filter. February 1997.
94. Yeo B., Liu B. Rapid scene analysis on compressed videos. IEEE Trans. Circuit Systems Video Technol. 5:1995;533-544.
95. B.-L. Yeo, B. Liu, A unified approach to temporal segmentation of motion JPEG and MPEG compressed video, Proceedings of the Second Internation Conference on Multimedia Computing and Systems, May 1995.
96. M. Yeung, B.-L. Yeo, B. Liu, Extracting story units from long programs, Proceedings of the International Conference on Multimedia Computing and Systems, June 1996.
97. M. M. Yeung, B.-L. Yeo, W. Wolf, B. Liu, Video browsing using clustering and scene transitions on compressed sequences, Proceedings of the IS&T/SPIE Multimedia Computing and Networking, San Josè, CA, February 1995.
98. H.-H. Yu, W. Wolf, Scenic classification methods for image and video databases, Proceedings of the ACM Multimedia '93 Conference, C.-C. J. Kuo, 2606, 1995, 363, 371.
99. Pfeiffer S., Lienhart R., Fisher S., Effelsberg W. Abstracting digital movies automatically. J. Visual Commun. Image Representation. 7:1996;345-353.
100. Devadiga S., Kosiba D. A., Gargi U., Oswald S., Kasturi R. A semiautomatic video database system. Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases III. 2420:1995.
101. S. Fischer, R. Lienhart, W. Effelsberg, Automatic recognition of film genres, Proc. ACM Multimedia 95, San Francisco, CA, November 1995, 295, 304.
102. Hawley M. K. Structure out of Sound. September 1993.
103. P. Aigrain, P. Joly, V. Longueville, Medium knowledge-based macrosegmentation of video into sequences, Proceedings IJCAI '95 Workshop on Intelligent Multimedia Information Retrieval, Montreal, Canada, August 1995, M. Maybury.
104. Zhang H. J., Tan S. Y., Smoliar S. W., Yihong G. Automatic parsing and indexing of news video. Multimedia Systems. 2:1995;256-266.
105. M. G. Christel, M. A. Smith, C. R. Taylor, D. B. Winkler, Evolving video skims into useful multimedia abstractions, Proc. of ACM CHI'98, Conference on Human Factors in Computing Systems, Los Angeles, CA, April 1998.
106. Y. Nakamura, T. Kanade, Semantic analysis for video contents extraction - Spotting by association in news video, Proc. of the Fifth ACM International Multimedia Conference, November 1997.
107. R. Lienhart, W. Effelsberg, R. Jain, VisualGREP: A systematic method to compare and retrieve video sequences, SPIE, Storage and Retrieval for Image and Video Databases VI, January 1998, 3312.
108. M. Caliani, C. Colombo, A. Del Bimbo, P. Pala, Commercial video retrieval by induced semantics, Proc. of IEEE Internation Workshop on Content-Based Access of Image and Video Databases (CAIVD8), Bombay, India, 1998.
109. Christel M., Martin D. Information visualization within a digital video library. J. Intell. Inform. Systems. 11:1998.
110. D. DeMenthon, V. Kobla, D. Doermann, Video summarization by curve simplification, Proceedings of the Sixth ACM Multimedia Conference, Bristol, UK, September 1998.
111. K. Manske, M. Muhlhauser, S. Vogl, M. Goldberg, OBVI: Hierarchical 3D video-browsing, Proceedings of the Sixth ACM Multimedia Conference, Bristol, UK, September 1998.