Review of Image and Video Indexing Techniques

Journal of Visual Communication and Image Representation

Volumn 8, Issue 2, 1997, Pages 146-166

  Idris, Fayez ^a   Panchanathan, Sethuraman ^a,b  

^a UNIVERSITY OF OTTAWA   (Canada)

^b INDIAN INSTITUTE OF TECHNOLOGY MADRAS   (India)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS;

VIDEO INDEXING TECHNIQUES;

IMAGE ANALYSIS;

EID: 0031153499     PISSN: 10473203     EISSN: None     Source Type: Journal    
DOI: 10.1006/jvci.1997.0355     Document Type: Article

References (111)

1. G. Salton and M. J. McGill, An Introduction to Modern Information Retrieval, McGraw-Hill, New York, 1983.
2. J. J. Fan and K. Y. Su, An efficient algorithm for matching multiple patterns, IEEE Trans. Knowl. Data Eng. 5(2), April 1993, 339-351.
3. P. Aigrain, H.-J. Zhang, and D. Petkovic, Content-based represented and retrieval of visual media: A state-of-the-art-review, Multimedia Tools Applications 3(3), November 1996, 179-202.
4. H. Tamura and N. Nokoya, Image database systems: A survey, Patt. Recognition 17(1), 1984, 29-43.
5. A. K. Jain, Fundamentals of Digital Image Processing, Prentice Hall International, Englewood Cliffs, NJ, 1989.
6. E. L. Hall, Computer Image Processing and Recognition, Academic Press, New York, 1979.
7. V. N. Gudivada and V. V. Raghvan, Content-based image retrieval systems, IEEE Comput. 28(9), September 1995, 18-22.
8. M. J. Swain and D. H. Ballard, color indexing, Int. J. Comput. Vision 7(1), 1991, 11-32.
9. M. J. Swain, Interactive indexing into image databases, Proc. SPIE: Storage Retrieval Image Video Databases 1908, February 1993, 95-103.
10. Y. Gong, H. Zhang, H. Chuant, and M. Sakauuchi, An image database system with content capturing and fast image indexing abilities, in Proceedings of the International Conference on Multimedia Computing and Systems, May 1994, pp. 121-130.
11. W. Niblack, R. Barber, W. Equitz, M. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, and G. Taubin, The QBIC project: Querying images by content using color, texture and shape, Storage Retrieval Image Video Databases 1908, February 1993, 173-187.
12. S. W. Smoliar and H.-J. Zhang, Content-based video indexing and retrieval, IEEE Multimedia 1(2), Summer 1994, 62-72.
13. M. Stricker and M. Orengo, Similarity of color images, Storage Retrieval Image Video Databases III, 2420, February 1995, 381-392.
14. A. Nagasaka and Y. Tanaka, Automatic video indexing and full-video search for object appearance, IFIP: Visual Database Systems II, 1992, 113-127.
15. T.-S. Chua, S.-K. Lim, and H.-K. Pung, Content-based retrieval of segmented images, ACM Multimedia 94, 1994, 211-218.
16. A. Vellaikal and C.-C. J. Kuo, Content-based image retrieval using multiresolution histogram representation, Digital Image Storage Archiving Systems 2602, October 1995, 312-323.
17. M. Stricker and A. Dimai, Color indexing with weak spatial constraints, Storage Retrieval Still Image Video Databases IV 2670, February 1996, 29-39.
18. A. Vellaikal and C.-C. J. Kuo, Content-based retrieval of color and multispectral images using joint spatial-spectral indexing, Digital Image Storage Archiving Systems 2602, October 1995, 232-243.
19. X. Wan and C.-C. J. Kuo, Color analysis and quantization for image retrieval, Storage Retrieval Still Image Video Databases IV 2670, February 1996, 8-16.
20. R. Rickman and J. Stonham, Content-based image retrieval using color tuple histograms, Storage Retrieval Still Image Video Databases IV 2670, February 1996, 2-7.
21. J. Hafner, H. S. Sawhney, W. Equitz, M. Flickner, and W. Niblack, Efficient color histogram indexing for quadratic form distance function, IEEE Trans. Patt. Anal. Mach. Intell. 17(7), July 1995, 729-736.
22. M. Tuceryan and A. K. Jain, Texture analysis, in Handbook of Pattern Recognition and Computer Vision (C. H. Chen, L. F. Pau, and P. S. P. Wang, Eds.), pp. 235-276, World Scientific, Singapore, 1993.
23. I. M. Elfadel and R. W. Picard, Gibbs random fields, cooccurences, and texture modeling, IEEE Trans. Patt. Anal. Mach. Intell. 16(1), January 1994, 118-125.
24. M. Unser, Sum and difference histogram for texture classification, IEEE Trans. Patt. Anal. Mach. Intell. PAMI-8(1), 1986, 118-125.
25. L. J. Guibas, B. Rogoff, and C. Tomasi, Fixed-window image descriptors for image retrieval, Proc. SPIE: Storage Retrieval Image Video Databases III 2420, February 1995, 352-362.
26. R. W. Picard and T. Kabir, Finding similar patterns in large image databases, in International Conference on Acoustics, Speech and Signal Processing, April 1993, Vol. V, pp. 161-164.
27. R. W. Picard and F. Liu, A new wold ordering for image similarity, International Conference on Acoustics, Speech and Signal Processing, April 1994, Vol. V, pp. 129-132.
28. A. Petland, R. W. Picard, and S. Sclaroff, Photobook: Tools for content-based manipulation of image databases, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 34-47.
29. H. Tamura, S. Mori, and T. Yamawaki, Texture features corresponding to visual perception, IEEE Trans. Systems Man Cybernetics SMC-8(6), June 1978, 460-473.
30. P. Brodatz, Textures: A Photographic Album for Artists and Designers, Dover, New York, 1966.
31. W. Y. Ma and B. S. Manjunath, Image indexing using a texture dictionary, Digital Image Storage Archiving Systems 2606, October 1995, 288-298.
32. A. D. Alexandrov, W. Y. Ma, A. El Abbadi, and B. S. Manjunath, Adaptive filtering and indexing for image databases, Storage Retrieval Image Video Databases III 2420, February 1995, 12-23.
33. B. S. Manjunath and W. Y. Ma, Texture features for browsing and retrieval of image data, IEEE Trans. Patt. Anal. Mach. Intell. 18(8), August 1996, 837-842.
34. H. Zhang and D. Zhong, A scheme for visual feature based image indexing, Storage Retrieval Image Video Databases III 2420, February 1995, 36-46.
35. J.-L. Chen and A. Kundu, Rotation and gray scale invariant texture identification using wavelet decomposition and hidden Markov model, IEEE Trans. Patt. Anal. Mach. Intell. 16(2), February 1994, 208-214.
36. A. R. Rao, N. Bhushan, and G. L. Lohse, The relationship between texture terms and texture images: A study in human texture perception, Storage Retrieval for Still Image Video Databases IV 2670, February 1996, 206-214.
37. G. Taubin and D. B. Coper, Recognition and positioning of rigid objects using algebraic moment invariants, Proc. SPIE: Geometric Methods Comput. Vision 1570, 1991, 175-186.
38. E. Persoon and K. S. Fu, Shape discrimination using Fourier descriptors, IEEE Trans. Systems Man Cybernetics SMC-8, 1977, 170-179.
39. S. R. Dubois and F. H. Glanz, An autoregressive model approach to dimensional shape classification, IEEE Trans. Patt. Anal. Mach. Intell. 8, 1986, 55-66.
40. H. H. Chen and J. S. Su, "A syntactic approach to shape recognition, Proc. Int. Comput. Symp. 1986, 103-122.
41. W. I. Grosky and Z. Jiang, A hierarchical approach to feature indexing, Proc. SPIE: Image Storage Retrieval Systems 1662, February 1992, 9-20.
42. B. Scassellati, S. Alexopoulos, and M. Flickner, Retrieving images by 2D shape: A comparison of computation methods with human perceptual judgments, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 2-14.
43. J. E. Gary and R. Mehrotra, Shape retrieval in image database systems, Proc. SPIE: Image Storage Retrieval Systems 1661, February 1992, 2-8.
44. R. Mehrotra and J. E. Gary, Similar shape retrieval in shape data management, IEEE Comput. 28(9), September 1995, 57-62.
45. D. Tegolo, Shape analysis for image retrieval, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 59-69.
46. J. P. Eakins, K. Shields, and J. Boardman, ARTISAN-A shape retrieval system based on boundary family indexing, Proc. SPIE: Storage Retrieval Image Video Databases IV 2670, February 1996, 17-28.
47. Y. H. Ang, Z. Li, and S. H. Ong, Image retrieval based on multidimensional feature properties, Proc. SPIE: Storage Retrieval Image Video Databases III 2420, February 1995, 47-57.
48. T. Kato, T. Kurita, N. Otsu, and K. Hirata, A sketch retrieval method for full color image database, in International Conference on Pattern Recognition, September 1992, pp. 530-533.
49. S.-K. Chang, Q.-Y. Shi, and C.-W. Yan, Iconic indexing by 2-D strings, IEEE Trans. Patt. Anal. Mach. Intell. PAMI-9(3), May 1987, 413-428.
50. E. Jungert, Extended symbolic projection as a knowledge structure for image database systems, Fourth BPRA Conference on Pattern Recognition, March 1988, pp. 343-351, Springer-Verlag, Berlin/ New York.
51. S. Chang, E. Jungert, and Y. Li, Representation and retrieval of symbolic pictures using generalized 2-D strings, Proc. SPIE: Visual Commun. Image Process. IV 1199, 1989, 1360-1372.
52. S. K. Chang, C. M. Lee, and C. R. Dow, A 2-D string matching algorithm for conceptual pictorial queries, Proc. SPIE: Image Storage Retrieval Systems 1662, February 1992, 47-58.
53. S.-Y. Lee and F.-J. Hsu, Spatial reasoning and similarity retrieval of images using 2-D C-string knowledge representation, Patt. Recognition 25(3), 1992, 305-318.
54. S.-Y. Lee, M.-C. Yang, and J.-W. Chen, Signature files as a spatial filter for iconic image database, J. Visual Lang. Comput. 3(4), December 1992, 373-397.
55. T.-Y. Hou, A. Hsu, and M.-Y. Chiu, A content based indexing technique using relative geometry features, Image Storage Retrieval Systems 1662, February 1992, 59-68.
56. G. K. Wallace, The JPEG still picture compression standard, Commun. ACM 34(4), April 1991, 31-45.
57. D. L. Gall, MPEG: A video compression standard for multimedia applications, Commun. ACM 34(4), April 1991, 59-63.
58. M. Liou, Overview of the p × 64 kbits/s video coding standard, Commun. ACM 34(4), April 1991, 46-58.
59. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression, Kluwer, Boston, 1991.
60. S.-F. Chang, Compressed domain techniques for image/video indexing and manipulation, in IEEE International Conference on Image Processing (1), October 1995, 314-317.
61. M. Shneier and M. Abdel-Mottaleb, Exploiting the JPEG compression scheme for image retrieval, IEEE Trans. Patt. Anal. Mach. Intell. 18(8), August 1996, 849-853.
62. F. Idris and S. Panchanathan, Image indexing using vector quantization, Proc. SPIE: Storage Retrieval Image Video Databases III 2420, February 1995, 373-380.
63. F. Idris and S. Panchanathan, Storage and retrieval of compressed images, IEEE Trans. Consumer Electronics 41, August 1995, 937-941.
64. F. Idris and S. Panchanathan, Image indexing using wavelet vector quantization, Proc. SPIE: Digital Image Storage Archiving Systems 2606, October 1995, 269-275.
65. H. Sakamoto, H. Suzuki, and A. Uemori, Flexible montage retrieval for image data, Storage Retrieval Image Video Databases II 2185, February 1994, 25-33.
66. R. C. Jain, S. N. J. Murthy, and P. L.-J. Chen, Similarity measures for image databases, Proc. SPIE: Storage Retrieval Image Video Databases III 2420, February 1995, 58-65.
67. L. A. Rowe, J. S. Boreczky and C. A. Eads, Indexes for user access to large video databases, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 150-161.
68. B. Holt and L. Hartwick, Visual image retrieval for applications in art and history, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 70-81.
69. R. Kasturi and R. Jain, Dynamic vision, in Computer Vision: Principles, pp. 469-480, IEEE Comput. Soc., Los Alamitos, CA, 1990.
70. H. J. Zhang, A. Kankanhalli, S. W. Smoliar, and S. Y. Tan, Automatic partitioning of full motion video, ACM Multimedia Systems 1(1), 1993, 10-28.
71. H. J. Zhang, Y. Gong, S. W. Smoliar, and S. Y. Tan, Automatic parsing of news video, in Proceedings of the International Conference on Multimedia Computing and Systems, May 1994, pp. 45-54.
72. Y. Tonomura, Video handling based on structured information for hypermedia systems, in ACM Proceedings: International Conference on Multimedia Information Systems '91, 1991, pp. 333-344.
73. K. Otsuji, Y. Tonomura, and Y. Ohba, Video browsing using brightness data, Visual Commun. Image Process. '91 1606, November 1991, 980-989.
74. K. Otsuji and Y. Tonomura, Projection detecting filter for video cut detection, ACM Multimedia 93, 1993, 251-257.
75. U. Gargi, S. Oswald, D. Kosiba, S. Devadiga, and R. Kasturi, Evaluation of video sequence indexing and hierarchical video indexing, Proc. SPIE: Storage Retrieval Image Video Databases III February 1995, 144-151.
76. D. Swanberg, C.-F. Shu, and R. Jain, Knowledge guided parsing in video databases, Proc. SPIE 1908, 1993, pp. 13-24.
77. S. Shahraray, Scene change detection and content-based sampling of video sequences, Digital Video Compression: Algorithms Tech. 2419, February 1995, 2-13.
78. F. Arman, A. Hsu, and M.-Y. Chiu, Image processing on compressed data for large video databases, Proc. SPIE: Storage Retrieval Image Video Databases 1993, pp. 267-272.
79. F. Arman, A. Hsu, and M.-Y. Chiu, Feature management for large video databases, ACM Multimedia 93 1908, February 1993, 2-12.
80. H. J. Zhang, C. Y. Low, Y. Gong, S. W. Smoliar, and S. Y. Tan, Video parsing compressed data, Proc. SPIE: Image Video Processing II 2182, 1994, 142-149.
81. H. J. Zhang, C. Y. Low, S. W. Smoliar, and S. Y. Tan, Video parsing and browsing using compressed data, Multimedia Tools Applications 1, 1995, 89-111.
82. B.-L. Yeo and B. Liu, A unified approach to temporal segmentation of motion JPEG and MPEG compressed videos, in Proceedings of the International Conference on Multimedia Computing and Systems, May 1995, pp. 81-88.
83. S.-F. Chang and D. G. Messerschmitt, Manipulation and composition of MC-DCT compressed video, IEEE J. Selected Areas Commun. 13(1), January 1995, 1-11.
84. H.-C. H. Liu and G. L. Zick, Scene decomposition of MPEG compressed video, Digital Video Compression: Algorithms Tech. 2419, February 1995, 26-37.
85. J. Meng, Y. Juan, and S.-F. Chang, Scene change detection in a MPEG compressed video sequence, Digital Video Compression: Algorithms Tech. 2419, February 1995, 14-25.
86. J. Lee and B. W. Dickinson, Multiresolution video indexing for subband coded video databases, Proc. SPIE: Image Video Process. II 2185, 1994, 162-173.
87. F. Arman, R. Depommier, A. Hsu, and M.-Y. Chiu, Content-based browsing of video sequences, ACM Multimedia 94, 1994, 97-103.
88. H. J. Zhang and S. W. Smoliar, Developing power tools for video and retrieval, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 140-149.
89. P. Aigrain and P. Joly, The automatic real-time analysis of film editing and transition effects and its applications, Comput. Graphics 18(1), 1994, 93-103.
90. A. Hampapur, R. Jain, and T. E. Weymouth, Production model based digital video segmentation, Multimedia Tools Applications 1, 1995, 9-46.
91. A. Akutsu, Y. Tonomura, H. Hashimoto, and Y. Ohba, Video indexing using motion vectors, Proc. SPIE: Visual Commun. Image Process. '92 1818, 1992, 1522-1530.
92. A. Akutsu and Y. Tonomura, Video tomography: An efficient method for camerawork extraction and motion analysis, ACM Multimedia 94, 1994, 349-356.
93. M. V. Srinivasan, S. Venkatesh, and R. Hosie, "Qualitative Estimation of Camera Motion Parameters from Video Sequences, submitted to publication.
94. Y. Wu and D. Suter, A comparison of methods for scene change detection in noisy image sequence, in Proceedings of Visual '96: The First International Conference on Visual Information Systems, February 1996, pp. 459-468.
95. A. Dailianas, R. B. Allen, and P. England, Comparison of automatic video segmentation algorithms, Proc. SPIE: Integration Issues Large Commercial Media Delivery Systems 2615, 1995, 2-16.
96. M. Ioka and M. Kuroka, A method for retrieving sequences of images on the basis of motion analysis, Proc. SPIE: Storage Retrieval Systems 1662, February 1992, 35-46.
97. S. Y. Lee and H. M. Kao, Video indexing - An approach based on moving object and track, Proc. SPIE: Storage Retrieval Image Video Databases, February 1993, 25-36.
98. χ for semantic video database retrieval, ACM Multimedia 94, 1994, 219-226.
99. H. S. Sawhney, Motion video analysis using planar parallax, Proc. SPIE: Storage Retrieval Image Video Databases II 2185, February 1994, 231-242.
100. G. K. Wallace, JPEG still picture compression standard, Commun. ACM 34(4), April 1991, 31-45.
101. R. Elmasri and S. B. Navathe, Fundamentals of Database Systems, Benjamin-Cummings, Redwood City, CA, 1989.
102. S.-K. Chang and A. Hsu, Image information systems: Where do we go from here? IEEE Trans. Knowl. Data Eng. 4(5), October 1992, 431-441.
103. A. Gupta, T. Weymouth, and R. Jain, Semantic queries with pictures: The VIMSYS model, Proc. VLDB'91, 1991, 69-79.
104. G. Davenport, T. A. Smith, and N. Pincever, Cinematic primitives for multimedia, IEEE Comput. Graphics Applications, July 1991, 67-74.
105. + tree: A dynamic index for multidimensional objects, in Proceedings of the 13th International Conference on Very Large Databases, 1987, pp. 507-518.
106. N. Beckmann, H. P. Kriegel, R. Schneider, and B. Seeger, The R*-tree: An efficient and robust access method for points and rectangles, in Proceedings ACM SIGMOD the International Conference on the Management of Data, May 1990, pp. 322-331.
107. I. Gargantini, An effective way to represent quadtrees, Commun. ACM 25(12), 1982, 905-910.
108. J. Nievergelt, H. Hinterberger, and K. C. Sevcik, The grid file: An adaptable symmetric multikey file structure, ACM Trans. Database Systems 9(1), March 1984, 38-71.
109. Y. Niu, M. T. Ozsu, and X. Li, A Study of Image Indexing Techniques for Multimedia Database Systems, Department of Computing Science, University of Alberta, Technical Report TR 95-19, July 1995.
110. G. Ahanger and T. D. C. Little, A survey of technologies for parsing and indexing digital video, J. Visual Commun. Image Represent. 7(1), March 1996, 28-43.
111. IEEE Spectrum, Special Issue on Interactive Multimedia, March 1993.