A motion-based scene tree for browsing and retrieval of compressed videos

Information Systems

Volumn 31, Issue 7, 2006, Pages 638-658

  Yi, Haoran ^a   Rajan, Deepu ^a   Chia, Liang Tien ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Shot boundary detection; Video browsing; Video indexing; Video retrieval; Video similarity

Indexed keywords

DATABASE SYSTEMS; IMAGE COMPRESSION; MOTION ESTIMATION; SEMANTICS; TREES (MATHEMATICS); WEB BROWSERS;

SHOT BOUNDARY DETECTION; VIDEO BROWSING; VIDEO INDEXING; VIDEO RETRIEVAL; VIDEO SIMILARITY;

INFORMATION RETRIEVAL;

EID: 33747167943     PISSN: 03064379     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.is.2005.12.005     Document Type: Article

References (46)

1. International Organization for Standardization, Overview of the MPEG-7 Standard, ISO/IEC/JTC1/SC29/WG11 N4031 Edition, March 2001.
2. International Organization for Standardization, MPEG21 Overview (CODING OF MOVING PICTURES AND AUDIO), ISO/IEC JTC1/SC29/WG11/N4318 Edition, July 2001.
3. ITU-T, Video Coding for Low Bitrate Communication ITU-T Recommendation, H.263 Edition, February 1998.
4. ITU-T, Joint Final Committee Draft (JFCD) of Joint Video Specification (ITU-T Rec. H.264 - ISO/IEC 14496-10 AVC), H.264 Edition, July 2002.
5. Katz E. The Film Encyclopedia. second ed. (1994), Harper Collins, New York
6. J.R. Kender, B.-L. Yeo, Video scene segmentation via continuous video coherence, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, 1998, pp. 367-373.
7. Truong B.T., Vekatesh S., and Dorai C. Scene extraction in motion picture. IEEE Trans. Circuits Syst. Video Technol. 13 1 (2003) 5-15
8. M.A. Robertson, R.L. Stevenson, Restoration of compressed video using temporal information, in: Proceedings of SPIE Conference on Visual Communications and Image Processing, vol. 4310, San Jose, CA, 2001, pp. 21-29.
9. Gunturk B., Altunbasak Y., and Mersereau R. Super-resolution reconstruction of compressed video using transform-domain statistics. IEEE Trans. Image Process. 13 1 (2004) 33-43
10. Schonfeld D., and Lelescu D. VORTEX: video retrieval and tracking from compressed multimedia databases-multiple object tracking from MPEG-2 bitstream. J. Visual Commun. Image Representation 11 (2000) 154-182 (special issue on Multimedia Database Management)
11. Wang H., Divakaran A., Vetro A., Chang S.-F., and Sun H. Survey of compressed-domain features used in audio-visual indexing and analysis. J. Visual Commun. Image Representation 14 2 (2003) 50-183
12. Zhang H., and Liu H. A hierarchical organization scheme for video data. Pattern Recognition 35 (2002) 2381-2387
13. Hanjalic A. Shot-boundary detection: unraveled and resolved?. IEEE Trans. Circuits Syst. Video Technol. 12 2 (2002) 90-105
14. Ford R.M., Robson C., Temple D., and Gerlach M. Metrics for shot boundary detection in digital video sequences. Multimedia Syst. 8 1 (2000) 37-46
15. R. Lienhart, Comparison of automatic shot boundary detection algorithms, in: Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases VII, vol. 3656, San Jose, CA, 1999, pp. 290-301.
16. Zhang H., Kankanhalli A., and Smoliar S. Automatic partitioning of full-motion video. Multimedia Syst. 1 (1993) 10-28
17. I.K. Sethi, N.V. Patel, Statistical approach to scene change detection, in: Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases, vol. 2420, San Jose, CA, 1995, pp. 329-338.
18. Lo C.-C., and Wang S.-J. A histogram-based moment-preserving clustering algorithm for video segmentation. Pattern Recognition Lett. 24 14 (2003) 2209-2218
19. Yeo B.L., and Liu B. Rapid scene analysis on compressed video. IEEE Trans. Circuits Syst. Video Technol. 5 (1995) 544-553
20. R. Zabih, J. Miller, K. Mai, A feature-based algorithm for detecting and classifying scene breaks, in: Proceedings of ACM Multimedia 95, vol. 1, San Francisco, CA, 1995, pp. 10-28.
21. Heng W.J., and Ngan K.N. An object-based shot boundary detection using edge tracing and tracking. J. Visual Commun. Image Representation 12 3 (2001) 217-239
22. Patel N.V., and Sethi I.K. Video shot detection and characterization for video databases. Pattern Recognition 30 (1997) 607-625
23. J. Feng, K.-T. Lo, H. Mehrpour, Scene change detection algorithm for MPEG video sequence, in: Proceedings of IEEE International Conference on Image Processing, vol. 1, 1996, pp. 821-824.
24. J. Meng, Y. Juan, S.-F. Chang, Scene change detection in a MPEG video sequence, in: Proceedings of SPIE Conference on Multimedia Computing and Networking, vol. 2417, San Jose, CA, 1995, pp. 180-191.
25. Brunelli R., Mich O., and Modena C.M. A survey on the automatic indexing of video data. J. Visual Commun. Image Representation 10 2 (1999) 78-112
26. Heng W., and Ngan K. Post shot boundary detection technique: transition type-independent shot boundary refinement. IEEE Trans. Multimedia 4 4 (2002) 434-445
27. H. Yi, D. Rajan, L.-T. Chia, A unified approach to detection of shot boundaries and subshots in compressed video, in: Proceedings of IEEE International Conference on Image Processing, Barcelona, Spain, 2003, pp. 10005-10008.
28. Haskell B.G., Puri A., and Netravali A.N. Digital Video: An Introduction to MPEG-2 (1997), Chapman & Hall, New York
29. Hanjalic A., Lagendijk R.L., and Biemond J. Automated segmentation of movies into logical story units. IEEE Trans. Circuits Syst. Video Technol. 9 4 (1999) 580-588
30. Daniel A. Grammar of the Film Language (1976), Focal Press, London
31. C. Saraceno, R. Leonardi, Identification of story units in audio-visual sequences by joint audio and video processing, in: Proceeding of International Conference on Image Processing, Chicago, IL, USA, 1998, pp. 358-362.
32. Z. Rasheed, M. Shah, Scene boundary detection in hollywood movies and TV show, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, Madison, WI, 2003, pp. 343-348.
33. J. Nam, A.H. Tewfik, Combined audio and visual streams analysis for video sequence segmentation, in: Proceedings of ICASSP-97, vol. 4, Munich, Germany, 1997, pp. 2665-2668.
34. J. Oh, K.A. Hua, An efficient and cost-effective technique for browsing and indexing large video databases, in: Proceedings of 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, 2000, pp. 415-426.
35. B. Manjunath, P. Salembier, T. Sikora, Introduction to MPEG-7: Multimedia Content Description Interface, Wiley, New York, 2002.
36. G. Robertson, J. Machinlay, S. Card, Cone trees: animated 3D visualization of hierarchical information, in: Proceedings of ACM SIGCHI Conference on Human Factors in Computing System'91, 1991.
37. Smoliar S., and Zhang H. Content-based video indexing and retrieval. IEEE Trans. Multimedia 1 (1994) 62-72
38. Deng Y., Manjunath B.S., Kenney C., Moore M.S., and Shin H. An efficient color representation for image retrieval. IEEE Trans. Image Process. 10 1 (2001) 140-147
39. Manjunath B.S., and Ma W.Y. Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18 8 (1996) 837-842
40. Y. Rui, A.C. She, T.S. Huang, Modified Fourier descriptors for shape representation a practical approach, in: Proceedings of First International Workshop on Image Databases and Multimedia Search, 1996.
41. D.K. Park, Y.S. Jeon, C.S. Won, Efficient use of local edge histogram descriptor, in: Proceedings of the ACM Workshops on Multimedia, Los Angeles, California, USA, 2000, pp. 51-54.
42. Ngo C.-W., Pong T.-C., and Zhang H.-J. On clustering and retrieval of video shots through temporal slices analysis. IEEE Trans. Multimedia 4 4 (2002) 446-458
43. Chang S.F., Chen W., Meng H.J., Sundaram H., and Zhong D. A fully automatic content-based video search engine supporting multiple object spatio-temporal queries. IEEE Trans. Circuit Syst. Video Technol. 8 (1998) 602-615
44. R. Fablet, P. Bouthemy, P. Perez, Statistical motion-based video indexing and retrieval, in: International Conference on Content Based Multimedia Information Access, 2000, pp. 602-619.
45. Sahouria E., and Zakhor A. Content analysis of video using principal components. IEEE Trans. Circuit System Video Technol. 9 (1999) 1290-1298
46. MPEG, Multimedia content description interface-part 8: extraction and use of MPEG-7 descriptors, ISO/IEC 15938-8:2002, 2002.