A compressed-domain approach for shot boundary detection on H.264/AVC bit streams

Signal Processing: Image Communication

Volumn 23, Issue 7, 2008, Pages 473-489

  De Bruyne, Sarah ^a   Van Deursen, Davy ^a   De Cock, Jan ^a   De Neve, Wesley ^a   Lambert, Peter ^a   Van de Walle, Rik ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

H.264 AVC; Shot boundary detection; Temporal segmentation; Video analysis

Indexed keywords

ALGORITHMS; ARSENIC; ARSENIC COMPOUNDS; AUTOMATIC INDEXING; BOOLEAN FUNCTIONS; COMPUTATIONAL COMPLEXITY; IMAGE SEGMENTATION; IMAGING TECHNIQUES; INFORMATION THEORY; MOTION PICTURE EXPERTS GROUP STANDARDS; MULTIMEDIA SYSTEMS; PHOTOGRAPHY; PROGRAMMING THEORY; RIVERS; SIGNAL DETECTION; SPECIFICATIONS; STANDARDS; VIDEO RECORDING; VISUAL COMMUNICATION;

BIT STREAM (BS); CODING STRUCTURES; CODING TOOLS; COMPRESSED BIT STREAM; COMPRESSED DOMAINS; DIGITAL VIDEO CONTENT; DOMAIN APPROACH; H.264/AVC; HIERARCHICAL CODING; HIGH ACCURACY; PYRAMIDAL STRUCTURES; SEMANTIC ANALYSIS; SHOT BOUNDARY DETECTION (SBD); SHOT BOUNDARY DETECTION TECHNIQUE; TEMPORAL STRUCTURING; VIDEO ANALYSIS (VA); VIDEO SEQUENCING; VIDEO-CONTENT ANALYSIS;

COMPUTER GRAPHICS;

EID: 48649105449     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2008.04.012     Document Type: Article

References (37)

1. Bescós J. Real-time shot change detection over online MPEG-2 video. IEEE Trans. Circuits Systems Video Technol. 14 4 (2004) 475-484
2. Boccignone G., Chianese A., Moscato V., and Picariello A. Foveated shot detection for video segmentation. IEEE Trans. Circuits Systems Video Technol. 15 3 (2005) 365-377
3. Burnett I.S., Pereira F., Van de Walle R., and Koenen R. The MPEG-21 Book (2006), Wiley, New York
4. C̀alić J., Gibson D.P., and Campbell N.W. Efficient layout of comic-like video summaries. IEEE Trans. Circuits Systems Video Technol. 17 7 (2007) 931-936
5. Chang S.-F., and Vetro A. Video adaptation: concepts, technologies and open issues. Proc. IEEE 93 1 (2005) 148-158
6. Damghanian B., Hashemi M.R., and Akbari M.K. A novel fade detection algorithm on H.264/AVC compressed domain. Lecture Notes in Computer Science vol. 4319 (2006), Springer, Berlin 1159-1167
7. De Bruyne S., De Neve W., De Wolf K., De Schrijver D., Verhoeve P., and Van de Walle R. Temporal video segmentation on H.264/AVC compressed bitstreams. Lecture Notes in Computer Science vol. 4351 (2007), Springer, Berlin 1-12
8. De Neve W., Van Deursen D., De Schrijver D., De Wolf K., and Van de Walle R. Using bitstream structure descriptions for the exploitation of multi-layered temporal scalability in H.264/AVC's base specification. Lecture Notes in Computer Science vol. 3767 (2005), Springer, Berlin 641-652
9. DELOS Network of Excellence on Digital Libraries 〈http://www.delos.info/〉.
10. A. Divakaran, K.A. Peker, R. Radhakrishnan, Z. Xiong, R. Cabasson, Video summarization using MPEG-7 motion activity and audio descriptors, Technical Report TR-2003-34, Mitsubishi Electric Research Laboratories, 2003.
11. Fonseca P.M., and Pereira F. Automatic video summarization based on MPEG-7 descriptions. Signal Processing: Image Communications 19 8 (2004) 685-699
12. Gargi U., Kasturi R., and Strayer S.H. Performance characterization of video-shot-change detection methods. IEEE Trans. Circuits Systems Video Technol. 10 1 (2000) 1-13
13. Girgensohn A., and Boreczky J. Time-constrained keyframe selection technique. Multimedia Tools Appl. 11 3 (2000) 347-358
14. Grana C., and Cucchiara R. Linear transition detection as a unified shot detection approach. IEEE Trans. Circuits Systems Video Technol. 17 4 (2007) 483-489
15. Hanjalic A. Shot-boundary detection: unraveled and resolved?. IEEE Trans. Circuits Systems Video Technol. 12 2 (2002) 90-105
16. Heijmans H.J.A.M. Composing morphological filters. IEEE Trans. Image Process. 6 5 (1997) 713-723
17. ISO/IEC JTC1/SC29/WGll/N2467, Description of MPEG-7 content set, 1998.
18. ISO/IEC 15938-3, Information technology-multimedia content description interface-Part 3: visual, 2002.
19. ITU-T and ISO/IEC JTC 1, Advanced video coding for generic audiovisual services, ITU-T Rec. H.264 and ISO/IEC 14496-10 AVC, 2003.
20. A. Jacobs, A. Miene, G.T. Ioannidis, O. Herzog, Automatic shot boundary detection combining color, edge, and motion features of adjacent frames, in: TRECVID 2004 Workshop Notebook Papers, 2004, pp. 197-206.
21. Jeannin S., and Divakaran A. MPEG-7 visual motion descriptors. IEEE Trans. Circuits Systems Video Technol. 11 6 (2001) 720-724
22. Kim S.M., Byun J., and Won C.S. A scene change detection in H.264/AVC compression domain. Lecture Notes in Computer Science vol. 3768 (2005), Springer, Berlin 1072-1082
23. Leontaris A., and Cosman P.C. Compression efficiency and delay tradeoffs for hierarchical B-pictures and pulsed-quality frames. IEEE Trans. Image Process. 16 7 (2007) 1726-1740
24. Li Z., Schuster G.M., and Katsaggelos A.K. MINMAX optimal video summarization. IEEE Trans. Circuits Systems Video Technol. 15 10 (2005) 1245-1256
25. Lienhart R. Comparison of automatic shot boundary detection algorithms. Proceedings of the SPIE Storage and Retrieval for Image and Video Databases VII vol. 3656 (1998) 290-301
26. Liu Y., Wang W., Gao W., and Zeng W. A novel compressed domain shot segmentation algorithm on H.264/AVC. Proceedings of the IEEE International Conference on Image Processing vol. 4 (2004) 2235-2238
27. Magalhães J., and Pereira F. Using MPEG standards for multimedia customization. Signal Processing: Image Communications 19 5 (2004) 437-456
28. Manjunath B.S., Salembier P., and Sikora T. Introduction to MPEG-7: Multimedia Content Description Interface (2002), Wiley, New York
29. Pei S.-C., and Chou Y.-Z. Efficient MPEG compressed video analysis using macroblock type information. IEEE Trans. Multimedia 1 4 (1999) 321-333
30. Schwarz H., Marpe D., and Wiegand T. Analysis of hierarchical B pictures and MCTF. Proceedings of the IEEE International Conference on Multimedia and Expo (2006) 1929-1932
31. Tian D., Hannuksela M.M., and Gabbouj M. Sub-sequence video coding for improved temporal scalability. Proceedings of the IEEE International Symposium on Circuits and Systems (2005) 6074-6077
32. Wiegand T., Sullivan G.J., Bjøntegaard G., and Luthra A. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Systems Video Technol. 13 7 (2003) 560-576
33. Xiong Z., Radhakrishnan R., Divakaran A., Rui Y., and Huang T. A Unified Framework for Video Summarization, Browsing & Retrieval: With Applications to Consumer and Surveillance Video (2005), Academic Press, New York
34. Yeo B.-L., and Liu B. Rapid scene analysis on compressed video. IEEE Trans. Circuits Systems Video Technol. 5 6 (1995) 533-544
35. Zeng W., and Gao W. Shot change detection on H.264/AVC compressed video. Proceedings of the IEEE International Symposium on Circuits and Systems vol. 4 (2005) 3459-3462
36. Zhang H.J., Kankanhalli A., and Smoliar S.W. Automatic partitioning of full-motion video. Multimedia Systems 1 1 (1993) 10-28
37. Zhang H.J., Low C.Y., and Smoliar S.W. Video parsing and browsing using compressed data. Multimedia Tools Appl. 1 1 (1995) 89-111