Enhanced eigen-audioframes for audiovisual scene change detection

IEEE Transactions on Multimedia

Volumn 9, Issue 4, 2007, Pages 785-797

  Kyperountas, Marios ^b   Kotropoulos, Constantine ^a,b   Pitas, Ioannis ^a,b  

^a IEEE   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Audio visual video segmentation; Eigen audioframes; Scene change detection; TRECVID2003

Indexed keywords

AUDIO-VISUAL VIDEO SEGMENTATION; EIGEN-AUDIOFRAMES; SCENE CHANGE DETECTION;

ALGORITHMS; FEATURE EXTRACTION; IMAGE ANALYSIS; MULTIMEDIA SYSTEMS; VIDEO SIGNAL PROCESSING;

IMAGE SEGMENTATION;

EID: 34249317639     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.893337     Document Type: Article

References (31)

1. M. De Santo, G. Percannella, C. Sansone, and M. Vento, "Dialogue scenes detection in MPEG movies: A multi-expert approach," Lecture Notes Comput. Sci., vol. 2184, pp. 192-201, Sep. 2001.
2. M. Bertini, A. Del Bimbo, and P. Pala, "Content-based indexing and retrieval of TV-news," Pattern Recognit. Lett., vol. 22, no. 5, pp. 503-516, 2001.
3. H. Jiang, T. Lin, and H. J. Zhang, "Video segmentation with the assistance of audio content analysis," in Proc. 2000 IEEE Int. Conf. Multimedia Expo, 30 July-30 Aug. 2000, vol. 3, pp. 1507-1510.
4. H. Sundaram and S. F. Chang, "Audio scene segmentation using multiple features, models and time scales," in Proc. 2000 IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Istanbul, Turkey, Jun. 5-9, 2000, vol. 4, pp. 2441-2444.
5. N. Nitanda, M. Haseyama, and H. Kitajima, "Audio signal segmentation and classification for scene-cut detection," in Proc. 2005 Int. Symp. on Circuits and Systems, May 23-26, 2005, pp. 4030-4033.
6. Y. Li, S. Narayanan, and C.-C. J. Kuo, "Content-based movie analysis and indexing based on audio-visual cues," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 8, pp. 1073-1085, 2004.
7. Y. Zhu and D. Zhou, "Scene change detection based on audio and video content analysis," in Proc. 5th Int. Conf. Computational Intelligence and Multimedia Applications, Sep. 27-30, 2003, pp. 229-234.
8. J. Huang, Z. Liu, and Y. Wang, "Joint scene classification and segmentation based on Hidden Markov Model," IEEE Trans. Multimedia, vol. 7, no. 3, pp. 538-550, 2005.
9. M. Sugano, R. Isaksson, Y. Nakajima, and H. Yanagihara, "Shot genre classification using compressed audio-visual features," in Proc. 2003 IEEE Int. Conf. Image. Processing, Barcelona, Spain, Sep. 14-17, 2003, vol. 2, pp. 17-20.
10. S.-C. Chen, M.-L. Shyu, W. Liao, and C. Zhang, "Scene change detection by audio and video clues," in Proc. 2002 IEEE Int. Conf. Multimedia and Expo, Lausanne, 2002, vol. 2, pp. 365-368.
11. W. H.-M. Hsu and S.-F. Chang, "A statistical framework for fusing midlevel perceptual features in news story segmentation," in Proc. 2003 IEEE Int. Conf. Multimedia and Expo, Baltimore, MD, 2003, vol. 2, pp. 413-416.
12. A. O'Hare, A. F. Smeaton, C. Czirjek, N. O'Connor, and N. Murphy, "A generic news story segmentation system and its evaluation," in Proc. 2004 IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Montreal, May 17-21, 2004, vol. 3, pp. 1028-1031.
13. Guidelines TRECVID 2003 Evaluation, , Nat. Inst. Stand. Technol. (NIST) [Online]. Available: http://www.nlpir.nist.gov/projects/tv2003/tv2003. html
14. W. Weiqiang and G. Wen, "Automatic segmentation of news items based on video and audio features," J. Comput. Sci. Technol., vol. 17, no. 2, pp. 189-195, 2002.
15. T. L. Nwe and H. Li, "Broadcast news segmentation by audio type analysis," in Proc. 2005 IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Montreal, QC, Canada, Mar. 18-23, 2005, vol. 2, pp. 1065-1068.
16. P. Wang, R. Cai, and S.-Q. Yang, "A hybrid approach to news video classification multimodal features," in Proc. 2003 Joint 4th Int. Conf. Information, Communications, and Signal Processing and Fourth IEEE Pacific-Rim Conf. Multimedia, Singapore, Dec. 15-18, 2003, vol. 2, pp. 787-791.
17. N. Bertoldi, F. Brugnara, M. Cettolo, M. Federico, D. Giuliani, E. Leeuwis, and V. Sandrini, "The ITC-irst news on demand platform," in Proc. 25th Eur. Conf. IR Research: Advances in Information Retrieval, Pisa, Apr. 14-16, 2003, vol. 2633, pp. 520-527.
18. A. Albiol, L. Torres, and E. J. Delp, "Combining audio and video for video sequence indexing applications," in Proc. 2002 IEEE Int. Conf. Multimedia and Expo, Laussane, Switzerland, 2002, vol. 2, pp. 353-356.
19. "CBC news online," Canada Now [Online], Available: http://www.cbc.ca/MRL/clips/latest/canadanow.ram
20. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
21. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
22. M. Kyperountas, Z. Cernekova, C. Kotropoulos, M. Gavrielides, and I. Pitas, "Audio PCA in a novel multimedia scheme for scene change detection," in Proc. 2004 IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Montreal, May 17-21, 2004, vol. 4, pp. 353-356.
23. Z. Cernekova, C. Nikou, and I. Pitas, "Shot detection in video sequences using entropy-based metrics," in Proc. 2002 IEEE Int. Conf. Image Processing, 2002, vol. 3, pp. 421-4-24.
24. J. Huang, Z. Liu, and W. Yao, "Integration of audio and visual information for content-based video segmentation," in Proc. 1998 IEEE Int. Conf. Image Processing, Oct. 4-7, 1998, vol. 3, pp. 526-529.
25. Y. Wang, Z. Liu, and J. Huang, "Multimedia content analysis using both audio and visual clues," Signal Process, Mag., vol. 17, pp. 12-36, Nov. 2000.
26. L. Lu, H. Jiang, and H. J. Zhang, "A robust audio classification and segmentation method," in Proc. 9th ACM Int. Conf. on Multimedia. Ottawa, Canada, 2001, vol. 9, pp. 203-211.
27. Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based shot cut/fade detection and video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, Jan. 2006.
28. C.-L. Huang and B.-Y. Liao, "A robust scene-change detection method for video segmentation," IEEE Trans. Circuits Syst. Video Technol. vol. 11, no. 12, pp. 1281-1288, 2001.
29. S. Lee and M. H. Hayes, "Efficient scene segmentation for contentbased indexing in the compressed domain," in Proc. IEEE Workshop Multimedia Signal Processing, Cannes, France, Oct. 3-5, 2001, pp. 473-478.
30. B. T. Truong, S. Venkatesh, and C. Dorai, "Scene extraction in motion pictures," IEEE Trans. Circuits Syst. Video Technol.: Special Issue Multimedia Content Description, vol. 15, no. 1, pp. 5-15, 2003.
31. N. Nitanda, M. Haseyama, and H. Kitajima, "An audio-scene cut detection method using fuzzy c-means algorithm for audio-visual indexing," in Proc. 2004 Int. Symp. Circuits and Systems, May 23-26, 2004, vol. 2, pp. 89-92.