Major cast detection in video using both speaker and face information

IEEE Transactions on Multimedia

Volumn 9, Issue 1, 2007, Pages 89-101

  Liu, Zhu ^a,b   Wang, Yao ^a,c  

^a IEEE   (United States)

^b AT AND T LABS RESEARCH   (United States)

^c POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Content based multimedia indexing; Face detection; Major cast detection; Media integration; Speaker segmentation; Video browsing; Video summary

Indexed keywords

CONTENT-BASED MULTIMEDIA INDEXING; FACE DETECTION; MEDIA INTEGRATION; SPEAKER SEGMENTATION; VIDEO BROWSING; VIDEO SUMMARY;

ALGORITHMS; IMAGE ANALYSIS; IMAGE SEGMENTATION; INFORMATION ANALYSIS; MOTION PICTURES;

FACE RECOGNITION;

EID: 33846216333     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.886360     Document Type: Article

References (29)

1. J. S. Boreczky and L. D. Wilcox, "A hidden Markov model framework for video segmentation using audio and image features," in Proc. ICASSP'1998, Seattle, WA, May 12-15, 1998, vol. 6, pp. 3741-3744.
2. R. Chellappa, C. L. Wilson, and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. IEEE, vol. 83, no. 5, pp. 705-741, May 1995.
3. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
4. R. Cutler and L. Davis, "Look who's talking: Speaker detection using video and audio corrlation," in Proc. ICME, New York, Nov. 2000.
5. M. Flickner et al., "Query by image and video content: The QBIC system," IEEE Comput., vol. 28, no. 9, pp. 23-32, Sep. 1995.
6. A. Ferman and A. Tekalp, "Efficient filtering and clustering methods for temporal video segmentation and visual summarization," J. Vis. Comun. Image Repres., vol. 9, no. 4, pp. 336-351, Dec. 1998.
7. C. N. G. Iyengar, H. Nock, and M. Franz, "Semantic indexing of multimedia using audio, text and visual cues," in Proc. ICME, Lausanne, Switzerland, 2002, pp. 369-372.
8. J. Huang, Z. Liu, and Y. Wang, "Integration of audio and visual information for content-based video segmentation," in Proc. ICIP'1998, Chicago, IL, Oct. 4-7, 1998, vol. 3, pp. 526-530.
9. W. F. J. Fisher, T. Darrell, and P. Viola, "Learning joint statistical models for audio-visual fusion and segregation," in Advances in Neural Information Processing Systems., Denver, CO, 2000.
10. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Upper Saddle River, NJ: Prentice-Hall, 1998.
11. R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Scene determination based on video and audio features," in Proc. IEEE Int. Conf. Multimedia Computing and Systems, Jun. 7-11, 1999, vol. 1, pp. 685-690.
12. Z. Liu and Q. Huang, "A new distance measure for probability distribution function of mixture type," in Proc. ICASSP '2000, Istanbul, Turkey, Jun. 5-9, 2000.
13. Z. Liu and Y. Wang, "Face detection and tracking in video using dynamic programming," in Proc. ICIP'2000, Vancouver, BC, Canada, Sep. 10-13, 2000.
14. _, "Major cast detection in video using both audio and visual information," in Proc. ICASSP'2001, Salt Lake City, UT, May 7-11, 2001.
15. Z. Liu, Y. Wang, and T. Chen, "Audio feature extraction and analysis for scene segmentation and classification," J. VLSI Signal Process. Syst. for Signal, Image, and Video Technol., vol. 20, no. 1/2, pp. 61-79, Oct. 1998.
16. G. Lupatini, C. Saraceno, and R. Leonardi, "Scene break detection: A comparison," in Proc. 8th Int. Workshop on Research Issues In Data Engineering, Feb. 1998, pp. 34-41.
17. A. Martinez and R. Benavente, The AR Face Database 1998 [Online]. Available: http://rvl1.ecn.purdue.edu/~aleix/aleix_face_DB.html
18. M. Y. N. Ahuja and D. Kriegman, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 1, pp. 34-58, Jan. 2002.
19. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
20. H. A. Rowley, S. Baluja, and T. Kanade, "Neural network-baesd face detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 22-38, Jan. 1998.
21. Y. Rui, T. S. Huang, and S.-F. Chang, "Image retrieval: Current technologies, promising directions, and open issues," J. Vis. Commun. Image Represen., vol. 10, no. 1, pp. 39-62, Mar. 1999.
22. A. Samal and P. A. Iyengar, "Automatic recognition and analysis of human faces and facial expressions: A survey," Pattern Recognit., vol. 25, no. 1, pp. 65-77, 1992.
23. C. Saraceno and R. Leonardi, "Identification of story units in audio-visual sequencies by joint audio and video processing," in Proc. ICIP'1998, Chicago, IL, Oct. 4-7, 1998, vol. 1, pp. 363-367.
24. S. Satoh, Y. Nakamura, and T. Kanade, "Name-it: Naming and detecting faces in news videos," IEEE Multimedia Mag., vol. 6, no. 1, pp. 22-35, Jan.-Mar. 1999.
25. J. Saunders, "Real-time discrimination of broadcast speech/music," in Proc. ICASSP'1996, Atlanta, GA, May 7-10, 1996, vol. 2, pp. 993-996.
26. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer, 1998.
27. E. Wold, T. Blum, D. Keislar, and J. Wheaton, "Content-based classification, search, and retrieval of audio," IEEE Multimedia Mag., vol. 3, no. 3, pp. 27-36, Sep. 1996.
28. H. J. Zhang, A. Kankanhalli, and S. W. Smoliar, "Automatic partioning of video," Multimedia Syst., vol. 1, no. 1, pp. 10-28, 1993.
29. T. Zhang and C.-C. J. Kuo, "Hierarchical classification of audio data for archiving and retrieving," in Proc. ICASSP'1999, Phoenix, AZ, Mar. 15-19, 1999, vol. 6, pp. 3001-3004.