Towards extracting semantically meaningful key frames from personal video clips: From humans to computers

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 2, 2009, Pages 289-301

  Luo, Jiebo ^a   Papin, Christophe ^a,b   Costello, Kathleen ^a  

^a EASTMAN KODAK COMPANY   (United States)

^b Multimedia Processing Group of Thaies Communications France   (France)

Author keywords

Camera motion; Consumer video clips; Digital video; Ground truth; Key frame extraction; Object motion; Scene analysis; Video analysis; Video summary

Indexed keywords

CAMERAS; DIGITAL CAMERAS; IMAGE COMPRESSION; INFORMATION THEORY; MULTIMEDIA SYSTEMS; PERSONAL COMPUTERS; VIDEO CAMERAS; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

CAMERA MOTION; CONSUMER VIDEO CLIPS; DIGITAL VIDEO; GROUND TRUTH; KEY FRAME EXTRACTION; OBJECT MOTION; SCENE ANALYSIS; VIDEO ANALYSIS; VIDEO SUMMARY;

COMPUTER GRAPHICS;

EID: 59649115008     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.2009241     Document Type: Article

References (23)

1. N. Dimitrova, T. McGee, and H. Elenbaas, "Video keyframe extraction and filtering: A keyframe is not a keyframe to everyone," in Proc. CIKM, 1997, pp. 113-120.
2. J. Kender and B. Yeo, "On the structure and analysis of home videos," in Proc. ACCV, 2000, CD-ROM.
3. T. Zhang, "Intelligent key-frame extraction for video printing," HP Labs, Palo Alto, CA, 2004, Tech. Rep. HPL-2004-143.
4. Rasheed and M. Shah, "Detection and representation of scenes in videos," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1097-1105, Dec. 2005.
5. P. O. Gresele and T. S. Huang, "Gisting of video documents: A key frames selection algorithm using relative activity measure," in Proc. CVIS, 1997, CD-ROM.
6. Y. Zhuang, Y. Rui, T. S. Huang, and S. Mehrotra, "Adaptive key frame extraction using unsupervised clustering," in Proc. IEEE Intl. Conf. Image Process., 1998, pp. 866-870.
7. Z. Xiong, R. Radhakrishnan, A. Divakaran, and T. S. Huang, "Effective and efficient sports highlights extraction using the minimum description length criterion in selecting GMM structures," in Proc. ICME, 2004, pp. 1947-1950.
8. B. Truong and S. Venkatesh, "Video abstraction: A system review," ACM Trans. Multimedia, vol. 5, no. 11, pp. 1529-3785, Nov. 2005.
9. Y. S. Avrithis, A. D. Doulamis, N. D. Doulamis, and S. D. Kollias, "A stochastic framework for optimal key frame extraction from MPEG video databases," Comput. Visi. Image Understand., vol. 75, no. 1-2, pp. 3-24, Jul.-Aug. 1999.
10. T. Liu, H. J. Zhang, and F. Qi, "A novel video key-frame-extraction algorithm based on perceived motion energy model," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, pp. 1006-1013, Oct. 2003.
11. M. J. Pickering and S. Rüger, "Evaluation of key frame-based retrieval techniques for video," Comput. Vis. Image Understand., vol. 92, no. 2-3, pp. 217-235, Nov.-Dec. 2003.
12. A. Aner-Wolf and J. R. Kender, "Video summaries and cross-referencing through mosaic-based representation," Comput. Vis. Image Understand., vol. 95, no. 2, pp. 201-237, Aug. 2004.
13. T. Liu and J. R. Kender, "Optimization algorithms for the selection of key frame sequences of variable length," in Proc. ECCV, 2002, CD-ROM.
14. B. Fauvet, P. Bouthemy, P. Gros, and F. Spindler, "A geometrical key-frame selection method exploiting dominant motion estimation in video," in Proc. CIVR, 2004, CD-ROM.
15. A. Amer, E. Dubois, and A. Mitiche, "Context-independent real-time event recognition: Application to key-image extraction," in Proc. ICPR, 2002, CD-ROM.
16. P. Campisi and A. Neri, "Synthetic summaries of video sequences using a multiresolution based key frame selection technique in a perceptually uniform color space," in Pioc. ICIP, 2000, CD-ROM.
17. Y. Rui, A. Gupta, and A. Acero, "Automatically extracting highlights for TV baseball programs," in Proc. ACM Multimedia, 2000, CD-ROM.
18. B. Li and I. Sezan, "Semantic sports video analysis: Approaches and new applications," in Proc. IEEE ICIP, 2003, CD-ROM.
19. B. Li and M. I. Sezan, "Event detection and summarization in sports video," in Proc. IEEE Workshop CBAIVL, 2001, CD-ROM.
20. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," J. Vis. Comm. Image Rep., vol. 6, no. 4, pp. 348-348, Dec. 1995.
21. L. Liu and G. Fan, "Combined key-frame extraction and object-based video segmentation," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 7, pp. 869-884, Jul. 2005.
22. Guidelines for the TRECVID 2007 Evaluation (2008). [Online]. Available: http://www-nlpir.nist.gov/projects/tv2007/tv2007.html
23. A. Loui, J. Luo, S.-F. Chang, D. Ellis, W. Jiang, L. Kennedy, K. Lee, and A. Yanagawa, "A consumer video benchmark data set: Concept definition and annotation," presented at the ACM Int. Workshop Multimedia Inf. Retrieval, Augsburg, Germany, Sep. 2007.