Video classification and recommendation based on affective analysis of viewers

Neurocomputing

Volumn 119, Issue , 2013, Pages 101-110

  Zhao, Sicheng ^a   Yao, Hongxun ^a   Sun, Xiaoshuai ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Affective analysis; Facial expression recognition; Recommendation; Segmentation; Spatio temporal feature fusion; Video classification; Viewers

Indexed keywords

AFFECTIVE ANALYSIS; FACIAL EXPRESSION RECOGNITION; RECOMMENDATION; SPATIO-TEMPORAL FEATURES; VIDEO CLASSIFICATION; VIEWERS;

GESTURE RECOGNITION; IMAGE CLASSIFICATION; IMAGE SEGMENTATION;

CLASSIFICATION (OF INFORMATION);

AFFECT; ARTICLE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; CLASSIFIER; CONTENT ANALYSIS; FACIAL EXPRESSION; LEARNING ALGORITHM; PRIORITY JOURNAL; VIDEO CLASSIFICATION; VIDEO RECOMMENDATION; VIDEORECORDING;

EID: 84881558645     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.04.042     Document Type: Article

References (32)

1. YouKu , YouTube .
2. Go Irie Kota Hidaka, et al. Latent topic driving model for movie affective scene classification. ACM Multimedia 2009, 565-568.
3. Kang H.B. Affective content detection using HMMs. ACM Multimedia 2003, 259-262.
4. Arifin S., Cheung.P.Y.K. Affective level video segmentation by utilizing the pleasure-arousal-dominance information. IEEE Trans. Multimedia 2008, 10(7):1325-1341.
5. Xu M., Jin J.S., Luo S., Duan L. Hierarchical movie affective content analysis based on arousal and valence features. ACM Multimedia 2008, 677-680.
6. Zhang S., Huang Q., Jiang S., Gao W., Tian Q. Affective Visualization and Retrieval for Music Video. IEEE Trans. Multimedia 2010, 12(6):510-522.
7. Y. Song, M. Zhao, JayYagnik, X. Wu. Taxonomic classification for web-based videos, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2010.
8. Z. Wang, M. Zhao, et al, YouTubeCat: learning to categorize wild web videos, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2010.
9. Tang J., Hua X.-S., Qi G.-J., Wang M., Mei T., Wu X. Structure-sensitive manifold ranking for video concept detection. ACM Multimedia 2007, 852-861.
10. Tang J., Hua X.-S., Qi G.J., Song Y., Wu X. Video annotation based on kernel linear neighborhood propagation. IEEE Trans. Multimedia 2008, 10(4):620-628.
11. Tang J., Hua X.-S., Wang M., Gu Z., Qi G.-J., Wu X. Correlative linear neighborhood propagation for video annotation. IEEE Trans. Syst. Man Cybern. B Cybern. 2009, 39(2).
12. Seungmin Rho Byeong-jun, Han Eenjun Hwang SVR-based music mood classification and context-based music recommendation. ACM Multimedia 2009, 713-716.
13. Hideo Joho Jacopo, Staiano Nicu Sebe, Jose M. Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents. Multimedia Tools Appl. 2011, 51(2):505-523.
14. Hideo Joho M., Jose Roberto, Valenti Nicu Sebe Exploiting facial expressions for affective video summarisation. ACM Int. Conf. Image Video Retreival (CIVR) 2009.
15. Picard R.W. Affective Computing [M] 1997, MIT Press, London, England.
16. Chang K., Liu T., Lai.S. Learning partially-observed hidden conditional random fields for facial expression recognition. IEEE Conf. Comput. Vision Pattern Recognition (CVPR) 2009.
17. Izard C.E. The Face of Emotion 1971, Appleton-Century-Crofts, New York.
18. Ekman P., Friesen W.V. Facial Action Coding System 1978, Consulting Psychologists Press.
19. Cohen I., Sebe N., Garg A., Chen L., Huang T. Facial expression recognition from video sequences: temporal and static modeling. Comput. Vision Image Understanding (CVIU) 2003.
20. Zhao G., Pietikainen M. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2007, 29(6).
21. Cootes T.F., Taylor C.J., Cooper D.H., Graham J. Active shape models: their training and application. Comput. Vision Image Understanding (CVIU) 1995, 61(1).
22. C. Shan, S. Gong, P.W. McOwan, Robust facial expression recognition using local binary patterns, in: Proceedings of IEEE International Conference on Image Processing, ICIP, 2005.
23. J. Whitehill, C.W. Omlin, Haar features for FACE AU recognition, in: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, FG, 2006.
24. Yang P., Liu Q., Metaxas D.N. Exploring facial expressions with compositional features. IEEE Conf. Comput. Vision Pattern Recognition (CVPR) 2010.
25. Yang P., Liu Q., Metaxas D.N. Boosting encoded dynamic features for facial expression recognition. Pattern Recognition Lett. 2009, 30(2).
26. Zhang Y., Ji Q. Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2005, 27(5):699-714.
27. Cohen I., Sebe N., Garg A., Chen L., Huang T. Facial expression recognition from video sequences: Temporal and static modeling. IEEE Conf. Comput. Vision Image Understanding (CVIU) 2003, 91(1-2).
28. Quattoni A., Collins M., Darrell T. Conditional random fields for object recognition 2004, Neural Information Processing Systems (NIPS).
29. J. Lafferty, A. McCallum, F. Pereira, Conditional random fields: probabilistic models for segmenting and labeling sequence data, in: Proceedings of the International Conference on Machine Learning, ICML, 2001.
30. Hao Jian Film Typology 2002, Peking University Press, (in Chinese).
31. T. Kanade, J. Cohn, Y.-L. Tian, Comprehensive database for facial expression analysis, in: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, FG, 2000.
32. Hanjalic A., Xu L.-Q. Affective video content representation and modeling. IEEE Trans. Multimedia 2005, 7(1):143-154.