Affective level video segmentation by utilizing the pleasure-arousal- dominance information

IEEE Transactions on Multimedia

Volumn 10, Issue 7, 2008, Pages 1325-1341

  Arifin, Sutjipto ^a   Cheung, Peter Y K ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Affective video content analysis; Bayesian networks; Emotion recognition; Video segmentation

Indexed keywords

ADAPTIVE ALGORITHMS; CLUSTERING ALGORITHMS; DISTRIBUTED PARAMETER NETWORKS; FACE RECOGNITION; FLOW OF SOLIDS; IMAGE SEGMENTATION; INFERENCE ENGINES; INTELLIGENT NETWORKS; SPEECH ANALYSIS; VISUAL COMMUNICATION;

ADAPTIVE CLUSTERING; AFFECTIVE VIDEO CONTENT ANALYSIS; DYNAMIC BAYESIAN NETWORKS; EMOTION RECOGNITION; NOVEL COMPUTATIONS; SEGMENTATION METHODS; TWO STAGES; VIDEO SEGMENTATION; VIDEO SEGMENTATIONS;

BAYESIAN NETWORKS;

EID: 56549083696     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2004911     Document Type: Article

References (48)

1. J. A. Russell and A. Mehrabian, "Evidence for a three-factor theory of emotions," J. Res. Personality, vol. 11, pp. 273-294, 1977.
2. J. Vendrig and M. Warring, "Systematic evaluation of logical story unit segmentation," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 492-499, Dec. 2002.
3. A. Hanjalic and L. Q. Xu, "Affective content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005.
4. A. M. Ferman and A. M. Tekalp, "Probabilistic analysis and extraction of video content," in IEEE Int. Conf. Image Process., Oct. 1999.
5. W. Wolf, "Hidden markov model parsing of video programs," in IEEE Int. Conf. Acoustics, Speech, and Signal Processing.
6. R. Qian, N. Hearing, and I. Sezan, "A computational approach to semantic event detection," in IEEE Conf. Computer Vision and Pattern Recognition, June 1999, vol. 1, pp. 200-206.
7. S. F. Chang, W. Chen, and H. Sundaram, "Semantic visual templates linking features to semantics," in IEEE Int. Conf on Image Process., Oct. 1998, vol. 3, pp. 531-535.
8. M. Naphade, T. Kristjansson, B. Frey, and T. S. Huang, "Probabilistic multimedia objects (multijects): A novel approach to indexing and retrieval in multimedia systems," in IEEE Int. Conf. on Image Process., Oct. .1998, vol. 3, pp. 536-540.
9. M. R. Naphade and T. S. Huang, "A probabilistic framework for semantic video indexing, filtering, and retrieval," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 141-151, Mar. 2001.
10. T. Zhang and C. Kuo, "An integrated approach to multimodal media content analysis," in Proc SPIE, Storage and Retrieval for Media Databases, Jan. 2000, vol. 3972, pp. 506-517.
11. A. Jaimes, T. Echigo, M. Teraguchin, and F. Satoh, "Learning personalized video highlights from detailed mpeg-7 metadata," in IEEE Intl. Conf. on Image Process., vol. 1.
12. A. Lang, P. Dhillon, and Q. Dong, "Arousal, emotion, and memory for television messages," J. Broadcast, Electron. Media, vol. 38.
13. A. Lang, J. Newhagen, and B. Reeves, "Negative video as structure: Emotion, attention, capacity and memory," J. Broadcast. Electron. Media, vol. 40.
14. R. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.
15. A. Ortony and T. J. Turner, "Negative video as structure: Emotion, attention, capacity and memory," Psychol. Rev., vol. 97, no. 3.
16. H. B. Kang, "Affective content detection using hidden markov models," in ACM Int. Conf on Multimedia, Nov. 2003, pp. 259-262.
17. H. B. Kang, "Analysis of scene context related with emotional events," in ACM Int. Conf. on Multimedia.
18. M. Xu, L. T. Chia, and J. Jin, "Affective content analysis in comedy and horror videos by audio emotional event detection," in IEEE Int. Conf. on Multimedia and Expo., July 2005.
19. S. Moncrieff, C. Dorai, and S. Venkatesh, "Affect computing in film through sound energy dynamics," in ACM Int. Conf. on Multimedia, vol. 9.
20. H. Schlosberg, "Three dimensions of emotion," Psychol. Review, vol. 61, no. 2.
21. C. E. Osgood, G. J. Suci, and P. H. Tannenbaum., The Measurement of Meaning. Urbana, IL: Univ. of Illinois Press, 1967.
22. J. R. Davitz, The Language of Emotion 1969.
23. P. Shaver, J. Schwartz, D. Kirson, and C. O'Connor, "Emotion knowledge: Further exploration of a prototype approach," J. Personality Social Psychol., vol. 52, no. 6.
24. P. Lang, The Network Model of Emotion: Motivational Connections. Hillsdale, NJ: Lawrence Erlbaum, 1995.
25. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol. 18, no. 1.
26. C. Breazeal, "Emotion and sociable humanoid robots," Int. J. Human-Computer Stud., vol. 59, no. 1-2, pp. 119-155, Jul. 2003.
27. R. Dietz and A. Lang, "Aefective agents: Effects of agent affect on arousal, attention, liking and learning," in Proc. Cognitive Technology Conf., 1999.
28. A. Jaimes, T. Nagamine, J. Liu, K. Omura, and N. Sebe, "Affective meeting video analysis," in IEEE Int. Conf. on Multimedia and Expo., Jul. 2005, pp. 1412-1415.
29. A. Hanjalic and R. Lagendijk, "Automated high level segmentation for advanced video retrieval systems," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, pp. 580-588, June 1999.
30. Y. M. Kwon, C. J. Song, and I. J. Kim, "A new approach for high level video structuring," in IEEE Intl. Conf. on Multimedia and Expo., 2000, vol. 2, pp. 773-776.
31. P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic algorithm for video segmentation and summarization," in IEEE Int. Conf. on Multimedia and Expo., 2000, vol. 3, pp. 1329-1332.
32. J. Kender and B. L. Yeo, "Video scene segmentation via continuous video coherence," in IEEE Conf. Comput. Vision and Pattern Recognition.
33. H. Sundaram and S. F. Chang, "Determining computable scenes in films and their structures using audio visual memory models," in ACM Int. Conf. on Multimedia, 2000.
34. R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Scene determination based on video and audio features," in Int. Conf. of Multimedia Systems.
35. M. Yeung, B. L. Yeo, and B. Liu, "Segmentation of video by clustering and graph analysis," Comput. Visi. Image Understand., vol. 71, no. 1, pp. 94-109, 1998.
36. Y. Rui, T. S. Huang, and S. Mehrotra, "Constructing table-of-content for videos," Multimedia Syst., vol.. 7, no. 5.
37. S. Arifin and P. Y. K. Cheung, "A computation method for video segmentation utilizing the pleasure-arousal-dominance emotional information," in ACM Int. Conf. on Multimedia, Sept. 2007, pp. 68-77.
38. J. J. Gross and R. W. Levenson, "Emotion elicitation using films," Cogn. Emot., vol. 9, no. 1, pp. 87-108, Jan. 1995.
39. R. M. Bolle, B. L. Yeo, and M. Yeung, "Video query: Research directions," IBM J. Res. Develop., vol. 42, no. 2.
40. Q., Huang, Z. Liu, A. Rosenberg, D. Gibbon, and B. Shahraray, "Automated generation of news content hierarchy by integrating audio, video, and text information," in IEEE Int. Conf. Acoustics, Speech, and Signal Processing.
41. D. Arijon, Grammar of the Film Language. Los Angeles, CA: Silman-James, 1991.
42. M. Paskin, A Short Course on Graphical Models: The Junction Tree Algorithms [Online]. Available: http://ai.stanford.edu/~paskin/gm.-short-course/ lec3.pdf [Online]. Available
43. L. Hagen and A. Kahng, "New spectral methods for ratio cut partitioning and clustering," IEEE Trans. Comput.-Aided Design Integr. Circuits Syst., vol. 11, no. 9, pp. 1074-1085, Aug. 1992.
44. C. H. Q. Ding, X. He, H. Zha, M. Gu, and H. D. Simon, "A min-max cut algorithm for graph partitioning and data clustering," in Intl. Conf. on Data Mining.
45. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
46. U. von Luxburg, A Tutorial on Spectral Clustering Max Planck Institute for Biological Cybernetics, Tech. Rep. TR-149, Aug. 2006, pp. 1-25.
47. The Classification of Ethnic Groups, Feb. 2001 [Online]. Available: http://www.statistics.gov.uk/about/Classifications, Statistics [Online]. Available
48. K. Murphy, Dynamic Bayesian Networks , , Nov. 2002 [Online]. Available: http://www.cs.ubc.ca/~murphyk/Papers/dbnchapter.pdf, [Online]. Available