Multimedia content analysis for emotional characterization of music video clips

Eurasip Journal on Image and Video Processing

Volumn 2013, Issue , 2013, Pages

  Yazdani, Ashkan ^a   Skodras, Evangelos ^b   Fakotakis, Nikolaos ^b   Ebrahimi, Touradj ^a  

^a EPFL   (Switzerland)

^b UNIVERSITY OF PATRAS   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECT RECOGNITION; AFFECTIVE STATE; AUDIO AND VISUAL CUES; FUSION TECHNIQUES; MULTIMEDIA CONTENT ANALYSIS; MULTIMEDIA CONTENT SHARING; MULTIMEDIA CONTENTS; SEARCH AND RETRIEVAL;

VIDEO CAMERAS;

EID: 84887095967     PISSN: 16875176     EISSN: 16875281     Source Type: Journal    
DOI: 10.1186/1687-5281-2013-26     Document Type: Article

References (29)

1. Nov O, Naaman M, Ye C: What drives content tagging: the case of photos on Flickr. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems. New York: ACM; 2008:1097-1100.
2. Pantic M, Vinciarelli A: Implicit human-centered tagging [Social Sciences]. Signal Process. Mag. IEEE 2009,26(6):173-180.
3. Hanjalic A, Xu L: Affective video content representation and modeling. Multimedia, IEEE Trans 2005, 7:143-154. (Pubitemid 40178377)
4. Zeng Z, Pantic M, Roisman G, Huang T: A survey of affect recognition methods: audio, visual, and spontaneous expressions. Pattern Anal. Mach. Intell., IEEE Trans 2009, 31:39-58.
5. Koelstra S, Muehl C, Soleymani M, Lee J, Yazdani A, Ebrahimi T, Pun T, Patras I, A, Nijholt: DEAP: a Database for Emotion Analysis using Physiological Signals. IEEE Trans. Affect. Comput 2011, 3:18-31.
6. Wang Y, Liu Z, Huang J: Multimedia content analysis-using both audio and visual clues. Signal Process. Mag., IEEE 2000,17(6):12-36. (Pubitemid 32090406)
7. Ekman P: Basic emotions. In Handbook of Cognition and Emotion. Hoboken: Wiley; 1999:45-60.
8. Kim J, André E: Emotion recognition based on physiological changes in listening music. IEEE Transactions in Pattern Analysis and Machine Intelligence 2008, 30:2067-2083.
9. Lang P, Bradley M, Cuthbert B: International Affective Picture System (IAPS): instruction manual and affective ratings. The Center for Research in Psychophysiology, University of Florida 1999.
10. Bradley M, Lang P: Center for the Study of Emotion and Attention and National Institute of Mental Health. In The International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and Affective Ratings. Florida: NIMH Center for the Study of Emotion and Attention; 1999.
11. Yazdani A, Kappeler K, Ebrahimi T: Affective content analysis of music video clips. In Proceedings of the 1st International ACM Workshop on Music Information Retrieval with User-Centered and Multimodal Strategies. New York: ACM; 2011:7-12.
12. Hanjalic A: Extracting moods from pictures and sounds: towards truly personalized TV. Signal Process. Mag., IEEE 2006,23(2):90-100.
13. Kang H: Affective content detection using HMMs. In Proceedings of the Eleventh ACM International Conference on Multimedia. ACM; 2003:259-262. New York
14. Xu M, Chia L, Jin J: Affective content analysis in comedy and horror videos by audio emotional event detection. In 2005 IEEE International Conference on Multimedia and Expo. Washinton, DC: IEEE; 2005:4-10.
15. Moncrieff S, Dorai C, Venkatesh S: Affect computing in film through sound energy dynamics. In Proceedings of the Ninth ACM International Conference on Multimedia. New York: ACM; 2001:525-527. (Pubitemid 32968734)
16. Sun K, Yu J: Video affective content representation and recognition using video affective tree and hidden Markov models. Affect. Comput. Intell. Interact 2007, 4738:594-605.
17. Rasheed Z, Sheikh Y, Shah M: On the use of computable features for film classification. Circuits Syst. Video Technol., IEEE Trans 2005, 15:52-64. (Pubitemid 40135877)
18. Malandrakis N, Potamianos A, Evangelopoulos G, Zlatintsi A: A supervised approach to movie emotion tracking. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Washington, DC: IEEE; 2011:2376-2379.
19. Wang HL, Cheong LF: Affective understanding in film. Circuits Syst. Video Technol., IEEE Trans 2006,16(6):689-704. (Pubitemid 44109543)
20. Lienhart R: Comparison of automatic shot boundary detection algorithms. In Proceedings of SPIE, Vol. 3656. Bellingham: SPIE; 1999:290-301.
21. Mas J, Fernandez G: Video shot boundary detection based on color histogram. In Notebook Pap TRECVID2003. Gaithersburg: NIST; 2003.
22. Abd-Almageed W: Online, simultaneous shot boundary detection and key frame extraction for sports videos using rank tracing. In 15th IEEE International Conference on Image Processing, 2008 ICIP 2008. Washington: IEEE; 2008:3200-3203.
23. Yang Y, Chen H: Ranking-based emotion recognition for music organization and retrieval. Audio, Speech, Lang. Process., IEEE Trans 2011,19(4):762-774.
24. Lartillot O, Toiviainen P, Eerola T: A matlab toolbox for music information retrieval. Data Anal., Mach. Learn. Appl 2008, 261-268.
25. Chu S, Libal V, Marcheret E, Neti C, Potamianos G: Multistage information fusion for audio-visual speech recognition 2004. In IEEE International Conference on Multimedia and Expo, 2004 ICME'04 Volume 3. Washington: IEEE; 2004:1651-1654. (Pubitemid 40063367)
26. Hennecke M, Stork D, Venkatesh Prasad K: Visionary speech: Looking ahead to practical speechreading systems. NATO ASI Ser. F: Comput. Syst. Sci 1996, 150:331-350.
27. Lucey S, Chen T, Sridharan S, Chandran V: Integration strategies for audio-visual speech processing: applied to text-dependent speaker recognition. Multimedia, IEEE Trans 2005,7(3):495-506. (Pubitemid 40795048)
28. Kittler J, Hatef M, Duin R, Matas J: On combining classifiers. Pattern Anal. Mach. Intell., IEEE Trans 1998,20(3):226-239. (Pubitemid 128741312)
29. Lewis T, Powers D: Sensor fusion weighting measures in audio-visual speech recognition. In Proceedings of the 27th Australasian Conference on Computer Science-Volume 26. Sydney: Australian Computer Society Inc.; 2004:305-314.