Content-based mood classification for photos and music: A generic multi-modal classification framework and evaluation approach

Proceedings of the 1st International ACM Conference on Multimedia Information Retrieval, MIR2008, Co-located with the 2008 ACM International Conference on Multimedia, MM'08

Volumn , Issue , 2008, Pages 97-104

  Dunker, Peter ^a   Nowak, Stefanie ^a   Begau, André ^a   Lanz, Cornelia ^a  

^a FRAUNHOFER IDMT   (Germany)

Author keywords

Evaluation; Image content analysis; Multi modal mood classification; Music information retrieval

Indexed keywords

AUDIO-VISUAL FEATURES; CLASSIFICATION FRAMEWORK; CONTENT-BASED; END-USERS; EVALUATION APPROACH; IMAGE CONTENT ANALYSIS; MULTI-MODAL; MULTIMEDIA ARCHIVES; MULTIMEDIA OBJECT; MULTIMEDIA PLAYER; MULTIPLE CLASSIFIERS; MUSIC INFORMATION RETRIEVAL; REFERENCE SET; RESEARCH GROUPS; RETRIEVAL SYSTEMS; SCIENTIFIC COMMUNITY; SEARCH TERMS;

AUDIO ACOUSTICS; CLASSIFICATION (OF INFORMATION); ELECTRONIC MUSICAL INSTRUMENTS; FLUORINE CONTAINING POLYMERS; INFORMATION RETRIEVAL; INFORMATION SERVICES; METHOD OF MOMENTS;

MULTIMEDIA SYSTEMS;

EID: 70449608008     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1460096.1460114     Document Type: Conference Paper

References (41)

1. T. Li, M. Ogihara, and Q. Li. A comparative study on content-based music genre classification. Proc. ACM SIGIR '03, pages 282-289, 2003.
2. A. Bosch, A. Zisserman, and X. Munoz. Scene classification via pLSA. Proc. ECCV, 4:517-530, 2006.
3. A. Laengle. Zur Begriffichkeit der Emotionslehre in der Existenzanalyse. Laengle A (Hg) Emotion und Existenz. Wien: WUV-Facultas, pages 185-200, 2003.
4. K. Hevner. Experimental studies of the elements of expression in music. American Journal of Psychology, 48(2):246-268, 1936.
5. C.H. Chen, M.F. Weng, S.K. Jeng, and Y.Y. Chuang. Emotion-Based Music Visualization Using Photos. LNCS, 4903:358-368, 2008.
6. E. Schubert. Measurement and Time Series Analysis of Emotion in Music. PhD thesis, University of New South Wales, 1999.
7. A. Feist and E. Stephan. Entwicklung eines Verfahrens zur Erfassung des Gefühlszustandes (VGZ). http://psydok.sulb.uni-saarland.de/volltexte/2007/ 952/.
8. A. Mehrabian. Framework for a comprehensive description and measurement of emotional states. Genet Soc Gen Psychol Monogr, 121(3):339-61, 1995.
9. R.E. Thayer. The Biopsychology of Mood and Arousal. Oxford University Press, USA, 1989.
10. B. van de Laar. Emotion detection in music, a survey. Twente Student Conference on IT, 1:700, 2006.
11. R. Reisenzein. Worum geht es in der Debatte um die Basisemotionen? Forsterling, Stiensmeier-Pelster & Silny (Hg.), Kognitive und emotionale Aspekte der Motivation, pages 205-237, 2000.
12. Y. Feng, Y. Zhuang, and Y. Pan. Music information retrieval by detecting mood via computational media aesthetics. In IEEE/WIC, pages 235-241, 2003.
13. D. Yang and W. Lee. Disambiguating music emotion using software agents. In Proc. of the Int. Conf. on Music Information Retrieval, 2004.
14. L. Lu, D. Liu, and H.J. Zhang. Automatic mood detection and tracking of music audio signals. IEEE Trans. Audio, Speech & Language Process, 14(1), 2006.
15. T. Li and M. Ogihara. Content-based music similarity search and emotion detection. IEEE Int. Conf. on Acoustics, Speech & Signal Processing, 5, 2004.
16. nd IEEE Consumer Communications and Networking Conference, pages 71-75, 2005.
17. th International Multimedia Modeling Conference. Springer, 2008.
18. th Int. Conf. on Signal Processing, volume 2, pages 1352-1355, 2004.
19. T. Li and M. Ogihara. Detecting emotion in music. Proc. Int. Symp. Music Information Retrieval, 2003.
20. D. Liu, L. Lu, and H.J. Zhang. Automatic mood detection from acoustic music data. Proc. Int. Symp. Music Information Retrieval, pages 81-87, 2003.
21. C.C. Liu, Y.H. Yang, P.H. Wu, and H.H. Chen. Detecting and classifying emotion in popular music. In JCIS, 2006.
22. W. Wei-ning, Y. Ying-lin, and J. Sheng-ming. Image retrieval by emotional semantics: A study of emotional space and feature extraction. IEEE Int. Conf. Systems, Man and Cybernetics, 4, 2006.
23. H.W. Yoo. Visual-based emotional descriptor and feedback mechanism for image retrieval. Journal of Information Science and Engineering, 22(5):1205-1227, 2006.
24. T. Soen, T. Shimada, and M. Akita. Objective evaluation of color design. Color Res Appl, 12(4):184-194, 1987.
25. S.B. Cho. Emotional image and musical information retrieval with interactive genetic algorithm. In Proc. IEEE, volume 92, pages 702-711, 2004.
26. th IEEE Int. Conf. on Cognitive Informatics, 1, 2006.
27. X. Hu, M. Bay, and J. S. Downie. Creating a simplified music mood classification ground-truth set. Int. Symp. on Music Information Retrieval, pages 309-310, 2007.
28. th Int. Conf. on Machine Learning and Cybernetics, 7:4571-4576, Aug 2005.
29. W.N. Wang, Y.L. Yu, and J.C. Zhang. Image emotional classification: static vs. dynamic. IEEE Int. Conf. on Systems, Man and Cybernetics, 7, 2004.
30. S. Kim, S. Kim, S. Kwon, and H. Kim. A music summarization scheme using tempo tracking and two stage clustering. IEEE Workshop on Multimedia Signal Processing, pages 225-228, 2006.
31. A. Hanjalic. Extracting moods from pictures and sounds. IEEE Signal Processing Magazine, 23(2):90-100, 2006.
32. I. Crüger. http://www.ipsi.fraunhofer.de/~crueger/farbe/farb-wirk1. html.
33. J. Monaco. Film verstehen. Kunst, Technik, Sprache, Geschichte und Theorie des Films und der Medien. Au., Hamburg/London/New York, 2000.
34. H. Gembris. Wie Musik auf den Menschen wirkt. Korczak, D. & Hecker, J.(Hg.): Praktische Psychologie, Bd, 23:236-274, 2000.
35. B.S. Manjunath, P. Salembier, and T. Sikora, editors. Introduction to MPEG-7. John Wiley & Sons, 2002.
36. th IEEE Int. Symp. on Consumer Electronics, 2008.
37. C. Dittmar, C. Bastuck, and M. Gruhne. Novel mid-level audio features for music similarity. In Proc. Int. Conf. on Music Communication Science, 2007.
38. nd edition, 2002.
39. V.N. Vapnik. Statistical learning theory. Wiley New York, 1998.
40. T. Westerveld. Using generative probabilistic models for multimedia retrieval. PhD thesis, University of Twente, 2004.
41. C.W. Hsu, C.C. Chang, C.J. Lin, et al. A practical guide to support vector classification. National Taiwan University, Tech. Rep., July, 2003.