Quantitative study of music listening behavior in a social and affective context

IEEE Transactions on Multimedia

Volumn 15, Issue 6, 2013, Pages 1304-1315

  Yang, Yi Hsuan ^a   Liu, Jen Yu ^a  

^a RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

Author keywords

Affective computing; music emotion recognition; music listening behavior; social media; user mood recognition

Indexed keywords

AFFECTIVE COMPUTING; MUSIC EMOTIONS; MUSIC LISTENING BEHAVIOR; SOCIAL MEDIA; USER MOOD RECOGNITION;

HUMAN COMPUTER INTERACTION;

BLOGS;

EID: 84884580664     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2265078     Document Type: Article

References (68)

1. M. Clayton, "The social and personal functions of music in cross-cultural perspective," in The Oxford Handbook of Music Psychology, S. Hallam, I. Cross, and M. Thaut, Eds. New York, NY, USA: Oxford Univ. Press, 2008.
2. D. J. Hargreaves and A. C. North, "The functions of music in everyday life: Redefining the social in music psychology," Psychol. Music, vol. 27, no. 1, pp. 71-83, 1999.
3. Y.-HYang and H.H. Chen,Music Emotion Recognition. Boca Raton, FL, USA: CRC, 2011.
4. M. Zentner, D. Grandjean, and K. R. Scherer, "Emotions evoked by the sound of music: Characterization, classification, and measurement," Emotion, vol. 8, no. 4, pp. 494-521, 2008.
5. P. N. Juslin and P. Laukka, "Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening," J. New Music Res., vol. 33, no. 3, pp. 217-238, 2004.
6. M. Müller et al., "Signal processing for music analysis," IEEE J. Sel. Topics Signal Process., vol. 5, no. 6, pp. 1088-1110, 2011.
7. L. Lu, D. Liu, and H. Zhang, "Automatic mood detection and tracking of music audio signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 5-18, 2006. (Pubitemid 43863448)
8. T. T. Dang andK. Shirai, "Machine learning approaches formood classification of songs toward music search engine," in Proc. Int. Conf. Knowledge & Syst. Eng., 2009.
9. X. Hu, "Improving music mood classification using lyrics, audio and social tags," Ph.D. dissertation, Univ. Illinois at Urbana-Champaign, Urbana, IL, USA, 2010.
10. B. Schuller, F. Weninger, and J. Dorfner, "Multi-modal non-prototypical music mood analysis in continuous space: Reliability and performances continuous space: Reliability and performances," in Proc. Int. Soc. Music Info. Retrieval Conf., 2011, pp. 759-764.
11. C. Laurier, "Automatic classification of musical mood by content-based analysis," Ph.D. dissertation, Universitat Pompeu Fabra, Barcelona, Spain, 2011.
12. Y.-H. Yang and H. H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 762-774, 2011.
13. J.-C. Wang et al., "The acoustic emotion Gaussians model for emotion-based music annotation and retrieval," in Proc. ACM Multimedia, , 2012, pp. 89-98.
14. Y. E. Kim et al., "Music emotion recognition: A state of the art review," in Proc. Int. Soc. Music Info. Retrieval Conf., 2010.
15. Y.-C. Lin, Y.-H. Yang, and H. H. Chen, "Exploiting online music tags for music emotion classification," ACM Trans. Multimedia Comput., Commun., Applicat., vol. 7S, no. 1, 2011.
16. Y.-H. Yang and H.-H. Chen, "Machine recognition of music emotion: A review," ACM Trans. Intell. Syst. Technol., vol. 3, no. 4, 2012.
17. M. Barthet, G. Fazekas, and M. Sandler, "Multidisciplinary perspectives on music emotion recognition: Implications for content and context-based models," Proc. Int. Soc. Comput. Music Modelling & Retrieval, pp. 492-507, 2012.
18. R. W. Picard, Affective Computing. Cambridge, MA, USA: MIT Press, 1997.
19. S. Koelstra et al., "Deap: A database for emotion analysis; using physiological signals," IEEE Trans. Affective Comput., vol. 3, no. 1, pp. 18-31, 2012.
20. K. Jonghwa and E. Andé, "Emotion recognition based on physiological changes in music listening," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 12, pp. 2067-2083, 2008.
21. R. A. Calvo and S. D'Mello, "Affect detection: An interdisciplinary review of models, methods, and their applications," IEEE Trans. Affective Comput., vol. 1, no. 1, pp. 18-37, 2010.
22. V. N. Salimpoor et al., "Anatomically distinct dopamine release during anticipation and experience of peak emotion to music," Nature Neurosci., vol. 14, pp. 257-262, 2011.
23. M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, 2009.
24. M. A. Nicolaou et al., "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space," IEEE Trans. Affective Comput., vol. 2, no. 2, pp. 92-105, 2011.
25. P. D. Turney andM. L. Littman, "Measuring praise and criticism: Inference of semantic orientation from association," ACM Trans. Inf. Syst., vol. 21, no. 4, pp. 315-346, 2003.
26. A. Gabrielsson, "Emotion perceived and emotion felt: Same or different?," Musicae Scientiae, pp. 123-147, 2002.
27. A. J. Lonsdale and A. C. North, "Why do we listen to music? a uses and gratifications analysis," British J. Psychol., vol. 102, pp. 108-134, 2011.
28. A. V. Goethem and J. A. Sloboda, "The functions of music for affect regulation," Musicae Scientiae, vol. 15, no. 2, pp. 208-228, 2011.
29. P. G. Hunter, E. G. Schellenberg, and A. T. Griffith, "Misery loves company: Mood-congruent emotional responding to music," Emotion, vol. 11, no. 5, pp. 1068-1072, 2011.
30. A. J. M. van den Tol, "A self-regulatory perspective on people's decision to engage in listening to self-selected sad music when feeling sad," Ph.D. dissertation, Univ. Limerick, Limerick, Ireland, 2012.
31. S. J. Breckler, R. B. Allen, andV. J.Konecni, "Mood-optimizing strategies in aesthetic-choice behavior," Music Percept., vol. 2, no. 4, pp. 459-470, 1985.
32. D.Watson and R.Mandryk, "An in-situ study of real-life listening context," in Proc. Sound and Music Computing Conf., 2012, pp. 11-16.
33. M. A. Cohn, M. R. Mehl, and J. W. Pennebaker, "Why we blog?," Commun. ACM, vol. 47, no. 12, pp. 41-46, 2004.
34. G. Leshed and J. Kaye, "Understanding how bloggers feel: Recognizing affect in blog posts," in Proc. ACM Int. Conf. Comput. Human Interaction, 2006.
35. A. Miura and K. Yamashita, "Psychological and social influences on blog writing: An online survey of blog authors in Japan," J. Comput.-Mediated Commun., vol. 12, pp. 1452-1471, 2007.
36. J. Tang et al., "Quantitative study of individual emotional states in social networks," IEEE Trans. Affective Comput., vol. 3, pp. 132-144, 2012.
37. A. Schindler, R. Mayer, and A. Rauber, "Facilitating comprehensive benchmarking experiments on the million song dataset," in Proc. Int. Soc. Music Info. Retrieval Conf., 2012, pp. 469-474.
38. F. Mairesse et al., "Using linguistic cues for the automatic recognition of personality in conversation and text," J. Artif. Intell. Res., vol. 30, pp. 457-501, 2007.
39. T. Yarkoni, "Personality in 100,000 words: A large-scale analysis of personality and word use among bloggers," J. Res. Personality, vol. 44, no. 3, pp. 363-373, 2010.
40. K. D. Schwartz and G. T. Fouts, "Music preferences, personality style, and developmental issues of adolescents," J. Youth Adolescence, vol. 32, pp. 205-213, 2003.
41. P. J. Rentfrow and S. D. Gosling, "The Do Re Mi's of everyday life: The structure and personality correlates of music preferences," J. Personality Soc. Psychol., vol. 84, no. 6, pp. 1236-1256, 2003. (Pubitemid 37189381)
42. P. J. Rentfrow, L. R. Goldberg, and D. Levitin, "The structure of musical preferences: A five-factor model," J. Personality Soc. Psychol., vol. 100, no. 6, pp. 1139-1157, 2011.
43. T. Chamorro-Premuzic et al., "Personality, self-estimated intelligence, and uses of music: A Spanish replication and extension using structural equation modeling," Psychol. Aesthet., Creativ. Arts, vol. 3, no. 3, pp. 149-155, 2009.
44. O. Ladinig and E. G. Schellenberg, "Liking unfamiliar music: Effects of felt emotion and individual differences," Psychol. Aesthet., Creativ. Arts, vol. 6, no. 2, pp. 146-154, 2011.
45. L. R. Goldberg, "An alternative description of personality: the big-five factor structure," J. Personality Soc. Psychol., vol. 59, no. 6, pp. 1216-1229, 1990.
46. J. A. Russell, "A circumplex model of affect," J. Personality Soc. Sci., vol. 39, no. 6, pp. 1161-1178, 1980.
47. M. Bradley and P. J. Lang, Affective Norms for EnglishWords ANEW: Instruction Manual and Affective Ratings.The Center for Research in Psychophysiology, Univ. Florida, Tech. Rep., 1999.
48. D. Cabrera, S. Ferguson, and E. Schubert, "Psysound3: software for acoustic and psychoacoustic analysis of sound recordings," in Proc. Int. Conf. Auditory Display, 2007, pp. 356-363. [Online]. Available: http://psysound.wikidot.com/.
49. O. Lartillot and P. Toiviainen, "MIR in matlab (II): a toolbox for musical feature extraction from audio," in Proc. Int. Soc. Music Info. Retrieval Conf., 2007, pp. 127-130. [Online]. Available: http://users.jyu.fi/lartillo/mirtoolbox/.
50. F. Sebastiani, "Machine learning in automated text categorization," ACM Comput. Surveys, vol. 34, no. 1, pp. 1-47, 2002.
51. A. Aizawa, "An information-theoretic perspective of tf-idf measures," Inf. Process. Manage., vol. 39, pp. 45-65, 2003. (Pubitemid 35452378)
52. S. E. Robertson et al., "Okapi at trec-4," in Proc. Text REtrieval Conf. (TREC-4), 1995, pp. 73-96.
53. M. Lan et al., "Supervised and traditional term weighting methods for automatic text categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, pp. 721-735, 2009.
54. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. ACM SIGIR Conf. Res. and Develop. in Inf. Retrieval, 1999, pp. 50-57.
55. R.-E. F. Fan et al., "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, 2008.
56. X.-Y. Liu, J. Wu, and Z.-H. Zhou, "Exploratory under-sampling for class-imbalance learning," IEEE Trans. Syst., Man, Cybern., vol. 39, no. 2, pp. 539-553, 2009.
57. C. Cortes and M. Mohri, "Auc optimization vs. error rate minimization," in Proc. Conf. Advances in Neural Inf. Processing Syst., 2004.
58. K. Jarvelin and J. Kekalainen, "Cumulated gain-based evaluation of IR techniques," ACM Trans. Inf. Syst., vol. 20, no. 4, pp. 422-446, 2002. (Pubitemid 44642296)
59. D. C. Montgomery, G. C. Runger, and N. F. Hubele, Engineering Statistics. New York, NY, USA: Wiley, 1998.
60. D. Tingle, Y. E. Kim, and D. Turnbull, "Exploring automatic music annotation with acoustically objective tags," in Proc. ACM Int. Conf. Multimedia Inf. Retrieval, 2010, pp. 55-62.
61. C.-C. Chang and C.-J. Lin, LIBSVM:ALibrary for SupportVector Machines, 2001. [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm.
62. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006. [Online]. Available: http://www.gaussianprocess.org/.
63. L. L. Nathans, F. L. Oswald, and K. Nimon, "Interpreting multiple linear regression: A guidebook of variable importance," Practical Assess., Res., Eval., vol. 17, no. 9, pp. 1-19, 2012.
64. J. W. Pennebaker, M. E. Francis, and R. J. Booth, Linguistic inquiry and word count-LIWC2001, 2001. [Online]. Available: http://www. liwc.net/descriptiontable1.php.
65. M. Coltheart, "The MRC Psycholinguistic database," Quart. J. Exp. Psychol. Section A, vol. 33, no. 4, pp. 497-505, 1981.
66. M. Kaminskas and F. Ricci, "Contextual music information retrieval and recommendation: State of the art and challenges," Comput. Sci. Rev., vol. 6, no. 2-3, pp. 89-119, 2012.
67. G. T. Elliott and B. Tomlinson, "Personalsoundtrack: contextaware playlists that adapt to user pace," in Proc. ACM CHI, 2006, pp. 736-741.
68. N. Bolger, A. Davis, and E. Rafaeli, "Diary methods: capturing life as it is lived," Annu Rev. Psychol., vol. 54, pp. 579-616, 2003. (Pubitemid 37417506)