ADVISOR - Personalized video soundtrack recommendation by late fusion with heuristic rankings

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 607-616

  Shah, Rajiv Ratn ^a   Yu, Yi ^a   Zimmermann, Roger ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Geographic category; Music retrieval; Scene mood prediction; User preference; Video soundtrack generation

Indexed keywords

GEOGRAPHIC CATEGORY; MUSIC RETRIEVAL; OUTDOOR ACTIVITIES; PERSONALIZED VIDEO; REAL WORLD VIDEOS; USER PREFERENCE; USER-GENERATED VIDEO; VIDEO SOUNDTRACK GENERATION;

SOUND RECORDING;

EID: 84913553761     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654919     Document Type: Conference Paper

References (35)

1. K. Aizawa, D. Tancharoen, S. Kawasaki, and T. Yamasaki. Efficient Retrieval of Life Log based on Context and Content. In ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, pages 22-31, 2004.
2. B. Chen, J. Wang, Q. Huang, and T. Mei. Personalized Video Recommendation through Tripartite Graph Propagation. In ACM International Conference on Multimedia, pages 1133-1136, 2012.
3. J. Cohen. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, 20(1):37-46, 1960.
4. M. Cristani, A. Pesarin, C. Drioli, V. Murino, A. Rodà, M. Grapulin, and N. Sebe. Toward an Automatically Generated Soundtrack from Low-level Cross-modal Correlations for Automotive Scenarios. In ACM Int'l Conference on Multimedia, pages 551-560, 2010.
5. A. Ghias, J. Logan, D. Chamberlin, and B. C. Smith. Query by Humming: Musical Information Retrieval in an Audio Database. In ACM International Conference on Multimedia, pages 231-236, 1995.
6. A. Hanjalic and L.-Q. Xu. Affective Video Content Representation and Modeling. In IEEE Transactions on Multimedia, 7(1):143-154, 2005.
7. K. Hevner. Experimental Studies of the Elements of Expression in Music. The American Journal of Psychology, pages 246-268, 1936.
8. T. Joachims, T. Finley, and C.-N. Yu. Cutting-plane Training of Structural SVMs. Machine Learning Journal, 77(1):27-59, 2009.
9. M. Kaminskas and F. Ricci. Location-adapted Music Recommendation using Tags. In User Modeling, Adaption and Personalization, pages 183-194. Springer, 2011.
10. H. B. Kang. Affective Content Detection using HMMs. In ACM International Conference on Multimedia, pages 259-262, 2003.
11. Y. E. Kim, E. M. Schmidt, R. Migneco, B. G. Morton, P. Richardson, J. Scott, J. A. Speck, and D. Turnbull. Music Emotion Recognition: A State of the Art Review. In International Society for Music Information Retrieval (ISMIR), pages 255-266, 2010.
12. Y. Ko. A Study of Term Weighting Schemes using Class Information for Text Classification. In ACM Special Interest Group on Information Retrieval (SIGIR), pages 1029-1030, 2012.
13. O. Kucuktunc, U. Gudukbay, and O. Ulusoy. Fuzzy Color Histogram-based Video Segmentation. In Computer Vision and Image Understanding, 114(1):125-134, 2010.
14. F.-F. Kuo, M.-F. Chiang, M.-K. Shan, and S.-Y. Lee. Emotion-based Music Recommendation by Association Discovery from Film Music. In ACM International Conference on Multimedia, pages 507-510, 2005.
15. C. Laurier, M. Sordo, J. Serrà, and P. Herrera. Music Mood Representations from Social Tags. In Int'l Society for Music Information Retrieval (ISMIR), pages 381-386, 2009.
16. C. T. Li and M. K. Shan. Emotion-based Impressionism Slideshow with Automatic Music Accompaniment. In ACM Int'l Conference on Multimedia, pages 839-842, 2007.
17. L. Lu, H. You, and H. Zhang. A New Approach to Query by Humming in Music Retrieval. In IEEE Int'l Conference on Multimedia and Expo (ICME), pages 22-25, 2001.
18. M. H. Park, J. H. Hong, and S. B. Cho. Location-based Recommendation System using Bayesian User's Preference Model in Mobile Devices. In Ubiquitous Intelligence and Computing, pages 1130-1139. Springer, 2007.
19. H. Rahmani, B. Piccart, D. Fierens, and H. Blockeel. Three Complementary Approaches to Context Aware Movie Recommendation. In ACM Workshop on Context-Aware Movie Recommendation, pages 57-60, 2010.
20. J. A. Russell. A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39:1161-1178, 1980.
21. M. Sahidullah and G. Saha. Design, Analysis and Experimental Evaluation of Block based Transformation in MFCC Computation for Speaker Recognition. In Speech Communication, volume 54, pages 543-565, 2012.
22. M. Schedl and D. Schnitzer. Location-Aware Music Artist Recommendation. In MultiMedia Modeling, pages 205-213. Springer, 2014.
23. B. Schuller, C. Hage, D. Schuller, and G. Rigoll. Mister DJ, Cheer Me Up!: Musical and Textual Features for Automatic Mood Classification. In Journal of New Music Research, 39(1):13-34, 2010.
24. R. R. Shah, Y. Yu, and R. Zimmermann. User Preference-Aware Music Video Generation Based on Modeling Scene Moods. In ACM Int'l Conference on Multimedia Systems (MMSys), pages 156-159, 2014.
25. C. G. Snoek, M. Worring, and A. W. Smeulders. Early versus Late Fusion in Semantic Video Analysis. In ACM Int'l Conference on Multimedia, pages 399-402, 2005.
26. C. G. Snoek, M. Worring, J. C. Van Gemert, J.-M. Geusebroek, and A. W. Smeulders. The Challenge Problem for Automated Detection of 101 Semantic Concepts in Multimedia. In ACM International Conference on Multimedia, pages 421-430, 2006.
27. M. Soleymani, J. J. M. Kierkels, G. Chanel, and T. Pun. A Bayesian Framework for Video Affective Representation. In IEEE Int'l Conference on Affective Computing and Intelligent Interaction and Workshops, pages 1-7, 2009.
28. R. E. Thayer. The Biopsychology of Mood and Arousal. Oxford University Press, 1989.
29. H. L. Wang and L. F. Cheong. Affective Understanding in Film. In IEEE Transactions on Circuits and Systems for Video Technology, 16(6):689-704, 2006.
30. C. Y. Wei, N. Dimitrova, and S.-F. Chang. Color-mood Analysis of Films based on Syntactic and Psychological Models. In IEEE International Conference on Multimedia and Expo (ICME), pages 831-834, 2004.
31. Y. H. Yang, Y. C. Lin, Y. F. Su, and H. H. Chen. A Regression Approach to Music Emotion Recognition. In IEEE Transactions on Audio, Speech, and Language Processing, 16(2):448-457, 2008.
32. G. Ye, D. Liu, I.-H. Jhuo, and S.-F. Chang. Robust Late Fusion with Rank Minimization. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3021-3028, 2012.
33. Y. Yu, K. Joe, V. Oria, F. Moerchen, J. S. Downie, and L. Chen. Multi-version Music Search using Acoustic Feature Union and Exact Soft Mapping. In International Journal of Semantic Computing, 3(02):209-234, 2009.
34. Y. Yu, Z. Shen, and R. Zimmermann. Automatic Music Soundtrack Generation for Outdoor Videos from Contextual Sensor Information. In ACM International Conference on Multimedia, pages 1377-1378, 2012.
35. R. Zimmermann and Y. Yu. Social Interactions over Geographic-aware Multimedia Systems. In ACM Int'l Conference on Multimedia, pages 1115-1116, 2013.