Emotional accompaniment generation system based on harmonic progression

IEEE Transactions on Multimedia

Volumn 15, Issue 7, 2013, Pages 1469-1479

  Chen, Pei Chun ^a   Lin, Keng Sheng ^b   Chen, Homer H ^b  

^a Stanford University   (United States)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Accompaniment; harmonic progression; melody; music emotion; onset rate

Indexed keywords

ACCOMPANIMENT; GENERATION SYSTEMS; HARMONIC PROGRESSION; KEY FEATURE; MELODY; MUSIC EMOTIONS; SPEARMAN CORRELATION;

HARMONIC ANALYSIS;

BEHAVIORAL RESEARCH;

EID: 84886492386     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2267206     Document Type: Article

References (44)

1. P. Juslin and J. Sloboda, Music and Emotion: Theory and Research. Oxford, U.K.: Oxford Univ. Press, 2001, pp. 45-70.
2. L. Meyer, Emotion and Meaning in Music. Chicago, IL: Univ. of Chicago Press, 1956, pp. 25-27.
3. P. Tagg, "Melody and accompaniment," in Encyclopedia of Popular Music of the World, 2009, pp. 1-23.
4. E. Aldwell and C. Schachter, Harmony and Voice Leading, 2nd ed. San Diego, CA: Harcourt Brace Jovanovich, 1989, pp. 102-203.
5. R. Parncutt, Harmony: A Psychoacoustical Approach. NewYork: Springer-Verlag, 1989, vol. 19, ch. 4-5.
6. M. Doucleff, "Anatomy of a tear-jerker," Wall Street J. Feb. 11, 2012 [Online]. Available: http://goo.gl/5Y6Sa
7. C. Dahlhaus, "Harmony," in The New Grove Dictionary of Music and Musicians, 2nd ed. Washington, DC: Groves Dictionaries of Music, 2001, vol. 10, pp. 858-877.
8. J. Stambaugh, "Music as temporal form," J. Phil., vol. 61, no. 9, pp. 265-280, 1964.
9. H.-T. Cheng, Y.-H.Yang, Y.-C. Lin, I.-B. Liao, and H.H. Chen, "Automatic chord recognition for music classification and retrieval," in Proc. Int. Conf. Multimedia Expo, 2008, pp. 1-4.
10. V. R. Madgazin, "The Information Theory of Emotions of Musical Chords," Ph.D. dissertation, Dept. Comp. Sci., Cornell Univ., Ithaca, NY, USA, 2009, pp. 1-5.
11. P. Gomez and B. Danuser, "Relationships between musical structure and psychophysiological measures of emotion," Emotion, vol. 7, pp. 377-387, 2007. (Pubitemid 46800378)
12. R. E. Thayer, The Biopsychology of Mood and Arousal. NewYork: Oxford Univ. Press, 1989, ch. 2-5.
13. A. P. Oliveira and A. Cardoso, "A musical system for emotional expression," J. Knowledge-Based Systems, vol. 23, no. 8, pp. 901-913, 2010.
14. A. Gabrielsson and E. Lindström, "The influence of musical structure on emotional expression," Music and Emotion: Theory and Res., pp. 223-248, 2001.
15. C. Laurier, O. Lartillot, T. Eerola, and P. Toiviainen, "Exploring relationships between audio features and emotion in music," in 7th ESCOM, 2009, pp. 1-5.
16. B. Vercoe, "The computer as musical accompanist," ACM SIGCHI Bull., vol. 17, no. 4, pp. 41-43, 1986.
17. R. Dannenberg, "An online algorithm for real-time accompaniment," in Proc. Int. ComputerMusic Conf., San Francisco, 1985, pp. 193-198.
18. M. Puckette and C. Lippe, "Score following in practice," in Proc. ICMC, San Jose, 1992, pp. 199-200.
19. A. Cont, D. Schwarz, N. Schnell, and C. Raphael, "Evaluation of realtime audio-to-score alignment," in ISMIR, Vienna, Oct. 2007, pp. 1-2.
20. C. Raphael, "A probabilistic expert system for automatic musical accompaniment," J.Comp.Graph. Stat., vol. 10, no. 3, pp. 487-512, 1999.
21. A. Jordanous and A. Smaill, "Investigating the role of score following in automatic musical accompaniment," J. New Music Research, vol. 38, no. 2, pp. 197-209, 2009.
22. C.-H. Chuan and E. Chew, "A hybrid system for automatic generation of style-specific accompaniment," in Proc. 4th Int. Joint Workshop on Comput. Creativity, 2007, pp. 1-8.
23. I. Simon,D. Morris, and S. Basu, "Mysong: Automatic accompaniment generation for vocal melodies," in Proc. CHI, 2008, pp. 1-10.
24. D. Morris, I. Simon, and S. Basu, "Exposing parameters of a trained dynamic model for interactive music creation," in Proc. AAAI, Chicago, Jul. 2008, pp. 1-8.
25. Y.-H. Yang and H. H. Chen, Music Emotion Recognition. Boca Raton, FL: CRC/Taylor & Francis, 2011, pp. 23-97.
26. M. Wollmer, F. Eyben, S. Reiter, B. Schuller, C. Cox, E. Douglas-Cowie, and R. Cowie, "Abandoning emotion classes-Towards continuous emotion recognition with modelling of long-range dependencies," in Proc. Interspeech, 2008, pp. 597-600.
27. Y.-H. Yang, Y.-C. Lin, Y.-F. Su, and H.-H. Chen, "A regression approach to music emotion recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 448-457, 2008.
28. I.Wallis, T. Ingalls, and E. Campana, "Computer generating emotional music: The design of an affective music algorithm," in Proc. Int. Conf. Digital Audio Effects, 2008, pp. 7-12.
29. P. N. Juslin and P. Laukka, "Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening," J. New Music Res., vol. 33, no. 3, pp. 217-238, 2004.
30. T. Eerola and P. Toiviainen, MIDI Toolbox: MATLAB Tools for Music Research. Jyväskylä, Finland: Univ. Jyväskylä, 2004, pp. 8-31.
31. C. Smit, "Karaoke midi toolbox," 2010 [Online]. Available: http://www.ee.columbia.edu/~csmit/matlab-midi.html
32. B. Benward and G. White, Music in Theory and Practice, 4th ed. Dubuque, IA: Brown, 1989, vol. 1, ch. 3-4.
33. C. Becchetti and L. P. Ricotti, Speech Recognition Theory and C++ Implementation. New York: Wiley, 1999, ch. 6.
34. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, MA: MIT Press, 1999, ch. 4.
35. M. Besson and D. Schön, "Comparison between language and music," in Ann. New York Acad. Science. New York: New York Academy of Sci., 2001, vol. 930, pp. 232-258. (Pubitemid 32611844)
36. Y.-H. Yang and H. H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Trans. Audio, Speech, Language Processing, vol. 19, no. 4, pp. 762-774, 2011.
37. C. L. Krumhansl, "Rhythm and pitch in music cognition," Psychol. Bull., vol. 126, pp. 159-179, 2000.
38. E. Schubert, "Modeling perceived emotion with continuous musical features," Music Perception, vol. 21, pp. 561-585, 2004.
39. F. Blume, Classic and Romantic Music: A Comprehensive Survey. New York: Norton, 1970, pp. 53-100.
40. B. Glenn, "A thorough Harping on Alberti," Music Res. Forum, vol. 4, pp. 1-10, 1989.
41. J. L. Myers and A. D. Well, Research Design and Statistical Analysis, 2nd ed. Mahwah, NJ, USA: Erlbaum, 2003, pp. 506-509.
42. J. S. Maritz, Distribution-Free Statistical Methods. New York: Chapman and Hall, 1981, pp. 216-218.
43. M. Melucci and N. Orio, "Evaluating automatic melody segmentation aimed at music information retrieval," in Proc. JCDL, 2002, pp. 310-311.
44. M. Ferrand, P. Nelson, and G. Wiggins, "Memory and melodic density: A model for melody segmentation," in Proc. XIV CIM, 2003, pp. 95-98.