Directing physiology and mood through music: Validation of an affective music player

IEEE Transactions on Affective Computing

Volumn 4, Issue 1, 2013, Pages 57-68

  Van Der Zwaag, Marjolein D ^a   Janssen, Joris H ^a   Westerink, Joyce H D M ^a  

^a PHILIPS RESEARCH LABORATORIES   (Netherlands)

Author keywords

Affective music player; mood; music; physiology; skin conductance; skin temperature

Indexed keywords

MOOD; MUSIC; MUSIC PLAYERS; SKIN CONDUCTANCE; SKIN TEMPERATURES;

HUMAN COMPUTER INTERACTION; MATHEMATICAL MODELS;

PHYSIOLOGY;

EID: 84876223741     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/T-AFFC.2012.28     Document Type: Article

References (61)

1. P.N. Juslin and J. Sloboda, Handbook of Music and Emotion: Theory, Research, Applications. Oxford Univ. Press, 2010.
2. J.J. Gross, Handbook of Emotion Regulation. Guilford Press, 2007.
3. A.C. North and D.J. Hargreaves, The Social and Applied Psychology of Music. Oxford Univ. Press, 2008.
4. A.M. Isen, "Positive Affect and Decision Making," Handbook of Emotions, second ed., C.R. Snyder and S. Lopez, eds., pp. 417-435, Oxford Univ. Press, 2000.
5. G.H.E. Gendolla, "On the Impact of Mood on Behavior: An Integrative Theory and a Review," Rev. of General Psychology, vol. 4, pp. 378-408, 2000.
6. T. Lesiuk, "The Effect of Preferred Music on Mood and Performance in a High-Cognitive Demand Occupation," J. Music Therapy, vol. 47, no. 2, pp. 137-154, 2010.
7. J.H. Janssen, E.L. Van den Broek, and J.H.D.M. Westerink, "Tune in to Your Emotions: A Robust Personalized Affective Music Player," User Modeling and User Adapted Interaction, vol. 22, pp. 25-279, 2012.
8. N. Oliver and L. Kreger-Stickles, "Papa: Physiology and Purpose-Aware Automatic Playlist Generation," Proc. Seventh Int'l Conf. Music Information Retrieval, pp. 250-253, 2006.
9. G.G. Cassidy and R.A.R. MacDonald, "The Effects of Music Choice on Task Performance: A Study of the Impact of Self-Selected and Experimenter-Selected Music on Driving Game Performance and Experience," Musicae Scientiae, vol. 13, pp. 357-386, 2009.
10. P. Wilhelm and D. Schoebi, "Assessing Mood in Daily Life," European J. Psychological Assessment, vol. 23, no. 3, pp. 258-267, 2007.
11. V. Konecni, "Social Interaction and Musical Preference," The Psychology of Music, D. Deutsch, ed., pp. 497-516, Academic Press, 1982.
12. R.M. Yerkes and J.D. Dodson, "The Relation of Strength of Stimulus to Rapidity of Habit-Formation," J. Comparative Neurology and Psychology, vol. 18, pp. 459-482, 1908.
13. D.E. Berlyne, Aesthetics and Psychobiology. Appleton-Century-Crofts, 1971.
14. D. Hodges, "Psycho-Physiological Measures," Handbook of Music and Emotions: Theory, Research, Applications, second ed., P.N. Juslin and J.A. Sloboda, eds., chapter 11, pp. 279-311, Oxford Univ. Press, 2010.
15. R.A. Calvo and S. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan. 2010.
16. J.H. Janssen, J.N. Bailenson, W.A. IJsselsteijn, and J.H.D.M. Westerink, "Intimate Heartbeats: Opportunities for Affective Communication Technology," IEEE Trans. Affective Computing, vol. 1, no. 2, pp. 72-80, July-Dec. 2010.
17. R.W. Picard, Affective Computing. MIT Press, 1997.
18. M.D. Van der Zwaag, J.H.D.M. Westerink, L.J.M. Mulder, D. de Waard, and K.A. Brookhuis, "Sustaining Moods with Background Music: Physiological Patterns and Subjective Experience," submitted for publication.
19. J.T. Cacioppo, L. Tassinary, and G.G. Berntson, Handbook of Psychophysiology. Cambridge Univ. Press, 2007.
20. C.L. Krumhansl, "An Exploratory Study of Musical Emotions and Psychophysiology," Canadian J. Experimental Psychology, vol. 51, pp. 336-353, 1997.
21. I. Nyklicek, J.F. Thayer, and L.J.P. Van Doornen, "Cardiorespiratory Differentiation of Musically-Induced Emotions." J. Psychophysiology, vol. 11, pp. 304-321, 1997. (Pubitemid 28029931)
22. L. Venables and S.H. Fairclough, "The Influence of Performance Feedback on Goal-Setting and Mental Effort Regulation," Motivation and Emotion, vol. 33, pp. 63-74, 2009.
23. M.D. Van der Zwaag and J.H.D.M. Westerink, "Physiological Patterns during Music Mood Induction," submitted for publication.
24. M.D. Van der Zwaag, J.H.D.M. Westerink, and E.L. Van den Broek, "Emotional and Psychophysiological Responses to Tempo, Mode, and Percussiveness," Musicae Scientiae, vol. 15, no. 2, pp. 250-269, 2011.
25. L.-O. Lundqvist, F. Carlsson, P. Hilmersson, and P.N. Juslin, "Emotional Responses to Music: Experience, Expression, and Physiology," Psychology of Music, vol. 37, pp. 61-90, 2009.
26. R.A. McFarland, "Relationship of Skin Temperature Changes to the Emotions Accompanying Music," Biofeedback and Self-Regulation, vol. 10, pp. 255-267, 1985. (Pubitemid 16024324)
27. S. Rimm-Kaufman and J. Kagan, "The Psychological Significance of Changes in Skin Temperature," Motivation and Emotion, vol. 20, pp. 64-78, 1996.
28. R.A. McFarland and R. Kadish, "Sex Differences in Finger Temperature Response to Music," Int'l J. Psychophysiology, vol. 11, pp. 295-298, 1991.
29. B. Mittelmann and H. Wolff, "Emotions and Skin Temperature: Observations on Patients during Psychotherapeutic (Psychoanalytic) Interviews," Psychosomatic Medicine, vol. 5, pp. 211-231, 1943.
30. U.M. Nater, E. Abbruzzese, M. Krebs, and U. Ehlert, "Sex Differences in Emotional and Psychophysiological Responses to Musical Stimuli," Int'l J. Psychophysiology, vol. 62, pp. 300-308, 2006. (Pubitemid 44441612)
31. E.N. Marieb and K. Hoehn, Human Anatomy & Physiology, seventh ed. Pearson Education, 2007.
32. J.-W. Chung and G.S. Vercoe, "The Affective Remixer: Personalized Music Arranging," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '06), pp. 393-398, 2006.
33. J. Kim and E. André, "Emotion Recognition Based on Physiological Changes in Music Listening," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2067-2083, Dec. 2008.
34. J. Skowronek, M.F. McKinney, and S. Van de Par, "Ground Truth for Automatic Music Mood Classification," Proc. Seventh Int'l Conf. Music Information Retrieval (ISMIR), pp. 395-396, 2006.
35. J. Skowronek, M.F. McKinney, and S. Van de Par, "A Demonstrator for Automatic Music Mood Estimation," Proc. Eighth Int'l Conf. Music Information Retrieval (ISMIR), pp. 345-346, 2007.
36. M.D. Van der Zwaag, J.H.D.M. Westerink, and E.L. Van den Broek, "Deploying Music Characteristics for an Affective Music Player," Proc. IEEE Int'l Conf. Affective Computing & Intelligent Interaction, J. Cohn, A. Nijholt, and M. Pantic, eds., pp. 459-465, 2009.
37. G. Wijnalda, S. Pauws, F. Vignoli, and H. Stuckenschmidt, "A Personalized Music System for Motivation in Sport Performance," IEEE Pervasive Computing, vol. 4, no. 3, pp. 26-32, July/Sept. 2005. (Pubitemid 43079933)
38. S. Zhang, Q. Tian, S. Jiang, Q. Huang, and W. Gao, "Affective MTB Analysis Based on Arousal and Valence Features," Proc. IEEE Int'l Conf. Multimedia and Expo (ICME '08), pp. 1369-1372, 2008.
39. N. Oliver and F. Flores-Mangas, "MPTrain: A Mobile, Music and Physiology-Based Personal Trainer," Proc. Eighth Conf. Human-Computer Interaction with Mobile Devices and Services, pp. 21-28, 2006. (Pubitemid 47140781)
40. J.A. Healey, R.W. Picard, and F. Dabek, "A New Affect-Perceiving Interface and Its Application to Personalized Music Selection," Proc. Workshop Perceptual User Interfaces (PUI), M. Turk, ed., pp. 2-5, 1998.
41. J.H. Janssen, E.L. Van den Broek, and J.H.D.M. Westerink, "Personalized Affective Music Player," Proc. IEEE Int'l Conf. Affective Computing and Intelligent Interaction (ACII), pp. 472-477, 2009.
42. K. Höö k, "Affective Loop Experiences: What Are They?" Proc. Third Int'l Conf. Persuasive Technology, pp. 1-12, 2008.
43. K. Höö k, "Affective Loop Experiences: Designing for Interactional Embodiment," Philosophical Trans. Royal Soc. B, vol. 364, pp. 3585-3595, 2009.
44. R. Geenen and F.J.R. Van de Vijver, "A Simple Test of the Law of Initial Values," Psychophysiology, vol. 30, pp. 525-530, 1993. (Pubitemid 23250126)
45. A. Schroeder, M.D. Van der Zwaag, and M. Hammer, "A Middleware Architecture for Human-Centred Pervasive Adaptive Applications," Proc. IEEE Int'l Conf. Self-Adaptive and Self-Organizing Systems, vol. 1, pp. 138-143, 2008.
46. A. Haarmann, W. Boucsein, and F. Schaefer, "Combining Electrodermal Responses and Cardiovascular Measures for Probing Adaptive Automation during Simulated Flight," Applied Ergonomics, vol. 40, no. 6, pp. 1026-1040, 2009.
47. D. Novak, M. Mihelj, J. Ziherl, A. Olensek, and M. Munih, "Measuring Motor Actions and Psychophysiology for Task Difficulty Estimation in Human-Robot Interaction," Proc. Seventh Int'l Conf. Methods and Techniques in Behavioral Research (MB '10), pp. 1-4, 2010.
48. W.A. Wagenaar, "Note on the Construction of Digram-Balanced Latin Squares," Psychological Bull., vol. 72, no. 6, pp. 384-386, 1969.
49. J. Wilder, Stimulus and Response: The Law of Initial Values. Wright, 1967.
50. B.W. Silverman, Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
51. S.H. Fairclough and L. Venables, "Prediction of Subjective States from Psychophysiology: A Multivariate Approach," Biological Psychology, vol. 71, pp. 100-110, 2006. (Pubitemid 41797794)
52. L.J.M. Mulder, C. Dijksterhuis, A. Stuiver, and D. De Waard, "Cardiovascular State Changes during Performance of a Simulated Ambulance Dispatchers' Task: Potential Use for Adaptive Support," Applied Ergonomics, vol. 40, no. 6, pp. 965-77, 2009.
53. G. Matthews, D.M. Jones, and A.G. Chamberlain, "Refining the Measurement of Mood: The UWIST Mood Adjective Checklist," British J. Psychology, vol. 81, no. 1, pp. 17-42, 1990.
54. W. Boucsein, Electrodermal Activity, first ed. Plenum Press, 1992.
55. M.D. Van der Zwaag, S.H. Fairclough, E. Spiridon, and J.H.D.M. Westerink, "The Impact of Music on Affect during Anger Inducing Drives," Proc. Fourth Int'l Conf. Affective Computing and Intelligent Interaction, 2011.
56. M.D. Van der Zwaag, C. Dijksterhuis, D. De Waard, L.J.M. Mulder, J.H.D.M. Westerink, and K.A. Brookhuis, "The Influence of Music on Mood and Performance While Driving," Ergonomics, vol. 55, no. 1, pp. 12-22, 2012.
57. M.D. Van der Zwaag, J.H. Janssen, C. Nass, J.H.D.M. Westerink, S. Chowdhury, and D. De Waard, "Using Music to Regulate Mood While Driving," submitted for publication.
58. M.D. Van der Zwaag, T. Tijs, J.H.D.M. Westerink, and R. Molegraaf, "Personalized Relax Music to Reduce Patient Anxiety," Proc. 32nd Int'l Conf. Stress and Anxiety Research Soc. (STAR), P. Buchwald, K. Moore, and T. Ringeisen, eds., 2011.
59. M.D. Van der Zwaag, T. Tijs, and J.H.D.M. Westerink, "Personalized Calming Music to Reduce Patient Anxiety," Proc. Int'l Conf. Music Health and Wellbeing, Current Developments in Research and Practice, M. Shipton and E. Himonides, eds., pp. 211-212, 2011.
60. M. Ouwerkerk, "Unobtrusive Emotions Sensing in Daily Life," Sensing Emotions. The Impact of Context on Experience Measurements. Philips Research Book Series, 12th ed., J.H.D.M. Westerink, M. Krans, and M. Ouwerkerk, eds., pp. 21-39, Springer, 2011.
61. M.-Z. Poh, N.C. Swensen, and R.W. Picard, "A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity," IEEE Trans. Biomedical Eng., vol. 57, no. 5, pp. 1243-1252, 2010.