Intimate heartbeats: Opportunities for affective communication technology

IEEE Transactions on Affective Computing

Volumn 1, Issue 2, 2010, Pages 72-80

  Janssen, Joris H ^a,b   Bailenson, Jeremy N ^c   Ijsselsteijn, Wijnand A ^a   Westerink, Joyce H D M ^b  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b PHILIPS RESEARCH LABORATORIES   (Netherlands)

^c STANFORD UNIVERSITY   (United States)

Author keywords

and virtual realities; artificial; augmented; communications applications; nonverbal signals; Psychology; social issues

Indexed keywords

ARTIFICIAL; AUGMENTED; NON-VERBAL SIGNALS; PSYCHOLOGY; SOCIAL ISSUES;

VIRTUAL REALITY;

COMMUNICATION;

EID: 84859805519     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/T-AFFC.2010.13     Document Type: Article

References (66)

1. J.T. Cacioppo and W. Patrick, Loneliness: Human Nature and the Need for Social Connection. W.W. Norton & Company, 2008.
2. R.F. Baumeister and M.R. Leary, "The Need to Belong: Desire for Interpersonal Attachment as a Fundamental Human Motivation," Psychological Bull., vol. 117, pp. 497-529, 1995.
3. R. Axelrod and W.D. Hamilton, "The Evolution of Cooperation," Science, vol. 211, pp. 1390-1396, 1981. (Pubitemid 11107890)
4. M. Argyle, The Psychology of Happiness. Routledge, 1987.
5. D.P. McAdams and F.B. Bryant, "Intimacy Motivation and Subjective Mental Health in a Nationwide Sample," J. Personality, vol. 55, pp. 395-413, 1987.
6. J.T. Cacioppo, M.E. Hughes, L.J. Waite, L.C. Hawkley, and R.A. Thisted, "Loneliness as a Specific Risk Factor for Depressive Symptoms: Cross-Sectional and Longitudinal Analyses," Psychology and Aging, vol. 21, pp. 140-151, 2006. (Pubitemid 44212054)
7. J.J. Lynch, The Broken Heart: The Medical Consequences of Loneliness. Basic Books, 1979.
8. A. DeLongis, S. Folkman, and R.S. Lazarus, "The Impact of Daily Stress on Health and Mood: Psychological and Social Resources," J. Personality and Social Psychology, vol. 54, pp. 486-495, 1988.
9. J.S. Goodwin, W.C. Hunt, C.R. Key, and J.M. Samet, "The Effect of Marital Status on Stage, Treatment, and Survival of Cancer Patients," J. Am. Medical Assoc., vol. 258, pp. 3125-3130, 1987. (Pubitemid 17156228)
10. L.M. Diamond, A.M. Hicks, and K.D. Otter-Henderson, "Every Time You Go Away: Changes in Affect, Behavior, and Physiology Associated with Travel-Related Separations from Romantic Partners," J. Personality and Social Psychology, vol. 95, pp. 385-403, 2008.
11. M. McPherson, L. Smith-Lovin, and M.T. Brashears, "Social Isolation in America: Changes in Core Discussion Networks over Two Decades," Am. Sociological Rev., vol. 71, pp. 353-375, 2006. (Pubitemid 44137924)
12. P. Markopoulos, B. De Ruyter, and W. Mackay, Awareness Systems: Advances in Theory, Methodology, and Design. Springer, 2009.
13. D.T. Van Bel, W.A. IJsselsteijn, and Y.A. de Kort, "Interpersonal Connectedness: Conceptualization and Directions for a Measurement Instrument," Proc. Workshop Computer-Human Interaction: Extended Abstracts on Human Factors in Computing Systems, pp. 3129-3134, 2008.
14. T. Visser, P. Dadlani, D. van Bel, and S. Yarosh, "Designing and Evaluating Affective Aspects of Sociable Media to Support Social Connectedness," Proc. Workshop Computer-Human Interaction: Extended Abstracts on Human Factors in Computing Systems, pp. 4437-4440, 2010.
15. F. Vetere, M.R. Gibbs, J. Kjeldskov, S. Howard, F. Mueller, S. Pedell, K. Mecoles, and M. Bunyan, "Mediating Intimacy: Designing Technologies to Support Strong-Tie Relationships," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 471-480, 2005. (Pubitemid 41809084)
16. K. Garnæs, O. Grünberger, J. Kjeldskov, and M.B. Skov, "Designing Technologies for Presence-in-Absence," Personal and Ubiquitous Computing, vol. 11, pp. 403-408, 2007.
17. W. Gaver, "Designing for Emotion (among Other Things)," Philosophical Trans. Royal Soc. B: Biological Sciences, vol. 364, pp. 3597-3604, 2009.
18. J. Kaye, M.K. Levitt, J. Nevins, J. Golden, and V. Schmidt, "Communicating Intimacy One Bit at a Time," Proc. Workshop Human-Computer Interaction: Extended Abstracts on Human Factors in Computing Systems, pp. 1529-1532, 2005.
19. J.P. Laurenceau, L.F. Barrett, and P.R. Pietromonaco, "Intimacy as an Interpersonal Process: The Importance of Self-Disclosure, Partner Disclosure, and Perceived Partner Responsiveness in Interpersonal Exchanges," J. Personality and Social Psychology, vol. 74, pp. 1238-1251, 1998. (Pubitemid 128656641)
20. J.P. Laurenceau, L.F. Barrett, and M.J. Rovine, "The Interpersonal Process Model of Intimacy in Marriage: A Daily-Diary and Multilevel Modeling Approach," J. Family Psychology, vol. 19, pp. 314-323, 2005. (Pubitemid 41017454)
21. E.A. Butler, B. Egloff, F.H. Wilhelm, N.C. Smith, E.A. Erickson, and J.J. Gross, "The Social Consequences of Expressive Suppression," Emotion, vol. 3, pp. 48-67, 2003. (Pubitemid 37322442)
22. T.L. Chartrand and J.A. Bargh, "The Chameleon Effect: The Perception-Behavior Link and Social Interaction," J. Personality and Social Psychology, vol. 76, pp. 893-910, 1999.
23. J.L. Lakin, V.E. Jefferis, C.M. Cheng, and T.L. Chartrand, "The Chameleon Effect as Social Glue: Evidence for the Evolutionary Significance of Nonconscious Mimicry," J. Nonverbal Behavior, vol. 27, pp. 145-162, 2003.
24. C. Anderson, D. Keltner, and O.P. John, "Emotional Convergence between People over Time," J. Personality and Social Psychology, vol. 84, pp. 1054-1068, 2003. (Pubitemid 37189394)
25. W.J. Ickes, Empathic Accuracy. Guilford Press, 1997.
26. R. Banse and K.R. Scherer, "Acoustic Profiles in Vocal Emotion Expression," J. Personality and Social Psychology, vol. 70, pp. 614-636, 1996. (Pubitemid 126420699)
27. C. Darwin, P. Ekman, and P. Prodger, The Expression of the Emotions in Man and Animals. Oxford Univ. Press, 2002.
28. D. Derks, A.H. Fischer, and A.E.R. Bos, "The Role of Emotion in Computer-Mediated Communication: A Review," Computers in Human Behavior, vol. 24, pp. 766-785, 2008. (Pubitemid 351305155)
29. J.B. Walther and J.K. Burgoon, "Relational Communication in Computer-Mediated Communication," Human Comm. Research, vol. 19, pp. 50-88, 1992.
30. L.C. Tidwell and J.B. Walther, "Computer-Mediated Communication Effects on Disclosure, Impressions, and Interpersonal Evaluations: Getting to Know One Another a Bit at a Time," Human Comm. Research, vol. 28, pp. 317-348, 2002. (Pubitemid 37496225)
31. J.B. Walther, "Computer-Mediated Communication: Impersonal, Interpersonal and Hyperpersonal Interaction," Comm. Research, vol. 23, pp. 3-43, 1996.
32. A.R. Damasio, Descartes' Error: Emotion, Reason, and the Human Brain. G.P. Putnam, 1994.
33. W. James, "The Physical Basis of Emotion," Psychological Rev., vol. 1, pp. 516-529, 1894.
34. S. Schachter and J. Singer, "Cognitive, Social, and Physiological Determinants of Emotional State," Psychological Rev., vol. 69, pp. 379-399, 1962.
35. J. Blascovich, M.D. Seery, C.A. Mugridge, R. Kyle Norris, and M. Weisbuch, "Predicting Athletic Performance from Cardiovascular Indexes of Challenge and Threat," J. Experimental Social Psychology, vol. 40, pp. 683-688, 2004. (Pubitemid 39659337)
36. S. Valins, "Cognitive Effects of False Heart-Rate Feedback," J. Personality and Social Psychology, vol. 4, pp. 400-408, 1966.
37. B. Parkinson, "Emotional Effects of False Autonomic Feedback," Psychological Bull., vol. 98, pp. 471-494, 1985.
38. O.G. Cameron, "Interoception the Inside Story: A Model for Psychosomatic Process," Psychosomatic Medicine, vol. 63, pp. 697-710, 2001. (Pubitemid 32910997)
39. H.D. Critchley, S. Wiens, P. Rothstein, A. Ohman, and R.J. Dolan, "Neural Systems Supporting Interoceptive Awareness," Nature Neuroscience, vol. 7, pp. 189-195, 2004. (Pubitemid 38129796)
40. M.L. Ferguson and E.S. Katkin, "Visceral Perception, Anhedonia, and Emotion," Biological Psychology, vol. 5, pp. 131-145, 1996. (Pubitemid 26011869)
41. M. Hantas, E.S. Katkin, and J. Blascovich, "Relationship between Heartbeat Discrimination and Subjective Experience of Affective State," Psychophysiology, vol. 19, p. 563, 1982.
42. B.M. Herbert, O. Pollatos, H. Flor, P. Enck, and R. Schandry, "Cardiac Awareness and Autonomic Cardiac Reactivity during Emotional Picture Viewing and Mental Stress," Psychophysiology, vol. 49, pp. 342-354, 2010.
43. S. Wiens, E.S. Mezzacappa, and E.S. Katkin, "Heartbeat Detection and the Experience of Emotions," Cognition and Emotion, vol. 14, pp. 417-427, 2000. (Pubitemid 30367754)
44. J. Werner, R. Wettach, and E. Hornecker, "United-Pulse: Feeling Your Partner's Pulse," Proc. 10th Int'l Conf. Human Computer Interaction with Mobile Devices and Services, pp. 535-538, 2008.
45. M. Argyle and J. Dean, "Eye-Contact, Distance, and Affiliation," Sociometry, vol. 28, pp. 289-304, 1965.
46. A. Mehrabian, Nonverbal Communication. Aldine-Atherton, 1972.
47. J.K. Burgoon, L.A. Stern, and L. Dillman, Interpersonal Adaptation: Dyadic Interaction Patterns. Cambridge Univ. Press, 1995.
48. P.A. Andersen, L.K. Guerrero, D.B. Buller, and P.F. Jorgensen, "An Empirical Comparison of Three Theories of Nonverbal Immediacy Exchange," Human Comm. Research, vol. 24, pp. 501-535, 1998.
49. J.N. Bailenson, J. Blascovich, A.C. Beall, and J.M. Loomis, "Interpersonal Distance in Immersive Virtual Environments," Personality and Social Psychology Bull., vol. 29, pp. 1-15, 2002.
50. J. Blascovich, J. Loomis, A. Beall, K. Swinth, C. Hoyt, and J. Bailenson, "Immersive Virtual Environment Technology as a Research Tool for Social Psychology," Psychological Inquiry, vol. 13, pp. 103-125, 2002.
51. J.A. Fox, D. Arena, and J.N. Bailenson, "Virtual Reality: A Survival Guide for the Social Scientist," J. Media Psychology, vol. 21, pp. 95-113, 2009.
52. J.N. Bailenson, J. Blascovich, A.C. Beall, and J.M. Loomis, "Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments," Presence: Teleoperaters and Virtual Environments, vol. 10, pp. 583-597, 2001.
53. N. Yee and J.N. Bailenson, "The Proteus Effect: The Effect of Transformed Self-Representation on Behavior," Human Comm. Research, vol. 33, pp. 271-290, 2007.
54. A. Aron, E.N. Aron, M. Tudor, and G. Nelson, "Close Relationships as Including the Other in the Self," J. Personality and Social Psychology, vol. 60, pp. 241-253, 1991.
55. B. Parkinson and A.S. Manstead, "An Examination of the Roles Played by Meaning of Feedback and Attention to Feedback in the 'Valins Effect'," J. Personality and Social Psychology, vol. 40, pp. 239-245. 1981.
56. J.E. McGrath and J.R. Kelly, Time and Human Interaction: Toward a Social Psychology of Time. Guilford Press, 1986.
57. P. Ekman, R.W. Levenson, and W.V. Friesen, "Autonomic Nervous System Activity Distinguishes between Emotions," Science, vol. 221, pp. 1208-1210, 1983. (Pubitemid 13001240)
58. I.C. Christie and B.H. Friedman, "Autonomic Specificity of Discrete Emotion and Dimensions of Affective Space: A Multivariate Approach," Int'l J. Psychophysiology, vol. 51, pp. 143-153, 2004. (Pubitemid 38018963)
59. S.H. Fairclough, "Fundamentals of Physiological Computing," Interacting with Computers, vol. 21, pp. 133-145, 2009.
60. E.L. Van Den Broek, V. Lisy, J.H. Janssen, J.H.D.M. Westerink, M.H. Schut, and K. Tuinenbreijer, "Affective Man-Machine Interface: Unveiling Human Emotions through Biosignals," Biomedical Engineering Systems and Technologies, A. Fred, J. Filipe, and H. Gamboa, eds., pp. 21-47, Springer, 2010.
61. E.L. Van Den Broek, J.H. Janssen, J.H.D.M. Westerink, and J.A. Healey, "Prerequisites for Affective Signal Processing (ASP)," Proc. Int'l Conf. Bio-Inspired Systems and Signal Processing pp. 426-433, 2009.
62. J.H. Janssen, E.L. Van Den broek, and J.H.D.M. Westerink, "Personalized Affective Music Player," Proc. Third Int'l Conf. Affective Computing and Intelligent Interaction and Workshop, pp. 472-477. 2009.
63. R.W. Levenson and A.M. Ruef, "Empathy: A Physiological Substrate," J. Personality and Social Psychology, vol. 63, pp. 234-246, 1992.
64. J. Zaki, N. Bolger, and K. Ochsner, "Unpacking the Informational Bases of Empathic Accuracy," Emotion, vol. 9, pp. 478-487, 2009.
65. J.H.D.M. Westerink, G. De Vries, S. De Waele, J. Eerenbeemd, M. Van Boven, and M. Ouwerkerk, "Emotion Measurement Platform for Daily Life Situations," Proc. Third Int'l Conf. Affective Computing and Intelligent Interaction and Workshop, pp. 217-223, 2009.
66. M.A. Hanson, H.C. Powell, Jr., A.T. Barth, K. Ringenberg, B.H. Calhoun, and J.H. Aylor, "Body Area Sensor Networks: Challenges and Opportunities," Computer, vol. 42, no. 1, pp. 58-65, Jan. 2009.