Connecting brains and bodies: Applying physiological computing to support social interaction

Interacting with Computers

Volumn 27, Issue 5, 2015, Pages 534-550

  Chanel, Guillaume ^a   Mühl, Christian ^b  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

Affective computing; Collaborative and social computing; Collaborative interaction; Human centered computing; Law social en behavioral sciences; Physiological computing

Indexed keywords

BEHAVIORAL RESEARCH; SIGNAL PROCESSING; SOCIAL COMPUTING; SOCIAL SCIENCES COMPUTING;

AFFECTIVE COMPUTING; BEHAVIORAL SCIENCE; COLLABORATIVE INTERACTION; HUMAN-CENTERED COMPUTING; PHYSIOLOGICAL COMPUTING;

PHYSIOLOGY;

EID: 84941909368     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1093/iwc/iwv013     Document Type: Review

References (142)

1. Adolphs, R. (2003) Cognitive neuroscience of human social behaviour. Nat. Rev. Neurosci., 4, 165-178.
2. Allison, P.D. and Liker, J.K. (1982) Analyzing sequential categorical data on dyadic interaction: a comment on Gottman. Psychol. Bull., 91, 393-403.
3. Astolfi, L., Toppi, J., De Vico Fallani, F., Vecchiato, G., Salinari, S., Mattia, D., Colosimo, A., Babiloni, F. (2010) Neuroelectrical hyperscanning measures simultaneous brain activity in humans. Brain Topogr., 23, 243-256.
4. Astolfi, L. et al. (2011a) Study of the Functional Hyperconnectivity Between Couples of Pilots During Flight Simulation: An EEG Hyperscanning Study. In Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society, pp. 2338-2341. IEEE.
5. Astolfi, L. et al. (2011b) Imaging the social brain by simultaneous hyperscanning during subject interaction. IEEE Intell. Syst., 26, 38-45.
6. Babiloni, F. and Astolfi, L. (2012) Social neuroscience and hyperscanning techniques: past, present and future. Neurosci. Biobehav. Revi. doi:10.1016/j.neubiorev.2012.07.006.
7. Babiloni, F. et al. (2007a) Cortical Activity and Connectivity of Human Brain During the Prisoner's Dilemma: An EEG Hyperscanning Study. In Conference Proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society, pp. 4953-4956.
8. Babiloni, F. et al. (2007b) High Resolution EEG Hyperscanning During a Card Game. In 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4957-4960. IEEE.
9. Babiloni, C. et al. (2012) Brains 'in concert': frontal oscillatory alpha rhythms and empathy in professional musicians. NeuroImage, 60, 105-116.
10. Barrett, L.F. and Satpute, A.B. (2013) Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain. Curr. Opin. Neurobiol., 1-12. doi:10.1016/j.conb.2012.12.012.
11. Barrett, L.F., Mesquita, B., Ochsner, K.N. and Gross, J.J. (2007) The experience of emotion. Ann. Rev. Psychol., 58, 373-403.
12. Barry, R.J., Clarke, A.R., Johnstone, S.J., Magee, C.A. and Rushby, J.A. (2007) EEG differences between eyes-closed and eyes-open resting conditions. Clin. Neurophysiol., 118, 2765-2773.
13. Barry, R.J., Clarke, A.R., Johnstone, S.J. and Brown, C.R. (2009) EEG differences in children between eyes-closed and eyes-open resting conditions. Clin. Neurophysiol., 120, 1806-1811.
14. Bartlett, M.S., Littlewort, G.C., Frank, M.G. and Lee, K. (2014) Automatic decoding of facial movements reveals deceptive pain expressions. Current Biol., 24(7), 738-743.
15. Biocca, F. and Harms, C. (2003a) Guide to the Networked Minds Social Presence Inventory v. 1.2: measures of copresence, social presence, subjective symmetry, and intersubjective symmetry. Retrieved from http://cogprints.org/6743/1/2002-guide-netminds-measure.pdf.
16. Biocca, F. and Harms, C. (2003b) Toward a more robust theory and measure of social presence: review and suggested criteria. Presence, 12, 456-480.
17. Boucsein, W. (1992) Electrodermal Indices of Emotion and Stress. In Electrodermal Activity, pp. 369-391. Springer, New York.
18. Broek, E.L., van den Schut, M.H., Westerink, J.H.D.M., Herk, J., van Tuinenbreijer, K., van den Broek, E. L. and van Herk, J. (2006) Computing Emotion Awareness through Facial Electromyography. In Huang, T.S., Sebe, N., Lew, M.S., Pavlovic, V., Kölsch, M., Galata, A. and Kisacanin, B. (eds.) ECCV 2006Workshop on HCI, LNCS 3979, pp. 52-63. Springer, Graz, Austria.
19. Burgess, A.P. (2013) On the interpretation of synchronization in EEG hyperscanning studies: a cautionary note. Front. Hum. Neurosci., 7, 881.
20. Cacioppo, J.T., Petty, R.E. and Tassinary, L.G. (1989) Social psychophysiology: a new look. Adv. Exp. Soc. Psychol., 22, 39-91.
21. Calvo, R.A. and D'Mello, S. (2010) Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput., 1, 18-37.
22. Castellano, G., Villalba, S. and Camurri, A. (2007) Recognising Human Emotions from Body Movement and Gesture Dynamics. In Paiva, A., Prada, R. and Picard, R.W. (eds) Affective Computing and Intelligent Interaction, LNCS 4738, pp. 71-82. Springer, Berlin, Heidelberg.
23. Castellano, G., Caridakis, G., Camurri, A., Karpouzis, K., Volpe, G. and Kollias, S. (2010) Body Gesture and Facial Expression Analysis for Automatic Affect Recognition. In Scherer, K.R., Baenziger, T. and Roesch, E.B. (eds) Blueprint for Affective Computing: A Sourcebook, pp. 245-255. Oxford University Press, Oxford, England.
24. Chanel, G., Kierkels, J.J.M., Soleymani, M. and Pun, T. (2009) Shortterm emotion assessment in a recall paradigm. Int. J. Hum.-Comput. Stud., 67, 607-627.
25. Chanel, G., Pelli, S., Ravaja, N. and Kuikkaniemi, K. (2010) Social Interaction Using Mobile Devices and Biofeedback: Effects on Presence, Attraction and Emotions. In BioSPlay Workshop, Fun and Games Conference. Leuven, Belgium. http://www.physiologicalcomputing.net/workshops/biosplay2010/BioSPlay-Chanel%20et%20al%20%28Synchro%29.pdf.
26. Chanel, G., Rebetez, C., Bétrancourt, M. and Pun, T. (2011) Emotion assessment from physiological signals for adaptation of games difficulty. IEEE Trans. Syst. Man Cybern., Part A, 41, 1052-1063.
27. Chanel, G., Kalogianni, K., Pun, T. and Betrancourt, M. (2012a) GamEMO: How Physiological Signals Show your Emotions and Enhance your Game Experience. In 14th ACM International Conference on Multimodal Interaction. Santa Monica, CA, USA. ACM.
28. Chanel, G., Kivikangas, J. M. and Ravaja, N. (2012b) Physiological compliance for social gaming analysis: cooperative versus competitive play. Interact. Comput., 24, 306-3016.
29. Chanel, G., Molinari, G., Cereghetti, D., Bétrancourt, M. and Pun, T. (2013) Assessment of Computer-Supported Collaborative Processes using Interpersonal Physiological and Eye-Movement Coupling. In Conference on Affective Computing and Intelligent Interaction. Geneva, Switzerland.
30. Chenes, C., Chanel, G., Soleymani, M. and Pun, T. (2013) Highlights Detection in Movie Scenes Through Inter-Users Physiological Linkage. In Ramzan, N., van Zwol, R., Lee, J.-S., Clüver, K. and Hua, X.-S. (eds) Social Media Retrieval. Springer, London. IEEE.
31. Coan, J.A. and Allen, J.J.B. (2004) Frontal EEG asymmetry as a moderator and mediator of emotion. Biol. Psychol., 67, 7-50.
32. Cornelius, R.R. (1996) The Science of Emotion. Research and Tradition in the Psyhcology of Emotion. Prentice-Hall, Upper Saddle River, NJ.
33. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W. and Taylor, J.G. (2001) Emotion recognition in human-computer interaction. IEEE Signal Process. Mag., 18, 32-80.
34. Cui, X., Bryant, D.M. and Reiss, A.L. (2012) NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation. NeuroImage, 59, 2430-2437.
35. Damasio, A.R. (2001) Fundamental feelings. Nature, 413, 781.
36. Davidson, R.J. (1995) Cerebral Asymmetry, Emotion, and Affective Style. In Davidson, R.J. and Hugdahl, K. (eds) Brain Asymmetry, pp. 361-387. MIT Press, Cambridge.
37. De Vico Fallani, F. et al. (2010) Defecting or not defecting: how to 'read' human behavior during cooperative games by EEG measurements. PloS One, 5(12), e14187.
38. Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S. and Cohen, D. (2012) Interpersonal synchrony: a survey of evaluation methods across disciplines. IEEE Trans. Affect. Comput., 3, 349-365.
39. Delplanque, S. et al. (2008) Emotional processing of odors: evidence for a nonlinear relation between pleasantness and familiarity evaluations. Chemical Senses, 33, 469-479.
40. Dmochowski, J.P., Sajda, P., Dias, J. and Parra, L.C. (2012) Correlated components of ongoing EEG point to emotionally laden attention-A possible marker of engagement? Front. Hum. Neurosci., 6, 112.
41. Dumas, G. (2011) Towards a two-body neuroscience. Commun. Integrative Biol., 4, 349-352.
42. Dumas, G., Nadel, J., Soussignan, R., Martinerie, J. and Garnero, L. (2010) Inter-brain synchronization during social interaction. PloS One, 5, 1-10.
43. Ěerekoviæ, a. (2012) An insight into multimodal databases for social signal processing: acquisition, efforts, and directions. Artif. Intell. Rev. doi:10.1007/s10462-012-9334-2.
44. Ekman, P., Levenson, R.W. and Friesen, W.V. (1983) Autonomic nervous-system activity distinguishes among emotions. Science, 221, 1208-1210.
45. Ekman, I., Chanel, G., Kivikangas, J.M., Salminen, M., Järvelä, S. and Ravaja, N. (2012) Social interaction in games: measuring physiological linkage and social presence. Simul. Gaming, 43, 321-338.
46. Fairclough, S.H. (2009) Fundamentals of physiological computing. Interact. Comput., 21, 133-145.
47. Féré, C. (1888) Note sur les modifications de la resistance electrique sous l'influence des excitations sensorielles et des emotions. Compt. Rend. Soc. Biol., 5, 217-219.
48. Fleureau, J., Guillotel, P. and Orlac, I. (2013) Affective Benchmarking of Movies Based on the Physiological Responses of a Real Audience. In 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 73-78. IEEE, Geneva, Switzerland.
49. Frith, C.D. and Frith, U. (2006) How we predict what other people are going to do. Brain Res., 1079, 36-46.
50. Gendolla, G.H.E. and Richter, M. (2005) Ego involvement and effort: Cardiovascular, electrodermal, and performance effects. Psychophysiology, 42, 596-603.
51. Gottman, J.M. and Ringland, J.T. (1981) The analysis of dominance and bidirectionality in social-development. Child Dev., 52, 393-412.
52. Gunes, H., Piccardi, M. and Pantic, M. (2008) From the Lab to the Real World: Affect Recognition Using Multiple Cues and Modalities. In Jimmy, O. (ed.) Affective Computing, Focus on Emotion Expression, Synthesis and Recognition, pp. 185-218. ITech Education and Publishing, Vienna, Austria.
53. Gunes, H., Shan, C., Chen, S. and Tian, Y. (2013) Bodily Expression for Automatic Affect Recognition. In Konar, A. and Chakraborty, A. (eds) Advances in Emotion Recognition, pp. 1-34. Wiley.
54. Hareli, S. and Parkinson, B. (2008) What's social about social emotions? J. Theory Soc. Behav., 38, 131-156.
55. Harmon-Jones, E. (2003) Clarifying the emotive functions of asymmetrical frontal cortical activity. Psychophysiology, 40, 838-848.
56. Hasson, U., Ghazanfar, A.a., Galantucci, B., Garrod, S. and Keysers, C. (2012) Brain-To-brain coupling: a mechanism for creating and sharing a social world. Trends Cogn. Sci., 1-8. doi:10.1016/j.tics.2011.12.007.
57. Hatfield, E., Rapson, R.L. and Le, Y.-C.L. (2009) Emotional Contagion and Empathy. In Decety, J. and Ickes, W. (eds) The Social Neuroscience of Empathy, pp. 19-30. MIT Press, Cambridge, Massachusetts.
58. Hazlett, R.L. and Benedek, J. (2007) Measuring emotional valence to understand the user's experience of software. Int. J. Hum.-Comput. Stud., 65, 306-314.
59. Henning, R. A., Boucsein, W. and Gil, M. C. (2001). Socialphysiological compliance as a determinant of team performance. Int. J. Psychophysiol., 40, 221-232.
60. Henning, R. A., Armstead, A. G. and Ferris, J. K. (2009). Social psychophysiological compliance in a four-person research team. Appl. Ergon., 40(6), 1004-1010.
61. Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F. and Schultz, T. (2013) Mental workload during n-back task-quantified in the prefrontal cortex using fNIRS. Front. Hum. Neurosci., 7, 935.
62. Hussain, M.S., Alzoubi, O., Calvo, R.A. and D'Mello, S. (2011) Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor. In Biswas, G., Bull, S., Kay, J. and Mitrovic, A. (eds) Artificial Intelligence in Education, LNCS 6738, pp. 131-138. Springer, Auckland, New Zealand.
63. Jakobs, E., Fischer, A.H. and Manstead, A.S.R. (1997) Emotional experience as a function of social context: the role of the other. J. Nonverbal Behav., 21, 103-130.
64. Jalili, M., Barzegaran, E. and Knyazeva, M.G. (2014) Synchronization of EEG: bivariate and multivariate measures. IEEE Trans. Neural Syst. Rehabil. Eng., 22, 212-221.
65. Janssen, J.H. (2012) A three-component framework for empathic technologies to augment human interaction. J. Multimodal User Interfaces, 6, 143-161.
66. Janssen, J.H., Bailenson, J.N., IJsselsteijn, W.a. and Westerink, J.H.D.M. (2010) Intimate heartbeats: opportunities for affective communication technology. IEEE Trans. Affect. Comput., 1, 72-80.
67. Janssen, J.H., Ijsselsteijn, W.A., Westerink, J.H.D.M., Tacken, P. and de Vries, G.-J. (2013a) The tell-Tale heart: perceived emotional intensity of heartbeats. Int. J. Synth. Emotions, 4, 65-91.
68. Janssen, J.H., Tacken, P., de Vries, J.J.G. (Gert-J), van den Broek, E.L., Westerink, J.H.D.M., Haselager, P. and IJsselsteijn, W.A. (2013b) Machines outperform laypersons in recognizing emotions elicited by autobiographical recollection. Hum.-Comput. Interact., 28, 479-517.
69. Jensen, O. and Tesche, C.D. (2002) Frontal theta activity in humans increases with memory load in a working memory task. Eur. J. Neurosci., 15, 1395-1399.
70. Jiang, J., Dai, B., Peng, D., Zhu, C., Liu, L. and Lu, C. (2012) Neural synchronization during face-To-face communication. J. Neurosci., 32, 16064-16069.
71. Jones, A. and Issroff, K. (2005) Learning technologies: affective and social issues in computer-supported collaborative learning. Comput. Educ., 44, 395-408.
72. Katsis, C.D., Katertsidis, N., Ganiatras, G. and Fotiadis, D.I. (2008) Toward emotion recognition in car racing drivers: a biosignal processing approach. IEEE Trans. Syst. Man Cybernet.-Part A: Syst. Hum., 38, 502-512.
73. Kilner, J.M. and Frith, C.D. (2008) Action observation: inferring intentions without mirror neurons. Current Biol., 18(1), R32-R33.
74. Kivikangas, J.M., Chanel, G., Cowley, B., Ekman, I., Salminen, M., Järvelä, S. and Ravaja, N. (2011) A review of the use of psychophysiological methods in game research. J. Gaming Virtual Worlds, 3, 181-199.
75. Kleinsmith, A., Bianchi-Berthouze, N. and Steed, A. (2011) Automatic recognition of non-Acted affective postures. IEEE Trans. Syst. Man Cybernet., Part B: Cybernet., PP, 1-12.
76. Klimesch, W. (1996) Memory processes, brain oscillations and EEG synchronization. Int. J. Psychophysiol., 24, 61-100.
77. Koelstra, S. and Patras, I. (2013) Fusion of Facial expressions and EEG for implicit affective tagging. Image Vision Comput., 31, 164-174.
78. Koelstra, S. et al. (2012) DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput., 3, 18-31.
79. Konvalinka, I., Bauer, M., Stahlhut, C., Hansen, L.K., Roepstorff, A. and Frith, C. D. (2014) Frontal alpha oscillations distinguish leaders from followers: multivariate decoding of mutually interacting brains. NeuroImage, 94, 79-88.
80. Kosunen, I., Kuikkaniemi, K., Laitinen, T. and Turpeinen, M. (2010) Demonstration: Listen to Yourself and Others-Multiuser Mobile Biosignal Sonification Platform EMOListen. In BioSPlay Workshop, Fun and Games Conference. Leuven, Belgium. http://www.physiologicalcomputing.net/workshops/biosplay2010/BioSPLay-Kosunen%20et%20al%20%28Emolisten%29.pdf.
81. Kreibig, S.D. (2010) Autonomic nervous system activity in emotion: a review. Biol. Psychol., 84, 394-421.
82. Lang, P.J., Greenwald, M.K., Bradley, M.M. and Hamm, A.O. (1993) Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology, 30, 261-273.
83. Laursen, B., Jensen, B.R., Garde, A.H. and Jørgensen, A.H. (2002) Effect of mental and physical demands on muscular activity during the use of a computer mouse and a keyboard. Scand. J. Work Environ. Health, 28, 215-221.
84. Le Van Quyen, M., Foucher, J., Lachaux, J., Rodriguez, E., Lutz, A., Martinerie, J. and Varela, F. J. (2001) Comparison of Hilbert transform and wavelet methods for the analysis of neuronal synchrony. J. Neurosci. Methods, 111, 83-98.
85. Lehmann-Willenbrock, N., Meyers, R.a., Kauffeld, S., Neininger, a. and Henschel, a. (2011) Verbal interaction sequences and group mood: exploring the role of team planning communication. Small Group Res., 42, 639-668.
86. Levenson, R.W. and Gottman, J.M. (1983) Marital interaction: physiological linkage and affective exchange. J. Pers. Soc. Psychol., 45, 587-597.
87. Levenson, R.W. and Ruef, A.M. (1992) Empathy: a physiological substrate. J. Pers. Soc. Psychol., 63, 234-246.
88. Liao, L.-D. et al. (2012) Biosensor technologies for augmented brain-computer interfaces in the next decades. Proc. IEEE, 100, 1553-1566.
89. Lindenberger, U., Li, S.C., Gruber, W. and Muller, V. (2009) Brains swinging in concert: cortical phase synchronization while playing guitar. BMC Neurosci., 10, 22.
90. Lindquist, K.a and Barrett, L.F. (2012) A functional architecture of the human brain: emerging insights from the science of emotion. Trends Cogn. Sci., 16, 533-540.
91. Lisetti, C.L. and Nasoz, F. (2004) Using noninvasive wearable computers to recognize human emotions from physiological signals. J. Appl. Signal Process., 11, 1672-1687.
92. Liu, C., Agrawal, P., Sarkar, N. and Chen, S. (2009) Dynamic difficulty adjustment in computer games through real-Time anxiety-based affective feedback. Int. J. Hum.-Comput. Interact., 25, 506-529.
93. Mandryk, R.L., Inkpen, K.M. and Calvert, T.W. (2006) Using psychophysiological techniques to measure user experience with entertainment technologies. Behav. Inf. Technol., 25, 141-158.
94. Mehu, M. and Scherer, K.R. (2012) A psycho-ethological approach to social signal processing. Cogn. Process., 13, 397-414.
95. Ménoret, M. et al. (2014) Neural correlates of non-verbal social interactions: a dual-EEG study. Neuropsychologia, 55, 85-97.
96. Molenberghs, P., Cunnington, R. and Mattingley, J.B. (2009) Is the mirror neuron system involved in imitation? A short review and meta-Analysis. Neurosci. Biobehav. Rev., 33, 975-980.
97. Mühl, C. et al. (2010) Bacteria hunt-evaluating multi-paradigm BCI interaction. J. Multimodal User Interfaces, 4, 11-25.
98. Mühl, C., Brouwer, A.-M., van Wouwe, N., van den Broek, E.L., Nijboer, F. and Heylen, D.K.J. (2011) Modality-Specific Affective Responses and their Implications for Affective BCI. In Müller-Putz, G.R., Scherer, R., Billinger, M., Kreilinger, A., Kaiser, V. and Neuper, C. (eds) Proceedings of the Fifth International Brain-Computer Interface Conference 2011, Graz, Austria. Verlag der Technischen Universität, Graz, Austria.
99. Mühl, C., Allison, B., Nijholt, A. and Chanel, G. (2014a) A survey of affective brain computer interfaces: principles, state-of-The-Art, and challenges. Brain-Comput. Interfaces, 1, 66-84.
100. Mühl, C., Jeunet, C. and Lotte, F. (2014b) EEG-based workload estimation across affective contexts. Front. Neurosci., 8, 114.
101. Müller, V., Sänger, J. and Lindenberger, U. (2013) Intra-and interbrain synchronization during musical improvisation on the guitar. PloS One, 8, e73852.
102. Naeem, M., Prasad, G., Watson, D.R. and Kelso, J.a.S. (2012) Electrophysiological signatures of intentional social coordination in the 10-12 Hz range. NeuroImage, 59, 1795-1803.
103. Niedermeyer, E. (2005) The Normal EEG of the Waking Adult. In Niedermeyer, E. and Lopes Da Silva, F. (eds) Electroencephalography Basic Principles Clinical Applications and Related Fields, pp. 167-192. Williams & Wilkins.
104. Novak, D., Mihelj, M. and Munih, M. (2012) A survey of methods for data fusion and system adaptation using autonomic nervous system responses in physiological computing. Interact. Comput., 24, 154-172.
105. Ortony, A., Revelle, W. and Zinbarg, R. (2007) Why Emotional Intelligence Needs a Fluid Component. In Matthews, G., Zeidner, M. and Roberts, R.D. (eds) The Science of Emotional Intelligence, pp. 288-304. Oxford University Press.
106. Pantic, M. and Rothkrantz, L.J.M. (2003) Toward an affectsensitive multimodal human-computer interaction. Proc. IEEE, 91, 1370-1390.
107. Pentland, A.S. (2006) Collective intelligence. August, 9-12.
108. Pentland, A.S. (2007) Social signal processing. IEEE Signal Process. Mag., July, 108-111.
109. Pesarin, A., Cristani, M., Murino, V. and Vinciarelli, A. (2012). Conversation analysis at work: detection of conflict in competitive discussions through semi-Automatic turn-organization analysis. Cogn. Process., 13, 533-540.
110. Pfurtscheller, G., Stancák, A. and Neuper, C. (1996) Event-related synchronization (ERS) in the alpha band-An electrophysiological correlate of cortical idling: a review. Int. J. Psychophysiol., 24, 39-46.
111. Picard, R.W. (1997) Affective computing. The MIT Press.
112. Poh, M.-Z., McDuff, D.J. and Picard, R.W. (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics Express, 18, 10762-10774.
113. Rainville, P., Bechara, A., Naqvi, N. and Damasio, A.R. (2006) Basic emotions are associated with distinct patterns of cardiorespiratory activity. Int. J. Psychophysiol., 61, 5-18.
114. Ravaja, N. (2004) Contributions of phsychophysiology to media research: review and recommendations. Media Psychol., 6, 193-235.
115. Ringeval, F., Sonderegger, A., Sauer, J. and Lalanne, D. (2013) Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions. In 10th IEEE International Conference andWorkshops on Automatic Face and Gesture Recognition (FG), pp. 1-8. IEEE.
116. Rizzolatti, G. and Craighero, L. (2004) The mirror-neuron system. Ann. Rev. Neurosci., 27, 169-192.
117. Rizzolatti, G. and Fabbri-Destro, M. (2008) The mirror system and its role in social cognition. Curr. Opin. Neurobiol., 18, 179-184.
118. Sallnäs, E.-L. (2005) Effects of communication mode on social presence, virtual presence, and performance in collaborative virtual environments. Presence, 14, 434-449.
119. Sanchez-Cortes, D., Aran, O., Babu Jayagopi, D., Schmid Mast, M. and Gatica-Perez, D. (2012) Emergent leaders through looking and speaking: from audio-visual data to multimodal recognition. J. Multimodal User Interfaces, August.
120. Sander, D., Grandjean, D. and Scherer, K.R. (2005) A systems approach to appraisal mechanisms in emotion. Neural Netw., 18, 317-352.
121. Sänger, J., Lindenberger, U. and Müller, V. (2011) Interactive brains, social minds. System, December, 655-663.
122. Sassaroli, A., Zheng, F., Hirshfield, L.M., Girouard, A., Solovey, E.T., Jacob, R.J.K., and Fantini, S. (2008) Discrimination of mental workload levels in human subjects with functional near-infrared spectroscopy. J. Innov. Optical Health Sci., 01, 227-237.
123. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T. and Vogeley, K. (2013) Toward a second-person neuroscience. Behav. Brain Sci., 36, 393-414.
124. Schmidt, L.A. and Trainor, L.J. (2001) Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cogn. Emotion, 15, 487-500.
125. Scully, C.G., Lee, J., Meyer, J., Gorbach, A.M., Granquist-Fraser, D., Mendelson, Y. and Chon, K.H. (2012) Physiological parameter monitoring from optical recordings with a mobile phone. IEEE Trans. Biomed. Eng., 59, 303-306.
126. Slovák, P., Janssen, J. and Fitzpatrick, G. (2012) Understanding Heart Rate Sharing: Towards Unpacking Physiological Space. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems-CHI'12, p. 859. ACM Press, New York, New York, USA.
127. Soleymani, M., Lichtenauer, J., Pun, T. and Pantic, M. (2012) A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput., 3, 42-55.
128. Stemmler, G., Heldmann, M., Pauls, C.A. and Scherer, T. (2001) Constraints for emotion specificity in fear and anger: the context counts. Psychophysiology, 38, 275-291.
129. Tangney, J.P., Stuewig, J. and Mashek, D.J. (2007) Moral emotions and moral behavior. Ann. Rev. Psychol., 58, 345-372.
130. Tognoli, E., Lagarde, J., DeGuzman, G.C. and Kelso, J.a.S. (2007) The phi complex as a neuromarker of human social coordination. Proc. Natl Acad. Sci. USA, 104, 8190-8195.
131. Treder, M.S., Bahramisharif, A., Schmidt, N.M., van Gerven, M.A.J. and Blankertz, B. (2011) Brain-computer interfacing using modulations of alpha activity induced by covert shifts of attention. J. Neuroeng. Rehabil., 8, 24.
132. Uddin, L.Q., Iacoboni, M., Lange, C. and Keenan, J. P. (2007) The self and social cognition: the role of cortical midline structures and mirror neurons. Trends Cogn. Sci., 11(4), 153-157.
133. Van Kleef, G.a. (2009) How Emotions Regulate Social Life. Curr. Dir. Psychol. Sci., 18, 184-188.
134. Van Kleef, G. a., De Dreu, C. K. W., Pietroni, D. and Manstead, A. S. R. (2006). Power and emotion in negotiation: power moderates the interpersonal effects of anger and happiness on concession making. Eur. J. Soc. Psychol., 36, 557-581.
135. Verwey, W.B. and Veltman, H.A. (1984) Detecting short periods of elevated workload: a comparison of nine workload assessment techniques. J. Exp. Psychol. Appl., 2, 270-285.
136. Vinciarelli, A., Pantic, M. and Bourlard, H. (2009) Social signal processing: Survey of an emerging domain. Image Vision Comput., 27, 1743-1759.
137. Vinciarelli, A., Pantic, M., Heylen, D., Pelachaud, C., Poggi, I., D'Errico, F. and Schroeder, M. (2012) Bridging the gap between social animal and unsocial machine: a survey of social signal processing. IEEE Trans. Affect. Comput., 3, 69-87.
138. Vytal, K. and Hamann, S. (2010) Neuroimaging support for discrete neural correlates of basic emotions: a voxel-based meta-Analysis. J. Cogn. Neurosci., 22, 2864-2885.
139. Wilhelm, F.H., Pfaltz, M.C. and Grossman, P. (2006) Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion. Interact. Comput., 18, 171-186.
140. Yamabe, T., Kosunen, I., Ekman, I., Liikkanen, L.A., Kuikkaniemi, K. and Nakajima, T. (2010) Biofeedback Training with EmoPoker: Controlling Emotional Arousal for Better Poker Play. In BioSPlay Workshop, Fun and Games Conference. Leuven, Belgium.
141. Yun, K., Chung, D. and Jeong, J. (2008) Emotional Interactions in Human Decision-Making using EEG Hyperscanning. Proceedings of the 6th International Conference on Cognitive Science, pp. 327-330. http://cogsci.snu.ac.kr/jcs/iccs/.
142. Zeng, Z.H., Pantic, M., Roisman, G.I. and Huang, T.S. (2009) A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell., 31, 39-58.