Intra- and interpersonal functions of head motion in emotion communication

RFMIR 2014 - Proceedings of the 2014 ACM Roadmapping the Future of Multimodal Interaction Research Including Business Opportunities and Challenges, Co-located with ICMI 2014

Volumn , Issue , 2014, Pages 19-22

  Hammal, Zakia ^a   Cohn, Jeffrey F ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Emotion communication; Head motion; Interpersonal interaction

Indexed keywords

AFFECTIVE COMPUTING; CROSS CORRELATIONS; FACE-TO-FACE INTERACTION; FACIAL EXPRESSIONS; HEAD MOTION; INTERPERSONAL INTERACTION; PSYCHOLOGICAL DISTRESS; TEMPORAL COORDINATION;

MOTION TRACKING;

EID: 84919330142     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2666253.2666259     Document Type: Conference Paper

References (28)

1. Z. Zeng, M. Pantic, G.I. Roisman, T.S. Huang, 2009. A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. on PAMI, 31(1), 39-58.
2. H. Gunes and M. Pantic. 2010. Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners. Intelligent virtual agents, J. A. e. al., Ed., ed Heidelberg: Springer-Verlag Berlin, 6356, 371-377.
3. C. Busso, Z., Deng, M., Grimm, U., Neumann, and S., Narayanan., 2007. Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis. IEEE Trans. on Audio, Speech, and Language Processing, 15(3), 1075-1086.
4. R. el Kaliouby, and P. Robinson. 2005. Real-time inference of complex mental states from facial expressions and head gestures. Real-time vision for HCI, 181-200.
5. J. F. Cohn, L. I. Reed, T. Moriyama, J. Xiao,, K. L. Schmidt, and Z. 2004. Multimodal coordination of facial action, head rotation, and eye motion. The 6th IEEE AFGR, Seoul, Korea..
6. S. Duncan. 1972. Some signals and rules for taking speaking turns in conversations. J. of Personality and Social Psychology, 23(2), 283-292.
7. M. L. Knapp and J. A. Hall. 2010. Nonverbal behavior in human communication. 7th ed. Boston: Wadsworth/Cengage.
8. Boker, S. M., Cohn, J. F., Theobald, B. J., Matthews, I., Mangini, M., Spies, J. R. et al., 2011. Something in the way we move: Motion, not perceived sex, influences nods in conversation," J. of Experimental Psychology: Human Perception and Performance, 37,874-891.
9. Hammal, Z., Cohn, J.F., &George, D.T. 2014. Interpersonal Coordination of Head Motion in Distressed Couples. IEEE Trans. on Affective Computing, 5(2), 155-167, doi: http://dx.doi.org/10.1109/TAFFC.2014.2326408
10. J. W. Davidson, 2004. What type of information is conveyed in the body movements of solo musician performers? J. Human Movement Stud. 6, 279-301.
11. J. F. Hall, F. J. Frank, and D. R. Carney. Nonverbal behavior and interpersonal sensitivity. The new handbook methods in nonverbal behavior research. Edited by Jinni Harrigan, Robert Rosenthal, and Klaus Scherer, Oxford University Press, Oxford University Press Inc., New York, 237-281.
12. D. K. Yoshimoto, A. Shapiro, K. O'brien, and J. M. Gottman. Nonverbal communication coding systems of committed couples. The new handbook methods in nonverbal behavior research. Edited by Jinni Harrigan, Robert Rosenthal, and Klaus Scherer, Oxford University Press, Oxford University Press Inc., New York, 369-397.
13. M. Cox, J. Nuevo-Chiquero, J. M. Saragih, and S. Lucey. CSIRO Face Analysis SDK. ed. Brisbane, Australia , 2013.
14. Kenny, D. A., Kashy, D. A., &Cook, W. L. 2006. Dyadic data analysis. New York: Guilford.
15. N. A. Roberts, J. L. Tsai, and J. A. Coan. 2007. Emotion elicitation using dyadic interaction tasks, In Handbook of Emotion Elicitation and Assessment. J. A. Coan and J. J. B. Allen (Eds.), New York, NY: Oxford University Press, 106-123.
16. J. P., Caughlin and A. M., Scott, 2010. Toward a communication theory of the demand/withdraw pattern of interaction in interpersonal relationships. In S. W. Smith and S. R. Wilson (Eds.), New directions in interpersonal communication research. Thousand Oaks, CA US: Sage Publications, Inc., 180-200.
17. Hammal, Z., Cohn, J.F., &Messinger, D. 2014 Head Movement Dynamics During Normal and Perturbed Mother-Infant Interaction, under review.
18. Tronick, E.Z., Als, H., Adamson, L. Susan Wise, B. A. and Brazelton, T. B. 1978. The infant's response to entrapment between contradictory messages in face-to-face interaction," J. of the American Academy of Child Adolescent Psychiatry, 17, 1-13.
19. Adamson, L. B. and Frick, J. E. 2003. The still-face: A history of a shared experimental paradigm, Infancy, 4, 451-474.
20. Girard, J. M., Cohn, J. F., Mahoor, M. H., Mavadati, S. M., Hammal, Z., and Rosenwald, D. P. 2013. Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses. Image and Vision Computing.
21. Scherer, S., Stratou, G., Lucas, G., Mahmoud M., Boberg J., Gratch, J., Rizzo, A., Morency, L.P. 2014. Automatic audiovisual behavior descriptors for psychological disorder analysis. Image and Vision Computing
22. Joshi, J., Goecke, R., Braeaksp, M., Breakspear, M., and Cohn, J. F. 2013. Relative body parts movement for automatic depression analysis. Proceedings of the Affective Computing and Intelligent Interaction, Geneva, Switzerland.
23. Allen, N. B., and Badcock, P. B. T. 2003. The social risk hypothesis of depressed mood: Evolutionary, psychosocial, and neurobiological perspectives. Psychological Bulletin, 17(6), 647-670.
24. Camras, L. A., Lambrecht, L., and Michel, G. F. 1996. Infant "surprise" expressions as coordinative motor structures. J. of Nonverbal Behavior, 20(3), 183-195.
25. Mariooryad, S., and Busso, C. 2013. Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition Soroosh Mariooryad, Student Member, IEEE, and Carlos Busso,. Trans. on Affective Computing, 4(2), 183-196.
26. Boker, S. M., Rotondo, J. L., Xu, M., and King, K. 2002. Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series. Psychological Methods, 7(1), 338-355
27. Tronick, E. Z., and Cohn, J. F. 1989. Infant-mother face-toface interaction: Age and gender differences in coordination and the occurrence of miscoordination. Child Development, 60, 85-92.
28. Madhyastha, T. M., Hamaker, E. L., and Gottman, J. M. 2011. Investigating spousal influence using moment-tomoment affect data from marital conflict. J. of Family Psychology, 25(2), 292-300. doi: 10.1037/a0023028