Automatic recognition of non-acted affective postures

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 4, 2011, Pages 1027-1038

  Kleinsmith, Andrea ^a   Bianchi Berthouze, Nadia ^b   Steed, Anthony ^b  

^a UNIVERSITY OF LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Affective posture; automatic emotion recognition; human emotion recognition; non acted posture

Indexed keywords

AFFECTIVE POSTURE; AFFECTIVE STATE; AUTOMATIC RECOGNITION; BASE RATE; BODY POSTURES; EMOTION RECOGNITION; GROUND TRUTH; HUMAN EMOTION RECOGNITION; NON-ACTED POSTURE; RECOGNITION MODELS; RESEARCH AREAS; TRAINING AND TESTING; USERS' AFFECTIVE STATE; VIDEO GAME;

EID: 79960699221     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2103557     Document Type: Article

References (60)

1. A. R. Damasio, Descartes' Error: Emotion, Reason and the Human Brain. New York: Avon Books, 1994.
2. R. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.
3. R. El Kaliouby and P. Robinson, "Real-time inference of complex mental states from facial expressions and head gestures," in Proc. Real-Time Vis. HCI, 2005, pp. 181-200.
4. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
5. P. Ekman and W. Friesen, Manual for the Facial Action Coding System. Palo Alto, CA: Consulting Psychol. Press, 1978.
6. M. Argyle, Bodily Communication. London, U.K.: Methuen & Co. Ltd., 1988.
7. H. Meeren, C. van Heijnsbergen, and B. de Gelder, "Rapid perceptual integration of facial expression and emotional body language," Proc. Nat. Acad. Sci. U.S.A., vol. 102, no. 45, pp. 16 518-16 523, Nov. 2005. (Pubitemid 41688946)
8. A. Kleinsmith, R. De Silva, and N. Bianchi-Berthouze, "Cross-cultural differences in recognizing affect from body posture," Interact. Comput., vol. 18, no. 6, pp. 1371-1389, Dec. 2006. (Pubitemid 44709886)
9. A. Camurri, B. Mazzarino, M. Ricchetti, R. Timmers, and G. Volpe, "Multimodal analysis of expressive gesture in music and dance performances," in Proc. Gesture-Based Commun. Human-Comput. Interact., 2004, pp. 20-39. (Pubitemid 38285426)
10. D. Bernhardt and P. Robinson, "Detecting affect from non-stylised body motions," in Proc. Int. Conf. Affective Comput. Intell. Interact., vol. 4738, LNCS, 2007, pp. 59-70.
11. P. R. De Silva, M. Osano, A. Marasinghe, and A. P. Madurapperuma, "Towards recognizing emotion with affective dimensions through body gestures," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2006, pp. 269-274. (Pubitemid 44711361)
12. A. Kapoor, R. W. Picard, and Y. Ivanov, "Probabilistic combination of multiple modalities to detect interest," in Proc. 17th Int. Conf. Pattern Recog., Aug. 2004, vol. 3, pp. 969-972.
13. A. Mehrabian and J. Friar, "Encoding of attitude by a seated communicator via posture and position cues," J. Consulting Clin. Psychol., vol. 33, pp. 330-336, 1969.
14. H. G. Wallbott and K. R. Scherer, "Cues and channels in emotion recognition," J. Personality Social Psychol., vol. 51, no. 4, pp. 690-699, 1986.
15. P. Ekman and W. Friesen, "Nonverbal leakage and clues to deception," Psychiatry, vol. 32, no. 1, pp. 88-105, Feb. 1969.
16. H. M. Paterson, F. E. Pollick, and E. Jackson, "Movement and faces in the perception of emotion from motion," Perception, ECVP Glasgow Suppl., vol. 31, no. 118, p. 232, 2002.
17. P. Ekman andW. Friesen, "Detecting deception from the body or face," J. Personality Social Psychol., vol. 29, no. 3, pp. 288-298, Mar. 1974.
18. C. C. R. J. van Heijnsbergen, H. K. M. Meeren, J. Grezes, and B. de Gelder, "Rapid detection of fear in body expressions, an ERP study," Brain Res., vol. 1186, pp. 233-241, Dec. 2007.
19. F. E. Pollick, H. Paterson, and P. Mamassian, "Combining faces and movements to recognize affect," J. Vis., vol. 4, no. 8, p. 232, 2004.
20. J. Lange and M. Lappe, "The role of spatial and temporal information in biological motion perception," Adv. Cogn. Psychol., vol. 3, no. 4, pp. 419-428, 2007.
21. M. Hirai and K. Hiraki, "The relative importance of spatial versus temporal structure in the perception of biological motion: An event-related potential study," Cognition, vol. 99, no. 1, pp. B15-B29, Feb. 2006. (Pubitemid 43145924)
22. M. V. Peelen, A. J.Wiggett, and P. E. Downing, "Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion," Neuron, vol. 49, no. 6, pp. 815-822, Mar. 2006. (Pubitemid 43376079)
23. A. P. Atkinson, M. L. Tunstall, and W. H. Dittrich, "Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures," Cognition, vol. 104, no. 1, pp. 59-72, Jul. 2007. (Pubitemid 46627560)
24. C. Roether, L. Omlor, A. Christensen, and M. A. Giese, "Critical features for the perception of emotion from gait," J. Vis., vol. 9, no. 6:15, pp. 1-32, Jun. 2009.
25. J. Aronoff, B. A. Woike, and L. M. Hyman, "Which are the stimuli in facial displays of anger and happiness? Configurational bases of emotion recognition," J. Personality Social Psychol., vol. 62, no. 6, pp. 1050-1066, Jun. 1992.
26. W. T. James, "A study of the expression of bodily posture," J. Gen. Psychol., vol. 7, pp. 405-437, 1932.
27. M. Coulson, "Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence," J. Nonverbal Behavior, vol. 28, no. 2, pp. 117-139, Jun. 2004. (Pubitemid 39015676)
28. L. Omlor and M. A. Giese, "Extraction of spatio-temporal primitives of emotional body expressions," Neurocomputing, vol. 70, no. 10-12, pp. 1938-1942, Jun. 2007. (Pubitemid 46657011)
29. R. von Laban, TheMastery ofMovement. London, U.K.: Macdonald and Evans, 1971.
30. A. Camurri, I. Lagerlof, and G. Volpe, "Recognizing emotion from dance movement: Comparison of spectator recognition and automated techniques," Int. J. Human-Comput. Stud., vol. 59, no. 1/2, pp. 213-225, Jul. 2003.
31. R. De Silva and N. Bianchi-Berthouze, "Modeling human affective postures: An information theoretic characterization of posture features," Comput. Anim. Virtual Worlds, vol. 15, no. 3/4, pp. 269-276, Jul. 2004. (Pubitemid 41108005)
32. A. Kleinsmith and N. Bianchi-Berthouze, "Recognizing affective dimensions from body posture," in Proc. Int. Conf. Affective Comput. Intell. Interact., vol. 4738, LNCS, Lisbon, Portugal, 2007, pp. 48-58.
33. Y. Ma, H.M. Paterson, and F. E. Pollick, "A motion capture library for the study of identity, gender, and emotion perception from biological motion," Behavior Res. Methods, vol. 38, no. 1, pp. 134-141, 2006. (Pubitemid 44945608)
34. A. Kapoor, W. Burleson, and R. W. Picard, "Automatic prediction of frustration," Int. J. Human-Comput. Stud., vol. 65, no. 8, pp. 724-736, Aug. 2007. (Pubitemid 46810294)
35. retrieved Nov. 2007 . [Online]. Available: http://www.animazoo.com/
36. N. Lazzaro, "Why we play games: Four keys to more emotion without story," XEODesign, Inc., Oakland, CA, Tech. Rep., Mar. 2004.
37. C. Storm and T. Storm, "A taxonomic study of the vocabulary of emotions," J. Personality Social Psychol., vol. 53, no. 4, pp. 805-816, Oct. 1987.
38. J. A. Russell and L. Feldman-Barrett, "Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant," J. Personality Social Psychol., vol. 76, no. 5, pp. 805-819, May 1999.
39. G. Rugg and P. McGeorge, "The sorting techniques: A tutorial paper on card sorts, picture sorts and item sorts," Expert Syst., vol. 14, no. 2, pp. 80-93, May 1997.
40. J. A. Russell, "Is there universal recognition of emotion from facial expressions? A review of the cross-cultural studies," Psychol. Bull., vol. 115, no. 1, pp. 102-141, Jan. 1994. (Pubitemid 24976739)
41. N. H. Frijda, "The understanding of facial expression of emotion," Acta Psychologica, vol. 9, pp. 294-362, 1953.
42. B. M. Finifter, "The generation of confidence: Evaluating research findings by random subsample replication," Sociol. Methodology, vol. 4, pp. 112-175, 1972.
43. D. L. Verbyla and J. A. Litvaitis, "Resampling methods for evaluating classification accuracy of wildlife habitat models," Environ. Manage., vol. 13, no. 6, pp. 783-787, 1989.
44. R. W. Picard, E. Vyzas, and J. Healey, "Toward machine emotional intelligence: Analysis of affective physiological state," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 10, pp. 1175-1191, Oct. 2001. (Pubitemid 33047955)
45. J. L. Fleiss, "Measuring nominal scale agreement among many raters," Psychol. Bull., vol. 76, no. 5, pp. 378-382, Nov. 1971.
46. A. J. Viera and J. M. Garrett, "Understanding interobserver agreement: The kappa statistic," Family Med., vol. 37, no. 5, pp. 360-363, May 2005. (Pubitemid 40656185)
47. J. Cohen, "A coefficient of agreement for nominal scale," Educ. Psychol. Meas., vol. 20, no. 1, pp. 37-46, Apr. 1960.
48. J. R. Landis and G. G. Koch, "The measurement of observer agreement for categorical data," Biometrics, vol. 33, no. 1, pp. 159-174, Mar. 1977. (Pubitemid 8054849)
49. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA data mining software: An update," SIGKDD Explor., vol. 11, no. 1, pp. 10-18, 2009.
50. W. Wundt, Outlines of Psychology. Leipzig, Germany: Englemann, 1907.
51. C. E. Osgood, G. J. Suci, and P. H. Tannenbaum, The Measurement of Meaning. Chicago, IL: Univ. Illinois Press, 1957.
52. A. Mehrabian and J. Russell, An Approach to Environmental Psychology. Cambridge, MA: MIT Press, 1974.
53. J. R. Davitz, "Auditory correlates of vocal expression of emotional feeling," in The Communication of Emotional Meaning, J. R. Davitz, Ed. New York: McGraw-Hill, 1964, pp. 101-112.
54. L. J. Cronbach, "Coefficient alpha and the internal structure of tests," Psychometrika, vol. 16, no. 3, pp. 297-334, 1951.
55. P. Ekman and W. Friesen, "Head and body cues in the judgment of emotion: A reformulation," Perceptual Motor Skills, vol. 24, no. 3, pp. 711-724, 1967.
56. A. Mehrabian and N. Epstein, "A measure of emotional empathy," J. Personality, vol. 40, pp. 525-543, 1972.
57. E. J. Lawrence, P. Shaw, D. Baker, S. Baron-Cohen, and A. S. David, "Measuring empathy: Reliability and validity of the Empathy Quotient," Psychol. Med., vol. 34, pp. 911-924, 2004.
58. J. W. Davis and H. Gao, "An expressive three-mode principal component model for gender recognition," J. Vis., vol. 4, no. 5, pp. 362-377, 2004. (Pubitemid 39047443)
59. M. A. Giese and T. Poggio, "Neural mechanisms for the recognition of biological movements," Neuroscience, vol. 4, pp. 179-191, 2003.
60. A. Kapur, A. Kapur, N. Virji-Babul, G. Tzanetakis, and P. F. Driessen, "Gesture-based affective computing on motion capture data," in Proc. Int. Conf. Affective Comput. Intell. Interact., 2005, pp. 1-7. (Pubitemid 43763304)