Recognition of affect based on gait patterns

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 4, 2010, Pages 1050-1061

  Karg, Michelle ^a   Kühnlenz, Kolja ^a   Buss, Martin ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Affective computing; feature extraction; gait recognition; human motion analysis; pattern classification

Indexed keywords

AFFECT-BASED; AFFECTIVE COMPUTING; AFFECTIVE STATE; APPLICATION SCENARIO; GAIT PATTERN; GAIT RECOGNITION; HOME ENVIRONMENT; HUMAN MOTION ANALYSIS; HUMAN ROBOT INTERACTIONS; KERNEL PCA; LINEAR DISCRIMINANT ANALYSIS; MOTION CAPTURE DATA; PATTERN CLASSIFICATION; PERSON-DEPENDENT; PRIMARY TASK; TEMPORAL INFORMATION;

DISCRIMINANT ANALYSIS; GAIT ANALYSIS; PRINCIPAL COMPONENT ANALYSIS;

FEATURE EXTRACTION;

AFFECT; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; GAIT; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; PHOTOGRAPHY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

AFFECT; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; GAIT; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 77954763159     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2044040     Document Type: Article

References (51)

1. R. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.
2. C. Peter and R. Beale, Affect and Emotion in Human-Computer Interaction. New York: Springer-Verlag, 2008.
3. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.1, pp. 39-58, Jan. 2009.
4. H. Gunes and M. Piccardi, "Automatic temporal segment detection and affect recognition from face and body display," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol.39, no.1, pp. 64-84, Feb. 2009.
5. A. Kale, A. Sundaresan, A. Rajagopalan, N. Cuntoor, A. Roy-Chowdhury, V. Krüger, and R. Chellappa, "Identification of humans using gait," IEEE Trans. Image Process., vol.13, no.9, pp. 1163-1173, Sep. 2004.
6. T. Chau, "A review of analytical techniques for gait data-Part 1: Fuzzy, statistical and fractal methods," Gait Posture, vol.13, no.1, pp. 49-66, Feb. 2001. (Pubitemid 32109219)
7. T. Chau, "A review of analytical techniques for gait data-Part 2: Neural network and wavelet methods," Gait Posture, vol.13, no.2, pp. 102-120, Apr. 2001. (Pubitemid 32181341)
8. M. Nixon, T. Tan, and R. Chellappa, Human Identification Based on Gait. New York: Springer-Verlag, 2006.
9. S. Sarkar, P. Phillips, Z. Liu, I. Vega, P. Grother, and K. Bowyer, "The humanID gait challenge problem: Data sets, performance, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.2, pp. 162-177, Feb. 2005.
10. L. Wang, T. Tan, H. Ning, and W. Hu, "Silhouette-analysis-based gait recognition for human identification," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.12, pp. 1505-1518, Dec. 2003.
11. L. Wang and D. Suter, "Learning and matching of dynamic shape manifolds for human action recognition," IEEE Trans. Image Process., vol.16, no.6, pp. 1646-1661, Jun. 2007.
12. D. Kulic, W. Takano, and Y. Nakamura, "Incremental learning, clustering and hierarchy formation of whole-body motion patterns using adaptive hidden Markov chains," Int. J. Robot. Res., vol.27, no.7, pp. 761-784, Jul. 2008.
13. L. Lee andW. Grimson, "Gait analysis for recognition and classification," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2002, pp. 148-155.
14. N. Boulgouris, D. Hatzinakos, and K. Plataniotis, "Gait recognition: A challenging signal processing technology for biometric identification," IEEE Signal Process. Mag., vol.22, no.6, pp. 78-90, Nov. 2005.
15. J. Han and B. Bhanu, "Individual recognition using gait energy image," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.2, pp. 316-322, Feb. 2006.
16. T. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in visionbased human motion capture and analysis," Comput. Vis. Image Underst., vol. 104, no. 2/3, pp. 90-126, Nov./Dec. 2006.
17. E. Rolls, Emotion Explained. London, U.K.: Oxford Univ. Press, 2007.
18. P. Ekman and W. Friesen, "A new pan-cultural facial expression of emotion," Motivation Emotion, vol.10, no.2, pp. 159-168, Jun. 1986.
19. J. Russell and A. Mehrabian, "Evidence for a three-factor theory of emotions," J. Res. Personality, vol.11, no.3, pp. 273-294, Sep. 1977.
20. J. Mikels, B. Fredrickson, G. Larkin, C. Lindberg, S. Magold, and P. Reuter-Lorenz, "Emotional category data on images from the international affective picture system," Behavior Res. Methods, vol.37, no.4, pp. 626-630, 2005.
21. J. Morris, "Observations: SAM: The self-assessment manikin-An efficient cross-cultural measurement of emotional response," J. Advertising Res., vol.35, pp. 63-68, Nov. 1995.
22. K. Scherer, Handbook of Cognition and Emotion. New York: Wiley, 1999, ch. Appraisal Theory, pp. 637-663.
23. P. Niedenthal, "Embodying emotion," Science, vol.316, no.5827, pp. 1002-1005, May 2007.
24. R. Lazarus, Emotion and Adaptation. London, U.K.: Oxford Univ. Press, 1991.
25. L. Kozlowski and J. Cutting, "Recognizing the sex of a walker from a dynamic point-light display," Perception Psychophysics, vol.21, no.6, pp. 575-580, 1977.
26. J. Cutting and L. Kozlowski, "Recognizing friends by their walk: Gait perception without familiarity cues," Bull. Psychonomic Soc., vol.9, no.5, pp. 353-356, 1977.
27. S. Brownlow, A. Dixon, C. Egbert, and R. Radcliffe, "Perception of movement and dancer characteristics from point-light displays of dance," Psych. Rec., vol.47, pp. 411-421, 1997. (Pubitemid 127363904)
28. M. Coulson, "Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence," Nonverbal Behavior, vol.28, no.2, pp. 117-139, Jun. 2004.
29. W. Dittrich, T. Troscianko, S. L. Ans, and D. Morgan, "Perception of emotion from dynamic point-light displays represented in dance," Perception, vol.25, no.6, pp. 727-738, 1996.
30. F. Pollick, H. Paterson, A. Bruderlin, and A. Sanford, "Perceiving affect from arm movement," Cognition, vol.82, no.2, pp. B51-B61, Dec. 2001.
31. D. Bernhardt and P. Robinson, "Detecting affect from nonstylized body motions," in Proc. Int. Conf. Affective Comput. Intell. Interaction, vol.4738, LNCS, 2007, pp. 59-70.
32. A. Kleinsmith and N. Bianchi-Berthouze, "Recognizing affective dimensions from body posture," in Proc. Int. Conf. Affective Computing Intell. Interaction, vol.4738, LNCS, 2007, pp. 48-58.
33. J. Montepare, S. Goldstein, and A. Clausen, "The identification of emotions from gait information," Nonverbal Behavior, vol.11, no.1, pp. 33- 42, Mar. 1987.
34. J. Michalak, N. Troje, J. Fischer, P. Vollmar, T. Heidenreich, and D. Schulte, "Embodiment of sadness and depression: Gait patterns associated with dysphoric mood," Psychosomatic Med., vol.71, no.5, pp. 580- 587, Jun. 2009.
35. E. Crane and M. Gross, "Motion capture and emotion: Affect detection in whole-body movement," in Proc. Int. Conf. Affective Comput. Intell. Interaction, vol.4738, LNCS, 2007, pp. 95-101.
36. S. Halovic and C. Kroos, "Facilitating the perception of anger and fear in male and female walkers," in Proc. AISB: Symp. Mental States, Emotions Embodiment, 2009.
37. C. Roether, L. Omlor, A. Christensen, and M. Giese, "Critical features for the perception of emotion from gait," J. Vis., vol.9, no.6, pp. 1-32, Jun. 2009.
38. A. Heberlein, R. Adolphs, D. Tranel, and H. Damasio, "Cortical regions for judgments of emotions and personality traits from point-light walkers," Cogn. Neurosci., vol.16, no.7, pp. 1143-1158, Sep. 2004.
39. D. Janssen, W. Schöllhorn, J. Lubienetzki, K. Fölling, H. Kokenge, and K. Davids, "Recognition of emotions in gait patterns by means of artificial neural nets," Nonverbal Behav., vol.32, no.2, pp. 79-92, Jun. 2008.
40. J. Wu, J. Wang, and L. Liu, "Feature extraction via KPCA for classification of gait patterns," Hum. Mov. Sci., vol.26, no.3, pp. 393-411, Jun. 2007.
41. N. Troje, "Decomposing biological motion: A framework for analysis and synthesis of human gait patterns," J. Vis., vol.2, no.5, pp. 371-387, 2002.
42. M. Karg, R. Jenke, W. Seiberl, K. Kühnlenz, A. Schwirtz, and M. Buss, "A comparison of PCA, KPCA and LDA for feature extraction to recognize affect in gait patterns," in Proc. Int. Conf. Affective Comput. Intell. Interaction, 2009, pp. 195-200.
43. M. Zuckermann, D. Larrance, J. Hall, R. DeFrank, and R. Rosenthal, "Posed and spontaneous communication of emotion via facial and vocal cues," Personality, vol.47, no.4, pp. 712-733, Dec. 1978.
44. P. Lang, "Behavioral treatment and biobehavioral assessment: Computer applications," in Technology in Mental Health Care Delivery Systems. Norwood, NJ: Ablex, 1980, pp. 119-l37.
45. C. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
46. R.O.Duda, P. E. Hart, andD. G. Stork, Pattern Classification. Hoboken, NJ: Wiley, 2001.
47. L. Van Der Maaten, E. Postma, and H. Van Den Herik, Dimensionality Reduction: A Comparative Review, Tilburg, The Netherlands, 2009. Tech. Rep. [Online]. Available: http://www.tilburguniversity.nl/faculties/ humanities/ticc/research/technicalreports/TR2009005.pdf
48. B. Schölkopf, A. Smola, and K.-R. Müller, "Kernel principal component analysis," in Proc. Int. Conf. Artif. Neural Netw., vol.1327, LNCS, 1997, pp. 583-588.
49. A. Martinez and A. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.2, pp. 228-233, Feb. 2001.
50. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol.12, no.10, pp. 2385-2404, Oct. 2000.
51. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001. [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/ libsvm