Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features

User Modeling and User-Adapted Interaction

Volumn 20, Issue 2, 2010, Pages 147-187

  D'Mello, Sidney K ^a   Graesser, Arthur ^a  

^a UNIVERSITY OF MEMPHIS   (United States)

Author keywords

Affective computing; AutoTutor; Conversational cues; Facial features; Gross body language; Human computer interaction; Multimodal affect detection; Superadditivity

Indexed keywords

AFFECT DETECTION; AFFECTIVE COMPUTING; BODY LANGUAGE; FACIAL FEATURE; MULTI-MODAL; SUPERADDITIVITY;

COMBINES; COMPUTER AIDED INSTRUCTION; DETECTORS; DISCRIMINANT ANALYSIS; EDUCATION COMPUTING; KNOWLEDGE MANAGEMENT; LINGUISTICS;

HUMAN COMPUTER INTERACTION;

EID: 77954089820     PISSN: 09241868     EISSN: 15731391     Source Type: Journal    
DOI: 10.1007/s11257-010-9074-4     Document Type: Article

References (118)

1. Afzal, S., Robinson, P.: Natural affect data-collection and annotation in a learning context. In: International Conference on affective computing and intelligent interaction. Amsterdam, The Netherlands (2009)
2. Allison P. D.: Multiple Regression. Pine Forge Press, Thousand Oaks, CA (1999)
3. J. Anderson A. Corbett K. Koedinger R. Pelletier 1995 Cognitive tutors: Lessons learned J. Learn. Sci. 4 167 207 10.1207/s15327809jls0402-2
4. Anderson J., Douglass S., Qin Y.: How should a theory of learning and cognition inform instruction?. In: Healy, A. (eds) Experimental Cognitive Ppsychology and it's Applications, pp. 47-58. American Psychological Association, Washington, DC (2005)
5. Ang, J., Dhillon, R., Krupski, A., Shriberg, E., Stolcke, A.: Prosody-based automatic detection of annoyance and frustration in human-computer dialog. In: International conference on spoken language processing, Denver, CO (2002)
6. Arroyo I., Woolf B., Cooper D., Burleson W., Muldner K., Christopherson R.: Emotion sensors go to school. In: Dimitrova, V., Mizoguchi, R., Du Boulay, B., Graesser, A. (eds) 14th International Conference on Artificial Intelligence In Education, IOS Press, Amsterdam (2009)
7. Asthana, A., Saragih, J., Wagner, M., Goecke, R.: Evaluating AAM Fitting Methods for Facial Expression Recognition. In: International conference on affective computing and intelligent interaction. Amsterdam, The Netherlands (2009)
8. R. Baker S. D'Mello M. Rodrigo A. Graesser 2010 Better to be frustrated than bored: The incidence and persistence of affect during interactions with three different computer-based learning environments Int. J. Hum.-Comput. Stud. 68 4 223 241 10.1016/j.ijhcs.2009.12.003
9. R. Banse K. Scherer 1996 Acoustic profiles in vocal emotion expression J. Pers. Soc. Psychol. 70 614 636 10.1037/0022-3514.70.3.614
10. L. Barrett 2006 Are emotions natural kinds? Perspect. Psychol. Sci. 1 28 58 10.1111/j.1745-6916.2006.00003.x
11. L. Barrett B. Mesquita K. Ochsner J. Gross 2007 The experience of emotion Ann. Rev. Psychol. 58 373 403 10.1146/annurev.psych.58.110405.085709
12. Biggs, J.: Enhancing teaching through constructive alignment. In: 20th International conference on improving university teaching, Hong Kong, Hong Kong (1995)
13. G. Bower 1981 Mood and memory Am. Psychol. 36 129 148 10.1037/0003-066X.36.2.129
14. Brick, T., Hunter, M., Cohn. J.: Get the FACS fast: automated FACS face analysis benefits from the addition of velocity. In: International conference on affective computing and intelligent interaction. Amsterdam, The Netherlands (2009)
15. Bull P.: Posture and Gesture. Oxford Pergamon Press, Oxford (1987)
16. W. Burleson R. Picard 2007 Evidence for gender specific approaches to the development of emotionally intelligent learning companions IEEE Intell. Syst. 22 62 69 10.1109/MIS.2007.69 (Pubitemid 47274707)
17. Caridakis, G., Malatesta, L., Kessous, L., Amir, N., Paouzaiou, A., Karpouzis, K.: Modeling naturalistic affective states via facial and vocal expression recognition. In: International conference on multimodal interfaces. Cambridge, Massachusetts (2006)
18. G. Castellano M. Mortillaro A. Camurri G. Volpe K. Scherer 2008 Automated analysis of body movement in emotionally expressive piano performances Music Percept. 26 103 119 10.1525/mp.2008.26.2.103
19. Chen, L., Huang, T., Miyasato, T., Nakatsu, R.: Multimodal human emotion/expression recognition. In: Third IEEE international conference on automatic face and gesture recognition, pp. 366-371 (1998)
20. M. Chi M. Roy R. Hausmann 2008 Observing tutorial dialogues collaboratively: Insights about human tutoring effectiveness from vicarious learning Cogn. Sci. 32 301 341 10.1080/03640210701863396
21. J. Cohen 1960 A coefficient of agreement for nominal scales Educ. Psychol. Meas. 20 37 46 10.1177/001316446002000104
22. J. Cohn K. Schmidt 2004 The timing of facial motion in posed and spontaneous smiles Int. J. Wavelets Multiresolut. Inf. Process. 2 1 12 10.1142/S021969130400041X 2065523
23. C. Conati 2002 Probabilistic assessment of user's emotions in educational games Appl. Artif. Intell. 16 555 575 10.1080/08839510290030390 (Pubitemid 35019458)
24. C. Conati H. Maclaren 2009 Empirically building and evaluating a probabilistic model of user affect User Model. User-Adapt. Interact. 19 267 303 10.1007/s11257-009-9062-8
25. Craig, S., D'Mello, S., Witherspoon, A., Sullins, J., Graesser, A.: Emotions during learning: the first step toward an affect sensitive intelligent tutoring system. In: International conference on eLearning, Orlando, Florida, pp. 284-288 (2004)
26. S. Craig S. D'Mello A. Witherspoon A. Graesser 2008 Emote aloud during learning with AutoTutor: applying the facial action coding system to cognitive-affective states during learning Cogn. Emot. 22 777 788 10.1080/02699930701516759 (Pubitemid 351983084)
27. D'Mello, S., Craig, S., Gholson, B., Franklin, S., Picard, R., Graesser, A.: Integrating affect sensors in an intelligent tutoring system. In: The computer in the affective loop workshop at 2005 international conference on intelligent user interfaces, New York, AMC Press, pp. 7-13 (2005)
28. S. D'Mello S. Craig J. Sullins A. Graesser 2006 Predicting affective states expressed through an emote-aloud procedure from AutoTutor's mixed-initiative dialogue Int. J. Artif. Intell. Educ. 16 3 28
29. S. D'Mello R. Picard A. Graesser 2007 Towards an affect-sensitive AutoTutor Intelligent Systems, IEEE 22 53 61 10.1109/MIS.2007.79 (Pubitemid 47274706)
30. S. D'Mello S. Craig A. Witherspoon B. McDaniel A. Graesser 2008 Automatic detection of learner's affect from conversational cues User Model. User-Adapt. Interact. 18 45 80 10.1007/s11257-007-9037-6
31. D'Mello, S., Jackson, G., Craig, S., Morgan, B., Chipman, P., White, H. et al.: AutoTutor detects and responds to learners affective and cognitive states. In: Workshop on emotional and cognitive issues in ITS held in conjunction with the ninth international conference on intelligent tutoring systems, Montreal, Canada (2008)
32. D'Mello, S., King, B., Entezari, O., Chipman, P., Graesser, A.: The impact of automatic speech recognition errors on learning gains with AutoTutor. In: Annual meeting of the American Educational Research Association, New York, New York (2008)
33. S. D'Mello A. Graesser 2009 Automatic detection of learners' affect from gross body language Appl. Artif. Intell. 23 123 150 10.1080/08839510802631745
34. S. D'Mello S. Craig A. Graesser 2009 Multi-method assessment of affective experience and expression during deep learning Int. J. Learn. Technol. 4 165 187 10.1504/IJLT.2009.028805
35. D'Mello S., Craig S., Fike K., Graesser A.: Responding to learners' cognitive-affective states with supportive and shakeup dialogues. In: Jacko, J. (eds) Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction, pp. 59-604. Springer, Berlin/Heidelberg (2009)
36. D'Mello, S., Dowell, N., Graesser, A.: Cohesion relationships in tutorial dialogue as predictors of affective states. In: Dimitrova V., Mizoguchi R., du Boulay B., Graesser A. (eds.) 14th International conference on artificial intelligence in education IOS Press, Amsterdam, pp. 9-16 (2009)
37. Damasio A.: Looking for Spinoza: joy, sorrow, and the feeling brain. Harcourt Inc., New York (2003)
38. B. Dasarathy 1997 Sensor fusion potential exploitation: innovative architectures and illustrative approaches IEEE 85 24 38 10.1109/5.554206
39. de Rosis, F., Castelfranchi, C., Goldie, P., Carofiglio, V.: Cognitive evaluations and intuitive appraisals: can emotion models handle them both? HUMAINE Handbook. Springer, Berlin (in press)
40. De Vicente A., Pain H.: Informing the detection of the students' motivational state: An empirical study. In: Cerri, S. A., Gouarderes, G., Paraguacu, F. (eds) 6th International conference on intelligent tutoring systems, pp. 933-943. San Sebastian, Spain (2002)
41. P. Dodds J. Fletcher 2004 Opportunities for new "smart" learning environments enabled by next-generation web capabilities J. Educ. Multimed. Hypermed. 13 391 404
42. Ekman P.: Expression and the nature of emotion. In: Scherer, K., Ekman, P. (eds) Approaches to Emotion, pp. 319-344. Erlbaum, Hillsdale, NJ (1984)
43. P. Ekman 1992 An Argument for basic emotions Cogn. Emot. 6 169 200 10.1080/02699939208411068
44. Ekman, P.: Darwin, deception, and facial expression. In: Conference on emotions inside out, 130 years after Darwin's the expression of the emotions in man and animals, New York, New York (2002)
45. P. Ekman W. Friesen 1969 Nonverbal leakage and clues to deception Psychiatry 32 88 105
46. Ekman P., Friesen W.: Unmasking the Face: A Guide to Recognizing Emotions from Facial Expressions. Prentice-Hall, Englewood Cliffs, NJ (1975)
47. Ekman P., Friesen W.: The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
48. P. Ekman W. Friesen R. Davidson 1990 The Duchenne smile-emotional expression and brain physiology. 2 J. Pers. Soc. Psychol. 58 342 353 10.1037/0022-3514.58.2.342
49. Fernandez, R., Picard, R.: Classical and novel discriminant features for affect recognition from speech. In: 9th European conference on speech communication and technology (2005)
50. Fleiss J.: Statistical Methods for Rates and Proportions. 2nd edn. John Wiley and Son, New York (1981)
51. K. Forbes-Riley M. Rotaru D. Litman 2008 The relative impact of student affect on performance models in a spoken dialogue tutoring system User Model. User-Adapt. Interact. 18 11 43 10.1007/s11257-007-9038-5
52. Gertner A., VanLehn K.: Andes: a coached problem solving environment for physics. In: Gauthier, G., Frasson, C., VanLehn, K. (eds) International conference on intelligent tutoring systems, pp. 133-142. Springer, Berlin/Heidelberg (2000)
53. A. Graesser K. VanLehn C. P. Rose P. W. Jordan D. Harter 2001 Intelligent tutoring systems with conversational dialogue AI Mag. 22 39 51
54. A. Graesser S. L. Lu G. Jackson H. Mitchell M. Ventura A. Olney, et al. 2004 AutoTutor: a tutor with dialogue in natural language Behav. Res. Method. Instrum. Comput. 36 180 193
55. A. Graesser P. Chipman B. Haynes A. Olney 2005 AutoTutor: an intelligent tutoring system with mixed-initiative dialogue IEEE Transac. Educ. 48 612 618 10.1109/TE.2005.856149 (Pubitemid 41723893)
56. A. Graesser D. McNamara K. VanLehn 2005 Scaffolding deep comprehension strategies through PointandQuery, AutoTutor, and iSTART Educ. Psychol. 40 225 234 10.1207/s15326985ep4004-4 (Pubitemid 43266591)
57. Graesser, A., McDaniel, B., Chipman, P., Witherspoon, A., D'Mello, S., Gholson, B.: Detection of emotions during learning with AutoTutor. In: 28th Annual conference of the cognitive science society, Vancouver, Canada (2006)
58. Graesser A., Penumatsa P., Ventura M., Cai Z., Hu X.: Using LSA in AutoTutor: learning through mixed-initiative dialogue in natural language. In: Landauer, T., McNamara, D., Dennis, S., Kintsch, W. (eds) Handbook of Latent Semantic Analysis, pp. 243-262. Erlbaum, Mahwah, NJ (2007)
59. R. Hocking 1976 Analysis and selection of variables in linear regression Biometrics 32 1 49 0328.62042 10.2307/2529336 398008
60. Hoque, M. E., el Kaliouby, R., Picard, R. W.: When human coders (and machines) disagree on the meaning of facial affect in spontaneous videos. In: 9th International conference on intelligent virtual agents, Amsterdam (2009)
61. E. Hudlicka M. McNeese 2002 Assessment of user affective and belief states for interface adaptation: Application to an Air Force pilot task User Model. User-Adapt. Interact. 12 1 47 1030.68703 10.1023/A:1013337427135 (Pubitemid 34109557)
62. A. Jaimes N. Sebe 2007 Multimodal human-computer interaction: a survey Comput. Vis. Image Underst. 108 116 134 10.1016/j.cviu.2006.10.019 (Pubitemid 47333395)
63. Johnstone T., Scherer K.: Vocal communication of emotion. In: Lewis, M., Haviland-Jones, J. (eds) Handbook of emotions (2nd edn.), pp. 220-235. Guilford Press, New York (2000)
64. Jonassen D., Peck K., Wilson B.: Learning with technology: a constructivist perspective. Prentice Hall, Upper Saddle River, NJ (1999)
65. A. Kapoor B. Burleson R. Picard 2007 Automatic prediction of frustration Int. J. Hum.-Comput. Stud. 65 724 736 10.1016/j.ijhcs.2007.02.003 (Pubitemid 46810294)
66. Kapoor, A., Picard, R.: Multimodal affect recognition in learning environments. In: 13th annual ACM international conference on Multimedia, Hilton, Singapore (2005)
67. Keltner D., Ekman P.: Facial expression of emotion. In: Lewis, R., Haviland-Jones, J. M. (eds) Handbook of Emotions (2nd edn.), pp. 236-264. Guilford, New York (2000)
68. Klecka W.: Discriminant Analysis. Sage, Beverly Hills, CA (1980)
69. K. Koedinger J. Anderson W. Hadley M. Mark 1997 Intelligent tutoring goes to school in the big city Int. J. Artif. Intell. Educ. 8 30 43
70. Koedinger K., Corbett A.: Cognitive tutors: technology bringing learning sciences to the classroom. In: Sawyer, R.K. (eds) The Cambridge Handbook of the Learning Sciences, pp. 61-78. Cambridge University Press, New York, NY (2006)
71. Kort, B., Reilly, R., Picard, R.: An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion. In: IEEE international conference on advanced learning technologies, Madison, Wisconsin (2001)
72. T. Landauer S. Dumais 1997 A solution to Plato's problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge Psychol. Rev. 104 211 240 10.1037/0033-295X.104.2.211
73. Landauer, T., McNamara, D., Dennis, S., Kintsch, W. (eds): Handbook of Latent Semantic Analysis. Erlbaum, Mahwah, NJ (2007)
74. Landauer, T., McNamara, D., Dennis, S., Kintsch, W. (eds): Handbook of Latent Semantic Analysis. Erlbaum, Mahwah, NJ (2008)
75. C. Lee S. Narayanan 2005 Toward detecting emotions in spoken dialogs IEEE Transac. Speech Audio Process. 13 293 303 10.1109/TSA.2004.838534 (Pubitemid 40320247)
76. Lehman B., D'Mello, S., Person, N.: All Alone with your Emotions: an analysis of student emotions during effortful problem solving activities. In: Workshop on emotional and cognitive issues in ITS at the ninth international conference on intelligent tutoring systems. Montreal, Canada (2008)
77. Lehman B., Matthews M., D'Mello S., Person N.: What are you feeling? Investigating student affective states during expert human tutoring sessions. In: Woolf, B., Aimeur, E., Nkambou, N., Lajoie, S. (eds) 9th International conference on intelligent tutoring systems, pp. 50-59. Montreal, Canada (2008)
78. Liscombe, J., Riccardi, G., Hakkani-Tü, D.: Using Context to Improve Emotion Detection in Spoken Dialog Systems. In: 9th European conference on speech communication and technology, Lisbon, Portugal (2005)
79. Litman, D., Forbes-Riley, K.: Predicting student emotions in computer-human tutoring dialogues. In:42nd Annual meeting on association for computational linguistics, Barcelona, Spain (2004)
80. Madsen, M., el Kaliouby, R., Goodwin, M., Picard, R.: Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In: 10th ACM conference on computers and accessibility. Halifax, Canada (2008)
81. Mandler G.: Mind and Emotion. Wiley, New York (1976)
82. Mandler G.: Mind and Body: Psychology of Emotion and Stress. W.W. Norton and Company, New York (1984)
83. I. Marsic A. Medl J. Flanagan 2000 Natural communication with information systems IEEE 88 1354 1366 10.1109/5.880088
84. McDaniel B., D'Mello S., King B., Chipman P., Tapp K., Graesser A.: Facial features for affective state detection in learning environments. In: McNamara, D., Trafton, G. (eds) 29th Annual meeting of the cognitive science society, pp. 467-472. Cognitive Science Society, Austin, TX (2007)
85. S. McQuiggan B. Mott J. Lester 2008 Modeling self-efficacy in intelligent tutoring systems: an inductive approach User Model. User-Adapt. Interact. 18 81 123 10.1007/s11257-007-9040-y
86. Mitchell, T.: Machine Learning. Mc-Graw-Hill, (1997)
87. Morimoto, C., Koons, D., Amir, A., Flickner, M.: Pupil detection and tracking using multiple light sources. In: Workshop on advances in facial image analysis and recognition technology, Fifth European Conference on Computer Vision (ECCV'98), Freiburg, June 1998
88. D. Moshman 1982 Exogenous, endogenous, and dialectical constructivism Dev. Rev. 2 371 384 10.1016/0273-2297(82)90019-3
89. D. Norman 1994 How might people interact with agents Commun. ACM 37 68 71 10.1145/176789.176796
90. Olney, A., Louwerse, M., Mathews, E., Marineau, J., Hite-Mitchell, H., Graesser, A.: Utterance classification in AutoTutor. In: Human language technology-North American chapter of the association for computational linguistics conference. Edmonton, Canada (2003)
91. A. Ortony T. Turner 1990 What's basic about basic emotions Psychol. Rev. 97 315 331 10.1037/0033-295X.97.3.315
92. Paiva, A., Prada, R., Picard, R. (eds): Affective Computing and Intelligent Interaction. Springer, Heidelberg (2007)
93. Panksepp J.: Emotions as natural kinds within the mammalian brain. In: Lewis, M., Haviland-Jones, J. M. (eds) Handbook of Emotions (2nd edn.), pp. 137-156. Guilford, New York (2000)
94. M. Pantic I. Patras 2006 Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences IEEE Transac. Syst. Man Cybern. B 36 433 449 10.1109/TSMCB.2005.859075
95. M. Pantic L. Rothkrantz 2003 Toward an affect-sensitive multimodal human-computer interaction Proc. IEEE 91 1370 1390 10.1109/JPROC.2003.817122 (Pubitemid 40890819)
96. A. Pentland 2000 Looking at people: sensing for ubiquitous and wearable computing IEEE Transac. Pattern Anal. Mach. Intell. 22 107 119 10.1109/34.824823 (Pubitemid 32132957)
97. Picard R.: Affective Computing. MIT Press, Cambridge, Mass (1997)
98. R. Picard E. Vyzas J. Healey 2001 Toward machine emotional intelligence: analysis of affective physiological state IEEE Transac. Pattern Anal. Mach. Intell. 23 1175 1191 10.1109/34.954607 (Pubitemid 33047955)
99. K. Porayska-Pomsta M. Mavrikis H. Pain 2008 Diagnosing and acting on student affect: the tutor's perspective User Model. User-Adapt. Interact. 18 125 173 10.1007/s11257-007-9041-x
100. H. Prendinger M. Ishizuka 2005 The empathic companion: a character-based interface that addresses users' affective states Appl. Artif. Intell. 19 267 285 10.1080/08839510590910174 (Pubitemid 40500032)
101. Robson C.: Real World Research: Resource for Social Scientist and Practitioner Researchers. Blackwell, Oxford (1993)
102. Rus V., Graesser A.: Lexico-syntactic subsumption for textual entailment. In: Nicolov, N., Bontcheva, K., Angelova, G., Mitkov, R. (eds) Recent Advances in Natural Language Processing IV: Selected Papers from RANLP 200., pp. 187-196. John Benjamins Publishing Company, Amsterdam (2007)
103. J. Russell 1994 Is there universal recognition of emotion from facial expression-a review of the cross-cultural studies Psychol. Bull. 115 102 141 10.1037/0033-2909.115.1.102
104. J. Russell 2003 Core affect and the psychological construction of emotion Psychol. Rev. 110 145 172 10.1037/0033-295X.110.1.145
105. K. Scherer 2003 Vocal communication of emotion: a review of research paradigms Speech Commun. 40 227 256 1006.68948 10.1016/S0167-6393(02)00084-5
106. K. Scherer H. Ellgring 2007 Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7 158 171 10.1037/1528-3542.7.1.158 (Pubitemid 46433172)
107. Scherer K., Johnstone T., Klasmeyer G.: Vocal expression of emotion. In: Davidson, R. J., Scherer, K. R., Goldsmith, H. (eds) Handbook of the Affective Sciences, pp. 433-456. Oxford University Press, New York and Oxford (2003)
108. Shneiderman B., Plaisant C.: Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley, Reading, MA (2005)
109. Storey, J., Kopp, K., Wiemer, K., Chipman, P., Graesser, A.: Critical thinking tutor: using AutoTutor to teach scientific critical thinking skills'. Behav. Res. Method. (in press)
110. Tekscan: Body Pressure Measurement System User's Manual. Tekscan Inc., South Boston, MA (1997)
111. T. Turner A. Ortony 1992 Basic emotions-can conflicting criteria converge Psychol. Rev. 99 566 571 10.1037/0033-295X.99.3.566
112. VanLehn K.: Mind Bugs: The Origins of Procedural Misconceptions. MIT Press, Cambridge, MA (1990)
113. K. VanLehn A. Graesser G. Jackson P. Jordan A. Olney C. Rose 2007 When are tutorial dialogues more effective than reading? Cogn. Sci. 31 3 62
114. K. VanLehn C. Lynch K. Schulze J. Shapiro R. Shelby L. Taylor, et al. 2005 The Andes physics tutoring system: five years of evaluations Int. J. Artif. Intell. Educ. 15 147 204
115. Woolf, B., Burleson, W., Arroyo, I.: Emotional intelligence for computer tutors. In: Workshop on modeling and scaffolding affective experiences to impact learning at 13th international conference on artificial intelligence in education, Los Angeles, California (2007)
116. Yoshitomi, Y., Sung-Ill, K., Kawano, T., Kilazoe, T.: Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face. In: IEEE international workshop on robots and human interactive communications, Osaka, Japan (2000)
117. Zeng, Z., Hu, Y., Roisman, G., Wen, Z., Fu, Y., Huang, T.: Audio-visual emotion recognition in adult attachment interview. In: International conference on multimodal interfaces, Alberta, Canada (2006)
118. Z. Zeng M. Pantic G. Roisman T. Huang 2009 A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Transac. Pattern Anal. Mach. Intell. 31 39 58 10.1109/TPAMI.2008.52