Image and video processing for affective applications

Cognitive Technologies

Volumn , Issue 9783642151835, 2011, Pages 101-114

  Pantic, Maja ^a,b   Caridakis, George ^c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE PROCESSING; PATTERN RECOGNITION;

AFFECTIVE COMPUTING; APPLICATION AREA; EMOTION-AWARE SYSTEMS; FACIAL EXPRESSIONS; IMAGE AND VIDEO PROCESSING; RESEARCH EFFORTS; STATE OF THE ART; VISUAL CUES;

VIDEO SIGNAL PROCESSING;

EID: 84910055589     PISSN: 16112482     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-15184-2_7     Document Type: Chapter

References (76)

1. Ambadar, Z., Schooler, J., Cohn, JF., (2005) Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychol Sci 16(5):403-410
2. Ambady N, Rosenthal R (1992) Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychol Bull 111(2):256-274
3. Anderson K, McOwan PW (2006) A real-time automated system for recognition of human facial expressions. IEEE Trans Syst Man Cybern B 36(1):96-105
4. Bartlett MS, Hager JC, Ekman P, Sejnowski TJ (1999) Measuring facial expressions by computer image analysis. Psychophysiology 36(2):253-263
5. Bartlett MS, Littlewort G, Frank MG, Lainscsek C, Fasel I, Movellan J (2006) Fully automatic facial action recognition in spontaneous behavior. In: Seventh IEEE international conference on automatic face and gesture recognition (FG 2006), April 10-12, Southampton, UK, pp 223-230
6. Bartlett MS, Viola PA, Sejnowski TJ, Golomb BA, Larsen J, Hager JC, Ekman P (1996) Classifying facial actions. Adv Neural Inf Process Syst 8:823-829
7. Black MJ, Jepson AD (1998) Recognizing temporal trajectories using the condensation algorithm. In: Proceedings of the 3rd international conference on Face and Gesture Recognition FG, IEEE Computer Society, Washington, DC
8. Black M, Yacoob Y (1997) Recognizing facial expressions in image sequences using local parameterized models of image motion. Comput Vis 25(1):23-48
9. aA state-based approach to the representation and recognition of gesture. IEEE Trans Pattern Anal Mach Intell 19(12):1325-1337
10. Chang Y, Hu C, Feris R, Turk M (2006) Manifold based analysis of facial expression. J Image Vis Comput 24(6):605-614
11. Cohen MM (2006) Perspectives on the face. Oxford University Press, Oxford, UK
12. Cohn JF (2006) Foundations of human computing: facial expression and emotion. In: Proceedings of the ACM international conference on Multimodal Interfaces, Banff, Canada, November 2-4, pp 233-238
13. Cohn JF, Reed LI, Ambadar Z, Xiao J, Moriyama T (2004) Automatic analysis and recognition of brow actions in spontaneous facial behavior. In: Proceedings of the IEEE international conference on systems, man and cybernetics, The Hague, Netherlands, October 10-13, pp 610-616
14. Cohn JF, Schmidt KL (2004) The timing of facial motion in posed and spontaneous smiles. J Wavelets Multiresolution Inf Process 2(2):121-132
15. Ekman P (2003) Darwin, deception, and facial expression. Ann N Y Acad Sci 1000:205-221
16. Ekman P, Friesen WF (1969) The repertoire of nonverbal behavioral categories-origins, usage, and coding. Semiotica 1:49-98
17. Ekman P, Friesen WF (1978) Facial action coding system. Consulting Psychologist Press, Palo Alto, CA
18. Ekman P, Friesen WF, Hager JC (2002) Facial action coding system. A Human Face, Salt Lake City
19. Ekman P, Huang TS, Sejnowski TJ, Hager JC (eds) (1993) NSF understanding the face. A Human Face Store, Salt Lake City, (see Library)
20. Ekman P, Rosenberg EL, (eds) (2005) What the face reveals: basic and applied studies of spontaneous expression using the FACS. Oxford University Press, Oxford, UK
21. El Kaliouby R, Robinson P (2004) Real-time inference of complex mental states from facial expressions and head gestures. Proc Int Conf Comput Vis Pattern Recogn 3:154
22. Fang G, Gao W, Ma J (2001) Signer-independent sign language recognition based on SOFM/HMM, Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 2001. In: Proceedings of the IEEE ICCV Workshop on RATFG-RTS’01, Vancouver, Canada, July 13, pp 90-95
23. Fasel B, Monay F, Gatica-Perez D (2004) Latent semantic analysis of facial action codes for automatic facial expression recognition. In: Proceedings of the 6th ACM SIGMM international workshop on Multimedia Information Retrieval, New York, NY, October 10-16, pp 181-188
24. Fridlund AJ (1997) The new ethology of human facial expression. In: Russell JA, Fernandez-Dols JM (eds) The psychology of facial expression. Cambridge University Press, Cambridge, MA, pp 103-129
25. Gokturk SB, Bouguet JY, Tomasi C, Girod B (2002) Model-based face tracking for view independent facial expression recognition. In: 5th IEEE international conference on automatic face and gesture recognition (FGR 2002), Washington, DC, May 20-21, pp 272-278
26. Goleman D (1995) Emotional intelligence. Bantam Books, New York, NY
27. Gu H, Ji Q (2004) An automated face reader for fatigue detection. In: Sixth IEEE international conference on automatic face and gesture recognition (FGR 2004), IEEE Computer Society, Seoul, Korea, May 17-19, pp 111-116
28. Hong P, Turk M, Huang TS (2000) Gesture modeling and recognition using finite state machines. In: Proceedings of the 4th IEEE international conference and Gesture Recognition, Mar 2000, Grenoble
29. Hossain M, Jenkin M (2005) Recognizing hand-raising gestures using HMM. In: Proceedings of the 2nd Canadian conference on Computer and Robot Vision (CRV'05)-vol 00 (9-11 May 2005). CRV, IEEE Computer Society, Washington, DC, pp 405-412
30. Huang Y, Zhu Y, Xu G, Zhang H (1998) Spatial-temporal features by image registration and warping for dynamic gesture recognition. In: IEEE international conference on Systems, Man, and Cybernetics, vol 5, 11-14 Oct 1998, San Diego, pp 4498-4503
31. Juang CF, Ku K-C (2005 Aug) A recurrent fuzzy network for fuzzy temporal sequence processing and gesture recognition. IEEE Trans Syst Man Cybern B 35(4):646-658
32. Juslin PN, Scherer KR (2005) Vocal expression of affect. In: Harrigan J, Rosenthal R, Scherer K (eds) The new handbook of methods in nonverbal behavior research. Oxford University Press, Oxford
33. Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: 4th IEEE international conference on automatic face and gesture recognition (FGR 2000), IEEE Comptuer Society, Grenoble, France, March 26-30, pp 46-53
34. Kapoor A, Qi Y, Picard RW (2003) Fully automatic upper facial action recognition. In: Proceedings of the IEEE international workshop on Analysis and Modeling of Faces and Gestures, Nice, France, pp 195-202
35. Larsen RJ, Diener E (1992) Promises and problems with the circumplex model of emotion. Emotion 13:25-59. In: Clark MS (ed) Review of personality and social psychology. Sage, Newbury Park, CA
36. Lee C, Ghyme S, Park C, Wohn K (1998) The control of avatar motion using hand gesture. In: Proceedings of the ACM symposium on Virtual Reality Software and Technology (Taipei, Taiwan, 2-5 Nov 1998). VRST '98, ACM Press, New York, NY, pp 59-65
37. aAn HMM-based threshold model approach for gesture recognition°. IEEE Trans Pattern Anal Mach Intell 21(10):961-973
38. Li SZ, Jain AK, (eds) (2005) Handbook of face recognition. Springer, New York, NY
39. Lien JJJ, Kanade T, Cohn JF, Li CC (1998) Subtly different facial expression recognition and expression intensity estimation. In: Proceedings of the IEEE international conference on Computer Vision and Pattern Recognition, Research Triangle Park, North Carolina, pp 853-859
40. Mantyla VM, Mantyjarvi J, Seppanen T, Tuulari E (2000) Hand gesture recognition of a mobile device user. In: IEEE international conference on Multimedia and Expo (ICME 2000), New York, NY, vol 1, pp 281-284
41. Mu-Chun S (2000) A fuzzy rule-based approach to spatio-temporal hand gesture recognition. IEEE Trans Syst Man Cybern C Appl Rev 30(2):276-281
42. Ong SCW, Ranganath S (2005) Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans Pattern Anal Mach Intell 27(6):873-891
43. Ozer IB, Lu T, Wolf W (2005) Design of a real-time gesture recognition system: high performance through algorithms and software. Signal Process Mag IEEE 22(3):57-64
44. Pantic M (2005) Affective computing. In: Pagani M (ed) Encyclopedia of multimedia technology and networking, vol 1. Idea Group Reference, Hershy, PA, pp 8-14
45. Pantic M (2006) Face for ambient interface. Lect Notes Artif Intell 3864:35-66
46. Pantic M, Bartlett MS (2007) Machine analysis of facial expressions. In: Kurihara K (ed) Face recognition. Advanced Robotic Systems, Vienna, Austria
47. Pantic M, Patras I (2005) Detecting facial actions and their temporal segments in nearly frontalview face image sequences. In: Proceedings of the IEEE international conference on systems, Man and Cybernetics, Salerno, Italy, pp 3358-3363
48. Pantic M, Patras I (2006) Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans Syst Man Cybern B 36(2):433-449
49. Pantic M, Pentland A, Nijholt A, Huang TS (2006) Human Computing and machine understanding of human behaviour: a Survey. In: Proceedings of the ACM international conference Multimodal Interfaces, Banff, Canada, pp 239-248
50. Pantic M, Rothkrantz LJM (2000) Automatic analysis of facial expressions-the state of the art. IEEE Trans Pattern Anal Mach Intell 22(12):1424-1445
51. Pantic M, Rothkrantz LJM (2003) Toward an affect-sensitive multimodal human-computer interaction. Proc IEEE 91(9):1370-1390
52. Pantic M, Rothkrantz LJM (2004a) Facial action recognition for facial expression analysis from static face images. IEEE Trans Syst Man Cybern B 34(3):1449-1461
53. Pantic M, Rothkrantz LJM (2004b) Case-based reasoning for user-profiled recognition of emotions from face images. In: Proceedings of the 2004 IEEE international conference on multimedia & expo, ICME 2004, IEEE, Taipei, Taiwan, June 27-30, pp 391-394
54. Pantic M, Rothkrantz LJM, Koppelaar H (1998) Automation of non-verbal communication of facial expressions. In: Proceedings of the conference on Euromedia’98, De Montfort University, Leicester, UK, January 5-7, pp 86-93
55. Pantic M, Sebe N, Cohn JF, Huang TS (2005) Affective multimodal human-computer interaction. In: Proceedings of the ACM international conference on Multimedia, Hilton, Singapore, pp 669-676
56. Pantic M, Valstar MF, Rademaker R, Maat L (2005) Web-based database for facial expression analysis. In: Proceedings of the IEEE international conference on Multimedia and Expo, pp 317-321. www.mmifacedb.com
57. Patras I, Pantic M (2004) Particle filtering with factorized likelihoods for tracking facial features. In: Sixth IEEE international conference on automatic face and gesture recognition (FGR 2004), IEEE Computer Society, Seoul, Korea, May 17-19, pp 97-102
58. Perrin S, Cassinelli A, Ishikawa M (2004) Gesture recognition using laser-based tracking system. In: Sixth IEEE international conference on automatic face and gesture recognition (FGR 2004), IEEE Computer Society, Seoul, Korea, May 17-19, pp 541-546
59. Russell JA (1994) Is there universal recognition of emotion from facial expression? Psychol Bull 115(1):102-141
60. Samal A, Iyengar PA (1992) Automatic recognition and analysis of human faces and facial expressions: A survey. Pattern Recogn 25(1):65-77
61. Starner T, Weaver J, Pentland A (1998) Real-time American sign language recognition using desk and wearable computer-based video. IEEE Trans Pattern Anal Mach Intell 20(12):1371-1375
62. Tian YL, Kanade T, Cohn JF (2001) Recognizing action units for facial expression analysis. IEEE Trans Pattern Anal Mach Intell 23(2):97-115
63. Tian YL, Kanade T, Cohn JF (2005) Facial expression analysis. In: Li SZ, Jain AK (eds) Handbook of face recognition. Springer, New York, NY, pp 247-276
64. Valstar MF, Pantic M (2006) Fully automatic facial action unit detection and temporal analysis. Proc IEEE Int Conf Comput Vis Pattern Recogn 3:149
65. Valstar MF, Pantic M, Ambadar Z, Cohn JF (2006) Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceedings of the ACM international conference on Multimodal Interfaces, Banff, Alberta, Canada, pp 162-170
66. Valstar MF, Pantic M, Patras I (2004) Motion history for facial action detection from face video. Proc IEEE Int Conf Syst Man Cybern 1:635-640
67. Viola P, Jones M (2004) Robust real-time face detection. J Comput Vis 57(2):137-154
68. aASL recognition based on a coupling between HMMs and 3D Motion Analysis.° In: Proceedings of the 6th IEEE international conference on Computer Vision (ICCV-98), Narosa Publishing House, Bombay, India, January 4-7, pp 363-369
69. Vukadinovic D, Pantic M (2005) Fully automatic facial feature point detection using Gabor feature based boosted classifiers. In: Proceedings of the IEEE international conference on Systems, Man and Cybernetics, The Big Island, Hawaii, pp 1692-1698
70. Wierzbicka A (1993) Reading human faces. Pragmat Cogn 1(1):1-23
71. Wilson I, Bobick A (1999) Parametric hidden Markov models for gesture recognition. IEEE Trans Pattern Anal Mach Intell 21(9):884-900
72. Wong S, Cipolla R (2006) Continuous gesture recognition using a sparse Bayesian classifier. In: Proceedings of the 18th international conference on Pattern Recognition-vol 01, 2006. ICPR, IEEE Computer Society, Washington, DC, pp 1084-1087
73. Yang MH, Ahuja N, Tabb M (2002) Extraction of 2d motion trajectories and its application to hand gesture recognition. IEEE Trans Pattern Anal Mach Intell 24(8):1061-1074
74. Yang MH, Kriegman DJ, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34-58
75. Ying W, Huang TS (2001) Hand modeling, analysis and recognition. Signal Process Mag IEEE 18(3):51-60
76. Zhang Y, Ji Q (2005) Active and dynamic information fusion for facial expression understanding from image sequence. IEEE Trans Pattern Anal Mach Intell 27(5):699-714