Micro-Expression Recognition Using Color Spaces

IEEE Transactions on Image Processing

Volumn 24, Issue 12, 2015, Pages 6034-6047

  Wang, Su Jing ^a,b   Yan, Wen Jing ^c   Li, Xiaobai ^d   Zhao, Guoying ^d   Zhou, Chun Guang ^b   Fu, Xiaolan ^a   Yang, Minghao ^e   Tao, Jianhua ^e  

^a INSTITUTE OF PSYCHOLOGY   (China)

^b JILIN UNIVERSITY   (China)

^c WENZHOU UNIVERSITY   (China)

^d UNIVERSITY OF OULU   (Finland)

^e INSTITUTE OF AUTOMATION   (China)

Author keywords

Color Spaces; Facial Action Coding System; Local Binary Patterns; Micro expression recognition; Tensor Analysis

Indexed keywords

COMPUTER KEYBOARDS; FACE RECOGNITION; GESTURE RECOGNITION; PATTERN RECOGNITION; PATTERN RECOGNITION SYSTEMS; SIGNAL ENCODING; TEMPERATURE INDICATING CAMERAS; TENSORS;

COLOR SPACE; FACIAL ACTION CODING SYSTEM; LOCAL BINARY PATTERNS; MICRO-EXPRESSIONS; TENSOR ANALYSIS;

COLOR;

AUTOMATED PATTERN RECOGNITION; COLOR; EMOTION; FACE; FACIAL EXPRESSION; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PHYSIOLOGY; PROCEDURES;

COLOR; DATABASES, FACTUAL; EMOTIONS; FACE; FACIAL EXPRESSION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED;

EID: 84960131330     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2496314     Document Type: Article

References (43)

1. S.-J. Wang, W.-J. Yan, X. Li, G. Zhao, X. Fu, "Micro-expression recognition using dynamic textures on tensor independent color space," in Proc. 22nd Int. Conf. Pattern Recognit. (ICPR), Aug. 2014, pp. 4678-4683.
2. P. Ekman and W. Friesen, "Nonverbal leakage and clues to deception," Psychiatry, vol. 32, no. 1, pp. 88-106, 1969.
3. P. Ekman, "Lie catching and microexpressions," Philos. Deception, pp. 118-133, 2009.
4. M. G. Frank et al., "I see how you feel: Training laypeople and professionals to recognize fleeting emotions," in Proc. Annu. Meeting Int. Commun. Assoc., New York, NY, USA, 2009. [Online]. Available: http://www.allacademic.com/meta/p15018-index.html
5. M. O'Sullivan, M. G. Frank, C. M. Hurley, J. Tiwana, "Police lie detection accuracy: The effect of lie scenario," Law Human Behavior, vol. 33, no. 6, pp. 530-538, 2009.
6. M. G. Frank, C. Maccario, V. Govindaraju, Behavior and Security. Santa Barbara, CA, USA: Greenwood Pub. Group, 2009, pp. 86-106.
7. S. M. Lajevardi and Z. M. Hussain, "Automatic facial expression recognition: Feature extraction and selection," Signal, Image Video Process., vol. 6, no. 1, pp. 159-169, 2012.
8. E. A. Haggard and K. S. Isaacs, "Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy," in Methods of Research in Psychotherapy. New York, NY, USA: Appleton-Century-Crofts, 1966, pp. 154-165.
9. P. Ekman, "Darwin, deception, facial expression," Ann. New York Acad. Sci., vol. 1000, no. 1, pp. 205-221, 2003.
10. S. Weinberger, "Airport security: Intent to deceive?" Nature, vol. 465, no. 7297, pp. 412-415, 2010.
11. W.-J. Yan, Q. Wu, J. Liang, Y.-H. Chen, X. Fu, "How fast are the leaked facial expressions: The duration of micro-expressions," J. Nonverbal Behavior, vol. 37, no. 4, pp. 217-230, 2013.
12. D. Matsumoto and H. S. Hwang, "Evidence for training the ability to read microexpressions of emotion," Motivat. Emotion, vol. 35, no. 2, pp. 181-191, 2011.
13. S. Porter and L. ten Brinke, "Reading between the lies: Identifying concealed and falsified emotions in universal facial expressions.," Psychol. Sci., vol. 19, no. 5, pp. 508-514, 2008.
14. P. Ekman. (2002). Micro Expression Training Tool (METT). [Online]. Available: http://www.paulekman.com
15. S. Polikovsky, Y. Kameda, Y. Ohta, "Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor," in Proc. 3rd Int. Conf. Crime Detect. Prevent., 2009, pp. 1-6.
16. S.-J. Wang, H.-L. Chen, W.-J. Yan, Y.-H. Chen, X. Fu, "Face recognition and micro-expression recognition based on discriminant tensor subspace analysis plus extreme learning machine," Neural Process. Lett., vol. 39, no. 1, pp. 25-43, 2014.
17. T. Pfister, X. Li, G. Zhao, M. Pietikaïnen, "Recognising spontaneous facial micro-expressions," in Proc. 12th IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1449-1456.
18. G. Zhao and M. Pietikaïnen, "Dynamic texture recognition using local binary patterns with an application to facial expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 915-928, Jun. 2007.
19. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1635-1650, Jun. 2010.
20. C. Zhu, C.-E. Bichot, L. Chen, "Image region description using orthogonal combination of local binary patterns enhanced with color information," Pattern Recognit., vol. 46, no. 7, pp. 1949-1963, Jul. 2013.
21. S. H. Lee, H. Kim, Y. M. Ro, K. N. Plataniotis, "Using color texture sparsity for facial expression recognition," in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit. (FG), Apr. 2013, pp. 1-6.
22. R. Mehta and R. Zhu, "Blue or red? Exploring the effect of color on cognitive task performances," Science, vol. 323, no. 5918, pp. 1226-1229, 2009.
23. M. Villegas, R. Paredes, A. Juan, E. Vidal, "Face verification on color images using local features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2008, pp. 1-6.
24. C. Liu, "Learning the uncorrelated, independent, discriminating color spaces for face recognition," IEEE Trans. Inf. Forensics Security, vol. 3, no. 2, pp. 213-222, Jun. 2008.
25. C. Liu and J. Yang, "ICA color space for pattern recognition," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 248-257, Feb. 2009.
26. J. Yang and C. Liu, "Color image discriminant models and algorithms for face recognition," IEEE Trans. Neural Netw., vol. 19, no. 12, pp. 2088-2098, Dec. 2008.
27. S.-J. Wang, J. Yang, N. Zhang, C.-G. Zhou, "Tensor discriminant color space for face recognition," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2490-2501, Sep. 2011.
28. S.-J. Wang, J. Yang, M.-F. Sun, X.-J. Peng, M.-M. Sun, C.-G. Zhou, "Sparse tensor discriminant color space for face verification," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 6, pp. 876-888, Jun. 2012.
29. P. J. Phillips et al., "Overview of the face recognition grand challenge," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2005, pp. 947-954.
30. S. M. Lajevardi and H. R. Wu, "Facial expression recognition in perceptual color space," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3721-3733, Aug. 2012.
31. G. A. Ramirez, O. Fuentes, S. L. Crites, M. Jimenez, J. Ordonez, "Color analysis of facial skin: Detection of emotional state," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2014, pp. 474-479.
32. T. G. Kolda and B. W. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, 2009.
33. R. C. Gonzalez and R. E. Woods, Digital Image Processing Using MATLAB., 2nd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 2002.
34. P. Comon, "Independent component analysis: A new concept?" Signal Process., vol. 36, no. 3, pp. 287-314, 1994.
35. T. Ojala, M. Pietikaïnen, T. Maënpaä, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
36. P. Ekman, W. V. Friesen, J. C. Hager, "Facial action coding system: The manual on CD-ROM," Instructor's Guide, 2002.
37. T. F. Cootes, C. J. Taylor, D. H. Cooper, J. Graham, "Active shape models-Their training and application," Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, 1995.
38. W.-J. Yan, Q. Wu, Y.-J. Liu, S.-J. Wang, X. Fu, "CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces," in Proc. 10th IEEE Conf. Autom. Face Gesture Recognit., Apr. 2013, pp. 1-7.
39. P. Ekman, W. Friesen, J. Hager, FACS Investigator's Guide (The Manual on CD Rom), Salt Lake, UT, USA: Network Information Research Corporation, 2002.
40. W.-J. Yan et al., "CASME II: An improved spontaneous microexpression database and the baseline evaluation," PLoS ONE, vol. 9, no. 1, p. e86041, 2014.
41. F. S. Khan, J. van de Weijer, S. Ali, M. Felsberg, "Evaluating the impact of color on texture recognition," in Computer Analysis of Images and Patterns. Berlin, Germany: Springer-Verlag, 2013, pp. 154-162.
42. T. Maënpaä and M. Pietikaïnen, "Classification with color and texture: Jointly or separately?" Pattern Recognit., vol. 37, no. 8, pp. 1629-1640, 2004.
43. K. E. A. van de Sande, T. Gevers, C. G. M. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.