Discriminative shared gaussian processes for multiview and view-invariant facial expression recognition

IEEE Transactions on Image Processing

Volumn 24, Issue 1, 2015, Pages 189-204

  Eleftheriadis, Stefanos ^a   Rudovic, Ognjen ^a   Pantic, Maja ^a,b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

acial expression recognition; Gaussian Processes; multi view learning; view invariant

Indexed keywords

ANATOMY AND HISTOLOGY; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; FACE; FACIAL EXPRESSION; HUMAN; IMAGE PROCESSING; NORMAL DISTRIBUTION; PROCEDURES;

ARTIFICIAL INTELLIGENCE; FACE; FACIAL EXPRESSION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; NORMAL DISTRIBUTION; PATTERN RECOGNITION, AUTOMATED;

EID: 84919898241     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2375634     Document Type: Article

References (53)

1. M. Pantic, A. Nijholt, A. Pentland, and T. S. Huanag, "Human-centred intelligent humanComputer interaction (HCI2): How far are we from attaining it?" Int. J. Auto. Adapt. Commun. Syst., vol. 1, no. 2, pp. 168-187, 2008.
2. A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: Survey of an emerging domain," Image Vis. Comput., vol. 27, no. 12, pp. 1743-1759, Nov. 2009.
3. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
4. Z. Zhu and Q. Ji, "Robust real-time face pose and facial expression recovery," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2006, pp. 681-688.
5. P. Ekman and W. V. Friesen, Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. Los Altos, CA, USA: Ishk, 2003.
6. S. Moore and R. Bowden, "Local binary patterns for multi-view facial expression recognitio," Comput. Vis. Image Understand., vol. 115, no. 4, pp. 541-558, Apr. 2011.
7. Y. Hu, Z. Zeng, L. Yin, X. Wei, J. Tu, and T. S. Huang, "A study of non-frontal-view facial expressions recognition," in Proc. 19th Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
8. N. Hesse, T. Gehrig, H. Gao, and H. K. Ekenel, "Multi-view facial expression recognition using local appearance features," in Proc. 21st Int. Conf. Pattern Recognit., Nov. 2012, pp. 3533-3536.
9. O. Rudovic, M. Pantic, and I. Patras, "Coupled Gaussian processes for pose-invariant facial expression recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1357-1369, Jun. 2013.
10. O. Rudovic, I. Patras, and M. Pantic, "Regression-based multiview facial expression recognition," in Proc. 20th Int. Conf. Pattern Recognit. (ICPR), Istanbul, Turkey, Aug. 2010, pp. 4121-4124.
11. W. Zheng, H. Tang, Z. Lin, and T. S. Huang, "Emotion recognition from arbitrary view facial images," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 490-503.
12. U. Tariq, J. Yang, and T. S. Huang, "Multi-view facial expression recognition analysis with generic sparse coding feature," in Proc. Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 578-588.
13. A. Sharma, A. Kumar, H. Daume, and D. W. Jacobs, "Generalized multiview analysis: A discriminative latent space," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2160-2167.
14. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-view discriminant analysis," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, pp. 808-821.
15. A. P. Shon, K. Grochow, A. Hertzmann, and R. P. N. Rao, "Learning shared latent structure for image synthesis and robotic imitation," in Proc. Adv. Neural Inf. Process. Syst., vol. 18. 2006, pp. 1233-1240.
16. C. H. Ek and P. H. T. N. D. Lawrence, "Shared Gaussian process latent variable models," Ph.D. dissertation, Dept. Comput. Sci., Oxford Brookes Univ., Headington, U.K., 2009.
17. R. Urtasun and T. Darrell, "Discriminative Gaussian process latent variable model for classification," in Proc. 24th Int. Conf. Mach. Learn., Jun. 2007, pp. 927-934.
18. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods (Computer Science and Applied Mathematics), vol. 1. Boston, MA, USA: Academic, 1982.
19. S. Eleftheriadis, O. Rudovic, and M. Pantic, "Shared Gaussian process latent variable model for multi-view facial expression recognition," in Proc. ISVC, Jul. 2013, pp. 527-538.
20. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
21. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
22. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
23. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 886-893.
24. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
25. N. Ahmed, T. Natarajan, and K. R. Rao, "Discrete cosine transform," IEEE Trans. Comput., vol. C-23, no. 1, pp. 90-93, Jan. 1974.
26. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. 7th IEEE Int. Conf. Comput. Vis., vol. 2. Sep. 1999, pp. 1150-1157.
27. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1794-1801.
28. H. Hotelling, "Relations between two sets of variates," Biometrika, vol. 28, nos. 3-4, pp. 321-377, 1936.
29. D. Hardoon, S. Szedmak, and J. Shawe-Taylor, "Canonical correlation analysis: An overview with application to learning methods," Neural Comput., vol. 16, no. 12, pp. 2639-2664, Dec. 2004.
30. J. Rupnik and J. Shawe-Taylor, "Multi-view canonical correlation analysis," in Proc. Conf. Data Mining Data Warehouses, 2010, pp. 1-4.
31. A. Kumar and H. Daumé, III, "A co-training approach for multiview spectral clustering," in Proc. Int. Conf. Mach. Learn., 2011, pp. 393-400.
32. T. Diethe, D. R. Hardoon, and J. Shawe-Taylor, "Constructing nonlinear discriminants from multiple data views," in Machine Learning and Knowledge Discovery in Databases. Berlin, Germany: Springer-Verlag, 2010, pp. 328-343.
33. C. M. Bishop, Pattern Recognition and Machine Learning, vol. 4. New York, NY, USA: Springer-Verlag, 2006.
34. X. Niyogi, "Locality preserving projections," in Proc. Neural Inf. Process. Syst., vol. 16. 2004, p. 153.
35. N. Lawrence, "Probabilistic non-linear principal component analysis with Gaussian process latent variable models," J. Mach. Learn. Res., vol. 6, pp. 1783-1816, Nov. 2005.
36. G. Zhong, W.-J. Li, D.-Y. Yeung, X. Hou, and C.-L. Liu, "Gaussian process latent random field," in Proc. 24th AAAI Conf. Artif. Intell., 2010, pp. 679-684.
37. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning, vol. 1. Cambridge, MA, USA: MIT Press, 2006.
38. N. D. Lawrence and J. Quiñonero-Candela, "Local distance preservation in the GP-LVM through back constraints," in Proc. Int. Conf. Mach. Learn., vol. 148. 2006, pp. 513-520.
39. F. Chung, Spectral Graph Theory. Providence, RI, USA: AMS, 1997.
40. H. Rue and L. Held, Gaussian Markov Random Fields: Theory and Applications, vol. 104. London, U.K.: Chapman & Hall, 2005.
41. M. Salzmann and R. Urtasun, "Implicitly constrained Gaussian process regression for monocular non-rigid pose estimation," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 2065-2073.
42. X. Zhu, J. D. Lafferty, and Z. Ghahramani, "Semi-supervised learning: From Gaussian fields to Gaussian processes," School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CS-03-175, 2003.
43. J. Hainmueller and C. Hazlett, "Kernel regularized least squares: Reducing misspecification bias with a flexible and interpretable machine learning approach," Political Anal., vol. 22, no. 2, pp. 143-168, 2014.
44. B. Schölkopf, R. Herbrich, and A. J. Smola, "A generalized representer theorem," in Computational Learning Theory. Berlin, Germany: Springer-Verlag, 2001, pp. 416-426.
45. S. Sundararajan and S. Keerthi, "Predictive approaches for choosing hyperparameters in Gaussian processes," Neural Comput., vol. 13, no. 5, pp. 1103-1118, May 2001.
46. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-pie," Image Vis. Comput., vol. 28, no. 5, pp. 807-813, May 2010.
47. P. N. Belhumeur, D.W. Jacobs, D. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 545-552.
48. A. Dhall, R. Goecke, S. Lucey, and T. Gedeon, "Static facial expression analysis in tough conditions: Data, evaluation protocol and benchmark," in Proc. Int. Conf Comput. Vis. Workshops, Nov. 2011, pp. 2106-2112.
49. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "A semiautomatic methodology for facial landmark annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2013, pp. 896-903.
50. V. Ojansivu and J. Heikkilä, "Blur insensitive texture classification using local phase quantization," in Image and Signal Processing. Berlin, Germany: Springer-Verlag, 2008, pp. 236-243.
51. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," in Proc. Int. Conf. Image Video Retr., 2007, pp. 401-408.
52. Z. Zheng, F. Yang, W. Tan, J. Jia, and J. Yang, "Gabor feature-based face recognition using supervised locality preserving projection," Signal Process., vol. 87, no. 10, pp. 2473-2483, Oct. 2007.
53. M. Pantic and I. Patras, "Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 2, pp. 433-449, Apr. 2006.