A generative restricted Boltzmann machine based method for high-dimensional motion data modeling

Computer Vision and Image Understanding

Volumn 136, Issue , 2015, Pages 14-22

  Nie, Siqi ^a   Wang, Ziheng ^a   Ji, Qiang ^a  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Facial expression recognition; Generative model; High dimensional motion data; Human action recognition; Restricted Boltzmann machine

Indexed keywords

COMPUTER VISION; GESTURE RECOGNITION; LEARNING SYSTEMS; MOTION ESTIMATION;

FACIAL EXPRESSION RECOGNITION; GENERATIVE MODEL; HUMAN-ACTION RECOGNITION; MOTION DATA; RESTRICTED BOLTZMANN MACHINE;

FACE RECOGNITION;

EID: 84951985479     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.12.005     Document Type: Article

References (36)

1. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake Real-time human pose recognition in parts from single depth images CVPR 2011 IEEE 1297 1304
2. P. Lucey, J.F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression CVPR Workshops 2010 IEEE 94 101
3. I. Laptev On space-time interest points Int. J. Comput. Vis. 64 2-3 2005 107 123
4. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: CVPR, 2008, pp. 1-8.
5. F. Lv, and R. Nevatia Recognition and segmentation of 3-d human action using hmm and multi-class adaboost ECCV 2006 359 372
6. J. Wang, Z. Liu, Y. Wu, and J. Yuan Mining actionlet ensemble for action recognition with depth cameras CVPR 2012 IEEE 1290 1297
7. I. Dagli, M. Brost, and G. Breuel Action recognition and prediction for driver assistance systems using dynamic belief networks Agent Technologies, Infrastructures, Tools, and Applications for E-Services 2003 Springer 179 194
8. C. Sminchisescu, A. Kanaujia, and D. Metaxas Conditional models for contextual human motion recognition Comput. Vis. Image Underst. 104 2 2006 210 220
9. S.A. Eslami, N. Heess, and J. Winn The shape Boltzmann machine: a strong model of object shape CVPR 2012 IEEE 406 413
10. Z. Wang, G. Schalk, Q. Ji, Anatomically constrained decoding of finger flexion from electrocorticographic signals, in: NIPS, 2011.
11. S. Osindero, G.E. Hinton, Modeling image patches with a directed hierarchy of Markov random fields, in: NIPS, 2007, pp. 1121-1128.
12. V. Bloom, D. Makris, and V. Argyriou G3d: a gaming action dataset and real time action recognition evaluation framework CVPR Workshops 2012 IEEE 7 12
13. M. Carreira-Perpinan, G. Hinton, On contrastive divergence learning, in: Artificial Intelligence and Statistics, vol. 2005, 2005, p. 17.
14. H. Lee, R. Grosse, R. Ranganath, and A.Y. Ng Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations Proceedings of the 26th Annual International Conference on Machine Learning 2009 ACM 609 616
15. R. Cutler, and M. Turk View-based interpretation of real-time optical flow for gesture recognition Automatic Face and Gesture Recognition 1998 IEEE 416 421
16. G. Yang, Y. Lin, and P. Bhattacharya A driver fatigue recognition model based on information fusion and dynamic bayesian network Inf. Sci. 180 10 2010 1942 1954
17. B. Packer, K. Saenko, and D. Koller A combined pose, object, and feature model for action understanding CVPR 2012 IEEE 1378 1385
18. G. Hinton, and R. Salakhutdinov Reducing the dimensionality of data with neural networks Science 313 5786 2006 504 507
19. V. Nair, and G. Hinton 3-d object recognition with deep belief nets NIPS 22 2009 1339 1347
20. Y. Wu, Z. Wang, and Q. Ji Facial feature tracking under varying facial expressions and face poses based on restricted Boltzmann machine CVPR 2013 IEEE
21. G. Taylor, G. Hinton, and S. Roweis Modeling human motion using binary latent variables NIPS 19 2007 1345
22. A. Kae, K. Sohn, H. Lee, and E. Learned-Miller Augmenting CRFs with Boltzmann machine shape priors for image labeling 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013 IEEE 2019 2026
23. A. Kae, B. Marlin, and E. Learned-Miller The shape-time random field for semantic video labeling 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014 IEEE
24. I. Sutskever, G.E. Hinton, Learning multilevel distributed representations for high-dimensional sequences, in: Artificial Intelligence and Statistics, 2007, pp. 544-551.
25. H. Larochelle, and Y. Bengio Classification using discriminative restricted Boltzmann machines ICML 2008 ACM 536 543
26. J. Louradour, and H. Larochelle Classification of Sets Using Restricted Boltzmann Machines UAI 2011 IEEE
27. G. Hinton Training products of experts by minimizing contrastive divergence Neural Comput. 14 8 2002 1771 1800
28. G. Hinton A practical guide to training restricted Boltzmann machines Momentum 9 2010 1
29. R. Salakhutdinov, and I. Murray On the quantitative analysis of deep belief networks Proceedings of the 25th International Conference on Machine Learning 2008 ACM 872 879
30. T. Schmah, G.E. Hinton, S.L. Small, S. Strother, R.S. Zemel, Generative versus discriminative training of RBMs for classification of fMRI images, in: NIPS, 2008, pp. 1409-1416.
31. E. Hüllermeier, J. Fürnkranz, W. Cheng, and K. Brinker Label ranking by learning pairwise preferences Artif. Intell. 172 16 2008 1897 1916
32. Z. Wang, S. Wang, Q. Ji, Capturing complex spatiooral relations among facial muscles for facial expression recognition, in: CVPR, 2013.
33. A. Lorincz, L.A. Jeni, Z. Szabó, J.F. Cohn, and T. Kanade Emotional expression classification using time-series kernels 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2013 IEEE 889 895
34. F. Long, T. Wu, J.R. Movellan, M.S. Bartlett, and G. Littlewort Learning spatiotemporal features by using independent component analysis with application to facial expression recognition Neurocomputing 93 2012 126 132
35. P. Yang, Q. Liu, and D.N. Metaxas Boosting encoded dynamic features for facial expression recognition Pattern Recogn. Lett. 30 2 2009 132 139
36. L.A. Jeni, J.M. Girard, J.F. Cohn, and F. De La Torre Continuous au intensity estimation using localized, sparse facial feature space 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) 2013 IEEE 1 7