Gesture modeling by Hanklet-Based Hidden Markov model

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 9005, Issue , 2015, Pages 529-546

  Presti, Liliana Lo ^a   La Cascia, Marco ^a   Sclaroff, Stan ^b   Camps, Octavia ^c  

^a UNIVERSITY OF PALERMO   (Italy)

^b BOSTON UNIVERSITY   (United States)

^c Northeastern University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; LINEAR SYSTEMS; MATRIX ALGEBRA; TRAJECTORIES;

DISCRIMINATIVE APPROACH; FEATURE REPRESENTATION; HUMAN BODY MOTION; JOINT TRAJECTORIES; LINEAR TIME-INVARIANT SYSTEM; OBSERVABILITY MATRIX; STATE OF THE ART; TEMPORAL WINDOWS;

TEMPORAL LOGIC;

EID: 84983621565     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-16811-1_35     Document Type: Conference Paper

References (48)

1. Kwak, S., Han, B., Han, J.: Scenario-based video event recognition by constraint flow. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3345–3352. IEEE (2011)
2. Gaur, U., Zhu, Y., Song, B., Roy-Chowdhury, A.: A string of feature graphs model for recognition of complex activities in natural videos. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2595–2602. IEEE (2011)
3. Park, S., Aggarwal, J.: Recognition of two-person interactions using a hierarchical Bayesian network. In: First ACM SIGMM International Workshop on Video Surveillance, pp. 65–76. ACM (2003)
4. Junejo, I., Dexter, E., Laptev, I., Pérez, P.: View-independent action recognition from temporal self-similarities. IEEE Trans. Pattern Anal. Mach. Intell. 33, 172–185 (2011)
5. Duric, Z., Gray, W., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M., Schunn, C., Wechsler, H.: Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. Proceeding of the IEEE 90(7), 1272–1289 (2002)
6. Chang, Y. J., Chen, S. F., Huang, J. D.: A kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Res. Dev. Disabil. 32, 2566–2570 (2011)
7. Rehg, J. M., Abowd, G. D., Rozga, A., Romero, M., Clements, M. A., Sclaroff, S., Essa, I., Ousley, O. Y., Li, Y., Kim, C., et al.: Decoding children’s social behavior. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3414–3421. IEEE (2013)
8. Lo Presti, L., Sclaroff, S., Rozga, A.: Joint alignment and modeling of correlated behavior streams. In: The IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 730-737 (2013)
9. Jung, N., Moon, H., Sharma, R.: Method and system for measuring shopper response to products based on behavior and facial expression. US Patent 8, 219, 438 (2012)
10. Müller, M., Röder, T.: Motion templates for automatic classification and retrieval of motion capture data. In: Proceedings of the 2006 ACM SIGGRAPH/ Eurographics symposium on Computer animation, pp. 137–146. Eurographics Association (2006)
11. Lv, F., Nevatia, R.: Recognition and segmentation of 3-D human action using HMM and multi-class AdaBoost. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 359–372. Springer, Heidelberg (2006)
12. Masood, S. Z., Ellis, C., Tappen, M. F., LaViola, J. J., Sukthankar, R.: Exploring the trade-off between accuracy and observational latency in action recognition. Int. J. Comput. Vis. 101, 420–436 (2013)
13. Oreifej, O., Liu, Z., Redmond, W.: HON4D: histogram of oriented 4D normals for activity recognition from depth sequences. In: Computer Vision and Pattern Recognition (CVPR), pp. 716–723 (2013)
14. Yamato, J., Ohya, J., Ishii, K.: Recognizing human action in time-sequential images using hidden Markov Model. In: 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Proceedings CVPR 1992, pp. 379–385. IEEE (1992)
15. Starner, T., Pentland, A.: Real-time American sign language recognition from video using hidden Markov models. In: Shah, M., Jain, R. (eds.) Motion-Based Recognition. CIV, vol. 9, pp. 227–243. Springer, Heidelberg (1997)
16. Wang, Y., Mori, G.: Max-margin hidden conditional random fields for human action recognition. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2009, pp. 872–879. IEEE (2009)
17. Vail, D. L., Veloso, M. M., Lafferty, J. D.: Conditional random fields for activity recognition. In: Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1331–1338, ACM (2007)
18. Wang, S. B., Quattoni, A., Morency, L., Demirdjian, D., Darrell, T.: Hidden conditional random fields for gesture recognition. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1521–1527. IEEE (2006)
19. Li, B., Ayazoglu, M., Mao, T., Camps, O. I., Sznaier, M.: Activity recognition using dynamic subspace angles. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3193–3200. IEEE (2011)
20. Xia, L., Chen, C. C., Aggarwal, J.: View invariant human action recognition using histograms of 3D joints. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 20–27. IEEE (2012)
21. Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Commun. ACM 56, 116–124 (2013)
22. Yang, X., Tian, Y.: Eigenjoints-based action recognition using Naive-Bayes-Nearest-Neighbor. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 14–19. IEEE (2012)
23. Wang, J., Liu, Z., Wu, Y., Yuan, J.: Mining actionlet ensemble for action recognition with depth cameras. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1290–1297. IEEE (2012)
24. Li, W., Zhang, Z., Liu, Z.: Action recognition based on a bag of 3D points. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 9–14. IEEE (2010)
25. Wang, J., Liu, Z., Chorowski, J., Chen, Z., Wu, Y.: Robust 3D action recognition with random occupancy patterns. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 872–885. Springer, Heidelberg (2012)
26. Vieira, A. W., Nascimento, E. R., Oliveira, G. L., Liu, Z., Campos, M. F.: Stop: spacetime occupancy patterns for 3D action recognition from depth map sequences. In: Alvarez, L., Mejail, M., Gomez, L., Jacobo, J. (eds.) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. LNCS, vol. 7441, pp. 252–259. Springer, Heidelberg (2012)
27. Devanne, M., Wannous, H., Berretti, S., Pala, P., Daoudi, M., Del Bimbo, A.: Space-time pose representation for 3D human action recognition. In: Petrosino, A., Maddalena, L., Pala, P. (eds.) ICIAP 2013. LNCS, vol. 8158, pp. 456–464. Springer, Heidelberg (2013)
28. Sung, J., Ponce, C., Selman, B., Saxena, A.: Unstructured human activity detection from RGBD images. In: 2012 IEEE International Conference on Robotics and Automation (ICRA), pp. 842–849. IEEE (2012)
29. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)
30. Weinland, D., Boyer, E., Ronfard, R.: Action recognition from arbitrary views using 3D exemplars. In: IEEE 11th International Conference on Computer Vision. ICCV 2007, pp. 1–7. IEEE (2007)
31. Martinez-Contreras, F., Orrite-Urunuela, C., Herrero-Jaraba, E., Ragheb, H., Velastin, S. A.: Recognizing human actions using silhouette-based HMM. In: Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance. AVSS 2009, pp. 43–48. IEEE (2009)
32. Lan, T., Wang, Y., Yang, W., Mori, G.: Beyond actions: discriminative models for contextual group activities. NIPS 4321, 4322–4325 (2010)
33. Wilson, A. D., Bobick, A. F.: Parametric hidden Markov models for gesture recognition. IEEE Trans. Pattern Anal. Mach. Intell. 21, 884–900 (1999)
34. Sha, F., Saul, L. K.: Large margin hidden Markov models for automatic speech recognition. Adv. Neural Inf. Process. Syst. 19, 1249 (2007)
35. Collins, M.: Discriminative training methods for hidden Markov models: theory and experiments with perceptron algorithms. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 1–8. Association for Computational Linguistics (2002)
36. Bamieh, B., Giarre, L.: Identification of linear parameter varying models. Int. J. Robust Nonlinear Control 12, 841–853 (2002)
37. Paoletti, S., Juloski, A. L., Ferrari-Trecate, G., Vidal, R.: Identification of hybrid systems a tutorial. Eur. J. Control 13, 242–260 (2007)
38. Sontag, E. D.: Nonlinear regulation: the piecewise linear approach. IEEE Trans. Autom. Control 26, 346–358 (1981)
39. Gupta, V., Murray, R. M., Shi, L., Sinopoli, B.: Networked sensing, estimation and control systems. California Institute of Technology Report (2009)
40. Cuzzolin, F., Sapienza, M.: Learning pullback HMM distances. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1483–1489 (2013)
41. Li, B., Camps, O. I., Sznaier, M.: Cross-view activity recognition using Hankelets. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1362–1369. IEEE (2012)
42. Doretto, G., Chiuso, A., Wu, Y. N., Soatto, S.: Dynamic textures. Int. J. Comput. Vis. 51, 91–109 (2003)
43. Dicle, C., Camps, O. I., Sznaier, M.: The way they move: tracking multiple targets with similar appearance, pp. 2304–2311 (2013)
44. Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989)
45. Chang, P. C., Juang, B. H.: Discriminative training of dynamic programming based speech recognizers. IEEE Trans. Speech Audio Process. 1, 135–143 (1993)
46. Green, P. J.: Reversible jump Markov Chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711–732 (1995)
47. Martens, J., Sutskever, I.: Learning recurrent neural networks with Hessian-free optimization. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 1033–1040 (2011)
48. Yang, X., Zhang, C., Tian, Y.: Recognizing actions using depth motion maps-based histograms of oriented gradients. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 1057–1060. ACM (2012)