Dimensionality reduction using a Gaussian Process Annealed Particle Filter for tracking and classification of articulated body motions

Computer Vision and Image Understanding

Volumn 115, Issue 4, 2011, Pages 503-519

  Raskin, Leonid ^a   Rudzsky, Michael ^a   Rivlin, Ehud ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Action classification; Articulated body tracking; Dimensionality reduction

Indexed keywords

ACTION CLASSIFICATION; ANNEALED PARTICLE FILTERS; ARTICULATED BODY TRACKING; ARTICULATED HUMAN BODY TRACKING; BODY MOTIONS; BODY POSE; DATA SETS; DIMENSIONALITY REDUCTION; GAUSSIAN PROCESSES; HIGH-DIMENSIONAL DATA SPACE; HUMAN ACTIONS; HUMAN BODY MOTION; LOW DIMENSIONAL; LOW-DIMENSIONAL MANIFOLDS; LOW-DIMENSIONAL REPRESENTATION; MAPPING FUNCTIONS; NONLINEAR DIMENSIONALITY REDUCTION; TRACKING AND CLASSIFICATION;

EID: 79751532010     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.12.002     Document Type: Article

References (73)

1. J.K. Aggarwal, and Q. Cai Human motion analysis: a review Computer Vision and Image Understanding (CVIU) 73 3 1999 295 304
2. H. Alt, C. Knauer, C. Wenk, Matching polygonal curves with respect to the frchet distance, in: Proceedings of 18th International Symposium on Theoretical Aspect of Computer Science (STACS), vol. 2, 2001, pp. 63-74. (Pubitemid 33241740)
3. M.S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking IEEE Transactions on Signal Processing 50 2 2002 174 188 (Pubitemid 34291500)
4. A. Bakowski, and G. Jones Video surveillance tracking using color region adjacency graphs Image Processing and its Applications 1999 794 798 (Pubitemid 30503242)
5. A. Balan, L. Sigal, M. Black, A quantitative evaluation of video-based 3d person tracking, in: IEEE Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), 2005, pp. 349-356. (Pubitemid 46170648)
6. C. Bregler, J. Malik, and K. Pullen Twist based acquisition and tracking of animal and human kinematics International Journal of Computer Vision (IJCV) 56 3 2004 179 194
7. D. Comaniciu, V. Ramesh, and P. Meer Kernel-based object tracking IEEE Transaction Pattern Analysis and Machine Learning (PAMI) 25 5 2003 564 577
8. Q. Delamarre, and O. Faugeras 3d Articulated models and multi-view tracking with silhouettes Proceedings of International Conference on Computer Vision (ICCV) 2 1999 716 721 (Pubitemid 32079936)
9. Q. Delamarre, and O. Faugeras 3d articulated models and multi-view tracking with physical forces Computer Vision and Image Understanding (CVIU) 81 3 2001 328 357 (Pubitemid 32415980)
10. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, in: Proceedings of Computer Vision and Pattern Recognition (CVPR), 2000, pp. 2126-2133.
11. J. Deutscher, and I. Reid Articulated body motion capture by stochastic search International Journal of Computer Vision 61 2 2004 185 205
12. D. DiFranco, T.J. Cham, J.M. Rehg, Reconstruction of 3-d figure motion from 2-d correspondences, in: Proceedings of CVPR, 2001, pp. 307-314.
13. T. Drummond, and R. Cipolla Real-time tracking of highly articulated structures in the presence of noisy measurements Proceedings of International Conference on Computer Vision (ICCV) 2 2001 315 320 (Pubitemid 32795076)
14. A.M. Elgammal, and L. Davis Problematic frameworks for segmentation people under occlusion Proceedings of ICCV 2 2001 145 152 (Pubitemid 32795052)
15. A.M. Elgammal, and C. Lee Inferring 3d body pose from silhouettes using activity mani-fold learning Proceedings of Computer Vision and Pattern Recognition (CVPR) 2 2004 681 688
16. P. Felzenszwalb, D. Huttenlocher, Distance transforms of sampled functions, Technical report TR2004-1963, Cornell Computing and Information Science, 2004.
17. D.M. Gavrila, L.S. Davis, Tracking of human actions: a 3d mode-based approach, in: Proceedings of Computer Vision and Pattern Recognition (CVPR), 1996, pp. 73-80.
18. C. Gentile, O. Camps, and M. Sznaier Segmentation for robust tracking in the presence of severe occlusions IEEE Transactions on Image Processing 13 2 2004 166 178
19. K. Grauman, G. Shakhnarovich, T. Darrell, Inferring 3d structure with a statistical image-based shape model, in: Proceedings of International Conference on Computer Vision (ICCV), 2003, pp. 641-648.
20. K. Grochow, S. Martin, A. Hertzmann, and Z. Popovic Inferring 3d structure with a statistical image-based shape model ACM Transactions on Graphics SIGGRAPH 24 3 2004 522 531
21. S. Hongeng, F. Bremond, and R. Nevatia Representation and optimal recognition of human activities Proceedings of Computer Vision and Pattern Recognition (CVPR) 1 2000 818 825
22. G. Hua, M.-H. Yang, and Y. Wu Learning to estimate human pose with data driven belief propagation Proceedings of Computer Vision and Pattern Recognition (CVPR) 2 2005 747 754
23. S. Ioffe, and D.A. Forsyth Human tracking with mixtures of trees Proceedings of International Conference on Computer Vision (ICCV) 1 2001 690 695 (Pubitemid 32804835)
24. M. Isard, and A. Blake Condensation - conditional density propagation for visual tracking International Journal of Computer Vision (IJCV) 29 1 1998 5 28 (Pubitemid 128523364)
25. O.C. Jenkins, and M.J. Mataric A spatio-temporal extension to isomap nonlinear dimension reduction Proceedings of International Conference on Machine Learning (ICML) 2004 69
26. S. Kirkpatrick, C.D. Gellatt, and M.P. Vecchi Optimisation by simulated annealing Science 220 4598 1983 671 680
27. A. Kojima, and T. Tamura Natural language description of human activities from video image based on concept hierarchy of actions International Journal of Computer Vision 50 2001 171 184 (Pubitemid 35311926)
28. N.D. Lawrence Gaussian process latent variable models for visualization of high dimensional data Advances in Neural Information Processing Systems (NIPS) 16 2004 329 336
29. N.D. Lawrence, J.Q. Candela, Local distance preservation in the gp-lvm through back constraints, in: Proceedings of International Conference on Machine Learning (ICML), 2006, pp. 513-520.
30. R. Li, M.-H. Yang, S. Sclaroff, T.-P. Tian, Monocular tracking of 3d human motion with a coordinated mixture of factor analyzers, in: Proceedings of European Conference on Computer Vision (ECCV), vol. 2, 2006, pp. 137-150. (Pubitemid 44029723)
31. J. MacCormick, and M. Isard Partitioned sampling, articulated objects and interface-quality hand tracking Proceedings of European Conference on Computer Vision (ECCV) 2 2000 3 19
32. D.J.C. MacKay, Introduction to gaussian processes, Neural Networks and Machine Learning, 1998, pp. 133-166.
33. D.J.C. MacKay Information Theory, Inference, and Learning Algorithms 2003 Cambridge University Press
34. A. Mittal, and L.S. Davis M2tracker: a multi-view approach to segmenting and tracking people in a cluttered scene International Journal of Computer Vision 51 3 2003 189 203
35. G. Mori, X. Ren, A.A. Efros, and J. Malik Recovering human body configurations: combining segmentation and recognition Proceedings of Computer Vision and Pattern Recognition (CVPR) 2 2004 326 333
36. R. Navaratnam, A. Thayananthan, P.H. Torr, R. Cipolla, Hierarchical part-based human body pose estimation, in: British Machine Vision Conference (BMVC), 2005.
37. R.M. Neal, Bayesian learning for neural networks, Lecture Notes in Statistics, 1996.
38. N.M. Oliver, B. Rosario, and A.P. Pentland A bayesian computer vision system for modeling human interactions IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 831 843
39. D. Ormoneit, H. Sidenbladh, M. Black, and T. Hastie Learning and tracking cyclic human motion Advances in Neural Information Processing Systems (NIPS) 13 2006 894 900
40. J. Park, S. Park, and J.K. Aggrawal Human motion tracking by combining view-based and model-based methods for monocular video sequences Korean Journal of Information Processing 10 6 2003 657 664
41. S. Park, and J.K. Aggrawal A hierarchical bayesian network for event recognition of human actions and interactions ACM Multimedia Systems Journal 10 22 2004 164 179
42. S. Park, and J.K. Aggrawal Recognition of human interactions using multiple features in a grayscale images Proceedings of ICPR 1 2000 51 54
43. P. Perez, C. Hue, J. Vermaak, M. Gangnet, Color-based probabilistic tracking, in: Proceedings of European Conference on Computer Vision (ECCV), 2002, pp. 661-675.
44. D. Ramanan Learning to parse images of articulated bodies Advances in Neural Information Processing Systems (NIPS) 16 2006 329 336
45. D. Ramanan, and D.A. Forsyth Automatic annotation of everyday movements Information Processing Systems (NIPS) 2003
46. D. Ramanan, and D.A. Forsyth Finding and tracking people from the bottom up Proceedings of Computer Vision and Pattern Recognition (CVPR) 2 2003 467 474
47. D. Ramanan, and C. Sminchisescu Training deformable models for localization Proceedings of the Computer Vision and Pattern Recognition (CVPR) 1 2006 206 213 (Pubitemid 44931332)
48. C.E. Rasmussen, Gaussian processes in machine learning, Advanced Lectures on Machine Learning, 2003, pp. 63-71. (Pubitemid 39741628)
49. X. Ren, A.C. Berg, and J. Malik Recovering human body configurations using pairwise constrains between parts Proceedings of International Conference on Computer Vision (ICCV) 1 2005 824 831 (Pubitemid 44055040)
50. R. Rosales, S. Sclaroff, Inferring body pose without tracking body parts, in: Proceedings of CVPR, 2000, pp. 721-727.
51. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326 (Pubitemid 32041578)
52. J. Sherrah, and S. Gong Resolving visual uncertainty and occlusion through probabilistic reasoning British Machine Vision Conference 1 2000 252 261
53. H. Sidenbladh, M.J. Black, and D. Fleet Stochastic tracking of 3d human figures using 2d image motion Proceedings of the European Conference on Computer Vision (ECCV) 2 2000 702 718
54. L. Sigal, S. Bhatia, S. Roth, M.J. Black, and M. Isard Tracking loose-limbed people Proceedings of the Computer Vision and Pattern Recognition (CVPR) 1 2004 421 428
55. L. Sigal, and M.J. Black Measure locally, reason globally: occlusion-sensitive articulated pose estimation Proceedings of the Computer Vision and Pattern Recognition (CVPR) 2 2006 2041 2048 (Pubitemid 44931566)
56. L. Sigal, M. Isard, B. Sigelman, and M.J. Black Attractive people: Assempling lose-limbed models using non-parametric belief propagation Information Processing Systems (NIPS) 16 2003 1539 1546
57. C. Sminchisescu, A.D. Jepson, Generative modeling for continuous non-linearly embedded visual inference, in: Proceedings of the International Conference on Machine Learning (ICML), 2004.
58. C. Sminchisescu, A. Kanaujia, and D. Metaxas Learning joint top-down and bottom-up processes for 3d visual inference Proceedings of the Computer Vision and Pattern Recognition (CVPR) 2 2006 1743 1752
59. C. Sminchisescu, and B. Triggs Kinematic jump processes for monocular 3d human tracking Proceedings of the Computer Vision and Pattern Recognition (CVPR) 1 2003 69 76
60. W.Y. Teh, and S. Roweis Automatic alignment of local representations Advances in Neural Information Processing Systems (NIPS) 2002 841 848
61. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323 (Pubitemid 32041577)
62. T.-P. Tian, R. Liand, S. Sclaroff, Tracking human body pose on a learned smooth space, Technical report BUCS-TR-2005-029, 2005.
63. M.E. Tipping, and C.M. Bishop Probabilistic principal component analysis Journal of the Royal Statistical Society 6 3 1999 611 622
64. R. Urtasun, D.J. Fleet, and P. Fua 3d People tracking with gaussian process dynamical models Proceedings of the Computer Vision and Pattern Recognition (CVPR) 1 2006 238 245 (Pubitemid 44931336)
65. R. Urtasun, D.J. Fleet, A. Hertzmann, and P. Fua Priors for people tracking from small training sets Proceedings of the International Conference on Computer Vision (ICCV) 1 2005 403 410 (Pubitemid 44054986)
66. R. Urtasun, and P. Fua 3d Human body tracking using deterministic temporal motion models Proceedings of the European Conference on Computer Vision (ECCV) 3 2004 92 106
67. S. Wachter, and H.-H. Nagel Tracking persons in monocular image sequences Computer Vision and Image Understanding (CVIU) 74 3 1999 174 192
68. T. Wada, and T. Matsuyama Multiobject behavior recognition by event driven selective attention method IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 873 887
69. J. Wang, Gaussian process dynamical models for human motions, Master's thesis, University of Toronto, 2005.
70. J. Wang, D.J. Fleet, and A. Hetzmann Gaussian process dynamical models Information Processing Systems (NIPS) 2005 1441 1448
71. Q. Wang, G. Xu, and H. Ai Learning object intrinsic structure for robust visual tracking Proceedings of the Computer Vision and Pattern Recognition (CVPR) 2 2003 227 233
72. L. Zhao, and L. Davis Human body pose estimation by shape analysis of silhouettes IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) 2 2003 227 233
73. T. Zhao, and R. Nevatia Tracking multiple humans in complex situations IEEE Transactions on Patterns Analysis and Machine Intelligence (PAMI) 26 9 2004 1208 1221