Temporal motion models for monocular and multiview 3D human body tracking

Computer Vision and Image Understanding

Volumn 104, Issue 2-3 SPEC. ISS., 2006, Pages 157-177

  Urtasun, Raquel ^a   Fleet, David J ^b   Fua, Pascal ^a  

^a EPFL   (Switzerland)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Motion models; Optimization; Tracking

Indexed keywords

HUMAN BODY TRACKING; MONOCULAR; MOTION MODELS; MULTI CAMERA TRACKING;

MONTE CARLO METHODS; MOTION COMPENSATION; OPTIMIZATION; PARTICLE BEAM TRACKING; THREE DIMENSIONAL;

MOTION ESTIMATION;

EID: 33750031202     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2006.08.006     Document Type: Article

References (53)

1. Blake A., North B., and Isard M. Learning multi-class dynamics. Advances in Neural Information Processing Systems 11 (1999) 389-395
2. Howe N.R., Leventon M.E., and Freeman W.T. Bayesian reconstructions of 3D human motion from single-camera video. Neural Information Processing Systems (1999), MIT Press, Cambridge, MA
3. V. Pavlovic, J. Rehg, J. MacCormick, Impact of dynamic model learning on classification of human motion, in: Conference on Computer Vision and Pattern Recognition, vol. 1, 2000, pp. 788-795.
4. North B., Blake A., Isard A., and Rittscher J. Learning and classification of complex dynamics. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 (2000) 1016-1034
5. Choo K., and Fleet D.J. People tracking using hybrid monte carlo filtering. International Conference on Computer Vision vol. 2 (2001), Vancouver, Canada 321-328
6. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, in: Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, 2000, pp. 2126-2133.
7. Isard M., and Blake A. Condensation-conditional density propagation for visual tracking. International Journal of Computer Vision 29 1 (1998) 5-28
8. H. Sidenbladh, M.J. Black, D.J. Fleet, Stochastic tracking of 3D human figures using 2D image motion, in: European Conference on Computer Vision, vol. 2, 2000, pp. 702-718.
9. C. Sminchisescu, B. Triggs, Kinematic jump processes for monocular 3D human tracking, in: Conference on Computer Vision and Pattern Recognition, vol. I, Madison, WI, 2003, pp. 69-76.
10. T. Moeslund, Computer vision-based motion capture of body language, Ph.D. thesis, Aalborg University, Aalborg, Denmark (June 2003).
11. Moeslund T., and Granum E. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81 3 (2001) 231-268
12. Bottino A., and Laurentinni A. A silhouette based technique for the reconstruction of human movement. Computer Vision and Image Understanding 83 (2001) 79-95
13. G. Cheung, S. Baker, T. Kanade, Shape-from-silhouette of articulated objects and its use for human body kinematis estimation and motion capture, in: Conference on Computer Vision and Pattern Recognition, Madison, WI, 2003, pp. 569-577.
14. Mikic I., Trivedi M., Hunter E., and Cosman P. Human body model acquisition and tracking using voxel data. International Journal of Computer Vision 53 3 (2003) 199-223
15. Q. Delamarre, O. Faugeras, 3D articulated models and multi-view tracking with silhouettes, in: International Conference on Computer Vision, vol. 2, Corfu, Greece, 1999, pp. 716-721.
16. T. Drummond, R. Cipolla, Real-time tracking of highly articulated structures in the presence of noisy measurements, in: International Conference on Computer Vision, vol. 2, Vancouver, Canada, 2001, pp. 315-320.
17. K. Grauman, G. Shakhnarovich, T. Darrell, Inferring 3D structure with a statistical image-based shape model, in: International Conference on Computer Vision, Nice, France, 2003, pp. 641-648.
18. G.J. Brostow, I. Essa, D. Steedly, V. Kwatra, Novel skeletal representation for articulated creatures, in: European Conference on Computer Vision, vol. 3, Prague, Czech Republic, 2004, pp. 66-78.
19. C.W. Chu, O.C. Jenkins, M.J. Mataric, Markerless kinematic model capture from volume sequences., in: Conference on Computer Vision and Pattern Recognition, Madison, WI, 2003, pp. 475-482.
20. A. Agarwal, B. Triggs, 3d human pose from silhouettes by relevance vector regression, in: Conference on Computer Vision and Pattern Recognition, vol. 2, 2004, pp. 882-888.
21. A. Elgammal, C. Lee, Inferring 3D body pose from silhouettes using activity manifold learning, in: CVPR, vol. 2, Washington, DC, 2004, pp. 681-688.
22. G. Mori, X. Ren, A. Efros, J. Malik, Recovering human body configurations: combining segmentation and recognition, in: Conference on Computer Vision and Pattern Recognition, vol. 2, Washington, DC, 2004, pp. 326-333.
23. R. Rosales, S. Sclaroff, Infering body pose without tracking body parts, in: Conference on Computer Vision and Pattern Recognition, vol. 2, 2000, pp. 506-511.
24. J. Sullivan, S. Carlsson, Recognizing and tracking human action, in: European Conference on Computer Vision, vol. 1, 2002, pp. 629-644.
25. Davison A.J., Deutscher J., and Reid I.D. Markerless motion capture of complex full-body movement for character animation. Eurographics Workshop on Computer Animation and Simulation. LNCS (2001), Springer-Verlag, Berlin 3-14
26. A. Agarwal, B. Triggs, Tracking articulated motion with piecewise learned dynamical models, in: European Conference on Computer Vision, vol. 3, Prague, 2004, pp. 54-65.
27. D. Ormoneit, H. Sidenbladh, M. Black, T. Hastie, Learning and tracking cyclic human motion, in: Advances in Neural Information Processing Systems 13, 2001, pp. 894-900.
28. Herda L., Urtasun R., and Fua P. Hierarchical implicit surface joint limits for human body tracking. Computer Vision and Image Understanding 99 2 (2005) 189-209
29. C. Sminchisescu, B. Triggs, Covariance scaled sampling for monocular 3D body tracking, in: Conference on Computer Vision and Pattern Recognition, vol. 1, Hawaii, 2001, pp. 447-454.
30. Murase H., and Sakay R. Moving object recongition in eigenspace representation: gait analysis and lip reading. Pattern Recognition Letters 17 (1996) 155-162
31. A. Rahimi, B. Recht, T. Darrell, Learning appearance manifolds from video, in: Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005, pp. 868-875.
32. C. Sminchisescu, A. Jepson, Generative Modeling for Continuous Non-Linearly Embedded Visual Inference, in: International Conference in Machine Learning, vol. 69, Banff, Alberta, Canada, 2004, pp. 96-103.
33. T. Tian, R. Li, S. Sclaroff, Articulated pose estimation in a learned smooth space of feasible solutions, in: CVPR Learning Workshop, vol. 3, San Diego, CA, 2005.
34. R. Urtasun, D.J. Fleet, A. Hertzman, P. Fua, Priors for people tracking from small training sets, in: International Conference on Computer Vision, Beijing, China, 2005, pp. 403-410.
35. M. Alexa, W. Mueller, Representing animations by principal components, in: Eurographics, vol. 19, 2000, pp. 411-418.
36. V. Blanz, C. Basso, T. Poggio, T. Vetter, Reanimating faces in images and video, in: Eurographics, vol. 22, Granada, Spain, 2003.
37. Brand M., and Hertzmann A. Style machines. Computer Graphics, SIGGRAPH Proceedings (2000) 183-192
38. Urtasun R., Glardon P., Boulic R., Thalmann D., and Fua P. Style-based motion synthesis. Computer Graphics Forum 23 4 (2004) 799-812
39. Y. Yacoob, M.J. Black, Parametric modeling and recognition of activities, in: International Conference on Computer Vision, Mumbai, India, 1998, pp. 120-127.
40. Troje N. Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. Journal of Vision 2 5 (2002) 371-387
41. Shoemake K. Animating rotation with quaternion curves. Computer Graphics, SIGGRAPH Proceedings 19 (1985) 245-254
42. CMU database, .
43. Tipping M., and Bishop C. Probabilistic principal component anlaysis. Journal of the Royal Statistical Society, B 61 3 (1999) 611-622
44. Press W., Flannery B., Teukolsky S., and Vetterling W. Numerical Recipes, the Art of Scientific Computing (1992), Cambridge University Press, Cambridge, MA
45. Plänkers R., and Fua P. Articulated soft objects for multi-view shape and motion capture. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 (2003) 1182-1187
46. J. MacCormick, M. Isard, Partitioned sampling, articulated objects, and interface-quality hand tracking, in: European Conference on Computer Vision, vol. 2, 2000, pp. 3-19.
47. R. Urtasun, D.J. Fleet, P. Fua, Monocular 3-d tracking of the golf swing, in: Conference on Computer Vision and Pattern Recognition, vol. 2, San Diego, CA, 2005, pp. 932-938.
48. Jepson A., Fleet D.J., and El-Maraghi T. Robust on-line appearance models for vision tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 10 (2003) 1296-1311
49. H. Sidenbladh, M. J. Black, L. Sigal, Implicit probabilistic models of human motion for synthesis and tracking, in: European Conference on Computer Vision, vol. 1, Copenhagen, Denmark, 2002, pp. 784-800.
50. A. Agarwal, B. Triggs, Learning to track 3D human motion from silhouettes, in: International Conference in Machine Learning, Banff, Alberta, Canada, 2004.
51. V. Lepetit, A. Shahrokni, P. Fua, Robust data association for online applications, in: Conference on Computer Vision and Pattern Recognition, vol. 1, Madison, WI, 2003, pp. 281-288.
52. R. Urtasun, P. Fua, 3D human body tracking using deterministic temporal motion models, in: European Conference on Computer Vision, vol. 3, Prague, Czech Republic, 2004, pp. 92-106.
53. R. Urtasun, P. Fua, Human motion models for characterization and recognition, in: Automated Face and Gesture Recognition, Seoul, Korea, 2004 pp. 17-22.